BioMed Research International

Volume 2014 (2014), Article ID 531389, 4 pages

http://dx.doi.org/10.1155/2014/531389

Research Article

Comparison of Semi-Automated and Manual Measurements of Carotid Intima-Media Thickening

Oscar Mac Ananey, Greg Mellotte, and Vincent Maher

Department of Cardiology, Tallaght Hospital, Dublin 24, Ireland

Received 24 April 2013; Accepted 28 October 2013; Published 21 January 2014

Academic Editor: Ali AbuRahma

Copyright © 2014 Oscar Mac Ananey et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Carotid intima-media thickening (CIMT) is a marker of both arteriosclerotic and atherosclerotic risks. Technological advances have semiautomated CIMT image acquisition and quantification. Studies comparing manual and automated methods have yielded conflicting results possibly due to plaque inclusion in measurements. Low atherosclerotic risk subjects were recruited to minimise the effect of focal atherosclerotic lesions on CIMT variability. CIMT was assessed by high-resolution B-mode ultrasound (Philips HDX7E, Phillips, UK) images of the common carotid artery using both manual and semiautomated methods (QLAB, Phillips, UK). Intraclass correlation coefficient (ICC) and the mean differences of paired measurements (Bland-Altman method) were used to compare both methodologies. The ICC of manual ( mm) and automated (0.524 ± 0.068 mm) methods was and an absolute mean bias ± SD of  mm was observed. Interobserver and intraobserver ICC were greater for automated ( and 0.99) compared to manual ( and 0.88) methods. Although not considered to be clinically significant, manual measurements yielded higher values compared to automated measurements. Automated measurements were more reproducible and showed lower interobserver variation compared to manual measurements. These results offer important considerations for large epidemiological studies.

1. Introduction

Vascular risk assessment has become integral to good clinical practice. Conventional risk factors which are derived from a patient’s family and smoking history, blood pressure, and measurement of blood glucose and lipid levels have been used successfully to derive a person’s future risk of developing atherosclerotic cardiovascular disease [1, 2]. Measurement of carotid intima-media thickness (CIMT), a marker of atherosclerosis risk, can improve individual risk assessment and quantify pathology and/or drug therapy efficacy [3, 4]. Because it is noninvasive, easy to perform, and highly repeatable, a number of epidemiological studies have adopted CIMT as a surrogate marker of cardiovascular risk [5–7]. Technological advances over the past number of years have improved image acquisition and measurement methods [8]. In tandem with these new methodologies, a number of studies have emerged comparing older manual and newer automated/semiautomated methods [8–12]. However, in some of these previous studies the statistical methods may have been unsuitable or the cohort may have been biased. Our aim was to compare manual and semiautomated methods of measuring CIMT in healthy male and female subjects with very low cardiovascular risk. The rationale for the low risk subjects was to minimise the potential influence of plaque on CIMT measurements. In addition, we examined the intraobserver and interobserver variation of each method.

2. Material and Methods

One hundred and twenty-six (68 male and 58 female) subjects were recruited from the general population. The study was approved by Trinity College Dublin Ethics Committee. Written informed consent was obtained from all subjects prior to testing protocols. Subjects were included if they were lifelong never-smokers, free from cardiovascular disease, and normotensive (<140/90 mmHg), had normal lipid profile (LDLc < 4.0 mmol/L), normal fasting glucose (fasting glucose < 6.2 mmol/L), and moderate alcohol intake (male < 21 units per week; female < 14 units per week). Subjects were excluded if they were receiving treatment for or had a history of hypertension, hyperlipidaemia, and diabetes or were taking any medications that affected haemodynamic and/or metabolic responses.

Subjects attended the Cardiovascular Research Unit at Tallaght Hospital. Various anthropometrical measurements were recorded, including height (Seca 202, SECA, UK), weight (Avery E101, Avery, UK), and waist/hip circumference (Creative Health Products, USA).

High-resolution B-mode ultrasound images of the right and left common carotid artery were used to measure carotid intima-media thickness. Patients were scanned in the supine position using 7–12 MHz linear array transducer (Philips HDX7E, Phillips, UK).

CIMT was calculated using both manual (Manual) and semiautomated (Automated; QLAB, Phillips, UK) methods. Manual CIMT measurements were recorded from the far wall at 1 cm, 1.5 cm, and 2 cm intervals proximal to the carotid bulb [13]. Automated measurements were also recorded from the far wall, using the same image, from the identical 1 cm section proximal to the carotid bulb. The carotid bulb was defined as the point where the far wall deviated from the parallel plane of the distal CCA. Mean manual and automated CIMT measurements for the right and left CCA were calculated from three consecutive cardiac cycles [14].

Pearson product-moment correlation coefficient and the intraclass correlation coefficient (ICC) were used to examine the relationship between manual and automated methods [15]. The associations of the differences of the mean of the paired measurements (Bland-Altman method) were used to examine absolute differences between the two methods (MedCalc, Belgium).

The technical error of measurement (TEM) and ICC of ten randomly selected subjects were used to identify intraobserver reproducibility and interobserver reliability of the two methods [15, 16].

An unpaired -test was used to compare gender differences (MedCalc, Belgium). Values are reported as mean ± SD unless otherwise stated.

3. Results

Subject characteristics and cardiovascular risk factors are outlined in Table 1. There were 65 male and 54 female subjects with a mean age of 40.5 years. No differences in age, diastolic blood pressure, total cholesterol, and LDLc were observed between genders. However, BMI, systolic blood pressure, triglyceride, and glucose were higher and HDLc was lower in males compared to females ().

Table 1: Subject characteristics and cardiovascular risk factors.

Subject characteristics and cardiovascular risk factors

(Male ; female )

Age (years)

BMI (kg·m²)

SBP (mmHg)

DBP (mmHg)

Total cholesterol (mmol·L⁻¹)

Triglyceride (mmol·L⁻¹)

LDLc (mmol·L⁻¹)

HDLc (mmol·L⁻¹)

Fasting glucose (mmol·L⁻¹)

Body mass index (BMI), systolic blood pressure (SBP), diastolic blood pressure (DBP), low-density lipoprotein cholesterol (LDLc), and high-density lipoprotein cholesterol (HDLc). Values are mean ± SD.

Pearson correlation demonstrated strong association (; ) between manual (mean ± SD;  mm) and automated (mean ± SD;  mm) methods; however, the same association was not observed with ICC ().

Evaluation of the differences of paired means (Bland-Altman method) identified an absolute mean bias and SD of − mm between manual and automated CIMT measurements with limits of agreement of 0.078 to −0.125 mm (Figure 1).

Figure 1: Bland-Altman plot of the absolute mean differences of automated and manual CIMT measurements with a mean bias and SD of − mm and limits of agreement of 0.078 to −0.125 mm.

The TEM, quantifying the interobserver reproducibility and intraobserver variability, was lower for automated (3.71% and 1.52%) compared to manual (8.11% and 6.30%) methods. As a consequence, the interobserver and intraobserver ICC was greater for automated ( and 0.99) compared to manual ( and  0.88) methods.

4. Discussion

This study highlights that manual measurements yield higher values compared to automated measurements even in subjects with very low atherosclerotic risk. The mean differences of both methods were not clinically significant and no systematic errors were observed. In the absence of a gold standard measurement such as using a phantom, it is unclear which method best approximates real values.

The results also demonstrate that automated CIMT calculations are more reproducible and show lower interobserver variation compared to manual calculations. These results offer important considerations where patients may be scanned by different technicians and where the accumulation of small variations may impact results, especially in large scale epidemiological studies.

In the present study, Pearson product-moment correlation coefficient demonstrated a strong association between both methods; however, a strong ICC was not observed () [17]. Pearson product-moment correlation coefficient is not considered to be a robust determination of association whereas ICC represents perfect agreement [16]. This was further emphasised by the mean bias of the Bland-Altman plot where manual measurements yielded greater, although not clinically significant, values compared to automated measurements.

Previous studies report no differences between automated versus manual CIMT methodologies whereas other studies report significantly greater values using manual techniques [9, 10, 12].

Seçil et al. [12] reported significantly greater values for manual CIMT calculations compared to automated calculations. The authors reported that manual measurements were significantly higher (1.3–8.7%) compared to automated measurements. In the same study the authors also reported higher interobserver correlation coefficients for automated methods compared to manual methods.

Freire et al. [9] reported no differences between automated and manual CIMT calculations; however automated methods provided lower interobserver and intraobserver variation coefficients. Puchner et al. [10] reported significant correlation (; ) between automated and manual methodologies with no observable systematic bias in the mean differences (mean difference  mm). The authors also reported lower interobserver and intraobserver variation coefficients for automated methods (6.6% and 5.6%) compared to manual methods (14.1% and 11.1%). More recently, Yanase et al. [11] reported similar values for manual and automated methods; yet automated calculations had lower standard deviations and variation coefficients indicating better reproducibility. Furthermore, automated methods were better correlated with Framingham and Prospective Cardiovascular Munster study (PROCAM) risk scores.

For the present study, in order to minimise potential measurement inconsistencies caused by abnormal CIMT, focal thickening, or the presence of atheromatous lesions, only subjects with very low cardiovascular risk were recruited. In addition, manual CIMT measurements were averaged from three anatomic sites, over several cardiac cycles from both left and right sides. Despite these precautions, it is possible that outliers may have caused an overestimation of manual CIMT [18]. For automated methods, several hundred measurements are recorded, and so, averaged values would be less susceptible to individual outlier errors [18].

This study does not examine serial changes in CIMT over given time intervals. Such measurements are used in clinical practice as surrogate markers of vascular risk [19]. Larger increments in CIMT are more associated with greater risk of vascular events [20]. However, it is also important to make a clear distinction between changes in CIMT and progression of atheromatous plaque. As atherosclerosis has focal changes more so than uniform changes, variation in CIMT at different segments or changes in maximal CIMT may better represent progression of atherosclerotic disease [18]. Changes in vascular wall properties, characterised by CIMT, represent different disease processes. Standardised definitions of focal plaque structures such as luminal encroachment of 50% or >0.5 mm should be adopted to help differentiate the two distinct diseases processes [18].

Most large scale epidemiological studies have adopted manual methodologies to quantify CIMT with only one study using semiautomated edge detection software [6, 21–23]. Based on the results of our study, it is fair to suggest that future studies, particularly interventional and longitudinal studies, should consider adopting automated CIMT methodologies.

5. Conclusion

In conclusion, semiautomated measurements of CIMT yield significantly lower values compared to manual measurements and produce lower intraobserver and interobserver variation. Although the differences between manual and automated methods are small and may not be clinically significant, these observations offer important considerations for large epidemiological or longitudinal studies.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgment

The authors would also like to acknowledge the Meath Foundation as without their support this study would not have been possible.

References

L. J. Laslett, P. Alagona Jr., B. A. Clark III, et al., “The worldwide environment of cardiovascular disease: prevalence, diagnosis, therapy, and policy issues: a report from the American College of Cardiology,” Journal of the American College of Cardiology, vol. 60, no. 28, supplement, pp. S1–S49, 2012.

M. Chiu, P. C. Austin, D. G. Manuel, and J. V. Tu, “Comparison of cardiovascular risk profiles among ethnic groups using population health surveys between 1996 and 2007,” Canadian Medical Association Journal, vol. 182, no. 8, pp. E301–E310, 2010.

H. M. Den Ruijter, S. A. Peters, T. J. Anderson, et al., “Common carotid intima-media thickness measurements in cardiovascular risk prediction: a meta-analysis,” The Journal of the American Medical Association, vol. 308, no. 8, pp. 796–803, 2012.

E. de Groot, S. I. van Leuven, R. Duivenvoorden et al., “Measurement of carotid intima-media thickness to assess progression and regression of atherosclerosis,” Nature Clinical Practice Cardiovascular Medicine, vol. 5, no. 5, pp. 280–288, 2008.

A. Hofman, C. M. van Duijn, O. H. Franco et al., “The Rotterdam Study: 2012 objectives and design update,” European Journal of Epidemiology, vol. 26, no. 8, pp. 657–686, 2011.

S. Mora, M. Szklo, J. D. Otvos et al., “LDL particle subclasses, LDL particle size, and carotid atherosclerosis in the Multi-Ethnic Study of Atherosclerosis (MESA),” Atherosclerosis, vol. 192, no. 1, pp. 211–217, 2007.

R. Li, B. B. Duncan, P. A. Metcalf et al., “B-mode-detected carotid artery plaque in a general population,” Stroke, vol. 25, no. 12, pp. 2377–2383, 1994.

F. Molinari, G. Zeng, and J. S. Suri, “A state of the art review on intima-media thickness (IMT) measurement and wall segmentation techniques for carotid ultrasound,” Computer Methods and Programs in Biomedicine, vol. 100, no. 3, pp. 201–221, 2010.

V. Freire, A. Ribeiro, F. Barbosa et al., “Comparison between automated and manual measurements of carotid intima-media thickness in clinical practice,” Vascular Health and Risk Management, vol. 5, pp. 811–817, 2009.

S. Puchner, M. Reiter, C. Baros, E. Minar, J. Lammer, and R. A. Bucek, “Assessment of intima-media thickness of carotid arteries: evaluation of an automated computer software,” Neuroradiology, vol. 50, no. 10, pp. 849–853, 2008.

T. Yanase, S. Nasu, Y. Mukuta et al., “Evaluation of a new carotid intima-media thickness measurement by B-Mode ultrasonography using an innovative measurement software, intimascope,” American Journal of Hypertension, vol. 19, no. 12, pp. 1206–1212, 2006.

M. Seçil, C. Altay, A. Gülcü, H. Ceçe, A. Y. Göktay, and O. Dicle, “Automated measurement of intima-media thickness of carotid arteries in ultrasonography by computer software,” Diagnostic and Interventional Radiology, vol. 11, no. 2, pp. 105–108, 2005.

A. D. Gepner, J. G. Keevil, R. A. Wyman et al., “Use of carotid intima-media thickness and vascular age to modify cardiovascular risk prediction,” Journal of the American Society of Echocardiography, vol. 19, no. 9, pp. 1170–1174, 2006.

R. R. Rodriguez, R. A. Gómez-Díaz, J. T. Haj, et al., “Carotid intima-media thickness in pediatric type 1 diabetic patients,” Diabetes Care, vol. 30, no. 10, pp. 2599–2602, 2007.

G. Vicente-Rodríguez, J. P. Rey-López, M. I. Mesana, et al., “Reliability and intermethod agreement for body fat assessment among two field and two laboratory methods in adolescents,” Obesity, vol. 20, no. 1, pp. 221–228, 2012.

J. M. Bland and D. G. Altman, “A note on the use of the intraclass correlation coefficient in the evaluation of agreement between two methods of measurement,” Computers in Biology and Medicine, vol. 20, no. 5, pp. 337–340, 1990.

L. G. Portney and M. P. Watkins, Foundations of Clinical Research Applications to Practice, Pearson, 3th edition, 2008.

P.-J. Touboul, M. G. Hennerici, S. Meairs et al., “Mannheim carotid intima-media thickness consensus (2004-2006): an update on behalf of the advisory board of the 3rd and 4th Watching the Risk Symposium 13th and 15th European Stroke Conferences, Mannheim, Germany, 2004, and Brussels, Belgium, 2006,” Cerebrovascular Diseases, vol. 23, no. 1, pp. 75–80, 2007.

Z. D. Goldberger, J. A. Valle, V. K. Dandekar, P. S. Chan, D. T. Ko, and B. K. Nallamothu, “Are changes in carotid intima-media thickness related to risk of nonfatal myocardial infarction? A critical review and meta-regression analysis,” American Heart Journal, vol. 160, no. 4, pp. 701–714, 2010.

S. Latika, S. C. Agarwal, and D. Philip, “Carotid intima-media thickness as a surrogate marker of cardiovascular disease in diabetes,” Diabetes, Metabolic Syndrome and Obesity, vol. 2011, article 4, pp. 23–24, 2011.

V. Nambi, L. Chambless, A. R. Folsom et al., “Carotid intima-media thickness and presence or absence of plaque improves prediction of coronary heart disease risk: the ARIC (Atherosclerosis Risk In Communities) study,” Journal of the American College of Cardiology, vol. 55, no. 15, pp. 1600–1607, 2010.

M. W. Lorenz, S. von Kegler, H. Steinmetz, H. S. Markus, and M. Sitzer, “Carotid intima-media thickening indicates a higher vascular risk across a wide age range: prospective data from the carotid atherosclerosis progression study (CAPS),” Stroke, vol. 37, no. 1, pp. 87–92, 2006.

I. Wendelhag, T. Gustavsson, M. Suurküla, G. Berglund, and J. Wikstrand, “Ultrasound measurement of wall thickness in the carotid artery: fundamental principles and description of a computerized analysing system,” Clinical Physiology, vol. 11, no. 6, pp. 565–577, 1991.