PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of cardiabBioMed CentralBiomed Central Web Sitesearchsubmit a manuscriptregisterthis articleCardiovascular DiabetologyJournal Front Page
 
Cardiovasc Diabetol. 2012; 11: 128.
Published online Oct 13, 2012. doi:  10.1186/1475-2840-11-128
PMCID: PMC3489601
A confirmatory factor analysis of the metabolic syndrome in adolescents: an examination of sex and racial/ethnic differences
Matthew J Gurka,corresponding author1 Christa L Ice,1 Shumei S Sun,2 and Mark D DeBoer3
1Department of Biostatistics, School of Public Health, West Virginia University, Morgantown, West Virginia, USA
2Department of Biostatistics, School of Medicine, Virginia Commonwealth University, Richmond, Virginia, USA
3Department of Pediatrics, School of Medicine, University of Virginia, Charlottesville, Virginia, USA
corresponding authorCorresponding author.
Matthew J Gurka: mgurka/at/hsc.wvu.edu; Christa L Ice: cice/at/hsc.wvu.edu; Shumei S Sun: ssun/at/vcu.edu; Mark D DeBoer: MDD5Z/at/hscmail.mcc.virginia.edu
Received September 3, 2012; Accepted October 10, 2012.
Objective
The metabolic syndrome (MetS) is a cluster of clinical indices that signals increased risk for cardiovascular disease and Type 2 diabetes. The diagnosis of MetS is typically based on cut-off points for various components, e.g. waist circumference and blood pressure. Because current MetS criteria result in racial/ethnic discrepancies, our goal was to use confirmatory factor analysis to delineate differential contributions to MetS by sub-group.
Research Design and Methods
Using 1999–2010 data from the National Health and Nutrition Examination Survey (NHANES), we performed a confirmatory factor analysis of a single MetS factor that allowed differential loadings across sex and race/ethnicity, resulting in a continuous MetS risk score that is sex and race/ethnicity-specific.
Results
Loadings to the MetS score differed by racial/ethnic and gender subgroup with respect to triglycerides and HDL-cholesterol. ROC-curve analysis revealed high area-under-the-curve concordance with MetS by traditional criteria (0.96), and with elevations in MetS-associated risk markers, including high-sensitivity C-reactive protein (0.71), uric acid (0.75) and fasting insulin (0.82). Using a cut off for this score derived from ROC-curve analysis, the MetS risk score exhibited increased sensitivity for predicting elevations in ≥2 of these risk markers as compared with traditional pediatric MetS criteria.
Conclusions
The equations from this sex- and race/ethnicity-specific analysis provide a clinically-accessible and interpretable continuous measure of MetS that can be used to identify children at higher risk for developing adult diseases related to MetS, who could then be targeted for intervention. These equations also provide a powerful new outcome for use in childhood obesity and MetS research.
Keywords: Metabolic syndrome, Factor analysis, Statistical, Insulin resistance, Pediatrics, Adolescents, Epidemiology, Clinical studies, Obesity, Risk factors
The metabolic syndrome (MetS) is a cluster of interrelated individual factors that increase risk for future Type 2 diabetes mellitus (T2DM) and cardiovascular disease (CVD) [1,2]. These individual components of MetS include elevations in adiposity, triglycerides, blood pressure (BP) and fasting glucose, and low levels of high-density lipoprotein (HDL) particles (a surrogate for which is HDL cholesterol) [3]. While the pathophysiologic processes that drive abnormalities in these individual components are not fully understood, these underlying processes appear to be related to systemic insulin resistance [3]. In an attempt to understand the existence of MetS and the contributions of clinical measures of its components more fully, numerous researchers have used factor analysis, a model that explains the correlation among a set of variables in terms of a smaller set of unobserved “factors” [4-6]. A previous review highlighted the motivations and the pitfalls of the use of various forms of factor analysis for this purpose [4]. Namely, the majority of studies have been exploratory, have not fully evaluated the appropriateness of a linear factor model in exploring MetS, and have not taken great care in the factor analysis itself, for example including in the model(s) highly correlated variables such as systolic blood pressure (SBP) and diastolic blood pressure simultaneously.
For most sets of MetS criteria—including the Adult Treatment Panel III (ATP-III)—MetS is classified based on cut-off values for each of the individual components [3,7-9]. A given person is classified as having MetS in the presence of three or more abnormalities in these components. When applied to populations, the ATP-III MetS criteria for adults [3]—or an adolescent adaptation of these criteria [7]—predict elevations in measures of obesity-related inflammation (such as serum levels of high-sensitivity C-reactive protein, hsCRP [10]), oxidative stress (such as uric acid [11,12]) and insulin resistance (often assessed in epidemiological studies as fasting insulin [13-15]). In a prospective manner, a classification of MetS can be tracked over time [16] and predicts future T2DM in adolescents [8] and future CVD [2,17] and T2DM [18] in adults. As such, the presence of MetS in this era of pediatric obesity [19] has been proposed as a trigger for increased intervention [9,20].
Nevertheless, controversy exists over which of a variety of sets of MetS criteria to use among adolescents (Additional file 1: Table S1) [7,9,21-24], and evidence suggests that current criteria exhibit racial/ethnic and gender differences in the ability of MetS criteria to identify increased risk [25]. Non-Hispanic-black individuals have lower rates of MetS [26,27] despite having higher rates T2DM and death from CVD [28]. Currently-used criteria for MetS exhibit a lower sensitivity to detect insulin resistance [14], underlying inflammation [29] and oxidative stress (as assessed by levels of uric acid) [30] among non-Hispanic-black adolescents compared to non-Hispanic whites or Hispanics. A major reason for this is that in non-Hispanic-black adolescents triglyceride levels are lower and HDL levels are higher (i.e., more favorable) at baseline, and although these levels continue to worsen with progressive insulin resistance, they are overall less likely to exceed population cut-offs required for MetS diagnosis [27,31,32].
Because of these drawbacks of current MetS criteria, many have advocated for using a continuous scale for MetS diagnosis [33,34] or for criteria that are race/ethnicity-specific [27,31,32] Eisenmann provides an overview of multiple proposed continuous pediatric MetS scores, the majority of which use a sum of z-scores of individual MetS components [33]. While these z-scores can be calculated to account for age, sex and race/ethnicity, the method of standardizing components (e.g., waist circumference (WC), blood pressure) and summing the resulting z-scores to formulate a MetS score does not account for the strong correlations that occur across the components themselves and does not account for possible differential influences of individual components on the overall score [33]. To better account for these drawbacks, Li and Ford performed a confirmatory factor analysis on adolescents to assess the validity of one factor in explaining the covariance across the traditional MetS components; however, they did not detect hypothesized differences by sex and race/ethnicity, potentially due to being inadequately powered [5]. Others have performed such an analysis in ethnically homogeneous populations [6,35].
Our study had two primary goals. Our first goal was to perform a multi-group confirmatory factor analysis that assumed a one-factor model of the traditional MetS components while allowing for differences across sex and race/ethnicity [5]. Thus, we are testing our hypothesis that the factor structure is the same across all sex and race/ethnicity groups, but that the manner in which these MetS components correlate with this factor differs across the groups in a meaningful way. Second, if we found differences in these correlations utilizing this one-factor model, we would utilize the factor score from this model among adolescents as a continuous MetS “risk score” that was sex- and race/ethnicity specific. The ability of this risk score to detect elevations in surrogate factors related to processes underlying MetS, including hsCRP, uric acid and fasting insulin, could then be assessed on a race/ethnicity-specific basis. The data for this study were from the past twelve complete years released from NHANES (1999–2010), and thus would provide substantially more power than prior attempts to detect sex and racial/ethnic differences if they exist and would provide a subsequent reliable set of equations from which to base a continuous score. Our hypothesis was that such a race/ethnicity and sex-specific score, if determined necessary by the confirmatory factor analysis, would perform better than traditional MetS criteria at predicting surrogate factors related to MetS.
Data were obtained from NHANES (1999–2010), a complex, multistage probability sample of the US population [7]. These annual cross-sectional surveys are conducted by the National Center for Health Statistics (NCHS) of the Centers for Disease Control (CDC), with randomly-selected subjects undergoing anthropometric and blood pressure measurements, answering questionnaires and undergoing phlebotomy. The NCHS ethics review board reviewed and approved the survey and participants gave informed consent prior to participation. Body mass index (BMI), SBP, and laboratory measures of triglycerides, HDL-C, and fasting glucose were obtained using standardized protocols and calibrated equipment [7]. For SBP, the mean of up to four readings taken on each individual was used. All blood samples used for analyses were obtained following a fast ≥8 hours prior to the blood draw.
Data from non-Hispanic-white, non-Hispanic-black, or Hispanic (Mexican-American/other Hispanic) adolescents 12–19 years old were analyzed. Children <12 years old were excluded since fasting values for triglycerides and glucose were only obtained in participants ≥12 years old. Subjects were excluded if they had known diabetes or unknown diabetes (fasting plasma glucose >125 mg/dL), as each of these limit insulin release [36]. Pregnant women were also excluded, as well as individuals taking antihyperlipidemic or anti-diabetic medications as these are all likely to alter lipid and insulin levels.
We combined all data sets from the 6 two-year cycles (1999–2010) for statistical analyses to increase our total sample size. Prevalence rates of MetS were calculated by sex and race/ethnicity, according to Ford’s pediatric adaptation of the ATP III adult criteria [7], and mean levels (95% CI’s) of the MetS components of interest (BMI z-score, SBP, HDL, triglycerides, and glucose) as well as the surrogate outcomes (hsCRP, uric acid, fasting insulin) were calculated by sex and race/ethnicity.
A series of confirmatory factor analyses (CFA) were then performed on the five identified MetS components: BMI z-score, SBP, HDL, triglycerides, and glucose. Numerous definitions of MetS have been proposed with various components that comprise it [3,7-9,21-24,37-39]. We selected these five components exclusively because of their inclusion in the most prominently used MetS criteria (Additional file 1: Table S1) and due to their clinical accessibility. We chose to use BMI-z-score instead of WC because BMI-z-scores can be standardized by age and sex using established CDC programs [40]. Unfortunately, while cut-off values exist to identify elevations in WC by age in adolescents [7,9], there is a lack of precise percentiles to permit such standardization of WC values in adolescents. In addition, WC as a clinical measure is prone to substantial measurement error [41] and is not consistently used in clinical care, while BMI z-scores are readily available and are the predominant tool recommended for adiposity assessment in clinical practice [42]. With such a factor analysis, both SBP and DBP should not be included together [4], and we chose SBP given it is more strongly associated with insulin resistance [5] and other outcomes [43]. Triglycerides were log-transformed, and all variables were standardized (mean=0, SD=1) over the entire sample. The inverse of HDL was used when standardizing, so a higher factor loading score would be similar in interpretation to the other measures in the model. The variables were not standardized within groups to allow for potential overall higher standardized scores within sex- and race/ethnic-specific groups. A one-factor model formed the basis of all of the CFA’s performed; measurement errors between the five components were assumed not to be correlated. The factor loadings were of interest, indicating the magnitude of association between each component and the underlying “MetS” factor. Factor loadings >0.3 were considered clinically meaningful. Using PROC CALIS in SAS, the parameters of the CFA’s were estimated via maximum likelihood. Two multi-group one-factor CFA’s were fit:
1) Model 1: constrained the factor loadings to be equal across the six combinations of sex and race/ethnicity;
2) Model 2: allowed the factor loadings to vary across the six groups.
Chi-square tests of the equality of the factor loadings across the six groups in Model 2 were performed. The two models were compared using various fit statistics, both overall and by group. Chi-square and Akaike’s Information Criteria (AIC) were used for model comparisons; smaller chi-square and AIC values indicated a better fit. A chi-square difference test was calculated; a significant difference between two nested models implies that the model with more paths explains the data better [44]. Other goodness of fit indices included the Root Mean Square Error of Approximation (RMSEA; >0.06 poor fit), the Standardized Root Mean Square Residual (SRMR; >0.08 poor fit), the Goodness of Fit Index (GFI; <0.90 poor fit), and the Bentler-Bonett Normed Fit Index (NFI; <0.90 poor fit) [45].
The standardized factor coefficients from the better-fitting model were used to calculate the MetS factor score on each individual. This score can be interpreted as a Z-score (mean 0, SD=1), with higher scores representing an increased risk of MetS. Receiver operating characteristic (ROC) analysis was used to assess the ability of this new score to discriminate against the traditional MetS criteria [7] as well as elevated levels of the three identified CVD/T2DM surrogates. Specifically, we were interested in the ability to predict elevated fasting insulin (>16 IU/mL, the 95th percentile among normal-weight adolescents [14]), elevated hsCRP (>4.5 mg/L [29]), and elevated uric acid (approximately the 95th percentile among lean individuals: 7.0 mg/dL for males, 5.5 mg/dL for females [30]). In this analysis, individuals with CRP >10.0 mg/L were excluded. In addition, the ability to predict 1 and ≥2 elevations amongst these surrogates was of interest, as this indicates the more at-risk adolescents. Overall predictive performance was measured by the area under the curve (AUC) of the ROC curve, with 0.5 and 1.0 indicating no and perfect predictive ability, respectively. We considered AUC values >0.70 to be reasonably accurate and AUC >0.90 to be very accurate. Sensitivities and specificities to predict ≥2 elevations among the three surrogates were compared between the traditional MetS classification and a definition of MetS using a cutoff identified by the ROC analysis; these statistics were done on a sex and race/ethnicity-specific basis.
Statistical significance was defined as a p-value<0.05. Statistical analysis was performed using SAS (version 9.3, Cary, NC). Descriptive statistics as well as sensitivity estimates used SAS survey procedures (SURVEYMEANS, SURVEYFREQ), which accounts for the survey design when estimating standard errors to obtain population-based estimates. The CFA itself did not account for the survey design due to the inability of standard software to perform multigroup CFA’s within subpopulations while accounting for the survey design.
Of the 4,413 participants eligible per the criteria described above, 239 (5.4%) were missing at least one of the MetS components and were not included in the analysis. The sample of participants thus consisted of 4,174 male and female non-Hispanic blacks, non-Hispanic whites, and Hispanics age 12–19 years old with complete data for MetS components (Table (Table1).1). The overall prevalence of MetS in these adolescents was 8.1% according to Ford’s pediatric adaptation of the ATP-III criteria [7]. Among US adolescent males and females, the prevalence of ATP-III-based MetS was considerably lower among non-Hispanic-blacks. Males were generally more likely to have MetS across racial/ethnic group.
Table 1
Table 1
NHANES 1999–2010 Characteristics: Children 12–19 Years Old with Data on all Metabolic Syndrome Components (n = 4,174)
Comparison of overall chi-square test values between the two CFA models indicate that Model 2 provides the significantly better fit relative to the other two (Δχ2 (50)=253.28, p<0.001); this is confirmed when comparing the Akaike’s Information Criteria (AIC) between the two overall models. The other fit statistics, presented in Table Table2,2, indicate that while a one-factor model of the traditional MetS components is not necessarily an excellent fit, allowing the loadings to vary by sex and race/ethnicity in such a one-factor representation of MetS (Model 2) provided a better fit. When examining MetS on a sex and racial/ethnic specific basis via Model 2; a one-factor model of MetS using traditional measures fit all groups well, except for non-Hispanic-white females. Tests of the equality of the loadings across groups in Model 2 were significant for HDL, SBP and triglycerides (Table (Table2).2). Examination of the loadings in Model 2 indicate that overall glucose is not correlated with a single MetS factor for any subgroup (all loadings <0.30); we chose to keep it in the model given its prominence in established MetS criteria. SBP is more correlated with a single MetS factor for non-Hispanic-white males; HDL is less correlated with a single MetS factor for non-Hispanic-white females. Triglycerides are less correlated for females than for males, particularly for non-Hispanic-white and non-Hispanic-black adolescents.
Table 2
Table 2
Confirmatory Factor Analysis Results*
Equations based on the factor coefficients from Model 2 are presented in Table Table3,3, and can be used to calculate what is called a MetS risk score based on the clinically-used components of MetS. For ease of clinical use, these equations are based on the actual values of the variables (except for BMI), and not the standardized measures that went into the factor analysis. ROC analysis of this resulting risk score indicates that is has excellent ability to predict a traditional MetS classification (AUC=0.96; Figure Figure1).1). It exhibits a moderate ability to discriminate against elevated surrogate outcomes (hsCRP, uric acid, fasting insulin), with AUC values equal to 0.71, 0.75, and 0.82, respectively (Figure (Figure1).1). However, it has near excellent ability to predict those individuals with ≥2 elevations among the three surrogates (AUC=0.87). Most importantly, the predictive ability assessed here did not systematically differ by sex or race/ethnicity (AUC values ranged between 0.81 and 0.92 across the six groups; not shown).
Table 3
Table 3
Equations for New Sex and Race/Ethnic-Specific Childhood Metabolic Syndrome Risk Z-Score
Figure 1
Figure 1
ROC Curves for New Sex and Race/Ethnic-Specific Childhood Metabolic Syndrome Risk Score. ROC curves and area under the curve (AUC) for childhood MetS Risk Score for non-Hispanic white, non-Hispanic black and Hispanic adolescent participants of NHANES (more ...)
From this ROC analysis of ≥2 predictors, a reasonable cut-off of this new continuous score appeared to be around 0.75, if one wished to maintain a traditional MetS binary classification (overall sensitivity=66%; specificity=87%). While using a cutoff is not necessarily advocated here, defining adolescents with a score >0.75 as having “MetS” allowed for a direct comparison of sensitivity values with the traditional MetS criteria in predicting the most severe adolescents, those with ≥2 elevations among hsCRP, uric acid and insulin. When using 0.75, the percent with this new “MetS” is increased considerably compared to the traditional MetS classification across all groups (Figure (Figure2A).2A). While racial/ethnic differences in prevalences remain when using this particular cutoff, particularly for males, the racial/ethnic differences in the ability of a MetS diagnosis to be sensitive and specific to elevated surrogate levels has diminished considerably. As seen elsewhere [14,29,30], the traditional MetS classification has an overall poor sensitivity, and this sensitivity varies by sex and race/ethnicity (Figure (Figure2B).2B). This traditional classification is particularly insensitive for non-Hispanic-black adolescents. However, a new MetS classification using a cutoff of 0.75 is more sensitive, both overall and across sex and race/ethnicity, with no respective clinically meaningful decrease in specificity (Figure (Figure2C).2C).
Figure 2
Figure 2
Comparison of “Traditional” vs. “New” MetS. A: Prevalence of MetS among adolescents from NHANES 1999–2010 based on a common pediatric adaptation of ATP-III MetS as compared to “New” MetS based on (more ...)
The present analysis reveals racial/ethnic and sex differences among adolescents in loading weights to MetS that result in improvements in the ability of MetS to predict elevations in MetS-associated risk markers. While the value of a diagnosis of MetS has been questioned as being more valuable than the sum of its parts [46], the concept of MetS remains a frequently-used research tool that has validity in being able to predict future occurrence of T2DM in children [8] and CVD in adults [17]. Most currently-employed criteria for diagnosing MetS in children and adolescents utilize somewhat arbitrarily-determined cut-off values for individual components (Table (Table1)1) that appear to have racial/ethnic biases [25,31] while other sets of criteria have used a sum of z-scores, which does not account for the strong correlations across the components and does not account for possible differential influences of individual components on the overall score [33]. Our current approach offers multiple improvements on these prior approaches by using a confirmatory factor analysis, allowing for sex and racial/ethnic differences in the weighting of individual components to the risk score. Restated, this allows for the possibility that MetS manifests itself differently between sex and racial/ethnic groups in a way that may affect our ability to identify MetS-associated risks. The sex- and race/ethnicity-specific differences result in unique equations to calculate the risk score based on sex and racial/ethnic group. Once this score has been more fully validated it could be placed on an internet web site or smart phone application to assist in clinical use, alerting clinicians and patients regarding an adolescent’s risk score—along with any risk implications specific to that individual’s sex and racial/ethnic group.
In evaluating race/ethnicity-specific differences in this score, we noted in particular variations in contributions of lipid measures by sex and race/ethnicity to the single MetS factor. This is perhaps not surprising, given that non-Hispanic-black adolescents have lower levels of triglycerides and higher levels of HDL at baseline and although they exhibit worsening dyslipidemia with insulin resistance, they are less likely to exhibit gross abnormalities in lipids when using population-based cut-off values [25,27]. This results in a lower prevalence of MetS among non-Hispanic-black males using traditional criteria and a poorer sensitivity for MetS to detect elevations in surrogates of MetS-related processes [14,29,30]. In the current analysis (Table (Table3),3), we noted that as compared to the factor loadings for non-Hispanic-white males, non-Hispanic-blacks had a higher loading of HDL (0.51 non-Hispanic whites vs. 0.66 non-Hispanic blacks) but a lower loading of triglycerides (0.62 vs. 0.50). This would suggest that lower levels of HDL may be even more indicative of worsening MetS severity in non-Hispanic-black males compared to non-Hispanic whites while higher levels of triglycerides may not be as strong an indicator in non-Hispanic-black males. Hispanic males exhibited high loading factors of both HDL and triglycerides, potentially suggesting that worsening levels of both components are important indicators of increasing degree of MetS severity. Non-Hispanic-white males had high loadings for SBP (0.50) compared to non-Hispanic blacks (0.33) and Hispanics (0.30). This is interesting given that while elevated SBP is more common in non-Hispanic blacks and less common in Hispanics compared to non-Hispanic whites [14], SBP appears to have a greater relative importance to MetS in non-Hispanic whites compared to the other groups.
Non-Hispanic-white females exhibited lower factor loadings of HDL and triglycerides relative to either of the other racial/ethnic groups, while Hispanic females exhibited the highest loadings for HDL and triglycerides. These data again suggest that changes in these lipid values are more likely to indicate worsening of underlying MetS among Hispanics. Overall, the poor model fit indices for non-Hispanic-white females in particular, may indicate that a one-factor model of MetS may not be appropriate for this group.
It was notable that fasting glucose had a low factor loading for all sex and racial/ethnic groups. While others have included insulin in some manner as a measure in factor analyses [5,33], we chose to use glucose because the lack of standardized assays for insulin would impede use of the risk score for clinical purposes. It has been noted previously that glucose is maintained in a relatively narrow range among obese children [39], and this range was narrowed further in our analysis by excluding diabetic individuals (glucose>125 mg/dL). We ultimately elected to retain glucose in the score because of the near universality of its inclusion in prior MetS criteria [3,7-9,21-24] and its common use in screening for undiagnosed diabetes [47].
Most telling of the accuracy of this new score would be in its ability to predict future disease risk. The optimal testing for such risk would require long-term data including childhood factors and adult disease outcomes. Lacking these, such a score could also be used to assess the quantity of markers associated with processes associated with MetS-related risk, including adiponectin (which appears to be in the causative pathway of insulin resistance [20,48]) or markers of atherogenic dyslipidemia, including ApoB, small, dense LDL particles [49]. In the present analysis, we instead assessed the accuracy of the new score for its ability to identify individuals with elevations in clinical measures that are part of processes related to MetS. These measures were serum levels of fasting insulin (as an assessment of insulin resistance [13]), hsCRP (as an assessment of underlying inflammation [10]) and uric acid (as an assessment of oxidative stress [11,12]). Comparing the score’s performance in predicting these elevations to the more traditional MetS diagnosis required using a cutoff value for the MetS risk score itself—even though one of the benefits of such a score is its lack of binary nature. We chose a cutoff of a z-score of 0.75 based on the ROC curve for the score to identify individuals with traditional MetS. Using this cutoff, there was a higher prevalence of adolescents with MetS in each sex/racial/ethnic group and in particular among non-Hispanic-black males and females (Figure (Figure2A).2A). While traditional MetS criteria (ATP-III based) performed poorly in predicting elevations in these measures (sensitivity 21-65%), the new risk score (cut-off of 0.75) performed significantly better (sensitivity 43-81%) without clinically meaningful differences in specificity (90-98% for traditional score vs. 78-92%). This cut-off, if used, could help to identify a larger number of at-risk children and adolescents that currently-used MetS criteria—particularly among non-Hispanic-black individuals.
It is important to note that our aim was not to question the existence of the metabolic syndrome in general, nor study in an exploratory fashion the precise number of factors. We operated under the assumption that one “MetS” factor exists in the pediatric population, and under the assumption, we assessed whether the components contribute to that factor differentially by sex and race/ethnicity. Along those lines, we focused only on traditional MetS components that are common to almost all existing MetS criteria based on cutoffs of these components in order to ensure a clinically accessible risk score that results from the analysis. The limited number of components that comprise traditional MetS criteria did not allow for examination of more than one factor. Thus, our examination here was to examine the one-factor model of MetS in adolescents that would thus allow for a continuous representation of traditionally-defined MetS while simultaneously allowing for sex and race/ethnic differences within this one-factor model. Our comparison of the predictive ability of this new score to the traditional MetS diagnosis required the use of a cutoff value. However, a clear benefit of this score is its potential to identify elevated risk in an individual who has a high score but would not be classified as having MetS using traditional criteria based on having elevations in components of MetS that did not exceed population-based or perhaps even arbitrary thresholds (see Additional file 1: Table S1 for examples). Importantly, this score could also be used to assess degree of improvement during lifestyle modification treatment for weight loss.
This study had several weaknesses. We utilized NHANES data which, although powerful, are cross-sectional. Future use of this score will need to utilize longitudinal databases that include information regarding long-term disease outcomes. We used BMI z-score as an assessment of obesity. While this has been done for prior MetS criteria [8,39], it is generally recognized that markers of visceral obesity (such as WC) are more strongly associated with MetS risk than BMI [9]. Nevertheless, BMI is known to be highly associated with MetS risk [8,42] and has been noted in prior factor analyses of MetS [1,33]. In addition, our MetS risk score that was developed using BMI z-score had near-perfect ability (ROC AUC=0.96) to discriminate against an ATP-III-based classification that utilized WC percentile cut-offs, indicating use of BMI in this instance is sufficient in the creation of a continuous representation of the traditional MetS diagnosis.
Conclusions
In summary, using confirmatory factor analysis, we have demonstrated significant sex- and racial/ethnic differences in factor loading of MetS components that has resulted in a novel sex- and race/ethnicity-specific MetS risk score. This continuous score demonstrates strong predictive ability to detect MetS-associated processes while being less prone to racial/ethnic differences than traditional pediatric MetS criteria. Future research is needed to ascertain the ability of this score to identify individuals at risk for long-term CVD and T2DM, as well as its ability to monitor MetS in the setting of lifestyle modification for obesity treatment.
Abbreviations
AIC: Akaike’s information criteria; AUC: Area under the curve; ATP-III: Adult treatment panel III; BMI: Body mass index; BP: Blood pressure; CVD: Cardiovascular disease; CFA: Confirmatory factor analysis; DBP: Diastolic blood pressure; GFI: Goodness of fit index; HDL: High-density lipoprotein cholesterol; hsCRP: High-sensitivity C-reactive protein; MetS: Metabolic syndrome; NFI: Bentler-bonett normed fit index; NHANES: National health and nutrition examination survey; RMSEA: Root mean square error of approximation; SBP: Systolic blood pressure; SRMR: Standardized root mean square residual; T2DM: Type 2 diabetes mellitus; WC: Waist circumference.
Competing interests
The authors have no conflicts of interest to disclose.
MJG helped in the conception and design of the study, acquired the data, analyzed the data and interpreted the results, and wrote the initial draft of the manuscript and contributed in the critical revision process. CLI helped analyzed the data and interpret the results, and critically reviewed and revised the manuscript. SSS helped conceive the study, assisted in the interpretation of the results, and reviewed and revised the manuscript. MDD helped in the conception and design of the study, assisted in the interpretation of the results, and wrote the initial draft of the manuscript and contributed in the critical revision process. All authors read and approved the final manuscript.
Supplementary Material
Additional file 1
Table S1.Proposed Criteria for the Diagnosis of the Metabolic Syndrome in Children.
Acknowledgments
This work was supported by NIH grants 5K08HD060739-03 (MDD), U54GM104942 (MJG), and 1R21DK085363 (MDD and MJG). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
  • Shen BJ, Todaro JF, Niaura R, McCaffery JM, Zhang J, Spiro A, Ward KD. Are metabolic risk factors one unified syndrome? Modeling the structure of the metabolic syndrome X. Am J Epidemiol. 2003;157(8):701–711. doi: 10.1093/aje/kwg045. [PubMed] [Cross Ref]
  • Tenenbaum A, Fisman EZ. “The metabolic syndrome. is dead”: these reports are an exaggeration. Cardiovasc Diabetol. 2011;10(1):11. doi: 10.1186/1475-2840-10-11. [PMC free article] [PubMed] [Cross Ref]
  • Grundy SM, Cleeman JI, Daniels SR, Donato KA, Eckel RH, Franklin BA, Gordon DJ, Krauss RM, Savage PJ, Smith SC. et al. Diagnosis and management of the metabolic syndrome: an American heart association/national heart, lung, and blood institute scientific statement. Circulation. 2005;112(17):2735–2752. doi: 10.1161/CIRCULATIONAHA.105.169404. [PubMed] [Cross Ref]
  • Lawlor DA, Ebrahim S, May M, Davey Smith G. (Mis)use of factor analysis in the study of insulin resistance syndrome. Am J Epidemiol. 2004;159(11):1013–1018. doi: 10.1093/aje/kwh150. [PubMed] [Cross Ref]
  • Li C, Ford ES. Is there a single underlying factor for the metabolic syndrome in adolescents? A confirmatory factor analysis. Diabetes Care. 2007;30(6):1556–1561. doi: 10.2337/dc06-2481. [PubMed] [Cross Ref]
  • Martinez-Vizcaino V, Martinez MS, Aguilar FS, Martinez SS, Gutierrez RF, Lopez MS, Martinez PM, Rodriguez-Artalejo F. Validity of a single-factor model underlying the metabolic syndrome in children: a confirmatory factor analysis. Diabetes Care. 2010;33(6):1370–1372. doi: 10.2337/dc09-2049. [PMC free article] [PubMed] [Cross Ref]
  • Ford ES, Li C, Cook S, Choi HK. Serum concentrations of uric acid and the metabolic syndrome among US children and adolescents. Circulation. 2007;115(19):2526–2532. doi: 10.1161/CIRCULATIONAHA.106.657627. [PubMed] [Cross Ref]
  • Morrison JA, Friedman LA, Wang P, Glueck CJ. Metabolic syndrome in childhood predicts adult metabolic syndrome and type 2 diabetes mellitus 25 to 30 years later. J Pediatr. 2008;152(2):201–206. doi: 10.1016/j.jpeds.2007.09.010. [PubMed] [Cross Ref]
  • Zimmet P, Alberti G, Kaufman F, Tajima N, Silink M, Arslanian S, Wong G, Bennett P, Shaw J, Caprio S. The metabolic syndrome in children and adolescents. Lancet. 2007;369(9579):2059–2061. doi: 10.1016/S0140-6736(07)60958-1. [PubMed] [Cross Ref]
  • Ford ES, Ajani UA, Mokdad AH. The metabolic syndrome and concentrations of C-reactive protein among U.S. youth. Diabetes Care. 2005;28(4):878–881. doi: 10.2337/diacare.28.4.878. [PubMed] [Cross Ref]
  • Gagliardi AC, Miname MH, Santos RD. Uric acid: A marker of increased cardiovascular risk. Atherosclerosis. 2009;202(1):11–17. doi: 10.1016/j.atherosclerosis.2008.05.022. [PubMed] [Cross Ref]
  • Goncalves JP, Oliveira A, Severo M, Santos AC, Lopes C. Cross-sectional and longitudinal associations between serum uric acid and metabolic syndrome. Endocrine. 2012;41(3):450–457. doi: 10.1007/s12020-012-9629-8. [PubMed] [Cross Ref]
  • Hanson RL, Pratley RE, Bogardus C, Narayan KM, Roumain JM, Imperatore G, Fagot-Campagna A, Pettitt DJ, Bennett PH, Knowler WC. Evaluation of simple indices of insulin sensitivity and insulin secretion for use in epidemiologic studies. Am J Epidemiol. 2000;151(2):190–198. doi: 10.1093/oxfordjournals.aje.a010187. [PubMed] [Cross Ref]
  • DeBoer MD, Dong L, Gurka MJ. Racial/Ethnic and sex differences in the ability of metabolic syndrome criteria to predict elevations in fasting insulin levels in adolescents. J Pediatr. 2011;159(6):975–981. doi: 10.1016/j.jpeds.2011.05.023. e973. [PMC free article] [PubMed] [Cross Ref]
  • Sung KC, Seo MH, Rhee EJ, Wilson AM. Elevated fasting insulin predicts the future incidence of metabolic syndrome: a 5-year follow-up study. Cardiovasc Diabetol. 2011;10:108. doi: 10.1186/1475-2840-10-108. [PMC free article] [PubMed] [Cross Ref]
  • Martinez-Vizcaino V, Ortega FB, Solera-Martinez M, Ruiz JR, Labayen I, Eensoo D, Harro J, Loit HM, Veidebaum T, Sjostrom M. Stability of the factorial structure of metabolic syndrome from childhood to adolescence: a 6-year follow-up study. Cardiovasc Diabetol. 2011;10:81. doi: 10.1186/1475-2840-10-81. [PMC free article] [PubMed] [Cross Ref]
  • Dekker JM, Girman C, Rhodes T, Nijpels G, Stehouwer CD, Bouter LM, Heine RJ. Metabolic syndrome and 10-year cardiovascular disease risk in the Hoorn study. Circulation. 2005;112(5):666–673. doi: 10.1161/CIRCULATIONAHA.104.516948. [PubMed] [Cross Ref]
  • Hanley AJ, Karter AJ, Williams K, Festa A, D’Agostino RB, Wagenknecht LE, Haffner SM. Prediction of type 2 diabetes mellitus with alternative definitions of the metabolic syndrome: the insulin resistance atherosclerosis study. Circulation. 2005;112(24):3713–3721. doi: 10.1161/CIRCULATIONAHA.105.559633. [PubMed] [Cross Ref]
  • van Vliet M, Heymans MW, von Rosenstiel IA, Brandjes DP, Beijnen JH, Diamant M. Cardiometabolic risk variables in overweight and obese children: a worldwide comparison. Cardiovasc Diabetol. 2011;10:106. doi: 10.1186/1475-2840-10-106. [PMC free article] [PubMed] [Cross Ref]
  • DeBoer MD. Obesity, systemic inflammation, and increased risk for cardiovascular disease and diabetes among adolescents: A need for screening tools to target interventions. Nutrition. 2012. [PubMed] [Cross Ref]
  • de Ferranti SD, Gauvreau K, Ludwig DS, Neufeld EJ, Newburger JW, Rifai N. Prevalence of the metabolic syndrome in American adolescents: findings from the third national health and nutrition examination survey. Circulation. 2004;110(16):2494–2497. doi: 10.1161/01.CIR.0000145117.40114.C7. [PubMed] [Cross Ref]
  • DeBoer MD, Gurka MJ. Ability among adolescents for the metabolic syndrome to predict elevations in factors associated with type 2 diabetes and cardiovascular disease: data from the national health and nutrition examination survey 1999–2006. Metab Syndr Relat Disord. 2010;8(4):343–353. doi: 10.1089/met.2010.0008. [PMC free article] [PubMed] [Cross Ref]
  • Lee S, Bacha F, Gungor N, Arslanian S. Comparison of different definitions of pediatric metabolic syndrome: relation to abdominal adiposity, insulin resistance, adiponectin, and inflammatory biomarkers. J Pediatr. 2008;152(2):177–184. doi: 10.1016/j.jpeds.2007.07.053. [PubMed] [Cross Ref]
  • Reinehr T, de Sousa G, Toschke AM, Andler W. Comparison of metabolic syndrome prevalence using eight different definitions: a critical approach. Arch Dis Child. 2007;92(12):1067–1072. doi: 10.1136/adc.2006.104588. [PMC free article] [PubMed] [Cross Ref]
  • Sumner AE. Ethnic differences in triglyceride levels and high-density lipoprotein lead to underdiagnosis of the metabolic syndrome in black children and adults. J Pediatr. 2009;155(3):e7–11. S7. [PMC free article] [PubMed]
  • Park YW, Zhu S, Palaniappan L, Heshka S, Carnethon MR, Heymsfield SB. The metabolic syndrome: prevalence and associated risk factor findings in the US population from the third national health and nutrition examination survey, 1988–1994. Arch Intern Med. 2003;163(4):427–436. doi: 10.1001/archinte.163.4.427. [PMC free article] [PubMed] [Cross Ref]
  • Walker SE, Gurka MJ, Oliver MN, Johns DW, Deboer MD. Racial/ethnic discrepancies in the metabolic syndrome begin in childhood and persist after adjustment for environmental factors. Nutr Metab Cardiovasc Dis. 2012;22(2):141–148. doi: 10.1016/j.numecd.2010.05.006. [PMC free article] [PubMed] [Cross Ref]
  • Mensah GA, Mokdad AH, Ford ES, Greenlund KJ, Croft JB. State of disparities in cardiovascular health in the United States. Circulation. 2005;111(10):1233–1241. doi: 10.1161/01.CIR.0000158136.76824.04. [PubMed] [Cross Ref]
  • DeBoer MD, Gurka MJ, Sumner AE. Diagnosis of the metabolic syndrome is associated with disproportionately high levels of high-sensitivity C-reactive protein in Non-Hispanic black adolescents: an analysis of NHANES 1999–2008. Diabetes Care. 2011;34(3):734–740. doi: 10.2337/dc10-1877. [PMC free article] [PubMed] [Cross Ref]
  • DeBoer MD, Gurka MJ. Low sensitivity for the metabolic syndrome to detect uric acid elevations in females and non-Hispanic-black male adolescents: An analysis of NHANES 1999–2006. Atherosclerosis. 2012;220(2):575–580. doi: 10.1016/j.atherosclerosis.2011.11.033. [PMC free article] [PubMed] [Cross Ref]
  • DeBoer MD. Ethnicity, obesity and the metabolic syndrome: implications on assessing risk and targeting intervention. Expert Rev Endocrinol Metab. 2011;6(2):279–289. doi: 10.1586/eem.11.17. [PMC free article] [PubMed] [Cross Ref]
  • Sumner AE, Cowie CC. Ethnic differences in the ability of triglyceride levels to identify insulin resistance. Atherosclerosis. 2008;196(2):696–703. doi: 10.1016/j.atherosclerosis.2006.12.018. [PubMed] [Cross Ref]
  • Eisenmann JC. On the use of a continuous metabolic syndrome score in pediatric research. Cardiovasc Diabetol. 2008;7:17. doi: 10.1186/1475-2840-7-17. [PMC free article] [PubMed] [Cross Ref]
  • Kahn R, Buse J, Ferrannini E, Stern M. The metabolic syndrome: time for a critical appraisal: joint statement from the American diabetes association and the European association for the study of diabetes. Diabetes Care. 2005;28(9):2289–2304. doi: 10.2337/diacare.28.9.2289. [PubMed] [Cross Ref]
  • Hong TK, Trang NH, Dibley MJ. Prevalence of metabolic syndrome and factor analysis of cardiovascular risk clustering among adolescents in Ho Chi minh city, Vietnam. Prev Med. 2012. E-pub ahead of print. [PubMed]
  • Defronzo RA. Banting lecture. From the triumvirate to the ominous octet: a new paradigm for the treatment of type 2 diabetes mellitus. Diabetes. 2009;58(4):773–795. doi: 10.2337/db09-9028. [PMC free article] [PubMed] [Cross Ref]
  • Alberti KG, Eckel RH, Grundy SM, Zimmet PZ, Cleeman JI, Donato KA, Fruchart JC, James WP, Loria CM, Smith SC. Harmonizing the metabolic syndrome: a joint interim statement of the international diabetes federation task force on epidemiology and prevention; national heart, lung, and blood institute; American heart association; world heart federation; international atherosclerosis society; and international association for the study of obesity. Circulation. 2009;120(16):1640–1645. doi: 10.1161/CIRCULATIONAHA.109.192644. [PubMed] [Cross Ref]
  • Grundy SM, Brewer HB, Cleeman JI, Smith SC, Lenfant C. Definition of metabolic syndrome: report of the national heart, lung, and blood institute/American heart association conference on scientific issues related to definition. Circulation. 2004;109(3):433–438. doi: 10.1161/01.CIR.0000111245.75752.C6. [PubMed] [Cross Ref]
  • Weiss R, Dziura J, Burgert TS, Tamborlane WV, Taksali SE, Yeckel CW, Allen K, Lopes M, Savoye M, Morrison J. et al. Obesity and the metabolic syndrome in children and adolescents. N Engl J Med. 2004;350(23):2362–2374. doi: 10.1056/NEJMoa031049. [PubMed] [Cross Ref]
  • CDC. A SAS program for the CDC growth charts. http://www.cdc.gov.com, accessed 6/7/12.
  • Bosy-Westphal A, Booke CA, Blocker T, Kossel E, Goele K, Later W, Hitze B, Heller M, Gluer CC, Muller MJ. Measurement site for waist circumference affects its accuracy as an index of visceral and abdominal subcutaneous fat in a Caucasian population. J Nutr. 2010;140(5):954–961. doi: 10.3945/jn.109.118737. [PubMed] [Cross Ref]
  • Freedman DS, Sherry B. The validity of BMI as an indicator of body fatness and risk among children. Pediatrics. 2009;124(Suppl 1):S23–34. [PubMed]
  • Kannel WB. Elevated systolic blood pressure as a cardiovascular risk factor. Am J Cardiol. 2000;85(2):251–255. doi: 10.1016/S0002-9149(99)00635-9. [PubMed] [Cross Ref]
  • Yaun KH, Bentler PM. On Chi-square difference and Z-tests in mean and covariance structure analysis when the base model is misspecified. Educ Psychol Meas. 2004;64:737–757. doi: 10.1177/0013164404264853. [Cross Ref]
  • Hu LT, Bentler PM. Cut-off criteria for fit indexes in covariance structure analysis: conventional criteria vs. new alternatives. Struct Equ Model. 1999;6:1–55. doi: 10.1080/10705519909540118. [Cross Ref]
  • Kahn R. Metabolic syndrome: is it a syndrome? Does it matter? Circulation. 2007;115(13):1806–1810. doi: 10.1161/CIRCULATIONAHA.106.658336. discussion 1811. [PubMed] [Cross Ref]
  • Standards of medical care in diabetes. Diabetes Care. 2012;35(Suppl 1):S11–63. [PubMed]
  • Yamauchi T, Kamon J, Waki H, Terauchi Y, Kubota N, Hara K, Mori Y, Ide T, Murakami K, Tsuboyama-Kasaoka N. et al. The fat-derived hormone adiponectin reverses insulin resistance associated with both lipoatrophy and obesity. Nat Med. 2001;7(8):941–946. doi: 10.1038/90984. [PubMed] [Cross Ref]
  • Davidson MH. Apolipoprotein measurements: is more widespread use clinically indicated? Clin Cardiol. 2009;32(9):482–486. doi: 10.1002/clc.20559. [PubMed] [Cross Ref]
Articles from Cardiovascular Diabetology are provided here courtesy of
BioMed Central