|Home | About | Journals | Submit | Contact Us | Français|
Investigating the validity of the self-reported values of weight allows for the proper assessment of studies using questionnaire-derived data. The study examined the accuracy of gender-specific self-reported weight in a sample of adults. The effects of age, education, race and ethnicity, income, general health and medical status on the degree of discrepancy (the difference between self-reported weight and measured weight) are similarly considered.
The analysis used data from the US Third National Health and Nutrition Examination Survey. Self-reported and measured weights were abstracted and analyzed according to sex, age, measured weight, self-reported weight, and body mass index (BMI). A proportional odds model was applied.
The weight discrepancy was positively associated with age, and negatively associated with measured weight and BMI. Ordered logistic regression modeling showed age, race-ethnicity, education, and BMI to be associated with the degree of discrepancy in both sexes. In men, additional predictors were consumption of more than 100 cigarettes and the desire to change weight. In women, marital status, income, activity level, and the number of months since the last doctor's visit were important.
Predictors of the degree of weight discrepancy are gender-specific, and require careful consideration when examined.
Individuals are often asked about common physical attributes such as weight and height in lieu of actual measurements. In some surveys and large epidemiologic studies, self-reported measurements of these characteristics may replace actual instrument-derived data. For instance, the National Health Interview Surveys, one of the oldest US national health surveys used to obtain data on the health of the resident, civilian, non-institutionalized population of the United States relies on the question "About how much [do you] weigh without shoes?".
Previous studies have indicated that self-reported and actual weights correlate by more than 90% [1,2], but that more than 20% of adults underestimate their actual weight by 2 kilograms or more [1,3-5]. There is also a general overestimation of weight by overweight people and the elderly [6-8].
Recently, Kuczmarski et al. examined the effect of age on the extent to which the body mass index (BMI) calculated from self-reported anthropometric information compared with estimates calculated from measured values. Using data from the Third National Health and Nutrition Examination Survey (NHANES III), the authors found that significant misclassification of overweight status could arise if self-reported values for height and weight were accepted as true. This was especially apparent in those of at least 60 years of age. Results from a Swedish population suggest that socioeconomic factors also play a role in these differentials .
The use of equations to predict measured variables from self-reported variables have been derived from regression models but have been unable to eliminate systematic error in their predictions [11,12].
Differences in findings across international settings also compound the problem. Results from a Scottish population seem to indicate that rates of misclassification are low  in contrast to those found in Wales , Australia , France , Spain , and Sweden . Chiu et al. suggest that a more comprehensive approach to the determinants of this misclassification phenomenon be examined.
Investigating the validity of the self-reported values of weight allows for the proper assessment of studies using questionnaire-derived data. The same studies citing problems with the validity of self-reported measures also caution against their use in epidemiologic research [6,9,12,14-17]. While there is an understanding that certain specific characteristics (e.g., age, gender, socioeconomic status, etc.) are associated with misclassification, little has been written about the joint effect of a collection of presumed predictors and the degree of misclassification. In a sense, focus shifts from attempting to estimate measured variables from predictive coefficients derived from regression equations to qualitatively examining the relationship of the potential for misclassification given a set of putative covariates.
This paper attempts to provide that information using a nationally-representative sample of US adults. Project investigators considering the use of self-reported values may be guided by these results in evaluating whether the potential for misclassification is present to an extent that suggests that measured values be derived. Specifically, this study assesses the effects of age, education, race and ethnicity, income, and general health and medical status on the degree of discrepancy between self-reported and measured weight in a nationally-representative sample of US adults.
Data were derived from NHANES III, conducted by the National Center for Health Statistics of the Centers for Disease Control and Prevention. NHANES III was designed to provide a nationally representative sample of the US population. The plan and operation of the NHANES III have been described elsewhere [19,20]. Briefly, the study was conducted from 1988 to 1994, and was composed of two 3-year phases: phase I from 1988 to 1991, and phase II from 1991 to 1994. To ensure reliable estimates, the oversampling of selected subgroups (including children, the elderly, Mexican-Americans, and non-Hispanic blacks) was performed. The current analysis combines both phases of the survey and focuses on individuals aged 17 and older.
Individuals were interviewed at home and invited to participate in clinical examinations conducted either in the home or in a mobile examination center (MEC). Persons with missing weight data were excluded from the analysis, as were persons who had a proxy answer questions for them, and pregnant women. In some cases in which measured weight was not available during the clinical examination, an imputation procedure was performed that substituted an estimate of weight based on external characteristics or self-reported values. These cases were also excluded. All told, data from 15,944 subjects were available for analyses. No statistically significant differences were found between those excluded from the analysis and those retained (data not shown).
Participants were asked how much they weighed "without clothes or shoes". Responses were given in pounds and converted to kilograms. Actual weight (in kilograms) was measured in the MEC using a Toledo 2181 self-zeroing digital weight scale which was calibrated at regular intervals. In the home examination, examiners were provided with a SECA Integra Model 815 Scale standardized against the MEC Toledo scale. All persons were asked to remove footwear and heavy outer clothing prior to measurement. The degree of discrepancy in weight was calculated as the difference between self-reported and measured weight, and was categorized into 7 levels (>10 kg too low, 5–10 kg too low, 2–4 kg too low, within 2 kg of actual value, 2–4 kg too high, 5–10 kg too low, and >10 kg too high).
The effects of four classes of variables were examined. Sociodemographic variables included sex, age, race-ethnicity, highest educational attainment, and annual family income. Weight perception related variables included questions about attempts to lose weight in the past 12 months, the desire to change weight ("Would you like to weight more, less, or stay about the same?"), participants' perception of current weight ("Do you consider yourself now to be overweight, underweight, or about the right weight?"), and level of activity ("How does the amount of activity you reported for the past month compare with your physical activity for the past 12 months? During the past month, were you more active, less active, or about the same?" and "Compared to most men or women your age, would you say that you are more active, less active, or about the same?").
Participants were also asked questions about their general state of health ("Would you say your health in general is excellent, very good, good, fair, or poor?"), length of time since their last visit to a health professional (including hospitalizations) to discuss their health, and the number of hospitalizations and visits to physicians during the past year.
Anthropometric variables included calculation of BMI computed as weight in kilograms divided by square of height in meters using measured attributes, standing height, waist to hip ratio, and triceps and subscapular skinfold measurements.
All analyses incorporated sampling weights consistent with the sampling design of the NHANES III survey in order to take into account the unequal selection probabilities resulting from the complex, multi-stage design of the study; adjustment for non-coverage and non-response; and the oversampling of subgroups .
Statistical analyses were carried out using Stata 7.0 . Conventional statistical analyses with underlying distributional assumptions were inappropriate for variance estimation and statistical testing because of the multistage probability sampling design of the NHANES III. The use of conventional statistical analyses (which are based on simple random sampling) produces underestimates of the variance, thereby inflating statistical significance. Stata implements a method of variance estimation known as "linearization" in which linear approximates (ie., the estimated variance) of a nonlinear function (ie., the true variance) are derived by taking the first-order Taylor series of the approximation.
An approximate F statistic incorporating an adjusted Wald test was used to compare continuous variables . Design-based F statistics were calculated for cross-tabulations of categorical variables. The independent effects of particular independent variables on the degree of discrepancy were examined in univariable and multivariable models using regression analyses. A Type I error rate of five percent was used.
Table Table11 describes the characteristics of the study population. The mean (standard error [SE]) age was 43.14 (0.38) years, about 51.25% was female, and slightly more than three-fourths were non-Hispanic Whites with similar proportions reported completion of tertiary-level education or less, and annual incomes of less than $50,000. About half of the adult female population (44.45 percent) and almost two-thirds (61.74 percent) of the male population reported having smoked 100 cigarettes in the past.
Almost 30 percent of males reported having tried to lose weight in the past 12 months with about one-fourth attempting to lose weight at the time of the interview. The proportions for females were about 50 and 40 percent, respectively. About half of the men interviewed (49.10 percent) said they wanted to weigh less than their current weight, while this figure for females was 69.99 percent. About half of the females interviewed felt that they were overweight, compared to only 42.61 percent of males. A quarter of all women and 19 percent of all men interviewed reported that they were less active than people of the same age. The distribution of levels of health perception by the participants and assessment by a medical examiner were similar for males and females. The average number of months since the last visit to a health professional was 15 months for males and 8 months for females.
The mean BMI was 26 kg/m2 for both men and women. The average measured weight was 81.57 kg for males and 68.87 kg for females. Average self-reported weight was 82.06 kg and 67.24 kg for males and females, respectively.
Using ordered logistic regression, the crude odds ratios of the association of the degree of discrepancy in weight and selected characteristics are given in table table2.2. Compared to the 30 to 39 age group, younger males and those greater than 80 years of age were more likely to overestimate their weight (p ≤ 0.01). In contrast, females of at least 60 years of age were more likely to overestimate their weight (p ≤ 0.01). In both sexes, increasing age was associated with a higher probability of discrepancy.
Non-Hispanic black and Mexican-American males were 66 percent (95% CI: 41% to 95%) and 16 percent (95% CI: 1% to 32%) more likely, respectively, to overestimate their weight compared to their non-Hispanic white counterparts. For females, non-Hispanic blacks were no more likely to report discrepancies in weight compared to non-Hispanic whites. However, Mexican-American women and women of other races were 17 percent (95% CI: 1% to 35%) and 29 percent (95% CI: 2% to 62%) more likely to overestimate their weight.
The attainment of a primary education in males was associated with an increase of 1.364 (95% CI: 1.132 to 1.643) in the odds of overestimating measured weight by self report compared to those attaining a tertiary education. Secondary education was associated with an increase of a similar magnitude. Results were similar for females.
The association between annual income and the degree of discrepancy in weight is statistically evident only in the upper income brackets. Compared to those earning $20,000 to $29,000 a year, males earning more than $40,000 a year are more likely to underestimate their weight (p ≤ 0.05). For females, this association is evident at a much lower income bracket ($30,000, p ≤ 0.05).
Smoking more than 100 cigarettes in the past was associated with an increase of 27 percent (95% CI: 11% to 46%) in the chances of overestimating weight. This association was seen in males only.
Participants who, in the past year, attempted to lose weight were more likely to underestimate their weight during the interview (males: OR = 0.488; 95% CI: 0.420 to 0.567; females: OR = 0.605; 95% CI: 0.532 to 0.689). Similar associations were found among those who were currently attempting to lose weight.
Discrepancy in self-reported weight was found to reflect the desires and perceptions of the participants. The desire to weigh more and the perception of being underweight was each associated with a two-fold increase in the likelihood of overestimating weight during the interview. A similar two-fold increase in the chance of reporting a lower weight was seen when participants reported a desire to weigh less or when they perceived themselves to be overweight.
Self-reported level of activity and the number of months since the last visit to a health professional were associated with a discrepancy in self-reported weight only in women. Compared to women who reported comparable levels of activity with people of the same age, women who considered themselves more active were 1.183 times (95% CI: 1.060 to 1.319) more likely to overestimate their weight. An increase in one year since the last visit to a health professional was associated with a 3 percent increase (95% CI: 0.3% to 6%) in the likelihood on underestimating one's weight.
The participants' perception of their health status was associated with a disagreement between self-reported and measured weight only in the two worst levels. Compared to a rating of "good," males reporting their health as being "fair" and "poor" were 1.303 and 1.536 times more likely, respectively, to overestimate their weights (p ≤ 0.01). For females, this association was statistically evident only in those reporting "fair" health (OR = 1.336; 95% CI: 1.104 to 1.616).
Similarly, a medical professional's assessment of health was associated with a discrepancy in self-reported weight only in the extremes of the scale. For males, this was apparent only in those whose health was assessed as being "poor;" in females, an association was found only in those with a rating of "excellent." Compared to those with a rating of "good," males with a "poor" rating were 1.818 times (95% CI: 1.102 to 3.000) more likely to overestimate their weights. Females with a rating of "excellent" were 1.197 times (95% CI: 1.015 to 1.413) more likely to overestimate their weights.
BMI was associated with decreasing trends in the odds ratios in both sexes (p for trend < 0.0001). Using a BMI of 18.5 to 24.9 as the reference group, males and females with a BMI of less than 18.5 were 2.659 (95% CI: 1.522 to 4.646) and 3.642 (95% CI: 2.580 to 5.143) times more likely to overestimate their weights, respectively. Underestimation of weight was associated with higher BMI categories. For females, overweight, obesity I, II, and III statuses were associated with 47%, 66%, 76% and 87% increases in the likelihood of underestimating their weights, respectively. These values were 55%, 74%, 89%, and 94% for males, respectively.
The application of a multiple ordered logistic regression model to the predictors produced the estimates of association shown in table table3.3. Separate models are given for males and females. For both sexes, important predictors of the degree of discrepancy in self-reported weight include age, race-ethnicity, highest educational attainment, and measured BMI. For males alone, additional predictors were cigarette smoking and the desire to change weight. For females, marital status, annual income, level of activity, and the length of time since the participant's last visit to a health professional were important.
Adjustment of other covariates reversed the direction of effect of age in males and females. Compared to those aged 30 to 39, males and females aged less than 20 years were found to be 20 (95% CI: 6% to 47%) and 44 percent (95% CI: 23% to 60%) more likely, respectively, to underestimate their weights. No other statistically significant associations were found for other age group in males. Females older than 60 years, however, were more likely to overestimate their weights with the oldest age group being 3.3 times more likely than those in the reference group.
The adjusted effect of race-ethnicity in males was similar to the crude estimates. For females, however, non-Hispanic blacks, a group previously found to be no more likely to misreport their weights during the analysis of crude effects, were shown to have 1.369 times (95% CI: 1.145 to 1.636) the odds of overestimation compared to their non-Hispanic white counterparts. The estimates for Mexican-Americans and women of other groups were only slightly increased after adjustment.
The estimated effects of BMI and highest educational attainment after adjustment were similar to estimates of their crude effects, as were the adjusted effects of cigarette smoking and desire to change weight in males, and annual income and the length of time since the participant's last visit to a health professional in females.
Utilizing these figures, estimates of the proportions of males and females in the NHANES III by the degree of discrepancy between self-reported and measured weight stratified by age are given in table table44 and represented graphically in figure figure1.1. Overall, more than 35 percent of males overestimate their weight by 2 kilograms or more; in females, this proportion is only about 14 percent. About a 35 percent of all females underestimate their weight, compared to about 25 percent for males. Although the proportion of people correctly reporting their weight to within 1 kilogram was approximately constant throughout the age range, a greater proportion of the elderly was shown to overestimate, and of the young to underestimate, their weights.
The systematic differences between self-reported and measured values of weight were documented by previous studies [1,3-5]. However, the lack of population-based samples made estimates difficult to generalize to larger population groups or to special subgroups. In this study, a nationally-representative sample was used to derive estimates of this bias and its determinants.
The main finding suggests that personal attributes are associated with the tendency of adults to differ in their reporting of their correct weight. Overall, there was a general underreporting of weight by about half a kilogram. However, males overestimated their weights by half a kilogram and females underestimated their weights by almost 1.5 kilograms.
These personal attributes were often gender-specific, a bias that extended to the predictors of the degree of discrepancy between the two measures. The results may be regarded as one of the instances in which gender-specific interaction is demonstrated . While there were covariates that affected both sexes, the magnitudes and directions of effect were often not similar. Only the youngest males, for instance, showed any statistically significant probability of reporting weight discrepancy compared to the reference group and after adjustment for other covariates. In females, almost the entire age range is influenced. Some covariates were statistically significant in one sex but not in the other as was, for instance, level of activity in females or cigarette smoking in males.
Variables were selected on the basis of a statistically significant association with the degree of discrepancy. While the use of a proportional odds model clearly delineates the importance of these predictors in terms of relative odds, this study was limited in its examination of the absolute magnitude of these discrepancies (i.e., the number of kilograms reported versus measured) after accounting for the study's complex sampling design and adjustment for multiple covariates.
Some variables served as non-specific indicators of lifestyle and health behaviors. The better quantification of some of these behaviors (such as smoking or level of activity) may lead to a better characterization of their association with self-reported weight. The length of time since the participant's last visit to a health professional is particularly nettlesome, as one can premise that individuals seeking consultation for health conditions are more likely to be cognizant of their weight, especially in particular medical conditions such diabetes or cardiovascular disease. The inclusion and simultaneous adjustment of an additional set of variables, however, was deemed inadvisable from a model-building standpoint. Therefore, generalizations of these results to these subgroups must be tempered with caution.
This study supports previous research in suggesting that the biases associated with self-reported weight precludes its use as an accurate surrogate for measured values in epidemiologic studies and field trials [6,9,12,14-17]. However, the results also suggest a finding that was not altogether unexpected – that in certain subgroups (e.g., the obese elderly) where accuracy is of prime concern, biases may be particularly significant.
The implications for practice are clear: project investigators should endeavor to gain accurate measures of weight in adults where feasible. The ease of acquisition of self-reported values must be weighed against the overall utility of an analysis that incorporates potentially biased estimates of effect. Careful deliberation about the resource implications of such an endeavor and its likely gain in accuracy must also be carried out.
Future research is necessary to examine the generalizability of these findings in other settings. Research might be targeted to better understand the impact of surrogate measures in well-defined population groups. It is hoped that by generating a fuller picture of the complex relationships that impact on self-reported weight and weight perception, a better understanding of the issues surrounding overweight and obesity may be gained.
Self-reported measures of body weight in adults are associated with gender-specific biases. The careful and deliberate consideration of their usefulness as surrogates of instrument-derived measures is important, especially when particular subgroups are involved.
The pre-publication history for this paper can be accessed here:
Saifuddin Ahmed, MBBS PhD, Department of Population and Family Health Sciences, Bloomberg School of Public Health, Johns Hopkins University provided valuable advice on data analysis.