|Home | About | Journals | Submit | Contact Us | Français|
To improve the health of overweight and obese veterans, the Department of Veterans Affairs (VA) developed the MOVE! Weight Management Program for Veterans. The aim of this evaluation was to assess its reach and effectiveness.
We extracted data on program involvement, demographics, medical conditions, and outcomes from VA administrative databases in 4 Western states. Eligibility criteria for MOVE! were being younger than 70 years and having a body mass index (BMI, in kg/m2) of at least 30.0, or 25.0 to 29.9 with an obesity-related condition. To evaluate reach, we estimated the percentage of eligible veterans who participated in the program and their representativeness. To evaluate effectiveness, we estimated changes in weight and BMI using multivariable linear regression.
Less than 5% of eligible veterans participated, of whom half had only a single encounter. Likelihood of participation was greater in women, those with a higher BMI, and those with more primary care visits, sleep apnea, or a mental health condition. Likelihood of participation was lower among those who were younger than 55 (vs 55-64), widowed, current smokers, and residing farther from the medical center (≥30 vs <30 miles). At 6- and 12-month follow-up, participants lost an average of 1.3 lb (95% confidence interval [CI], −2.6 to −0.02 lb) and 0.9 lb (95% CI, −2.0 to 0.1 lb) more than nonparticipants, after covariate adjustment. More intensive treatment (≥6 encounters) was associated with greater weight loss at 12 months (−3.7 lb; 95% CI, −5.1 to −2.3 lb).
Few eligible patients participated in the program during the study period, and overall estimates of effectiveness were low.
An estimated 70% of veterans are overweight or obese, with a body mass index (BMI, in kg/m2) of 25.0 or more, consistent with the prevalence of overweight and obesity among demographically similar nonveterans (1-4). Weight loss as small as 5% can reduce the risk of chronic conditions associated with obesity (5). Participants in intensive lifestyle interventions such as those tested in the Diabetes Prevention Program and the Look Ahead trials achieved clinically significant weight loss (6,7). Mean weight losses in those trials were approximately 7% to 8% at 1 year, or 19 pounds (6,7). Translating these successful interventions into programs that can be disseminated widely and implemented in clinical and community settings is a key to reducing the prevalence of obesity.
The Department of Veterans Affairs (VA) administers the largest integrated health care system in the United States; it includes 152 medical centers and 804 community-based outpatient clinics (8). More than 8 million men and women were enrolled in the VA Health Care System in 2010, and approximately 6 million of them received health care in this system (8). To improve the care of veterans who are obese and overweight, VA created and disseminated a clinic-based weight management program, the MOVE! Weight Management Program for Veterans, beginning in 2005.
MOVE! is the largest clinically based weight management program in the United States. Little is known about the proportion of eligible VA patients (“candidates”) who participate in the program, the characteristics of participants, or the program’s effectiveness. The primary aims of this study were to 1) estimate participation in the program, including comparisons of veterans who did and did not participate, and 2) assess the program’s effectiveness in terms of weight change. Secondary aims were to evaluate effectiveness in subgroups and assess implementation and adoption of the program.
We conducted an evaluation of the program in 1 of the 21 regional VA networks and used the RE-AIM framework (reach, effectiveness, adoption, implementation, and maintenance) for organizing our analysis, results, and interpretation, focusing mainly on reach and effectiveness (9). This framework emphasizes that for a program to be effective in the general population, evaluation of components other than efficacy is important.
The VA National Center for Health Promotion and Disease Prevention (NCP) developed MOVE! to provide a standardized format for weight management (10). NCP created the program and materials on the basis of published evidence and clinical practice guidelines from VA and non-VA committees and organizations, as well as other published studies (5,7,10-12).
To disseminate the program, NCP created handouts for patients, training modules for staff, curricula for group sessions, weight management assessment tools, and methods for electronic tracking of participation in program activities (10). Each facility was permitted to determine its own methods to identify patients for the program and the types and extent of offerings in the program.
The treatment components were intended to be individually tailored, integrated into each patient’s ongoing care, and implemented in clinics by multidisciplinary teams (eg, dietitians, physical and recreational therapists, social workers, and mental health professionals). Typically, during the first encounter, staff provide an overview of the program and instruct patients to complete a 23-item questionnaire on their diet, physical activity, health status, and prior weight loss attempts. An individualized report is then generated; it includes a list of recommended print-ready materials on nutrition, physical activity, and healthy behavior change available from the MOVE! website (www.move.va.gov/). MOVE! staff may also help patients set goals to change diet and physical activity at this initial encounter. Follow-up sessions may be group-based, one-on-one, or by telephone.
Pilot feasibility trials were conducted at 17 VA medical centers between October 2003 and December 2004. On the basis of lessons learned in the pilot testing, NCP revised the program components and materials and launched the program nationally in late 2005. VA leadership issued formal policy in early 2006 requiring weight management treatment to be available at all VA medical facilities (http://vaww.move.med.va.gov/).
Because there was no data source for national estimates of key variables, we performed these analyses using data from the VA Northwest Region database (Veterans Integrated Service Network [VISN 20]), which includes data on demographics vital signs, pharmacy use, and laboratory tests and clinical and administrative medical record data about use of outpatient and inpatient services. We obtained information on MOVE! participation and encounter type (ie, group, individual, or telephone) from the National Patient Care Database, which integrates enterprise-wide, patient-level administrative data related to the program. The institutional review boards of VA Puget Sound Health Care System and Portland VA Medical Center approved the study.
We included patients who had a primary care encounter during the study period at any of the 8 VISN 20 facilities in Alaska, Idaho, Oregon, and Washington State (Figure). “Facility” refers to the main VA hospital and any affiliated satellite hospitals or community-based outpatient clinics (CBOCs); the number of patients at CBOCs was generally too small to analyze separately. For the cross-sectional (reach) analyses, the study period was between October 1, 2005, or the start of MOVE! implementation at each facility, whichever was later, and September 31, 2008. For the longitudinal (effectiveness) analyses, follow-up was until December 31, 2008, the most recent data available when this study was initiated. Because 1 facility did not launch a program until 2009, patients from this facility were excluded from all analyses. Two other facilities began program enrollment late in the study period and thus had few enrollees and limited follow-up time. Consequently, patients from these 2 facilities were considered for inclusion for the cross-sectional analyses only.
To identify patients who were MOVE! candidates, we used BMI derived from heights and weights obtained during routine clinical encounters. We attempted to use heights measured during the same period as weights but used heights recorded as far back as January 1997. We used an iterative process to eliminate height, weight, and BMI measures that reflected probable data entry errors (Appendix).
Patients were considered candidates for MOVE! if they 1) had a BMI of at least 30.0, or 25.0 to 29.9 with an obesity-related condition and 2) were younger than 70 (because the program was not designed for older people). We excluded patients who had a medical condition that contraindicated weight management (Appendix). Patients were classified as participants if they had at least 1 encounter coded as related to MOVE!. Nonparticipants were defined as MOVE! candidates who had no MOVE!-related encounters.
We defined reach as the proportion of candidate veterans who participated in MOVE!. Representativeness was based on comparisons of participants to nonparticipants for key sociodemographic and health-related characteristics. To determine the independent associations between characteristics and participation, we created a multivariable logistic regression model.
We attempted to obtain weights at the most relevant period while minimizing the number of patients dropped from analyses. For the longitudinal analyses, baseline weight for nonparticipants was the first recorded weight after program implementation at the patient’s facility (or a weight recorded up to 30 days prior) and for participants, a weight measured on the day of the patient’s first MOVE! encounter or up to 30 days prior.
For each person, we selected the weight closest to 183 and 365 days, respectively, after baseline for the 6-month and 12-month follow-up outcome measures. The range for the 6-month measures was 84 to 213 days (median: 168 and 169 days for nonparticipants and participants, respectively) and for the 12-month measures was 214 to 395 days (median: 349 and 350 days for nonparticipants and participants, respectively). We considered 12 weeks the minimum time necessary to result in meaningful changes in weight and thus the earliest follow-up time for the 6-month longitudinal analyses.
To compare changes in outcomes between participants and nonparticipants, we used multivariable linear regression. The follow-up values were included as the outcome and adjusted for the baseline measure and the duration of follow-up (in days), in addition to all factors significantly associated with participation. In our primary analyses, we evaluated participation as a dichotomous variable (yes/no). As a secondary analysis, we evaluated participation in terms of “intensity/dose” (ie, nonparticipation vs 1, 2 to 5, and ≥6 MOVE! encounters). Finally, to better understand factors associated with weight loss, we used multivariable logistic regression to determine associations between characteristics and clinically important weight loss in MOVE! participants, defined as at least 5% of baseline weight. Standard errors for multivariable analyses were adjusted for clustering of patients within facilities using a clustered sandwich estimator.
To assess adoption, we calculated the number of facilities that implemented MOVE! in the first year that it was disseminated. As a proxy measure of implementation, we assessed the average number of MOVE! encounters per person and the percentage of patients with only 1 vs 6 or more encounters, at the facility level, in the year following the initial visit.
Of the 173,127 people who were potentially eligible for MOVE!, 76,599 were classified as MOVE! candidates and included in the cross-sectional analyses (Figure). The primary reasons for exclusion were missing or implausible weight, height, or BMI (n = 56,803); BMI below the threshold for inclusion (n = 31,327); and a diagnosis or hospitalization contraindicating participation in a weight management program (n = 8,398).
A total of 3,192 (4.2%) patients participated in MOVE!, and participation ranged by facility from 0.4% (Facility G) to 8.2% (Facility A) (Table 1). Participation was greater for sites that launched a MOVE! program in April 2006 or earlier.
After adjusting for all factors in Table 2, the following characteristics were associated with likelihood of participation at least 30% higher than the reference categories: female sex, BMI of 30.0 or more, 3 or more primary care visits, sleep apnea, and any mental health condition (including bipolar disorder, depression, or schizophrenia) (Table 2). Age younger than 55 (vs 55–64, the reference category), current smoking, being widowed (vs never married), and receiving care at a facility 30 miles or more from the patient’s home were associated with lower likelihood of participation.
Participants lost approximately 1 to 2 lb (0.2 to 0.3 kg/m2) during 6 to 12 months of follow-up (Table 3). After multivariable adjustment, mean weight losses in participants were significantly greater than in nonparticipants at 6 months (−1.3 lb) but not 12 months (−0.9 lb). Patients who had 6 or more encounters had significantly greater weight losses at 6-month and 12-month follow-up than nonparticipants (−2.6 lb; 95% CI, −3.8 to −1.5 and −3.7 lb; 95% CI, −5.1 to −2.3, respectively).
There were no consistent associations between facility and clinically important weight loss; for example, although the likelihood of clinically important weight loss at 6 months was approximately 4 times greater at Facility B than Facility D, no such association was apparent for 12-month weight loss. Women (vs men) and those with 2 or more comorbidities (vs none) had a lower likelihood of clinically important weight loss, while greater BMI was associated with higher likelihood of clinically important weight loss.
The mean number of encounters during follow-up was 3.0 and varied among facilities (range, 1.6–4.6) (Table 1); 49.6% of participants had only a single encounter (range among facilities, 24.3%–71.9%), while 13.1% had 6 or more encounters (range among facilities, 0%–31.8%). Additionally, the percentage of encounters that were group-based differed among facilities (0%–95.8%).
Five of the 8 VISN 20 facilities launched a MOVE! program by October 2006 (within 12 months of national implementation), whereas 3 facilities did not begin offering MOVE! until at least 2 years after the program was implemented nationally.
This study demonstrated that only a small proportion (<5%) of veterans who were candidates for MOVE! participated. Participation was associated with reductions in weight, although the reductions were small and of questionable clinical significance, albeit comparable in magnitude to several other “real world” implementation studies conducted in similar settings (13,14).
Women were more likely to participate than men but were less likely to have clinically important weight loss. BMI was strongly and positively associated with both participation and clinically important weight loss. Although participants had more primary care visits and obesity-related conditions, including sleep apnea, than nonparticipants, participants with more comorbidities were less likely to lose at least 5% of their weight than those with fewer comorbidities or primary care visits. One novel finding was a greater likelihood of participation among veterans with a mental health condition, although there was no evidence of greater effectiveness. People with a mental health condition in the current study also had more obesity-related conditions (eg, heart disease, diabetes, sleep apnea). They may have been viewed by their health care provider as at greater risk for the consequences of obesity, and because of their comorbidities and likely greater contact with health professionals, may have had more opportunities to be offered enrollment in this program. These findings suggest that high-risk participants, such as those with mental health conditions, are interested in weight management. Determining methods to engage them and help them achieve weight management goals is an area for future research.
Evaluating the effectiveness of MOVE! is challenging because it is not clear that the program was implemented as intended. Sustained and intensive treatments are associated with better outcomes (12). Participants in the Diabetes Prevention Program and Look Ahead trials met with interventionists an average of 23.6 and 35.4 times, respectively, in the first year (6,15), nearly an order of magnitude more than was observed for VA Northwest Region patients.
We observed large variability in implementation across facilities. This variability is in part a product of the VA system because decisions on resource allocation are made at the local level. Some facilities in the study region offered only a single educational seminar each month, while other facilities offered 12-session group-based classes 2 or more times per week in addition to ongoing weekly maintenance sessions. Because of the small number of facilities in our study sample and the heterogeneity among them, it was not possible to evaluate associations between facility-level factors and participation or outcomes; other groups are in the process of doing so (16). This area of research may lead to improved reach and effectiveness.
Our study had several limitations. Patients were not randomized into MOVE!. Thus, confounding factors related to motivation to lose weight may explain some or all of the weight loss differences observed. Second, we were unable to assess clinical eligibility for MOVE! or weight change in a large number of patients because of missing data; as a result, participation rates may have been overestimated because many of those without weights and/or heights recorded in the medical record were likely candidates for the program. Conversely, use of administrative databases permitted us to include a large sample of both program participants and nonparticipants and to assess changes in measured rather that self-reported weight. Third, the findings from the Northwest region during the study period may not generalize to other areas of the country because of differences in patients, local implementation, and resources allocated to the program. Fourth, information was not available on weight loss activities unrelated to MOVE!, which may have differed between participants and nonparticipants. Finally, we were limited in our ability to assess other aspects of the RE-AIM framework, including direct measures of implementation, organizational factors, and maintenance (9).
This study focused on evaluation of MOVE! in the first few years after implementation. In 2008, the VA introduced a national overweight/obesity screening performance measure that requires providers to screen patients annually for obesity using BMI, provide obesity risk counseling, and offer comprehensive weight management treatment when appropriate (11). This measure may force facilities to reevaluate and reconfigure their existing MOVE! programs to better serve the increased number of veterans who will be offered treatment.
MOVE! participation in the 4 Western states studied in this evaluation was associated with small weight losses; weight losses were greater and suggested clinically important benefits in patients who received more intensive treatment (ie, ≥6 encounters). Although the findings for more intensive treatment are encouraging, only a small fraction of participants achieved this level of intensity, resulting in a small overall impact of the program. The lack of resources available to implement the program was likely a major contributing factor to the low participation and the limited evidence of effectiveness (17). Ideally, future evaluations will collect information from a national sample of community-based outpatient clinics and medical centers to determine both facility-level and individual-level factors associated with better outcomes. One benefit of the implementation of widespread screening for obesity in the VA is that it will be possible to assess MOVE! candidacy and effectiveness in a greater proportion of VA patients. Such evaluations will provide valuable information about how to increase the efficacy of the program to improve the health and well-being of overweight and obese veterans.
This study was supported in part by the Quality Enhancement Research Initiative (RRP-07-279), the Cooperative Studies Program, and VA Puget Sound Health Care System, Department of Veterans Affairs. Dr Littman was supported by a VA Rehabilitation Research and Development Career Development Award (#6982). Dr Leila Kahwati provided valuable feedback on program components, study analysis, and interpretation.
For weight, height, and body mass index, we first removed biologically implausible values (weight <75 lb or >600 lb, height <49 in or >94 in, and body mass index >80 kg/m2) (1,2). Next, we applied algorithms to identify measures that were plausible but appeared to be erroneous on the basis of a review of all recorded weights and heights during the relevant time period. After reviewing records that had large standard deviations (SDs) (explained in more detail below), we used the algorithm that follows to exclude values that were likely erroneous while keeping values that were plausible. We excluded any weight measurements that met the following 2 criteria: 1) the difference between the mean weight and weight in question was greater than the SD and 2) the SD was greater than 10% of the mean. For example, 1 participant’s weight in pounds was recorded as 300 and 160 lb, both measured on December 7, 2005, 310 lb measured on June 12, 2006, 276 lb measured on August 8, 2006, 291 lb measured on August 15, 2006, and 291 lb measured on September 13, 2007, resulting in mean (SD) of 271.3 (55.7) lb. The weight of 160 lb recorded on December 7, 2005, was considered erroneous and dropped because the difference between the index weight and mean weight was greater than the SD (271 − 160 = 113.3 lb) and the SD was greater than 10% of the mean of all weights ([55.7/271.3] × 100 = 20.5%). Using a similar method, we considered a participant’s height measurement to be erroneous if 1) the difference between the mean height and height in question was greater than the SD and 2) the SD was greater than 2.5% of the average height. The most deviant height was dropped, and the same algorithm was rerun to identify any additional implausible height values. Participants with at least half of remaining heights flagged as implausible were dropped from analyses. Only 0.2% of measured weights and 0.99% of measured heights were considered erroneous and excluded after applying these rules.
For the secondary outcomes, the following values were considered to be implausible: high-density lipoprotein (HDL) cholesterol <10 or >120 mg/dL, LDL cholesterol <30 or >300 mg/dL, systolic blood pressure <60 or >250 mm Hg, and diastolic blood pressure <40 or >140 mm Hg.
Participants with International Classification of Diseases, Clinical Modification, Ninth Revision (ICD-9-CM) diagnosis codes indicating the presence of 1 or more of the following conditions were not considered eligible for a weight management program: HIV; progressive central nervous system infections; organic brain syndromes or dementias; anorexia; anterior horn cell disease (including amyotrophic lateral sclerosis); Huntington’s disease; cirrhosis; dialysis; congestive heart failure; chronic obstructive pulmonary disorder; neurological disorders; septicemia; peritonitis; hepatitis with hepatic coma; transplant surgery; or residing in a nursing home, hospice, residential, or adult day health care. In addition, participants with a hospitalization within 30 days before or after their last recorded primary care visit were ineligible. We excluded participants who were pregnant in the prior year, had a cancer diagnosis combined with oncology codes indicating active treatment, or had 3 or more admissions for day hospital or intensive care management. Oncology codes indicating active treatment were 141.0–208.9x (except 140–140.9 and 173.0–173.9) plus 2 or more oncology Stop Codes (XRT 149, Onc 316, ChemoRX 330, 431).
The opinions expressed by authors contributing to this journal do not necessarily reflect the opinions of the U.S. Department of Health and Human Services, the Public Health Service, the Centers for Disease Control and Prevention, or the authors' affiliated institutions.
Suggested citation for this article: Littman AJ, Boyko EJ, McDonell MB, Fihn SD. Evaluation of a Weight Management Program for Veterans. Prev Chronic Dis 2012;9:110267. DOI: http://dx.doi.org/10.5888/pcd9.110267.