From the Patient’s Perspective: The Impact of Training on Resident Physician’s Obesity Counseling

doi:10.1007/s11606-010-1299-8

J Gen Intern Med. 2010 May; 25(5): 415–422.

Published online 2010 March 9. doi: 10.1007/s11606-010-1299-8

PMCID: PMC2855014

From the Patient’s Perspective: The Impact of Training on Resident Physician’s Obesity Counseling

Melanie Jay, MD,¹ Sheira Schlair, MD,³ Rob Caldwell, MD,¹ Adina Kalet, MD, MPH,¹ Scott Sherman, MD, MPH,^1,² and Colleen Gillespie, PhD¹

¹Division of General Internal Medicine, New York University School of Medicine, VA New York Harbor, 423 E 23rd Street, New York, NY 10010 USA

²Veterans Affairs New York Harbor, New York, NY USA

³Division of General Internal Medicine, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467 USA

Melanie Jay, Email: Melanie.jay/at/nyumc.org.

Corresponding author.

Received September 11, 2009; Revised December 8, 2009; Accepted February 8, 2010.

This article has been cited by other articles in PMC.

Abstract

BACKGROUND

It is uncertain whether training improves physicians’ obesity counseling.

OBJECTIVE

To assess the impact of an obesity counseling curriculum for residents.

DESIGN

A non-randomized, wait-list/control design.

PARTICIPANTS

Twenty-three primary care internal medicine residents; 12 were assigned to the curriculum group, and 11 were assigned to the no-curriculum group. Over a 7-month period (1–8 months post-intervention) 163 of the residents’ obese patients were interviewed after their medical visits.

INTERVENTION

A 5-hour, multi-modal obesity counseling curriculum based on the 5As (Assess, Advise, Agree, Assist, Arrange) using didactics, role-playing, and standardized patients.

MAIN MEASURES

Patient-report of physicians’ use of the 5As was assessed using a structured interview survey. Main outcomes were whether obese patients were counseled about diet, exercise, or weight loss (rate of counseling) and the quality of counseling provided (percentage of 5As skills performed during the visit). Univariate statistics (t-tests) were used to compare the rate and quality of counseling in the two resident groups. Logistic and linear regression was used to isolate the impact of the curriculum after controlling for patient, physician, and visit characteristics.

KEY RESULTS

A large percentage of patients seen by both groups of residents received counseling about their weight, diet, and/or exercise (over 70%), but the quality of counseling was low in both the curriculum and no curriculum groups (mean 36.6% vs. 31.2% of 19 possible 5As counseling strategies, p

0.21). This difference was not significant. However, after controlling for patient, physician and visit characteristics, residents in the curriculum group appeared to provide significantly higher quality counseling than those in the control group (std β

0.18; R² change

2.9%, P

0.05).

CONCLUSIONS

Residents who received an obesity counseling curriculum were not more likely to counsel obese patients than residents who did not. Training, however, is associated with higher quality of counseling when patient, physician, and visit characteristics are taken into account.

KEY WORDS: obesity, counseling, results

INTRODUCTION

The majority of Americans are either overweight or obese¹ and obesity is associated with higher mortality² and increased risk of co-morbidities.³^–⁵ Modest weight loss with diet and exercise can improve health outcomes.⁶ Physician counseling is associated with improved diet and physical activity,⁷ readiness for lifestyle change,⁸ and short-term weight loss.⁹^,¹⁰ Thus, several organizations recommend that physicians should counsel obese patients to lose weight¹¹^–¹³.

However, physicians often do not counsel patients about their weight.⁷^,¹⁴^–¹⁶ When counseling does occur, most physicians do not discuss specific behavior change recommendations such as diet and exercise,⁸ indicating that quality of counseling may be poor. Lack of training and competency in obesity management are among the reasons that physicians do not adequately counsel patients.⁸^,¹⁷^–¹⁹

The 5As counseling framework is an evidence-based way to teach physicians to counsel obese patients¹⁹^,²⁰ and measure the quality of obesity counseling.²¹ This framework guides providers to assess risk, current behavior, and readiness to change, advise change of specific behaviors, agree and collaboratively set goals, assist in addressing barriers and securing support, and arrange for follow-up.²⁰^,²² Training physicians about this framework has been shown to improve patient outcomes in smoking cessation.²³ When combined with office management strategies, training physicians to perform the 5As produced greater lipid control and weight loss⁹ in patients. We, therefore, used the 5As framework to design and evaluate our obesity curriculum.

The goal of this pilot study was to measure the impact of an obesity counseling curriculum on resident physicians’ obesity counseling, operationalized as the use of 5As counseling strategies. In our conceptual model, we anticipated that selected patient (BMI, health status, stage of change, and overall satisfaction with the clinic), visit (degree of continuity, whether physician was primary provider), and physician characteristics (gender, patient-centeredness) would be important confounding influences on physicians’ obesity counseling. Thus, we sought to compare the patient-reported rate and quality of counseling of residents who did and did not participate in an obesity counseling curriculum while controlling for these potential confounders.

METHODS

Participants: Residents

We used a non-randomized, wait-list/control design to examine the impact of the obesity curriculum on physicians’ obesity counseling. We included all 23 resident physicians in the primary care residency program in this study; all had consented to be part of a medical education research registry approved by the IRB at New York University. These residents were stratified by year of training and assigned to either an intervention (curriculum) group or control group (no curriculum) based on their rotation schedule, determined independently and a priori by an outside administrator blinded to the study (See Fig. 1). Residents entering their outpatient rotation at the beginning of the study (February 2008) were placed in the intervention group, and those entering their rotation later (March 2008) were placed in the control group and received the curriculum after the study ended. While the residents were not blinded to the intervention, they were not told that this specific curriculum was being studied.

Figure 1

Patient and physician flow chart.

Intervention: Obesity Curriculum for Residents

The 5-hour curriculum, given over three weekly sessions, utilized multiple active instructional methods including case-studies, role-playing, standardized patients for counseling practice, and faculty-facilitated videotape review of residents counseling their own patients. Skills such as behavioral assessment, goal setting, and motivational interviewing were stressed¹⁹. Participation was monitored using attendance forms.

Measures: Body Mass Index

Weight was measured using one of four analog scales each equipped with a stadiometer to take height measurements with the patients fully clothed except for shoes and jackets. The scales were calibrated at the start of the study.

Patient Exit Interview

We developed a questionnaire to evaluate the rate and quality of physician counseling in English and Spanish. It was designed to be read by a research assistant and asked patients to indicate whether the physician used each of nineteen literature-derived 5As counseling skills²⁰^,²² (See Table 1). We have used similar items in observed structured clinical exams (OSCEs) to evaluate physician performance and have found the assessment to have adequate internal consistency (Cronbach’s alpha >0.75). Based on these OSCEs and a needs assessment of faculty and residents¹⁹, we identified 11 items reflecting more advanced skills (Table 1).

Table 1

Assessment of 5As Obesity Counseling Practices

We also measured theory-based patient, provider, and visit characteristics based on our conceptual model. Patient factors included BMI, socio-demographic information, perceived health status, presence and number of self-reported co-morbidities (diabetes, high cholesterol, hypertension, arthritis), health literacy, and patient stage of weight management change. Stage of change questions were adapted from previously used questionnaires.²⁴ Health literacy was assessed using two literature-derived screening questions.²⁵ We assessed patients’ overall satisfaction with clinic services using 6 items from frequently used satisfaction questionairres²⁶ with fairly strong evidence of reliability (internal consistency and test-retest) and validity (e.g., associations with adherence, doctor shopping, disenrollment from health plans).²⁷

Visit characteristics included a measure of continuity (estimated number of times the patient had seen the physician with 0

never; 1

once; 2

2–3 times; 4

4–10 times; 5

11–20 times; 6

more than 20 times) and whether the patient considered the physician to be his or her primary care provider. Time since the intervention (measured in weeks) was included to control for seasonal (patient) and developmental (resident experience and training, decay of curriculum impact) effects. The provider characteristics included gender and physician’s patient-centeredness of care which was assessed with seven questions adapted from the RAND Patient Satisfaction Questionnaire²⁷ and the OPTION shared decision-making scales.²⁸

We piloted the survey with 20 patients in both Spanish and English to ensure that the questions were understandable, culturally appropriate, and accurately translated.

Patients and Procedures

The residents see patients at Gouverneur Healthcare Services, part of the New York City Health and Hospitals Corporation (HHC). Gouverneur serves a largely low income, underserved immigrant population (45% Hispanic (HHC internal document, August 2008)).

Fifteen nursing staff identified all patients seen by residents with a BMI ≥30 using a BMI measurement wheel. Bilingual research assistants approached patients immediately after their medical visit to invite them to be part of the study. Research assistants obtained verbal consent using a consent script (to accommodate low literacy patients). They then conducted the 15–30 minute interview in a separate room after explicitly stating that the physicians would be informed about patients’ answers. The patient interviews were conducted 1–8 months after the residents received the curriculum. Patients received a pedometer (estimated value $3.15) as compensation. The Institutional Review Boards at New York University School of Medicine and Gouverneur Healthcare Services approved this study.

Statistical Analyses

Sample Size Calculations

A priori power calculations were based on an anticipated 25% difference in the rate of obesity counseling between the intervention and control groups, adjusted for possible clustering effects²⁹. With the number of clusters (residents) fixed at 23, we calculated that we would need a minimum of five patients per resident (115 patients) to have minimum power (0.80) to detect this difference in the rate of obesity counseling assuming relatively large (e.g. conservative) intra-class correlations (ICCs) of up to 0.10.

Analysis

Our two main outcomes were rate of obesity counseling (patients who indicated that they were counseled about their weight, diet, and/or exercise were counted as ‘counseled’ ) and the quality of counseling using a 5As counseling score (calculated as the % of 19 individual 5As counseling strategies used) and an Advanced Skills Score (calculated as the % of 11 higher-level counseling strategies used). We used t-tests and chi-square statistics to assess the significance of differences between the curriculum groups in rate and quality of counseling.

Multivariate analyses assessed the impact of the curriculum on the rate of counseling (logistic regression using dichotomous counseled or not as the dependent variable) and quality of counseling (linear regression using counseling scores as dependent variables) after controlling for selected patient, visit, and provider characteristics (listed in Table 4). Independent variables were chosen based on findings of significant or nearly significant differences between intervention and control groups in order to control for the non-randomness of our design and on theory suggesting direct associations with obesity counseling (e.g., BMI, health status, and number of co-morbidities of the patient). Given the number of variables in our model, we report adjusted R².

Table 4

Hierarchical Regression Analyses with 5As Obesity Counseling Score and Advanced Skills Score as Dependent Variables

All analyses were based on an intention-to-treat model; patients of residents in the curriculum group who did not complete the curriculum were included in the analysis.

RESULTS

See Fig. 1 for the resident and patient flow chart. Of the 12 residents in the curriculum group, 11 (92%) completed the full curriculum. Four patients spoke neither English nor Spanish and were thus ineligible. Twenty-eight patients declined to participate mostly due to time constraints. Thus, we interviewed 158 patients. The average number of patients per resident was 7 (range 2–15; three residents who each saw only one patient were excluded). Twenty-one of the patients interviewed had a BMI less than 30 (26–29.99) due to inappropriate referrals and/or BMI calculation errors by staff. Of these, we chose to include patients who had a BMI that rounded to a whole number ≥30 or ≥27 with diabetes or two or more co-morbidities (as per NIH guidelines³⁰ in order to preserve sample size.

Table 2 shows the patient characteristics in the control and intervention groups. Overall, the majority of the patients were female, Hispanic, Spanish-speaking, and of low health literacy. The intervention group patients were less likely to report being in the action or maintenance stage of change and were less satisfied with their clinic experience. More time had elapsed since the intervention for the control group by design—intervention residents were on their outpatient rotations earlier where they see more patients.

Table 2

Patient and Physician Characteristics

Table 3 shows the percentage of patients counseled about weight, diet, and/or exercise in each group as well as the quality of counseling scores (5As Counseling Score and Advanced Skills) at both the resident and patient levels. For the patient-level data, the 5As counseling score is also broken down by each of the 5As categories. We found no differences in counseling rates—all residents counseled a large percent of patients (72%). While the intervention group consistently used more 5As counseling practices, these differences were not statistically significant. The Cohen’s d for the 5As counseling score and advanced skills score indicate small effects (0.20 and 0.27, respectively). Clustering effects were much smaller than we estimated for our main outcome (counseling rate-ICC

0.01) and core patient characteristics (ICCs for: BMI

0.01, self-rated health

0.01, age

0.03, gender

0.02), we did find a larger clustering effect for patient speaking Spanish (ICC

0.21). More residents in the curriculum group (5/12) than the no curriculum group (1/9) saw only Spanish-speaking patients; although the total percent of Spanish-speaking patients did not differ significantly between the intervention groups. Language-related cluster effects could be expected given that Spanish-speaking patients tend to see Spanish-speaking residents. To test whether this clustering effect impacted our results, we compared the main outcomes for residents with only Spanish-speaking patients to those with patients of mixed language and found no significant differences. These ICCs suggest that much of the variation is associated with patients rather than residents and support our decision to conduct analyses at the patient level, controlling for key covariates.

Table 3

Patient Report of Physician Obesity Counseling Performance

In the multivariate analyses, we found small but significant effects of the intervention on quality of counseling but not on the rate of counseling. Being seen by a resident in the curriculum group was not significantly associated with increased likelihood of being counseled (OR

1.94, CI .80-4.68, p

0.14) (not tabled). Patient’s BMI (OR

1.12; CI 1.01–1.24 P

0.04), stage of change (OR

3.54; CI 1.24–10.16, P

0.02), and continuity (OR

1.49; CI 1.03–2.15, P

0.03) were associated with increased odds of being counseled.

Table 4 shows hierarchical linear regression models with 5As counseling score and advanced skills score as the dependent variables. Being seen by a resident in the curriculum group was associated with receiving higher quality of counseling in both models. The standardized beta of 0.18 for participation in the curriculum suggests that, while controlling for co-variates, receiving the curriculum is associated with about a 5% increase in quality of counseling (or using approximately one additional 5As counseling practice). Other factors associated with higher quality of counseling of similar magnitude included higher BMI, better health, and having female and patient-centered providers. Factors that were negatively associated with quality of counseling included being a female patient and considering the physician to be one’s primary care provider. We found similar results when advanced skills score was the dependent variable.

DISCUSSION

While a majority of patients in our study reported being counseled, their physicians did not address most of the 5As, thus confirming the need to improve physicians’ quality of obesity counseling.⁸ Our study did not find significant bivariate differences in obesity counseling between residents in the intervention and control groups. However, when theoretically-supported patient, visit and provider characteristics were taken into account, the obesity counseling curriculum was associated with higher quality of counseling. This is encouraging giving the challenges of determining the direct effects of training on clinical care and supports efforts to train physicians to deliver high quality obesity counseling. This study also highlights that there are many factors besides physician training that influence the quality of care a patient receives.

Patients with a higher BMI were more likely to receive counseling. This is not surprising since both patients and physicians are more likely to identify obesity as a problem when patients weigh more.³¹ Higher self-reported health status was associated with higher quality physician counseling which supports previous work showing that counseling is most likely to take place when there are fewer competing issues.³² Having a female physician was associated with higher quality of obesity counseling; female physician gender has been shown to predict higher rates of preventive care counseling in other studies.³³ Greater continuity of care with the physician was associated with higher quality of counseling--physicians may have more time to counsel patients they have seen previously. Paradoxically, considering the physician to be one’s primary care provider was associated with lower quality counseling—future research is needed to confirm and elucidate whether and why this might be true. Unfortunately, female gender of the patient was associated with decreased quality of obesity counseling. This is concerning and warrants further study because obesity is more common in females.¹

While this was a largely negative study, it has important strengths. We tested the impact of our curriculum on patient care. Few studies have examined the impact of medical education interventions on real-world physician performance³⁴ possibly because attempts to show a significant impact of medical education are hindered by the relatively small anticipated effect of curricula on outcomes³⁵ when compared to the myriad of other factors that impact patient care³². Further, we developed a conceptual model and used it to identify important variables which could be expected to influence obesity counseling. While our study did not account for all potentially important factors (e.g., year of resident training, patient activation, language and/or cultural concordance) it demonstrated the need to develop more nuanced models to better identify evidence of educationally sensitive variance in outcomes. This may guide the design of future medical education studies to capture the impact of training interventions on patient outcomes.

There are several limitations to this study. Given the small sample size, our study was underpowered to detect small differences. Residents who did not receive the curriculum may have learned from their peers in the intervention group, diminishing the measured differences between the groups. Generalizability is limited because we studied only one training program, although we anticipate using a more diverse sample of residents would yield substantially larger curriculum effects. Our residents had a higher rate of counseling in both groups than is reported in the literature (>70% vs. 20–30% in other studies (14, 31)), which may have produced a ceiling effect, diminishing the detectable difference between the two groups. Post hoc power calculations suggest that we would have needed a sample size of >700 to have minimum power (0.80) to detect the simple bivariate difference in quality of counseling we found between the curricular groups (about 5%).

There are also limitations in our study design and analysis. We could not randomize the residents to the intervention due to fixed rotation schedules. While patients were blinded to intervention status, the residents were not. There may have been some variability in the quality and accuracy of weight and height measurements. The study was cross-sectional, and by not collecting data from multiple visits, we may have missed important curriculum effects. Our findings may not hold up with different patient populations although we suspect that many of the same core patient and visit characteristics will be important.

Our measures are also limited. Ideally, we would have liked to have assessed more physician and visit characteristics but were limited both by the availability of data (determined by respondent burden and resource constraints) and by our small sample size which precluded the inclusion of too many variables. We relied on patient report to assess the quality of obesity counseling which may have produced a recall bias. While patient report has been shown to be superior to physician report and chart reviews as a method to assess physician practice³⁶, we cannot determine the accuracy of patient reporting in our study.

This study suggests avenues for further research. We plan to test the impact of this obesity curriculum using larger numbers of residents from multiple institutions. We also plan to conduct longitudinal follow-up of patients to see if training physicians to deliver higher quality obesity care leads to improved outcomes such as patient activation, intention to lose weight, and weight loss.

CONCLUSIONS

A multi-modal obesity counseling curriculum using the 5As is associated with higher quality of obesity counseling after controlling for patient, visit, and provider factors in underserved patients. Future research should determine whether training physicians improves obesity care in a larger, more heterogeneous sample of physicians and patients.

Acknowledgements

Melanie Jay had full access to the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. The authors would also like to thank Jennifer Adams, Sondra Zabar, David Stevens, Mack Lipkin and the Research on Medical Education Outcomes (ROMEO) team for their consultation and contributions to this project.

Conflict of Interest None of the authors report any conflict of interest.

Footnotes

This project was funded in part from HRSA Grant 12-191-1077--Academic Administrative Units in Primary Care and by CDC Grant # 5 T01 CD000146-03--CDC Fellowship in Medicine and Public Health Research.

References

1. Ogden CL, Carroll MD, Curtin LR, McDowell MA, Tabak CJ, Flegal KM. Prevalence of overweight and obesity in the united states, 1999–2004. JAMA. 2006;295(13):1549–55. doi: 10.1001/jama.295.13.1549. [PubMed] [Cross Ref]

2. McGee DL, Diverse Populations C. Body mass index and mortality: A meta-analysis based on person-level data from twenty-six observational studies. Ann Epidemiol. 2005;15(2):87–97. doi: 10.1016/j.annepidem.2004.05.012. [PubMed] [Cross Ref]

3. Mokdad AH, Ford ES, Bowman BA, et al. Prevalence of obesity, diabetes, and obesity-related health risk factors, 2001. JAMA. 2003;289(1):76–9. doi: 10.1001/jama.289.1.76. [PubMed] [Cross Ref]

4. Larsson SC, Wolk A. Overweight and obesity and incidence of leukemia: A meta-analysis of cohort studies. Int J Cancer. 2008;122(6):1418–21. doi: 10.1002/ijc.23176. [PubMed] [Cross Ref]

5. Burke GL, Bertoni AG, Shea S, et al. The impact of obesity on cardiovascular disease risk factors and subclinical vascular disease: The multi-ethnic study of atherosclerosis. Arch Intern Med. 2008;168(9):928–35. doi: 10.1001/archinte.168.9.928. [PMC free article] [PubMed] [Cross Ref]

6. Knowler WC, Barrett-Connor E, Fowler SE, et al. Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin.see comment. N Engl J Med. 2002;346(6):393–403. doi: 10.1056/NEJMoa012512. [PMC free article] [PubMed] [Cross Ref]

7. Loureiro ML, Nayga RM., Jr Obesity, weight loss, and physician’s advice. Soc Sci Med. 2006;62(10):2458–68. doi: 10.1016/j.socscimed.2005.11.011. [PubMed] [Cross Ref]

8. Huang J, Yu H, Marin E, Brock S, Carden D, Davis T. Physicians’ weight loss counseling in two public hospital primary care clinics. Acad Med. 2004;79(2):156–61. doi: 10.1097/00001888-200402000-00012. [PubMed] [Cross Ref]

9. Ockene IS, Hebert JR, Ockene JK, et al. Effect of physician-delivered nutrition counseling training and an office-support program on saturated fat intake, weight, and serum lipid measurements in a hyperlipidemic population: Worcester area trial for counseling in hyperlipidemia (WATCH) Arch Intern Med. 1999;159(7):725–31. doi: 10.1001/archinte.159.7.725. [PubMed] [Cross Ref]

10. Martin PD, Dutton GR, Rhode PC, Horswell RL, Ryan DH, Brantley PJ. Weight loss maintenance following a primary care intervention for low-income minority women. Obesity. 2008;16(11):2462–7. doi: 10.1038/oby.2008.399. [PMC free article] [PubMed] [Cross Ref]

11. U.S. Preventive Services Task Force. Screening for obesity in adults Recommendations and rationale. See comment. Ann Intern Med. 2003;139(11):930–2. [PubMed]

12. Grundy SM, Balady GJ, Criqui MH, et al. Guide to primary prevention of cardiovascular diseases. A statement for healthcare professionals from the task force on risk reduction. American Heart Association science advisory and coordinating committee. Circulation. 1997;95(9):2329–31. [PubMed]

13. Klein S, Sheard NF, Pi-Sunyer X, et al. Weight management through lifestyle modification for the prevention and management of type 2 diabetes: Rationale and strategies. A statement of the American Diabetes Association, the North American Association for the Study of Obesity, and the American Society for Clinical Nutrition. Am J Clin Nutr. 2004;80(2):257–63. [PubMed]

14. Nawaz H, Adams ML, Katz DL. Weight loss counseling by health care providers. Am J Public Health. 1999;89(5):764–7. doi: 10.2105/AJPH.89.5.764. [PubMed] [Cross Ref]

15. O’Brien SH, Holubkov R, Reis EC. Identification, evaluation, and management of obesity in an academic primary care center. Pediatrics. 2004;114(2):e154–9. doi: 10.1542/peds.114.2.e154. [PubMed] [Cross Ref]

16. Scott JG, Cohen D, DiCicco-Bloom B, et al. Speaking of weight: How patients and primary care clinicians initiate weight loss counseling. Prev Med. 2004;38(6):819–27. doi: 10.1016/j.ypmed.2004.01.001. [PubMed] [Cross Ref]

17. Block JP, DeSalvo KB, Fisher WP. Are physicians equipped to address the obesity epidemic? knowledge and attitudes of internal medicine residents. Prev Med. 2003;36(6):669–75. doi: 10.1016/S0091-7435(03)00055-0. [PubMed] [Cross Ref]

18. Kushner RF. Barriers to providing nutrition counseling by physicians: A survey of primary care practitioners. Comment. Prev Med. 1995;24(6):546–52. doi: 10.1006/pmed.1995.1087. [PubMed] [Cross Ref]

19. Jay M, Gillespie C, Ark T, et al. Do internists, pediatricians, and psychiatrists feel competent in obesity care? using a needs assessment to drive curriculum design. JGIM. 2008;23(7):1066–1070. doi: 10.1007/s11606-008-0519-y. [PMC free article] [PubMed] [Cross Ref]

20. Serdula MK, Khan LK, Dietz WH. Weight loss counseling revisited. JAMA. 2003;289(14):1747–50. doi: 10.1001/jama.289.14.1747. [PubMed] [Cross Ref]

21. Glasgow RE, Emont S, Miller DC. Assessing delivery of the five ‘As’ for patient-centered counseling. Health Promot Int. 2006;21(3):245–55. doi: 10.1093/heapro/dal017. [PubMed] [Cross Ref]

22. Whitlock EP, Orleans CT, Pender N, Allan J. Evaluating primary care behavioral counseling interventions: An evidence-based approach. Am J Prev Med. 2002;22(4):267–84. doi: 10.1016/S0749-3797(02)00415-4. [PubMed] [Cross Ref]

23. Unrod M, Smith M, Spring B, DePue J, Redd W, Winkel G. Randomized controlled trial of a computer-based, tailored intervention to increase smoking cessation counseling by primary care physicians. J Gen Intern Med. 2007;22(4):478–84. doi: 10.1007/s11606-006-0069-0. [PMC free article] [PubMed] [Cross Ref]

24. Lamb R, Joshi MS. The stage of change model and processes of change in dietary fat reduction. J Hum Nutr Diet. 1996;9(1):43–53. doi: 10.1046/j.1365-277X.1996.00439.x. [Cross Ref]

25. Chew LD, Bradley KA, Boyko EJ. Brief questions to identify patients with inadequate health literacy. Fam Med. 2004;36(8):588–94. [PubMed]

26. Ware J, Snyder M, Wright W. Development and validation of scales to measure patient satisfaction with medical care services. vol I, part B: Results regarding scales constructed from the patient satisfaction questionnaire and measures of other health care perceptions. Springfield, VA: National Technical Information Service; 1976.

27. Marshal G, Hays RS. The patient satisfaction questionnaire short form (PS-18) California: Rand Publications; 1994.

28. Elwyn G, Edwards A, Wensing M, Hood K, Atwell C, Grol R. Shared decision making: Developing the OPTION scale for measuring patient involvement. Qual Saf Health Care. 2003;12(2):93–9. doi: 10.1136/qhc.12.2.93. [PMC free article] [PubMed] [Cross Ref]

29. Campbell MK, Thomson S, Ramsay CR, MacLennan GS, Grimshaw JM. Sample size calculator for cluster randomised trials. Comput Biol Med. 2004;34:113–25. doi: 10.1016/S0010-4825(03)00039-8. [PubMed] [Cross Ref]

30. Clinical guidelines on the identification, evaluation, and treatment of overweight and obesity in adults--the evidence report. national institutes of health. Obes Res. 1998 Sep; 6 Suppl 2:51S-209S. [PubMed]

31. Ruser CB, Sanders L, Brescia GR, et al. Identification and management of overweight and obesity by internal medicine residents. J Gen Intern Med. 2005;20(12):1139–41. doi: 10.1111/j.1525-1497.2005.0263.x. [PMC free article] [PubMed] [Cross Ref]

32. Chernof BA, Sherman SE, Lanto AB, Lee ML, Yano EM, Rubenstein LV. Health habit counseling amidst competing demands: Effects of patient health habits and visit characteristics. Med Care. 1999;37(8):738–47. doi: 10.1097/00005650-199908000-00004. [PubMed] [Cross Ref]

33. Henderson JT, Weisman CS. Physician gender effects on preventive screening and counseling: An analysis of male and female patients’ health care experiences. Med Care. 2001;39(12):1281–92. doi: 10.1097/00005650-200112000-00004. [PubMed] [Cross Ref]

34. LeCheminant JD, Jacobsen DJ, Hall MA, Donnelly JE. A comparison of meal replacements and medication in weight maintenance after weight loss. J Am Coll Nutr. 2005;24(5):347–53. [PubMed]

35. Carek PJ, Dickerson LM, Boggan H, Diaz V. A limited effect on performance indicators from resident-initiated chart audits and clinical guideline education. Fam Med. 2009;41(4):249–54. [PubMed]

36. Hrisos S, Eccles MP, Francis JJ, et al. Are there valid proxy measures of clinical behaviour? a systematic review. Implement Sci. 2009;4:37. doi: 10.1186/1748-5908-4-37. [PMC free article] [PubMed] [Cross Ref]

Articles from Journal of General Internal Medicine are provided here courtesy of
Society of General Internal Medicine