Do Internists, Pediatricians, and Psychiatrists Feel Competent in Obesity Care?: Using a Needs Assessment to Drive Curriculum Design

doi:10.1007/s11606-008-0519-y

J Gen Intern Med. 2008 July; 23(7): 1066–1070.

Published online 2008 July 10. doi: 10.1007/s11606-008-0519-y

PMCID: PMC2517928

Do Internists, Pediatricians, and Psychiatrists Feel Competent in Obesity Care?

Using a Needs Assessment to Drive Curriculum Design

Melanie Jay, MD,^1,³ Colleen Gillespie, PhD,¹ Tavinder Ark, BSc MSc,¹ Regina Richter, MA,¹ Michelle McMacken, MD,¹ Sondra Zabar, MD,¹ Steven Paik, MD, EdM,² Mary Jo Messito, MD,² Joshua Lee, MD, MS,¹ and Adina Kalet, MD, MPH¹

¹Division of General Internal Medicine, New York University School of Medicine, New York, NY USA

²Department of Pediatrics, New York University School of Medicine, New York, NY USA

³VA New York Harbor, New York, NY USA

Melanie Jay, Phone: +1-917-6677376, Fax: +1-212-2634240, Email: Jaym01/at/med.nyu.edu.

Corresponding author.

This article has been cited by other articles in PMC.

Abstract

BACKGROUND

Physicians must effectively evaluate and treat obesity. To design a needs-driven curriculum intended to improve patient outcomes, physicians were surveyed about their self-perceived knowledge and skills.

OBJECTIVE

The objective of this study was to determine the expressed needs of residents and faculty regarding obesity care training across three specialties.

DESIGN

The study used a survey given to faculty and residents in General Internal Medicine, Pediatrics, and Psychiatry.

METHODS

Survey questions were generated from comprehensive nutrition curriculum and clinical recommendations, administered online, and then organized around a validated behavioral health framework—the 5As (assess, advise, agree, assist, arrange). Analyses were conducted to evaluate differences in perceived knowledge and skills between specialties and across training levels.

RESULTS

From an overall response rate of 65% (65 residents and 250 faculty members), nearly 20% reported inadequate competency in every item with 48% of respondents reporting an inability to adequately counsel patients about common treatment options. Internists reported the lowest competency in arranging referrals and follow-up. Psychiatrists reported the lowest competency in assessment skills.

CONCLUSIONS

This survey demonstrated a critical need for training in specific areas of obesity care. The proposed curriculum targets these areas taking into consideration observed differences across specialties.

Key words: obesity care, weight loss, medical education (education, medical), obesity, curriculum

BACKGROUND

Despite guidelines established by the U.S. Preventive Services Task Force (USPSTF),¹ the American Diabetes Association,² and the Maternal and Child Health Bureau³, physicians frequently fail to counsel obese patients about their weight. In a recent study, counseling about excess weight occurred in only 17% of 376 encounters with overweight or obese patients.⁴ Even when physicians advise patients to lose weight, they may not do so effectively. Of obese patients in two clinics, 79% of patients recalled being counseled to lose weight, and only 28% of these recalled being given specific weight loss recommendations. Of these, 17% remembered discussion of dietary modification, and 5% recalled a strategy combining diet and exercise,⁵ suggesting a real deficiency in physician counseling techniques that are teachable.

Physicians report lack of training in obesity management.⁵^–⁷ In one survey, only 31% reported that they learned good obesity management in residency; interestingly, those who did were more likely to discuss diet or exercise with obese patients (59% vs 29%).⁸ This identifies lack of training as one reason why physicians insufficiently counsel obese patients.

The 5As is a counseling strategy recommended by the USPSTF⁹ that is useful in several areas of office-based counseling including smoking cessation,¹⁰^,¹¹ lowering cholesterol,¹² and weight loss.¹³ The 5As framework guides the physician to Assess risk, current behavior, and readiness to change, Advise change of specific behaviors, Agree and collaboratively set goals, Assist in addressing barriers and securing support, and Arrange for follow-up.⁹^,¹³ As part of an initiative to develop a needs-targeted obesity curriculum, we surveyed faculty and residents about their self-perceived skills. We then used the 5As model to organize competencies and identify areas for residency training and faculty development.

METHODS

Participants

We emailed all senior residents at New York University School of Medicine (NYUSoM) in Internal Medicine (IM), Pediatrics (Peds), and Psychiatry (Psych) asking them to complete an online survey. Faculty lists were obtained from NYUSoM administrators in the Divisions of IM, Peds, and Psych. We excluded faculty who had no working email address, were retired, had left the institution, were non-MDs, or were neonatologists. Over the course of a 3-month period, we reminded residents and faculty each 8 times to complete the survey.

Survey Design

We compiled survey items assessing physicians’ perceived competency in treating and preventing obesity through a review of a comprehensive curriculum¹⁴ and clinical¹⁵^,¹⁶ recommendations. Demographic items for residents included training year and previous obesity training, whereas for faculty, they included years since residency, location of main outpatient practice, hours per week in outpatient practice, percent of obese patients, percent of obese patients who lose weight, and teaching responsibilities. Expert faculty ranked the competencies’ salience and suggested missing items. The final 15 items were arranged in random order. Slight survey modifications were made for pediatricians, as counseling and assessment often occur at the caregiver level.

We assessed competency using a 4-point scale derived from the “see one, do one, teach one” tradition and shown previously to distinguish mean competency levels between residents who participated in a curriculum and those who did not.¹⁷ The response options were: Know very little about and not able to perform (1); Know something about and somewhat able to perform (2); Able to perform well (3); and Able to teach others how to perform (4). Responses 1 and 2 were considered to be inadequate competency, whereas 3 and 4 were adequate.

Measurement and Analysis

Questions were grouped according to the 5As model using published guidelines,⁹^,¹³ maximizing internal reliability. We performed a repeated measures analysis of variance (ANOVA) with training level (faculty/residents) and specialty (IM/Peds/Psych) included as the between-subject grouping factor. The 5As were included as the within-subjects repeated measures; post hoc testing employed a Bonferroni correction. ANOVAs were conducted to explore whether differences existed between the 5As, specialty, and physician level. Pearson correlations, t tests, ANOVA, and chi-squares were performed on continuous and categorical variables, respectively, between overall mean competency and each possible predictor variable. Any significant results were included in the ANOVA and a multiple regression analysis.

This study was approved by the institutional review board at NYU.

RESULTS

Participants

We received completed surveys from 65 of 87 (75%) residents. After excluding 150 faculty (77 no longer at the institution, 11 collaborators in this study, 38 without working emails, and 24 non-physicians or neonatologists), we sent surveys to 399 faculty (158 internists, 81 pediatricians, and 160 psychiatrists). The response rate for faculty was 63% (59% IM, 73% Peds, 61% Psych), yielding an overall response rate of 65%.

Table 1 describes demographic data for the faculty and residents. Approximately two thirds of residents had previous obesity training. The mean percentage of obese patients seen by faculty was 25%, with IM faculty reporting a higher percentage than psychiatry (35% vs 19%, p

.02). Pediatricians reported significantly fewer patients losing weight (7.7% Peds vs 15.3% IM vs 19.4% Psych; p

.006).

Table 1

Demographics

Competencies

The mean overall competency score for all participants was 2.8 (SD

.57). The mean score for each competency ranged from 2.6 to 3.0 across all specialties, and responses were normally distributed with no overall difference between residents and faculty. The differences among the mean scores of the different specialties (Peds

3.0, SD

.57; IM

2.8, SD

.53; Psych

2.7, SD

.62) approached significance (p

.05). Demographic factors did not correlate with competency.

Table 2 shows how individual items were categorized according to the 5As model. The internal consistency for each category, as measured by Cronbach’s alpha, ranged from .77 to .90. The mean score for each competency ranged from 2.6 to 2.9 across all specialties. The mean score for ‘assist’ (2.6) was significantly lower than all the other competencies (p

.005), followed by ‘agree’ (2.7), which was significantly different from every category except ‘arrange’ (p

.05). The repeated measures ANOVA analysis found an interaction between specialty and 5As competencies, with Psych reporting significantly lower competency in ‘assess’ (p

.02) and IM reporting significantly lower competency in ‘arrange’ (p

.001) than the other specialties. Additionally, for the ‘advise’ category, an interaction between physician level (faculty vs resident) and specialty was identified, with IM faculty scoring higher than residents (p

.03).

Table 2

Self-Rated Physician Competency of Individual Survey Items (% Inadequate Competency)*

Table 2 also presents individual item responses. Nearly 20% of physicians reported inadequate competency for each item. In the ‘assess ‘category, pediatricians reported higher competency in taking a diet history and assessing diet than the other specialties (6.5% inadequate vs >20% in IM/Psych, p

.001), whereas psychiatrists reported lower competency in performing a history and physical exam (53% inadequate, p

.001), determining body mass index (BMI; 32% inadequate, p

.001), and ascertaining patients’ readiness to change (49% inadequate, p

.004). For ‘advise,’ nearly half of physicians could not adequately respond to a patient’s questions regarding treatment options for obesity, with no significant difference across specialties. For ‘agree,’ more than 34% of physicians could not set weight loss, lifestyle, and physical activity goals adequately. In the ‘assist’ category, 59% of physicians reported inadequate competency using motivational interviewing, and 39% could not adequately provide a brief weight-loss counseling intervention. Finally, for ‘arrange,’ internists reported being less competent at referring patients for eating disorders (42% inadequate, p

.001), whereas pediatricians reported being significantly better at collaborating with dietitians and referring to community resources than other specialties (20% inadequate, p

.002).

DISCUSSION

In this study, we identified important areas of focus for future curriculum development, implementation, and evaluation. Findings indicate that physicians across three specialties report inadequate obesity counseling skills, and the mean overall competency was low. Astonishingly, 1 in 5 physicians rated themselves as inadequately competent in every item, and almost 60% could not adequately use motivational interviewing to change behavior. These findings indicate a clear need for targeted evidenced-based curricula.

No significant difference in mean competency scores was found between residents and faculty. While this finding could indicate a limitation of our survey to distinguish between training levels, it more likely signifies that faculty education is needed, as number of years out of residency did not correlate to competency. Other studies have shown a general lack of training for both residents and faculty⁷^,⁵ and that faculty development is a barrier to obesity education.¹⁸ Thus, faculty training must be incorporated into the curriculum to ensure its success.

This study validates the 5As model construct, leading to more trustworthy overall discipline-specific data upon which to develop obesity curricula likely to improve patient outcomes. Overall, physicians reported lower mean scores in ‘agree’ and ‘assist’ than for most of the other competencies, which reflects deficiencies in goal-setting and motivational interviewing—both teachable skills.¹⁹

Internists had lower competency in ‘arrange’ as compared to other specialties. Specifically, they had low perceived competency in recognizing and referring patients with eating disorders, collaborating with dieticians, and referring to community nutrition resources. These issues can be addressed in a targeted curriculum. IM residents also had lower perceived competency in ‘advise’ than faculty, which may indicate either that residents are less comfortable advising patients or that they have more need for didactic information regarding obesity risk and treatment options. Pediatricians reported higher competency than other specialties in some items (assessing diet, collaborating with dieticians, and referring to community nutrition resources); thus, these areas could be de-emphasized in their curriculum. Interestingly, pediatric faculty reported a lower percentage of obese patients losing weight than the other specialties despite the higher level of perceived competency.

Psychiatrists were less competent in ‘assess’ than other specialties. Supporting this finding is that psychiatrists reported significantly fewer obese patients than internists, although obesity is more prevalent in their population.²⁰ Specifically, psychiatrists scored lowest on determining body mass index, ascertaining readiness to change, taking a targeted history and physical exam, and setting weight loss and physical activity goals with patients. These are all useful guides for curriculum development.

There are several limitations to this study. First, we relied on self-report rather than using direct methods (i.e., standardized tests, direct observation, and chart review) to test knowledge, skills, and patient outcomes. While studies have shown that physicians are poor at accurately evaluating their own skills,²¹ our findings are consistent with studies measuring physician performance.⁴^,²²^,²³ Second, the physicians surveyed were from one institution which may limit the generalizability of our findings. Counter to that is the fact that study participants practice in a variety of different public and private practice settings across three different specialties. Further, only 15% of NYU residents are graduates of NYUSoM, suggesting that obesity training is insufficient at other institutions as well.

CURRICULUM DEVELOPMENT

Based on the above findings, we developed a curriculum to address specific gaps in knowledge and skills (Table 3) with the goal of improving obesity care in the outpatient setting. By tailoring the curriculum to meet specific learner needs, we aim to increase the efficacy of training, thereby positively influencing patient health outcomes. Interactive didactic sessions provide the core knowledge-based components complemented by skill practice sessions using standardized patients in individual and group settings. Later, learners will apply these skills at a weight management preceptorship. We will experiment with a variety of curriculum implementation approaches including computer-assisted instruction and cross-disciplinary sessions. Faculty development and training will be a crucial component. Finally, we will adapt the curriculum for each specialty based on the specialty-specific strengths and weaknesses that we identified.

Table 3

Components of Obesity Curriculum

Next steps include assessing the efficacy of such training by studying its impact on physician behavior and patient outcomes modeled on the work of Glasgow et al.²⁴ who have developed tools to assess the 5As in office practice. Directly linking educational interventions like this one to patient outcomes will allow for the development of curricular models and the creation of a richer evidence base in obesity training. Physicians from various specialties who see patients longitudinally have an opportunity and a responsibility to prevent and treat obesity. This will not happen, however, without adequate training. A needs-driven, evidenced-based obesity curriculum is the crucial first step in providing effective training in obesity care.

Acknowledgment

We would like to thank the Health Resources and Services Administration (HRSA), Academic Administrative Units in Primary Care for funding this project. We would also like to thank Scott Sherman and Mack Lipkin for their help with this manuscript.

Grant Funding: 12-191-1077 Health Resources and Services Administration (HRSA), Academic Administrative Units in Primary Care, 11/05–11/08.

Conflict of Interest None disclosed.

References

1. U.S. Preventive Services Task Force. Screening for obesity in adults: Recommendations and rationale. See comment. Ann Intern Med. 2003;139(11):930–2. (Dec 2). [PubMed]

2. Klein S, Sheard NF, Pi-Sunyer X, et al. Weight management through lifestyle modification for the prevention and management of type 2 diabetes: Rationale and strategies. A statement of the American Diabetes Association the North American Association for the Study of Obesity and the American Society for Clinical Nutrition. Am J Clin Nutr. 2004;80(22):57–63. (Aug). [PubMed]

3. Barlow SE, Dietz WH. Obesity evaluation and treatment: Expert committee recommendations. The Maternal and Child Health Bureau, Health Resources and Services. Administration and the Department of Health and Human Services. Pediatrics. 1998;10(23):E29. (Sep). [PubMed]

4. Scott JG, Cohen D, DiCicco-Bloom B, et al. Speaking of weight: How patients and primary care clinicians initiate weight loss counseling. Prev Med. 2004;38(6):819–27. (Jun). [PubMed]

5. Huang J, Yu H, Marin E, Brock S, Carden D, Davis T. Physicians’ weight loss counseling in two public hospital primary care clinics. Acad Med. 2004;79(2):156–61. (Feb). [PubMed]

6. Block JP, DeSalvo KB, Fisher WP. Are physicians equipped to address the obesity epidemic? Knowledge and attitudes of internal medicine residents. Prev Med. 2003;36(6):669–75. (Jun). [PubMed]

7. Kushner RF. Barriers to providing nutrition counseling by physicians: A survey of primary care practitioners comment. Prev Med. 1995;24(6):546–52. (Nov). [PubMed]

8. Forman-Hoffman V, Little A, Wahls T. Barriers to obesity management: A pilot study of primary care clinicians. BMC Fam Pract. 2006;7:35. [PMC free article] [PubMed]

9. Whitlock EP, Orleans CT, Pender N, Allan J. Evaluating primary care behavioral counseling interventions: An evidence-based approach. Am J Prev Med. 2002/5;22(4):267–84. [PubMed]

10. Unrod M, Smith M, Spring B, DePue J, Redd W, Winkel G. Randomized controlled trial of a computer-based, tailored intervention to increase smoking cessation counseling by primary care physicians. J Gen Intern Med. 2007;22(4):478–84. (Apr). [PMC free article] [PubMed]

11. The Tobacco Use and Dependence Clinical Practice Guideline Panel, Staff, and Consortium Representatives. A clinical practice guideline for treating tobacco use and dependence: A US Public Health Service report.. The tobacco use and dependence clinical practice guideline panel, staff, and consortium representatives. JAMA. 2000;283(24):3244–54. (Jun 28). [PubMed]

12. Ockene IS, Hebert J, Ockene JK, et al. Effect of physician-delivered nutrition counseling training and an office-support program on saturated fat intake, weight, and serum lipid measurements in a hyperlipidemic population: Worcester area trial for counseling in hyperlipidemia (WATCH). Arch Intern Med. 1999;159(7):725–31. (Apr 12). [PubMed]

13. Serdula MK, Khan LK, Dietz WH. Weight loss counseling revisited. JAMA. 2003;289(14):1747–50. (Apr 9). [PubMed]

14. Group on Nutrition, Society of Teachers of Family Medicine, editor. Physician’s curriculum in primary care. 2001; Updated 2005.

15. Sadovsky R. Management of obesity: An official recommendation. Am Fam Phys. 2003;67(2):379.

16. National Heart, Lung, and Blood Institute Obesity Education Initiative, editor. Expert Panel on the Identification, Evaluation, and Treatment of Overweight and Obesity in Adults. Clinical guidelines on the identification, evaluation, and treatment of overweight and obesity in adults: Evidence report. Bethesda, MD: NIH Publication No. 98-4083; 1998.

17. Yedidia MJ, Gillespie CC, Moore GT. Specific clinical competencies for managing care: Views of residency directors and managed care medical directors. JAMA. 2000;284(9):1093–8. (Sep 6). [PubMed]

18. Goff SL, Holmboe ES, Curry L. Barriers to obesity training for pediatric residents: A qualitative exploration of residency director perspectives. Teach Learn Med. 2006;18(4):348–55. [PubMed]

19. Rubak S, Sandbaek A, Lauritzen T, Borch-Johnsen K, Christensen B. An education and training course in motivational interviewing influence: GPs’ professional behaviour—ADDITION Denmark. Br J Gen Pract. 2006;56(527):429–36. (Jun). [PMC free article] [PubMed]

20. John U, Meyer C, Rumpf HJ, Hapke U. Relationships of psychiatric disorders with overweight and obesity in an adult general population. Obes Res. 2005;13(1):101–9. (Jan). [PubMed]

21. Davis DA, Mazmanian PE, Fordis M, Van Harrison, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: A systematic review [see comment]. JAMA. 2006;296(9):1094–102. (Sep 6). [PubMed]

22. Ruser CB, Sanders L, Brescia G, et al. Identification and management of overweight and obesity by internal medicine residents. J Gen Intern Med. 2005;20(12):1139–41. (Dec). [PMC free article] [PubMed]

23. Eaton CB, Goodwin MA, Stange KC. Direct observation of nutrition counseling in community family practice. Am J Prev Med. 2002;23(3):174–9. (Oct). [PubMed]

24. Glasgow RE, Emont S, Miller DC. Assessing delivery of the five ‘As’ for patient-centered counseling. Health Promot Int. 2006;21(3):245–55. (Sep). [PubMed]

Articles from Journal of General Internal Medicine are provided here courtesy of
Society of General Internal Medicine