PMCC PMCC

Search tips
Search criteria

Advanced
Results 1-25 (520880)

Clipboard (0)
None

Related Articles

1.  Impact of subspecialty elective exposures on outcomes on the American board of internal medicine certification examination 
BMC Medical Education  2012;12:94.
Background
The American Board of Internal Medicine Certification Examination (ABIM-CE) is one of several methods used to assess medical knowledge, an Accreditation Council for Graduate Medical Education (ACGME) core competency for graduating internal medicine residents. With recent changes in graduate medical education program directors and internal medicine residents are seeking evidence to guide decisions regarding residency elective choices. Prior studies have shown that formalized elective curricula improve subspecialty ABIM-CE scores. The primary aim of this study was to evaluate whether the number of subspecialty elective exposures or the specific subspecialties which residents complete electives in impact ABIM-CE scores.
Methods
ABIM-CE scores, elective exposures and demographic characteristics were collected for MedStar Georgetown University Hospital internal medicine residents who were first-time takers of the ABIM-CE in 2006–2010 (n=152). Elective exposures were defined as a two-week period assigned to the respective subspecialty. ABIM-CE score was analyzed using the difference between the ABIM-CE score and the standardized passing score (delta-SPS). Subspecialty scores were analyzed using percentage of correct responses. Data was analyzed using GraphPad Prism version 5.00 for Windows.
Results
Paired elective exposure and ABIM-CE scores were available in 131 residents. There was no linear correlation between ABIM-CE mean delta-SPS and the total number of electives or the number of unique elective exposures. Residents with ≤14 elective exposures had higher ABIM-CE mean delta-SPS than those with ≥15 elective exposures (143.4 compared to 129.7, p=0.051). Repeated electives in individual subspecialties were not associated with significant difference in mean ABIM-CE delta-SPS.
Conclusions
This study did not demonstrate significant positive associations between individual subspecialty elective exposures and ABIM-CE mean delta-SPS score. Residents with ≤14 elective exposures had higher ABIM-CE mean delta-SPS than those with ≥15 elective exposures suggesting there may be an “ideal” number of elective exposures that supports improved ABIM-CE performance. Repeated elective exposures in an individual specialty did not correlate with overall or subspecialty ABIM-CE performance.
doi:10.1186/1472-6920-12-94
PMCID: PMC3480921  PMID: 23057635
Resident education; Gender; Elective; Subspecialty; Graduate medical education
2.  Educational Milestone Development in the First 7 Specialties to Enter the Next Accreditation System 
Background
The Accreditation Council for Graduate Medical Education (ACGME) Outcome Project introduced 6 general competencies relevant to medical practice but fell short of its goal to create a robust assessment system that would allow program accreditation based on outcomes. In response, the ACGME, the specialty boards, and other stakeholders collaborated to develop educational milestones, observable steps in residents' professional development that describe progress from entry to graduation and beyond.
Objectives
We summarize the development of the milestones, focusing on 7 specialties, moving to the next accreditation system in July 2013, and offer evidence of their validity.
Methods
Specialty workgroups with broad representation used a 5-level developmental framework and incorporated information from literature reviews, specialty curricula, dialogue with constituents, and pilot testing.
Results
The workgroups produced richly diverse sets of milestones that reflect the community's consideration of attributes of competence relevant to practice in the given specialty. Both their development process and the milestones themselves establish a validity argument, when contemporary views of validity for complex performance assessment are used.
Conclusions
Initial evidence for validity emerges from the development processes and the resulting milestones. Further advancing a validity argument will require research on the use of milestone data in resident assessment and program accreditation.
doi:10.4300/JGME-05-01-33
PMCID: PMC3613328  PMID: 24404235
3.  A Qualitative Study of Improving Preceptor Feedback Delivery on Professionalism to Postgraduate Year 1 Residents Through Education, Observation, and Reflection 
The Ochsner Journal  2013;13(3):322-326.
Background
To better standardize the teaching of professionalism, the American Board of Internal Medicine and the Accreditation Council for Graduate Medical Education established competency-based training milestones for internal medicine residency programs. Accordingly, professionalism milestones served as the basis for a faculty development program centered on providing feedback to postgraduate year 1 residents (interns) on their own professionalism behaviors during preceptor-resident sessions in the internal medicine continuity clinic.
Methods
To determine the level of faculty (n=8) understanding and comfort in providing feedback, surveys listing 12-month professionalism milestones were distributed to core internal medicine teaching faculty. Current interns (n=10) also rated their understanding of the same milestones. The faculty development program included interpersonal communication education, role-plays of difficult situations, and pocket resources, as well as direct feedback on videotaped sessions with residents. At the end of the intervention period, participating faculty completed a postdevelopment survey, and the current 6-month interns completed a follow-up assessment.
Results
Average ratings between the pre- and postintervention teaching faculty surveys fell approximately 0.25%-0.50% on all measures of understanding, but increased slightly on measures of comfort. Conversely, average ratings between the pre- and postintervention 6-month intern surveys generally increased 0.25%-0.50% for measures of comfort and understanding.
Conclusions
The faculty perceived the intervention as helpful in teaching them to focus on behaviors that change the context of overall feedback delivery. However, the study results showed that the system in place was not conducive to implementing such a program without modification and the introduction of resources.
PMCID: PMC3776506  PMID: 24052760
Graduate medical education; quality improvement
4.  Operationalizing the Internal Medicine Milestones–An Early Status Report 
Background
The internal medicine milestones were developed to advance outcomes-based residency training and will play an important role in the next accreditation system.
Innovation
As an element of our program's participation in the internal medicine educational innovations project, we implemented a milestones-based evaluation process in our general medicine and pulmonary-critical care rotations on July 1, 2010.
Measures
Outcomes assessed included survey-rated acceptability to participating faculty, residents, and clinical competency committee members.
Results
Faculty and residents agreed that the milestones promoted a common understanding of what knowledge, skills, and attitudes should be displayed at particular points in residents' professional development and enhanced evaluators' ability to provide specific performance feedback. Most residents and faculty members agreed that the milestones promoted fairness and uniformity in the evaluation process. Clinical competency committee members agreed the milestones improved the quality of information available for deliberations and resulted in more uniform promotion standards. Faculty rated the use of too many milestones per form/tool at a mean of 7.3 (where 1 was minimally problematic, and 10 was maximally problematic) and the potential for evaluator fatigue (mean, 8.2) as the most significant challenges to the use of milestones. Eight of 12 faculty members would recommend milestones in other programs; 4 were uncertain.
Conclusions
Despite logistical challenges, educators and trainees found that milestones promoted a common understanding of what knowledge, skills and attitudes should be displayed at particular stages of training; permitted greater specificity in performance feedback; and enhanced uniformity and fairness in promotion decisions.
doi:10.4300/JGME-D-12-00130.1
PMCID: PMC3613298  PMID: 24404240
5.  The Pediatrics Milestones: Conceptual Framework, Guiding Principles, and Approach to Development 
Background
The Accreditation Council for Graduate Medical Education (ACGME) and the American Board of Pediatrics (ABP) have partnered to initiate the Pediatrics Milestone Project to further refine the 6 ACGME competencies and to set performance standards as part of the continued commitment to document outcomes of training and program effectiveness.
Intervention
Members of the Pediatrics Milestone Project Working Group searched the medical literature and beyond to create a synopsis of models and evidence for a developmental ontogeny of the elements for 52 subcompetencies. For each subcompetency, we created a series of Milestones, grounded in the literature. The milestones were vetted with the entire working group, engaging in an iterative process of revisions until reaching consensus that their narrative descriptions (1) included all critical elements, (2) were behaviorally based, (3) were properly sequenced, and (4) represented the educational continuum of training and practice.
Outcomes
We have completed the first iteration of milestones for all subcompetencies. For each milestone, a synopsis of relevant literature provides background, references, and a conceptual framework. These milestones provide narrative descriptions of behaviors that represent the ontogeny of knowledge, skill, and attitude development across the educational continuum of training and practice.
Discussion
The pediatrics milestones take us a step closer to meaningful outcome assessment. Next steps include undertaking rigorous study, making appropriate modifications, and setting performance standards. Our aim is to assist program directors in making more reliable and valid judgments as to whether a resident is a “good doctor” and to provide outcome evidence regarding the program's success in developing doctors.
doi:10.4300/JGME-D-10-00126.1
PMCID: PMC2951782  PMID: 21976091
6.  Accreditation council for graduate medical education (ACGME) annual anesthesiology residency and fellowship program review: a "report card" model for continuous improvement 
BMC Medical Education  2010;10:13.
Background
The Accreditation Council for Graduate Medical Education (ACGME) requires an annual evaluation of all ACGME-accredited residency and fellowship programs to assess program quality. The results of this evaluation must be used to improve the program. This manuscript describes a metric to be used in conducting ACGME-mandated annual program review of ACGME-accredited anesthesiology residencies and fellowships.
Methods
A variety of metrics to assess anesthesiology residency and fellowship programs are identified by the authors through literature review and considered for use in constructing a program "report card."
Results
Metrics used to assess program quality include success in achieving American Board of Anesthesiology (ABA) certification, performance on the annual ABA/American Society of Anesthesiology In-Training Examination, performance on mock oral ABA certification examinations, trainee scholarly activities (publications and presentations), accreditation site visit and internal review results, ACGME and alumni survey results, National Resident Matching Program (NRMP) results, exit interview feedback, diversity data and extensive program/rotation/faculty/curriculum evaluations by trainees and faculty. The results are used to construct a "report card" that provides a high-level review of program performance and can be used in a continuous quality improvement process.
Conclusions
An annual program review is required to assess all ACGME-accredited residency and fellowship programs to monitor and improve program quality. We describe an annual review process based on metrics that can be used to focus attention on areas for improvement and track program performance year-to-year. A "report card" format is described as a high-level tool to track educational outcomes.
doi:10.1186/1472-6920-10-13
PMCID: PMC2830223  PMID: 20141641
7.  The research rotation: competency-based structured and novel approach to research training of internal medicine residents 
Background
In the United States, the Accreditation Council of graduate medical education (ACGME) requires all accredited Internal medicine residency training programs to facilitate resident scholarly activities. However, clinical experience and medical education still remain the main focus of graduate medical education in many Internal Medicine (IM) residency-training programs. Left to design the structure, process and outcome evaluation of the ACGME research requirement, residency-training programs are faced with numerous barriers. Many residency programs report having been cited by the ACGME residency review committee in IM for lack of scholarly activity by residents.
Methods
We would like to share our experience at Lincoln Hospital, an affiliate of Weill Medical College Cornell University New York, in designing and implementing a successful structured research curriculum based on ACGME competencies taught during a dedicated "research rotation".
Results
Since the inception of the research rotation in 2004, participation of our residents among scholarly activities has substantially increased. Our residents increasingly believe and appreciate that research is an integral component of residency training and essential for practice of medicine.
Conclusion
Internal medicine residents' outlook in research can be significantly improved using a research curriculum offered through a structured and dedicated research rotation. This is exemplified by the improvement noted in resident satisfaction, their participation in scholarly activities and resident research outcomes since the inception of the research rotation in our internal medicine training program.
doi:10.1186/1472-6920-6-52
PMCID: PMC1630691  PMID: 17044924
8.  Duty Hour Recommendations and Implications for Meeting the ACGME Core Competencies: Views of Residency Directors 
Mayo Clinic Proceedings  2011;86(3):185-191.
OBJECTIVE: To describe the views of residency program directors regarding the effect of the 2010 duty hour recommendations on the 6 core competencies of graduate medical education.
METHODS: US residency program directors in internal medicine, pediatrics, and general surgery were e-mailed a survey from July 8 through July 20, 2010, after the 2010 Accreditation Council for Graduate Medical Education (ACGME) duty hour recommendations were published. Directors were asked to rate the implications of the new recommendations for the 6 ACGME core competencies as well as for continuity of inpatient care and resident fatigue.
RESULTS: Of 719 eligible program directors, 464 (65%) responded. Most program directors believe that the new ACGME recommendations will decrease residents' continuity with hospitalized patients (404/464 [87%]) and will not change (303/464 [65%]) or will increase (26/464 [6%]) resident fatigue. Additionally, most program directors (249-363/464 [53%-78%]) believe that the new duty hour restrictions will decrease residents' ability to develop competency in 5 of the 6 core areas. Surgery directors were more likely than internal medicine directors to believe that the ACGME recommendations will decrease residents' competency in patient care (odds ratio [OR], 3.9; 95% confidence interval [CI], 2.5-6.3), medical knowledge (OR, 1.9; 95% CI, 1.2-3.2), practice-based learning and improvement (OR, 2.7; 95% CI, 1.7-4.4), interpersonal and communication skills (OR, 1.9; 95% CI, 1.2-3.0), and professionalism (OR, 2.5; 95% CI, 1.5-4.0).
CONCLUSION: Residency program directors' reactions to ACGME duty hour recommendations demonstrate a marked degree of concern about educating a competent generation of future physicians in the face of increasing duty hour standards and regulation.
The reactions of residency program directors to the ACGME duty hour recommendations demonstrate a marked degree of concern about educating a competent generation of future physicians in the face of increasing duty hour standards and regulation.
doi:10.4065/mcp.2010.0635
PMCID: PMC3046937  PMID: 21307391
9.  The State of Evaluation in Internal Medicine Residency 
Journal of General Internal Medicine  2008;23(7):1010-1015.
Background
There are no nationwide data on the methods residency programs are using to assess trainee competence. The Accreditation Council for Graduate Medical Education (ACGME) has recommended tools that programs can use to evaluate their trainees. It is unknown if programs are adhering to these recommendations.
Objective
To describe evaluation methods used by our nation’s internal medicine residency programs and assess adherence to ACGME methodological recommendations for evaluation.
Design
Nationwide survey.
Participants
All internal medicine programs registered with the Association of Program Directors of Internal Medicine (APDIM).
Measurements
Descriptive statistics of programs and tools used to evaluate competence; compliance with ACGME recommended evaluative methods.
Results
The response rate was 70%. Programs were using an average of 4.2–6.0 tools to evaluate their trainees with heavy reliance on rating forms. Direct observation and practice and data-based tools were used much less frequently. Most programs were using at least 1 of the Accreditation Council for Graduate Medical Education (ACGME)’s “most desirable” methods of evaluation for all 6 measures of trainee competence. These programs had higher support staff to resident ratios than programs using less desirable evaluative methods.
Conclusions
Residency programs are using a large number and variety of tools for evaluating the competence of their trainees. Most are complying with ACGME recommended methods of evaluation especially if the support staff to resident ratio is high.
doi:10.1007/s11606-008-0578-0
PMCID: PMC2517950  PMID: 18612734
graduate medical education; residency; ACGME; competency
10.  Meeting Requirements and Changing Culture 
Journal of General Internal Medicine  2004;19(5 Pt 2):492-495.
The Accreditation Council of Graduate Medical Education (ACGME) and the Residency Review Committee require a competency-based, accessible evaluation system. The paper system at our institution did not meet these demands and suffered from low compliance. A diverse committee of internal medicine faculty, program directors, and house staff designed a new clinical evaluation strategy based on ACGME competencies and utilizing a modular web-based system called ResEval. ResEval more effectively met requirements and provided useful data for program and curriculum development. The system is paperless, allows for evaluations at any time, and produces customized evaluation reports, dramatically improving our ability to analyze evaluation data. The use of this novel system and the inclusion of a robust technology infrastructure, repeated training and e-mail reminders, and program leadership commitment resulted in an increase in clinical skills evaluations performed and a rapid change in the workflow and culture of evaluation at our residency program.
doi:10.1111/j.1525-1497.2004.30065.x
PMCID: PMC1492338  PMID: 15109310
house staff evaluation; clinical skills assessment; internal medicine residency; Internet; educational measurement
11.  Are Commonly Used Resident Measurements Associated with Procedural Skills in Internal Medicine Residency Training? 
Background
Acquisition of competence in performing a variety of procedures is essential during Internal Medicine (IM) residency training.
Purposes
Determine the rate of procedural complications by IM residents; determine whether there was a correlation between having 1 or more complications and institutional procedural certification status or attending ratings of resident procedural skill competence on the American Board of Internal Medicine (ABIM) monthly evaluation form (ABIM-MEF). Assess if an association exists between procedural complications and in-training examination and ABIM board certification scores.
Methods
We retrospectively reviewed all procedure log sheets, procedural certification status, ABIM-MEF procedural skills ratings, in-training exam and certifying examination (ABIM-CE) scores from the period 1990–1999 for IM residency program graduates from a training program.
Results
Among 69 graduates, 2,212 monthly procedure log sheets and 2,475 ABIM-MEFs were reviewed. The overall complication rate was 2.3/1,000 procedures (95% CI: 1.4–3.1/1,000 procedure). With the exception of procedural certification status as judged by institutional faculty, there was no association between our resident measurements and procedural complications.
Conclusions
Our findings support the need for a resident procedural competence certification system based on direct observation. Our data support the ABIM’s action to remove resident procedural competence from the monthly ABIM-MEF ratings.
doi:10.1007/s11606-006-0068-1
PMCID: PMC1824756  PMID: 17356968
procedural skills; Internal Medicine residency training program; ABIM evaluation
12.  Are Commonly Used Resident Measurements Associated with Procedural Skills in Internal Medicine Residency Training? 
Background
Acquisition of competence in performing a variety of procedures is essential during Internal Medicine (IM) residency training.
Purposes
Determine the rate of procedural complications by IM residents; determine whether there was a correlation between having 1 or more complications and institutional procedural certification status or attending ratings of resident procedural skill competence on the American Board of Internal Medicine (ABIM) monthly evaluation form (ABIM-MEF). Assess if an association exists between procedural complications and in-training examination and ABIM board certification scores.
Methods
We retrospectively reviewed all procedure log sheets, procedural certification status, ABIM-MEF procedural skills ratings, in-training exam and certifying examination (ABIM-CE) scores from the period 1990–1999 for IM residency program graduates from a training program.
Results
Among 69 graduates, 2,212 monthly procedure log sheets and 2,475 ABIM-MEFs were reviewed. The overall complication rate was 2.3/1,000 procedures (95% CI: 1.4–3.1/1,000 procedure). With the exception of procedural certification status as judged by institutional faculty, there was no association between our resident measurements and procedural complications.
Conclusions
Our findings support the need for a resident procedural competence certification system based on direct observation. Our data support the ABIM’s action to remove resident procedural competence from the monthly ABIM-MEF ratings.
doi:10.1007/s11606-006-0068-1
PMCID: PMC1824756  PMID: 17356968
procedural skills; Internal Medicine residency training program; ABIM evaluation
13.  Resident Research and Scholarly Activity in Internal Medicine Residency Training Programs 
OBJECTIVES
1) To describe how internal medicine residency programs fulfill the Accreditation Council for Graduate Medical Education (ACGME) scholarly activity training requirement including the current context of resident scholarly work, and 2) to compare findings between university and nonuniversity programs.
DESIGN
Cross-sectional mailed survey.
SETTING
ACGME-accredited internal medicine residency programs.
PARTICIPANTS
Internal medicine residency program directors.
MEASUREMENTS
Data were collected on 1) interpretation of the scholarly activity requirement, 2) support for resident scholarship, 3) scholarly activities of residents, 4) attitudes toward resident research, and 5) program characteristics. University and nonuniversity programs were compared.
MAIN RESULTS
The response rate was 78%. Most residents completed a topic review with presentation (median, 100%) to fulfill the requirement. Residents at nonuniversity programs were more likely to complete case reports (median, 40% vs 25%; P =.04) and present at local or regional meetings (median, 25% vs 20%; P =.01), and were just as likely to conduct hypothesis-driven research (median, 20% vs 20%; P =.75) and present nationally (median, 10% vs 5%; P =.10) as residents at university programs. Nonuniversity programs were more likely to report lack of faculty mentors (61% vs 31%; P <.001) and resident interest (55% vs 40%; P =.01) as major barriers to resident scholarship. Programs support resident scholarship through research curricula (47%), funding (46%), and protected time (32%).
CONCLUSIONS
Internal medicine residents complete a variety of projects to fulfill the scholarly activity requirement. Nonuniversity programs are doing as much as university programs in meeting the requirement and supporting resident scholarship despite reporting significant barriers.
doi:10.1111/j.1525-1497.2005.40270.x
PMCID: PMC1490049  PMID: 15836549
ACGME; resident research; medical education; national survey
14.  Predicting Pass Rates on the American Board of Internal Medicine Certifying Examination 
Our objective was to determine the ability of the internal medicine In-Training Examination (ITE) to predict pass or fail outcomes on the American Board of Internal Medicine (ABIM) certifying examination and to develop an externally validated predictive model and a simple equation that can be used by residency directors to provide probability feedback for their residency programs. We collected a study sample of 155 internal medicine residents from the three Virginia internal medicine programs and a validation sample of 64 internal medicine residents from a residency program outside Virginia. Scores from both samples were collected across three class cohorts. The Kolmogorov-Smirnov z test indicated no statistically significant difference between the distribution of scores for the two samples (z = 1.284, p = .074). Results of the logistic model yielded a statistically significant prediction of ABIM pass or fail performance from ITE scores (Wald = 35.49, SE = 0.036, df = 1, p < .005) and overall correct classifications for the study sample and validation sample at 79% and 75%, respectively. The ITE is a useful tool in assessing the likelihood of a resident's passing or failing the ABIM certifying examination but is less predictive for residents who received ITE scores between 49 and 66.
doi:10.1046/j.1525-1497.1998.00122.x
PMCID: PMC1496976  PMID: 9669571
certifying examination; in-training examination; education; predictions; residents
15.  Instituting systems-based practice and practice-based learning and improvement: a curriculum of inquiry 
Medical Education Online  2013;18:10.3402/meo.v18i0.21612.
Background
The Accreditation Council for Graduate Medical Education (ACGME) requires that training programs integrate system-based practice (SBP) and practice-based learning and improvement (PBLI) into internal medicine residency curricula.
Context and setting
We instituted a seminar series and year-long-mentored curriculum designed to engage internal medicine residents in these competencies.
Methods
Residents participate in a seminar series that includes assigned reading and structured discussion with faculty who assist in the development of quality improvement or research projects. Residents pursue projects over the remainder of the year. Monthly works in progress meetings, protected time for inquiry, and continued faculty mentorship guide the residents in their project development. Trainees present their work at hospital-wide grand rounds at the end of the academic year. We performed a survey of residents to assess their self-reported knowledge, attitudes and skills in SBP and PBLI. In addition, blinded faculty scored projects for appropriateness, impact, and feasibility.
Outcomes
We measured resident self-reported knowledge, attitudes, and skills at the end of the academic year. We found evidence that participants improved their understanding of the context in which they were practicing, and that their ability to engage in quality improvement projects increased. Blinded faculty reviewers favorably ranked the projects’ feasibility, impact, and appropriateness. The ‘Curriculum of Inquiry’ generated 11 quality improvement and research projects during the study period. Barriers to the ongoing work include a limited supply of mentors and delays due to Institutional Review Board approval. Hospital leadership recognizes the importance of the curriculum, and our accreditation manager now cites our ongoing work.
Conclusions
A structured residency-based curriculum facilitates resident demonstration of SBP and practice-based learning and improvement. Residents gain knowledge and skills though this enterprise and hospitals gain access to trainees who help to solve ongoing problems and meet accreditation requirements.
doi:10.3402/meo.v18i0.21612
PMCID: PMC3776321  PMID: 24044686
graduate medical education; competencies; longitudinal curriculum
16.  Incorporating Evidence-based Medicine into Resident Education: A CORD Survey of Faculty and Resident Expectations 
Background
The Accreditation Council for Graduate Medical Education (ACGME) invokes evidence-based medicine (EBM) principles through the practice-based learning core competency. The authors hypothesized that among a representative sample of emergency medicine (EM) residency programs, a wide variability in EBM resident training priorities, faculty expertise expectations, and curricula exists.
Objectives
The primary objective was to obtain descriptive data regarding EBM practices and expectations from EM physician educators. Our secondary objective was to assess differences in EBM educational priorities among journal club directors compared with non–journal club directors.
Methods
A 19-question survey was developed by a group of recognized EBM curriculum innovators and then disseminated to Council of Emergency Medicine Residency Directors (CORD) conference participants, assessing their opinions regarding essential EBM skill sets and EBM curricular expectations for residents and faculty at their home institutions. The survey instrument also identified the degree of interest respondents had in receiving a free monthly EBM journal club curriculum.
Results
A total of 157 individuals registered for the conference, and 98 completed the survey. Seventy-seven (77% of respondents) were either residency program directors or assistant / associate program directors. The majority of participants were from university-based programs and in practice at least 5 years. Respondents reported the ability to identify flawed research (45%), apply research findings to patient care (43%), and comprehend research methodology (33%) as the most important resident skill sets. The majority of respondents reported no formal journal club or EBM curricula (75%) and do not utilize structured critical appraisal instruments (71%) when reviewing the literature. While journal club directors believed that resident learners’ most important EBM skill is to identify secondary peer-reviewed resources, non–journal club directors identified residents’ ability to distinguish significantly flawed research as the key skill to develop. Interest in receiving a free monthly EBM journal club curriculum was widely accepted (89%).
Conclusions
Attaining EBM proficiency is an expected outcome of graduate medical education (GME) training, although the specific domains of anticipated expertise differ between faculty and residents. Few respondents currently use a formalized curriculum to guide the development of EBM skill sets. There appears to be a high level of interest in obtaining EBM journal club educational content in a structured format. Measuring the effects of providing journal club curriculum content in conjunction with other EBM interventions may warrant further investigation.
doi:10.1111/j.1553-2712.2010.00889.x
PMCID: PMC3219923  PMID: 21199085
evidence-based medicine; knowledge translation; faculty development
17.  Educational Experiences Residents Perceive As Most Helpful for the Acquisition of the ACGME Competencies 
Background
The Accreditation Council for Graduate Medical Education (ACGME) requires physicians in training to be educated in 6 competencies considered important for independent medical practice. There is little information about the experiences that residents feel contribute most to the acquisition of the competencies.
Objective
To understand how residents perceive their learning of the ACGME competencies and to determine which educational activities were most helpful in acquiring these competencies.
Method
A web-based survey created by the graduate medical education office for institutional program monitoring and evaluation was sent to all residents in ACGME-accredited programs at the David Geffen School of Medicine, University of California-Los Angeles, from 2007 to 2010. Residents responded to questions about the adequacy of their learning for each of the 6 competencies and which learning activities were most helpful in competency acquisition.
Results
We analyzed 1378 responses collected from postgraduate year-1 (PGY-1) to PGY-3 residents in 12 different residency programs, surveyed between 2007 and 2010. The overall response rate varied by year (66%–82%). Most residents (80%–97%) stated that their learning of the 6 ACGME competencies was “adequate.” Patient care activities and observation of attending physicians and peers were listed as the 2 most helpful learning activities for acquiring the 6 competencies.
Conclusion
Our findings reinforce the importance of learning from role models during patient care activities and the heterogeneity of learning activities needed for acquiring all 6 competencies.
doi:10.4300/JGME-D-11-00058.1
PMCID: PMC3399609  PMID: 23730438
18.  Providing competency-based family medicine residency training in substance abuse in the new millennium: a model curriculum 
BMC Medical Education  2010;10:33.
Background
This article, developed for the Betty Ford Institute Consensus Conference on Graduate Medical Education (December, 2008), presents a model curriculum for Family Medicine residency training in substance abuse.
Methods
The authors reviewed reports of past Family Medicine curriculum development efforts, previously-identified barriers to education in high risk substance use, approaches to overcoming these barriers, and current training guidelines of the Accreditation Council for Graduate Medical Education (ACGME) and their Family Medicine Residency Review Committee. A proposed eight-module curriculum was developed, based on substance abuse competencies defined by Project MAINSTREAM and linked to core competencies defined by the ACGME. The curriculum provides basic training in high risk substance use to all residents, while also addressing current training challenges presented by U.S. work hour regulations, increasing international diversity of Family Medicine resident trainees, and emerging new primary care practice models.
Results
This paper offers a core curriculum, focused on screening, brief intervention and referral to treatment, which can be adapted by residency programs to meet their individual needs. The curriculum encourages direct observation of residents to ensure that core skills are learned and trains residents with several "new skills" that will expand the basket of substance abuse services they will be equipped to provide as they enter practice.
Conclusions
Broad-based implementation of a comprehensive Family Medicine residency curriculum should increase the ability of family physicians to provide basic substance abuse services in a primary care context. Such efforts should be coupled with faculty development initiatives which ensure that sufficient trained faculty are available to teach these concepts and with efforts by major Family Medicine organizations to implement and enforce residency requirements for substance abuse training.
doi:10.1186/1472-6920-10-33
PMCID: PMC2885404  PMID: 20459842
19.  A nomogram to predict the probability of passing the American Board of Internal Medicine examination 
Medical Education Online  2012;17:10.3402/meo.v17i0.18810.
Background
Although the American Board of Internal Medicine (ABIM) certification is valued as a reflection of physicians’ experience, education, and expertise, limited methods exist to predict performance in the examination.
Purpose
The objective of this study was to develop and validate a predictive tool based on variables common to all residency programs, regarding the probability of an internal medicine graduate passing the ABIM certification examination.
Methods
The development cohort was obtained from the files of the Cleveland Clinic internal medicine residents who began training between 2004 and 2008. A multivariable logistic regression model was built to predict the ABIM passing rate. The model was represented as a nomogram, which was internally validated with bootstrap resamples. The external validation was done retrospectively on a cohort of residents who graduated from two other independent internal medicine residency programs between 2007 and 2011.
Results
Of the 194 Cleveland Clinic graduates used for the nomogram development, 175 (90.2%) successfully passed the ABIM certification examination. The final nomogram included four predictors: In-Training Examination (ITE) scores in postgraduate year (PGY) 1, 2, and 3, and the number of months of overnight calls in the last 6 months of residency. The nomogram achieved a concordance index (CI) of 0.98 after correcting for over-fitting bias and allowed for the determination of an estimated probability of passing the ABIM exam. Of the 126 graduates from two other residency programs used for external validation, 116 (92.1%) passed the ABIM examination. The nomogram CI in the external validation cohort was 0.94, suggesting outstanding discrimination.
Conclusions
A simple user-friendly predictive tool, based on readily available data, was developed to predict the probability of passing the ABIM exam for internal medicine residents. This may guide program directors’ decision-making related to program curriculum and advice given to individual residents regarding board preparation.
doi:10.3402/meo.v17i0.18810
PMCID: PMC3475012  PMID: 23078794
board examination; in-training examination; internal medicine; residents; program directors
20.  Impact of 2011 Resident Duty Hour Requirements on Neurology Residency Programs and Departments 
The Neurohospitalist  2014;4(3):119-126.
Objective:
In 2011, the Accreditation Council on Graduate Medical Education (ACGME) redefined resident duty hour requirements by reducing in-hospital duty hour requirements for residents in an effort to improve patient care, resident well-being, and resident education. We sought to determine the cost of adoption based on changes made by neurology residency programs and departments due to these requirements.
Methods:
We surveyed department chairs or residency program directors at 123 ACGME-accredited US adult neurology training programs on programmatic changes and resident expansion, hiring practices, and development of new computer-based resources in direct response to the 2011 ACGME duty hour requirements. Using data from publicly available resources, we estimated respondents’ financial cost of adoption.
Results:
In all, 63 responded (51% response rate); 76% were program directors. The most common changes implemented by programs were adding night float systems (n = 31; 49%) and increasing faculty responsibility (n = 26; 41%). In direct response to the requirements, 21 programs applied to ACGME for 40 additional residents, 29 of which were fully covered by institutional funds. In direct response to the requirements, nearly half of the departments (n = 26) hired individuals for a total of 80 hires (or 64 full-time equivalents), most commonly mid-level practitioners. The total estimated cost to responding departments was US $12.7 million or US $201,000 per department annually. When projecting expenses of planned changes for the following year, costs increased to US $360,000 per department, with 5-year costs exceeding US $1 million.
Conclusions:
The most recent restriction on resident duty hours comes at substantial cost to neurology departments and residency programs.
doi:10.1177/1941874413518640
PMCID: PMC4056414  PMID: 24982715
education; training; academic; quality; safety; costs
21.  Predicting performance using background characteristics of international medical graduates in an inner-city university-affiliated Internal Medicine residency training program 
Background
IMGs constitute about a third of the United States (US) internal medicine graduates. US residency training programs face challenges in selection of IMGs with varied background features. However data on this topic is limited. We analyzed whether any pre-selection characteristics of IMG residents in our internal medicine program are associated with selected outcomes, namely competency based evaluation, examination performance and success in acquiring fellowship positions after graduation.
Methods
We conducted a retrospective study of 51 IMGs at our ACGME accredited teaching institution between 2004 and 2007. Background resident features namely age, gender, self-reported ethnicity, time between medical school graduation to residency (pre-hire time), USMLE step I & II clinical skills scores, pre-GME clinical experience, US externship and interest in pursuing fellowship after graduation expressed in their personal statements were noted. Data on competency-based evaluations, in-service exam scores, research presentation and publications, fellowship pursuance were collected. There were no fellowships offered in our hospital in this study period. Background features were compared between resident groups according to following outcomes: (a) annual aggregate graduate PGY-level specific competency-based evaluation (CBE) score above versus below the median score within our program (scoring scale of 1 – 10), (b) US graduate PGY-level specific resident in-training exam (ITE) score higher versus lower than the median score, and (c) those who succeeded to secure a fellowship within the study period. Using appropriate statistical tests & adjusted regression analysis, odds ratio with 95% confidence intervals were calculated.
Results
94% of the study sample were IMGs; median age was 35 years (Inter-Quartile range 25th – 75th percentile (IQR): 33–37 years); 43% women and 59% were Asian physicians. The median pre-hire time was 5 years (IQR: 4–7 years) and USMLE step I & step II clinical skills scores were 85 (IQR: 80–88) & 82 (IQR: 79–87) respectively. The median aggregate CBE scores during training were: PG1 5.8 (IQR: 5.6–6.3); PG2 6.3 (IQR 6–6.8) & PG3 6.7 (IQR: 6.7 – 7.1). 25% of our residents scored consistently above US national median ITE scores in all 3 years of training and 16% pursued a fellowship.
Younger residents had higher aggregate annual CBE score than the program median (p < 0.05). Higher USMLE scores were associated with higher than US median ITE scores, reflecting exam-taking skills. Success in acquiring a fellowship was associated with consistent fellowship interest (p < 0.05) and research publications or presentations (p <0.05). None of the other characteristics including visa status were associated with the outcomes.
Conclusion
Background IMG features namely, age and USMLE scores predict performance evaluation and in-training examination scores during residency training. In addition enhanced research activities during residency training could facilitate fellowship goals among interested IMGs.
doi:10.1186/1472-6920-9-42
PMCID: PMC2717068  PMID: 19594918
22.  Barriers to Implementing the ACGME Outcome Project: A Systematic Review of Program Director Surveys 
Introduction
The Accreditation Council for Graduate Medical Education (ACGME) introduced the Outcome Project in July 2001 to improve the quality of resident education through competency-based learning. The purpose of this systematic review is to determine and explore the perceptions of program directors regarding challenges to implementing the ACGME Outcome Project.
Methods
We used the PubMed and Web of Science databases and bibliographies for English-language articles published between January 1, 2001, and February 17, 2012. Studies were included if they described program directors' opinions on (1) barriers encountered when attempting to implement ACGME competency-based education, and (2) assessment methods that each residency program was using to implement competency-based education. Articles meeting the inclusion criteria were screened by 2 researchers. The grading criterion was created by the authors and used to assess the quality of each study.
Results
The survey-based data reported the opinions of 1076 program directors. Barriers that were encountered include: (1) lack of time; (2) lack of faculty support; (3) resistance of residents to the Outcome Project; (4) insufficient funding; (5) perceived low priority for the Outcome Project; (6) inadequate salary incentive; and (7) inadequate knowledge of the competencies. Of the 6 competencies, those pertaining to patient care and medical knowledge received the most responses from program directors and were given highest priority.
Conclusions
The reviewed literature revealed that time and financial constraints were the most important barriers encountered when implementing the ACGME Outcome Project.
doi:10.4300/JGME-D-11-00222.1
PMCID: PMC3546570  PMID: 24294417
23.  Building Faculty Community: Fellowship in Graduate Medical Education Administration 
Introduction
The Department of Graduate Medical Education at Stanford Hospital and Clinics has developed a professional training program for program directors. This paper outlines the goals, structure, and expected outcomes for the one-year Fellowship in Graduate Medical Education Administration program.
Background
The skills necessary for leading a successful Accreditation Council for Graduate Medical Education (ACGME) training program require an increased level of curricular and administrative expertise. To meet the ACGME Outcome Project goals, program directors must demonstrate not only sophisticated understanding of curricular design but also competency-based performance assessment, resource management, and employment law. Few faculty-development efforts adequately address the complexities of educational administration. As part of an institutional-needs assessment, 41% of Stanford program directors indicated that they wanted more training from the Department of Graduate Medical Education.
Intervention
To address this need, the Fellowship in Graduate Medical Education Administration program will provide a curriculum that includes (1) readings and discussions in 9 topic areas, (2) regular mentoring by the director of Graduate Medical Education (GME), (3) completion of a service project that helps improve GME across the institution, and (4) completion of an individual scholarly project that focuses on education.
Results
The first fellow was accepted during the 2008–2009 academic year. Outcomes for the project include presentation of a project at a national meeting, internal workshops geared towards disseminating learning to peer program directors, and the completion of a GME service project. The paper also discusses lessons learned for improving the program.
doi:10.4300/01.01.0024
PMCID: PMC2931184  PMID: 21975722
24.  Medicine in the 21st Century: Recommended Essential Geriatrics Competencies for Internal Medicine and Family Medicine Residents 
Background
Physician workforce projections by the Institute of Medicine require enhanced training in geriatrics for all primary care and subspecialty physicians. Defining essential geriatrics competencies for internal medicine and family medicine residents would improve training for primary care and subspecialty physicians. The objectives of this study were to (1) define essential geriatrics competencies common to internal medicine and family medicine residents that build on established national geriatrics competencies for medical students, are feasible within current residency programs, are assessable, and address the Accreditation Council for Graduate Medical Education competencies; and (2) involve key stakeholder organizations in their development and implementation.
Methods
Initial candidate competencies were defined through small group meetings and a survey of more than 100 experts, followed by detailed item review by 26 program directors and residency clinical educators from key professional organizations. Throughout, an 8-member working group made revisions to maintain consistency and compatibility among the competencies. Support and participation by key stakeholder organizations were secured throughout the project.
Results
The process identified 26 competencies in 7 domains: Medication Management; Cognitive, Affective, and Behavioral Health; Complex or Chronic Illness(es) in Older Adults; Palliative and End-of-Life Care; Hospital Patient Safety; Transitions of Care; and Ambulatory Care. The competencies map directly onto the medical student geriatric competencies and the 6 Accreditation Council for Graduate Medical Education Competencies.
Conclusions
Through a consensus-building process that included leadership and members of key stakeholder organizations, a concise set of essential geriatrics competencies for internal medicine and family medicine residencies has been developed. These competencies are well aligned with concerns for residency training raised in a recent Medicare Payment Advisory Commission report to Congress. Work is underway through stakeholder organizations to disseminate and assess the competencies among internal medicine and family medicine residency programs.
doi:10.4300/JGME-D-10-00065.1
PMCID: PMC2951777  PMID: 21976086
25.  Tracking Residents Through Multiple Residency Programs: A Different Approach for Measuring Residents' Rates of Continuing Graduate Medical Education in ACGME-Accredited Programs 
Background
Increased focus on the number and type of physicians delivering health care in the United States necessitates a better understanding of changes in graduate medical education (GME). Data collected by the Accreditation Council for Graduate Medical Education (ACGME) allow longitudinal tracking of residents, revealing the number and type of residents who continue GME following completion of an initial residency. We examined trends in the percent of graduates pursuing additional clinical education following graduation from ACGME-accredited pipeline specialty programs (specialties leading to initial board certification).
Methods
Using data collected annually by the ACGME, we tracked residents graduating from ACGME-accredited pipeline specialty programs between academic year (AY) 2002–2003 and AY 2006–2007 and those pursuing additional ACGME-accredited training within 2 years. We examined changes in the number of graduates and the percent of graduates continuing GME by specialty, by type of medical school, and overall.
Results
The number of pipeline specialty graduates increased by 1171 (5.3%) between AY 2002–2003 and AY 2006–2007. During the same period, the number of graduates pursuing additional GME increased by 1059 (16.7%). The overall rate of continuing GME increased each year, from 28.5% (6331/22229) in AY 2002–2003 to 31.6% (7390/23400) in AY 2006–2007. Rates differed by specialty and for US medical school graduates (26.4% [3896/14752] in AY 2002–2003 to 31.6% [4718/14941] in AY 2006–2007) versus international medical graduates (35.2% [2118/6023] to 33.8% [2246/6647]).
Conclusion
The number of graduates and the rate of continuing GME increased from AY 2002–2003 to AY 2006–2007. Our findings show a recent increase in the rate of continued training for US medical school graduates compared to international medical graduates. Our results differ from previously reported rates of subspecialization in the literature. Tracking individual residents through residency and fellowship programs provides a better understanding of residents' pathways to practice.
doi:10.4300/JGME-D-10-00105.1
PMCID: PMC3010950  PMID: 22132288

Results 1-25 (520880)