Background

Effective teaching requires an understanding of both what (content knowledge) and how (process knowledge) to teach. While previous studies involving medical students have compared preceptors with greater or lesser content knowledge, it is unclear whether process expertise can compensate for deficient content expertise. Therefore, the objective of our study was to compare the effect of preceptors with process expertise to those with content expertise on medical students' learning outcomes in a structured small group environment.

Methods

One hundred and fifty-one first year medical students were randomized to 11 groups for the small group component of the Cardiovascular-Respiratory course at the University of Calgary. Each group was then block randomized to one of three streams for the entire course: tutoring exclusively by physicians with content expertise (n = 5), tutoring exclusively by physicians with process expertise (n = 3), and tutoring by content experts for 11 sessions and process experts for 10 sessions (n = 3). After each of the 21 small group sessions, students evaluated their preceptors' teaching with a standardized instrument. Students' knowledge acquisition was assessed by an end-of-course multiple choice (EOC-MCQ) examination.

Results

Students rated the process experts significantly higher on each of the instrument's 15 items, including the overall rating. Students' mean score (±SD) on the EOC-MCQ exam was 76.1% (8.1) for groups taught by content experts, 78.2% (7.8) for the combination group and 79.5% (9.2) for process expert groups (p = 0.11). By linear regression student performance was higher if they had been taught by process experts (regression coefficient 2.7 [0.1, 5.4], p < .05), but not content experts (p = .09).

Conclusions

When preceptors are physicians, content expertise is not a prerequisite to teach first year medical students within a structured small group environment; preceptors with process expertise result in at least equivalent, if not superior, student outcomes in this setting.

Background

Peer-assisted learning has many purported benefits including preparing students as educators, improving communication skills and reducing faculty teaching burden. But comparatively little is known about the effects of teaching on learning outcomes of peer educators in medical education.

Methods

One hundred and thirty-five first year medical students were randomly allocated to 11 small groups for the Gastroenterology/Hematology Course at the University of Calgary. For each of 22 sessions, two students were randomly selected from each group to be peer educators. Students were surveyed to estimate time spent preparing as peer educator versus group member. Students completed an end-of-course 94 question multiple choice exam. A paired t-test was used to compare performance on clinical presentations for which students were peer educators to those for which they were not.

Results

Preparation time increased from a mean (SD) of 36 (33) minutes baseline to 99 (60) minutes when peer educators (Cohen's d = 1.3; p < 0.001). The mean score (SD) for clinical presentations in which students were peer educators was 80.7% (11.8) compared to77.6% (6.9) for those which they were not (d = 0.33; p < 0.01).

Conclusion

Our results suggest that involvement in teaching small group sessions improves medical students' knowledge acquisition and retention.

Background

During evolution from novice to expert, knowledge structure develops into an abridged network organized around pathophysiological concepts. The objectives of this study were to examine the change in knowledge structure in medical students in one year and to investigate the association between the use of a conceptual framework (diagnostic scheme) and long-term knowledge structure.

Methods

Medical students' knowledge structure of metabolic alkalosis was studied after instruction and one year later using concept-sorting. Knowledge structure was labeled 'expert-type' if students shared ≥ 2 concepts with experts and 'novice-type' if they shared < 2 concepts. Conditional logistic regression was used to study the association between short-term knowledge structure, the use of a diagnostic scheme and long-term knowledge structure.

Results

Thirty-four medical students completed the concept-sorting task on both occasions. Twenty-four used a diagnostic scheme for metabolic alkalosis. Short-term knowledge structure was not a correlate of long-term knowledge structure, whereas use of a diagnostic scheme was associated with increased odds of expert-type long-term knowledge structure (odds ratio 12.6 [1.4, 116.0], p = 0.02). There was an interaction between short-term knowledge structure and the use of a diagnostic scheme. In the group who did not use a diagnostic scheme the number of students changing from expert-type to novice-type was greater than vice versa (p = 0.046). There was no significant change in the group that used the diagnostic scheme (p = 0.6).

Conclusion

The use of a diagnostic scheme by students may attenuate the loss of expert-type knowledge structure.

Background

Resident-led morning report is an integral part of most residency programs and is ranked among the most valuable of educational experiences. The objectives of this study were to evaluate the effect of a resident-as-teacher educational intervention on the educational and teaching experience of morning report.

Methods

All senior internal medicine residents were invited to participate in this study as teaching participants. All internal medicine residents and clerks were invited to participate as audience participants. The educational intervention included reading material, a small group session and feedback after teaching sessions. The educational and teaching experiences were rated prior to and three months after the intervention using questionnaires.

Results

Forty-six audience participants and 18 teaching participants completed the questionnaires. The degree to which morning report met the educational needs of the audience was higher after the educational intervention (effect size, d = 0.26, p = 0.01). The perceptions of the audience were that delivery had improved and that the sessions were less intimidating and more interactive. The perception of the teaching participants was that delivery was less stressful, but this group now reported greater difficulty in engaging the audience and less confidence in their medical knowledge.

Conclusion

Following the educational intervention the audience's perception was that the educational experience had improved although there were mixed results for the teaching experience. When evaluating such interventions it is important to evaluate the impact on both the educational and teaching experiences as results may differ.

Background

To reduce inter-rater variability in evaluations and the demand on physician time, standardized patients (SP) are being used as examiners in OSCEs. There is concern that SP have insufficient training to provide valid evaluation of student competence and/or provide feedback on clinical skills. It is also unknown if SP ratings predict student competence in other areas. The objectives of this study were: to examine student attitudes towards SP examiners; to compare SP and physician evaluations of competence; and to compare predictive validity of these scores, using performance on the multiple choice questions examination (MCQE) as the outcome variable.

Methods

This was a cross-sectional study of third-year medical students undergoing an OSCE during the Internal Medicine clerkship rotation. Fifty-two students rotated through 8 stations (6 physician, 2 SP examiners). Statistical tests used were Pearson's correlation coefficient, two-sample t-test, effect size calculation, and multiple linear regression.

Results

Most students reported that SP stations were less stressful, that SP were as good as physicians in giving feedback, and that SP were sufficiently trained to judge clinical skills. SP scored students higher than physicians (mean 90.4% +/- 8.9 vs. 82.2% +/- 3.7, d = 1.5, p < 0.001) and there was a weak correlation between the SP and physician scores (coefficient 0.4, p = 0.003). Physician scores were predictive of summative MCQE scores (regression coefficient = 0.88 [0.15, 1.61], P = 0.019) but there was no relationship between SP scores and summative MCQE scores (regression coefficient = -0.23, P = 0.133).

Conclusion

These results suggest that SP examiners are acceptable to medical students, SP rate students higher than physicians and, unlike physician scores, SP scores are not related to other measures of competence.