Background

In the diagnostic reasoning process medical students and novice physicians need to be made aware of the diagnostic values of the clinical findings (including history, signs, and symptoms) to make an appropriate diagnostic decision. Diagnostic reasoning has been understood in light of two paradigms on clinical reasoning: problem solving and decision making. They advocate the reasoning strategies used by expert physicians and the statistical models of reasoning, respectively. Evidence-based medicine (EBM) applies decision theory to the clinical diagnosis, which can be a challenging topic in medical education.

This theoretical article tries to compare evidence-based diagnosis with expert-based strategies in clinical diagnosis and also defines a novel concept of category-oriented likelihood ratio (LR) to propose a new model combining both aforementioned methods.

Discussion

Evidence-based medicine advocates the use of quantitative evidence to estimate the probability of diseases more accurately and objectively; however, the published evidence for a given diagnosis cannot practically be utilized in primary care, especially if the patient is complaining of a nonspecific problem such as abdominal pain that could have a long list of differential diagnoses. In this case, expert physicians examine the key clinical findings that could differentiate between broader categories of diseases such as organic and non-organic disease categories to shorten the list of differential diagnoses. To approach nonspecific problems, not only do the experts revise the probability estimate of specific diseases, but also they revise the probability estimate of the categories of diseases by using the available clinical findings.

Summary

To make this approach analytical and objective, we need to know how much more likely it is for a key clinical finding to be present in patients with one of the diseases of a specific category versus those with a disease not included in that category. In this paper, we call this value category-oriented LR.

Background

Reflection on experience is an increasingly critical part of professional development and lifelong learning. There is, however, continuing uncertainty about how best to put principle into practice, particularly as regards assessment. This article explores those uncertainties in order to find practical ways of assessing reflection.

Discussion

We critically review four problems: 1. Inconsistent definitions of reflection; 2. Lack of standards to determine (in)adequate reflection; 3. Factors that complicate assessment; 4. Internal and external contextual factors affecting the assessment of reflection.

Summary

To address the problem of inconsistency, we identified processes that were common to a number of widely quoted theories and synthesised a model, which yielded six indicators that could be used in assessment instruments. We arrived at the conclusion that, until further progress has been made in defining standards, assessment must depend on developing and communicating local consensus between stakeholders (students, practitioners, teachers, supervisors, curriculum developers) about what is expected in exercises and formal tests. Major factors that complicate assessment are the subjective nature of reflection's content and the dependency on descriptions by persons being assessed about their reflection process, without any objective means of verification. To counter these validity threats, we suggest that assessment should focus on generic process skills rather than the subjective content of reflection and where possible to consider objective information about the triggering situation to verify described reflections. Finally, internal and external contextual factors such as motivation, instruction, character of assessment (formative or summative) and the ability of individual learning environments to stimulate reflection should be considered.

Background

Burnout has been traditionally defined in relation to the dimensions of "exhaustion", "cynicism", and "inefficiency". More recently, the Burnout Clinical Subtype Questionnaire (BCSQ-12) further established three different subtypes of burnout: the "frenetic" subtype (related to "overload"), the "under-challenged" subtype (related to "lack of development"), and the "worn-out" subtype (related to "neglect"). However, to date, these definitions have not been applied to students. The aims of this research were (1) to adapt a Spanish version of the BCSQ-12 for use with students, (2) to test its factorial validity, internal consistency, convergent and discriminant validity, and (3) to assess potential socio-demographic and occupational risk factors associated with the development of the subtypes.

Method

We used a cross-sectional design on a sample of dental students (n = 314) from Santiago and Huesca universities (Spain). Participants completed the Burnout Clinical Subtype Questionnaire Student Survey (BCSQ-12-SS), the Maslach Burnout Inventory Student Survey (MBI-SS), and a series of socio-demographic and occupational questions formulated for the specific purpose of this study. Data were subjected to exploratory factor analysis (EFA) using the principal component method with varimax orthogonal rotation. To assess the relations with the criterion, we calculated the Pearson correlation coefficient (r), multiple correlation coefficient (Ry.123), and the coefficient of determination (R2y.123). To assess the association between the subtypes and the socio-demographic variables, we examined the adjusted odds ratio (OR) obtained from multivariate logistic regression models.

Results

Factorial analyses supported the theoretical proposition of the BCSQ-12-SS, with α-values exceeding 0.80 for all dimensions. The "overload-exhaustion" relation was r = 0.59 (p < 0.001), "lack of development"-"cynicism", r = 0.49 (p < 0.001), "neglect"-"inefficiency", r = 0.47 (p < 0.001). The "overload"-"lack of development" relation was r = 0.21 (p < 0.001), "overload"-"neglect", r = 0.20 (p < 0.001), and "lack of development"-"neglect", r = 0.38 (p < 0.001). The BCSQ-12-SS explained 38.44% of the variability in "exhaustion", (Ry.123 = 0.62), 30.25% in "cynicism" (Ry.123 = 0.55), and 26.01% in "inefficiency" (Ry.123 = 0.51). "Hours spent on studying" was found to be associated with "overload" (p = 0.001), "campus" with "lack of development" (p = 0.013), and ""failed subjects" with "neglect" (p = 0.011).

Conclusions

The results support the definition of burnout as established by the BCSQ-12-SS. As such, the BCSQ-12-SS can be used for the recognition of clinical profiles and for the suggestion of potential intervention strategies specific to the characteristics of each particular case.

Background

In many academic settings teaching a particular topic is applied to every student enrolled in the same academic year, it is a difficult task for researchers to design a randomized control group study. This research aimed to estimate the effect of teaching management and planning on increasing academic planning behavior (APB), using propensity score matching (PSM).

Methods

In a cross-sectional survey utilizing a self-reported structured questionnaire on a systematic random sample of 421 students in Hanoi Medical University, one of the eight medical schools in Vietnam, this evaluation study adopted regression procedures to assess model fit, then PSM to create a matched control group in order to allow for evaluating the effect of management education.

Results

The study showed both direct and indirect effects of the education on behavior. After PSM to adjust for the possible confounders to balance statistically two groups - with and without management education, there is statistically a significant difference in APB between these two groups, making a net difference of 18.60% (p < .05). The estimated 18.6 percentage point increase can be translated into the practice of APB by 670 students in the population. This number of academic planners can be attributed to a high recall of important management and planning education.

Conclusions

The study provided theoretical as well as practical implications to guide the design of the education and evaluation of teaching.

Background

The role of deliberate practice in medical students' development from novice to expert was examined for preclinical skill training.

Methods

Students in years 1-3 completed 34 Likert type items, adapted from a questionnaire about the use of deliberate practice in cognitive learning. Exploratory factor analysis and reliability analysis were used to validate the questionnaire. Analysis of variance examined differences between years and regression analysis the relationship between deliberate practice and skill test results.

Results

875 students participated (90%). Factor analysis yielded four factors: planning, concentration/dedication, repetition/revision, study style/self reflection. Student scores on 'Planning' increased over time, score on sub-scale 'repetition/revision' decreased. Student results on the clinical skill test correlated positively with scores on subscales 'planning' and 'concentration/dedication' in years 1 and 3, and with scores on subscale 'repetition/revision' in year 1.

Conclusions

The positive effects on test results suggest that the role of deliberate practice in medical education merits further study. The cross-sectional design is a limitation, the large representative sample a strength of the study. The vanishing effect of repetition/revision may be attributable to inadequate feedback. Deliberate practice advocates sustained practice to address weaknesses, identified by (self-)assessment and stimulated by feedback. Further studies should use a longitudinal prospective design and extend the scope to expertise development during residency and beyond.

Background

Training in the five steps of evidence-based practice (EBP) has been recommended for inclusion in entry-level health professional training. The effectiveness of EBP education has been explored predominantly in the medical and nursing professions and more commonly in post-graduate than entry-level students. Few studies have investigated longitudinal changes in EBP attitudes and behaviours. This study aimed to assess the changes in EBP knowledge, attitudes and behaviours in entry-level physiotherapy students transitioning into the workforce.

Methods

A prospective, observational, longitudinal design was used, with two cohorts. From 2008, 29 participants were tested in their final year in a physiotherapy program, and after the first and second workforce years. From 2009, 76 participants were tested in their final entry-level and first workforce years. Participants completed an Evidence-Based Practice Profile questionnaire (EBP2), which includes self-report EBP domains [Relevance, Terminology (knowledge of EBP concepts), Confidence, Practice (EBP implementation), Sympathy (disposition towards EBP)]. Mixed model analysis with sequential Bonferroni adjustment was used to analyse the matched data. Effect sizes (ES) (95% CI) were calculated for all changes.

Results

Effect sizes of the changes in EBP domains were small (ES range 0.02 to 0.42). While most changes were not significant there was a consistent pattern of decline in scores for Relevance in the first workforce year (ES -0.42 to -0.29) followed by an improvement in the second year (ES +0.27). Scores in Terminology improved (ES +0.19 to +0.26) in each of the first two workforce years, while Practice scores declined (ES -0.23 to -0.19) in the first year and improved minimally in the second year (ES +0.04). Confidence scores improved during the second workforce year (ES +0.27). Scores for Sympathy showed little change.

Conclusions

During the first two years in the workforce, there was a transitory decline in the self-reported practice and sense of relevance of EBP, despite increases in confidence and knowledge. The pattern of progression of EBP skills beyond these early professional working years is unknown.

Background

The United Kingdom Clinical Aptitude Test (UKCAT) is a set of cognitive tests introduced in 2006, taken annually before application to medical school. The UKCAT is a test of aptitude and not acquired knowledge and as such the results give medical schools a standardised and objective tool that all schools could use to assist their decision making in selection, and so provide a fairer means of choosing future medical students.

Selection of students for UK medical schools is usually in three stages: assessment of academic qualifications, assessment of further qualities from the application form submitted via UCAS (Universities and Colleges Admissions Service) leading to invitation to interview, and then selection for offer of a place. Medical schools were informed of the psychometric qualities of the UKCAT subtests and given some guidance regarding the interpretation of results. Each school then decided how to use the results within its own selection system.

Methods

Annual retrospective key informant telephone interviews were conducted with every UKCAT Consortium medical school, using a pre-circulated structured questionnaire. The key points of the interview were transcribed, 'member checked' and a content analysis was undertaken.

Results

Four equally popular ways of using the test results have emerged, described as Borderline, Factor, Threshold and Rescue methods. Many schools use more than one method, at different stages in their selection process. Schools have used the scores in ways that have sought to improve the fairness of selection and support widening participation. Initially great care was taken not to exclude any applicant on the basis of low UKCAT scores alone but it has been used more as confidence has grown.

Conclusions

There is considerable variation in how medical schools use UKCAT, so it is important that they clearly inform applicants how the test will be used so they can make best use of their limited number of applications.

Background

Apart from objective exam results, the overall feeling of preparedness is important for a successful transition process from being a student to becoming a qualified doctor. This study examines the association between self-assessed deficits in medical skills and knowledge and the feeling of preparedness of junior doctors in order to determine which aspects of medical education need to be addressed in more detail in order to improve the quality of this transition phase and in order to increase patient safety.

Methods

A cohort of 637 doctors with up to two years of clinical work experience was included in this analysis and was asked about the overall feeling of preparedness and self-assessed deficits with regard to clinical knowledge and skills. Three logistic regression models were used to identify medical skills which predict the feeling of preparedness.

Results

All in all, about 60% of the participating doctors felt poorly prepared for post-graduate training. Self-assessed deficits in ECG interpretation (aOR: 4.39; 95% CI: 2.012-9.578), treatment and therapy planning (aOR: 3.42; 95% CI: 1.366-8.555), and intubation (aOR: 2.10; 95% CI: 1.092-4.049) were found to be independently associated with the overall feeling of preparedness in the final regression model.

Conclusions

Many junior doctors in Germany felt inadequately prepared for being a doctor. With regard to the contents of medical curricula, our results show that more emphasis on ECG-interpretation, treatment and therapy planning and intubation is required to improve the feeling of preparedness of medical graduates.

Background

Prior to 1999 students entering our MBBS course were selected on academic performance alone. We have now evaluated the impact on the demographics of subsequent cohorts of our standard entry students (those entering directly from high school) of the addition to the selection process of an aptitude test (UMAT), a highly structured interview and a rural incentive program.

Methods

Students entering from 1985 to 1998, selected on academic performance alone (N = 1402), were compared to those from 1999 to 2011, selected on the basis of a combination of academic performance, interview score, and UMAT score together with the progressive introduction of a rural special entry pathway (N = 1437).

Results

Males decreased from 57% to 45% of the cohort, students of NE or SE Asian origin decreased from 30% to 13%, students born in Oceania increased from 52% to 69%, students of rural origin from 5% to 21% and those from independent high schools from 56% to 66%. The proportion of students from high schools with relative socio-educational disadvantage remained unchanged at approximately 10%. The changes reflect in part increasing numbers of female and independent high school applicants and the increasing rural quota. However, they were also associated with higher interview scores in females vs males and lower interview scores in those of NE and SE Asian origin compared to those born in Oceania or the UK. Total UMAT scores were unrelated to gender or region of origin.

Conclusions

The revised selection processes had no impact on student representation from schools with relative socio-educational disadvantage. However, the introduction of special entry quotas for students of rural origin and a structured interview, but not an aptitude test, were associated with a change in gender balance and ethnicity of students in an Australian undergraduate MBBS course.

Background

Clinical activities that trainees can be trusted to perform with minimal or no supervision have been labelled as Entrustable Professional Activities (EPAs). We sought to examine what activities could be entrusted to psychiatry trainees in their first year of specialist training.

Methods

We conducted an online survey of Fellows of the Royal Australian and New Zealand College of Psychiatrists (RANZCP).

Results

The majority of respondents considered initiating patients with the common medications, discharging patient suffering from schizophrenia, bipolar disorder or following a crisis admission, conducting risk assessments and managing psychiatric emergencies were activities that trainees could be entrusted with by the end of the first stage of training.

Conclusions

Four activities were identified that trainees should be entrusted with by the end of their first year of training. Each of these activities comprises a set of competencies in each of the CanMEDS roles. When a trainee is unable to satisfactorily perform an EPA, deficits in the underpinning competencies can be a focus for remediation. Further EPAs are being identified in areas of more specialised practice for use within more advanced training.

Background

An earlier study at Nottingham suggested that 10-15% of the medical student intake was likely to fail completely or have substantial problems on the course. This is a problem for the students, the Faculty, and society as a whole. If struggling students could be identified early in the course and additional pastoral resources offered, some of this wastage might be avoided. An exploratory case study was conducted to determine whether there were common indicators in the early years, over and above academic failure, that might aid the identification of students potentially at risk.

Methods

The study group was drawn from five successive cohorts. Students who had experienced difficulties were identified in any of four ways: from Minutes of the Academic Progress Committee; by scanning examination lists at key stages (end of the first two years, and finals at the end of the clinical course); from lists of students flagged to the Postgraduate Deanery as in need of extra monitoring or support; and from progress files of those who had left the course prematurely. Relevant data were extracted from each student's course progress file into a customised database.

Results

1188 students were admitted over the five years. 162 (14%) were identified for the study, 75 of whom had failed to complete the course by October 2010. In the 87 who did graduate, a combination of markers in Years 1 and 2 identified over half of those who would subsequently have the most severe problems throughout the course. This 'toolkit' comprised failure of 3 or more examinations per year, an overall average of <50%, health or social difficulties, failure to complete Hepatitis B vaccination on time, and remarks noted about poor attitude or behaviour.

Conclusions

A simple toolkit of academic and non-academic markers could be used routinely to help identify potential strugglers at an early stage, enabling additional support and guidance to be given to these students.

Background

There is a growing acknowledgement that doctors need to develop leadership and management competences to become more actively involved in the planning, delivery and transformation of patient services. We undertook a systematic review of what is known concerning the knowledge, skills and attitudes of medical students regarding leadership and management. Here we report the results pertaining to the attitudes of students to provide evidence to inform curriculum development in this developing field of medical education.

Methods

We searched major electronic databases and citation indexes within the disciplines of medicine, education, social science and management. We undertook hand searching of major journals, and reference and citation tracking. We accessed websites of UK medical institutions and contacted individuals working within the field.

Results

26 studies were included. Most were conducted in the USA, using mainly quantitative methods. We used inductive analysis of the topics addressed by each study to identity five main content areas: Quality Improvement; Managed Care, Use of Resources and Costs; General Leadership and Management; Role of the Doctor, and Patient Safety. Students have positive attitudes to clinical practice guidelines, quality improvement techniques and multidisciplinary teamwork, but mixed attitudes to managed care, cost containment and medical error. Education interventions had variable effects on students' attitudes. Medical students perceive a need for leadership and management education but identified lack of curriculum time and disinterest in some activities as potential barriers to implementation.

Conclusions

The findings from our review may reflect the relatively little emphasis given to leadership and management in medical curricula. However, students recognise a need to develop leadership and management competences. Although further work needs to be undertaken, using rigorous methods, to identify the most effective and cost-effective curriculum innovations, this review offers the only currently available summary of work examining the attitudes of students to this important area of development for future doctors.

Background

Stress and distress among medical students are thoroughly studied and presumed to be particularly high, but comparative studies including other student groups are rare.

Methods

A web-based survey was distributed to 500 medical students and 500 business students. We compared levels of study stress (HESI), burnout (OLBI), alcohol habits (AUDIT) and depression (MDI), and analysed their relationship with self-assessed mental health problems by logistic regression, with respect to gender.

Results

Medical students' response rate was 81.6% and that of business students 69.4%. Business students scored higher on several study stress factors and on disengagement. Depression (OR 0.61, CI95 0.37;0.98) and harmful alcohol use (OR 0.55, CI95 0.37; 0.75) were both less common among medical students. However, harmful alcohol use was highly prevalent among male students in both groups (medical students 28.0%, business students 35.4%), and among female business students (25.0%). Mental health problems in need of treatment were equally common in both groups; 22.1% and 19.3%, respectively, and was associated with female sex (OR 2.01, CI95 1.32;3.04), exhaustion (OR 2.56, CI95 1.60;4.10), lower commitment to studies (OR 1.95, CI95 1.09;3.51) and financial concerns (OR 1.81 CI95 1.18;2.80)

Conclusions

Medical students may not be more stressed than other high achieving student populations. The more cohesive structure of medical school and a higher awareness of a healthy lifestyle may be beneficial factors.

Background

Team-based learning (TBL), a new active learning method, has not been reported for neurology education. We aimed to determine if TBL was more effective than passive learning (PL) in improving knowledge outcomes in two key neurology topics - neurological localization and neurological emergencies.

Methods

We conducted a modified crossover study during a nine-week internal medicine posting involving 49 third-year medical undergraduates, using TBL as the active intervention, compared against self-reading as a PL control, for teaching the two topics. Primary outcome was the mean percentage change in test scores immediately after (post-test 1) and 48 hours after TBL (post-test 2), compared to a baseline pre-test. Student engagement was the secondary outcome.

Results

Mean percentage change in scores was greater in the TBL versus the PL group in post-test 1 (8.8% vs 4.3%, p = 0.023) and post-test 2 (11.4% vs 3.4%, p = 0.001). After adjustment for gender and second year examination grades, mean percentage change in scores remained greater in the TBL versus the PL group for post-test 1 (10.3% vs 5.8%, mean difference 4.5%,95% CI 0.7 - 8.3%, p = 0.021) and post-test 2 (13.0% vs 4.9%, mean difference 8.1%,95% CI 3.7 - 12.5%, p = 0.001), indicating further score improvement 48 hours post-TBL. Academically weaker students, identified by poorer examination grades, showed a greater increase in scores with TBL versus strong students (p < 0.02). Measures of engagement were high in the TBL group, suggesting that continued improvements in scores 48 hours post-TBL may result from self-directed learning.

Conclusions

Compared to PL, TBL showed greater improvement in knowledge scores, with continued improvement up to 48 hours later. This effect is larger in academically weaker students. TBL is an effective method for improving knowledge in neurological localization and neurological emergencies in undergraduates.

Background

Computer-based examinations (CBE) ensure higher efficiency with respect to producibility and assessment compared to paper-based examinations (PBE). However, students often have objections against CBE and are afraid of getting poorer results in a CBE.

The aims of this study were (1) to assess the readiness and the objections of students to a CBE vs. PBE (2) to examine the acceptance and satisfaction with the CBE on a voluntary basis, and (3) to compare the results of the examinations, which were conducted in different formats.

Methods

Fifth year medical students were introduced to an examination-player and were free to choose their format for the test. The reason behind the choice of the format as well as the satisfaction with the choice was evaluated after the test with a questionnaire. Additionally, the expected and achieved examination results were measured.

Results

Out of 98 students, 36 voluntarily chose a CBE (37%), 62 students chose a PBE (63%). Both groups did not differ concerning sex, computer-experience, their achieved examination results of the test, and their satisfaction with the chosen format. Reasons for the students' objections against CBE include the possibility for outlines or written notices, a better overview, additional noise from the keyboard or missing habits normally present in a paper based exam. The students with the CBE tended to judge their examination to be more clear and understandable. Moreover, they saw their results to be independent of the format.

Conclusions

Voluntary computer-based examinations lead to equal test scores compared to a paper-based format.

Background

Empathy is important to patient care. The prevailing view is that empathy declines during university medical education. The significance of that decline has been debated.

This paper reports the findings in respect of two questions relating to university medical education:

1. Do men and women medical students differ in empathy?

2. Does empathy change amongst men and women over time?

Methods

The medical course at the University of Cambridge comprises two components: Core Science (Years 1-3) and Clinical (Years 4-6). Data were obtained from repeated questionnaire surveys of medical students from each component over a period of four years: 2007-2010. Participation in the study was voluntary.

Empathy was measured using two subscales of the Interpersonal Reactivity Index: IRI-EC (affective empathy) and IRI-PT (cognitive empathy). We analysed data separately for men and women from the Core Science and Clinical components. We undertook missing value analyses using logistic regression separately, for each measure of empathy, to examine non-response bias. We used Student's t-tests to examine gender differences and linear mixed effects regression analyses to examine changes over time. To assess the influence of outliers, we repeated the linear mixed effects regression analyses having excluded them.

Results

Women displayed statistically significant higher mean scores than men for affective empathy in all 6 years of medical training and for cognitive empathy in 4 out of 6 years - Years 1 and 2 (Core Science component) and Years 4 and 5 (Clinical component).

Amongst men, affective empathy declined slightly during both Core Science and Clinical components. Although statistically significant, both of these changes were extremely small. Cognitive empathy was unchanged during either component. Amongst women, neither affective empathy nor cognitive empathy changed during either component of the course.

Analysis following removal of outliers showed a statistically significant slight increase in men's cognitive empathy during the Core Science component and slight decline in women's affective empathy during the Clinical component. Again, although statistically significant, these changes were extremely small and do not influence the study's overall conclusions.

Conclusions

Amongst medical students at the University of Cambridge, women are more empathetic than men (a generally observed phenomenon). Men's affective empathy declined slightly across the course overall, whilst women's affective empathy showed no change. Neither men nor women showed any change in cognitive empathy during the course. Although statistically significant, the size of such changes as occurred makes their practical significance questionable. Neither men nor women appear to become meaningfully less empathetic during their medical education at the University of Cambridge.

Background

Despite there being considerable literature documenting learner distress and perceptions of mistreatment in medical education settings, these concerns have not been explored in-depth in Canadian family medicine residency programs. The purpose of the study was to examine intimidation, harassment and/or discrimination (IHD) as reported by Alberta family medicine graduates during their two-year residency program.

Methods

A retrospective questionnaire survey was conducted of all (n = 377) family medicine graduates from the University of Alberta and University of Calgary who completed residency training during 2001-2005. The frequency, type, source, and perceived basis of IHD were examined by gender, age, and Canadian vs international medical graduate. Descriptive data analysis (frequency, crosstabs), Chi-square, Fisher's Exact test, analysis of variance, and logistic regression were used as appropriate.

Results

Of 377 graduates, 242 (64.2%) responded to the survey, with 44.7% reporting they had experienced IHD while a resident. The most frequent type of IHD experienced was in the form of inappropriate verbal comments (94.3%), followed by work as punishment (27.6%). The main sources of IHD were specialist physicians (77.1%), hospital nurses (54.3%), specialty residents (45.7%), and patients (35.2%). The primary basis for IHD was perceived to be gender (26.7%), followed by ethnicity (16.2%), and culture (9.5%). A significantly greater proportion of males (38.6%) than females (20.0%) experienced IHD in the form of work as punishment. While a similar proportion of Canadian (46.1%) and international medical graduates (IMGs) (41.0%) experienced IHD, a significantly greater proportion of IMGs perceived ethnicity, culture, or language to be the basis of IHD.

Conclusions

Perceptions of IHD are prevalent among family medicine graduates. Residency programs should explicitly recognize and robustly address all IHD concerns.

Background

It has long been acknowledged that medical students frequently focus their learning on that which will enable them to pass examinations, and that they use a range of study approaches and resources in preparing for their examinations. A recent qualitative study identified that in addition to the formal curriculum, students are using a range of resources and study strategies which could be attributed to the informal curriculum. What is not clearly established is the extent to which these informal learning resources and strategies are utilized by medical students. The aim of this study was to establish the extent to which students in a graduate-entry medical program use various learning approaches to assist their learning and preparation for examinations, apart from those resources offered as part of the formal curriculum.

Methods

A validated survey instrument was administered to 522 medical students. Factor analysis and internal consistence, descriptive analysis and comparisons with demographic variables were completed. The factor analysis identified eight scales with acceptable levels of internal consistency with an alpha coefficient between 0.72 and 0.96.

Results

Nearly 80% of the students reported that they were overwhelmed by the amount of work that was perceived necessary to complete the formal curriculum, with 74.3% believing that the informal learning approaches helped them pass the examinations. 61.3% believed that they prepared them to be good doctors. A variety of informal learning activities utilized by students included using past student notes (85.8%) and PBL tutor guides (62.7%), and being part of self-organised study groups (62.6%), and peer-led tutorials (60.2%). Almost all students accessed the formal school resources for at least 10% of their study time. Students in the first year of the program were more likely to rely on the formal curriculum resources compared to those of Year 2 (p = 0.008).

Conclusions

Curriculum planners should examine the level of use of informal learning activities in their schools, and investigate whether this is to enhance student progress, a result of perceived weakness in the delivery and effectiveness of formal resources, or to overcome anxiety about the volume of work expected by medical programs.

Background

There is increasing attention to online learning as a convenient way of getting professional training. The number and popularity of online nursing continuing education programs are increasing rapidly in many countries. Understanding these may contribute to designing these programs to maximize success. Also, knowing the perceptions and preferences in online learning aids development and orientation of online programs. The aims of this study are to show nurses' perceptions of online continuing education and to determine perceptions of various groups; area groups, working companies, frequency of computer usage and age.

Methods

The survey method was used in this quantitative study to reveal perception levels and relationship with related variables. Data were collected through an online instrument from a convenience sample of 1041 Registered Nurses (RNs) at an online bachelor's degree program. Descriptive and inferential analysis techniques were performed.

Results

Nurses generally have positive perceptions about online learning (X = 3.86; SD = 0.48). A significant difference was seen between nurses who used computers least and those with the highest computer usage [F (3, 1033) = 3.040; P < .05]. Neither nurses' ages nor lengths of working experience are significantly related to perceptions of online programs (r = -.013; P > .05 and r = -.036; P > .05, respectively). Nurses' perceptions are significantly different depending on the settings where they work [F (3,989) = 3.193; P < .05]. The difference between perceptions of nurses living in urban areas (X = 3.82; SD = .51) and those living in rural areas (X = 3.88; SD = .47) was not significant [t (994) = -1.570, P > .05].

Conclusions

We found that nurses regard online learning opportunities as suitable for their working conditions and needs. Nurses should be provided with continued training through online learning alternatives, regardless of age, working experience or area of residence.

Background

Benefits of online learning in the health sector have been demonstrated in previous studies. We examined the potential benefits of a joint web-based curriculum on atopic eczema for health personnel.

Methods

Enrolled doctors and nurses had access to the curriculum for 8 weeks. After the course learners completed a questionnaire. Two dermatologists rated the quality of the submitted homework assignments. Based on data from the project's budget and the Norwegian Medical Association, we estimated the saved travel expenses.

Results

Eighty-eight learners (46 doctors) registered for the course. We received 55 questionnaires (response rate 63%). Twenty-seven learners (31%; 16 doctors, 11 nurses; χ2 = 0.03; P = 0.87) used the discussion forum. We found no significant differences in the total questionnaire scores between doctors and nurses. The homework assignments were given an average score of 3.6 for doctors and 3.5 for nurses (P = 0.8) by rater 1. Rater 2 scored 3.9 and 3.6 for doctors and nurses respectively (P = 0.2). The break-even between travel/hotel expenses and course development costs occurred at 135 saved travel refund applications.

Conclusions

Doctors and nurses were equally satisfied with a joint web-based course on atopic eczema. The use of an online discussion forum was limited but similar between doctors and nurses. There were no significant differences in the quality of submitted homework assignments. The cost of developing the course was 716 841 NOK and the first 86 learners saved 455 198 NOK in travel expenses.

Background

In some current healthcare settings, there is a noticeable absence of national institutions committed to the synthesis and use of evidence in healthcare decision- and policy-making. This absence creates a need to broaden the responsibilities of healthcare providers to include knowledge brokering and advocacy in order to optimize knowledge translation to other stakeholders, especially policy-makers. However, this process requires practitioners and researchers to acquire certain types of knowledge and skills. This article introduces two innovative methods for capacity building in knowledge translation (KT).

Methods

During a workshop aimed at preparing 21 trainers in evidence-based medicine, two innovative methods were used: (1) debate and (2) a knowledge translation project (KTP). The main objective of the debates approach was to strengthen participants' critical thinking abilities by requiring them to search for and appraise evidence and defend their arguments. The KTP was used to introduce participants to the essential steps of knowledge translation and to suggest an extended role for healthcare practitioners, i.e., using evidence to manage not only individual patients but also to a community of patients. Participants' performances were assessed according to a pre-designed scheme. At the end of the workshop, participants' opinions and experiences with the innovative teaching methods were evaluated based on their answers to a questionnaire and the results of small-group discussions.

Results

The participants performed well in both the debate and KTP methods. During post-workshop group discussions, they indicated that the debate approach had added a new dimension to their evidence-based medicine skills by adding purpose and motivation. However, they felt that their performances would have been better if they had been offered practical demonstrations of how to conduct the debate. The participants indicated that the KTP enhanced their understanding of the relationships between evidence and implementation, and motivated them to investigate public health problems in addition to individual patient problems. However, some participants maintained that these issues fell outside the scope of their role as doctors.

Conclusion

Debates and evidence implementation through KTP are generally well accepted by healthcare practitioners as methods by which they can improve their skills in KT.

Background

Knowledge in natural sciences generally predicts study performance in the first two years of the medical curriculum. In order to reduce delay and dropout in the preclinical years, Hamburg Medical School decided to develop a natural science test (HAM-Nat) for student selection. In the present study, two different approaches to scale construction are presented: a unidimensional scale and a scale composed of three subject specific dimensions. Their psychometric properties and relations to academic success are compared.

Methods

334 first year medical students of the 2006 cohort responded to 52 multiple choice items from biology, physics, and chemistry. For the construction of scales we generated two random subsamples, one for development and one for validation. In the development sample, unidimensional item sets were extracted from the item pool by means of weighted least squares (WLS) factor analysis, and subsequently fitted to the Rasch model. In the validation sample, the scales were subjected to confirmatory factor analysis and, again, Rasch modelling. The outcome measure was academic success after two years.

Results

Although the correlational structure within the item set is weak, a unidimensional scale could be fitted to the Rasch model. However, psychometric properties of this scale deteriorated in the validation sample. A model with three highly correlated subject specific factors performed better. All summary scales predicted academic success with an odds ratio of about 2.0. Prediction was independent of high school grades and there was a slight tendency for prediction to be better in females than in males.

Conclusions

A model separating biology, physics, and chemistry into different Rasch scales seems to be more suitable for item bank development than a unidimensional model, even when these scales are highly correlated and enter into a global score. When such a combination scale is used to select the upper quartile of applicants, the proportion of successful completion of the curriculum after two years is expected to rise substantially.

Background

Yearly surveys among the undergraduate students in oral and maxillofacial surgery at Karolinska Institutet have conveyed a wish for increased clinical training, and in particular, in surgical removal of mandibular third molars. Due to lack of resources, this kind of clinical supervision has so far not been possible to implement. One possible solution to this problem might be to introduce simulation into the curriculum. The purpose of this study was to investigate undergraduate students' perception of two different simulation methods for practicing clinical reasoning skills and technical skills in oral and maxillofacial surgery.

Methods

Forty-seven students participating in the oral and maxillofacial surgery course at Karolinska Institutet during their final year were included. Three different oral surgery patient cases were created in a Virtual Patient (VP) Simulation system (Web-SP) and used for training clinical reasoning. A mandibular third molar surgery simulator with tactile feedback, providing hands on training in the bone removal and tooth sectioning in third molar surgery, was also tested. A seminar was performed using the combination of these two simulators where students' perception of the two different simulation methods was assessed by means of a questionnaire.

Results

The response rate was 91.5% (43/47). The students were positive to the VP cases, although they rated their possible improvement of clinical reasoning skills as moderate. The students' perception of improved technical skills after training in the mandibular third molar surgery simulator was rated high. The majority of the students agreed that both simulation techniques should be included in the curriculum and strongly agreed that it was a good idea to use the two simulators in concert. The importance of feedback from the senior experts during simulator training was emphasised.

Conclusions

The two tested simulation methods were well accepted and most students agreed that the future curriculum would benefit from permanent inclusion of these exercises, especially when used in combination. The results also stress the importance of teaching technical skills and clinical reasoning in concert.

Background

Learning styles determine how people manage new information. Evidence-based medicine (EBM) involves the management of information in clinical practice. As a consequence, the way in which a person uses EBM can be related to his or her learning style. In order to tailor EBM education to the individual learner, this study aims to determine whether there is a relationship between an individual's learning style and EBM competence (knowledge/skills, attitude, behaviour).

Methods

In 2008, we conducted a survey among 140 novice GP trainees in order to assess their EBM competence and learning styles (Accommodator, Diverger, Assimilator, Converger, or mixed learning style).

Results

The trainees' EBM knowledge/skills (scale 0-15; mean 6.8; 95%CI 6.4-7.2) were adequate and their attitudes towards EBM (scale 0-100; mean 63; 95%CI 61.3-64.3) were positive. We found no relationship between their knowledge/skills or attitudes and their learning styles (p = 0.21; p = 0.19). Of the trainees, 40% used guidelines to answer clinical questions and 55% agreed that the use of guidelines is the most appropriate way of applying EBM in general practice. Trainees preferred using evidence from summaries to using evidence from single studies. There were no differences in medical decision-making or in EBM use (p = 0.59) for the various learning styles. However, we did find a link between having an Accommodating or Converging learning style and making greater use of intuition. Moreover, trainees with different learning styles expressed different ideas about the optimal use of EBM in primary care.

Conclusions

We found that EBM knowledge/skills and EBM attitudes did not differ with respect to the learning styles of GP trainees. However, we did find differences relating to the use of intuition and the trainees' ideas regarding the use of evidence in decision-making.

Background

A framework for high quality in post graduate training has been defined by the World Federation of Medical Education (WFME). The objective of this paper is to perform a systematic review of reviews to find current evidence regarding aspects of quality of post graduate training and to organise the results following the 9 areas of the WFME framework.

Methods

The systematic literature review was conducted in 2009 in Medline Ovid, EMBASE, ERIC and RDRB databases from 1995 onward. The reviews were selected by two independent researchers and a quality appraisal was based on the SIGN tool.

Results

31 reviews met inclusion criteria. The majority of the reviews provided information about the training process (WFME area 2), the assessment of trainees (WFME area 3) and the trainees (WFME area 4). One review covered the area 8 'governance and administration'. No review was found in relation to the mission and outcomes, the evaluation of the training process and the continuous renewal (respectively areas 1, 7 and 9 of the WFME framework).

Conclusions

The majority of the reviews provided information about the training process, the assessment of trainees and the trainees. Indicators used for quality assessment purposes of post graduate training should be based on this evidence but further research is needed for some areas in particular to assess the quality of the training process.