PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of canfamphysLink to Publisher's site
 
Can Fam Physician. 2010 September; 56(9): e345–e351.
PMCID: PMC2939136

Language: English | French

Game-based versus traditional case-based learning

Comparing effectiveness in stroke continuing medical education

Apprentissage par le jeux par rapport à l’apprentissage traditionnel à l’aide de cas

Deanna Telner, MD MEd CCFP
Family physician at the South East Toronto Family Health Team and an Assistant Professor in the Department of Family and Community Medicine at the University of Toronto in Ontario
Maja Bujas-Bobanovic, MD MSc
Senior Medical Advisor at Sanofi-aventis
David Chan, MD MEd FRCPC
Assistant Professor in the Division of Neurology at the University of Toronto and St Michael’s Hospital
Bob Chester
Education consultant
Bernard Marlow, MD CCFP FCFP FACME
Director of Continuing Professional Development at the College of Family Physicians of Canada in Mississauga, Ont
James Meuser, MD CCFP FCFP
Director of the Professional Development Program in the Department of Family and Community Medicine at the University of Toronto
Arthur Rothman, EdD
Professor Emeritus in the Department of Medicine at the University of Toronto
Bart Harvey, MD PhD MEd FRCPC

ABSTRACT

OBJECTIVE

To evaluate family physicians’ enjoyment of and knowledge gained from game-based learning, compared with traditional case-based learning, in a continuing medical education (CME) event on stroke prevention and management.

DESIGN

An equivalence trial to determine if game-based learning was as effective as case-based learning in terms of attained knowledge levels. Game questions and small group cases were developed. Participants were randomized to either a game-based or a case-based group and took part in the event.

SETTING

Ontario provincial family medicine conference.

PARTICIPANTS

Thirty-two family physicians and 3 senior family medicine residents attending the conference.

INTERVENTION

Participation in either a game-based or a case-based CME learning group.

MAIN OUTCOME MEASURES

Scores on 40-item immediate and 3-month posttests of knowledge and a satisfaction survey.

RESULTS

Results from knowledge testing immediately after the event and 3 months later showed no significant difference in scoring between groups. Participants in the game-based group reported higher levels of satisfaction with the learning experience.

CONCLUSION

Games provide a novel way of organizing CME events. They might provide more group interaction and discussion, as well as improve recruitment to CME events. They might also provide a forum for interdisciplinary CME. Using games in future CME events appears to be a promising approach to facilitate participant learning.

RÉSUMÉ

OBJECTIF

Évaluer chez des médecins de famille le plaisir éprouvé et les connaissances acquises lors d’un apprentissage par le jeu, comparativement à un apprentissage traditionnel à partir de cas, dans le cadre d’une séance de formation médicale continue (FMC) sur la prévention et le traitement des accidents vasculaires cérébraux.

TYPE D’ÉTUDE

Étude d’équivalence pour déterminer si l’apprentissage par le jeu était aussi efficace que l’apprentissage à partir de cas sur le plan du niveau des connaissances acquises. On a développé des questions pour les jeux et des cas pour des petits groupes. Les participants ont été assignés au hasard à un des 2 groupes et ont participé à la séance.

CONTEXTE

Une conférence en médecine familiale en Ontario.

PARTICIPANTS

Trente-deux médecins de famille et 3 résidents seniors en médecine familiale assistant à la conférence.

INTERVENTION

Participation au groupe utilisant le jeu ou à celui utilisant des cas.

PRINCIPAUX PARAMÈTRES À L’ÉTUDE

Notes obtenues à un examen de 40 questions sur les connaissances et la satisfaction immédiatement après et 3 mois après la séance.

RÉSULTATS

Les résultats de l’évaluation des connaissances immédiatement après la séance et 3 mois plus tard ne montraient aucune différence significative entre les 2 groupes. Les participants au groupe d‘apprentissage par le jeu se sont dits davantage satisfaits de cette expérience.

CONCLUSION

L’utilisation de jeux représente une nouvelle façon d’organiser les séances de FMC. Cette méthode pourrait favoriser davantage de discussion et d’interaction de groupe, en plus d’améliorer le recrutement pour les séances de FMC. Elle pourrait aussi offrir un forum pour la FMC interdisciplinaire. L’utilisation de jeux dans les futures séances de FMC est une méthode susceptible de faciliter l’apprentissage des participants.

Games are an innovative and challenging educational method.1 They have long been used as a teaching strategy in both child and adult education. They have also been used as a teaching strategy in medical education,210 predominantly to review and reinforce lecture material for undergraduate medical students. In contrast, the nursing literature contains examples of games being used as educational tools for practitioners.1120

It is well known that games can incorporate concepts and principles of adult learning, including promoting self-learning and participation.21 Games also provide the opportunity for learners to reinforce previously learned information and acquire new knowledge.14,22 By involving repetition and allowing important points to be reiterated, games appear to increase retention and application.23 In addition, games are believed to connect theory and practice and provide the opportunity for immediate feedback.1,14,17 Motivated by the inherent competition, games also provide opportunities for learners to serve as peer teachers, team leaders, and teammates.19 Games encourage interaction among learners, increase learners’ levels of motivation, and enhance the opportunity to learn from others.20 Unlike many other educational formats, game-based learning can bring fun and enjoyment to the learning experience and might encourage greater participation in group learning activities, with the potential to engage learners’ emotions, as well as their intellects. Therefore, this format could substantially contribute to the development of a wider repertoire of teaching and learning methods in continuing medical education (CME). Although many authors claim that games are as effective as more traditional educational methods, games have rarely been formally evaluated, with positive claims being largely based on anecdotal evidence. Formal evaluations of games, demonstrating that they are actually as effective a teaching and learning strategy for CME as more traditional methods are, are lacking. The purpose of this study was to determine if a game-based format is as effective as traditional case-based learning for a CME stroke prevention and management program.

METHODS

Ethics approval was obtained from the University of Toronto Research Ethics Board.

Development of materials

Development and validation of the game. The game was based on the board game “Snakes and Ladders.” The board game concept was chosen because it facilitates small group interactivity among learners.6 Twenty-two multiple-choice and true-or-false questions were developed from materials adapted from a nationally accredited educational workshop, “Changing Dynamics of Stroke Prevention and Management.” These questions were read and discussed by each team of participants. Each game involved 3 teams (pairs) of physicians, and 1 trained moderator who facilitated the game, kept time, and had the answers to the game’s questions. A neurologist was also available as a resource to participants.

The game had been previously used with 52 physicians on 4 different occasions. Questions and rules were modified based on these physicians’ suggestions and research team observations.

Development of the cases. Cases were adapted from an accredited learning activity of the University of Ottawa Department of CME, la Fédération des Médecins Omnipracticiens du Québec, and Aventis Inc. These cases were based on results of a needs assessment of 250 family physicians. Case groups consisted of 5 to 7 participants and a trained facilitator. A neurologist was also available as a resource to participants.

The investigators reviewed the game and case questions to ensure that both covered the same materials in a comparable fashion.

Development of the knowledge test. A 40-item multiple-choice knowledge test, which included 4 clinical vignettes and 20 free-standing questions, was developed. Clinical vignettes have been validated as a method for measuring the competence of physicians and the quality of their actual practice.24 The questions were designed to address the topics covered in the game-based and case-based CME sessions. The candidate questions were reviewed by several family physicians and a neurologist. The 3-month posttest consisted of the same questions presented in a different order, with reordering of answer options. All questions are available upon request.

Development of the participant evaluation of the sessions. Participants completed an evaluation that included 11 statements, each rated on a 5-point scale. The statements explored participants’ enjoyment of the event, their subjective learning experiences, and whether they would attend future CME events using the same format.

Video. A 30-minute videotaped lecture by a neurologist on stroke prevention and management was viewed by all participants before playing the game or discussing the cases, providing both groups with a similar baseline of knowledge.

Sample size calculation. Using a Web-based equivalence trial sample size calculator,25 we determined that 25 participants per group would be necessary to determine that the traditional case-based group’s mean score was no more than 2.5 points greater (out of 40) than the game-based group’s mean score (and 17 per group for a difference of no more than 3.0 points). The sample size was calculated for a study power of 80%, a 1-sided α of .05, an assumed overall mean score of 28 (out of 40), and a standard deviation of 3.5. These estimates were informed by the administration of an earlier version of the knowledge test to a convenience sample of 17 primary care physicians.

Analysis

Another Web-based calculator26 was used to assess differences of proportions for relevant demographic data (ie, the 2 × 2 tables) and for each of the 11 session-evaluation statements completed by the participants, comparing the proportion in each group “strongly agreeing” with the statement. A Web-based calculator for large contingency tables27 was used to analyze the remaining demographic data (ie, the 3 × 2 tables). The Simple Interactive Statistical Analysis Web-based calculator was used to conduct t tests and calculate the lower limit of the 1-tailed 95% confidence intervals (CIs) for the comparison of mean scores.28 Between-group comparisons of knowledge test scores and session evaluations were also conducted with the Wilcoxon test, using the Institute of Phonetic Sciences’ Web-based statistical calculator.29 Statistical significance (ie, α level) was set at .05 for all comparisons. Owing to concerns about data distribution, analysis was done with parametric and nonparametric tests. Because we found similar results with both tests, only the parametric test results are presented.

The event

The CME event took place at an annual meeting of the Ontario College of Family Physicians in Toronto, Ont. E-mails sent before and posters at the conference were used to recruit participants. All physicians attending the conference were invited to attend. Participants were randomized in blocks into groups of 6 to either the game-based or case-based groups (Figure 1). All participants viewed the 30-minute video. Following this, each group’s CME session ran simultaneously for 1 hour. In both groups, there was 1 facilitator for each group of 6 participants plus a neurologist in each of the 2 rooms. Facilitators were provided with a short explanation of the best answer for each question used in the sessions to reinforce participant learning.

Figure 1
Study design

RESULTS

Participants

Despite the participant incentives ($50 plus 2 family medicine texts), and extensive recruitment efforts, fewer than the target number of participants were recruited, with 32 family physicians and 3 senior family medicine residents participating. Eighteen participants were randomized to game-based learning (3 groups of 6) and 17 to case-based learning (2 groups of 6 and 1 group of 5). The demographic questionnaire, completed by each participant, demonstrated the comparability of the 2 groups (Table 1).

Table 1
Participant demographics

Knowledge test

Immediate posttest. On average, the game-based group scored 1.6 points lower (out of 40) than the case-based group (P = .24; lower limit of 95% CI −3.8) (Table 2).

Table 2
Comparison of game-based and case-based test results by time of testing: The game-based group scored on average 1.6 points lower (P = .24; lower limit of 95% CI −3.8) than the case-based group on the immediate posttest and 0.3 points lower (P ...

Three-month posttest. Thirty-one (89%) of the 35 participants completed this test (15 in the game-based group and 16 in the case-based group). On average, the game-based group scored 0.3 points lower (out of 40) than the case-based group (P = .83; lower limit of 95% CI −2.5) (Table 2).

Participants’ evaluation of the session

At the conclusion of the CME session, and after completing the immediate posttest of knowledge, all but one of the participants completed the session-evaluation questionnaire. Game-based participants more frequently chose “strongly agree” (5 on the 5-point scale) for many of the statements (Table 3). A higher proportion of game-based versus case-based participants strongly agreed that the event was enjoyable (94% vs 53%; P = .02), that their attention was high throughout the event (88% vs 41%; P = .012), and that they would register for a similar event in the future (82% vs 41%; P = .034). The comments about the CME event were more strongly positive from the game-based participants (Table 4).

Table 3
Results of participant evaluation of the session, comparing game-based and case-based participants responding “strongly agree” for each statement
Table 4
Written comments from participants on the session evaluation

DISCUSSION

This study found, on average, that participants in the traditional case-based learning group scored slightly higher on the immediate posttest of knowledge than the game-based group participants did, but this difference was not statistically significant. Further, 3 months following the CME session both groups had very comparable scores on the knowledge test. Participant evaluations demonstrated that game-based participants reported higher satisfaction with the event than their case-based counterparts did, which could mean that the game-based CME format has the potential to enhance recruitment for future game-based CME events.

While the immediate posttest results suggested that the traditional case-based format led to higher levels of knowledge (as much as a 3.8/40 or 9.5% higher score on the knowledge test), the knowledge levels were similar on the 3-month posttest of knowledge (consistent with the case-based group’s knowledge being no more than 2.5/40 or 6.3% greater than that of the game-based group).

This decrease in the difference between the 2 groups after 3 months appears to be largely due to a larger decline in knowledge scores after 3 months among the case-based group. This observation suggests the possibility that the game-based format leads to less long-term degradation of knowledge than the traditional case-based format. This differential in knowledge “decay” between the 2 educational formats deserves further exploration in future studies of game-based and case-based CME.

Strengths and limitations

The sample size was smaller than we had ideally hoped for, largely because of the challenge of recruiting participants. This might have been partly the result of the length of time required to participate (a total of 3 hours on the night of the event plus the 3-month posttest). It should be noted, however, that a game-based CME session, without the evaluation components or video, could be completed in half the time. Despite recruiting fewer participants than originally planned, the range of knowledge score differences suggested that the case-based group’s 3-month posttest knowledge scores would be no more than 6.3% (ie, 2.5 questions out of 40) greater than those of the game-based group. Finally, as frequently is the case in studies evaluating the effect of CME, this study measured only knowledge level and made no assessment of changes in participants’ clinical practice following the session.

Two study strengths were the use of an experimental design, which enhanced study group comparability, and the inclusion of a 3-month posttest, which enabled assessment of longer-term knowledge retention.

Conclusion

Presenting educational materials in a dynamic, innovative manner is a constant challenge for medical educators. This study found that knowledge gained through game-based learning was comparable to case-based learning, particularly 3 months after the event. In addition, the educational experience was reported as more enjoyable by the game-based participants. The findings of this study should encourage CME providers to consider using educational games more frequently. Future studies of this format should strive to include a larger number of participants. The interactivity and teamwork involved in this form of learning appear to make games a promising format for interprofessional continuing education.

Notes

EDITOR’S KEY POINTS

  • Educators strive to identify innovative ways of providing continuing medical education (CME) programs. Learning through games is engaging and challenging, and there are many possible applications of this strategy for CME for health professionals.
  • This study found that the long-term knowledge gained by family physicians through game-based learning was equivalent to that gained through traditional case-based learning, but participants enjoyed the game-based learning more and rated their level of satisfaction higher, compared with those participating in case-based learning.
  • Game-based learning provides a novel and effective way for delivering CME programming.

POINTS DE REPÈRE DU RÉDACTEUR

  • Les responsables des programmes de formation médicale continue (FMC) s’efforcent de trouver des méthodes d’enseignement novatrices. L’apprentissage par le jeu est une méthode attrayante et stimulante qui pourrait s’appliquer dans plusieurs domaines de la FMC pour les professionnels de la santé.
  • Cette étude a montré que les connaissances à long terme acquises par des médecins de famille au moyen de jeux étaient équivalentes à celles acquises par l’apprentissage traditionnel utilisant des cas, mais que les participants avaient davantage apprécié l’apprentissage par le jeu et accordé une cote de satisfaction plus élevée que ceux qui avaient appris par la méthode traditionnelle.
  • L’apprentissage par le jeu est une méthode nouvelle qui peut être utilisée efficacement dans les programmes de FMC.

Footnotes

This article has been peer reviewed.

Cet article a fait l’objet d’une révision par des pairs.

Contributors

All authors contributed to the design of the project and the educational event; Drs Rothman and Harvey analyzed the data; Drs Telner, Bujas-Bobanovic, Marlow, and Harvey and Mr Chester drafted the manuscript; and all authors revised and approved the final version of the manuscript.

Competing interests

Funding for this project was obtained from an unrestricted educational grant from Sanofi-aventis.

References

1. Schmitz BD, MacLean SL, Shidler HM. An emergency pursuit game: a method for teaching emergency decision-making skills. J Contin Educ Nurs. 1991;22(4):152–8. [PubMed]
2. Robertson D, Brocklehurst J. The aging game: a new teaching method in geriatric medicine. J Am Geriatr Soc. 1981;29(12):576–8. [PubMed]
3. Saunders NA, Wallis BJ. Learning decision-making in clinical medicine: a card game dealing with acute emergencies for undergraduate use. Med Educ. 1981;15(5):323–7. [PubMed]
4. Green J, Wardman G, Adam J, Hasnip JH. The survival game. Med Teach. 1992;14(2–3):211–4. [PubMed]
5. Elder SB, Gregory C. The “Lactation Game”: an innovative teaching method for health care professionals. J Hum Lact. 1996;12(2):137–8. [PubMed]
6. Fukuchi SG, Offutt LA, Sacks J, Mann BD. Teaching a multidisciplinary approach to cancer treatment during surgical clerkship via an interactive board game. Am J Surg. 2000;179(4):337–40. [PubMed]
7. Howard MG, Collins HL, DiCarlo SE. “Survivor” torches “Who Wants to Be a Physician?” in the educational games ratings war. Adv Physiol Educ. 2002;26(1–4):30–6. [PubMed]
8. Mann BD, Eidelson BM, Fukuchi SG, Nissman SA, Robertson S, Jardines L. The development of an interactive game-based tool for learning surgical management algorithms via computer. Am J Surg. 2002;183(3):305–8. [PubMed]
9. Roubidoux MA, Chapman CM, Piontek ME. Development and evaluation of an interactive Web-based breast imaging game for medical students. Acad Radiol. 2002;9(10):1169–78. [PubMed]
10. Steinman RA, Blastos MT. A trading-card game teaching about host defense. Med Educ. 2002;36(12):1201–8. [PubMed]
11. Duke ES. A taxonomy of games and simulations for nursing education. J Nurs Educ. 1986;25(5):197–206. [PubMed]
12. Lewis DJ, Saydak SJ, Mierzwa IP, Robinson JA. Gaming: a teaching strategy for adult learners. J Contin Educ Nurs. 1989;20(2):80–4. [PubMed]
13. Gruending DL, Fenty D, Hogan T. Fun and games in nursing staff development. J Contin Educ Nurs. 1991;22(6):259–62. [PubMed]
14. Speers AT. Games in nursing staff development. J Nurs Staff Dev. 1993;9(6):274–7. [PubMed]
15. Kramer N. Using games for learning. J Contin Educ Nurs. 1995;26(1):40–2. [PubMed]
16. Kuhn MA. Gaming: a technique that adds spice to learning. J Contin Educ Nurs. 1995;26(1):35–9. [PubMed]
17. Henry JM. Gaming: a teaching strategy to enhance adult learning. J Contin Educ Nurs. 1997;28(5):231–4. [PubMed]
18. Ingram C, Ray K, Landeen J, Keane DR. Evaluation of an educational game for health sciences students. J Nurs Educ. 1998;37(6):240–6. [PubMed]
19. Saethang T, Kee CC. A gaming strategy for teaching the use of critical cardiovascular drugs. J Contin Educ Nurs. 1998;29(2):61–5. [PubMed]
20. Skinner KD. Creating a game for sexuality and aging: the sexual dysfunction trivia game. J Contin Educ Nurs. 2000;31(4):185–9. [PubMed]
21. Amos A. Annual recertification: fun? Wow! J CANNT. 1994;4(1):21–4. [PubMed]
22. Blake J, Goodman J. Computer-based learning: games as an instructional strategy. ABFN J. 1999;10(2):43–6. [PubMed]
23. Bhoopathi PS, Sheoran R. Educational games for mental health professionals. Cochrane Database Syst Rev. 2006;(2):CD001471. [PubMed]
24. Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M. Comparison of vignettes, standardized patients, and chart abstraction. A prospective validation study of 3 methods for measuring quality. JAMA. 2000;283(13):1715–22. [PubMed]
25. Department of Obstetrics and Gynaecology, Chinese University of Hong Kong [website] Sample size for determination of equivalence of two means. Hong Kong: Chinese University of Hong Kong; 2000. Available from: http://department.obg.cuhk.edu.hk/researchsupport/Sample_size_CompEquivMean.asp. Accessed 2009 Nov 28.
26. Rweb [website] Difference between two proportions. Minneapolis, MN: University of Minnesota; 2009. Available from: www.stat.umn.edu/geyer/old00/3011/examp/ch8.html#two-prop. Accessed 2009 Nov 28.
27. Department of Obstetrics and Gynaecology, Chinese University of Hong Kong [website] Analysis of large contingency tables. Hong Kong: Chinese University of Hong Kong; 2000. Available from: http://department.obg.cuhk.edu.hk/researchsupport/RxC_contingency_table.asp. Accessed 2009 Nov 28.
28. Simple Interactive Statistical Analysis [website] T-test. Hilversum, The Netherlands: Simple Interactive Statistical Analysis; Available from: www.quantitativeskills.com/sisa/statistics/t-thlp.htm. Accessed 2009 Nov 28.
29. Institute of Phonetic Sciences [website] Wilcoxon test. Amsterdam, The Netherlands: Institute of Phonetic Sciences; Available from: www.fon.hum.uva.nl/Service/Statistics/Wilcoxon_Test.html. Accessed 2009 Nov 28.

Articles from Canadian Family Physician are provided here courtesy of College of Family Physicians of Canada