J Med Internet Res. 2003 Apr-Jun; 5(2): e13.
© John M Wiecha, Robert Gramling, Phyllis Joachim, Hannelore Vanderschmidt. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 27.6.2003. Except where otherwise noted, articles published in the Journal of Medical Internet Research are distributed under the terms of the Creative Commons Attribution License (http://www.creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited, including full bibliographic details and the URL (see "please cite as" above), and this statement is included.
Collaborative e-Learning Using Streaming Video and Asynchronous Discussion Boards to Teach the Cognitive Foundation of Medical Interviewing: A Case Study
1Boston University School of Medicine, Boston Medical Center, Boston MA, USA
2Brown University, Department of Family Medicine, Providence RI, USA
3Boston University School of Medicine, Department of Family Medicine, Boston MA, USA
4School of Public Health, Boston University, Center of Educational Development in Health, Boston MA, USA
Received November 5, 2002; Revisions requested April 15, 2003; Revised June 25, 2003; Accepted June 26, 2003.
Advances in electronic technology have created opportunities for new instructional designs of medical curricula.
We created and evaluated a 4-week online elective course for medical students to teach the cognitive basis for interviewing skills.
Ten students, from 2 medical schools, studied online modules on interviewing concepts and viewed videos illustrating the concepts. They then participated in asynchronous discussion groups designed to reinforce course concepts, stimulate reflective learning, and promote peer learning.
In qualitative evaluations, learners reported improvements in self-awareness; increased understanding of interviewing concepts; and benefits of online learning vs face to face learning. Participants reported high levels of satisfaction with online learning and with achievement of course objectives. Self-reported knowledge scores increased significantly from pre-course completion to post-course completion.
Online education has significant potential to augment curriculum on the medical interview, particularly among students trained in community settings geographically distant from their academic medical center.
Keywords: Education, distance; medical history taking; education, medical; online systems; students, medical; communication; physician-patient relations; clinical competence; Internet; World Wide Web
A number of organizations [1
] have identified deficiencies in physician communication-skills training. Strengthening instruction in communication skills is a priority national objective for US medical schools [4
]. Learning effective communication requires a cognitive foundation of interviewing theories and concepts [4
]. A curriculum on communication concepts and strategies should provide understanding of fundamental skills and processes, and will establish a sound foundation for learning skills [4
]. Such knowledge objectives have typically been best taught in years one and two of the curriculum [4
]. Decentralization [5
], a growing emphasis on adult learning principles, and use of distance education requires new thinking about curricular design and delivery. This paper reports our experiences with a new online method for teaching communication concepts to medical students.
Materials and Methods
The instructional design we use for online courses [6
] has the learner follow a deliberate sequence of educational activities (). Guided by the SEGUE (Set the Stage, Elicit Information, Give Information, Understand the Patient's Perspective, End the Encounter) framework of communication tasks [4
], over 4 weeks in an online elective course we consecutively addressed questioning techniques, affect and nonverbal cues, eliciting the cardinal features of a symptom, and stages and transitions.
Sequence of educational activities
Blackboard, a web-based learning system [7
] was used to organize course material and activities (Multimedia Appendix 1
). Two videos, delivered online through the Blackboard courseware and produced with GeoSystems compression software, illustrated the concepts presented each week in the Web-based text modules (). The videos were between 15 and 20 minutes in length. The first video demonstrated inexperienced interviewing by showing a first-year student interviewing a woman (Mary) with a depressed affect and dyspepsia. The second video was of a family physician interviewing a young man (Ed) with the same symptoms, and demonstrated a more-experienced interviewer. Each video was streamed through the course Web site.
Videos on the Blackboard e-learning site showing inexperienced and experienced interviews with patients
Students received access to a moderated, asynchronous discussion board and were required to post their impressions and observations each week. If necessary (that is, if they lagged in posting), they were reminded by the moderator. Using established principles [8
] (including probing participants for deeper reflection, challenging assertions by contrasting differing viewpoints and observations, and summarizing concepts and conclusions included in the postings to provide closure to each week's discussion), trained faculty moderated the discussion groups. Discourse should be a component of courses teaching communication concepts [4
]. At the course midpoint (ie, after 2 weeks) and at course end, students also received written feedback on their participation and performance by personal e-mail from one of the authors (PJ).
Evaluation Instruments and Processes
Qualitative assessments included one-to-one in-person interviews using open-ended questions, analysis of student course postings, and a face-to-face focus group with all 10 students, done by a facilitator previously unknown to the students. Interviews and focus groups were recorded and transcribed, and analyzed for emerging themes by one investigator (RG).
Eleven formative evaluation questions () were presented 1 week after the course using a Web-based questionnaire. Each question was scored on a 7-point Likert scale.
Student evaluation of the process of learning online
Students also completed pre-course and post-course Web-based questionnaires with 21 items (Multimedia Appendix 2
and Multimedia Appendix 3
), each scored on a scale from 1 (no understanding) to 10 (complete understanding), grouped into 4 categories (shown in ) corresponding to the major course objectives. Before/after scores were compared using a paired t test.
Level of understanding of interviewing concepts*
We calculated for each student a mean score on the baseline knowledge items. This score was linearly correlated with the number of interviews each student reported having completed to date ( r= 0.9412, P< .001), providing support for the construct validity of the self-reported knowledge measures ().
Interviewing experience vs. baseline interviewing knowledge
The course was offered to students between their first and second year at 2 medical schools to benefit from the inter-institutional learning facilitated by Web-based distance education. Our enrollment target of 10 students was reached with 7 students from Boston University and 3 from the University of Massachusetts. Two working groups of 5 students were created, in our experience an ideal size for online course discussions [6
Of the 10 students who started the course, one student dropped out of the course due to schedule conflicts, while 9 students completed the course and evaluations. Students made an average of 14 written postings during the 4-week course.
A qualitative analysis of the postings from course assignments consistently provided evidence of concept acquisition. A representative posting:
I realized that I never truly noticed any of Mary's or Ed's affect or non-verbal cues when I previously viewed the interview. However, when I watched the interview for a second time, I noticed many interactions that I had not before.
Major themes to emerge from the focus group are presented in Textbox 1
Theme 1: Theoretical understanding and self-awareness.
Student: "I really do think I have a more organized picture in my head of what I want to do the next time I sit down."
Theme 2: Benefits compared to face-to-face interaction.
Student 1: "You're forced to think through a good response and good interpretation . . . "
Student 2: "I think it's great. I never thought that I would, I'm very computer illiterate, I never thought that I would choose to do something online as opposed to just on paper or in class, but it was so convenient and so like relaxing you know? I took away a ton from it too. I mean I really feel like I did."
Student 3: "You're so much more likely to learn if you're doing it when you're ready for it."
Student 4: "I felt like there were some things that I was really able to take my time with and understand."
Also apparent from the group was a desire for variation in interviews to analyze (Theme 3) and opportunities to apply the concepts to real patients (Theme 4).
Open-ended comments on the course evaluation form supported these themes, and provided more detail about advantages of online learning in this course over more conventional methods. Two students provided representative viewpoints:
Student 1: ". . . interacting with students in the on-line format allowed for well thought-out, comprehensive responses and much more insightful comments than sometimes heard in a classroom. I attribute this to the time one has to sit and think through a response, choose the words carefully, and elaborate uninterrupted. There's less pressure on-line, so you can piece together your thoughts with less stress and greater sincerity."
Student 2: "The strengths are the high level of participation and interaction and conversation (more so than in any other course so far.)"
Students rated all aspects of the course highly () and knowledge scores increased significantly ( P< .01) at the end of the course (). As can be expected, students who reported the least baseline knowledge reported the greatest increase in understanding of course concepts ( r= 0.79, P= .015) ().
Gain in knowledge, by baseline knowledge
Also, gain correlated with the number of words posted to the course discussion group ( r= 0.72, P=.02), suggesting that greater educational effort was correlated with greater self-reported gain in knowledge ().
Correlation between words posted to course discussion group and gain in knowledge
The students completing this course participated at a high level and rated it highly on learning process and achievement of course goals. Our data suggests that it increased student understanding of basic concepts underlying effective clinical communication. The course's acceptance was in large part due to its congruence with principles of adult learning [11
] such as self pacing, reflective learning, and collaborative learning from peers [11
]. Participants noted a number of advantages of online learning. Although there are only rare examples in the literature of online courses on communication skills for medical professionals or students [12
], this study does add to the growing literature in medicine and in fields outside of medicine [13
], suggesting the effectiveness of Internet-based distance education. However, more-rigorous evaluations with control groups and a larger number of participants are required to establish which factors and participant characteristics are determinants of effective learning. Medical-education studies generally show that Internet-based instruction is at least as effective as conventional methods [16
] and in some cases superior [19
]. However, a recent meta-analysis of Web-based learning in medical education did not find this method superior to conventional methods, but did acknowledge that studies are needed that better compare instructional methods
rather than comparing instructional media
, as has been the focus of many studies to date, rendering conclusions about the relative merits of online vs face-to-face methods difficult to make [22
]. A carefully-designed, carefully-taught, and carefully-evaluated online course may effect better learning outcomes than face to face instruction [23
]. Based on the limitations of research to date, it is clear that further work is needed to assess the impact and acceptance of small group online education, and the role of faculty or other moderators in online medical education courses [19
]. The acceptance of this method in a broader, unselected student population will be of interest. Evidence suggests that most learners will ultimately be successful online learners [27
]. We also note that self report of learning is less reliable than direct measurement of knowledge acquisition. However, there was consistency of findings from the mixed-method approach used to evaluate this course. Given the favorable results from this elective, we plan to integrate elements of this online course into the preclinical-years' communication-skills curricula for use by all first-year students.
Jordan Cohen, the President of the Association of American Medical Colleges (AAMC), in a speech once exhorted medical educators to seize "the potential of the technological revolution to transform the way students learn" [28
]. In response, we have developed a new method of introducing the cognitive basis for communication using electronic technology. It should also be applicable to other content areas and is likely to prove particularly useful as medical education becomes increasingly decentralized.
This work was supported by an Instructional Technology Grant from Boston University, and by the Robert Wood Johnson Foundation via a Generalist Physician Faculty Scholars Award, both to Dr. Wiecha.
Multimedia Appendix 2
Interviewing Pre Survey Questionnaire
Multimedia Appendix 3
Interviewing Post Survey Questionnaire
1. Liaison Committee on Medical Education, authors. Functions and structure of a medical school. Washington, DC: Liaison Committee on Medical Education; 1998.
2. US Dept of Health and Human Services, authors. Physician education for a changing health care environment: Council on Graduate Medical Education thirteenth report (SuDoc HE 20.9019:P 56/2) Washington, DC: U.S. Dept. of Health and Human Services, Health Resources and Services Administration; 1999.
3. Association of American Medical Colleges, authors. Physicians for the twenty-first century. Report of the Project Panel on the General Professional Education of the Physician and College Preparation for Medicine. J Med Educ. 1984 Nov;59(11 Pt 2):1–208.
4. Association of American Medical Colleges, authors. Medical School Objectives Project. Report III: Contemporary issues in medicine: communication in medicine. Washington, DC: Association of American Medical Colleges; 1999.
5. Schroeder S A. Expanding the site of clinical education: moving beyond the hospital walls. J Gen Intern Med. 1988;3(2 Suppl):S5–14. [PubMed] 6. Wiecha John M, Vanderschmidt Hannelore, Schilling Kathy. HEAL: an instructional design model applied to an online clerkship in family medicine. Acad Med. 2002 Sep;77(9):925–6. [PubMed]
8. Collison George, Elbaum Bonnie, Haavind Sarah, Tinker Robert. Facilitating Online Learning: Effective Strategies for Moderators. Madison, WI: Atwood Pub; 2000. Oct 1,
10. Wiecha John, Barrie Nick. Collaborative online learning: a new approach to distance CME. Acad Med. 2002 Sep;77(9):928–9. [PubMed]
11. Whitman Neal. The physician as teacher. Salt Lake City, UT: Whitman Associates; 1997.
12. Fleetwood J, Vaught W, Feldman D, Gracely E, Kassutto Z, Novack D. MedEthEx Online: a computer-based learning program in medical ethics and communication skills. Teach Learn Med. 2000;12(2):96–104. doi: 10.1207/S15328015TLM1202_7. [PubMed] [Cross Ref]
13. Ryan WJ. Community College Innovations Conference. Boston, MA: League for Innovation in the Community College; 2002. Online and in the classroom: the numbers and what they might mean.
14. Thirunarayanan MO, Pérez-Prado A. Comparing Web-based and classroom-based learning: a quantitative study. Journal of Research on Technology in Education. 2002;34(2):131–137.
15. Johnson SD, Aragon S, Shaik N, Palma-Rivas N. De Bra P, Leggett JJ. Proceedings of WebNet 99: World Conference on the WWW and Internet. Charlottesville, VA: Association for the Advancement of Computing in Education (AACE); 1999. Comparative analysis of online vs. face to face instruction.
16. Mehta M P, Sinha P, Kanwar K, Inman A, Albanese M, Fahl W. Evaluation of Internet-based oncologic teaching for medical students. J Cancer Educ. 1998;13(4):197–202. [PubMed] 17. Hobbs G D, Moshinskie J F, Roden S K, Jarvis J L. A comparison of classroom and distance learning techniques for rural EMT-I instruction. Prehosp Emerg Care. 1998;2(3):189–91. [PubMed] 18. Zucker Donna M, Asselin Micheline. Migrating to the web: the transformation of a traditional RN to BS program. J Contin Educ Nurs. 2003;34(2):86–9. [PubMed] 19. Chan D H, Leclair K, Kaczorowski J. Problem-based small-group learning via the Internet among community family physicians: a randomized controlled trial. MD Comput. 1999;16(3):54–8. [PubMed] 20. Leong Shou Ling, Baldwin Constance D, Adelman Alan M. Integrating Web-based computer cases into a required clerkship: development and evaluation. Acad Med. 2003 Mar;78(3):295–301. [PubMed] 21. Radjenovic D, Wallace F L. Computer-based remote diabetes education for school personnel. Diabetes Technol Ther. 2001;3(4):601–7. doi: 10.1089/15209150152811225. [PubMed] [Cross Ref] 22. Chumley-jones Heidi S, Dobbie Alison, Alford Cynthia L. Web-based learning: sound educational method or hype? A review of the evaluation literature. Acad Med. 2002 Oct;77(10 Suppl):S86–93. [PubMed] 23. Lipman A J, Sade R M, Glotzbach A L, Lancaster C J, Marshall M F. The incremental value of internet-based instruction as an adjunct to classroom instruction: a prospective randomized study. Acad Med. 2001 Oct;76(10):1060–4. [PubMed] 24. Hay P J, Katsikitis M. The 'expert' in problem-based and case-based learning: necessary or not? Med Educ. 2001 Jan;35(1):22–6. doi: 10.1046/j.1365-2923.2001.00679.x.med679 [PubMed] [Cross Ref] 25. Marshall J N, Stewart M, Ostbye T. Small-group CME using e-mail discussions. Can it work? Can Fam Physician. 2001 Mar;47:557–63. [PMC free article] [PubMed]
27. Harasim Linda, Hiltz Starr Roxanne, Teles Lucio, Turoff Murray. Learning Networks: A Field Guide to Teaching and Learning On-Line. Cambridge, MA: The MIT Press; 1995. Sep 5,