PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of corrspringer.comThis journalToc AlertsSubmit OnlineOpen Choice
 
Clin Orthop Relat Res. 2016 April; 474(4): 882–886.
Published online 2016 February 17. doi:  10.1007/s11999-016-4750-2
PMCID: PMC4773326

Not the Last Word: Morbidity and Mortality Conference: Theater of Education

One essential feature of Morbidity and Mortality (M&M) conferences is the admission of error. In that spirit, I must concede that some of the opinions I have previously shared in this space were wrong. For example, my criticisms of core competencies for residents [3] were off target. All three commentators on that essay made the same point: The system may not be perfect, but it is better than what came before. They are correct.

Another essential function of M&M conferences is to prevent the repetition of error. And in that spirit, I will try to avoid making my previous mistake. So while I come now (a bit more humbled) to criticize the modern M&M conference, I admit right up front that the contemporary approach to studying medical error represents a vast improvement over the not-so-distant past [18], when mistakes were buried, in both senses of the word. Indeed, Codman’s innovative attention on  assessing treatment outcome (the forerunner of the M&M conference) stands next to antibiotics and anesthesia as one of the greatest medical advances in the last century.

Nonetheless, as a method of uncovering error, the M&M conference is flawed; and as a means of analyzing the causes of error, the M&M approach leaves a lot to be desired.

The first issue is that M&M uses the lowest form of medical evidence—the case report [12]. Case reports can be instructive, of course, yet isolated occurrences rarely articulate larger truths. In the realm of M&M, a single case will not speak to trends and patterns, and therefore can teach both too much and too little.

For example, a postoperative dislocation of a hip replacement might be the result of a technical error (implanting the device with inadequate soft-tissue tension or incorrect cup position, for example) but dislocation could also be seen after a perfectly-performed procedure as well. A talented surgeon will periodically have a patient dislocate, just as a talented baseball shortstop will, every now and then, throw the ball over the first baseman’s head. The occurrence of a dislocation or a single errant throw is not cause for alarm; a series of blunders, however, very well may be. Needless to say, discussion of a single case will fail to discern the difference.

It must be noted, too, that isolated cases can create incorrect impressions because of recall bias. For example, if a surgeon presents a rare complication with a specific device, those listening to the presentation may inappropriately avoid using that device, deeming the risk of complication to be higher than it truly is.

Another problem with M&M is how cases are selected: Namely, a complication must take place. Thus, an orthopaedic surgeon who does not administer postoperative deep vein thrombosis (DVT) prophylaxis will not get flagged in M&M unless and until his patient suffers a DVT. The error itself is not enough to trigger review. Indeed, the error could be repeated many times before a complication occurs.

Morbidity and Mortality conferences also will fail to include those errors whose problems are not immediate. For instance, pin penetration into the hip joint during surgical treatment of a slipped epiphysis may lead to chondrolysis [14]—but perhaps years later, outside the purview of the M&M conference.

Unfortunately, this lack of sensitivity is not necessarily offset by high specificity either. It is known that a DVT or chondrolysis may occur despite perfect care.

Within the conference itself, M&M is poorly structured for analysis. Typically, the first comments are offered by the senior surgeons; and owing to their experience, that is a good thing. Still, one strong comment either way, defending the treatment or criticizing it, can frame (or indeed, end) the discussion. When the department chair dismisses an error by saying “this happens to the best of us,” it is hard for a junior faculty member, to say nothing of a student or resident, to present a dissenting view. By contrast, the collective wisdom of the entire audience could be harnessed by anonymous audience response technology [15] that collects and integrates the individual responses of every person attending the conference, before the audience had its thoughts anchored by an assertive opinion.

Morbidity and Mortality conferences can, however, accomplish things beyond the reach of any other forum or medium. For one thing, these conferences are a platform for storytelling [10], and teaching in the context of stories is particularly effective. Instruction on the detection and management of complications will be more vivid and enduring (and provoke introspection, to boot) when it is presented in the context of a real case, tackled by known colleagues, in familiar surroundings. It is neither feasible nor desirable for residents to see every possible complication themselves; some second-hand learning is inevitable. And if a resident is not going to personally encounter a given complication, hearing about it in M&M conference might be the best alternative.

These conferences also serve a critical social function: Teaching the audience that it is not only permissible but healthful and necessary to admit one’s mistakes. Just as children cannot develop in full if they do not hear their parents say “I was wrong,” residents must see their teachers concede error when they commit one. Residents will reach their highest potential only if they engage in continued self-improvement [8]. To this end, they must admit their mistakes (at least, at first, to themselves). The example of respected mentors doing this can liberate this otherwise stifled step.

Morbidity and Mortality conferences must be seen for what they really are: Ritualized performances that serve to educate the audience. For true quality improvement and error reduction, a health system needs safety monitoring boards, peer-review committees and other, more refined methods. Morbidity and Mortality conferences cannot and should not supplant these efforts. Rather, M&M conferences exist specifically for the edification of students and residents. Indeed, a hospital without trainees won’t lose much were it to forgo the conference and stick to more effective procedures. The theater of the M&M conference is best reserved for its distinct audience.

Charles L. Bosk PhD

Professor of Sociology and Medical Ethics, University of Pennsylvania

Author of Forgive and Remember: Managing Medical Failure

Dr. Bernstein begins his piece on the utility of the M&M conference as a tool for improving patient safety with two observations that highlight why reducing harm to patients is such a challenging task. First, not all procedures that surgeons perform imperfectly result in harm to patients. Second, some procedures that are done flawlessly, nonetheless, have adverse outcomes.

From this starting point, Dr. Bernstein arrives at two conclusions; one of which is uncontestable, while the other invites vigorous disagreement. On the one hand, Dr. Bernstein is surely correct in arguing that any approach to quality improvement aimed at reducing harm to patients needs to be multipronged and include elements that are more systematic than M&M conferences alone. On the other, while Dr. Bernstein identifies the social function of morbidity and mortality as a forum for storytelling, he is too dismissive of how important this “occupational ritual” is for communicating professional norms to students and residents and for reinforcing those norms among colleagues [5, 6].

In part, Dr. Bernstein’s critique of M&M conferences stems from the flaws that are inherent to the conference itself. Case reports are seen as the least-reliable source of evidence for drawing general conclusions [12]. Discussions can be unproductive. Recall bias may create a distorted view of specific devices. The only purpose that mortality and morbidity serves is describing for students and residents complications that they may not have the opportunity to observe and showing those same students and residents that it is “healthful to admit mistakes.”

Dr. Bernstein acknowledges that this modeling is important; however, he does not seem to appreciate how critical this modeling truly is. These conferences differ from all the other more-systematic modes for uncovering latent system defects in one critical respect—M&M conferences alone involve colleagues, in face-to-relationships, discussing adverse events in context, shortly after they occurred.

This is critical for two reasons. First, unless there is a place where errors are discussed openly, then students, residents, and colleagues learn the lesson that errors are better left as a private matter. When errors are dealt with as a private matter, the professional community of physician colleagues abandon their fiduciary obligation to the larger community to regulate itself. That errors are better treated under a veil of silence is a terrible lesson for senior physicians to pass on to their students and residents.

Second, M&M conferences are one of the few arenas in which colleagues observe how seriously their peers think about adverse events. As such, performances in the “educational theater” of M&M conferences are one place for assessing the character, integrity, and trustworthiness of one’s peers.

For a variety of reasons, from increased production pressures on surgeons to increasing use of digital technologies for communication, the amount of face-to-face communication among peers and between teaching faculty with their students and residents has been reduced. Trust is built through face-to-face relationships. It is my contention that anything that erodes trust erodes patient safety. Because it is one avenue for sustaining face-to-face relationships, mortality and morbidity serve the goals of safety in ways that outweigh whatever imperfections inhere in their structure. Ritual processes are necessary for reinforcing and reanimating group norms. The role that M&M conferences play in communicating how seriously professionals ought to examine their adverse outcomes is not enough to enhance safety on its own, but without these conferences the possibility of improvement is greatly reduced.

Christina L. Cifra MD

Department of Pediatrics

University of Iowa Carver College of Medicine

Dr. Bernstein’s impassioned commentary on the nonutility of the M&M conference as an avenue for discovery and analysis of medical error is interesting, but not supported by current research. Numerous studies have been published in the past few years documenting the benefit of a systems-oriented M&M conference in many settings, both medical and surgical [2, 9]. Although it is true that the M&M conference is not a perfect quality improvement tool, this is also the case for established systems of error detection and investigation [20]. At this point, there is no ideal process, since specific adverse event surveillance systems work better for some, but not other types of error [13, 17].

As an error-detection system, the M&M conference does suffer from case selection bias, but other mechanisms that rely on voluntary reports such as incident reporting and root-cause analysis have the same bias as well. The M&M conference works best within a clinical microsystem [16] with a highly developed safety culture [4] in wh ich participants are encouraged to report mistakes without fear of personal judgment. This promotes the ability to capture a wide variety of events, both near-misses (such as the lack of DVT prophylaxis) and those that actually resulted in harm (like the occurrence of a DVT). The M&M conference fosters discussion at the frontlines, especially when a multidisciplinary group participates. This strengthens safety culture, which in turn enhances M&M conference error reporting [7]. Another approach is to discuss all cases that fulfill certain qualities (deaths, readmissions, or reoperations occurring within a prespecified period of time), which serve as red flags for possible undiscovered errors.

As an error-analysis system, the M&M conference is underutilized. Recent work has shown that the use of a structured tool for error analysis within the context of the M&M conference results in better understanding of causative factors, which translates to more quality improvement interventions implemented [2, 7]. Unfortunately, most M&M conferences do not take advantage of such tools [1]. Dr. Bernstein lamented that the M&M conference traffics only in case reports, and worries that isolated occurrences would not reflect larger trends. This is true. If analyzed well, however, one error discussed can uncover wide-reaching system problems that if corrected can improve many outcomes. Dr. Bernstein also touched on the possibility of error despite “perfect care,” alluding to issues of ascertaining preventability. Again, using a structured tool for analysis can help in this regard. Just because an event is a known complication of a procedure should not preclude its scrutiny. After all, a short decade ago it was common to accept central line-associated bloodstream infections as unpreventable when today we know this is untrue [19].

In summary, the M&M conference is not perfect, but it has distinct value in improving patient care. It is but one of many in the growing arsenal of quality improvement interventions we can employ to prevent harm and improve outcomes. If “every system is perfectly designed to achieve the results that it gets” [11], then why be content with ritualized performances and theater when we can redesign it to serve our cause?

Footnotes

Note from the Editor-in-Chief: We are pleased to present to readers of Clinical Orthopaedics and Related Research ® with the next Not the Last Word. The goal of this section is to explore timely and controversial issues that affect how orthopaedic surgery is taught, learned, and practiced. We welcome reader feedback on all of our columns and articles; please send your comments to eic@clinorthop.org.

The author certifies that he, or any member of his immediate family, has no funding or commercial associations (eg, consultancies, stock ownership, equity interest, patent/licensing arrangements, etc) that might pose a conflict of interest in connection with the submitted article.

All ICMJE Conflict of Interest Forms for authors and Clinical Orthopaedics and Related Research ® editors and board members are on file with the publication and can be viewed on request.

The opinions expressed are those of the writers, and do not reflect the opinion or policy of Clinical Orthopaedics and Related Research ® or The Association of Bone and Joint Surgeons®.

References

1. Aboumatar HJ, Blackledge CG, Jr, Dickson C, Heitmiller E, Freischlag J, Pronovost PJ. A descriptive study of morbidity and mortality conferences and their conformity to medical incident analysis models: results of the morbidity and mortality conference improvement study, phase 1. Am J Med Qual. 2007;22:232–238. doi: 10.1177/1062860607303292. [PubMed] [Cross Ref]
2. Bechtold ML, Scott S, Nelson K, Cox KR, Dellsperger KC, Hall LW. Educational quality improvement report: outcomes from a revised morbidity and mortality format that emphasised patient safety. Qual Saf Health Care. 2007;16:422–427. [PMC free article] [PubMed]
3. Bernstein J. Not the last word: The ACGME core competencies are overrated. Clin Orthop Relat Res. 2014;472:2932–2937. doi: 10.1007/s11999-014-3732-5. [PMC free article] [PubMed] [Cross Ref]
4. Berry JC, Davis JT, Bartman T, Hafer CC, Lieb LM, Khan N, Brilli RJ. Improved safety culture and teamwork climate are associated with decreases in patient harm and hospital mortality across a hospital system. [Published online ahead of print January 6, 2016]. J Patient Saf. DOI:10.1097/PTS.0000000000000251. [PubMed]
5. Bosk CL. Forgive and Remember: Managing Medical Failure. Chicago, IL: University of Chicago Press; 1979.
6. Bosk CL. Occupational rituals in patient management. N Engl J Med. 1980;303:71–76. doi: 10.1056/NEJM198007103030203. [PubMed] [Cross Ref]
7. Cifra CL, Bembea MM, Fackler JC, Miller MR. Transforming the morbidity and mortality conference to promote safety and quality in a PICU. Pediatr Crit Care Med. 2016;17:58–66. doi: 10.1097/PCC.0000000000000539. [PMC free article] [PubMed] [Cross Ref]
8. Covey S. The 7 Habits of Highly Effective People. New York, NY: Free Press; 1989.
9. Deis JN, Smith KM, Warren MD, Throop PG, Hickson GB, Joers BJ, Deshpande JK. Transforming the morbidity and mortality conference into an instrument for systemwide improvement. In: Henriksen K, Battles JB, Keyes MA, Grady ML, eds. Advances in Patient Safety: New Directions and Alternative Approaches(Vol. 2: Culture and Redesign). Rockville, MD: Agency for Healthcare Research and Quality; 2008. [PubMed]
10. Hunter KM, Charon R, Coulehan JL. The study of literature in medical education. Acad Med. 1995;70:787–794. doi: 10.1097/00001888-199509000-00014. [PubMed] [Cross Ref]
11. Institute for Healthcare Improvement. Like magic? (“Every system is perfectly designed…”). Available at: http://www.ihi.org/communities/blogs/_layouts/ihi/community/blog/itemview.aspx?List=7d1126ec-8f63-4a3b-9926-c44ea3036813&ID=159. Accessed February 4, 2016.
12. Leopold SS. Editorial: Case closed—discontinuing case reports in Clinical Orthopaedics and Related Research. Clin Orthop Relat Res. 2015;473:3074–3075. doi: 10.1007/s11999-015-4536-y. [PMC free article] [PubMed] [Cross Ref]
13. Levtzion-Korach O, Frankel A, Alcalai H, Keohane C, Orav J, Graydon-Baker E, Barnes J, Gordon K, Puopulo AL, Tomov EI, Sato L, Bates DW. Integrating incident data from five reporting systems to assess patient safety: making sense of the elephant. Jt Comm J Qual Patient Saf. 2010;36:402–410. [PubMed]
14. Lubicky JP. Chondrolysis and avascular necrosis: complications of slipped capital femoral epiphysis. J Pediatr Orthop B. 1996;5:162–167. doi: 10.1097/01202412-199605030-00005. [PubMed] [Cross Ref]
15. Nayak L, Erinjeri JP. Audience response systems in medical student education benefit learners and presenters. Acad Radiol. 2008;15:383–389. doi: 10.1016/j.acra.2007.09.021. [PubMed] [Cross Ref]
16. Nelson EC, Batalden PB, Godfrey MM, editors. Quality By Design: A Clinical Microsystems Approach. San Francisco, CA: John Wiley & Sons; 2011.
17. Olsen S, Neale G, Schwab K, Psaila B, Patel T, Chapman EJ, Vincent C. Hospital staff should use more than one method to detect adverse events and potential adverse events: incident reporting, pharmacist surveillance and local real-time record review may all have a place. Qual Saf Health Care. 2007;16:40–44. doi: 10.1136/qshc.2005.017616. [PMC free article] [PubMed] [Cross Ref]
18. Orlander JD, Barber TW, Fincke BG. The morbidity and mortality conference: the delicate nature of learning from error. Acad Med. 2002;77:1001–1006. doi: 10.1097/00001888-200210000-00011. [PubMed] [Cross Ref]
19. Pronovost P, Needham D, Berenholtz S, Sinopoli D, Chu H, Cosgrove S, Sexton B, Hyzy R, Welsh R, Roth G, Bander J, Kepros J, Goeschel C. An intervention to decrease catheter-related bloodstream infections in the ICU. N Engl J Med. 2006;355:2725–2732. doi: 10.1056/NEJMoa061115. [PubMed] [Cross Ref]
20. Shojania KG. The frustrating case of incident-reporting systems. Qual Saf Health Care. 2008;17:400–402. doi: 10.1136/qshc.2008.029496. [PubMed] [Cross Ref]

Articles from Clinical Orthopaedics and Related Research are provided here courtesy of The Association of Bone and Joint Surgeons