Towards a basic endoscopic evaluation of swallowing in acute stroke – identification of salient findings by the inexperienced examiner

doi:10.1186/1472-6920-9-13

BMC Med Educ. 2009; 9: 13.

Published online 2009 March 10. doi: 10.1186/1472-6920-9-13

PMCID: PMC2657144

Towards a basic endoscopic evaluation of swallowing in acute stroke – identification of salient findings by the inexperienced examiner

Tobias Warnecke,¹ Inga Teismann,¹ Stephan Oelenberg,¹ Christina Hamacher,¹ E Bernd Ringelstein,¹ Wolf R Schäbitz,¹ and Rainer Dziewas¹

¹Department of Neurology, University Hospital of Münster, Albert-Schweitzer-Str. 33, D-48129 Münster, Germany

Corresponding author.

Tobias Warnecke: Tobias.Warnecke/at/ukmuenster.de; Inga Teismann: i.teismann/at/uni-muenster.de; Stephan Oelenberg: oelenberg/at/uni-muenster.de; Christina Hamacher: c.hamacher/at/uni-muenster.de; E Bernd Ringelstein: ringels/at/uni-muenster.de; Wolf R Schäbitz: schabitz/at/uni-muenster.de; Rainer Dziewas: dziewas/at/uni-muenster.de

Received September 25, 2008; Accepted March 10, 2009.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

This article has been cited by other articles in PMC.

Abstract

Background

Dysphagia is common after stroke. Fiberoptic endoscopic evaluation of swallowing (FEES) is a powerful tool for dysphagia assessment. The purpose of this study was to assess whether a previously established endoscopic examination protocol based on the identification of typical findings indicative of stroke – related dysphagia may be learned and adopted by clinicians so far inexperienced in this field.

Methods

After receiving a structured lecture on this topic, participants were asked to rate video sequences of endoscopic swallowing examinations of acute stroke patients. The first part of the testing ("single findings-rating") comprised of 16 single sequences, the second part ("complete examination-rating") presented the key sequences of 8 complete examinations. Before the second part was started, results of the first were discussed.

Results

At the "single findings-rating" 88.8% of video-sequences were assessed correctly, while at the "complete examination-rating" the average performance had improved to 96%. Furthermore, no overlooking of relevant pathologies was noted in the second part of the testing.

Conclusion

This study suggests that the presented endoscopic examination protocol is reliably interpreted by inexperienced clinicians after a short lecture and may therefore easily and successfully be adopted in dysphagia management of acute stroke care.

Background

A proper assessment of dysphagia is one of the most important topics in acute stroke care. Although clinical dysphagia screening is known to reduce the risk of pneumonia and fatal outcome after stroke [1-3], this approach has an insufficient sensitivity, specificity and interrater reliability, and is particularly poor in detecting silent aspiration [4,5]. First evidence is evolving that fiberoptic endoscopic evaluation of swallowing (FEES) may be particularly helpful in this context [6,7]. This procedure can be performed at the bedside like clinical examination and is generally well tolerated and therefore frequently repeatable [6,8]. According to recent studies, FEES performs even better than videofluoroscopy in detecting important consequences of dysphagia, in particular aspiration and pharyngeal residue severity [9,10].

Recently, we developed a FEES-based dysphagia score that allows a quick deduction of clinical consequences from easy-to-identify endoscopic findings and may therefore efficiently guide management of stroke-related dysphagia in the acute stage of the illness [4].

FEES is usually considered to be a technique that needs a lot of experience to identify and interpret its findings. In the present study, we investigated whether our FEES-based dysphagia score for acute stroke patients may be adopted successfully after a short training session by physicians so far inexperienced in the field of endoscopic dysphagia assessment.

Methods

Dysphagia assessment

Previously, we developed a protocol for endoscopic assessment of dysphagia in patients with acute stroke. Following this protocol each examined patient is classified according to a six point scoring system that allows a quick deduction of clinical consequences (Figure (Figure1)1) [4,11]. In brief, the examination starts with rating the severity of oropharyngeal secretions (handling of secretions). In case saliva pooling with penetration or aspiration is found severe dysphagia is suspected and score 6 is given. Patients being able to handle their saliva without penetration or aspiration and do not have a severely reduced state of consciousness (i.e. stupor or coma) receive a teaspoon of puree consistency next. Those who show penetration or aspiration without protective reflex (i.e. coughing or swallowing) on at least one of three attempts are again diagnosed with severe dysphagia (score 5). If sufficient protective reflexes are present score 4 is attributed.

Figure 1

Flowchart for the endoscopic assessment of dysphagia.

Patients managing puree consistency are exposed to a teaspoon of colored water. Penetration or aspiration without sufficient protective reflex keeps the patient on score 4, while the presence of protective reflexes leads to score 3.

If patients being able to swallow liquids three times without penetration or aspiration, a small piece of white bread is given to them at the last step. Here, penetration or aspiration or severe residues (> 50% of bolus size, i.e. bolus fills or overflows the cavities) in the valleculae or pyriforms are taken as evidence of severe difficulty with this food consistency resulting in score 2. If none of these findings are observed on three consecutive trials score 1 is given.

Subjects

Seventeen neurologists (7 women, 10 men; mean age = 31 years, range 28 to 45 years) with a professional experience of 4.5 years (range 1–16 years) took part in the study. None of the participants had experience with fiberoptic endoscopic dysphagia assessment.

Lecture

First, a 30-minutes lecture on the physiology of swallowing and the basics of FEES was given. The above mentioned salient findings were defined, the dysphagia assessment protocol was explained and characteristic videos were shown.

Evaluation-videos and test construction

Suitable video sequences of endoscopic swallowing examinations of acute stroke patients with duration of 5 to 10 seconds were collected by one of the authors (S.O.) from archived material. Two raters (R.D., T.W.), both having several years of experience with this diagnostic procedure, separately evaluated the salient findings of each sequence. 5% of the collected samples were rejected due to disagreement between the two raters.

The first part of testing ("single findings-rating") comprised of 16 sequences presented to the inexperienced raters in succession without intermediate explanation or discussion. On request, sequences were repeatedly shown. Four samples each belonged to the category "handling of secretion", "puree consistency", "liquid", and "semisolid food", respectively. The raters were asked to evaluate the videos for the presence or absence of penetration or aspiration on a 5-point scale ("No penetration or aspiration", "Penetration with protective reflex", "Penetration without protective reflex", "Aspiration with protective reflex", and "Aspiration without protective reflex"). Additionally they had to assess severity ("No", "Mild", "Moderate", "Severe") and location ("No", "Valleculae", "Sinus piriformis") of residues that were left after the swallow [9]. After finishing the evaluation of the 16 video sequences by the inexperienced raters, all scoring sheets of the first part of testing were collected. Subsequently, the videos were briefly reviewed and evaluations were discussed. In this way, apart from serving as test instrument, the single findings-rating was also used as interactive teaching tool.

During the second part of testing ("complete examination-rating") the key sequences of 8 complete FEES examinations were presented. Three patients with infarction of the left middle cerebral artery (MCA), three with infarction of the right MCA, and two with brainstem infarction were chosen. According to the protocol described above, after each sequence, the raters had to state whether they wanted to finish the examination and decide on a score, because, for example, penetration was detected, or whether the examination should proceed to the next food consistency. Rating was done silently on a prepared score sheet.

Statistics

For each task, the percentage of correct ratings was determined. Furthermore, inter-rater reliability was assessed by calculating kappa (κ) coefficients. The upper limit of the κ-coefficient representing total agreement between the raters is 1.0, while a κ-coefficient of 0.0 represents agreement at chance level. κ-coefficient scores in the range of 0.41 to 0.60 indicate moderate agreement, 0.61 to 0.80 indicate substantial agreement, and 0.81 to 1.00 indicate excellent agreement [12].

Results

All participants completed the study. As is shown in table table1,1, at the "single findings-rating" 88.8% of video-sequences were assessed correctly. The corresponding κ-coefficient of 0.73 indicated substantial agreement between the raters (table (table22).

Table 1

Results of the "single findings-rating": Percentage of correct ratings

Table 2

Results of the "single findings-rating": κ-coefficients

With over 90% of correct ratings the items "handling of secretions" and "semisolid food" achieved the best results, while "liquids" and "pureed food" were still rated correctly in nearly 84% of cases. The corresponding κ-coefficients ranged from 0.60 (puree consistency) to 0.91 (handling of secretions) (table (table2).2). Looking at different types of salient findings, assessing penetration proved to be relatively difficult with 14% mistaken judgments. Aspiration and normal findings were rated better, wrong assessments occurred in only 9% of cases.

At the "complete examination rating" the participants' diagnostic abilities had improved. Altogether, only five mistakes occurred, giving an average of 96% of correct scores and a corresponding κ-coefficient of 0.91 (p < 0.001) indicating excellent agreement between the raters (Table (Table33).

Table 3

Results of the "complete examination-rating"

Interestingly, no instance of overlooking a relevant pathology was noted, whereas all wrong assessments belonged to the category "false positive" rating. In three cases, residues in the sinus pyriformis were misleadingly taken as reason to "terminate" the examination by suggesting a score, while twice saliva pooling in the sinus pyriformis without penetration or aspiration provoked an overly cautious approach.

Discussion

This study demonstrates that in acute stroke patients assessing salient findings of endoscopic swallowing examination following the here described protocol can be done reliably with a minimum of experience. After receiving an introductory lecture the previously untrained participants of our study gave a correct rating of characteristic video sequences in nearly 90% of cases, which corresponded to a κ-coefficient of 0.73.

The assessment of liquid and pureed food swallows proved relatively difficult in comparison to semisolid food. This is probably because the former consistencies typically showed predeglutitive key findings only for fractions of a second. Here, replaying of the respective sequences in slow motion, which is also advocated by Langmore and co-workers [13], might have been useful. The further improvement seen at the complete examination-rating with 96% correct assessments (corresponding κ-coefficient = 0.91) was probably due to a marked training effect of the previous testing and the subsequent discussion. Since systematic curricula on the present subject are sparse, this point may be of relevance for future teaching of endoscopic evaluation of swallowing.

Looking in detail at the few mistakes made at the second testing, it is striking that in each single case participants erred on "safe side" leading to a worse score than necessary.

Furthermore, the excellent κ-coefficient achieved by the previously untrained participants of our study at the complete examination-rating may suggest that endoscopic swallowing assessment according to the here described protocol is simpler to score and more reliable compared to videofluoroscopic swallowing evaluations of acute stroke patients [5,14].

When we developed our screening protocol for acute stroke patients, we aimed for a simple way of scoring endoscopic key findings making this tool more easy to adopt for inexperienced clinicians [4]. Thus, in comparison to the well-known 8-point Penetration-Aspiration Scale (PAS) developed by Rosenbek and co-workers [15], we chose a simplified 5-point scale to score penetration and aspiration events. By using this 5-point scale, the here described endoscopic dysphagia screening protocol showed an excellent interrater reliability when applied to acute stroke patients [4].

Apart from being able to correctly identify key findings of endoscopic swallowing examination, our protocol for acute stroke patients also requires demanding technical skills from the clinicians. Murray suggests that, after observing several examinations, the novice should perform at least 20 to 30 examinations under supervision before starting to work on his own [13]. Therefore, when intending to involve so far inexperienced clinicians in the endoscopic examination of swallowing, one has to provide sufficient practical instructions along with the mentioned theoretical tutorials.

Moreover, we would like to emphasise that the inexperienced clinicians participating in our study did not score and interpret complete FEES examinations, but only a small number of relevant parameters for the purpose of dysphagia screening. In comparison to the examination protocol outlined here, Langmore's original FEES protocol is clearly more differentiated [16]. Apart from identifying salient findings, it also comprises of additional important aspects like a detailed anatomic-physiologic assessment including a pharyngo-laryngeal sensory testing [8,17], evaluation of therapeutic maneuvers and their effect on the swallow, and testing of different methods of food delivery. Furthermore, the interpretation of endoscopic findings is not confined to the assessment of the aspiration risk alone but deduces the underlying pathophysiology of dysphagia for suggesting suitable therapeutic interventions and for giving a prognosis. Of course, analyzing and interpreting abnormal findings according to this differentiated and comprehensive protocol needs a lot more of clinical experience with the FEES procedure that cannot be learned in a 30 minutes-lecture.

Conclusion

Our study results give evidence that key findings of endoscopic swallowing evaluations of acute stroke patients and the deduction of clinical consequences can reliably be identified by so far inexperienced physicians after receiving a short and structured teaching. Therefore, we believe that the present approach will help FEES to be easily and successfully adopted in dysphagia management of acute stroke care.

Abbreviations

FEES: Fiberoptic endoscopic evaluation of swallowing; MCA: Middle cerebral artery.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

TW, IT, SO, CH and RD were involved in the FEES. TW, EBR, WRS and RD designed the study protocol. TW and RD performed statistical analysis. TW wrote the manuscript. WRS and EBR read previous drafts of the manuscript and made substantial improvements. All authors read and approved the final manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6920/9/13/prepub

References

Evans A, Perez I, Harraf F, Melbourn A, Steadman J, Donaldson N, Kalra L. Can differences in management processes explain different outcomes between stroke unit and stroke-team care? Lancet. 2001;358:1586–1592. doi: 10.1016/S0140-6736(01)06652-1. [PubMed] [Cross Ref]
Hinchey JA, Shephard T, Furie K, Smith D, Wang D, Tonn S. Formal dysphagia screening protocols prevent pneumonia. Stroke. 2005;36:1972–1976. doi: 10.1161/01.STR.0000177529.86868.8d. [PubMed] [Cross Ref]
Odderson IR, Keaton JC, McKenna BS. Swallow management in patients with on an acute stroke pathway: quality is cost effective. Arch Phys Med Rehabil. 1995;76:1130–1133. doi: 10.1016/S0003-9993(95)80121-9. [PubMed] [Cross Ref]
Dziewas R, Warnecke T, Olenberg S, Teismann I, Zimmermann J, Kramer C, Ritter M, Ringelstein EB, Schabitz WR. Towards a Basic Endoscopic Assessment of Swallowing in Acute Stroke – Development and Evaluation of a Simple Dysphagia Score. Cerebrovasc Dis. 2008;26:41–47. doi: 10.1159/000135652. [PubMed] [Cross Ref]
Ramsey DJC, Smithard DG, Kalra L. Early assessments of dysphagia and aspiration risk in acute stroke patients. Stroke. 2003;34:1252–1257. doi: 10.1161/01.STR.0000066309.06490.B8. [PubMed] [Cross Ref]
Warnecke T, Teismann I, Oelenberg S, Hamacher C, Ringelstein EB, Schabitz WR, Dziewas R. The Safety of Fiberoptic Endoscopic Evaluation of Swallowing in Acute Stroke Patients. Stroke. 2009;40:482–486. doi: 10.1161/STROKEAHA.108.520775. [PubMed] [Cross Ref]
Dziewas R, Warnecke T, Ritter M, Dittrich R, Schilling M, Schabitz WR, Ringelstein EB, Nabavi DG. Fatigable swallowing in myasthenia gravis – proposal of a standardized test and report of a case. J Clin Neuromusc Dis. 2006;8:12–15. doi: 10.1097/01.cnd.0000211411.17317.31. [Cross Ref]
Aviv JE. Prospective, randomized outcome study of endoscopy versus modified barium swallow in patients with dysphagia. Laryngoscope. 2000;110:563–574. doi: 10.1097/00005537-200004000-00008. [PubMed] [Cross Ref]
Kelly AM, Leslie P, Beale T, Payten C, Drinnan MJ. Fibreoptic endoscopic evaluation of swallowing and videofluoroscopy: does examination type influence perception of pharyngeal residue severity? Clin Otolaryngol. 2006;31:425–432. doi: 10.1111/j.1749-4486.2006.01292.x. [PubMed] [Cross Ref]
Kelly AM, Drinnan MJ, Leslie P. Assessing penetration and aspiration: how do videofluoroscopy and fiberoptic endoscopic evaluation of swallowing compare? Laryngoscope. 2007;117:1723–1727. doi: 10.1097/MLG.0b013e318123ee6a. [PubMed] [Cross Ref]
Dziewas R, Warnecke T, Hamacher C, Oelenberg S, Teismann I, Kraemer C, Ritter M, Ringelstein EB, Schaebitz WR. Do nasogastric tubes worsen dysphagia in patients with acute stroke? BMC Neurol. 2008;8:28. doi: 10.1186/1471-2377-8-28. [PMC free article] [PubMed] [Cross Ref]
Landis J, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. doi: 10.2307/2529310. [PubMed] [Cross Ref]
Murray J. Endoscopic mechanics and technique. New York, Stuttgart; 2001. pp. 61–72.
Stoeckli SJ, Huisman TA, Seifert B, Martin-Harris BJ. Interrater reliability of videofluoroscopic swallow evaluation. Dysphagia. 2003;18:53–57. doi: 10.1007/s00455-002-0085-0. [PubMed] [Cross Ref]
Rosenbek JC, Robbins J, Roecker EB, Coyle JL, Wood JL. A penetration-aspiration scale. Dysphagia. 1996;11:93–98. doi: 10.1007/BF00417897. [PubMed] [Cross Ref]
Aviv JE, Kaplan ST, Langmore SE. The Safety of Endoscopic Swallowing Evaluations. New York. 2001. pp. 235–242.
Aviv JE, Martin JH, Keen MS, Debell M, Blitzer A. Air pulse quantification of supraglottic and pharyngeal sensation: a new technique. Ann Otol Rhinol Laryngol. 1993;102:777–780. [PubMed]

Articles from BMC Medical Education are provided here courtesy of
BioMed Central