PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Stroke. Author manuscript; available in PMC 2010 September 1.
Published in final edited form as:
PMCID: PMC2763301
NIHMSID: NIHMS139845

NIHSS Score Is Poorly Predictive of Proximal Occlusion in Acute Cerebral Ischemia

Abstract

Background and Purpose

Multimodal imaging is gaining an important role in acute stroke. The benefit of obtaining additional clinically relevant information must be weighed against the detriment of increased cost, delaying time to treatment and adverse events such a contrast-induced nephropathy. Use of NIHSS score to predict a proximal arterial occlusion (PO) is suggested by several case series as a viable method of selecting cases appropriate for multimodal imaging.

Methods

699 patients enrolled in a prospective cohort study involving CTA imaging in acute stroke were dichotomized according to the presence of a PO, including a subgroup of 177 subjects with MCA M1 occlusion.

Results

The median NIHSS of patients found to have a PO was higher than the overall median (9 versus 5, p<0.0001). The median NIHSS score of patients with MCA M1 occlusion was 14. NIHSS score ≥ 10 had 81% positive predictive value for PO but only 48% sensitivity, with the majority of subjects with PO presenting with lower NIHSS scores. All patients with NIHSS ≥ 2 would need to undergo angiographic imaging to detect 90% of PO.

Conclusions

High NIHSS score correlates with the presence of a proximal arterial occlusion in patients presenting with acute cerebral ischemia. No NIHSS score threshold can be applied to select a subgroup of patients for angiographic imaging without failing to capture the majority of cases with clinically important occlusive lesions. The finding of minimal clinical deficits should not deter urgent angiographic imaging in otherwise appropriate patients suspected of acute stroke.

Background

In acute ischemic stroke, brain tissue may continue to infarct over many hours from initial stroke ictus.1 Noncontrast head CT is limited in its ability to characterize local tissue conditions in the acute phase2, whereas other imaging techniques yield information about vascular patency, tissue viability and regional perfusion that may be useful in predicting outcome or response to stroke therapies3-7. Multimodal imaging for acute stroke is not without disadvantages. Additional image acquisition consumes time, exposes patients to risks such as contrast-induced nephropathy, and increased costs. Citing both potentially useful applications and limitations, current American Stroke Association guidelines for early stroke management call for a focused selection of diagnostic tests for the sake of minimizing time to intervention.8

Although multimodal imaging requires further validation, it is already being incorporated into selection criteria for clinical trials.9,10 The additional image sequences are of particular interest in cases of proximal arterial occlusion for which the use of interventional techniques and induced hypertension are under investigation. A correlation between NIHSS score and the likelihood of encountering a proximal occlusion is described by several published reports.11-14 Use of NIHSS to predict the presence of a proximal occlusion as a method of triaging patients to further imaging studies or interventions is therefore of interest.

The aim of this study was to determine whether NIHSS score on admission predicts angiographic occlusion in a proximal artery using CT angiography in a broadly representative group of stroke patients. The clinically interesting population of patients with proximal MCA occlusion was studied separately for the same relationship. Finally, the question of using a NIHSS score threshold for performing angiographic imaging was explored.

Methods

Patient Selection

We analyzed data from 741 consecutive patients enrolled between March 2003 and January 2006 in a prospective cohort study at two university-based hospitals, part of the Screening Technology and Outcomes Project in Stroke (STOPStroke). All patients presenting with symptoms consistent with acute cerebral ischemia were considered eligible. Admission nonenhanced CT scans were obtained, followed by CT angiograms. Institutional protocol calls for all patients presenting with signs of acute cerebral ischemia to undergo nonenhanced head CT and CT angiographic imaging unless specific contraindications are present. Patients were excluded from enrollment for contraindication to iodinated contrast agent administration (history of contrast agent allergy, pregnancy, congestive heart failure, renal insufficiency) or if the nonenhanced CT scan showed evidence of intracranial hemorrhage. NIH Stroke Scale (NIHSS) scores were obtained by direct examination of subjects at the prespecified time points of admission, 24 hours after admission, discharge and at a 6 month follow up. All study staff performing examinations to obtain NIHSS scores were certified through the American Stroke Association’s NIH Stroke Scale training program. The study received institutional review board approval at both participating institutions and was Health Insurance Portability and Accountability Act compliant. At enrollment, all subjects gave informed consent for participation. Study subjects lacking all data requisite for the analysis described below were excluded.

Neuroimaging Protocol

Nonenhanced CT and CT angiographic acquisitions were performed according to standard departmental protocols with 8- or 16-section multidetector CT scanners (LightSpeed; GE Healthcare, Milwaukee, Wis). Nonenhanced CT was performed, with the patient in a head holder, in the transverse plane. Representative sample parameters, with minimal variations between scanners and sites shown as ranges, were as follows: 120–140 kVp, 170 mA, 2-second scan time, and 5-mm section thickness. Imaging with these parameters was immediately followed by biphasic helical scanning, performed at the same head tilt as was nonenhanced CT. CT angiography was performed after a 25-second delay (40 seconds for patients in atrial fibrillation) and administration of 100–140 mL of a nonionic contrast agent (Isovue; Bracco Diagnostics, Princeton, NJ) at an injection rate of 3 mL/sec by using a power injector (Medrad Power Injector; Medrad, Indianola, Pa) via an 18-gauge intravenous catheter. Parameters were 140 kVp, 220–250 mA, 0.8–1.0-second rotation time, 2.5-mm section thickness, 1.25-mm reconstruction interval, 3.75 mm per rotation table speed, and 0.75:1 pitch. Images were obtained from the C6 vertebral body level through the circle of Willis. Immediately afterward, a second set of images was obtained from the aortic arch to the skull base. Afterward, source images were reconstructed into standardized maximum intensity projection views of the intracranial and extracranial vasculature.

Image Review

Image review was independently performed on a picture archiving and communication system workstation (Impax; Agfa Technical Imaging Systems, Richfield Park, NJ) by a board-certified neuroradiologist and a clinical neurologist experienced in stroke imaging (M.H.L. and W.J.K., 15 and 25 years of neuroimaging review experience, respectively). Reviewers were blinded to follow-up clinical and imaging findings but had information in regard to the patients’ age, sex, and presenting clinical symptoms. Neither of the reviewers had participated in the selection of the patients. Variable window width and center level settings were used for optimal ischemic hypoattenuation detection with nonenhanced CT and CT angiographic source images. In all cases, nonenhanced CT images obtained for acute stroke were reviewed first, followed by CT angiographic source images, and finally, follow-up images for confirmation of true positive or true-negative infarct regions. Disagreements in readings were resolved in consensus. Reviewers rated the ischemic lesion on the nonenhanced CT scans, CT angiographic source images, and follow-up images according to ASPECTS15. Angiographic occlusions, with a 1 to 5 level of certainty rating, were recorded for 27 defined vessel segments. Lesions identified as subtotal or total occlusion of level 4 and 5 certainty (probably or definite) were defined as an occlusion. Proximal occlusion was defined as occlusion of the basilar artery, internal carotid artery, middle cerebral artery (MCA) M1 and/or M2 segment, anterior cerebral artery A1 and/or A2 segment, posterior cerebral artery or vertebral artery.

Analysis

Two analyses were performed. For the first, patients were dichotomized into those with a proximal arterial occlusion and those without. For a second analysis, patients with M1 segment MCA occlusions were studied. Given the use of NIHSS ≥10 for inclusion in recent interventional stroke trials, the positive predictive value and sensitivity is calculated at that threshold.

Time-to-imaging was calculated as the amount of time elapsed between the onset of symptoms and the acquisition of the CT angiography segment of the neuroimaging protocol. Time of onset was defined as time of symptom onset for witnessed events, and time the subject was last known normal for unwitnessed events. For patients with unwitnessed events where the time last known normal could only be estimated as “AM” or “PM”, a conservative estimate of midnight for AM and noon for PM were used. NIHSS was measured at the time of initial presentation. Student’s t test was used to compare means and the Wilcoxon rank sum test was used to compare medians.

Results

Of the 741 subjects enrolled in the study, 699 had requisite data for the primary analysis. For the secondary analysis, 177 subjects were identified. The characteristics of these individuals are summarized in Table 1. The median (interquartile range [IQR], average) NIHSS score was 5 (2-12, 7.5), and 54% of all acute cerebral ischemia subjects studied had a proximal arterial occlusion identified on CTA. The average time elapsed between symptom onset and CTA imaging was 7.5 hours.

Table 1
Patient Characteristics

Although the distribution of NIHSS scores was higher for subjects with proximal arterial occlusions than for subjects without (median: [IQR] 9 [4-16] versus 5 [2-12], mean: 10.3 versus 7.5, both p<0.0001), there was considerable overlap as depicted in Figure 1. A high initial NIHSS score was associated with a proximal occlusion, however many patients with low initial NIHSS scores were found to have clinically important occlusions. Nearly 90% of patients without proximal arterial occlusions presented with NIHSS scores ≤ 10, but so did 55% of all patients found to have occlusive lesions that may have been amenable for interventional therapy or inform management of blood pressure and other variables.

Figure 1
A histogram depicting the distribution of initial NIHSS scores as a percent of the total for subjects found to have a proximal occlusion and those in whom no proximal occlusion is identified.

Proximal occlusions were found in 90% of subjects presenting with an initial NIHSS score ≥16 and all subjects with an initial NIHSS score ≥27, but such high NIHSS scores were relatively uncommon. Figure 2 shows the percent of cases with a proximal occlusion that would go unidentified if NIHSS scores were used as a threshold for obtaining angiographic imaging. For example, using a NIHSS ≥10 threshold (81% positive predictive value) would have missed over half of all cases of proximal occlusion (48% sensitivity). A receiver operator characteristics curve is shown in Figure 3, demonstrating the range of sensitivities and specificities produced using different NIHSS score thresholds to select patients for CTA imaging. All patients with NIHSS ≥2 would need to undergo angiographic imaging to detect 90% of proximal occlusions.

Figure 2
This figure graphs the percentage of subjects with proximal occlusions that would have remain undetected if an NIHSS score threshold were applied to select subjects for angiographic imaging.
Figure 3
The receiver operator characteristic curve is shown for use of NIHSS score thresholds to predict proximal occlusion. Points on the curve are labeled with their corresponding NIHSS score.

Figure 4 summarizes the analysis for patients with isolated M1 segment MCA occlusions, showing a histogram of the number of subjects presenting with various NIHSS scores, along with the cumulative percentage of all such patients that presented at or below that NIHSS score. The median NIHSS among this subset of patients was 14 (IQR 9-18, mean 13.3). Only 10% of all acute TIA and stroke patients with MCA M1 division occlusions presented with NIHSS ≥22.

Figure 4
A histogram of initial NIHSS scores for subjects found to have MCA M1 segment occlusion. Superimposed on the histogram is a graph showing the cumulative percentage of subjects by increasing NIHSS score.

Discussion

The negative predictive value of NIHSS score for proximal occlusion is poor, making it an unreliable screening instrument. Many physicians hesitate to obtain urgent imaging beyond a non-contrast head CT for patients presenting with symptoms of acute cerebral ischemia, especially for those with low NIHSS scores. One concern is whether the extra time required to obtain the imaging may delay important treatment. A study of patients admitted to Calgary, Alberta area hospitals found that only 5.4% of patients presenting < 3 hours from onset were unable to receive IV t-PA due to the time required for in-hospital evaluation, including obtaining a CT scan and other decision making.16 The number of patients prevented from thrombolysis by in-hospital evaluation is small compared to a more fundamental problem of 75% of patients arriving beyond 3 hours. If a judicious and limited amount of additional imaging evaluation can safely extend the time window for thrombolysis as emerging data suggests17, it is warranted.

Another rationale for limiting acute phase imaging to a nonenhanced CT for patient with minor deficits is that there is a low probability of encountering a significant finding that would impact management. As observed in this group, the majority of patients presenting with symptoms of acute cerebral ischemia that are found to have proximal occlusions had low to moderate NIHSS scores. On average, the NIHSS scores of patients found to have proximal arterial occlusions was just 2.8 points higher than the average for all presenting patients. Although a NIHSS score threshold can be established that yields a high sensitivity for finding a proximal arterial occlusion, screening patients for angiographic imaging based on such a method would miss the vast majority of cases. In fact, patients with a proximal occlusion but lower NIHSS score are of particular clinical interest as they are more likely to have a large penumbra of at-risk tissue and therefore be ideal candidates for further interventions or other treatment trials.

The analysis presented here is directly relevant to the design of current interventional stroke trials. For example, the ongoing Interventional Management of Stroke Trial-III (clinical trial number NCT00359424) employs a NIHSS threshold of 10 and does not require non-invasive angiography for inclusion.18 Based on the representative sample of acute ischemic stroke patients in this study, 52% of cases with lesions amenable to the intervention would be excluded. The same concept is relevant to the application of other stroke therapies. Patients with proximal occlusions may respond differently to thrombolysis, induced hypertension and other therapies than those with no occlusions. Finally, 29% of subjects in this study presenting with initial NIHSS score = 0 were found to have proximal occlusions. TIA patients with intracranial occlusion on MRA have been found to have a 40% higher rate of second clinical stroke within 90 days and 17% higher rate of new silent DWI lesions at 30 days.19 Therefore, obtaining angiographic imaging for acute stroke or TIA in the context of low NIHSS score yields information important for both management and prognosis.

The use of a NIHSS threshold as an inclusion criterion in new interventional trials is defended by relying on previously published reports of NIHSS predicting occlusions.20 This data provides a more accurate representation of the relationship between NIHSS and the probability of a proximal artery occlusion than prior reports. In one study, 54 patients who underwent magnetic resonance angiography (MRA) within 24 hours of stroke onset found that NIHSS score was highly predictive of an occlusion, with no visualized occlusions in patients with a NIHSS score of 1 to 6, and in 78% of cases with a NIHSS score >15.11 The EMS Bridging Trial employing digital subtraction angiography (DSA) on 35 patients with baseline NIHSS scores ≥ 5 found occlusions in all patients with NIHSS scores ≥ 15.12 Another study of 43 patients who underwent DSA found that 96.9% of cases with NIHSS scores ≥ 10 had occlusions.13 A third study of 226 patients who underwent DSA with the intention of IA thrombolysis found that a NIHSS score ≥ 12 had a 91% positive predictive value for a central (basilar, ICA or M1/M2 MCA segment) occlusion.14

All of these series had smaller numbers of patients, employed MR angiography (which may have lower sensitivity for detecting arterial occlusions with certainty), or reviewed cases of patients who underwent DSA. Interpretation of all of these studies is also limited due to selection of patients with unrepresentatively high baseline NIHSS score (mean 13.5, mean 14.1, mean 14.7, and median 14, respectively), whereas the median baseline NIHSS score of all presenting stroke patients is closer to between 5 to 6.1 This undoubtedly represents a significant selection bias, especially in the interventional DSA studies where a high likelihood of an occlusion was desirable. Furthermore, only the last mentioned study specifies whether the occlusions identified were central/proximal occlusions and therefore representative of a major source of perfusion impairment, and amenable to an intervention. Another source of potential bias is time-to-imaging. A beneficial attribute of CTA is rapid image acquisition. Because MRA and DSA were used in prior studies, a longer delay to imaging may have occurred during which time occlusions may have resolved.

A potential for selection bias exists when drawing conclusions from a sample of patients who have undergone angiography for a clinical indication. Several facts mitigate the potential for such bias in this patient population. Institutional protocols in the sites patients were enrolled call for all patients with symptoms of acute cerebral ischemia to undergo nonenhanced CT and CT angiographic imaging unless specifically contraindicated, regardless of the type and magnitude of clinical deficits. This is reflected in the average NIHSS score of 7.5 and the fact that 12.2% of all enrolled patients had NIHSS scores of 0. The baseline attributes of this large, prospective study sample closely mirrors the age, sex and average NIHSS scores reported in the literature for unselected patients presenting with cerebral ischemia, thus these results should be generalizable to the broad population is patients with acute cerebral ischemia. The important limitation is the exclusion of patients unable to receive intravenous contrast. Although relevant to a minority of patients, excluded patients likely had greater medical comorbidities which may have influence the predictive relationship between NIHSS score and the presence of proximal occlusion in some way. Although contrast related contraindications are an important limitation to the use of CTA, the widespread access to CT scanners in emergency departments and rapid image acquisition compared to other angiographic imaging modalities is a compelling benefit.

Conclusions

Although high NIHSS scores are predictive of a proximal arterial occlusion in patients presenting with acute cerebral ischemia, the large majority with such lesions present with low to moderate NIHSS scores. Despite the need to evaluate patients quickly and efficiently in the setting of acute stroke, angiographic and perfusion imaging yields potentially useful information that is increasingly relied upon for decision making. Excluding patients presenting with low NIHSS scores from such diagnostic techniques would lead to a failure to diagnose the majority of arterials lesions amenable for alternative therapies.

Acknowledgements

Sources of Funding: Supported by National Institutes of Health grant AHRQ R01 HS11392. Matthew B. Maas is supported by National Institutes of Health grant P50NS051343. We gratefully acknowledge the support of the Deane Institute for Integrative research in Stroke and Atrial Fibrillation and the Lakeside Foundation.

Footnotes

Conflicts of Interest: Matthew B. Maas, MD- none.

Karen L. Furie, MD, MPH- none.

Michael H. Lev, MD- is a speaker for GE Healthcare, Waukesha, WI, receives educational support from GE Healthcare, serves on a medical advisory board for CoAxia, Maple Grove, MN, and is a research consultant for Vernalis, Winnersh, England.

Hakan Ay, MD- none.

Aneesh B. Singhal, MD- none.

David M. Greer, MD, MA- has served on the speaker’s bureau for Boehringer-Ingelheim Pharmaceuticals, Ridgefield, CT.

Gordon J. Harris, PhD- none.

Elkan Halpern, PhD- none.

Walter J. Koroshetz, MD- none.

Wade S. Smith, MD, PhD- owns stock and has stock options in Concentric Medical, Inc., Mountain View, CA, is a paid consultant for Concentric Medical, Inc., and has a research grant from Boerhinger-Ingelheim Pharmaceuticals, Ridgefield, CT.

References

(1) Saver JL. Time is brain--quantified. Stroke. 2006;37(1):263–266. [PubMed]
(2) Grotta J. NIHSS/EIC mismatch explains the >1/3 MCA conundrum. Stroke. 2003;34(9):e148–9. author reply e148-9. [PubMed]
(3) Barber PA, Darby DG, Desmond PM, Yang Q, Gerraty RP, Jolley D, Donnan GA, Tress BM, Davis SM. Prediction of stroke outcome with echoplanar perfusion- and diffusion-weighted MRI. Neurology. 1998;51(2):418–426. [PubMed]
(4) Butcher K, Parsons M, Baird T, Barber A, Donnan G, Desmond P, Tress B, Davis S. Perfusion thresholds in acute stroke thrombolysis. Stroke. 2003;34(9):2159–2164. [PubMed]
(5) Parsons MW, Li T, Barber PA, Yang Q, Darby DG, Desmond PM, Gerraty RP, Tress BM, Davis SM. Combined (1)H MR spectroscopy and diffusion-weighted MRI improves the prediction of stroke outcome. Neurology. 2000;55(4):498–505. [PubMed]
(6) Parsons MW, Yang Q, Barber PA, Darby DG, Desmond PM, Gerraty RP, Tress BM, Davis SM. Perfusion magnetic resonance imaging maps in hyperacute stroke: relative cerebral blood flow most accurately identifies tissue destined to infarct. Stroke. 2001;32(7):1581–1587. [PubMed]
(7) Baron JC, von Kummer R, del Zoppo GJ. Treatment of acute ischemic stroke. Challenging the concept of a rigid and universal time window. Stroke. 1995;26(12):2219–2221. [PubMed]
(8) Adams HP, Jr, del Zoppo G, Alberts MJ, Bhatt DL, Brass L, Furlan A, Grubb RL, Higashida RT, Jauch EC, Kidwell C, Lyden PD, Morgenstern LB, Qureshi AI, Rosenwasser RH, Scott PA, Wijdicks EF, American Heart Association. American Stroke Association Stroke Council. Clinical Cardiology Council. Cardiovascular Radiology and Intervention Council. Atherosclerotic Peripheral Vascular Disease and Quality of Care Outcomes in Research Interdisciplinary Working Groups Guidelines for the early management of adults with ischemic stroke: a guideline from the American Heart Association/American Stroke Association Stroke Council, Clinical Cardiology Council, Cardiovascular Radiology and Intervention Council, and the Atherosclerotic Peripheral Vascular Disease and Quality of Care Outcomes in Research Interdisciplinary Working Groups: the American Academy of Neurology affirms the value of this guideline as an educational tool for neurologists. Stroke. 2007;38(5):1655–1711. [PubMed]
(9) Barber PA, Parsons MW, Desmond PM, Bennett DA, Donnan GA, Tress BM, Davis SM. The use of PWI and DWI measures in the design of “proof-of-concept” stroke trials. J.Neuroimaging. 2004;14(2):123–132. [PubMed]
(10) Lev MH. CT/NIHSS mismatch for detection of salvageable brain in acute stroke triage beyond the 3-hour time window: overrated or undervalued? Stroke. 2007;38(7):2028–2029. [PubMed]
(11) Derex L, Nighoghossian N, Hermier M, Adeleine P, Froment JC, Trouillas P. Early detection of cerebral arterial occlusion on magnetic resonance angiography: predictive value of the baseline NIHSS score and impact on neurological outcome. Cerebrovasc.Dis. 2002;13(4):225–229. [PubMed]
(12) Lewandowski CA, Frankel M, Tomsick TA, Broderick J, Frey J, Clark W, Starkman S, Grotta J, Spilker J, Khoury J, Brott T. Combined intravenous and intra-arterial r-TPA versus intra-arterial therapy of acute ischemic stroke: Emergency Management of Stroke (EMS) Bridging Trial. Stroke. 1999;30(12):2598–2605. [PubMed]
(13) Nakajima M, Kimura K, Ogata T, Takada T, Uchino M, Minematsu K. Relationships between angiographic findings and National Institutes of Health stroke scale score in cases of hyperacute carotid ischemic stroke. AJNR Am.J.Neuroradiol. 2004;25(2):238–241. [PubMed]
(14) Fischer U, Arnold M, Nedeltchev K, Brekenfeld C, Ballinari P, Remonda L, Schroth G, Mattle HP. NIHSS score and arteriographic findings in acute ischemic stroke. Stroke. 2005;36(10):2121–2125. [PubMed]
(15) Barber PA, Demchuk AM, Zhang J, Buchan AM. Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. ASPECTS Study Group. Alberta Stroke Programme Early CT Score. Lancet. 2000;355(9216):1670–1674. [PubMed]
(16) Barber PA, Zhang J, Demchuk AM, Hill MD, Buchan AM. Why are stroke patients excluded from TPA therapy? An analysis of patient eligibility. Neurology. 2001;56(8):1015–1020. [PubMed]
(17) Hacke W, Kaste M, Bluhmki E, Brozman M, Davalos A, Guidetti D, Larrue V, Lees KR, Medeghri Z, Machnig T, Schneider D, von Kummer R, Wahlgren N, Toni D, ECASS Investigators Thrombolysis with alteplase 3 to 4.5 hours after acute ischemic stroke. N.Engl.J.Med. 2008;359(13):1317–1329. [PubMed]
(18) [Accessed 02/16, 2009]. Available at: http://www.clinicaltrials.gov/ct2/show/NCT00359424.
(19) Coutts SB, Hill MD, Campos CR, Choi YB, Subramaniam S, Kosior JC, Demchuk AM, VISION study group Recurrent events in transient ischemic attack and minor stroke: what events are happening and to which patients? Stroke. 2008;39(9):2461–2466. [PubMed]
(20) Mattle HP. Intravenous or intra-arterial thrombolysis?: it’s time to find the right approach for the right patient. Stroke. 2007;38(7):2038–40. [PubMed]