PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Neurosurgery. Author manuscript; available in PMC 2009 December 9.
Published in final edited form as:
PMCID: PMC2790598
NIHMSID: NIHMS156508

Head Impact Severity Measures for Evaluating Mild Traumatic Brain Injury Risk Exposure

Abstract

Objective

To quantify sensitivity of various biomechanical measures of head impact (linear acceleration, rotational acceleration, impact duration, impact location) to clinical diagnosis of concussion in American football players and to develop a novel measure of head impact severity which combines these measures into a single score that better predicts the incidence of concussion.

Methods

On-field head impact data were collected from 449 football players at 13 organizations (n = 289,916) using in-helmet systems of six single axis accelerometers. 1,2,3,4,5 Concussions were diagnosed by medical staff and later associated with impact data. Principal Component Analysis 6, 7 and a weighting coefficient based on impact location were used to transform correlated head impact measures into a new composite variable (wPCS). The predictive power of linear acceleration, rotational acceleration, Head Injury Criteria, and wPCS was quantified using Receiver Operating Characteristic8,9,10 curves. The null hypothesis that a measure was no more predictive than guessing was tested (α=0.05). Additionally, ROC curves for wPCS and classical measures were directly compared to test the hypothesis that wPCS was more predictive of concussion than classic measures (α=0.05).

Results

When all impacts were considered, every biomechanical measure evaluated was statistically more predictive of concussion than guessing (p < 0.005). However, for the top 1% and 2% of impacts based on linear acceleration, a subset that consisted of 82% of all diagnosed concussions, only wPCS was significantly more predictive of concussion than guessing (p<0.03), and, when compared to each other, wPCS was more predictive of concussion than classical measures for the top 1% and 2% of all data (p < 0.04).

Conclusions

A weighted combination of several biomechanical inputs, including impact location, is more predictive of concussion than a single biomechanical measure. This study is the first to quantify improvements in the sensitivity of a biomechanical measure to incidence of concussion when impact location is considered.

Keywords: Concussion, Football, Head impact tolerance, Head impact biomechanics, Mild traumatic brain injury, Sports injury prevention

Introduction

Head injuries in sports are occurring at an epidemic level. The Center for Disease Control and Prevention estimates that as many as 300,000 sports-related mild traumatic brain injuries (MTBI), also referred to as concussions, occur in the United States each year, with approximately 1/3 of these occurring in football.11,12 Among high school athletes 62,800 MTBI incidents are reported annually.13 A large review of injuries in high school athletics demonstrated that 13.3% of reported football injuries were head related.14 In recent years, MTBI has become the major concern for clinicians dealing with sport-related brain injuries.15,16,17 Correlating pathophysiology with clinical evaluation and treatment of injured athletes remains a challenge for practitioners and researchers alike. Early detection and accurate diagnosis are critical to the treatment of MTBI.

Brain injury following impact has been linked to increased strain in brain tissue as well as to pressure waves and gradients within the skull.18,19,20 While these injury mechanisms are likely related to kinetic measures of impact severity (e.g. peak linear acceleration, peak rotational acceleration, impact duration), it remains unclear if any single biomechanical measure is well correlated with the occurrence of MTBI.

Several injury tolerance criteria exist that associate linear head acceleration with severe brain injury. The Wayne State Tolerance Curve (WSTC), which was developed to better understand head injury acceleration tolerance in automotive crashes, defines an injury threshold using a linear acceleration versus impact time duration curve (Figure 1).21 In this model, the onset of skull fracture (rather than brain injury) is the injury criterion or curve boundary. Several impact severity measures based on weighted integrals of acceleration-time profiles, Gadd Severity Index (GSI)22 and Head Injury Criteria (HIC)23,24 were expansions of this work (Appendix A). Each of these injury tolerance curves, developed from animal and cadaveric data, is specifically limited to severe brain injury.25 Impact measures specific to MTBI are lacking. Many researchers speculate that rotational acceleration of the head leads to strain on the brain tissue and therefore it may be the underlying mechanism for MTBI.26,27,28,29 Other data suggest that impact location is a key factor in evaluating susceptibility to MTBI. As early as 1983, Hodgson30 suggested that lateral impacts were the most likely to lead to concussion. Several studies have demonstrated lower head impact tolerance for lateral translational impacts than anterior-posterior or axial (top of the head) impacts in humans, using finite element analysis.31,32,33 More recently, Delaney, et al. 34 prospectively analyzed 69 concussions to collegiate level football, hockey, and soccer players and reported that impacts to the side/temporal region were the most probable to result in concussion.

Figure 1
The Wayne State Tolerance Curve21 defines an injury threshold based on the onset of skull fracture which was thought to correlate with moderate to severe concussion.

Several head acceleration tolerance criteria designed specifically for assessing concussion risk have been derived from indirect measures of head accelerations via laboratory simulations with Hybrid III anthropomorphic test dummies (ATD). Newman et al. 35,36 proposed a new tolerance index, Head Impact Power, based on linear and rotational acceleration of the head during impact and on impact duration. Computation of this tolerance index requires inertial measurements (mass, density and geometry) of the head, which must be estimated and generalized for the target population. Head Impact Power, estimated through ATD reconstructions, was correlated with MTBI in a group of 24 professional football players representing 12 impacts (struck and striking players). Pellman et al. 37 performed a similar evaluation of impacts from National Football League (NFL) game videos, computing impact velocity and impact location from video and subsequently simulating the impacts in a laboratory using ATD. Linear and rotational head acceleration, GSI, and HIC were computed for striking and struck players from each simulated impact using a standard 3-2-2-2 accelerometer package located at the center of gravity of the ATD headform. Data from the laboratory impact reconstructions were categorized as concussive or non-concussive according to on-field diagnosis at the time of impact. These data suggested that of the measured or computed variables, linear acceleration was the most highly correlated with the clinical diagnosis of MTBI. Zhang, et al. 31,32 used biomechanical measures from these ATD simulations as inputs to a finite element analysis to predict brain response during impact, including intracranial pressure and brain shear stress, and concluded that the occurrence of concussion was best predicted by shear stress at the midbrain. These studies represented significant advances in the understanding of sports related MTBI. The ATD simulations in these studies were limited, however, to open field impacts because video from several angles was required for reconstruction analysis and to primarily injurious impacts that do not capture a representative sample of head impact biomechanics that occur in football.

Recently developed technology (Head Impact Telemetry (HIT) System, Simbex, Lebanon, NH; Sideline Response System, Riddell, Chicago, IL) 1,2 has enabled on-field measurement of head acceleration and impact location for all impacts in practices and games using helmets instrumented with linear accelerometers (Analog Devices, Inc., Cambridge, MA). Results of in vivo head acceleration measurements have been reported for 11,604 impacts recorded at Virginia Tech (Blacksburg, VA) during the 2003 and 2004 football seasons.3,4 290 impacts with peak linear accelerations > 75g were reported but only 3 (1%) of these impacts were associated with clinical diagnosis of concussion. Note that 75g represents the 41% concussion tolerance level from the NFL data37. An evaluation of 54,154 impacts from the University of Oklahoma (Oklahoma City, OK) and 8,326 impacts from Casady High School (Oklahoma City, OK) highlighted differences in impact profiles between the different levels of play.5 620 impacts with peak linear acceleration > 98g were reported but only 6 (1%) of those impacts were associated with clinical diagnosis of concussion. These results are not consistent with the logistic regression analysis from the NFL data where 98g represents the 74% concussion tolerance level.37

A data set consisting of 289,916 impacts collected from instrumented helmets at 13 institutions (6 NCAA Division I and 7 high schools) are available for analysis and provide a unique opportunity to examine classic measures of impact severity (e.g. linear acceleration, rotational acceleration, HIC) and to evaluate how biomechanical measures of head impact correlate with concussion.

The purpose of this paper is to quantify the sensitivity of various biomechanical measures of head impact (e.g. linear acceleration, rotational acceleration, impact duration, impact location) to the clinical diagnosis of concussion in football players using the aforementioned database of head acceleration measures from impacts collected on the field. For a given impact, these biomechanical measures are interdependent and thus should not be treated as independent variables. Analytic methods, such as Principal Component Analysis (PCA), 6,7 that account for these relationships among variables can be utilized. We hypothesize that computed indices which include multiple biomechanical measures, including impact location, will have a higher correlation with the incidence of concussion compared to individual measures alone.

Methods

On-field head impact data were collected during the 2004, 2005, and 2006 seasons from 259 players at 6 NCAA Division I schools (n=190,054) and 190 players at 7 high schools (n=99,862). All players wore Riddell football helmets (Riddell, Chicago IL) instrumented with six linear accelerometers that recorded an acceleration time history of the head center of gravity (CG) for all impacts during practices and games.1,2 Head linear acceleration, head rotational acceleration, impact location, impact duration, GSI, and HIC were computed for each of these impacts and stored for analysis.1, 38 Concussions were diagnosed by team medical staff and were later associated with impact data by cross referencing observed impact time and observed impact location (from video when available or from sideline observations) with recorded impact times and recorded impact locations. For the purposes of this study, each impact was defined as concussive or non-concussive based on the evaluations completed by each participating institution. All concussions were graded according to the American Academy Of Neurology (AAN) guidelines.

For several classic biomechanical measures (linear acceleration, rotational acceleration, HIC), Receiver Operating Characteristic (ROC)8,9 curves were developed from the data set. This type of curve defines the relationship between sensitivity and 1-specificity for each biomechanical measure. Sensitivity is the percentage of all concussions that were correctly identified by the measure (i.e. “correct prediction level”) and 1-specificity is the percentage of all non-injurious impacts that were incorrectly identified as concussions by the measure (i.e. “false response rate”). Varying the value of the biomechanical measure that defined the tolerance level to concussion injury alters the relationship between the correct prediction level and the false response rate.

The biomechanical measure most sensitive to the prediction of concussion injury was defined as the measure that minimized the false response rate across a wide range of correct prediction levels (i.e. percentage of concussions correctly identified). The area under each specific ROC curve (correct prediction level vs. false response rate) is a measure of the predictive value of that specific biomechanical measure. This area represents the probability that a randomly selected concussive impact will have a higher severity score, than a randomly selected non-injurious impact. An area under the curve of 0.5 implies that a given biomechanical measure is as predictive of concussion as guessing, while area under the curve of 1.0 implies that all concussions would be predicted by that measure with a zero false response rate.

A new biomechanical measure of impact severity was developed and subjected to the same analysis as the individual biomechanical measures. Principal Component Analysis (PCA),6,7 a multivariate data analysis technique, was used to orthogonally transform correlated input biomechanical measures (linear acceleration, rotational acceleration, HIC and GSI) into new uncorrelated composite variables. In order to utilize PCA, the input biomechanical measures were first mean-centered and scaled by the variance of each measure. For each impact a Principal Component Score (PCS) was calculated as the sum of each composite variable weighted according to the variance explained (i.e. the eigenvalues of the covariance matrix of the mean centered and normalized data). The resultant PCS is effectively a weighted sum of linear acceleration, rotational acceleration, HIC and GSI, with objectively defined weights.

The impact data were sorted into one of four bins (top, side, front, or back) based on impact location (Figure 2). Elevation angle was defined as the angle between the projection of the impact direction vector through the estimated head center of gravity (CG) and a horizontal plane through the CG. 1,3 Impacts occurring above 65° elevation were defined as top. The remaining impacts were divided into four equally spaced bins centered on the midsagittal and coronal planes. Impacts to the right and left side of the head were grouped together as side impacts. The distribution of recorded impact severities within each impact location bin was computed for each biomechanical measure. The top 1% of all impacts was defined as all impacts greater than or equal to the 99th percentile for a given measure, the top 2% was all impacts greater than or equal to the 98th percentile, etc.

Figure 2
Impacts were grouped into 5 bins based on impact location which is defined by azimuth (θ) and elevation (α). Azimuth (θ) is defined from −180° to 180° with 0° at the X axis and positive (θ) ...

For each impact, a weighted PCS (wPCS) was generated by multiplying PCS by a location coefficient that was based on impact location bin. These location coefficients were determined by normalizing 99th percentile of PCS for each impact location (defined as xn, where n=front, side, top, back). The impact location bin with the lowest PCS at the 99th percentile (defined as xo) was assigned a coefficient of 1 and the other coefficients were determined by xo/xn. All coefficients were therefore ≤1. To test the significance of changes in impact severity as a function of impact location, and thus to justify the use of location coefficients, a univariate analysis of variance statistic was used to compare mean impact severities by impact location bin for each biomechanical measure using SPSS (Chicago, IL) for all impacts as well as for the top 1%, 2%, and 5% of all impacts (Table 1). The significance level was set at α = 0.05.

Table 1
Cutoff values for the top 1%, 2%, and 5% for each classic biomechanical measure

ROC curves were generated for each biomechanical measure (linear acceleration, rotational acceleration, HIC, wPCS) using all data as well as the top 1%, 2%, and 5% of all impacts selected by linear acceleration magnitude (SPSS. Chicago, IL). For each ROC curve the null hypothesis, that the true area under the curve = 0.5, was tested and an asymptotic significance value (p-value) was reported. Significance was set at α=0.05. Additionally, Hanley’s method for direct comparison of ROC curves 39 was used to test the hypothesis that wPCS was more predictive of concussion than the classic biomechanical measures (α=0.05).

Results

A total of 17 players (11 collegiate and 6 high school), of the 449 in this study, sustained concussions that were diagnosed by medical staff. For each of these diagnosed concussions, a single significant impact was identified as the concussive event based on the collected head impact data and the onset of clinical symptoms. Of these 17 impacts, 8 were to the front, 3 to the top, 5 to the side, and 1 to the back of the head. 12 of these concussions were diagnosed as Grade 1, 3 were Grade 2, and 2 were Grade 3, according to the American Academy Of Neurology (AAN) guidelines. For the purposes of this paper concussion severity was not used as a covariate in the statistical analysis.

Linear acceleration measures exhibited the lowest false response rate (i.e. percentage of all non-injurious impacts that were incorrectly identified by the measure) among the classic biomechanical measures for correct prediction levels (i.e. percent of concussions correctly predicted) above ~70% (Figure 3). For example, at the 75% correct prediction level, linear acceleration measures resulted in a false response rate of 1.6% (n=4,755), while HIC and rotational acceleration measures resulted in false response rates of 1.9% (n=5,421) and 2.5% (n=7,161), respectively (Table 2). However, for correct prediction levels less than ~70% rotational acceleration exhibited the lowest false response rate among the classic measures (Figure 3). The threshold or impact severity associated with the 75% correct prediction level was 96g for linear acceleration, 7,235 rad/sec for rotational acceleration, and 160 for HIC (Figure 4).

Figure 3
Receiver Operator Characteristic (ROC) curves demonstrate the sensitivity of the independent measures (e.g. linear acceleration, rotational acceleration, HIC, weighted PCS) to the incidence of concussion. Each point on a curve represents a possible concussion ...
Figure 4
Values of the biomechanical measures that are associated with each correct prediction level (i.e. percentage of concussions correctly predicted).
Table 2
Differences in the false response rate for the classic biomechanical measures at the 50%, 75% and 90% correct prediction levels.

Principal Component Analysis yielded the following equation for Principal Component Score (PCS):

PCS=10·((0.4718·sGSI+0.4742·sHIC+0.4336·sLIN+0.2164·sROT)+2)
(1)

where: sX = (X − mean(X)) / (SD(X)), LIN = linear acceleration, ROT = rotational acceleration HIC = Head Impact Criteria, GSI = Gadd Severity Index. The offset by 2 and scaling by 10 generated PCS greater than zero and in the numerical range of the other classic measures studied. All four composite variables were utilized, capturing >99.9% of the variability in the data set. At the 50%, 75%, and 90% correct prediction levels PCS resulted in false response rates of 0.58%, 1.15%, and 3.60% respectively (Table 2).

Of the 289,916 impacts recorded, 124,817 (43.1%) were to the front of the head, 70,835 (24.4%) were to the back of the head, 56,566 (19.5%) were to the sides of the head, and 37,698 (13.0%) were to the top of the head. A univariate analysis of variance statistic demonstrated statistically significant differences in PCS by impact location for the top 1%, 2% and 5% of all impacts. Specifically, the top 1%, 2%, and 5% of all impacts to the top of the head had a higher PCS than impacts to the back of the head, which had higher PCS than impacts to the side and front. The top 1%, 2%, and 5% of all impacts to the side and front were statistically indistinguishable (Table 3).

Table 3
Differences in the distribution of PCS as a function of impact location.

Impact location weighting coefficients were derived based on the 99th percentile PCS for each location bin. The coefficients were 1.00, 0.95, 0.62, and 0.48 for side, front, back, and top impacts, respectively. Similar results were found when the location coefficient was based on the 95th or 98th percentiles. When PCS was weighted based on impact location, the new measure (wPCS) had the lowest false response rate of all the measures evaluated (Figure 3). Specifically, wPCS resulted in a mean (s.d.) reduction in the false response rate of 58% (9%) across correct prediction levels of 20% to 80% when compared to linear acceleration (Figure 3). There were statistically significant differences (p<0.05) in the area under the ROC curve for all biomechanical measures compared to area under the ROC = 0.5 (e.g. guessing) for all impacts and for the top 5% of all impacts (based on linear acceleration) (Table 4). However, for the top 1% and 2% of all data there were statistically significant differences in the area under the ROC curve compared to area under the ROC = 0.5 for wPCS (p < 0.01) only. For example, when the top 1% of all impacts were considered, the probability that a randomly selected MTBI case would have a higher linear acceleration than a randomly selected non-injurious impact was 0.56, which was not statistically different than a probability of 0.5 which would be achieved by guessing if each impact was injurious or not. The same probability for wPCS was 0.75, which was statistically significant. Direct comparison of ROC curves demonstrated that wPCS was more predictive of concussion than classic measures for the top 1% and 2% of all data (p < 0.04), but not for the top 5% of all data (p=0.31). The top 1%, 2%, and 5% of all impacts contained 11, 15, and 16 of the 17 diagnosed concussions, respectively (Table 4). Similar results were found for all analyses when the location cutoff for top impacts (elevation = 65°) was increased or decreased by 5°.

Table 4
ROC curves were generated for all data as well as for the top 1%, 2%, and 5% of impact severity for all data based on linear acceleration.

Discussion

We sought to quantify the performance of various biomechanical measures for predicting the incidence of MTBI. In light of recent research indicating that several biomechanical factors (linear acceleration, rotational acceleration, impact duration, and impact location) are linked to mechanisms of concussion18,26,27,28,31,32,33,34,35,36,37 and because of the on-field data collected with instrumented helmets3,4,5 that exceeded the estimated 75% linear acceleration threshold for concussion defined by the recent NFL study (98.9g)37 but that did not result in a clinically diagnosed concussion (n = 3,465), we believed that a novel measure of head impact severity would be both clinically and scientifically relevant. In order to optimize this new measure with respect to predicting concussion, we sought to understand the inter-relationships among measured and computed biomechanical variables and their correlation with concussion risk.

Contrary to the recent NFL study37 which concluded that linear acceleration was the best classic measure, we found that for correct prediction levels above ~70%, linear acceleration measures exhibited the lowest false response, but for correct prediction levels less than ~70% rotational acceleration exhibited the lowest false response rate among the classic measures. Additionally, the NFL study estimated that 75% of all impacts that were greater than 98.9g would result in concussion, while we collected on-field data for 3,476 impacts > 98.9g, only 11 of which (0.3%) were associated with clinical diagnosis of concussion (Figure 5). A possible explanation for this disparity is that the NFL data were heavily weighted toward injurious impacts and were not representative of all impacts that occurred, including many impacts that did not result in a concussion.

Figure 5
Linear acceleration concussion probability function generated from NFL impacts reconstructed in the laboratory, as in Pellman37, shown with 17 concussive impacts recorded in-vivo and a random sample of 100 controls (non-injurious impacts). In total there ...

In order to evaluate the clinical relevance of using various biomechanical measures of head impact to predict the clinical diagnosis of concussion, it is important to consider the rate of false responses (the percentage of all non-injurious impacts that were incorrectly identified by the measures). We utilized ROC curves to relate the false response rate to the correct prediction level (i.e. the percentage of all concussions that were correctly identified by the measures) as a function of various independent biomechanical measures of head impact. The measures evaluated were peak linear acceleration, peak rotational acceleration, HIC, GSI and a new measure (wPCS) which was derived through principal component analysis. We found similar results for both GSI and HIC, and report only the HIC risk curve based on a strong linear relationship between these two measures (r2 = 0.93). Despite this linear relationship, it is important to include both HIC and GSI as inputs to PCA so that the new measure (wPCS) can be related back these industry specific severity measures from both the automotive industry (HIC) and sports industries (GSI). Any correlation between HIC and GSI is captured by PCA and is not reflected in the resultant head impact severity measure (wPCS). We elected to use HIC15, rather than HIC36, because 95% of the recorded head impacts had an impact duration between 5.5 ms and 13.7 ms, thus HIC15 was sufficient to capture the characteristics of the impact while minimizing error associated with noise in the accelerometer signals outside the impact window which would tend to increase the value of HIC. HIC15 has been used in previously studies of helmet head impacts in football.3,4,31,35,36,37

The ROC curves demonstrate that wPCS results in a lower false response rate across a wide range of correct prediction levels compared to linear acceleration, rotational acceleration, or HIC. This new measure, wPCS, is based on PCA of linear acceleration, rotational acceleration, HIC, and GSI, weighted according to impact location. The location coefficients were derived from the 99th percentile PCS for impacts in each location bin. In other words, the data were normalized so that the 99th percentile wPCS was the same for each impact location. We elected to normalize the data based on the higher end of the impact magnitude scale because these impacts are most likely to be associated with concussion. Similar location coefficients were derived from the 98th and 95th percentiles, with no significant change in the overall analysis, Multiplying by these coefficients normalizes the data to account for variance in impact severity as a function of impact location. This is relevant because the impact locations with the highest impact magnitudes (top and back) did not have the most concussions.

Previous research has shown improved correlation between biomechanical measures of head impact severity and concussion when linear and rotational accelerations, instead of linear acceleration alone, were used as inputs to a multivariate regression.31 However, regression analysis may not be appropriate because linear and rotational accelerations from head impacts in football are highly correlated37 and multicollinearity of input variables is a known problem with regression.40 It is important to note that PCA is not a predictive approach. Rather, PCA is a statistical tool that is used to transform correlated input variables into new uncorrelated composite variables. These new uncorrelated composite variables can then be combined into a single score (wPCS) or evaluated independently using predictive techniques such as multivariate logistic regression. We combined the outputs of PCA into a single score (wPCS) based on the percent of the variance explained by each output. This is a method of noise reduction. The variables that capture the largest portions of the variance in the dataset are weighted highest. PCA is also unique in that it allows for visualization of impacts in a unique solution space in which trends in the data, which may have otherwise been masked by noise or inter-relationships between inputs, are highlighted.

The increased sensitivity of biomechanical measures to incidence of MTBI using wPCS is perhaps explained by the known relevance of impact duration (HIC and GSI),21,22,23 rotational acceleration26,27,28 and impact location30,31,32,33,34,37 on susceptibility to concussion. Several studies have utilized finite element models (FEM) to model brain acceleration during impact.31,32,33 Kleiven33 reported that strain in the bridging veins, which could be correlated with occurrence and severity of subdural hematoma, varied with impact direction for pure translational and pure rotational impulses simulated with an experimentally validated FEM. Specifically, for pure translational impulses, axial (top) impacts resulted in the lowest strain levels while posterior-anterior and lateral accelerations of the head CG with respect to the skull resulted in the highest strains.

Other studies have utilized high speed video and laboratory impact reconstructions using ATD to estimate the linear and rotational accelerations achieved during impact in professional American football. Previously published data has shown that the average linear acceleration for concussive impacts to the facemask (78±18g) was lower than the average linear accelerations for other locations (107 to 117g).37 This may be a result of the stiffness of the facemask compared to the helmet shell, interaction between the facemask and the shell, and/or physical properties of the head and neck.

The coefficients used to scale translational acceleration values, as reported by Kleiven33, the average linear accelerations of impacts that resulted in concussions reported by Pellman37, and the location coefficients presented herein all describe an effect of impact location on the likelihood of sustaining a concussion for a given impact. The effect of impact location was derived through different analytic means, but similar results were found for each study. Specifically, each study demonstrated that impacts to the top of the head were less likely to cause concussion than lateral or frontal impacts of the same impact accelerations. Top impacts may be less likely to cause concussion because the associated rotational acceleration is decreased due to the reduced lever arm of the impact vector with respect to the centers of rotation of the cervical spine or because the cervical spine absorbs impact energy thus reducing strain in the bridging veins and brain tissue. The aim of this study was not to evaluate the effect of impact location on the mechanisms of brain injury, but rather to quantify improvements in the sensitivity of biomechanical measures to the incidence of concussion when impact location is taken into account.

It is important to note that no current biomechanical measure of the severity of a single impact can predict concussions in football with a positive predictive value (PPV) (e.g. likelihood of concussion) as high as 75%, as suggested by previous research 37. The highest PPV for linear acceleration was 0.3% at the 50% correct prediction level. At this correct prediction level PPV for wPCS was 0.9%. It is important to note the difference between PPV or likelihood of concussion, as reported in previous research, and correct prediction level or sensitivity, as reported here. 75% PPV or likelihood of concussion at a given threshold means that on average 3 of 4 impacts above this threshold will result in concussion. 75% sensitivity or correct prediction level at a given threshold means that on average 3 of 4 concussions will result from impacts above the threshold. There are several variables that have not been accounted for in this analysis, including age, gender, and both impact and concussion histories for each individual player. For example, we noted a large variation in false response rates by player. In other words, certain players sustained high magnitude head impacts frequently and did not sustain a concussion while others sustained a head injury after relatively few and relatively minor head impacts. We also noted that for 76% of all concussions, wPCS that were associated with subsequent medical diagnosis of concussion were among the highest wPCS sustained by the injured player throughout the season (above the 99th percentile wPCS for that player). This suggests that each player may have a unique head injury tolerance that is reflected in the distribution of impact severity measures for all non-injurious impacts for that player. Future work will include quantifying the effects of a particular player’s impact history as well as the effect of severe impacts several days prior to injury. An analysis of correlation between concussion grade (severity) and biomechanical measures of head impact was beyond the scope of this study but will be addressed in future manuscripts.

There are several limitations of the current study. Regarding the development of the new measure (wPCS), all 17 concussive impacts collected on the field were used as a training dataset for creating the wPCS measure. The limited number of concussions prevented us from splitting the data into training and testing datasets. As concussion data become available for subsequent football seasons, wPCS and the location coefficients used will be further refined to improve their capability to prospectively assess concussion risk from on-field biomechanical measures of head impact. Additionally, statistical evaluation of the contribution of each independent variable to wPCS will be evaluated in an attempt to minimize the number of input variables required. For example, we will evaluate the predictive capability of a formulation of wPCS with only linear and only rotational acceleration. Regarding the data collection methods, in vivo measures of rotational acceleration using the instrumented helmets may be inexact because rotation was assumed to happen about a fixed point in the neck, limiting measurements to two dimensions. Specifically, flexion/extension (rotation about the y-axis, Figure 2) and lateral bending (rotation about the x-axis, Figure 2) are estimated based the geometrical properties of the head while axial rotation (rotation about the z-axis, Figure 2) is not. However, these measurements are still representative of actual rotational acceleration.1 The algorithm used to compute head acceleration has recently been expanded to include all six degrees of freedom38 and has been validated for field use in football. A second limitation of the data collection methods is that the instrumentation technology is only currently available for Riddell helmets, limiting any evaluation of the effect of helmet type on the measures of impact severity. Third, this study was limited to male athletes. Future studies will be expanded to include both male and female athletes in soccer, hockey and boxing. Fourth, as with any in-vivo study of head injury, it is possible that players sustained minor head injuries that were never reported or diagnosed. Finally, grouping data into distinct bins based on impact region may not be optimal. Future work will involve the development of a continuous variable for impact location risk that will be used in place of the location coefficients, which are currently based on location bins.

We do not advocate the use of measures of impact severity and/or impact history as a diagnostic tool for concussion. Concussions are difficult to diagnose and visual symptoms checks and direct medical attention by qualified personnel is required for both diagnosis and treatment.41 Nevertheless, the data described herein show strong correlations between biomechanical measures and concussion diagnosis. A widespread study which correlates individual impact history with changes in neurocognitive test results, neurological changes as seen via imaging methods including, but not limited to, functional magnetic resonance imaging (fMRI), and the occurrence of clinically diagnosed MTBI is recommended to refine this new impact tolerance measure (wPCS), which specifically addresses MTBI, as well as to quantify the effects of cumulative impacts and individual impact histories on susceptibility to concussion.

Conclusion

This work provides evidence that a single biomechanical measure, such as linear acceleration, is not the most sensitive biomechanical measure for determining concussion risk. A composite variable that contains aspects of linear acceleration, rotational acceleration, impact duration, and impact location is more sensitive to incidence of MTBI. This study is the first to quantify the sensitivity and specificity of an impact location based head impact severity measure for predicting concussion. We use PCA and a weighting system based on impact location to define a new measure (wPCS). This method accounts for the multicollinearity of the input variables (linear acceleration, rotational acceleration, HIC, and GSI) by transforming the data into new uncorrelated composite variables which can then combined into a single composite measure. Using this new head impact severity measure (wPCS), the rate of false responses was reduced at all correct prediction levels as compared to the classic biomechanical measures evaluated (linear acceleration, rotational acceleration, and HIC).

Acknowledgments

This work was supported in part by an award from the National Center for Medical Rehabilitation Research at the National Institute of Child Health and Human Development at the National Institutes of Health (R44HD40473) and research and development support from Riddell, Inc. (Chicago, IL). Accelerometers were provided or purchased from Analog Devices (Cambridge, MA). We appreciate and acknowledge the researchers and institutions from which the data were collected, including Stefan Duma PhD, Virginia Tech–Wake Forest Center for Injury Biomechanics, P. Gunnar Brolinson DO, Virginia Tech Sports Medicine and Edward Via Virginia College of Osteopathic Medicine, Mike Goforth ATC, Virginia Tech Sports Medicine, Brock Schnebel MD, McBride Clinic Inc, Oklahoma City, OK and University of Oklahoma Sports Medicine, Scott Anderson ATC, University of Oklahoma Sports Medicine, Ron Gatlin ATC, Casady HS Oklahoma City, OK, Tom McAllister MD, Dartmouth Hitchcock Medical Center. Jeff Frechette ATC and Scott Roy ATC, Dartmouth College Sports Medicine, Steven Broglio PhD, ATC, The University of Illinois - Department of Kinesiology and Community Health, Brian Lund ATC and Dean Kleinschmidt ATC, University of Indiana Sports Medicine, Steven Erickson, MD and Bryce Nalepa ATC, Arizona State University Sports Medicine, Mickey Collins PhD, University of Pittsburg Medical Center–Center for Sports Medicine, Jesse Townsend ATC, Greensburg Salam HS, Greensburg PA, Jeff Cienick ATC, Blackhawk HS, Beaver Falls PA, John Burnett ATC, Karns City HS, Karns City PA, John Panos ATC, Fox Chapel HS, Pittsburgh PA, Chris D’Antionio ATC, Mt. Lebanon HS, Mt. Lebanon PA, Don Short ATC, Hopewell HS, Aliquippa PA. Additionally, we would like to thank Tor Tosteson for his assistance with the statistical analysis.

Appendix A: Equations for Head Injury Criterion (HIC) and Gadd Severity Index (GSI)

HIC=(t2t1)[1t2t1t1t2a(t)dt]5/2GSI=0Ta(t)2.5dt

where a(t) = linear acceleration of the head center of gravity

t2−t1 <= 15 ms

* HIC can be calculated over any duration of time. Throughout this paper HIC is calculated over a 15 ms window.

Footnotes

2004 and 2005 data contains pre-season, regular season, and post season. At the time of this report, data from the 2006 collegiate post-season were not available for analysis.

References

1. Crisco JJ, Chu JJ, Greenwald RM. An Algorithm for Estimating Acceleration Magnitude and Impact Location Using Multiple Nonorthogonal Single-Axis Accelerometers. J BioMech Eng. 2004;126(1) [PubMed]
2. Manoogian S, McNeely D, Duma S, Brolinson G, Greenwald R. Head Acceleration is Less Than 10 Percent of Helmet Acceleration in Football Impacts. Technical Papers of ISA: Biomedical Sciences Instrumentation. 2006;42:383–388. [PubMed]
3. Duma SM, Manoogian SJ, Bussone WR, Brolinson PG, Goforth MW, Donnenwerth JJ, Greenwald RM, Chu JJ, Crisco JJ. Analysis of Real-time Head Accelerations in Collegiate Football Players. Clin J Sport Med. 2005;15(1):3–8. [PubMed]
4. Brolinson PG, Manoogian S, McNeely D, Goforth M, Greenwald R, Duma S. Analysis of Linear Head Accelerations from Collegiate Football Impacts. Curr Sport Med Rep. 2006;5:23–28. [PubMed]
5. Schnebel B, Gwin JT, Anderson S, Gatlin R. In Vivo Study of Head Impacts in Football: A Comparison of NCAA Divison I vs. High School Impacts. Neurosurgery. 2006;60(3):490–5. [PubMed]
6. Jackson JE. A user’s guide to principal components. New York: John Wiley; 1991.
7. Jollife IT. Principal component analysis. New York Berlin Heidelberg Tokyo: Springer-Verlag; 1986.
8. Tosteson TD, Buonaccorsi JP, Demidenko E, Wells WA. Measurement error and confidence intervals for ROC curves. Biometrical Journal. 2005;47(4):409–416. [PubMed]
9. Faraggi D, Reiser B. Estimation of the area under the ROC curve. Statistics in Medicine. 2002;21(20):3093–3106. [PubMed]
10. Hanley JA, McNeil BJ. The meaning and use of the area under Receiver Operator Characteristic (ROC) Curve. Radiology. 1982;143:29–36. [PubMed]
11. Centers for Disease Control and Prevention. Sports-related recurrent brain injuries: United States. Morb Mortal Wkly Rep. 1997;46(10):224–227. [PubMed]
12. Thurman DJ, Branche CM, Sniezek JE. The epidemiology of sports-related traumatic brain injuries in the United States: recent developments. J Head Trauma Rehabil. 1998;13(2):1–8. [PubMed]
13. Powell JW, Barber-Foss KD. Traumatic brain injury in high school athletics. JAMA. 1999;282:2283–2285. [PubMed]
14. Powell JW, Barber-Foss KD. Injury patterns in selected high school sports: A review of the 1995–1997 seasons. Journal of Athletic Training. 1999;34(3):277–284. [PMC free article] [PubMed]
15. Collins MW, Lovell MR, Mckeag DB. Current issues in managing sport-related concussion. JAMA. 1999;282:2283–2285. [PubMed]
16. Guskiewicz KM, Weaver NL, Padua DA, Garrett WE. Epidemiology of concussion in collegiate and high school football players. Am J Sport Med. 2000;28(5):642–650. [PubMed]
17. Aubry M, Cantu R, Dvorak J, Graf-Baumann T, Johnston K, Kelly J, Lovell M, McCrory P, Meeuwisse W, Schamasch P. Summary and agreement statement of the first International Conference on Concussion in Sport, Vienna 2001. Phys Sportsmed. 2002;30(2):57–63. [PubMed]
18. Bandak FA, Eppinger RH. A three dimensional finite element analysis of the human brain under combined rotational and translational accelerations. Proc 38th Stapp Car Crash Conf.; 1994. pp. 145–163.
19. Nusholtz G, Lux P, Kaiker P, Janicki M. Head Impact Response Skull Deformation and Angular Accelerations. In Biomechanics of Impact Injury and Injury Tolerance of the Head-Neck Complex. In: Backaitis SH, editor. Society of Automotive Engineers. 1993. pp. 159–192.
20. Magulies SS, Thibault LE. A proposed tolerance criterion for diffuse axonal injury in man. J Biomech. 1992;25(8):917–923. [PubMed]
21. Gurdjian ES, Lange WA, Patrick LM, Thomas LM. In: Impact injury and crash protection. Thomas CC, editor. Springfield; Illinois: 1970.
22. Gadd CW. Use of a weighted-impulse criterion for estimating injury hazard. Proc. 10th Stapp Car Crash Conf., Society of Automotive Engineers; New York. 1966. pp. 164–174.
23. Versace J. A review of the severity index. Proc. 15th Stapp Car Crash Conf. Society of Automotive Engineers; New York. 1971. pp. 771–796.
24. Eppinger RH. A Prospective View of Head Injury Research. In: Bandak FA, Eppinger RH, Ommaya AK, editors. Traumatic Brain Injury: Bioscience and Mechanics. Mary Ann Liebert, Inc; NY: 1996. pp. 19–38.
25. Prasad P, Mertz HJ. The position of the United States delegation to the ISO working group 6 on the use of HIC in the automotive enviroment. Society of Automotive Enigneers. 1985
26. Ommaya AK, Gennarelli TA. Cerebral concussion and traumatic unconciousness. Brain. 1974;97:633–654. [PubMed]
27. Ommaya AK, Hirsch AE, Martinez JL. The role of whiplash in cerebral concussion. Proceedings of the 33rd Stapp Car Crash Conference, Warrendale Society of Automotive Engineers; 1966.
28. DiMasi F, Marcus J, Eppinger RH. 3-D anatomic brain model of relating cortical strains to automotive crash loadings. Paper No. 91-S8-0-11, 13th International Technical Conference on Experimental Safety Vehicles; Paris, France. 1993.
29. Gurgjian ES, Webster JE, Lissner HR. Observations on the mechanism of brain concussion, contusion and laceration. Surg Gynecol Obstet. 1955;101:688–690. [PubMed]
30. Hodgson VR, Thomas LM, Khalil TB. The role of impact location in reversible cerebral concussion. Proceedings of the 27st Stapp Car Crash Conf., SAE Paper No. 831618; 1983.
31. Zhang L, Yang KH, King AI. A Proposed Injury Threshold for Mild Traumatic Brain Injury. J BioMech Eng. 2004;126(2) [PubMed]
32. Zhang L, Yang KH, King AI. Comparison of brain responses between frontal and lateral impacts by finite-element modeling. J Neurotrauma. 2001;18(1):21–30. [PubMed]
33. Kleiven S. Influence of Impact Direction on the Human Head in Prediction of Subdural Hematoma. J Neurotrauma. 2003;20(4):365–379. [PubMed]
34. Delaney JS, Puni V, Rouah F. Mechanisms of Injury for Concussions in University Football, Ice Hockey, and Soccer; A Pilot Study. Clin J Sport Med. 2006;16(2):162–165. [PubMed]
35. Newman JA, Shewchenko N, Welbourne E. A Proposed New Biomechanical Head Injury Assessment Function The Maximum Power Index. Proceedings of the 44th Stapp Car Crash Conference; New York. 2000. [PubMed]
36. Newman JA, Barr C, Beusenberg M, Fournier E, Shewchenko N, Welbourne E, Withnall C. A New Biomechanical Assessment of Mild Traumatic Brain Injury Part 2 Results and Conclusions. International Conference on Biomechanics of Impacts (IRCOBI); 2000.
37. Pellman EJ, Viano DC, Tucker AM, Casson IR, Waeckerle JF. Concussion in professional football: Reconstruction of game impacts and injuries. Neurosurgery. 2003;53:799–814. [PubMed]
38. Chu JJ, Beckwith JG, Crisco JJ, Greenwald RM. A novel algorithm to measure linear and rotational head acceleration using single-axis accelerometers. Munich, Germany. 5th World Congress of Biomechanics; 2006.
39. Hanley JA, McNeil BJ. A method of comparing areas under receiver operating characteristic curves derived from the same cases. Radiology. 1983;148:839–843. [PubMed]
40. Neter J, Kutner MH, Nachtsheim CJ, Wasserman W, editors. Applied Linear Statistical Models. 4. McGraw-Hill; Boston MA: 1996.
41. Guskiewicz KM, Bruce SL, Cantu RC, Ferrara MS, Kelly JP, McCrea M, Putukian M, Valovich McLeod TC. National Athletic Trainers’ Association Position Statement: Management of Sport-Related Concussion. J Athl Train. 2004 Sep;39(3):280–297. [PMC free article] [PubMed]