Search tips
Search criteria 


Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
Ann Emerg Med. Author manuscript; available in PMC 2016 July 1.
Published in final edited form as:
PMCID: PMC4478150

Revisiting the “Golden Hour”: An Evaluation of Out-of-Hospital Time in Shock and Traumatic Brain Injury

Craig D. Newgard, MD, MPH,1 Eric N. Meier, MS,2 Eileen M. Bulger, MD,3 Jason Buick, MSc, PCPf,4 Kellie Sheehan, BSN,2 Steve Lin, MD, MSc,4 Joseph P. Minei, MD,5 Roxy A. Barnes-Mackey, RN,6,7 Karen Brasel, MD, MPH,8 and the ROC Investigators


Study Objective

We evaluated shock and traumatic brain injury (TBI) patients previously enrolled in an out-of-hospital clinical trial to test the association between out-of-hospital time and outcome.


This was a secondary analysis of shock and TBI patients ≥ 15 years enrolled in a Resuscitation Outcomes Consortium out-of-hospital clinical trial by 81 EMS agencies transporting to 46 Level I and II trauma centers in 11 sites (May 2006 through May 2009). Inclusion criteria were: SBP ≤ 70 mmHg or SBP 71 - 90 mmHg with heart rate ≥ 108 beats per minute (shock cohort) and Glasgow Coma Scale score ≤ 8 (TBI cohort); patients meeting both criteria were placed in the shock cohort. Primary outcomes were 28-day mortality (shock cohort) and 6-month Glasgow Outcome Scale - Extended (GOSE) ≤ 4 (TBI cohort).


There were 778 patients in the shock cohort (26% 28-day mortality) and 1,239 patients in the TBI cohort (53% 6-month GOSE ≤ 4). Out-of-hospital time > 60 minutes was not associated with worse outcomes after accounting for important confounders in the shock cohort (adjusted odds ratio [aOR] 1.42, 95% CI 0.77-2.62) or TBI cohort (aOR 0.80, 95% CI 0.52-1.21). However, shock patients requiring early critical hospital resources and arriving > 60 minutes had higher 28-day mortality (aOR 2.37, 95% CI 1.05-5.37); this finding was not observed among a similar TBI subgroup.


Among out-of-hospital trauma patients meeting physiologic criteria for shock and TBI, there was no association between time and outcome. However, the subgroup of shock patients requiring early critical resources arriving after 60 minutes had higher mortality.



The concept that the first 60 minutes following traumatic injury is a critical period for getting patients to a trauma center (the “golden hour”) has been deeply ingrained in trauma systems, national field triage guidelines, emergency medical services (EMS) and clinical care.1,2 While clinical experience suggests that time is critically important in certain trauma patients, there is little empiric evidence to directly support the relationship between time and outcome following injury.3 To date, identifying the subgroup of trauma patients for whom shorter time results in better outcomes has remained elusive.


There have been numerous studies exploring the relationship between out-of-hospital time and outcome following injury.4-14 While a small number of studies suggest that shorter out-of-hospital time and possibly shorter scene time are associated with improved survival,4-6 the majority of studies have failed to substantiate such a relationship.7-14 There have been many challenges and limitations in testing the time-outcome association, including: bias (e.g., longer time accrual in less seriously injured patients results in the appearance that increased time is associated with better outcomes10); unmeasured confounding; in-hospital outcomes; small or highly selected samples; retrospective study designs; and limited analytic methods. Assuming that time is an important determinant of outcome in certain trauma patients, characterizing such patients may allow EMS and trauma systems to run more efficiently, improve outcomes for certain patients, better guide out-of-hospital decision-making and minimize unnecessary risk among EMS personnel and patients.15-17

Goals of This Investigation

In this study, we analyzed two groups of patients (shock and traumatic brain injury [TBI]) previously enrolled in an out-of-hospital clinical trial18,19 to evaluate the association between total out-of-hospital time and outcome (28-day mortality in shock, 6-month neurologic function in TBI). This study was designed to address several limitations of a previous study evaluating the role of time in trauma14 by including more homogenous trauma patients, detailed in-hospital data, subgroups of patients requiring time-dependent hospital interventions and longer-term outcomes.


Study Design

This was a secondary analysis of two cohorts of trauma patients (shock and TBI) who were enrolled in an out-of-hospital clinical trial evaluating the use of hypertonic saline and dextran (HSD) after injury.18,19


Data were collected from May 2006 to May 2009 as part of the Resuscitation Outcomes Consortium (ROC) HSD out-of-hospital clinical trial ( identifiers NCT00316017 and NCT00316004).18,19 The HSD study was a 3-arm, randomized, double-blind, placebo-controlled clinical trial to evaluate different types of early resuscitation fluid (0.9% saline vs. 7.5% HS vs. 7.5% HS and 6% dextran 70) among patients with field evidence of shock or TBI. This exception from informed consent study was closed early due to futility, with the results showing no outcome differences between treatment groups.18,19 The methodology and data collection used for this study have been previously detailed.20 Eligible patients were identified by 81 EMS agencies (ground and air medical) transporting to 46 Level I and II trauma hospitals in 11 sites across North America (Birmingham, AL; Dallas, TX; Memphis, TN; Milwaukee, WI; Pittsburgh, PA; Portland, OR; San Diego, CA; King County, WA; Ottawa, ON; Toronto, ON; and Vancouver, BC). Institutional Review Boards and Research Ethics Boards from the 11 sites reviewed and approved the HSD trial, which was conducted under the exception from informed consent regulations in the U.S. and Canada.

Selection of Participants

We evaluated two separate cohorts of injured adults evaluated by 9-1-1 advanced life support (ALS) EMS providers at the scene of injury: (1) patients with clinical evidence of hemorrhagic shock (systolic blood pressure [SBP] ≤ 70 mmHg or SBP 71 – 90 mmHg and heart rate ≥ 108 beats per minute at any point during out-of-hospital evaluation) and (2) patients with evidence of TBI (Glasgow Coma Scale [GCS] score ≤ 8 at any point during out-of-hospital evaluation). Patients meeting criteria for both cohorts were grouped in the shock cohort for purposes of analysis. The ROC HSD trial enrolled eligible patients ≥ 15 years (two younger patients of adult size were also enrolled based on initially incorrect ages); all enrolled patients were considered for this analysis. All patients had an intravenous line placed and study fluid initiated by EMS providers. Eligible patients had to be < 4 hours from the injury event, receive < 2 liters of crystalloid prior to enrollment and have planned transport from the scene of injury to a Level I or II trauma center. Exclusion criteria included: pregnancy, children, interhospital transfers, ongoing cardiopulmonary resuscitation, severe hypothermia, drowning, asphyxia due to hanging, burns > 20% of total body surface area, isolated penetrating injury to the head and incarceration/police custody.

We defined several a priori subgroups of patients for analysis based on plausible clinical mechanisms between time and outcome. Subgroups included: penetrating versus blunt injury, ground versus air transport and patients requiring early critical trauma resources. We defined “early critical trauma resources” as any of the following within 24 hours of emergency department (ED) arrival: packed red blood cell transfusion ≥ 6 units, major non-orthopedic surgical procedures (brain, spine, neck, thoracic, abdominal, pelvic and vascular), interventional radiology procedures or death. Patients who died within 24 hours were included to minimize survivor bias by retaining high-risk patients who may not have survived long enough to undergo critical interventions. Our definition for early critical trauma resources is similar to a recent consensus definition for patients requiring immediate care in major trauma centers.21

Methods and Measurements

The primary exposure variable was total out-of-hospital time, calculated from time of initial 9-1-1 call to time of EMS arrival at the receiving hospital ED. For patients with multiple sources of time records (e.g., dispatch, two or more patient care reports from different EMS agencies), data abstractors resolved discrepancies to produce the most accurate representation of time. There were strict quality assurance processes for data collection with the HSD trial.20 We did not evaluate sub-intervals of out-of-hospital time (e.g., response, on-scene, transport) because these intervals were not consistently captured in the trial.

We collected several additional out-of-hospital variables, including: patient demographics (age, sex), mechanism of injury (gunshot wound, stab/impalement, fall, motor vehicle occupant, motor vehicle vs. pedestrian or cyclist, motorcycle, struck, machinery or crushing injury), lowest SBP (in mmHg), initial Glasgow Coma Scale (GCS) score, highest and lowest heart rate (in beats/minute), advanced airway procedures (attempted intubation [endotracheal or nasal], supraglottic airway or cricothyrotomy), intravenous or intraosseus line placement, medication administration (paralytics, sedatives), field disposition and transport mode (ground ambulance versus helicopter).

Hospital variables included measures of injury severity (Abbreviated Injury Scale [AIS] score, Injury Severity Score [ISS]), non-orthopedic and orthopedic surgical interventions, the timing and volume of blood product transfusion, intensive care unit (ICU) duration of stay, total length of hospital stay (LOS) and in-hospital mortality.


We used the same primary outcomes captured in the HSD trial. For the shock cohort, the primary outcome was 28-day mortality. For the TBI cohort, the primary outcome was 6-month Glasgow Outcome Scale - Extended (GOSE). When possible, GOSE was collected directly from the patient via a structured phone interview. If the patient was unable, a family member or caregiver was allowed to provide the information. We dichotomized 6-month GOSE into poor outcome (severe disability or death, GOSE ≤ 4) versus good outcome (moderate or no disability, GOSE ≥ 5). We used mortality information to supplement the GOSE outcome, as collected from hospital records, phone follow-up and public records. For the TBI cohort, we considered 28-day mortality a secondary outcome.


We used descriptive statistics to compare patients in each cohort by total outof-hospital time ≤ 60 versus > 60 minutes. We then used multivariable logistic regression models to test the association between out-of-hospital time and outcome in the shock and TBI patient groups, analyzed separately. The time-outcome association was evaluated using multiple configurations of the time variable in separate models to comprehensively evaluate this relationship: continuous (linear association with outcome), spline regression (continuous, non-linear association with outcome), polytomous categorical (31 – 45, 46 – 60 and > 60 minute categories with ≤ 30 minutes as the reference), and dichotomous (≤ 60 versus > 60 minutes). We considered the dichotomous time variable a direct test of the “golden hour” concept in each cohort.

Multivariable models included plausible confounders of the time-outcome association and known predictors of outcome in trauma. We considered the following variables in the models: age (linear spline with knot at 45 years), sex, ISS, penetrating injury (shock model only), head AIS (TBI model only), SBP, GCS, heart rate, advanced airway attempt, mode of transport, and ROC site (fixed effect). To reduce bias and preserve study power, we used multiple imputation to handle missing values.22 We imputed the following key variables (% missing): age (0.1%), ISS (3.1%), heart rate (0.3%), head AIS (0.7% TBI cohort), SBP category (0.8% TBI cohort), 28-day mortality (0.7% TBI cohort) and GOSE (14.9% TBI cohort). The validity of multiple imputation for imputing missing out-of-hospital values and trauma data has been demonstrated under a variety of conditions.23,24 Twenty multiply imputed datasets were generated, each analyzed independently and combined using Rubin's method to appropriately account for variance within- and between-datasets.22 We assessed model fit using the Hosmer-Lemeshow goodness of fit test and examined diagnostic plots for change in coefficients (delta-beta) when individual episodes were excluded from the analysis. Analyses were conducted using R v3.01 (R Core Team, 2013) and the following R libraries: mice v2.16 and mitools v2.2.


Characteristics of Study Subjects

Of the 2,222 patients enrolled in the HSD trial, 2,017 met our study inclusion criteria and were retained for the primary sample. Two hundred five patients were excluded from the analysis for the following reasons: clinical trial study kit opened but not given, death in the field, missing key data, did not meet inclusion criteria and enrollment from a regional site with low representation (Figure 1). The primary sample included 778 patients in the shock cohort and 1,239 patients in the TBI cohort (Figure 1). Three hundred thirty-nine patients in the shock cohort also had an out-of-hospital GCS ≤ 8. Among patients with shock, 203 (26%) died within 28 days of injury. For the TBI cohort, 652 (53%) patients had GOSE ≤ 4 (including death) at 6 months and 304 (25%) died within 28 days. Characteristics of both cohorts, stratified by out-of-hospital time ≤ 60 versus > 60 minutes, are presented in Table 1. Shock patients with times longer than 60 minutes tended to be older, have more advanced airway interventions, air transport, blunt injury and slightly higher injury severity. TBI patients with times longer than 60 minutes tended to have more advanced airway interventions, air transport, motor vehicular mechanisms and higher injury severity.

Figure 1
Flow diagram of patients included in the primary analysis.
Table 1
Characteristics of the two trauma patient cohorts, stratified by total out-of-hospital time.

Main Results

The median total out-of-hospital time was 44 minutes (IQR 33-60) for the full sample, 41 minutes (IQR 31-59) for the shock cohort and 46 minutes (IQR 35-61) for the TBI cohort. There were 174 (22%) patients with out-of-hospital time > 60 minutes in the shock cohort and 325 (26%) patients in the TBI cohort. Across the 11 sites, the shock cohort median out-of-hospital time ranged from 35 to 75 minutes and from 38 to 65 minutes for patients with TBI. The distribution of total out-of-hospital time for each cohort, including the unadjusted proportion of patients incurring primary outcomes, is illustrated in Figure 2.

Figure 2
Total out-of-hospital time and unadjusted primary outcomes for the (A) shock cohort (n = 778) and (B) traumatic brain injury cohort (n = 1,239).*

In multivariable logistic regression models for the shock cohort, total out-of-hospital time was not associated with 28-day mortality (Table 2). These results persisted using a variety of methods for modeling the time variable, including continuous, spline, dichotomous and polytomous terms (Table 3). Among subgroup analyses, only shock patients requiring early critical interventions had an adjusted association between out-of-hospital time > 60 minutes and increased mortality (OR 2.37, 95% CI 1.05, 5.37). For patients with TBI, total out-of-hospital time was not associated with neurologic outcome at 6 months or 28-day mortality (Table 4). Similarly, there was no time-outcome association among TBI patients when the time variable was modeled in different forms or evaluated in subgroups (Table 5). These results did not qualitatively change when HSD treatment arm and a dichotomous version of heart rate (≤ 110 vs. > 110 beats/minute) were included in the models (data not shown).

Table 2
Multivariable logistic regression model evaluating the association between total out-of-hospital time and 28-day mortality among the shock cohort (n = 778).*
Table 3
The adjusted time-outcome association for the full shock cohort and shock subgroups (outcome = 28-day mortality) using different out-of-hospital time variables.*
Table 4
Multivariable logistic regression model evaluating the association between total out-of-hospital time and outcome among the TBI cohort (n = 1,239).*
Table 5
The adjusted time-outcome association for the full TBI cohort and subgroups (outcome = 6-month GOSE ≤ 4) using different out-of-hospital time variables.*

The primary models were well-fit (Hosmer-Lemeshow goodness of fit statistic p = 0.69 for the shock cohort and p = 0.47 for the TBI cohort). There was no evidence of effect modification between time and clinical variables in the shock cohort (all interactions p > .05). In the TBI cohort, there was suggestion of effect modification in two terms: time × head AIS ≥ 3 (p = .01) and time × ISS ≥ 16 (p = .03). While these TBI interactions suggest that the association between time and outcome was modified by injury severity, the direction of effect was not clinically plausible and did not change the overall results.

Results from pre-defined subgroup analyses for multivariable models using the dichotomous time variable are presented in Figure 3. Among the shock cohort, the only subgroup with an association between longer out-of-hospital time and greater 28-day mortality was the group requiring early critical resources (aOR > 60 minutes vs. ≤ 60 minutes 2.37, 95% CI 1.05-5.37). Using different definitions of total out-of-hospital time (continuous, polytomous, spline) among the same subgroup demonstrated similar findings, though none reached statistical significance (Table 3). As a sensitivity analysis for the early critical resources subgroup, we excluded 27 patients with no signs of life upon arrival to the ED who had no procedures and were declared dead within 30 minutes of ED arrival (i.e., it is possible these patients had fatal injuries recognized by EMS personnel with longer times to reach the hospital due to field-based interventions or other factors). This analysis produced a similar point estimate, but a wider 95% CI that did not reach statistical significance (aOR > 60 minutes vs. ≤ 60 minutes 2.14, 95% CI 0.91-5.04). There were no TBI subgroups that demonstrated a statistical association between longer time (> 60 minutes) and worse 6-month neurologic outcome (all p > 0.05) or greater 28-day mortality (all p > 0.05). Subgroup analyses for the TBI cohort using different versions of the time variable in multivariable models are presented in Table 5.

Figure 3
Subgroup analyses for shock (outcome = 28-day mortality) and traumatic brain injury (outcome = 6-month GOSE ≤ 4) cohorts using multivariable models and a dichotomous out-of-hospital time variable (> 60 minutes vs. ≤ 60 minutes). ...

As an additional sensitivity analysis, we conducted survival analyses for both cohorts using 28-day mortality. The lack of statistical association between out-of-hospital time (≤ 60 minutes vs. > 60 minutes) and mortality persisted in the shock cohort (hazard ratio [HR] 1.38, 95% CI .91 – 2.08) and TBI cohort (HR 0.82, 95% CI 0.59 – 1.13). Two shock subgroups demonstrated an association between longer out-of-hospital time and increased mortality: patients requiring early critical resources (HR 1.56, 95% CI 1.00 – 2.43) and patients injured by a blunt mechanism (HR 1.62, 95% CI 1.02 – 2.57). Other shock subgroups had no association. There were no TBI subgroups with an association between time and mortality in the survival analyses.


Many factors influence out-of-hospital time, some of which may confound the association between time and outcome. Traditional injury severity measures, patient demographics, mechanism of injury, physiologic response to injury and out-of-hospital procedures may not fully account for such confounding, which creates challenges in evaluating the true influence of time on outcome. Unmeasured factors related to patient prognosis can influence EMS provider behavior (e.g., less time on scene, light-and-sirens transport and faster driving), which in turn influences time. These relationships often result in patients with the worst prognosis (and therefore poor outcomes) having shorter out-of-hospital times, as illustrated in Figure 2. In observational research, it is difficult to fully account for all factors explaining the prognostic differences between patients and resulting EMS provider behavior. Such bias and confounding can create the appearance that longer time results in better outcomes (e.g., the air medical subgroup of TBI patients in Table 5) and create difficulty in generating a completely unbiased assessment of the time-outcome association. Use of techniques such as instrumental variable analysis have been used in EMS and trauma research to account for such unmeasured confounding and bias,14,25-27 though an appropriate instrument was not available in these data.

In addition, the database used for this study provided a fixed number of patients in each cohort, including those with field times greater than 60 minutes. It is possible that a larger overall sample size or larger number of patients with prolonged out-of-hospital times would have increased the power to detect an association between time and outcome. Furthermore, this study was a secondary analysis of data from a clinical trial, rather than a study powered specifically to address the question of a time-outcome association. While the 95% confidence interval around each cohort's point estimate for the time-outcome association crosses one and we conclude that there is no association, it is possible that the true association lies within this range and may be detectable with a larger sample powered to directly address this study question.

While our results suggest that arriving within 60 minutes to a major trauma center may result in better survival for shock patients requiring early critical interventions, this finding was from a subgroup analysis. Subgroup analyses have known limitations28 and this time-outcome association did not persist using all versions of the time variable. Whether these findings reflect differences in statistical efficiency (e.g., a larger reference group in the dichotomous term) or chance is unclear. The definition used to identify this subgroup was based on expert consensus21 and was similar to resource-based definitions used in many previous trauma studies,29-36 though it is possible that a different definition for this subgroup would have produced different findings. Nonetheless, we did specify this subgroup analysis a priori and there is good biologic plausibility for the findings. However, these results require confirmation in additional studies before the relationship can be considered conclusive. The survival analysis suggested that shock patients with a blunt mechanism requiring more than 60 minutes to arrive at a trauma center also have increased mortality, though this finding was from a sensitivity analysis and did not appear in the primary results. Furthermore, the data used for the present study came from a randomized controlled trial conducted in high-functioning ALS EMS agencies with direct transport to major trauma centers; our results may not generalize to regions with different resources or non-ALS EMS systems.

Finally, out-of-hospital time represents only one portion of the time continuum following injury. We were not able to account for the time between injury and 9-1-1 call or the time from ED arrival to hospital-based definitive care (for patients requiring such care). These additional time components are also likely to be important in evaluating the role of time in determining outcome following injury. However, one distinction with outof-hospital time is that this time interval is a modifiable component of trauma systems. That is, system-level operational changes can be implemented to increase or decrease total out-of-hospital time for certain patients in an effort to further optimize trauma systems and health outcomes.


In this study, we did not find an association between longer out-of-hospital time and worse outcomes among injured patients with field-based physiologic markers of shock and TBI. However, the subgroup of shock patients requiring early critical hospital interventions and arriving at a major trauma center greater than 60 minutes from 9-1-1 call were more likely to die within 28 days. Patients with TBI did not demonstrate a similar association. While our primary findings are consistent with a large number of previous studies demonstrating no association between time and outcome following injury,6-13 the subgroup results identify a population of injured patients where time may play an important role in determining outcome.

Although the concept of the “golden hour” and expeditious trauma care is a cornerstone of trauma systems, small differences in time (e.g., minutes) are unlikely to play a crucial role in determining outcome for all trauma patients. Many patients served by EMS will have non-life threatening injuries that do not require time-dependent intervention, even when physiologic compromise is present.18-20,37 However, clinical experience suggests that time can be critical in determining outcomes for certain trauma patients. The challenge has been in identifying and defining which patients have time-dependent injuries where out-of-hospital time may have a direct impact on outcome. Pushing for the fastest possible out-of-hospital care in every trauma patient (e.g., through lights-and-siren use, rapid driving and air medical transport) can create unnecessary risks to EMS providers, patients and the nearby public,15-17 while also being a common source of tort claims against EMS agencies.38 The EMS resources needed for rapid response and transport typically require comprehensive ambulance coverage, increased EMS staffing, and air medical services, all of which are expensive to sustain. In certain regions, it may not be possible to reach a major trauma center within 60 minutes due to geography, weather, extrication delays and other factors. In seeking to further optimize trauma systems, identifying which patients have better outcomes from rapid out-of-hospital care and which patients can be safely managed without such time constraints may help improve patient outcomes, reduce EMS occupational risks, reduce system costs and increase system efficiency.

Our findings add to the existing body of literature evaluating the role of time following injury. The only clinical conditions where out-of-hospital time has been consistently linked to outcome are non-traumatic cardiac arrest (response interval)39,40 and ST-elevation myocardial infarction (total out-of-hospital time).41 Time is also closely associated with outcome in stroke,42,43 though the relationship between out-of-hospital time and outcome following stroke has not been directly evaluated. One study suggested that shorter EMS response times were linked to improved survival among a mixed sample of patients served by EMS,25 though this finding has not been replicated in other studies.44,45 Among injured patients, the majority of previous studies evaluating the association between time and outcome have demonstrated no relationship.7-14 Our primary findings were similar, despite including patients with physiologic decompensation and accounting for multiple confounders. While out-of-hospital hypotension and depressed GCS are intended to identify the highest risk trauma patients for immediate transport to major trauma centers,1,2,46,47 these physiologic measures remain relatively crude tools in identifying patients with true time-dependent illness.

Our study is unique in suggesting one plausible subgroup of trauma patients where out-of-hospital time may be linked to outcome. Shock patients who required early critical interventions had higher adjusted survival when arriving within 60 minutes to a major trauma center. However, a similar TBI subgroup did not demonstrate such findings. These results will require confirmation before influencing EMS and trauma system operations. However, if confirmed, the ability to use these results in practice will also be contingent on being able to identify this important subgroup of patients with readily available information in the field. Current field trauma triage guidelines are generally designed to identify patients with serious injuries46 and therefore are not specific enough to separate out patients with time-dependent illness from those with less time-sensitive injuries. While we did not have enough information available in these data to determine specific types of injuries or clinical conditions represented in the group of patients requiring early critical interventions, this subgroup provides a target group for whom clinical decision rules could be developed using information readily available to EMS personnel. We have recently derived preliminary field-based decision rules for identifying such high-risk patients among a larger group of hypotensive trauma patients.48

There are several potential explanations for the lack of a time-outcome association among TBI patients. First, not all patients with GCS ≤ 8 had serious TBI, illustrating the lack of precision in current out-of-hospital physiologic measures in identifying high-risk patients. Second, the management of patients with TBI is complex, with many factors affecting outcome, including the severity and type of brain injury, age, physiologic response to injury, oxygenation, comorbidities, pre-injury medication use, early resuscitative care, surgical decision-making and critical care management. That is, time is but one factor involved in a complex combination of factors affecting outcome following TBI.


Among out-of-hospital trauma patients meeting physiologic criteria for shock and TBI, there was no overall association between time and outcome. However, in the subgroup of shock patients requiring early critical hospital interventions, arriving at a major trauma center within 60 minutes of 9-1-1 call was associated with higher 28-day survival.


We want to acknowledge and thank the many contributing EMS agencies, EMS providers, study coordinators, staff, and investigators for their willingness to participate in and support this project, and for their continued dedication to improving the EMS care and outcomes for their patients.


The ROC is supported by a series of cooperative agreements to multiple regional clinical centers (RCC) and one Data Coordinating Center (5U01 HL077863-University of Washington Data Coordinating Center, HL077866-Medical College of Wisconsin, HL077867-University of Washington, HL077871-University of Pittsburgh, HL077872-St. Michael's Hospital, HL077873-Oregon Health and Science University, HL077881-University of Alabama at Birmingham, HL077885-Ottawa Health Research Institute, HL077887-University of Texas SW Medical Ctr/Dallas, HL077908-University of California San Diego) from the National Heart, Lung and Blood Institute in partnership with the U.S. Army Medical Research & Material Command, The Canadian Institutes of Health Research (CIHR) - Institute of Circulatory and Respiratory Health, Defence Research and Development Canada, the Heart and Stroke Foundation of Canada, and the American Heart Association. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Heart, Lung and Blood Institute or the National Institutes of Health.

Technical Appendix

Analysis Software

All analyses were conducted in R v3.01.1 Multiply imputed datasets were generated using the package mice v2.162 and results from the multiple analyses were combined using functions from the package mitools v2.2.3

Multiple Imputation

For the shock cohort, Injury Severity Score (ISS) was the only measure with any notable missingness: 31 patients (4%). Because of the potential for selection bias in doing a complete case analysis and because we had good information (partial severity score data) from which to impute ISS, we chose to employ multiple imputation in our analyses. There were three other measures with missing values (counts in parentheses): age (1), initial GCS (1), and highest heart rate (4). Several severity-related measures not in the primary analysis model were used in the imputation models to impute ISS. Table 1 shows all the measures used in the shock cohort imputation and analysis models.

For the TBI cohort, the primary outcome, 6-month Glasgow Outcome Scale – Extended (GOSE), was missing for 185 patients (15%) and ISS was missing for 31 patients (3%). In addition, the following measures had missing values (counts in parenthesis): age (1), highest heart rate (2), 28-day mortality (8), head abbreviated injury score (8), and initial systolic blood pressure (10). Several severity-related measures not in the primary analysis model were used in the imputation models to impute GOSE and ISS. The selection of measures for the imputation of GOSE was informed by recent research by Zelnick et al.4 Table 2 shows all measures used in the TBI cohort imputation and analysis models. Twenty complete datasets were generated for each cohort using multivariable imputation by chained equation (MICE),3 also known as fully conditional specification (FCS). Results from the 20 datasets were combined using the method of Rubin,5 as implemented in mitools.

Analysis Models

The columns headed “In analysis model?” in Tables 1 and and22 indicate whether the variable was included in the analysis models for the shock and TBI cohorts. We modeled the EMS time covariate four different ways in separate models: dichotomous (≤ 60 vs. > 60 minutes), polytomous (≤ 30, 30-45, 46-60, and > 60 minutes), continuous, and continuous with spline knots at 30, 45, and 60 minutes. The other covariates are modeled as described in the “Modeled as ...” column for all analysis models.

Appendix Table 1

Shock Cohort: Characteristics in the Imputation and Analysis Models.

The following characteristics were included in imputation models to multiply impute values for those characteristics that were missing for one or more patients.
In analysis models?CharacteristicModeled as ...# MissingImputation method
Y28-day mortalityIndicator0
YEMS Time (minutes)aCategorical: ≤30, 30-45, 46-60, >600
YAgeContinuous, spline with knot at 45 years1PMM
YMale genderIndicator0
YPenetrating injuryIndicator0
YQualifying SBPCategorical: ≤50, 51-60, 61-70, 71-80, 81-900
YHighest heart rate (beats/minute)Categorical: <50, 51-110, >1104ML
YInitial GCSContinuous1PMM
YOut-of-hospital advanced airway attemptedIndicator0
YAir transportIndicator0
YRegional siteCategorical - fixed effect0
NRequired critical interventionIndicator0
NISS disposition categoryCategorical: Died < 6 hrs, other death, discharge ≥ 2 days, discharge < 2 days, discharge from ED, unknown1ML
NSerious injury (AIS ≥ 3) to chest or abdomenIndicator4LR
NSerious injury (AIS ≥ 3) to extremityIndicator7LR
NSerious injury (AIS ≥ 3) to the headIndicator1LR

Abbreviations: AIS, Abbreviated Injury Score; ED, emergency department; GCS, Glasgow Coma Scale; ISS, Injury Severity Score; LR, logistic regression; ML, multinomial logit; PMM, predictive mean modeling; SBP, systolic blood pressure.

aEMS time is also used as a continuous variable in some analysis models but not in the imputation models.
bIn most instances ISS is missing because one of the individual AIS scores is listed as “not otherwise specified” preventing the calculation of the ISS. However, there are other AIS scores available and this information can be used in the imputation process (see last 5 characteristics).

Appendix Table 2

Traumatic Brain Injury Cohort: Characteristics in the Imputation and Analysis Models.

The following characteristics were included in imputation models to multiply impute values for those characteristics that were missing for one or more patients.
In analysis models?CharacteristicModeled as ...# MissingImputation method
Y6-month GOSE ≤ 4Indicator185LR
Y28-day mortalityIndicator8LR
YEMS Time (minutes)aCategorical: ≤30, 30-45, 46-60, >600
YAgeContinuous, spline with knot at 45 years1PMM
YMale genderIndicator0
YHead AIS ≥ 3Indicator8LR
YInitial SBPCategorical: ≤90, 91-105, 106-120, 121-180, >18010ML
YHighest heart rate (beats/minute) > 110Indicator2LR
YQualifying GCSContinuous0
YOut-of-hospital advanced airway attemptedIndicator0
YAir transportIndicator0
YRegional siteCategorical - fixed effect0
NRequired critical interventionIndicator0
NDischarge GOSEContinuous69PMM
NDays alive and out of the hospital through day 28; death before 28 days is coded as 0.Continuous13PMM
NISS disposition categoryCategorical: Died < 6 hrs, other death, discharge ≥ 2 days, discharge < 2 days, discharge from ED, unknown0ML
NSerious injury (AIS ≥ 3) to chest or abdomenIndicator0LR
NSerious injury (AIS ≥ 3) to extremityIndicator0LR

Abbreviations: AIS, Abbreviated Injury Score; GCS, Glasgow Coma Scale; GOSE, Glasgow Outcome Scale – Extended, ISS, Injury Severity Score; LR, logistic regression; ML, multinomial logit; PMM, predictive mean modeling; SBP, systolic blood pressure.

aEMS time is also used as a continuous variable in some analysis models but not in the imputation models.
bIn most instances ISS is missing because one of the individual AIS scores is listed as “not otherwise specified” preventing the calculation of the ISS. However, there are other AIS scores available and this information can be used in the imputation process.


Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

No authors had conflicts of interest with this study.

Author Contributions

CDN and KB conceived of and designed the study. ENM performed all database management and statistical analyses. All authors helped refine the study plan, interpret preliminary results, and refine the analysis. CDN drafted the manuscript and all authors participated in critical revision of the manuscript. CDN and ENM take full responsibility for the data, results and manuscript as a whole.

1R Core Team (2013). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL

2Stef van Buuren, Karin Groothuis-Oudshoorn (2011). mice: Multivariate Imputation by Chained Equations in R. Journal of Statistical Software, 45(3), 1-67. URL

3Thomas Lumley (2012). mitools: Tools for multiple imputation of missing data. R package version 2.2.

4Zelnick LR, Morrison LJ, Devlin SM, et al. Addressing the challenges of obtaining functional outcomes in traumatic brain injury research: missing data patterns, timing of follow-up, and three prognostic models. J Neurotrauma 2014;31(11):1029-1038. doi:10.1089/neu.2013.3122.

5Rubin DB. Multiple Imputation for Nonresponse in Surveys. New York: John Wiley & Sons, Inc., 1987.


1. Committee on Trauma . Resources for Optimal Care of the Injured Patient. American College of Surgeons; Chicago, Ill: 2006.
2. Mackersie RC. History of trauma field triage development and the American College of Surgeons criteria. Prehospital Emergency Care. 2006;10:287–294. [PubMed]
3. Lerner EB, Moscati RM. The golden hour: scientific fact or medical “urban legend”? Acad Emerg Med. 2001;8:758–760. [PubMed]
4. Sampalis JS, Denis R, Lavoie A, et al. Trauma care regionalization: a process- outcome evaluation. J Trauma. 1999;46:565–581. [PubMed]
5. Sampalis JS, Lavoie A, Williams JI, et al. Impact of on-site care, prehospital time, and level of in-hospital care on survival in severely injured patients. J Trauma. 1993;34:252–261. [PubMed]
6. McCoy CE, Menchine M, Sampson S, Anderson C, Kahn C. Emergency medical services out-of-hospital scene and transport times and their association with mortality in trauma patients presenting to an urban Level I trauma center. Ann Emerg Med. 2013;61:167–174. [PubMed]
7. Stiell IG, Nesbitt LP, Pickett W, et al. The OPALS major trauma outcome study: impact of advanced life-support on survival and morbidity. CMAJ. 2008;178:1141–1152. [PMC free article] [PubMed]
8. Pepe PE, Wyatt CH, Bickell WH, et al. The relationship between total prehospital time and outcome in hypotensive victims of penetrating injuries. Ann Emerg Med. 1987;16:293–297. [PubMed]
9. Petri RW, Dyer A, Lumpkin J. The effect of prehospital transport time on the mortality from traumatic injury. Prehosp Disaster Med. 1995;10:24–29. [PubMed]
10. Lerner EB, Billittier AJ, Dorn JM, et al. Is total out-of-hospital time a significant predictor of trauma patient mortality? Acad Emerg Med. 2003;10:949–954. [PubMed]
11. Pons PT, Markovchick VJ. Eight minutes or less: does the ambulance response time guideline impact trauma patient outcome? J Emerg Med. 2002;23:43–48. [PubMed]
12. Di Bartolomeo S, Valent F, Rosolen V, et al. Are pre-hospital time and emergency department disposition time useful process indicators for trauma care in Italy? Injury. 2007;38:305–311. [PubMed]
13. Osterwalder JJ. Can the “Golden hour of shock” safely be extended in blunt polytrauma patients? Prehosp Disast Med. 2002;17:75–80. [PubMed]
14. Newgard CD, Schmicker R, Hedges JR, Trickett JP, Davis DP, Bulger EM, Aufderheide TP, Minei JP, Hata JS, Gubler KD, Brown TB, Yelle JD, Bardarson B, Nichol G. Emergency medical services time intervals and survival in trauma: assessment of the “Golden Hour” in a North American prospective cohort. Annals of Emergency Medicine. 2010;55(3):235–246. [PMC free article] [PubMed]
15. Ambulance crash-related injuries among Emergency Medical Services workers – Unites States, 1991-2002. MMWR Morb Mortal Wkly Rep. 2003;52:154–156. [PubMed]
16. Kahn CA, Pirrallo RG, Kuhn EM. Characteristics of fatal ambulance crashes in the United States: an 11-year retrospective analysis. Prehosp Emerg Care. 2001;5:261–269. [PubMed]
17. Becker LR, Zaloshnja E, Levick N, et al. Relative risk of injury and death in ambulances and other emergency vehicles. Accid Anal Prev. 2003;35:941–948. [PubMed]
18. Bulger EM, May S, Brasel KJ, Schreiber M, Kerby JD, Tisherman SA, Newgard C, Slutsky A, Coimbra R, Emerson S, Minei JP, Bardarson B, Kudenchuk P, Baker A, Christenson J, Idris A, Davis D, Fabian TC, Aufderheide TP, Callaway C, Williams C, Banek J, Vaillancourt C, van Heest R, Sopko G, Hata JS, Hoyt DB. ROC Investigators. Out-of-hospital hypertonic resuscitation following severe traumatic brain injury: a randomized controlled trial. JAMA. 2010;304(13):1455. [PMC free article] [PubMed]
19. Bulger EM, May S, Kerby JD, Emerson S, Stiell IG, Schreiber MA, Brasel KJ, Tisherman SA, Coimbra R, Rizoli S, Minei JP, Hata JS, Sopko G, Evans DC, Hoyt DB. Out-of-hospital hypertonic resuscitation after traumatic hypovolemic shock – a randomized, placebo controlled trial. Ann Surg. 2011;253:431–441. [PMC free article] [PubMed]
20. Brasel KJ, Bulger E, Cook AJ, et al. Hypertonic resuscitation: design and implementation of a prehospital intervention trial. J Am Coll Surg. Feb. 2008;206(2):220–32. [PubMed]
21. Lerner EB, Willenbring B, Pirrallo RG, Brasel KJ, Cady CE, Colella MR, Cooper A, Cushman JT, Gourlay DM, Jurkovich GJ, Newgard CD, Salomone JP, Sasser SM, Shah MN, Swor RA, Wang SC. A Consensus-Based Gold Standard for Trauma Center Need. J Trauma and Acute Care Surgery. In Press. [PubMed]
22. Rubin DB. Multiple Imputation for Nonresponse in Surveys. John Wiley & Sons, Inc.; New York: 1987.
23. Newgard CD. The validity of using multiple imputation for missing prehospital data in a state trauma registry. Acad Emerg Med. 2006;13:314–324. [PubMed]
24. Newgard CD, Haukoos J. Missing data in clinical research – part 2: Multiple imputation. Acad Emerg Med. 2007;14:669–678. [PubMed]
25. Wilde ET. Do emergency medical system response times matter for health outcomes? Health Econ. 2013;22:790–806. [PubMed]
26. Pracht EE, Tepas JJ, Celso BG, et al. Survival advantage associated with treatment of injury at designated trauma centers, A bivariate probit model with instrumental variables. Med Care Res Rev. 2007;64:83–97. [PubMed]
27. McConnell J, Newgard CD, Mullins RJ, et al. Mortality Benefit of Transfer to Level I vs. Level II Trauma Centers for Head-Injured Patients: Analysis using Instrumental Variables. Health Serv Res. 2005;40:435–457. [PMC free article] [PubMed]
28. Wears RL, Cooper RJ, Magid DJ. Subgroups, reanalyses, and other dangerous things. Ann Emerg Med. 2005;46:253–255. [PubMed]
29. Phillips JA, Buchman TG. Optimizing out of hospital triage criteria for trauma team alerts. J Trauma. 1993;34:127–32. [PubMed]
30. Baxt WG, Jones G, Fortlage D. The Trauma Triage Rule: a new, resource-based approach to the out-of-hospital identification of major trauma victims. Ann Emerg Med. 1990;19:1401–1406. [PubMed]
31. Fries GR, McCalla G, Levitt MA, et al. A prospective comparison of paramedic judgment and the trauma triage rule in the prehospital setting. Ann Emerg Med. 1994;24:885–889. [PubMed]
32. Zechnich AD, Hedges JR, Spackman K, et al. Applying the trauma triage rule to blunt trauma patients. Acad Emerg Med. 1995;2:1043–1052. [PubMed]
33. Newgard CD, Hui J, Griffin A, et al. Prospective validation of a clinical decision rule to identify severely injured children at the scene of motor vehicle crashes. Acad Emerg Med. 2005;12:679–687. [PubMed]
34. Henry MC, Hollander JE, Alicandro JM, et al. Incremental benefit of individual American College of Surgeons trauma triage criteria. Acad Emerg Med. 1996;3:992–1000. [PubMed]
35. Engum SA, Mitchell MK, Scherer LR, et al. Prehospital triage in the injured pediatric patient. J Pediatr Surg. 2000;35:82–87. [PubMed]
36. Qazi K, Kempf JA, Christopher NC, et al. Paramedic judgment of the need for trauma team activation for pediatric patients. Acad Emerg Med. 1998;5:1002–1007. [PubMed]
37. Newgard CD, Rudser K, Hedges JR, Kerby JD, Stiell IG, Davis DP, Morrison LJ, Bulger E, Terndrup T, Minei JP, Bardarson B, Emerson S, the ROC Investigators A critical assessment of the out-of-hospital trauma triage guidelines for physiologic abnormality. J Trauma. 2010;68(2):452–62. [PMC free article] [PubMed]
38. Wang HE, Faibanks RJ, Shah MN, Abo BN, Yealy DM. Tort claims and adverse events in emergency medical services. Ann Emerg Med. 2008;52:256–262. [PubMed]
39. Eisenberg MS, Bergner L, Hallstrom A. Cardiac resuscitation in the community: importance of rapid provision and implications for program planning. JAMA. 1979;241:1905–1907. [PubMed]
40. De Maio VJ, Stiell IG, Wells GA, et al. Optimal defibrillation response intervals for maximum out-of-hospital cardiac arrest survival rates. Ann Emerg Med. 2003;42:242–250. [PubMed]
41. Terkelsen CJ, Sorenson JT, Maeng M, Jensen LO, Tilsted H, Trautner S, Vach W, Johnsen SP, Thuesen L, Lassen JF. System delay and mortality among patients with STEMI treated with primary percutaneous coronary intervention. JAMA. 2010;304:763–771. [PubMed]
42. The National Institute of Neurological Disorders and Stroke rt-PA Stroke Study Group. Tissue plasminogen activator for acute ischemic stroke. N Engl J Med. 1995;333:1581–7. [PubMed]
43. Hacke W, Kaste M, Bluhmki E, Brozman M, Davalos A, Guidetti D, Larrue V, Lees KR, Medeghri Z, Machnig T, Schneider D, von Kummer R. Thrombolysis with Alteplase 3 to 4.5 hours after acute ischemic stroke. NEJM. 2008;359:1317–1329. [PubMed]
44. Pons PT, Haukoos JS, Bludworth W, et al. Paramedic response time: does is affect patient survival? Acad Emerg Med. 2005;12:594–600. [PubMed]
45. Blackwell TH, Kaufman JS. Response time effectiveness: comparison of response time and survival in an urban EMS system. Acad Emerg Med. 2002;9:288–295. [PubMed]
46. Sasser SM, Hunt RC, Faul M, Sugerman D, Pearson WS, Dulski T, Wald MM, Jurkovich GJ, Newgard CD, Lerner EB, Cooper A, Wang SC, Henry MC, Salomone JP, Galli RL. Guidelines for Field Triage of Injured Patients: Recommendations of the National Expert Panel on Field Triage, 2011. MMWR. 2012;61:1–20. [PubMed]
47. Hannan EL, Farrell LS, Cooper A, et al. Physiologic trauma triage criteria in adult trauma patients: are they effective in saving lives by transporting patients to trauma centers? J Am Coll Surg. 2005;200:584–592. [PubMed]
48. Newgard CD, Meier EN, McKnight B, Drennan IR, Richardson D, Brasel K, Schreiber M, Kerby JD, Kannas D, Austin M, Bulger EM, the ROC Investigators Understanding Traumatic Shock: Out-of-Hospital Hypotension With and Without Other Physiologic Compromise. J Trauma and Acute Care Surgery. In Press. [PMC free article] [PubMed]