PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Resuscitation. Author manuscript; available in PMC 2013 April 1.
Published in final edited form as:
PMCID: PMC3303947
NIHMSID: NIHMS331431

Coordination and management of multicenter clinical studies in trauma: Experience from the PRospective Observational Multicenter Major Trauma Transfusion (PROMMTT) Study

Abstract

Aim

Early death due to hemorrhage is a major consequence of traumatic injury. Transfusion practices differ among hospitals and it is unknown which transfusion practices improve survival. This report describes the experience of the PRospective Observational Multicenter Major Trauma Transfusion (PROMMTT) Study Data Coordination Center in designing and coordinating a study to examine transfusion practices at ten Level 1 trauma centers in the U.S.

Methods

PROMMTT was a multisite prospective observational study of severely injured transfused trauma patients. The clinical sites collected real-time information on the timing and amounts of blood product infusions as well as colloids and crystalloids, vital signs, initial diagnostic and clinical laboratory tests, life saving interventions and other clinical care data.

Results

Between July 2009 and October 2010, PROMMTT screened 12,561 trauma admissions and enrolled 1,245 patients who received one or more blood transfusions within 6 hours of ED admission. A total of 297 massive transfusions were observed over the course of the study at a combined rate of 5.0 massive transfusion patients/week.

Conclusion

PROMMTT is the first multisite study to collect real-time prospective data on trauma patients requiring transfusion. Support from the Department of Defense and collaborative expertise from the ten participating centers helped to demonstrate the feasibility of prospective trauma transfusion studies. The observational data collected from this study will be an invaluable resource for research in trauma surgery and it will guide the design and conduct of future randomized trials.

Introduction

In civilian trauma systems nearly 50% of in-hospital deaths occur within 12 hours of Emergency Department (ED) arrival and 70–80% within 48 hours.13 Hemorrhage is a contributing factor in 26–41% of early in-hospital deaths15 and many of these patients receive a massive transfusion (MT ≥ 10 units of red blood cells (RBCs) within 24 hours of admission). Coagulopathy plays a significant role in these deaths as truncal hemorrhage patients are the ones who most often present with coagulopathy in the ED.6;7

While a recent paper documents that the majority of MT patients receive 10 or more units of blood in the first 3 to 6 hours after injury and have the highest incidence of death during that period,8 essentially none of the specifics are known about the type and timing of resuscitative intervention during the critical 3 to 6 hours after admission, including the rates and sequence of infusions. Evidence suggests that increasing delay to the operating room (OR) worsens outcome in patients with truncal hemorrhage9 and that delivering a 1:1:1 ratio of plasma:platelets:RBCs is associated with improved survival.10 But it is clear from the existing MT literature that significant variation in practice and survival exists between trauma centers. Therefore, prospective minute-to-minute data collected during the first few hours after injury are critical for identifying practices that are associated with reduced mortality.

Responding to a request for proposals from the U.S. Department of Defense, Army Medical Research and Materiel Command, we conducted the PRospective Observational Multicenter Major Trauma Transfusion (PROMMTT) Study that aimed to identify practices leading to improved survival for trauma patients who require massive blood transfusions. Specific aims for PROMMTT were: 1) to compare survival of massively transfused trauma patients in 2009–2010 from PROMMTT to those who received the standard of care in 2006, as analyzed in a previously completed retrospective study;10 2) to prospectively validate an evidence-based algorithm to predict massive transfusion within 10 minutes of arrival in the ED; and 3) to document in real-time the timing of all lifesaving interventions and critical decisions in the ED, operating room (OR) or interventional radiology (IR) suite.

The Biostatistics/Epidemiology/Research Design component of the Center for Clinical and Translational Sciences at the University of Texas Health Science Center at Houston (UTHealth) serves as the Data Coordination Center (DCC) for PROMMTT. The DCC was responsible for providing the comprehensive supportive research infrastructure for developing, maintaining, and administering contractual agreements with each clinical site;11;12 standardized data collection processes and management across the Consortium including the training of clinical site personnel in project management and data entry, quality and security;13;14 and site monitoring and statistical analysis.11;15 The main objectives of this article are: 1) to describe in detail the design and development of PROMMTT; and 2) to discuss key methodological challenges associated with conducting a multicenter study of massive transfusion and lessons learned related to the coordination, and management of PROMMTT.

Materials and Methods

Study design and participating sites

PROMMTT was a prospective, consecutive patient, multicenter observational cohort study conducted at 10 clinical sites in the US. At each site, data collectors screened and enrolled consecutive severely injured trauma patients according to the inclusion and exclusion criteria found in Table 1.

Table 1
Eligibility criteria for PROMMTT

The PROMMTT-DCC was responsible for selection of the study sites. Because of the intensive nature of real time data collection, we considered the existing research infrastructure at each potential site, their ability to enroll an adequate number of eligible patients in the study,16 and active participation of an experienced and knowledgeable principal investigator at each site17 to be important selection criteria. The DCC developed a formal two-stage selection procedure to rank order individual candidate sites and performed an analysis of data quality from a previously completed retrospective study.10 Twenty-two potential clinical sites were subjected to rigorous metrics and a final group of 10 high-scoring sites that sufficiently represented the diverse patient populations and clinical practices across the country were chosen to become part of the Consortium. The criteria for selection of sites are shown in Table 2. Additionally, an External Advisory Committee was formed to provide guidance with respect to the suitability of the clinical sites and their ability to carry out study procedures.

Table 2
Criteria for site selection

The PROMMTT consortium consists of 10 clinical sites and a DCC located in the US. The DCC is located at the University of Texas Health Science Center at Houston (UTHealth) and the clinical sites are all accredited Level 1 trauma centers. The Consortium is composed of academic and governmental research institutions and affiliated hospitals (Table 3). The 10 clinical sites served a combined population of 26.9 million people and admitted 32,568 total trauma patients in 2010.

Table 3
Patient population and description of participating academic sites and associated hospitals

Regulatory oversight

The DCC developed an Institutional Review Board (IRB) application in accordance with all national regulations in consultation with human subjects experts. We applied for a waiver of consent for the study on the basis that as an observational study, patients would be subject to no more than minimal risk and that the research could not be practicably carried out because we expected a 30–60% refusal rate based on previous studies.1822

Once both DCC/UTHealth site IRB and US Army Medical Research and Materiel Command Office of Research Protections approvals were received, an IRB packet was sent to the nine external sites. The DCC provided assistance to each site during their local IRB application process, submitted all local approval documents to the Army for final approval, and continued to act as a facilitator between the Army and local IRBs throughout the study. One site (University of Washington) was required by its local IRB to obtain delayed consent for surviving patients. All sites were required to submit subsequent correspondence to or from their local IRB to the DCC, which submitted them to the Army as required in order to maintain compliance and to protect human subjects throughout PROMMTT. In total, the initial IRB approval process took 10 months to complete (range at clinical sites: 6 weeks to 4 months).

Data elements

Detailed patient data were collected on all routine clinical procedures and life-saving interventions administered to eligible trauma patients, as well as patient outcome data up to the time of death or discharge from the hospital. These data were captured in real-time at the patient bedside and included amount and timing of packed red blood cells, fresh frozen and thawed plasma, platelets, colloids and crystalloids infused and sequence and timing of interventions. The PROMMTT consortium collected 874 data fields using ten data forms (Table 4).

Table 4
PROMMTT data collection forms and included fields

The primary endpoint for this study was mortality. Secondary endpoints included event-free survival, cause of death, incidence of multiple organ failure (MOF), severe head injury, and incidence of specific surgical procedures.

Data collection system

The DCC implemented an informatics platform to support and automate data collection operations across the consortium. To facilitate real-time data collection, the PROMMTT data collection system was developed for use on tablet computers. The resulting system, the Survey On Demand System (SODS) was developed in collaboration with the School of Biomedical Informatics at UTHealth to function both online or offline and to provide 24/7 data capture, review, and submission by the sites. Paper-based backup case report forms were also provided to the sites. The DCC provided training and user support for SODS by conference call, email, meetings, and in written training documents.

Data management and quality control

To monitor quality, data submitted in SODS were exported nightly into a Structured Query Language (SQL) Server relational database and weekly into the PROMMTT data warehouse. Once in the data warehouse, records were reviewed and edited, and when necessary, transformed to comply with the PROMMTT data dictionary.

Because the majority of data were collected in real-time, the data entered on the tablet computer (or paper forms used for back-up) were the source documents for the study. While the hospital medical record may help clarify recorded data in some instances, the study protocol considered the medical records to be less reliable than the real-time data specifically for timing and sequence of infusions.

The DCC identified unacceptable data entries using custom software applications programmed to detect missing, impossible and improbable values, and logical inconsistencies between data fields and across forms. From detailed error logs, the DCC generated site-specific queries listing potential errors. Once the sites resolved these queries, the DCC updated and verified the patient records in the data warehouse and documented the resolution in the error log.

Management of laboratory specimens

As part of standard clinical practice, blood samples are obtained, processed, and analyzed on all newly admitted trauma patients at the clinical labs at the Consortium sites. In PROMMTT, these lab results were collected and recorded in SODS. Additional laboratory research was implemented to further improve understanding of the role of hemostatic proteins and cellular factors in early pathologic changes in massively injured and transfused trauma patients. Discarded patient blood samples were collected from patients at five IRB approved centers (starred sites in Table 3) and shipped to the UTHealth Center for Translational Injury Research central laboratory. The samples were analyzed using specialized laboratory assays that are not routinely done for clinical care. One site (University of California, San Francisco) had existing IRB approval to collect serial blood samples from trauma patients under a different protocol and performed a coordinated analysis on their samples with guidance and approval from the PROMMTT Laboratory Committee.

At the time of the initial ED blood draw for standard clinical blood tests, participating PROMMTT sites obtained any residual blood on all eligible trauma patients. If a patient received an MT, a second residual blood sample was obtained from a routine draw at the time of the 10th unit of RBC administration, 6 hours after ED admission or at arrival to the ICU, whichever occurred first. All blood samples were identified by identification number which also indicated the site, date and time of the specimen collection.

Available residual samples were transferred into either sodium citrate or special flow cytometry specimen tubes in a standardized order. The flow cytometry tubes contained a combination of ethylenediaminetetraacetic acid (EDTA) and a blood cell membrane stabilizer and were used for characterizing blood cell populations in whole blood.23 The sodium citrate tubes were used for measuring clotting factors and inhibitors, soluble inflammatory markers, and cellular microparticles.

Data analysis plan

In order to achieve Aim 1 of the study, we will explore both parametric and semi-parametric (Cox proportional hazards modeling) survival analyses to examine the data at both the site and individual patient levels to account for the potentially important variation in patient follow-up times and time-dependent covariates (e.g., patient-level changes in plasma and platelet ratios). We will check the underlying model assumptions and perform model diagnostics. In the event assumptions are violated or models fit poorly, we will identify alternative and appropriate data analysis strategies. We will apply the same data analysis approach for each of the secondary outcomes as well. However, because of potential inflation of the alpha level (type I error probability) due to multiple comparisons, the results from these analyses will be interpreted with caution.

In order to achieve Aim 2, we will split the prospective data into two random halves for a two-stage approach incorporating a training set and validation set. We will then develop an algorithm to predict the need for massive transfusion based on covariates identified from the training set. This model will then be tested for its predictive value on the validation set. It is important to note that different estimated risk cut-points produce different sensitivity and specificity profiles for a predictive model. Thus, we will define a classification rule that improves the accuracy of the predictive model by maximizing the area under a receiver operator characteristic (ROC) curve for the optimal cut-point of massive transfusion.

To achieve Aim 3, we will calculate point and interval (95% confidence limits) estimates for the rates, volume and timing of all crystalloid, colloids and blood products.

Target sample size and study power

The necessary sample size estimated for the research question described in Specific Aim 1, with 30-day survival, two-sided testing, power of 80% and a significance level of 5%, was 208 in each group. To allow for incomplete data on some patients and multivariable analyses, we planned to enroll 300 MT patients. We enrolled 297 MT patients and 948 non-MT patients over 15 months. These enrollment numbers allow 99% power to detect a difference in 30-day survival between MT and non-MT patients similar to the one detected in the previous retrospective study.10

PROMMTT Scientific Contributions

A PROMMTT Publication Committee includes one voting member from each site and one from the DCC. In order to use multisite data, investigators at the clinical sites or the DCC must submit proposal requests to the Publication Committee for review. The Committee approves all appropriate projects, makes suggestions to improve the project, and recommends other interested investigators who have volunteered to contribute. The Committee has approved seventeen investigator-initiated projects thus far. Prior to submission, the Publication Committee also reviews and approves manuscripts developed from approved proposals.

Results

A total of 12,561 patients were screened and 1,245 were enrolled from July 1, 2009 to October 15, 2010 (see Table 5). Sites had varying start and end dates within this interval. Of the eligible patients, 297 received a massive transfusion. PROMMTT enrolled an average 5.0 patients who received an MT per week over the course of the study, representing a range of 0.07–1.16 MT patients/week at the sites (mean=0.50 MT patients/week/site).

Table 5
PROMMTT final enrollment information by site

We collected 305 residual blood sample sets from enrolled patients at the five participating sites combined. Of these, 63 sample sets belonged to MT patients and 29 of the MT patients had a second sample collected.

Discussion

A major challenge early in the study was the coordination of Institutional Review Board approvals. The overall and site-specific regulatory approval process proceeded relatively smoothly and rapidly due to open lines of communication between the team of investigators and both local and US Army IRBs. Although we received all eleven necessary IRB approvals in 10 months, we had originally anticipated that the IRB process would take six months and thus our timeline was delayed at the start of data collection. Approval from the Army IRB alone required five months and no site could begin data collection until this approval was received. In hindsight, the IRB timeline may have been shortened considerably by not requesting a waiver of consent. The investigators were initially convinced that PROMMTT would have difficulty obtaining consent from a satisfactory percentage of patients if consent were required, but the only site required to obtain delayed consent received less than 5% refusals in this low-risk observational study.

Additionally, obtaining consent may have allowed more sites to participate in the blood sample collection as several sites informed the DCC that their local IRB would not approve the residual blood collection without consent. The use of residual samples was also less than ideal because frequently there was no residual blood available. If we had obtained consent, we would not have been restricted to residual samples and could have assured that samples were drawn for all enrolled patients. Another challenge was the operational difficulty of processing the residual samples. Hospital clinical laboratories have high volumes of clinical assays to run and were generally reluctant to commit staff time for processing research samples even for payment.

Another challenge was the performance of the tablet computers for real-time data capture in the ED due to 1) the large volume of complex, precisely timed data that had to be entered in a compressed time frame, and 2) system demands across diverse operating environments (e.g., hardware or operating system crashes and institutional firewall idiosyncrasies). Nine of ten sites ultimately reverted to paper-based data collection with delayed computer-based data entry. Also challenging was the transfer and conversion of study data from the SODS format24 to a traditional relational database warehouse.

Lastly, we were surprised by the variation among the sites in their clinical practices. For example, hospitals varied widely on trauma triage practices. Originally, PROMMTT had requested that data collectors begin data collection on patients who received the highest level of trauma activation. However, at some sites the highest level of activation missed a significant percentage of MT patients who were classified at lower trauma activation levels. To increase the number of MT patients enrolled, we changed the protocol to allow sites to start data collection on any trauma activation level.

The rich and complex database that PROMMTT has established will continue to be developed and mined for valuable clinical data for years to come. To that end, the DCC has received supplemental funds from the US Army to support further data management and statistical support for currently approved and future proposals through March 2013.

Conclusions

PROMMTT is the largest study to collect real-time prospective data on trauma patients requiring transfusion. PROMMTT was able to enroll, on average, 5 MT patients per week from a combination of high and low volume centers. Collaborative expertise from the ten participating centers helped to demonstrate the feasibility of prospective trauma transfusion studies. The observational data collected for this study will be an invaluable resource for answering important scientific questions regarding trauma medicine as well as to inform the design and conduct of future randomized trials.

Acknowledgments

This project was funded by the U.S. Army Medical Research and Materiel Command (Subcontract: W81XWH-08-C-0712). Infrastructure for the Data Coordinating Center was provided by the UTHealth Center for Clinical and Translational Sciences (NIH grant: UL1 RR024148). The study sponsors did not have a role in the study design; collection, analysis, and interpretation of data; writing of the manuscript; or the decision to submit this manuscript for publication.

The authors would like to thank the PROMMTT Coordinators and Data Collectors at each of the participating clinical sites as well as COL (Ret) Bob Saravideo, COL Dallas Hack, COL (Ret) Laura Brosch, and Dr. David Baer for their support and to the members of the U.S. armed services whose injuries in defense of their country motivated this research.

Appendix A

PROMMTT Investigators: Louis H. Alarcon, Karen J. Brasel, Eileen M. Bulger, Jay A. Johannigman, Margaret M. Knudson, Joseph P. Minei, Peter Muskat, John G. Myers, Herb A. Phelan, Andrew B. Peitzman, Ronald M. Stewart, Christopher E. White

Footnotes

Conflict of Interest Statement

No conflicts of interest have been declared by any authors in regards to this manuscript.

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

References

1. Stewart RM, Myers JG, Dent DL, et al. Seven hundred fifty-three consecutive deaths in a level I trauma center: the argument for injury prevention. J Trauma. 2003 Jan;54(1):66–70. [PubMed]
2. Peng R, Chang C, Gilmore D, Bongard F. Epidemiology of immediate and early trauma deaths at an urban Level I trauma center. Am Surg. 1998 Oct;64(10):950–4. [PubMed]
3. Sauaia A, Moore FA, Moore EE, et al. Epidemiology of trauma deaths: a reassessment. J Trauma. 1995 Feb;38(2):185–93. [PubMed]
4. Tien HC, Spencer F, Tremblay LN, Rizoli SB, Brenneman FD. Preventable deaths from hemorrhage at a level I Canadian trauma center. J Trauma. 2007 Jan;62(1):142–6. [PubMed]
5. Evans JA, van Wessem KJ, McDougall D, Lee KA, Lyons T, Balogh ZJ. Epidemiology of traumatic deaths: comprehensive population-based assessment. World J Surg. 2010 Jan;34(1):158–63. [PubMed]
6. MacLeod JB, Lynn M, McKenney MG, Cohn SM, Murtha M. Early coagulopathy predicts mortality in trauma. J Trauma. 2003 Jul;55(1):39–44. [PubMed]
7. Brohi K, Singh J, Heron M, Coats T. Acute traumatic coagulopathy. J Trauma. 2003 Jun;54(6):1127–30. [PubMed]
8. Moore FA, Nelson T, McKinley BA, et al. Massive transfusion in trauma patients: tissue hemoglobin oxygen saturation predicts poor outcome. J Trauma. 2008 Apr;64(4):1010–23. [PubMed]
9. Clarke JR, Trooskin SZ, Doshi PJ, Greenwald L, Mode CJ. Time to laparotomy for intra-abdominal bleeding from trauma does affect survival for delays up to 90 minutes. J Trauma. 2002 Mar;52(3):420–5. [PubMed]
10. Holcomb JB, Wade CE, Michalek JE, et al. Increased plasma and platelet to red blood cell ratios improves outcome in 466 massively transfused civilian trauma patients. Ann Surg. 2008 Sep;248(3):447–58. [PubMed]
11. Bangdiwala SI, de Paula CS, Ramiro LS, Munoz SR. Coordination of international multicenter studies: governance and administrative structure. Salud Publica Mex. 2003 Jan;45(1):58–66. [PubMed]
12. Blumenstein BA. Medical Research data. Control Clin Trials. 1995 Dec;16(6):453–5. [PubMed]
13. Marks RG, Conlon M, Ruberg SJ. Paradigm shifts in clinical trials enabled by information technology. Stat Med. 2001 Sep 15;20(17–18):2683–96. [PubMed]
14. Lallas CD, Preminger GM, Pearle MS, et al. Internet based multi-institutional clinical research: a convenient and secure option. J Urol. 2004 May;171(5):1880–5. [PubMed]
15. McFadden ET, LoPresti F, Bailey LR, Clarke E, Wilkins PC. Approaches to data management. Control Clin Trials. 1995 Apr;16(2 Suppl):30S–65S. [PubMed]
16. Vessey JA, Broome ME, Carlson K. Conduct of multisite clinical studies by professional organizations. J Spec Pediatr Nurs. 2003 Jan;8(1):13–21. [PubMed]
17. Weinberger M, Oddone EZ, Henderson WG, et al. Multisite randomized controlled trials in health services research: scientific challenges and operational issues. Med Care. 2001 Jun;39(6):627–34. [PubMed]
18. Dutton RP, Stansbury LG, Hemlock B, Hess JR, Scalea TM. Impediments to obtaining informed consent for clinical research in trauma patients. J Trauma. 2008 Apr;64(4):1106–12. [PubMed]
19. Al-Shahi R, Vousden C, Warlow C. Bias from requiring explicit consent from all participants in observational research: prospective, population based study. BMJ. 2005 Oct 22;331(7522):942. [PMC free article] [PubMed]
20. Tu JV, Willison DJ, Silver FL, et al. Impracticability of informed consent in the Registry of the Canadian Stroke Network. N Engl J Med. 2004 Apr 1;350(14):1414–21. [PubMed]
21. Mitchell AM, Kline JA. Systematic bias introduced by the informed consent process in a diagnostic research study. Acad Emerg Med. 2008 Mar;15(3):225–30. [PubMed]
22. Buckley B, Murphy AW, Byrne M, Glynn L. Selection bias resulting from the requirement for prior consent in observational research: a community cohort of people with ischaemic heart disease. Heart. 2007 Sep;93(9):1116–20. [PMC free article] [PubMed]
23. Warrino DE, DeGennaro LJ, Hanson M, Swindells S, Pirruccello SJ, Ryan WL. Stabilization of white blood cells and immunologic markers for extended analysis using flow cytometry. J Immunol Methods. 2005 Oct 30;305(2):107–19. [PubMed]
24. Mirhaji P, Zhu M, Vagnoni M, Bernstam EV, Zhang J, Smith JW. Ontology driven integration platform for clinical and translational research. BMC Bioinformatics. 2009;10( Suppl 2):S2. [PMC free article] [PubMed]