|Home | About | Journals | Submit | Contact Us | Français|
The aim of this study was to examine retrospective dengue-illness classification using only clinical laboratory data, without relying on X-ray, ultrasound, or percent hemoconcentration. We analyzed data from a study of children who presented with acute febrile illness to two hospitals in Thailand. Multivariable logistic regression models were used to distinguish: (1) dengue hemorrhagic fever (DHF) versus dengue fever (DF), (2) DHF versus DF + other febrile illness (OFI), (3) dengue versus OFI, and (4) severe dengue versus non-severe dengue + OFI. Data from the second hospital served as a validation set. There were 1,227 patients in the analysis. The sensitivity of the models ranged from 89.2% (dengue versus OFI) to 79.6% (DHF versus DF). The models showed high sensitivity in the validation dataset. These models could be used to calculate a probability and classify patients based on readily available clinical laboratory data, and they will need to be validated in other dengue-endemic regions.
Dengue is an emerging infectious disease throughout the world and is endemic in tropical and subtropical areas. Recent estimates are that 3.6 billion people (55% of the global population) are at risk of dengue infection and that 70–500 million dengue virus (DENV) infections occur annually, 2.1 million of which are severe dengue illnesses with ~21,000 deaths.1 DENV is spread by mosquito vectors, usually Aedes aegypti or Ae. albopictus. Dengue illnesses are usually classified as two distinct entities: dengue fever (DF) and dengue hemorrhagic fever (DHF), with the most severe cases of DHF classified as dengue shock syndrome (DSS). Patients diagnosed with DF typically have a mild febrile illness with two or more of the following: headache, myalgia, arthralgia, rash, hemorrhagic manifestations, and leukopenia.2 DHF is defined by four diagnostic criteria established by the World Health Orgainzation (WHO): fever, thrombocytopenia (platelet count < 100,000 cells/mm3), bleeding tendency (positive tourniquet test or spontaneous bleeding), and plasma leakage (evidence of pleural effusion, ascites, or > 20% hemoconcentration).3 Some patients with DF may exhibit severe illness but do not meet all four WHO DHF criteria. Likewise, some patients meeting diagnostic criteria for DHF have relatively mild illness, with minimal evidence of plasma leakage and bleeding diathesis not requiring medical intervention.
Previous studies have shown limited agreement between a physician's diagnosis of severe dengue illness and strict adherence to the WHO definition of DHF, and these studies have placed emphasis on a simpler definition of severe dengue illness.4–7 Dengue endemic regions often have limited hospital resources and may not have the capability to perform chest X-rays or ultrasounds to detect pleural effusion or ascites, making it more difficult to fulfill the WHO criteria for the diagnosis of DHF. Changes in hematocrit may be influenced by early fluid resuscitation. In addition, baseline, convalescent, and/or reference hematocrit values are needed to show hemoconcentration; these values are often missing. Given these scenarios, patients with a severe dengue infection may be classified as DF if WHO criteria are consistently applied, which may underestimate the global severity of dengue illness. Additionally, resource-poor areas lack essential laboratory support and may be unable to differentiate a DENV infection from other febrile illness (OFI). Previous studies suggest that other or additional indicators not in the WHO definition can distinguish patients with DHF from DF or patients with dengue from patients with OFI.8 However, among the studies with multivariable models, all of the final models produced had limited ability to make generalizations, and none of these models were statistically validated.
The aim of this study was to assess the retrospective value of laboratory measures that physicians use to classify dengue illnesses. Using more readily available clinical laboratory measures, we developed, evaluated, and validated different models of dengue-illness classification based on a large, prospectively collected dataset and compared our models with the WHO classification system and an experienced physician's diagnosis. We also assessed whether laboratory parameters alone could appropriately classify severe versus non-severe dengue illnesses.
A longitudinal observational study was conducted at two hospitals in Thailand: (1) the Queen Sirikit National Institute of Child Health (QSNICH) in Bangkok during the years 1994–1997, 1999–2002, and 2004–2007 and (2) Kamphaeng Phet Provincial Hospital (KPPPH) during the years 1994–1997. The study methods have been described elsewhere.9 In brief, children between the ages of 6 months and 15 years, presenting with temperature ≥ 38.5°C for ≤ 72 hours and no localizing symptoms, were eligible for the study. Exclusion criteria included: signs of shock at presentation, chronic disease, or an initial alternate non-dengue diagnosis. Children were admitted to the hospital and monitored throughout their hospital stay until 24 hours after their fever subsided. Written parental informed consent was obtained before enrollment. The study protocol was approved by the Institutional Review Boards of the Ministry of Public Health, Thailand, the US Army, and the University of Massachusetts Medical School.
A blood sample was obtained on the day of enrollment and daily thereafter until 1 day after defervescence or for a maximum of five consecutive blood collections. Clinical laboratory studies included complete blood count and manual white blood cell (WBC) differential. Serological assays (immunoglobulin M/G [IgM/IgG] enzyme-linked immunosorbent assay [ELISA] and hemagglutination inhibition assay), viral isolation, and/or reverse transcription polymerase chain reaction (RT-PCR) were used to confirm all dengue cases. Patients were observed daily, and clinical and laboratory measurements were recorded using standardized data-collection forms.
On the day of defervescence, finger-stick hematocrits were measured every 6 hours for 18 hours to capture hemoconcentration. A right lateral decubitus chest X-ray was taken the day after defervescence, and a pleural effusion index (PEI) was measured as 100× (maximum width of right pleural effusion/maximum width of right hemithorax). After completion of the case record and careful review of the medical record and laboratory results, a final diagnosis of DF, DHF, or OFI was assigned by an expert physician, who was not directly involved in patient care.
An additional category was constructed to classify patients with severe dengue versus non-severe dengue. Patients with dengue were classified as having severe dengue if they met any of the following criteria: (1) final diagnosis of DHF grade 3 or 4 (i.e., DHF with shock), (2) significant pleural effusion (PEI > 15), (3) required total fluid intervention (oral or intravenous) in any 24-hour period that exceeded maintenance volume + 5% volume deficit10,11, or (4) required intravenous fluid (IVF) throughout hospitalization (IVF was administered only under stringent circumstances, such as poor intake of oral fluids or signs of shock).
Descriptive characteristics, such as diagnosis, age, gender, length of illness at presentation, and hospital, were evaluated using t test for continuous variables and Pearson's χ2 test for categorical variables.
Logistic regression models were constructed using data from QSNICH and validated using data from KPPPH. For each outcome (DF versus DHF, DHF versus all others, any dengue versus OFI, and severe dengue versus all others), univariate logistic regression was performed on the training dataset (QSNICH) for each of the following variables: maximum values for tourniquet test (number of petechiae per square inch), hematocrit, serum aspartate aminotransferase (AST), serum alanine aminotransferase (ALT), percent neutrophils, percent lymphocytes, and percent monocytes and minimum platelet count and WBC count. Lowess curves were used to assess the distribution of the independent variables and determine the categorization for those with skewed distributions. If the linearity assumption held true, then the variable was used as a continuous variable.
Multivariable models were constructed for each outcome in a manual stepwise procedure based on the univariate indicators with the best area under the receiver operator characteristic (ROC) curve. For variables that were highly correlated, only the variable with the higher area under the curve (AUC) from univariate analysis was used in the multivariable modeling. Variables that did not remain significant at the α = 0.05 level were removed from the model, and the variable with the next highest area under the ROC was added into the model. The optimal sensitivity and specificity for each final multivariable model was chosen based on a probability cutoff where the sum of sensitivity and specificity were maximized, the maximum percent correctly classified was achieved, and sensitivity remained higher than specificity.
Sensitivity and specificity for each model were also established in the test dataset using the same coefficients and probability cutoff as from the training dataset.
The percent agreement between the physician's diagnosis of DHF or the statistical models and the current WHO definition of DHF was evaluated using κ statistics. The optimal probability cutoff from the model was used to determine the proportion of patients that would be defined as DHF, where each patient above the cutoff was considered DHF and each patient below the cutoff was considered not DHF.
There were 1,384 patients enrolled in the study; 1,311 of these patients had a diagnosis of DHF, DF, or OFI (presumed viral, non-dengue illness). For 65 of these patients (55 with OFI, 6 with DF, and 4 with DHF), a day of defervescence could not be assigned, and they were excluded from the analysis. Some patients with OFI were discharged from the study before defervescence because of a negative PCR. Data obtained from the day of enrollment showed no significant differences between these 65 excluded patients and the remainder of the cohort with the following exceptions: (1) patients with DF included in the study were older than those with DF that were excluded (8.7 years versus 6.0 years; P = 0.03), and (2) patients with OFI included in the analysis had higher percent monocytes than patients with OFI that were excluded (3.8% versus 2.4%; P = 0.01). An additional 19 patients did not have information on all clinical laboratory variables used in the analysis and were excluded.
There were 1,227 patients included in the analysis (228 with DHF, 386 with DF, and 613 with OFI). Patients with DHF were classified by grade as follows: grade 1 (N = 59), grade 2 (N = 129), grade 3 (N = 39), and grade 4 (N = 1). There were 1,058 patients who completed the study at QSNICH and 169 patients from KPPPH (Table 1). The number of patients included in each model is shown in Figure 1.
We compared the characteristics of subjects enrolled at QSNICH and KPPPH. A higher proportion of patients with DHF were enrolled at KPPPH compared with QSNICH (30.8% versus 16.6%; P < 0.001). Patients presenting to KPPPH were also older than those presenting to QSNICH (8.9, 95% confidence interval [CI] = 8.4–9.3 versus 7.7, 95% CI = 7.5–7.9; P < 0.001). There were no differences between the hospitals with regards to gender and days ill at presentation. However, at QSNICH, patients with DHF presented later than patients with DF or OFI (2.3 versus 2.1 and 1.7, respectively; P < 0.001), and patients with DF presented later than patients with OFI (2.1 versus 1.7, respectively; P < 0.001). Additionally, at QSNICH, patients with DHF and patients with DF were older than patients with OFI (P < 0.001). At KPPPH, a lower percentage of males was seen among patients with DF compared with patients with DHF or OFI (χ2 P = 0.03 and χ2 P = 0.02, respectively).
Table 2 shows the results of univariate logistic regression modeling using the QSNICH data. Clinical laboratory variables distinguishing each of the different diagnostic categories included minimum platelet count, maximum daily hematocrit (Hct), AST > 100, maximum ALT, and a positive tourniquet test (> 20 petechiae). Among these variables, unit decreases in minimum platelet count and increases in maximum Hct, AST, and ALT and having a positive tourniquet test were associated with having the more severe outcome in each of the models. The AUC for these variables ranged from 0.92 to 0.54. Additional variables of decreasing age and decreasing minimum WBC count distinguished between all categories except DHF versus DF and were associated with having the more severe outcome in each model. The maximum percent lymphocytes and percent neutrophils distinguished patients with DHF versus DF and those with dengue versus OFI.
Table 3 shows the results of multivariable analysis using QSNICH data. Maximum AST and ALT were found to be highly correlated (Pearson correlation = 0.86), and therefore, only maximum AST was used in the modeling. Incremental decreases in minimum platelet count (one unit = 25,000 cells/mm3) and a maximum AST > 100 were found to be associated with the more severe outcome in each of the final multivariable models. Additionally, increases in the maximum daily Hct were associated with having a diagnosis of DHF compared with DF or DF + OFI. Increases in maximum percent neutrophils, age, and incremental decreases in minimum WBC count (one unit = 500 cells/mm3) were associated with a diagnosis of DHF versus DF. All variables except maximum percent lymphocytes and percent neutrophils showed an association with having severe dengue illness compared with non-severe dengue or OFI. In addition to distinguishing patients with severe dengue, a tourniquet test of petechiae ≥ 20 was also included in the model for distinguishing patients with serologically confirmed dengue from those with OFI. Age is included in the models of DHF versus DF and severe dengue versus all others and shows that younger patients have higher odds of DHF or severe dengue after adjusting for all other variables in the model.
The probability cutoff for each multivariable model was defined as the cutoff that gave the highest percent of patients correctly classified where the sensitivity remained higher than the specificity. Figure 2 illustrates the tradeoff between sensitivity and specificity for each probability cutoff for all of the multivariable models and shows the optimal cutpoint.
The frequency distribution of each diagnosis (DHF, DF, and OFI) according to the optimal probability cutoff for each model is given in Figure 3, showing the distribution of diagnoses in both the training and test datasets. The sensitivity/specificity analysis, including AUC, positive and negative predictive values, and percent correctly classified, and validations with the test dataset are indicated in Table 4. When applying each model to the test dataset, the sensitivity decreased by 2.7% (DHF versus DF) to 8.9% (DHF versus all others). The specificity increased for each validation except severe dengue versus all others, where specificity decreased and sensitivity increased. The percent correctly classified decreased by 0.7% (DHF versus DF) to 4.3% (severe dengue versus all others). The final model distinguishing between patients with dengue and patients with OFI performed the best, giving the highest AUC, specificity, and percent correctly classified in both the training and test datasets.
Outside of a research setting, the entire spectrum of a patient's illness may not be available. Therefore, each model was applied to the test dataset using data only at defervescence and/or at 24 hours after defervescence, the period of greatest risk for plasma leakage when patients are most likely to require hospitalization. When using data from the test dataset obtained in these later stages of illness, the sensitivity for most models decreased. However, using data at 24 hours after defervescence, it remained moderately high for DHF versus DF, increasing from 76.9% to 86%, and DHF versus all others, at 71%.
Figure 4 shows the four validated multivariable models. Coefficients for the calculation of probability for each model are obtained by taking the natural logarithm of the odds ratio for each variable in Table 3.
Table 5 shows the percent agreement and κ statistics between the model's classification of DHF, the physician's diagnosis of DHF, and the WHO diagnosis of DHF. When applying the optimal probability cutoffs, the percent agreement between the model and the WHO classification of DHF compared with DF was 80.0% (κ = 0.58; P < 0.001). The percent agreement between the model and the WHO definition of DHF improved to 86.2% compared with all others (DF + OFI; κ = 0.60; P < 0.001). In both cases, the model had a higher percent agreement with a WHO diagnosis of DHF than the physician's diagnosis of DHF.
The model of DHF versus DF classified 42.0% (258/614) of patients with dengue as having DHF. The physician diagnosed 37.1% (228/614) of patients with dengue as DHF, and strict adherence to the WHO definition would have diagnosed 33.1% (203/614) patients with dengue as DHF. The model of DHF versus all others classified 51.6% (317/614) of patients with dengue as DHF. The model of severe dengue versus all others classified 49.2% (302/614) of patients with dengue as having a severe dengue illness, including 203 patients diagnosed by the physician as DF. Only 6.5% (40/614) of patients with dengue were diagnosed by the physician as DHF grade 3 or 4.
In this study, we developed models using clinical laboratory indicators to find associations with an expert physician's final diagnosis and WHO criteria of DHF and DF. Although these models rely on laboratory results, these tests are part of standard clinical practice, and the models do not rely on more costly chest X-ray or other measures of capillary leakage. In addition, we established a category of severe dengue illness using indicators known to be associated with DSS. We found that a large percentage of patients with dengue would be classified as having a severe dengue illness given their clinical laboratory values throughout their hospitalization. To our knowledge, our study involves the largest set of systematically collected data to address these questions.
An important aspect of this study is the use of a validation dataset. Previous studies have shown that strict adherence to WHO criteria does not identify all severe dengue disease. Some studies have used different definitions that may be more suitable for identifying severe disease and less confusing for physicians4,12–16; however, these different definitions have not been validated. The validation dataset in our study involved a different hospital, with a distinct and more rural catchment area (approximately 350 km northwest of Bangkok). Although patients at KPPPH were older and more patients were diagnosed with DHF, our models were still a robust fit for these data, with little change in the AUC compared with the training dataset. KPPPH is also in a region where Japanese encephalitis (JE) virus is known to cocirculate, and there is routine vaccination against JE.17,18 This diversity adds to the validation of the models presented here.
There is controversy surrounding the classification of DHF using the WHO definition. The previous WHO definition of DHF requires strict adherence to four criteria, which includes ambiguous definitions of bleeding tendency and hemoconcentration.3 Comparing our models with an expert physician's diagnosis of DHF and the WHO definition of DHF could help to alleviate ambiguity by finding other objective indicators that do not necessarily depend on convalescent visits or use of expensive tests in resource-limited areas. Although the diagnosing physician used chest X-rays to determine the final diagnosis, our models show high sensitivity in distinguishing DHF from DF and DHF from all others without including chest X-ray or hemoconcentration. Our models did not show an improved percent agreement over the physician's diagnosis or the WHO definition of DHF. However, this is not surprising when considering that the physician used PEI as an indicator for plasma leakage and the majority of patients diagnosed with DHF had evidence of pleural effusion. Nevertheless, our validated model of DHF versus DF did show a high percent agreement with both the physician's diagnosis of DHF and the WHO definition (79.5% and 80.0%, respectively).
We showed high sensitivity and specificity in classifying patients with severe dengue defined by shock or need for fluid resuscitation. Some indicators used in the WHO definition of DHF are affected by early hydration and detecting hemoconcentration and plasma leakage can be difficult.13 We defined a less-subjective category of severe dengue, which considered the amount of fluid resuscitation needed, and produced a model with high sensitivity and specificity without using a chest X-ray or hemoconcentration. Although early hydration can still affect the values of hematocrit used in our models, we have removed the requirement for baseline or convalescent hematocrits that may not always be available outside of a research setting. Furthermore, we applied our models to the validation dataset using data obtained at 24 hours after defervescence only and still achieved high sensitivity and specificity for DHF versus DF and DHF versus all others. This suggests that our models will be applicable outside of a research setting and perhaps, generalizable to patients who present later in illness; however, further studies are needed to test the generalizability.
Bleeding tendency is often indicated by a positive tourniquet test, but the test method is not always harmonized among treatment centers (Thomas SJ, unpublished data) and confusion arises as to which cutoff should be used to indicate a positive test.13 We found that a cutoff ≥ 20 petechiae yielded a higher AUC compared with a cutoff of ≥ 10 petechiae (data not shown). However, across all multivariable models, a positive tourniquet test showed an association only in the patients with dengue compared with patients with OFI. This supports use of this indicator to identify patients with dengue, whereas the tourniquet test has performed less well for distinguishing DHF from DF.9,16,19,20
Minimum platelet count and maximum Hct were associated with DHF and are part of the WHO definition. Although platelet count and Hct are included in the model, not all patients diagnosed by physicians with DHF had a platelet count below 100,000, and most patients with DHF had plasma leakage detected by pleural effusion rather than by hemoconcentration. Our models have no thresholds for particular variables but instead, use a combination of clinical laboratory variables to calculate a probability that can be used to classify patients.
The main limitation to our study is the exclusion of children who presented later in illness. This study design limits the number of patients who developed severe dengue illness. Our study was also limited to Thailand's pediatric population. However, this reflects what is seen in southeast Asia, where the majority of dengue cases are in the pediatric population.
Our study identified clinical indicators that could be used to calculate a probability of DHF or severe dengue illness. From our models, patients with DF or non-severe dengue illness and OFI have a uniformly low probability of DHF or severe dengue. The probability calculated from our models could be used to classify patients when other indicators, such as a chest X-ray or convalescent sera, are unavailable. These models are not meant to guide clinical management but can be used for retrospective classification of dengue illness in the absence of standard indicators of plasma leakage.
Financial support: This work was supported by National Institutes of Health Grant NIH-P01AI34533, Centers for Disease Control and Prevention Office of the Director Grant 1R36CK00123-01, and the Military Infectious Disease Research Program. The opinions or assertions contained herein are the private ones of the authors and are not to be construed as official or reflecting the view of the US Government. The authors have no conflicting financial interests.
Authors' addresses: James A. Potts, Anon Srikiatkhachorn, Wenjun Li, Daniel H. Libraty, Sharone Green, and Alan L. Rothman, Center for Infectious Disease and Vaccine Research and Department of Medicine, University of Massachusetts Medical School, Worcester, MA, E-mails: ude.demssamu@sttoP.semaJ, ude.demssamu@nrohcahktaikirS.nonA, ude.demssamu@iL.nujneW, ude.demssamu@ytarbiL.leinaD, ude.demssamu@neerG.enorahS, and ude.demssamu@namhtoR.nalA. Stephen J. Thomas, Ananda Nisalak, and Robert V. Gibbons, Department of Virology, Armed Forces Research Institute of Medical Sciences, Bangkok, Thailand, E-mails: firstname.lastname@example.org, gro.smirfa@nadnana, and email@example.com. Pra-on Supradish, Suchitra Nimmannitya, and Siripen Kalayanarooj, Queen Sirikit National Institute of Child Health, Bangkok, Thailand, E-mails: moc.oohay@usnoarp, ht.og.hpom.htlaeh@nartijus, and ht.og.hpom.htlaeh@piris. Timothy P. Endy, Department of Medicine, University of New York, Upstate Medical University, Syracuse, NY, E-mail: ude.etatspu@tydne.