Search tips
Search criteria 


Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
J Clin Epidemiol. Author manuscript; available in PMC 2010 March 1.
Published in final edited form as:
PMCID: PMC2736855

Administrative Codes Combined with Medical Records-based Criteria Accurately Identified Bacterial Infections among Rheumatoid Arthritis Patients

Nivedita M. Patkar, MD, MSPH,1 Jeffrey R. Curtis, MD, MPH,1 Gim Gee Teng, MD,1 Jeroan J. Allison, MD, MS,1 Michael Saag, MD,1 Carolyn Martin, MSW,2 and Kenneth G. Saag, MD, MSc1



To evaluate diagnostic properties of International Classification of Diseases, Version 9 (ICD-9) diagnosis codes and infection criteria to identify bacterial infections among rheumatoid arthritis (RA) patients.

Study Design and Setting

We performed a cross- sectional study of RA patients with and without ICD-9 codes for bacterial infections. Sixteen bacterial infection criteria were developed. Diagnostic properties of comprehensive and restrictive sets of ICD-9 codes and the infection criteria were tested against an adjudicated review of medical records.


Records on 162 RA patients with and 50 without purported bacterial infections were reviewed. Positive (PPV) and negative predictive values (NPVs) of ICD-9 codes ranged from 54% – 85% and 84% – 100%, respectively. PPVs of the medical records-based criteria were: 84% and 89% for “definite” and “definite or empirically treated” infections, respectively. PPV of infection criteria increased by 50% as disease prevalence increased using ICD-9 codes to enhance infection likelihood.


ICD-9 codes alone may misclassify bacterial infections in hospitalized RA patients. Misclassification varies with the specificity of the codes used and strength of evidence required to confirm infections. Combining ICD-9 codes with infection criteria identified infections with greatest accuracy. Novel infection criteria may limit the requirement to review medical records.

Keywords: Bacterial Infections, Diagnostic coding, Administrative claims data, Rheumatoid Arthritis, Bacterial infection classification criteria, Validation study

Bacterial infections in rheumatoid arthritis (RA) are common [1, 2] and are of growing interest based on an increasing number of serious infections reported in patients receiving biologic therapies [36]. A comprehensive understanding of the associations between infection with RA and the use of specific therapeutic agents has been limited by the absence of objective criteria to correctly identify infection in studies of large populations. Misclassifying infections may mask the risks related to use of particular arthritis medications [6] or could introduce bias if outcome assessment is subjective and reviewers are not blinded to medication exposure. A validated set of diagnostic criteria for a broad range of infections has been lacking in the medical literature and exists mainly for isolated infections such as the Duke criteria for endocarditis [7]. Additionally, although the accuracy of administrative claims data has been studied for various conditions [810], their ability to accurately identify bacterial infections in a hospitalized rheumatoid arthritis population is largely unknown.

To address these methodological gaps, we sought to evaluate the accuracy of the International Classification of Diseases, Version 9, Clinical Modification (ICD-9) codes commonly used to identify infection outcomes in epidemiologic research, by evaluating a population of RA patients who was hospitalized. Additionally, we constructed medical records- based infection criteria for bacterial infections that could be used to validate the presence of infection when applied to abstracted medical information. Both the claims-based algorithms and the medical records- based infection criteria were validated against a standard of physician panel review of medical records for hospitalized RA patients.


Study population and infection case identification

After local institutional review board approval, we used the administrative claims data from the University of Alabama at Birmingham (UAB) health system to identify adults (age ≥ 18 years at the time of hospitalization) with one or more diagnostic codes for RA (ICD-9, 714.X in any position on the hospital discharge claim), who were hospitalized at our institution between January 2002 and December 2003. We compiled two sets of ICD-9 codes for infections (Appendix 1) based on expert consensus, 1) a “comprehensive” set that included a wide range of codes, with the goal of maximizing sensitivity; 2) a “restricted” set that included presumably more specific ICD-9 codes, as used by Schneeweiss and colleagues to validate infections in a Veterans Affairs (VA) hospital [11]. Both these lists were grouped by anatomical site. Because hospitals may code the principal diagnosis as the one that leads to the highest reimbursement rather than the etiologic event that prompted the hospitalization, we allowed these infection codes to be in any position on the billing claim. We abstracted medical records of the first hospitalization during the study period that had an ICD-9 code for any bacterial infection (Figure 1). To ascertain the sensitivity of the administrative data to identify bacterial infections, medical records of 50 RA patients without a discharge diagnosis of infection in any position on the claims were randomly selected and similarly studied. The primary discharge diagnoses on the claims for these patients ranged from codes for arthritis related hospitalizations to codes for other systemic conditions such as multiple sclerosis, myocardial infarctions, and surgical treatments. None of the primary discharge diagnoses codes suggested admissions for treatment of putative infections.

Figure 1
Selection of rheumatoid arthritis (RA) patient population for assessing diagnostic properties of ICD-9* codes and medical records-based infection criteria for serious bacterial infections.

Medical record abstraction and diagnostic criteria for bacterial infections

We developed medical records-based infection criteria that encompassed 16 groups of bacterial infections commonly treated in clinical practice. As part of this process, we conducted a comprehensive literature review and integrated clinical, laboratory, microbiological, and radiological criteria used to diagnose infections (Appendix 2). These medical records-based infection criteria were further refined in collaboration with infectious disease specialists (N.A., M.S., A.R.), a gastroenterologist (C.E.), and a radiologist (R.L.). We excluded those microbes from bacterial cultures that were likely “contaminants” and whenever possible, we required objective criteria (e.g. culture data) to fulfill the infection criteria in order to maximize specificity. A medical record abstraction form was developed to collect relevant details of all bacterial infections that comprised these infection criteria. It included (among numerous data elements) results from up to six bacterial cultures and also the name and duration of use of all antibiotic treatments. Our medical record abstraction form though very similar to that used by Schneeweiss and colleagues [11], additionally included intra-abdominal bacterial infections requiring hospitalization that occurred in the presence of cholecystitis, diverticulitis or gastroenteritis. However, we did not capture non-bacterial atypical or opportunistic infections, as was done by Schneeweiss and colleagues [11]. The medical record abstraction form was extensively pilot tested using medical records from RA patients hospitalized in our university facility.

Medical record review to confirm infections

All medical records with any ICD-9 code for bacterial infection(s) were reviewed by a team of three trained reviewers consisting of two physicians (N.M.P., G.G.T.) and one physician assistant (K.C.). Each medical record was independently abstracted by two of the three reviewers. Reviewers assessed the medical records for all categories of bacterial infection, not limited to just those pre-identified by the initial ICD-9 code(s). Based on their clinical judgment, the reviewers’ findings for each type of infection were assigned to three categories, “definite”, “empirically treated” or “no” bacterial infection(s). Anticipating some clinical uncertainty and an occasional paucity of information in medical records, “empirically treated” was listed by the reviewers if after reading the medical record, clear evidence for an infection was lacking, but the treating health care providers appeared to be managing a putative infection. Discordances in the reviewers’ assessment were adjudicated by a consensus of two physicians (K.G.S or J.R.C). These two physicians assigned the case status only among the range of diagnostic categories in discordance.

Statistical analysis

The reviewers’ assessment of certainty of the bacterial infections (“definite”, “empirically treated” or “no”) was used as the standard against which the ICD-9 codes and medical records-based infection criteria were compared to determine sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV). Inter-rater reliability of the standard was assessed using Cohen’s Kappa [12] as the measure of agreement for the certainty of the bacterial infections between the reviewers’ independent assessment of the medical records. Kappa values lower than 0.40 represent a poor agreement beyond chance, values between 0.40 and 0.75 as fair to good agreement beyond chance and Kappa values higher than 0.75 represent excellent agreement beyond chance. Since there may be circumstances where the high specificity of an infection is desired, one analysis considered only “definite” infections according to our gold standard definition as the outcome point. However, because the high specificity of this approach reduces sensitivity, we also grouped “definite” together with “empirically treated” infections in a separate analysis. Using these two separate standards, we calculated sensitivity, specificity, positive and negative predictive values of the infection criteria and the comprehensive and the restricted sets of ICD-9 codes for at least 1 infection of any type occurring during that hospitalization and organ specific infections (e.g. lung infections such as pneumonia). The predictive values vary with the prevalence of the disease as per the Bayes’ Theorem. For a known prevalence of the disease in a study population, the predictive values can be calculated using the sensitivity and specificity for the test [13]. The findings from the 50 patients without a discharge diagnosis of infection were extrapolated to the additional hospitalized RA patients without ICD-9 evidence of bacterial infections to determine the prevalence of infection in the cohort of 557 patients. The sensitivity and specificity of ICD-9 codes were used to calculate the predictive values of these codes for a range of assumed prevalence of these infections [13].


Of the total 557 RA patients observed in the study period, we abstracted 100% of the relevant records of 162 RA patients hospitalized for the first time with a purported bacterial infection (based on ICD-9 codes) and 50 RA admitted patients without claims for infection (Figure 1). The mean ± standard deviation (SD) age of the patients was 63 ± 14 years and 73% were women. Using claims data, a median of 1.0 bacterial infection was identified per patient per hospitalization; the range of the number of infections per hospitalization was 1 to 5 among 13 possible discharge codes. Only one of the 50 (2%) medical records without claims for infection that were reviewed identified a bacterial infection.

Assessment of infections, inter-rater reliability, and infection prevalence

Prior to adjudication, the inter-rater reliability of the reviewers’ assessment for the presence of any bacterial infection(s) was 0.85 (95% CI 0.74–0.97). Of persons hospitalized with a suspected infection, 41% (n = 87) had “definite” infection using both the restricted and comprehensive codes. In contrast, 64% (n = 135) and 62% (n = 132) had a “definite or empirically treated” infection with the comprehensive and the restrictive ICD-9 codes, respectively. Among all 557 RA patients hospitalized for any condition, the prevalence of “definite” and “definite or empirically treated” infection was 16% and 25%, respectively.

Diagnostic performance characteristics of the ICD-9 codes

The sensitivity of comprehensive ICD-9 codes was higher than that of the restricted set for both “definite”, (100% vs. 59%) and “definite or empirically treated” infections (99% vs. 48%) respectively. The specificities of the comprehensive set of codes as expected were lower than those of the restricted set of codes (Table 1).

Table 1
Diagnostic properties of comprehensive and restricted set of International Classification of Diseases, Version 9, clinical modification (ICD-9) codes* and medical records-based infection criteria for bacterial infection compared to the gold standard of ...

The PPV and NPV of the two sets of ICD-9 codes ranged from 54%–85% and 84% –100% respectively. The effect of varying the prevalence of infections on the PPVs of the comprehensive and the restricted sets of ICD-9 codes are shown in Figure 2. Across infectious disease prevalence rates, the PPVs of the more restricted set of ICD-9 codes to identify either “definite”, or “definite or empirically treated” infections compared to the PPVs of the comprehensive set of ICD-9 codes to identify definite or empirically treated infections were very similar and were consistently greater than 80% at a disease prevalence of 25% (“definite or empiric” infections). Thus these restricted codes demonstrated greater accuracy over using the comprehensive codes in identifying infections. The positive predictive value of the more comprehensive codes to identify only “definite” infections did not exceed 80% unless the expected disease prevalence was at least 40%.

Figure 2
Positive predictive value (%) of ICD-9* codes according to the prevalence of bacterial Infections, the categories of reviewers’ assessment for infection, and the groupings of diagnostic codes (based on extrapolation to full cohort ...

Diagnostic performance characteristics of the medical records- based infection criteria

The medical records-based infection criteria were intentionally constructed to favor specificity over sensitivity. The specificity of both “definite” and “definite or empirically treated” infections was very high at 94% and 91% respectively; the sensitivity was similarly low (48% and 41% respectively) (Table 1). The PPV of the infection criteria was 84% for “definite” infections and 89% for “definite or empirically treated” infections. The PPVs of the infection criteria across a range of infection prevalence rates is shown in Figure 3. Figure 3 also shows that bacterial infection detection can be improved by using the ICD-9 codes simultaneously with the medical records-based infection criteria. For example, at a 16% infectious disease prevalence, the PPV of the infection criteria to identify definite bacterial infections was just 60%. By first screening with ICD-9 codes to increase the prevalence of definite bacterial infections to 54%, the PPV of the infection criteria then increased to 90%. Similarly, for identifying “definite or empirically treated” infections, the PPV of these criteria was 60% at a 25% disease prevalence. Using the ICD-9 codes to prescreen potential cases, the disease prevalence increased to 83%, and the PPV was then very high (96%).

Figure 3
Positive Predictive Value (%) of medical records-based infection criteria according to the prevalence of bacterial Infections and the categories of reviewers’ assessment for infection*.

For the most common site-specific infections, the specificities for urinary tract infection, bacteremia, and device-associated medical record infection criteria were each 100% and the specificities of the other sites of infection were only slightly lower (Table 2). The other site-specific infections that we examined occurred less frequently and were therefore not reported separately. These included postoperative infections (n = 11), upper respiratory tract infections (n = 9), osteomyelitis (n = 8), meningitis (n = 7), gastroenteritis (n = 5), septic arthritis and intraabdominal abscesses (n = 3), diverticulitis (n = 2), endocarditis and cholecystitis (n = 1).

Table 2
Diagnostic properties of medical records-based infection criteria for site-specific bacterial infections* compared to a gold standard of reviewers’ assessment as “definite or empirically treated” infections.


Our study evaluated the diagnostic properties of ICD-9 codes to identify putative bacterial infections in hospitalized rheumatoid arthritis patients. We found that using ICD- 9 codes alone to identify bacterial infections in hospitalized rheumatoid arthritis patients may misclassify 15% to 46% of the infections, depending on the set of codes and the strength of the evidence desired to identify infections. We also developed diagnostic criteria for bacterial infections based on medical records abstraction, and showed that they had very high positive predictive values. A two-stage process where potential cases are identified using claims data and these medical records classified based on the infection criteria, result in a PPV of 96% and eliminate the need for physicians to review each medical record.

Complementary to our work, Schneeweiss and colleagues developed infection criteria and identified suspected infections among general medical patients at a Veterans Administration (VA) hospital using the restricted list of ICD-9 codes that we adopted for this study [11]. In their study, the PPV of the claims data to identify selected bacterial infections combined was similar (90%) to our findings (85%). However, compared to the comprehensive set of codes, this high PPV and its corresponding specificity come at the expense of lower sensitivity (48%). Factors that might account for the modest differences in our studies include inherent dissimilarity in the coding practices between a VA and a university hospital, and differences in the characteristics of general medical patients versus RA patients. In addition, since both these studies were focused on assessing validity of the infection codes neither studies separately assessed possible nosocomial infections. Distinguishing nosocomial from community-acquired infections would be important when assessing susceptibility to infections with use of particular therapeutic interventions for managing RA. Schneeweiss and colleagues selected their study population using only the primary discharge diagnoses codes identified in VA data, excluding nosocomial infections [11]. In contrast, as we had to overcome the possibility of financial incentives in coding for higher reimbursements, we included bacterial infection codes at any position of the discharge claims.

Given their higher sensitivity, a comprehensive set of administrative codes are better able to maximally identify putative bacterial infections. This is necessary when initially researching large administrative databases to identify any potential infections. A restricted set of codes, however, given their better specificity will decrease the number of falsely identified cases of infections. The resultant risk estimates vary with differing sensitivity and specificity. It is important to note though that even if sensitivity is low, high specificity will result in un-biased relative effect measures [14, 15]. In our past experience, we used a “more sensitive” method of applying the medical and pharmacy administrative claims codes from a health-care insurers’ database as a first step for identifying as many cases of presumed serious bacterial infections [6]. Once the plausible bacterial infection cases were identified, these cases where further evaluated by applying a “more specific” medical record criteria for bacterial infections. As the specificity of the infection criteria increased, fewer cases met the criteria for an infection (i.e. sensitivity decreased and the adjusted hazard ratio for bacterial infection associated with TNFα antagonist increased).

To our knowledge, only few other studies have assessed the diagnostic accuracy of administrative data alone to identify patients with suspected bacterial infections. One study compared 5 different claims- based algorithms to a standard of clinically diagnosed pneumonia. The prevalence of pneumonia in that study was 2.5%, and the PPVs of the claims algorithms ranged from 73% to 81% compared to ours of 89% [16]. In another study using data from the General Practice Research Database, 62% of pneumococcal pneumonia administrative codes were confirmed using medical record review [17]. In both these studies the patients were healthier general medical populations in contrast to our RA patients that are commonly on immunosuppressant medications. Despite these differences in patient populations, the results of our study are similar, suggesting that ICD-9 codes are capable of identifying pneumonia accurately.

Our newly developed medical records-based infection criteria will be a particularly valuable resource when uniform classification criteria are needed. Examples of settings in which this may be particularly useful include multi-site trials where infectious adverse events are classified subjectively by individual site investigators or open label studies where investigators are not blinded to drug exposure status. They also may be useful in retrospective epidemiologic studies where abstractors can collect data and classify infections according to these validated medical records-based infection criteria without requiring case-by-case determinations from a physician.

Some bacterial infections have objective, pathognomonic laboratory findings and are therefore relatively simple to classify. For example, the diagnosis of bacteremia required presence of a positive blood culture, and thus the specificity of its infection criteria was 100%. Classification of some other infections however, was more challenging. For example, cellulitis, a predominantly clinical diagnosis, was defined mainly based on history and physical examination findings. These were sometimes inadequately documented in the medical records, and supporting microbiologic evidence for cellulitis is typically scant and not useful. Thus, the specificity of the cellulitis criteria was only 70%. In comparison, diagnosis of lower respiratory tract infections (mainly pneumonia), relied both on objective (laboratory & culture) and more subjective (i.e. clinical) evidence, and the infection criteria demonstrated an intermediate specificity of 82%.

As is true for any diagnostic test, higher specificity comes at the expense of lower sensitivity. This was made especially clear by the criteria for urinary tract infection (UTI) which had 100% specificity but a sensitivity of only 5%. The likely explanation for this very low sensitivity was the requirement for at least 10,000 colonies of an organism pathologic to the genitourinary tract, or for lesser colony counts, antibiotic administration of at least 7 days. Many of the suspected UTIs we found were treated on the basis of an abnormal urinalysis and no positive culture results were ever documented (even after hospital discharge).

Varying approaches have been used to diagnose bacterial infections in observational studies. Infections have been defined by using a combination of patient self-report, hospital records, physician reports, mortality records, antibiotic prescriptions, or by the opinion of treating physicians [5, 6, 11, 1820]. A few of these studies developed operational criteria to identify their outcomes [2, 11, 19, 20]. For example, Doran and colleagues required the presence of specific symptoms and laboratory values to define any infectious adverse events in RA patients in a retrospective longitudinal cohort study [2]. Leveille and colleagues [19] compared antibiotic prescription fills in automated pharmacy records with medical record review as the standard for infections. Although the face validity of these approaches is reasonable, these approaches were not rigorously evaluated and validated, as we did in this study, nor have they been widely adopted by subsequent investigators.

The major strengths of our study are its sample size and the full access we had to all the information in the medical records, including culture results that became positive even after patient discharge. All medical records were independently abstracted by two healthcare providers who had complete access to all the desired medical records and had high agreement on the classification of infections. Additionally, we studied RA patients who may experience unique patterns of infections compared to general medical patients.

Despite its strengths, our results must be interpreted in the context of our study design. Since this project was undertaken in one university health system, the results may not be generalizable to some other health care settings where medical record documentation or ICD-9 coding practices differ. We were unable to assess the medical records of all patients without an ICD-9 code for infection, hence verification bias might exist [21, 22], which might increase the apparent sensitivity and decrease the apparent specificity of the ICD-9 codes. Based though on an expectation that claims data may have high specificity [23], and the observation of only one infection (2%) from those medical records without an ICD-9 code for infection that were reviewed, this bias is likely lessened. Additionally, the medical record infection criteria were intentionally designed to favor specificity at the expense of sensitivity; thus, they under-ascertained infections that did not have objective diagnostic details in the medical records. For some particular sites of bacterial infections (e.g. meningitis), the low prevalence of these infections restricted drawing conclusions about the diagnostic accuracy of these groups of infections. Finally, our administrative data examined only single ICD-9 codes; more complex claims-based algorithms may be able to achieve higher specificities and PPVs.

In summary, the use of ICD-9 diagnosis codes alone may mis-classify bacterial infections in hospitalized RA populations, although the level of misclassification varies depending on the codes used. To improve accuracy in identifying infections by the administrative claims codes alone, a more restricted set of codes with higher specificity will be more efficient. Our novel, validated, medical records-based infection criteria for a broad range of serious bacterial infections, may limit the need for physicians’ manual review of medical records. These criteria may have usefulness both in clinical trials and observational study populations, either as the primary outcome or as part of a sensitivity analysis.


We thank Drs. Nenad Avramovski and Ari Robicsek M.D. for guiding in constructing the medical records-based infection criteria, Dr. Robert Lopez M.D. for guiding in interpreting the radiological findings, Dr. Charles Elson M.D. for his expertise in gastroenterology, Ms. Karen Connor, physician assistant who helped in abstracting medical records, Mr. Bart Prevallet MBA, for creating the data abstraction instrument, and Mr. Jorge Nunez for helping with the data entry.

Supported by the Engalitcheff Arthritis Outcomes Initiative, Maryland Chapter, Arthritis Foundation grant HS10389 from the Agency for Healthcare Research and Quality, from grant award 5K24AR052361-03,1-K23-AR053351-01-A1,PhRMA Foundation, Research Starter Grant in Health Outcomes

Appendix 1

International Classification of Diseases, Version 9, Clinical Modification codes for Serious Bacterial Infections

Discharge DiagnosisSensitive setSpecific set
320.X X320.XX
Pyelonephritis/Urinary Tract Infection590.XX590.X
Septic Arthritis003.23003.23
Upper Respiratory Tract Infection34
382. X
Abdominal Abscess95.2
Brain Abscess324.X
Prostate Infections98.32
Infectious Conjunctivitis372.0X
Device Associated Infections996.6X
Local Infections of skin and subcutaneous Tissue686.1
Retropharyngeal Abscess478.21
Breast Abscess611.0
Splenic Abscess289.5
Pyogenic Granuloma686.1
Post Traumatic Wound Infection958.3
Postoperative Wound Infection998.5
Infective Myositis40.81
Necrotizing Fascitis728.86

Appendix 2. Medical Records-Based Infection Criteria for Serious Bacterial Infections

  1. Infection Criteria for Septicemia (13)
    1. If at least one of the following is present:
      1. Patient meets criteria for another infection using criteria in the abstraction tool
      2. Patient meets criteria for bacteremia
    2. At least one of:
      1. History of fever or documented fever >38.0 °C/100.4 °F
      2. Hypothermia (Temperature <36.0 °C/96.8 °F)
      3. Tachycardia (Heart rate >90/min)
      4. Tachypnea (Respiratory rate >20/min)
      5. Diminished level of consciousness, confusion or delirium
      6. Blood glucose >120mg/dl
    3. At least one of:
      1. Hypotension (Systolic BP< 90mmHg) or decrease of SBP > 40mmHg from the baseline or mean arterial blood pressure > 40 mmHg from baseline( i.e. patient’s otherwise “normal” blood pressure)
      2. Administration of inotropic/vasopressor therapy (dopamine, vasopressin, norepinephrine, epinephrine, amrinone)
    4. At least one of:
      1. WBC >12,000cells/mm3
      2. WBC< 4000cells/mm3
      3. Normal WBC with >10% Bands or immature forms
        At least one of:
      4. Mechanical ventilation
      5. Oliguria (low urine output < 30 ml/hour)
      6. Increase in serum creatinine increase >0.5mg/dl within 48 hours of a previous report
      7. Thrombocytopenia <100,000 platelets/microL
  2. Infection Criteria for Bacteremia
    1. Any one of:
      1. At least one positive peripheral blood culture for any Gram negative organism
      2. At least one positive peripheral blood culture for any Gram positive organisms except for coagulase negative Staphylococcus, Bacillus species., Corynebacterium species., Propionibacterium species., Micrococcus
      3. Two or more positive consecutive peripheral blood cultures for coagulase negative Staphylococcus, Bacillus species., Corynebacterium species., Propionibacterium species., Micrococcus AND Patient treated for at least seven days with antibiotics for putative bacteremia
  3. Infection Criteria for Devise associated infections (49)
    Any one of
    1. Erythema/Redness in area surrounding location of the device
    2. Edema/Swelling in area surrounding location of the device
    3. Presence of pus/purulent discharge in area surrounding location of the device
    Patient meets criteria for bacteremia or septicemia
  4. Infection Criteria for Post-operative/Peri-operative infection
    If surgery or procedure is performed at least thirty days prior to infection
    If patient meets criteria for any other infection using any other listed pre-defined criteria in this appendix, OR Patient meets criteria for bacteremia.
  5. Infection Criteria for Intraabdominal Abscess/intra-abdominal infection/intra-peritoneal infection/peritonitis/Liver abscess (1013)
    If positive aspirate cultures* for the polymicrobial+ infection, e.g. enteric gram negative rods, enterococci, bacteroids fragilis, streptococcus milleri, staphylococcus aureus, klebsiella pneumoniae
    Any one of:
    1. Fever >101.0°F
    2. Chills
    3. Weight loss
    4. Weakness/malaise
    5. Abdominal pain/tenderness
    6. Elevated alkaline phosphatase ( > upper limit of laboratory normal)
    7. Leukocytocis/White Blood Cells ((WBC) > 12,000/cubic mm
    If radiographic findings on the computed tomography or ultrasonography of the abdomen are consistent with liver abscess.
  6. Infection Criteria for Cellulitis
    1. If both:
      1. Acute skin erythema (redness) or tenderness for < 14 days
      2. Treatment with Antibiotics for ≥ 7 days
    2. Any one of:
      1. History of fever or documented fever >38.0 °C/100.4 °F
      2. Leukocytosis/White blood cells (WBC) > 12,000/cubic mm
      3. Positive blood cultures* for typical pathogens (Streptococci, Staph Aureus, Clostridia…)
  7. Infection Criteria for Cholecystitis/Cholangitis (1417)
    1. If visible pus draining from the papilla
    2. Any one of:
      1. History of fever or documented fever (temperature > 38.0 °C/100.4 °F)
      2. Right upper quadrant pain
      3. Jaundice
      4. Leukocytosis/white blood cells (WBC) > 10,000/cubic mm
      5. Elevated alkaline phosphatase (> upper limit of laboratory normal)
      6. Elevated amylase (> upper limit of laboratory normal)
      7. Ultrasonographic Murphy’s sign (right upper quadrant tenderness)
    3. Any one of:
      1. Ultrasonography (US) of the abdomen consistent with cholecystitis
      2. Endoscopic retrograde cholangiopancreatography (ERCP) consistent with cholangitis
      3. Magnetic resonance cholangiopancreatography (MRCP) consistent with cholangitis
      4. Hydroxyl iminodiacetic acid (HIDA) scan consistent with cholecystitis
    4. Any one of:
      1. Positive gram stains from cholecystectomy specimens AND Patient treated for at least 7 days with antibiotics
      2. Positive Cultures for the infectious process from cholecystectomy specimens
    5. If histopathology findings consistent with “cholecystitis”
  8. Infection Criteria for Diverticulitis (1820)
    1. Any one of:
      1. Current lower abdominal pain
      2. Nausea/vomiting/emesis
      3. Palpable tender mass in abdomen
      4. Leukocytosis/white blood cells > 12,000/cubic mm
    2. If history of the previous episodes of lower abdominal pain/History of previous diagnosis of diverticulitis
    3. Any one of:
      1. CT scan showing “consistent with diverticulitis”
      2. CT scan showing increased soft tissue density within pericolic fat
      3. CT scan showing colonic diverticula’s
      4. CT scan showing bowel wall thickening
      1. If history of the previous episodes of lower abdominal pain/History of previous diagnosis of diverticulitis
    4. Any one of:
      • e) CT scan showing “consistent with diverticulitis”
      • f) CT scan showing increased soft tissue density within pericolic fat
      • g) CT scan showing colonic diverticula’s
      • h) CT scan showing bowel wall thickening
  9. Infection Criteria for Meningitis (21, 22)
    If any one of:
    1. CSF cultures growing bacterial pathogens without recent history* of any surgery involving the brain or spinal cord or head injury. Coag. Neg. Staph, Diphteroids, Propionibacteria, and Bacillus spp. are excluded.
    2. any positive CSF culture in the setting of recent brain or spinal cord surgery (e.g. neurosurgery, ENT surgery) or history of head trauma
    3. CSF Serology+ positive for Syphilis
    At least any two of:
    1. History of: Headaches, nausea, emesis, photophobia, neck stiffness, altered mental status
    2. Presence of clinical signs: petechial rash, rigid neck, fever >38.0 °C/100.4 °F
    3. Patients who were treated for meningitis with at least 7 days of IV Abx
    Any one of:
    1. CSF WBC >5cells/mm3
    2. CSF Glucose < 40 mg/dl
    3. CSF/Glucose ratio of ≤ 0.4
    4. CSF Protein > 45 mg/dl
  10. Infection Criteria for Osteomyelitis (2328)
    If any one of:
    1. Culture positive* bone biopsy
    2. Positive gram stain of the bone biopsy
    3. Histopathology findings consistent with osteomyelitis
    At least any two of:
    1. History of fever or documented fever >38.0 ° C/100.4 ° F
    2. Bone pain or/and tenderness
    3. Positive probing of the wound to the bone
    4. Draining sinus over the affected area
    5. Elevated ESR >100mm/hr
    6. Diabetic foot ulceration larger then 2cm in diameter
    Any one of:
    1. X- ray with specific findings c/w osteomyelitis
    2. CT findings consistent with osteomyelitis
    3. MRI findings consistent with osteomyelitis
    4. Bone scan consistent with osteomyelitis
  11. Infection Criteria for Septic Arthritis/Septic Bursitis (29):
    If any one of:
    1. Acutely swollen joint
    2. Acute pain and/tenderness in the affected joint
    If Leukocytosis/white blood cells (WBC)> 100,000cells/mm3 and polymorphonuclear cells >75%
    If any one of*:
    1. Positive Gram Stain of the synovial fluid.
    2. Positive culture of the synovial fluid
  12. Infection Criteria for Renal Abscess/Pyelonephritis
    1. At least any two of:
      1. History of fever or documented fever >38.0 °C/104.0 °F
      2. Dysuric complaints
      3. Flank pain/costovertebral angle tenderness
      4. Leukocytosis/white blood cells (WBC) > 12,000/cubic mm
      5. Abnormal urine (cloudy, frank pus or blood in urine, foul smell)
    2. Any one of:
      1. Computed Tomography (CT), Magnetic Resonance Imaging (MRI) or Ultrasonography (US) findings consistent with renal inflammation
      2. Computed Tomography (CT), Magnetic Resonance Imaging (MRI) or Ultrasonography (US) findings consistent with renal abscess
      3. Computed Tomography (CT), Magnetic Resonance Imaging (MRI) or Ultrasonography (US) findings consistent with hydronephrosis
    3. Any one of:
      1. Blood cultures and urine cultures positive for the same organism
      2. Blood cultures positive for the GNR, Enterococci or S. Saphrophyticus
      3. Urine culture positive for the >105 GNR, Enterococci or S. Saphrophyticus
      4. Urine culture positive for < 105 any organism AND Patient treated for ≥ 7 days with antibiotics
  13. Infection Criteria for Pneumonia
    1. Radiology- If radiological or historical evidence during current hospitalization consistent with pneumonia
    2. Organism- Any one of*:
      1. Sputum/Expectoration/bronchial secretions/endotracheal tube secretions/bronchoalveolar lavage (BAL) culture* report (source labeled as sputum or expectoration or bronchial secretions or endotracheal tube secretions or bronchioalveolar lavage/BAL) are Positive EXCEPT Staphylococcus epidermidis and Diphtheroids
        1. Positive Sputum culture (source labeled as sputum or expectoration or bronchial secretions or endotracheal tube secretions or bronchioalveolar lavage/BAL) for S. Pneumoniae,
        2. Positive Sputum culture (source labeled as sputum or expectoration or bronchial secretions or endotracheal tube secretions or bronchioalveolar lavage/BAL) for H. Influenzae,
        3. Positive Sputum culture (source labeled as sputum or expectoration or bronchial secretions or endotracheal tube secretions or bronchioalveolar lavage/BAL) for M. Catarrhalis,
        4. Positive Sputum culture (source labeled as sputum or expectoration or bronchial secretions or endotracheal tube secretions or bronchioalveolar lavage/BAL) for B. Pertussis
        5. Positive Sputum culture (source labeled as sputum or expectoration or bronchial secretions or endotracheal tube secretions or bronchioalveolar lavage/BAL) for Legionella spp.
        1. Positive Serum IgM antibodies for Mycoplasma Pneumoniae
        2. Positive Serum IgM antibodies for Chlamydia Pneumoniae
        3. Positive Serum IgM antibodies for Legionella Pneumophila
      2. Positive Urine Antigen test for Legionella
      3. Positive PCR for Mycoplasma Pneumoniae or Legionella Pneumophil
    3. Symptoms- Any one of:
      1. New or worsened cough
      2. New sputum production
      3. Shortness of breath
      4. Pleurisy
    4. Examination- Any one of:
      1. History of fever or documented fever >38.0 °C/100.4 °F
      2. Findings on auscultation of crackles or rales or egophony, or whispered pectoriloquy
      3. Findings of dullness to percussion
    5. White Blood Count- Any one of:
      1. White blood cell count (WBC) > 11.0 × 109/L
      2. White blood cell count (WBC) < 3.0 × 109/L
  14. Infection Criteria for Lung Abscess/Empyema
    1. Any one of:
      1. Pleural fluid culture Positive for gram negative organisms EXCEPT S. Epidermidis, Bacillus, Propionibacterium, corynbacterium, Micrococcus
      2. Pleural fluid culture Positive for gram positive organisms EXCEPT S. Epidermidis, Bacillus, Propionibacterium, corynbacterium, Micrococcus
    2. Any one of:
      1. Concurrent pneumonia
      2. History of fever or documented fever >38.0 °C/104.0 °F
      3. Chills
      4. Night sweat
    3. Any one of:
      1. CT scan report findings consistent with lung abscess
      2. CT scan report findings consistent with presence of pus in the pleural cavity
        At least any three of:
      3. Purulent fluid or Pus
      4. pH of pleural fluid/empyema <7.29
      5. Pleural fluid white blood cell count > 1000 cells/cubic mm
      6. Pleural fluid/empyema glucose <40 mg/dl
      7. Pleural fluid/empyema LDH >1000 IU/l
  15. Infection Criteria for Acute Bacterial Sinusitis (3032)
    If sinus culture of 105 or more of organisms/ml of likely respiratory pathogen (e.g. S. Pneumonia, H. Influenzae, S. Aureus, Brahmela Catharallis,..)
    If at least two of:
    1. Purulent nasopharyngeal discharge
    2. Maxillary toothache (dental pain)
    3. Poor response to decongestants
    4. 3 of: anosmia or hyposmia, ear fullness, cough, fatigue
    5. History of fever or documented fever >38.0 °C/100.4 °F
    AND If abnormal sinus imaging showing sinus opacification or air-fluid levels on sinus X-rays or CT scan.
  16. Infection Criteria for Gastroenteritis (3335):
    1. If any one of:
      1. Abdominal pain
      2. Dehydration
      3. Diarrhea
      4. Nausea
      5. Vomiting/Emesis
      6. Treated with ≥ 7 days of antibiotics
    2. AND If any one of:
      1. ≥ 1 stool culture positive for bacteria
      2. ≥ 1 blood culture positive for bacteria
      3. ≥ 1 stool gram stain positive for leukocytes AND RBCs
  17. Infection Criteria for Endocarditis (36)
    1. Major Criteria
      1. Positive 2 separate Blood Culture for typical organisms: Viridans Streptococci, S. Bovis, HACEK group or Community-acquired S. Aureus or Enterococci w/o other obvious focus or Persistently positive blood culture for any microorganism from the blood cultures drawn 12 hours apart
      2. All of 3, or 3 of 4 or more positive blood cultures with first and last set being drawn at least 1 hour apart.
      3. Endovascular involvement
        1. ECHO findings positive for IE such as vegetation on the valve, vegetation in the path of the regurgitant blood flow jets, on iatrogenic device, paravalvular abscess,
        2. New dehiscence of the prosthetic valve
      4. New valve regurgitation murmur (changes in the old murmur are not sufficient)
    2. Minor Criteria
      1. Predisposing heart condition or IVDU
      2. Fever > 38°C/100.4°F)
      3. Vascular phenomena: arterial embolism, septic pulmonary infarcts, mycotic aneurysm, secondary intracranial hemorrhage, Janeway lesions
      4. Immunologic phenomena: GN, Osler’s nodes, Roth spots
      5. ECHO findings c/w IE but not meeting major criteria
      6. Microbiologic criteria not meeting major criteria or serologic evidence of infection with organism c/w IE (Brucella, Bartonella, Coxiella Burnetti…)
    Infection Criteria for Infective Endocarditis:
    At least any 2 of Major criteria OR at least 1 of Major criteria AND at least 3 of Minor criteria
1. Systemic inflammatory response syndrome (SIRS) definition and diagnosis. UpToDate website [PubMed]
2. Levy MM, Fink MP, Marshall JC, et al. 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Crit Care Med. 2003;31(4):1250–6. [PubMed]
3. Levy MM, Fink MP, Marshall JC, et al. 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Intensive Care Med. 2003;29(4):530–8. [PubMed]
4. Bryant JK, Strand CL. Reliability of blood cultures collected from intravascular catheter versus venipuncture. Am J Clin Pathol. 1987;88(1):113–6. [PubMed]
5. DesJardin JA, Falagas ME, Ruthazer R, et al. Clinical utility of blood cultures drawn from indwelling central venous catheters in hospitalized patients with cancer. Ann Intern Med. 1999;131(9):641–7. [PubMed]
6. Everts RJ, Vinson EN, Adholla PO, Reller LB. Contamination of catheter-drawn blood cultures. J Clin Microbiol. 2001;39(9):3393–4. [PMC free article] [PubMed]
7. Maki DG. The prevention and management of device-related infection in infusion therapy. J Med. 1980;11(4):239–53. [PubMed]
8. Maki DG, Weise CE, Sarafin HW. A semiquantitative culture method for identifying intravenous-catheter-related infection. N Engl J Med. 1977;296(23):1305–9. [PubMed]
9. O’Grady NP, Alexander M, Dellinger EP, et al. Guidelines for the prevention of intravascular catheter-related infections. Centers for Disease Control and Prevention. MMWR Recomm Rep. 2002;51(RR10):1–29. [PubMed]
10. Gastrointestinal Infections: Diagnosis and Management. New York: Marcel Dekker; 1997. p. 397.
11. Huang CJ, Pitt HA, Lipsett PA, et al. Pyogenic hepatic abscess. Changing trends over 42 years. Ann Surg. 1996;223(5):600–7. discussion 607–9. [PubMed]
12. Rubin RH, Swartz MN, Malt R. Hepatic abscess: changes in clinical, bacteriologic and therapeutic aspects. Am J Med. 1974;57(4):601–10. [PubMed]
13. Wang JH, Liu YC, Lee SS, et al. Primary liver abscess due to Klebsiella pneumoniae in Taiwan. Clin Infect Dis. 1998;26(6):1434–8. [PubMed]
14. Chan YL, Chan AC, Lam WW, et al. Choledocholithiasis: comparison of MR cholangiography and endoscopic retrograde cholangiography. Radiology. 1996;200(1):85–9. [PubMed]
15. Lee MG, Lee HJ, Kim MH, et al. Extrahepatic biliary diseases: 3D MR cholangiopancreatography compared with endoscopic retrograde cholangiopancreatography. Radiology. 1997;202(3):663–9. [PubMed]
16. Saik RP, Greenburg AG, Farris JM, Peskin GW. Spectrum of cholangitis. Am J Surg. 1975;130(2):143–50. [PubMed]
17. Sinanan MN. Acute cholangitis. Infect Dis Clin North Am. 1992;6(3):571–99. [PubMed]
18. Fischer MG, Farkas AM. Diverticulitis of the cecum and ascending colon. Dis Colon Rectum. 1984;27(7):454–8. [PubMed]
19. Konvolinka CW. Acute diverticulitis under age forty. Am J Surg. 1994;167(6):562–5. [PubMed]
20. Rao PM, Rhea JT, Novelline RA, et al. Helical CT with only colonic contrast material for diagnosing diverticulitis: prospective evaluation of 150 patients. AJR Am J Roentgenol. 1998;170(6):1445–9. [PubMed]
21. Attia J, Hatala R, Cook DJ, Wong JG. The rational clinical examination. Does this adult patient have acute meningitis? Jama. 1999;282(2):175–81. [PubMed]
22. Leib SL, Boscacci R, Gratzl O, Zimmerli W. Predictive value of cerebrospinal fluid (CSF) lactate level versus CSF/blood glucose ratio for the diagnosis of bacterial meningitis following neurosurgery. Clin Infect Dis. 1999;29(1):69–74. [PubMed]
23. Gold RH, Hawkins RA, Katz RD. Bacterial osteomyelitis: findings on plain radiography, CT, MR, and scintigraphy. AJR Am J Roentgenol. 1991;157(2):365–70. [PubMed]
24. Grayson ML, Gibbons GW, Balogh K, Levin E, Karchmer AW. Probing to bone in infected pedal ulcers. A clinical sign of underlying osteomyelitis in diabetic patients. Jama. 1995;273(9):721–3. [PubMed]
25. Mackowiak PA, Jones SR, Smith JW. Diagnostic value of sinus-tract cultures in chronic osteomyelitis. Jama. 1978;239(26):2772–5. [PubMed]
26. Perry CR, Pearson RL, Miller GA. Accuracy of cultures of material from swabbing of the superficial aspect of the wound and needle biopsy in the preoperative assessment of osteomyelitis. J Bone Joint Surg Am. 1991;73(5):745–9. [PubMed]
27. Perry M. Erythrocyte sedimentation rate and C reactive protein in the assessment of suspected bone infection--are they reliable indices? J R Coll Surg Edinb. 1996;41(2):116–8. [PubMed]
28. Waldvogel FA, Medoff G, Swartz MN. Osteomyelitis: a review of clinical features, therapeutic considerations and unusual aspects. N Engl J Med. 1970;282(4):198–206. [PubMed]
29. Shmerling RH, Delbanco TL, Tosteson AN, Trentham DE. Synovial fluid tests. What should be ordered? Jama. 1990;264(8):1009–14. [PubMed]
30. Hansen JG, Schmidt H, Rosborg J, Lund E. Predicting acute maxillary sinusitis in a general practice population. Bmj. 1995;311(6999):233–6. [PMC free article] [PubMed]
31. Low DE, Desrosiers M, McSherry J, et al. A practical guide for the diagnosis and treatment of acute sinusitis. Cmaj. 1997;156 (Suppl 6):S1–14. [PubMed]
32. Snow V, Lascher S, Mottur-Pilson C. Evidence base for management of acute exacerbations of chronic obstructive pulmonary disease. Ann Intern Med. 2001;134(7):595–9. [PubMed]
33. Barbut F, Leluan P, Antoniotti G, Collignon A, Sedallian A, Petit JC. Value of routine stool cultures in hospitalized patients with diarrhea. Eur J Clin Microbiol Infect Dis. 1995;14(4):346–9. [PubMed]
34. Slutsker L, Ries AA, Greene KD, Wells JG, Hutwagner L, Griffin PM. Escherichia coli O157:H7 diarrhea in the United States: clinical and epidemiologic features. Ann Intern Med. 1997;126(7):505–13. [PubMed]
35. Talan D, Moran GJ, Newdow M, et al. Etiology of bloody diarrhea among patients presenting to United States emergency departments: prevalence of Escherichia coli O157:H7 and other enteropathogens. Clin Infect Dis. 2001;32(4):573–80. [PubMed]
36. Durack DT, Lukes AS, Bright DK. New criteria for diagnosis of infective endocarditis: utilization of specific echocardiographic findings. Duke Endocarditis Service. Am J Med. 1994;96(3):200–9. [PubMed]


*this is not an exhaustive list, any organism irrespective of colony count

+Polymicrobial infection = any number of organisms

*Any number of organisms irrespective of the colony count

*Recent history = 4 to 6 weeks prior to meningitis

+“positive” CSF serology for syphilic meningitis = CSF VDRL or RPR or FTA any one positive

*= presence of any organism irrespective of colony counts

*presence of any organism irrespective of colony counts

*IGNORE any gram stain report

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.


1. Baum J. Infection in rheumatoid arthritis. Arthritis Rheum. 1971;14(1):135–7. [PubMed]
2. Doran MF, Crowson CS, Pond GR, O’Fallon WM, Gabriel SE. Frequency of infection in patients with rheumatoid arthritis compared with controls: a population-based study. Arthritis Rheum. 2002;46(9):2287–93. [PubMed]
3. Hamilton CD. Infectious complications of treatment with biologic agents. Curr Opin Rheumatol. 2004;16(4):393–8. [PubMed]
4. Keane J, Gershon S, Wise RP, Mirabile-Levens E, Kasznica J, Schwieterman WD, Siegel JN, Braun MM. Tuberculosis associated with infliximab, a tumor necrosis factor alpha-neutralizing agent. New Engl J Med. 2001;345(15):1098–104. [PubMed]
5. Listing J, Strangfeld A, Kary S, Rau R, von Hinueber U, Stoyanova-Scholz M, Gromnica-Ihle E, Antoni C, Herzer P, Kekow J, Schneider M, Zink A. Infections in patients with rheumatoid arthritis treated with biologic agents. Arthritis Rheum. 2005;52(11):3403–12. [PubMed]
6. Curtis JR, Patkar N, Xie A, Martin C, Allison JJ, Saag M, Shatin D, Saag KG. Risk of serious bacterial infections among rheumatoid arthritis patients exposed to tumor necrosis factor alpha antagonists. Arthritis Rheum. 2007;56(4):1125–33. [PubMed]
7. Durack DT, Lukes AS, Bright DK. New criteria for diagnosis of infective endocarditis: utilization of specific echocardiographic findings. Duke Endocarditis Service. Am J Med. 1994;96(3):200–9. [PubMed]
8. Birman-Deych E, Waterman AD, Yan Y, Nilasena DS, Radford MJ, Gage BF. Accuracy of ICD-9-CM codes for identifying cardiovascular and stroke risk factors. Med Care. 2005;43(5):480–5. [PubMed]
9. Geraci JM, Ashton CM, Kuykendall DH, Johnson ML, Wu L. International Classification of Diseases, 9th Revision, Clinical Modification codes in discharge abstracts are poor measures of complication occurrence in medical inpatients. Med Care. 1997;35(6):589–602. [PubMed]
10. Kiyota Y, Schneeweiss S, Glynn RJ, Cannuscio CC, Avorn J, Solomon DH. Accuracy of Medicare claims-based diagnosis of acute myocardial infarction: estimating positive predictive value on the basis of review of hospital records. Am Heart J. 2004;148(1):99–104. [PubMed]
11. Schneeweiss S, Robicsek A, Scranton R, Zuckerman D, Solomon DH. Veteran’s affairs hospital discharge databases coded serious bacterial infections accurately. J Clin Epidemiol. 2007;60(4):397–409. [PubMed]
12. Cohen J. A coefficient of agreement for nominal scale. Educ Psychol Meas. 1960;20:37–46.
13. Woolson RF. Statistical Methods for the Analysis of Biomedical Data. New York: John Wiley & Sons; 1987.
14. Kelsey JL, Thompson WD, Evans AS. Methods in Observational Epidemiology. New York: Oxford University Press; 1986.
15. Schneeweiss S, Avorn J. A review of uses of health care utilization databases for epidemiologic research on therapeutics. J Clin Epidemiol. 2005;58(4):323–37. [PubMed]
16. Aronsky D, Haug PJ, Lagor C, Dean NC. Accuracy of administrative data for identifying patients with pneumonia. Am J Med Qual. 2005;20(6):319–28. [PubMed]
17. Metlay JP, Kinman JL. Failure to validate pneumococcal pneumonia diagnoses in the General Practice Research Database. Pharmacoepidemiol Drug Saf. 2003;12:S163–4.
18. Wolfe F, Caplan L, Michaud K. Treatment for rheumatoid arthritis and the risk of hospitalization for pneumonia: associations with prednisone, disease-modifying antirheumatic drugs, and anti-tumor necrosis factor therapy. Arthritis Rheum. 2006;54(2):628–34. [PubMed]
19. Leveille SG, Gray S, Black DJ, LaCroix AZ, Ferrucci L, Volpato S, Guralnik JM. A new method for identifying antibiotic-treated infections using automated pharmacy records. J Clin Epidemiol. 2000;53(10):1069–75. [PubMed]
20. Schneeweiss S, Setoguchi S, Weinblatt ME, Katz J, Avorn J, Sax PE, Levin R, Solomon DH. Anti-tumor necrosis factor alpha therapy and the risk of serious baterial infections in elderly patients with rheumatoid arthritis. Arthritis Rheum. 2007;56(6):1754–64. [PubMed]
21. Begg CB, Greenes RA. Assessment of diagnostic tests when disease verification is subject to selection bias. Biometrics. 1983;39(1):207–15. [PubMed]
22. Punglia RS, D’Amico AV, Catalona WJ, Roehl KA, Kuntz KM. Effect of verification bias on screening for prostate cancer by measurement of prostate-specific antigen. N Engl J Med. 2003;349(4):335–42. [PubMed]
23. Romano PS, Mark DH. Bias in the coding of hospital discharge data and its implications for quality assessment. Med Care. 1994;32(1):81–90. [PubMed]