PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of hhspaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Int J Tuberc Lung Dis. Author manuscript; available in PMC 2017 May 1.
Published in final edited form as:
PMCID: PMC4960979
NIHMSID: NIHMS802484

Media matters: Modeling the impact of solid media performance on tuberculosis trial sample size requirements

SUMMARY

Setting

Two-month solid media culture conversion is a commonly used (if suboptimal) endpoint for phase 2 tuberculosis treatment trials.

Objective and Design

To model the effect of solid media performance characteristics (sensitivity and contamination rate) on required sample size for a two-arm clinical trial with 85% true (gold standard) culture conversion in the control and 95% in the experimental arm.

Results

Increasing sensitivity and decreasing contamination reduced sample size from 239 subjects/arm (60% sensitivity, 30% contamination) to 138 subjects/arm (95% sensitivity, 1% contamination).

Conclusion

Optimizing solid medium has significant potential to reduce sample size and increase tuberculosis clinical trial efficiency.

Keywords: Mycobacterium tuberculosis, clinical trials, mathematical modeling, microbiology

Reliable growth of Mycobacterium tuberculosis (Mtb) on solid media is an important bacteriological endpoint for phase 2 clinical tuberculosis (TB) trials.1,2 While growth in liquid media is faster than solid media and allows for automated growth detection, it does not allow for examination of colony morphology or isolation of mixed cultures.35 Thus utilization of solid media (i.e., Löwenstein-Jensen (LJ), Middlebrook) is an essential diagnostic tool for clinical TB trials. But solid media performance, notably culture sensitivity and contamination rate, varies.1,2,46

Egg-based LJ medium is used more frequently because it does not require CO2 incubation and is less expensive to prepare in local laboratories.2 Middlebrook medium was designed to recover more fastidious Mtb strains and detect Mtb growth quicker; it is agar-based and requires a variety of supplements including oleic acid, albumin, dextrose, and catalase which add to the cost of the medium.2 LJ has historically been used as the solid medium of choice for clinical trials, but a recent prospective cohort study comparing five different solid media demonstrated that selective Middlebrook medium was a more reliable standard with lower rates of contamination than LJ medium.1,2,4 Limited additional data exist on which solid medium has better performance characteristics.

Although consensus may not exist regarding optimal solid medium selection, performance characteristics of solid media have important implications on the efficiency of conducting clinical TB trials and the reproducibility of results. Therefore, we developed a mathematical model to examine the influence of solid medium characteristics on the sample size required for a phase 2 clinical trial.

STUDY POPULATION AND METHODS

We modeled a theoretical, two-arm, phase 2 clinical TB trial with a primary endpoint of culture conversion on solid medium after two months of treatment. Similar to published trials, the assumed study procedure was to collect two sputum specimens after two months of treatment. Culture conversion was defined as a negative culture for both specimens, or a negative culture for one specimen and a contaminated result for the other. Results from subjects with two contaminated specimens were considered uninterpretable and were not included in the required sample size; in other words, these subjects would need to be replaced with subjects with interpretable results (Figure 1).

Figure 1
Hypothetical 2-arm study design comparing solid media performance for two-month culture conversion with two sputum specimens between a control arm with 85% “true” culture conversion using solid media to an experimental arm with 95% “true” ...

Sample size calculations were based upon the following assumptions:

  1. 80% power to detect a significant difference with a two-sided alpha of 0.05
  2. 85% culture conversion at 8 weeks detected by a “perfect” (gold standard) solid medium in the control arm7
  3. 95% culture conversion at 8 weeks detected by a “perfect” (gold standard) solid medium in the experimental arm7
  4. Each sputum specimen from a given patient is an independent event (i.e., within-patient correlation was ignored)
  5. No false positive cultures

The observed proportion of patients in each arm was derived from the “true” proportion by rolling back the tree in Figure 1. For example, if the solid medium sensitivity were 70% and contamination rate was 20%, the proportion of subjects with at least one observed positive culture in the control arm (“true” rate 15%) would be 0.15×(0.7×(1−0.2) + (0.7×(1−0.2)×(1−(0.7×(1−0.2))))), or about 12.1%. Per-arm sample size estimates were derived from standard formulas that use the normal approximation to the binomial distribution, dividing the calculated number in each arm by [1−(proportion of subjects with two contaminated specimens)] to simulate discarding data from patients with two contaminated specimens as described above.8 All calculations were performed using Microsoft Excel 2010 (Microsoft Corporation, Redmond, WA).

RESULTS

Figure 2 displays the number of subjects required per arm with 1–30% contamination and 60–95% sensitivity, both plausible ranges based on prior studies.9,10 Decreasing solid medium sensitivity attenuates observed differences between arms, resulting in less actual statistical power for a given sample size. Similarly, increasing contamination rates were associated with a higher number of participants with uninterpretable two-month culture results, also reducing effective statistical power due to lower effective sample size. For example, this model predicts that employing solid medium with a sensitivity of 85% and contamination rate of 20% would be associated with a sample size of 161 subjects required per arm. Alternatively, employing solid medium with a sensitivity of 95% and contamination rate of 10% would be associated with a sample size required per arm of 141 subjects. Thus a total of 40 less subjects (20 subjects/arm) would be required to perform a clinical TB trial if employing solid medium with the latter performance characteristics. Varying the sensitivity and contamination rate resulted in sample size requirements of between 138–239 subjects per arm.

Figure 2
Number of subjects/arm required for hypothetical study design with varying fixed sensitivities and contamination rates for solid media (varying the contamination rate between 1–30% and sensitivity between 60–95%). The top chart displays ...

DISCUSSION

Phase 2 clinical trials of new TB treatment regimens often use two-month solid medium culture conversion as a surrogate marker, although imperfect, for an appropriate response to TB therapy. Liquid media have distinct performance characteristics from solid media, and may be more advantageous to use in many settings, but we focused on solid medium in this analysis.2,46,10 This hypothetical modeling study illustrates that utilizing solid medium with higher sensitivity and lower contamination rates can result in smaller sample sizes required to perform clinical trials, thus reducing the time and effort required to conduct phase 2 clinical TB trials. Preliminary studies suggest that selective Middlebrook medium may have higher sensitivity and lower contamination rates than LJ medium.1,2,4 Confirmatory studies will be important to verify these performance differences.

However, the model used for this analysis does not address the effect of within-patient correlation of sputum culture results. The magnitude of within-patient correlation is not known, but we did two separate simulations that introduced within-patient correlation using constants (e.g., if the first specimen was contaminated, we increased the likelihood that the second specimen would also be contaminated (or negative in the second simulation)). Introducing an arbitrary level of within-patient correlation changed the specific numerical results but not the overall trend (data not shown).

CONCLUSIONS

Solid media play an important role in clinical TB trials, and optimizing solid media performance has significant potential to increase TB clinical trial efficiency by reducing the cost, time, and resources needed to conduct phase 2 clinical trials of new TB treatment regimens.

ACKNOWLEDGEMENTS

The authors would like to acknowledge support from the Centers for Disease Control and Prevention Tuberculosis Trials Consortium (TBTC). The findings and conclusions are those of the authors and do not necessarily represent the views of the Centers for Disease Control and Prevention.

Contributor Information

Matthew G. Johnson, Division of Infectious Diseases and International Health, Duke University Medical Center, Durham, NC, USA, ude.ekud@nosnhoj.g.wehttam.

Jason E. Stout, Division of Infectious Diseases and International Health, Duke University Medical Center, Durham, NC, USA, ude.ekud.md@tuots.nosaj.

Debra A. Benator, Infectious Diseases Section, Veterans Affairs Medical Center and the George Washington University Medical Center, Washington, DC, USA, vog.av@rotaneb.arbed.

William C. Whitworth, Division of Tuberculosis Elimination, Clinical Research Branch, Centers for Disease Control and Prevention, Atlanta, GA, USA, vog.cdc@2wcw.

David P. Holland, Division of Infectious Diseases and International Health, Duke University Medical Center, Durham, NC, USA, ude.yrome@dnalloh.divad.

REFERENCES

1. Heilig CM, Feng PI, Joloba ML, et al. How we determined the most reliable solid medium for studying treatment of tuberculosis. Tuberculosis. 2014;94:317–322. [PMC free article] [PubMed]
2. Joloba ML, Johnson JL, Feng PI. What is the most reliable solid culture medium for tuberculosis treatment trials. Tuberculosis. 2014;94:311–317. [PubMed]
3. American Thoracic Society (ATS) and CDC Diagnostic standards and classification of tuberculosis in adults and children. Am J Respir Crit Care Med. 2000;161:1376–1395. [PubMed]
4. Regeade F, Picot N, Blanc-Michaud A, et al. Performance of solid and liquid culture media for the detection of Mycobacterium tuberculosis in clinical materials: meta-analysis of recent studies. Eur J Clin Microbiol Infect Dis. 2014;33:867–870. [PubMed]
5. Chihota VN, Grant AD, Fielding K, et al. Liquid vs. solid culture for tuberculosis: performance and cost in a resource-constrained setting. Int J Tuberc Lung Dis. 2010;14:1024–1031. [PubMed]
6. Feyzioglu B, Dogan M, Sanli OO, et al. Comparison of the performance of TK system with LJ and MGIT methods in the diagnosis of tuberculosis. Int J Clin Exp Med. 2014;7:1084–1088. [PMC free article] [PubMed]
7. Dorman SE, Savis RM, Goldberg S, et al. Daily rifapentine for treatment of pulmonary tuberculosis. Am J Respir Crit Care Med. 2015;191:333–343. [PubMed]
8. Dawson-Saunders B, Trapp RG. Chapter 9: Estimating and Comparing Proportions. 2nd Appleton & Lange; 1994. Basic and Clinical Biostatistics.
9. Kassaza K, Orikiriza P, Llosa A, et al. Lowenstein-Jensen selective medium for reducing contamination in Mycobacterium tuberculosis culture. J Clin Microbiol. 2014;52:2671–2673. [PMC free article] [PubMed]
10. Lee JJ, Suo J, Lin CB. Comparative evaluation of the BACTEC MGIT 960 system with solid medium for isolation of mycobacteria. Int J Tuberc Lung Dis. 2003;7:569–574. [PubMed]