PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of jcmPermissionsJournals.ASM.orgJournalJCM ArticleJournal InfoAuthorsReviewers
 
J Clin Microbiol. Jan 1998; 36(1): 311–314.
PMCID: PMC124864
Note
Absolute Copy Number and Relative Change in Determinations of Human Immunodeficiency Virus Type 1 RNA in Plasma: Effect of an External Standard on Kit Comparisons
Donald Brambilla,1 Sheila Leung,1 Judy Lew,2 John Todd,3 Steven Herman,4 Mike Cronin,5 David E. Shapiro,6 James Bremer,7 Celine Hanson,8 George V. Hillyer,9 George D. McSherry,10 Rhoda S. Sperling,11 Robert W. Coombs,12 and Patricia S. Reichelderfer2*
New England Research Institutes, Watertown, Massachusetts 021721; National Institute of Allergy and Infectious Diseases, Bethesda, Maryland 208922; Chiron Corporation, Emeryville, California 946083; Roche Molecular Systems, Branchburg, New Jersey 088764; Organon Teknika Corporation, Durham, North Carolina 277125; Harvard School of Public Health, Boston, Massachusetts 021156; Rush-Presbyterian-St. Luke’s Medical Center, Chicago, Illinois 606127; Baylor College of Medicine, Houston, Texas 770308; University of Puerto Rico School of Medicine, San Juan, Puerto Rico 00936-50679; UMD-New Jersey Medical School, Newark, New Jersey 0710310; Mount Sinai Medical Center, New York, New York 1002911; and University of Washington, Seattle, Washington 9819512
*Corresponding author. Mailing address: NIH/NIAID/DAIDS, 6003 Executive Blvd., Rockville, MD 20776. Phone: (301) 496-0636. Fax: (301) 402-3171. E-mail: pr20f/at/nih.gov.
Received June 13, 1997; Revisions requested August 18, 1997; Accepted October 27, 1997.
Abstract
Use of a common set of human immunodeficiency virus type 1 (HIV-1) RNA standards eliminated differences among absolute HIV-1 RNA copy number estimates made with three commercially available assays. The relative changes in the viral RNA levels determined by the commercial assays were similar and were unaffected by the use of a common set of standards.
Quantitation of human immunodeficiency virus type 1 (HIV-1) RNA is being used to manage HIV-1-infected patients, to approve antiretroviral agents for licensure, and as entry criteria, endpoints, and change points for AIDS clinical trials (1, 2, 4, 9, 13, 19). Many of these uses rely on relative changes between measurements and increasingly on absolute viral RNA values (2). The differences between the values obtained by laboratories and kits with spiked samples were significantly reduced through the use of a common set of standards (20). However, spiked plasma samples do not reflect the actual variation in viral composition and in the plasma matrix. Previous assessments of kit differences in the measurement of patient RNA copy number have been limited by small sample sizes and the use of kit assay standards alone (12, 14, 17). The objective of this study was to assess the feasibility of reducing kit-related differences in HIV-1 RNA copy number estimates by utilizing a common set of external standards.
These analyses included two sets of data. The first analysis consisted of estimates from a three-way comparison of the Chiron Enhanced Sensitivity branched DNA (ES bDNA) assay (Chiron Corporation, Inc., Emeryville, Calif.), the reverse transcription (RT)-PCR amplification Monitor assay (Roche Molecular Systems, Branchburg, N.J.), and the Organon Teknika Corporation (OTC) NASBA-QT (Advanced BioScience Laboratories, Incorporated, Kensington, Md.). In the three-way comparison, 90 specimens from 22 pregnant women coenrolled in the Women and Infants Transmission Study (15) and Pediatric AIDS Clinical Trials Group protocol 076 were selected (5). The second analysis consisted of estimates from a two-way comparison of the ES bDNA and RT-PCR assays. This two-way comparison of ES bDNA and RT-PCR assay results was based on 912 specimens from 479 women enrolled in Pediatric AIDS Clinical Trials Group protocol 076. In both analyses, absolute levels and changes in RNA level from baseline to labor and delivery were compared among kits. Determinations of HIV RNA in all plasma specimens in both sets of comparisons were performed by the manufacturers themselves to minimize laboratory variation and to focus on the contribution of the kits to variation.
Specimens were assayed in accordance with each manufacturer’s instructions (7, 10, 18) by using both kit and National Institute of Allergy and Infectious Diseases (NIAID)-sponsored virology quality assurance (VQA) standards. The VQA standards have been previously described (8, 20). They consist of supernatants from HIV-1-infected patient cultures spiked into seronegative plasma, which was then characterized by multiple parameters for determination of absolute HIV-1 RNA copy numbers. The RT-PCR assay specimens were pretreated with heparinase (16). Specimens analyzed by Chiron were tested with the ES bDNA assay (7). Depending on the available volume, either 1.0 or 0.5 ml of plasma was assayed by this procedure. For the NASBA-QT assay, 10-fold-diluted calibrators were used to increase sensitivity (17); the sensitivity was similar to that of the newer NucliSens version of the assay. All samples from the same patient were assessed by batch assay to eliminate interassay variability and focus only on differences among kits.
For this analysis, the limit of assay sensitivity and the lowest observed RNA copy number were, respectively, 200 and 466 copies/ml for the RT-PCR assay of 0.2-ml samples, 1,000 and 1,100 copies/ml for the NASBA-QT assay of 0.1-ml samples, and 500 and 561 copies/ml for the ES-bDNA assay of 1.0-ml samples. Absolute copy numbers for pairwise comparisons were based on total specimens above the limit of detection for both assays, while relative-change pairwise comparisons were based on patients with estimates above the limit of detection for both specimens with both assays.
Results were compared among kits both before and after adjustment to the VQA standards. Adjustment for all kits was accomplished by using regressions of the estimated RNA concentration on the nominal log10 concentration for the VQA standards. The mean, median, and number of values above or below the assay cutoffs were calculated. Paired t tests were used to test the null hypothesis that the average difference in estimated RNA concentration between kits was zero.
The viral RNA copy numbers estimated by the kits were similar when either kit-based or VQA-adjusted standards were used (Table (Table1).1). However, differences in estimated copy numbers between kits were statistically significant at P < 0.001 (Table (Table2).2). The VQA standards for the group analysis eliminated differences among all of the assays. The results of the larger comparison between the RT-PCR and ES bDNA assays were similar to the results of the smaller three-way comparison.
TABLE 1
TABLE 1
Estimates of log10 RNA concentration for both the kit-adjusted and VQA-adjusted standards
TABLE 2
TABLE 2
Differences in log10 RNA concentration among estimates based on VQA or kit standards for determining nominal copy numbera
For all kits, the standard deviation (SD) was determined to be 0.18 log10 HIV-1 RNA copies per ml based on the performance of the VQA standard with a copy number of 1,500. Thus, the 95% confidence limits for the difference between two estimates was equivalent to ±0.5 log10. Although there was individual-subject variability in the HIV-1 RNA copy numbers estimated by the kits (Fig. (Fig.1a1a and b), the use of VQA standards reduced the number of patients within ±2 SD from 29.6 to 14.6% and increased the number of patients ±1 SD from 30.5 to 53.9% (Table (Table3).3).
FIG. 1
FIG. 1
Difference between log10 estimated RNA concentrations from the RT-PCR and Chiron ES bDNA assays plotted against the log-transformed mean of the two estimates. A positive difference indicates that the RT-PCR copy number was higher than the Chiron ES bDNA (more ...)
TABLE 3
TABLE 3
Frequency and percentage of points falling in each of the SD categories for the differences between log10 estimated RNA concentrations from the RT-PCR and Chiron ES bDNA assays
No statistically significant differences between kits in the mean relative change in HIV-1 RNA level were detected when either kit-based or VQA-adjusted estimates of RNA copy number were used (Table (Table4).4). Relative changes in viral RNA level for the individual subjects were strongly correlated between the RT-PCR and ES bDNA assays (Fig. (Fig.2a2a and b). Changes in opposite directions were identified in 12 (14%) of 83 patients. However, the difference in relative change between kits varied widely among the patients. The SD of the difference between relative changes for the RT-PCR and ES bDNA kits was 0.26, and the 10th and 90th percentiles of the differences were −0.30 and +0.30 log10. Thus, 20% of the time, there was at least a twofold difference between the relative change in the results obtained with one kit and the relative change in those obtained with the other.
TABLE 4
TABLE 4
Differences for within-individual log10 changes in RNA based on VQA or kit standards for determining nominal copy numbera
FIG. 2
FIG. 2
Change in log10 RNA concentration as measured by RT-PCR assay versus change in log10 RNA concentration as measured by the Chiron ES bDNA assay. a, kit-based copy number estimates; b, VQA-adjusted copy number estimates. ZDV, zidovudine.
In this study, each assay was performed by the respective manufacturer; thus, interlaboratory difference within kits was not assessed. The kit differences observed suggest that accurate determination of an absolute HIV-1 RNA copy number in patient plasma will be significantly affected by the kit used for the assessment. It was possible, however, to make the absolute copy numbers among the kits equivalent if they were adjusted to a common set of viral RNA standards. A common set of standards was unnecessary for assessment of the relative change in patient plasma RNA levels, since these values did not differ significantly among the three assays. It is possible that greater or lesser kit-related differences in relative change may occur with more potent antiviral therapy, since the magnitude of the changes in virus load in this study were modest (+0.76 to −0.66 log10).
In summary, the use of absolute viral levels is problematic for individual patient management because the assessment of the absolute viral RNA level is dependent upon the test method. However, the ability to adjust for kit differences in absolute copy number by using external standards has important implications for cross-protocol study analysis and possibly for individual patient management when kits are changed. Relative change in viral RNA level can be used for therapeutic management without adjustment. Given the lack of a universal standard, longitudinal assessment of HIV-1 RNA level should be done with the same manufacturer’s assay kit.
Acknowledgments
We acknowledge Joe Romano, Robert Kuzma, and Helen Payne for technical assistance and Shirley Traite and Michael Posner for computer programming.
This work was supported under NIAID contracts NO-AI-35172 (D.B. and S.L.), NO1-AI-35161 (S.L.), and NO1-AI-95030 (D.E.S.) and NIAID grants AI-27664, AI-30731 (R.W.C.), AI-25883-09 (G.M.), AI-34840 (C.H.), and AI-34858 (G.H.).
1. BHIVA Guidelines Co-ordinating Committee. British HIV association guidelines for antiretroviral treatment of HIV seropositive individuals. Lancet. 1997;349:1086–1092. [PubMed]
2. Carpenter C C J, Fischl M A, Hammer S M, Hirsch M S, Jacobsen D M, Katzenstein D A, Montaner J S G, Richman D D, Saag M S, Schooley R T, Thompson M A, Vella S, Yeni P G, Volberding P A. for the International AIDS Society—USA. Antiretroviral therapy for HIV-1 infection in 1996. JAMA. 1996;276:146–154. [PubMed]
3. Connor E M, Sperling R S, Gelber R, Kiselev P, Scott G, O’Sullivan M J, VanDyke R, Bey M, Shearer W, Jacobson R L, Jimenez E, O’Neill E, Bazin B, Delfraissy J, Culnane M, Coombs R, Elkins M, Moye J, Stratton P, Balsley J. for The Pediatric AIDS Clinical Trials Group Protocol 076 Study Group. Reduction of maternal-infant transmission of human immunodeficiency virus type 1 with zidovudine treatment. N Engl J Med. 1994;331:1173–1180. [PubMed]
4. Coombs R W. HIV-1 burden as a marker of disease progression and clinical response to therapy in AIDS. Clin Lab Med. 1994;14:301–311. [PubMed]
5. Garcia F, Vidal V, Gatell J M, Miro J M, Sorino A, Pumarola T. Viral load in asymptomatic patients with CD4+ lymphocyte counts above 500 × 106/l. AIDS. 1997;11:53–57. [PubMed]
6. Holodniy M, Mole L, Winters M, Merigan T C. Diurnal and short-term stability of HIV virus load as measured by gene amplification. J Acquired Immune Defic Syndr. 1994;7:363–368. [PubMed]
7. Kern D, Collins M, Fultz T, Detmer J, Hamren S, Peterkin J J, Sheridan P, Urdea M, White R, Yeghaizarian T, Todd J. An enhanced-sensitivity branched-DNA assay for quantification of human immunodeficiency virus type 1 RNA in plasma. J Clin Microbiol. 1996;34:3196–3202. [PMC free article] [PubMed]
8. Lin H J, Myers L E, Yen-Lieberman B, Hollinger F B, Henrard D, Hooper C J, Kokka R, Kwok S, Rasheed S, Vahey M, Winters M A, McQuay L J, Nara P L, Reichelderfer P, Coombs R W, Jackson J B. Multicenter evaluation of methods for the quantitation of plasma HIV-1 RNA. J Infect Dis. 1994;170:553–562. [PubMed]
9. Merigan, T. 1995. Individualization of therapy using viral markers. J. Acquired Immune Defic. Syndr. Hum. Retrovirol. 10(Suppl. 1):S41–S46. [PubMed]
10. Mulder J, McKinney N, Christopherson C, Sninsky J, Greenfield L, Kwok S. Rapid and simple PCR assay for quantitation of human immunodeficiency virus type 1 RNA in plasma: application to acute retroviral infection. J Clin Microbiol. 1994;32:292–300. [PMC free article] [PubMed]
11. Paxton W B, Coombs R W, McElrath M J, Keefer M C, Hughes J, Sinangil F, Chernoff D, Demeter L, Williams B, Corey L. for The National Institute of Allergy and Infectious Diseases AIDS Vaccine Evaluation Group. Longitudinal analysis of quantitative virologic measures in human immunodeficiency virus-infected subjects with >400 CD4 lymphocytes: implications for applying measurements to individual patients. J Infect Dis. 1997;175:247–254. [PubMed]
12. Revets H, Marissens D, De Wit S, Lacor P, Clumeck N, Lauwers S, Zissis G. Comparative evaluation of NASBA HIV-1 RNA QT, AMPLICOR-HIV Monitor, and QUANTIPLEX HIV RNA assay, three methods for quantification of human immunodeficiency virus type 1 RNA in plasma. J Clin Microbiol. 1996;34:1058–1064. [PMC free article] [PubMed]
13. Saag, M. S., M. Holodniy, D. R. Kuritzkes, W. A. O’Brien, R. Coombs, M. E. Poscher, D. M. Jacobson, G. M. Shaw, D. D. Richman, and P. A. Volberding. HIV viral load markers in clinical practice. Nat. Med. 2:625–629. [PubMed]
14. Schuurman R, Descamps D, Weverling G J, Kaye S, Tijnagel J, Williams I, van Leeuwen R, Tedder R, Boucher C A B, Brun-Vezinet F, Loveday C. Multicenter comparison of three commercial methods for quantification of human immunodeficiency virus type 1 RNA in plasma. J Clin Microbiol. 1996;34:3016–3022. [PMC free article] [PubMed]
15. Sheon A R, Fox H E, Rich K C, Stratton P, Diaz C, Tuomala R, Mendez H, Carrington J, Alexander G. The Women and Infants Transmission Study (WITS) of maternal-infant HIV transmission: study design, methods, and baseline data. J Women’s Health. 1996;5:69–78.
16. Sperling R S, Shapiro D E, Coombs R W, Todd J A, Herman S A, McSherry G D, O’Sullivan M J, Van Dyke R B, Jimenez E, Rouzioux C, Flynn P M, Sullivan J L. for The Pediatric AIDS Clinical Trials Group Protocol 076 Study Group. Maternal viral load, zidovudine treatment, and the risk of transmission of human immunodeficiency virus type 1 from mother to infant. N Engl J Med. 1996;335:1621–1629. [PubMed]
17. Vandamme A-M, Schmit J-C, van Dooren S, van Laethem K, Gobbers E, Kok W, Goubau P, Witvrouw M, Peetermans W, de Clercq E, Desmyter J. Quantification of HIV-1 RNA in plasma: comparable results with NASBA HIV-1 RNA QT and the Amplicor HIV Monitor test. J Acquired Immune Defic Syndr. 1996;13:127–139. [PubMed]
18. van Gemen B, Kievits T, Schukkink R, van Strijp D, Malek L T, Sooknanan R, Huisman H G, Lens P. Quantification of HIV-1 RNA in plasma using NASBA during HIV-1 primary infection. J Virol Methods. 1993;43:177–188. [PubMed]
19. Volberding P. HIV quantification: clinical applications. Lancet. 1996;347:71–73. [PubMed]
20. Yen-Lieberman B, Brambilla D, Jackson B, Bremer J, Coombs R, Cronin M, Herman S, Katzenstein D, Leung S, Lin H J, Palumbo P, Rasheed S, Todd J, Vahey M, Reichelderfer P. Evaluation of a quality assurance program for quantification of human immunodeficiency virus type 1 RNA in plasma by the AIDS Clinical Trials Group virology laboratories. J Clin Microbiol. 1996;34:2695–2701. [PMC free article] [PubMed]
Articles from Journal of Clinical Microbiology are provided here courtesy of
American Society for Microbiology (ASM)