Search tips
Search criteria 


Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
Obstet Gynecol. Author manuscript; available in PMC 2010 March 1.
Published in final edited form as:
PMCID: PMC2747731

Five-Year Experience of Human Papillomavirus DNA and Papanicolaou Test Cotesting



To estimate the 5-year age group-specific test positives for Papanicolaou (Pap) tests and human papillomavirus (HPV) testing in a large, general screening population of women 30 and older.


Using data from Kaiser Permanente Northern California, a large health maintenance organization that introduced cotesting in 2003, we evaluated the cotesting results overall and by 5-year age groups. Women (n=580,289) who opted for and underwent cotesting (n cotests=812,598) between January, 2003 and April, 2008 were included in the analysis. Pap tests interpreted as atypical squamous cells of undetermined significance (ASC-US) or more severe were considered to be positive. Women were tested for carcinogenic HPV using an assay approved by the U.S. Food and Drug Administration. Binomial exact 95% confidence intervals (CI) were calculated.


Overall, 6.27% (CI = 6.21%–6.32%) of cotests were assay positive, and only 3.99% (CI = 3.94%–4.03%) cotests had normal cytology and were assay-positive. By comparison, 5.18% (CI = 5.13%–5.23%) of cotests had ASC-US or more severe cytology, and 2.87% (CI = 2.84%–2.91%) of cotests had ASC-US or more severe cytology and were assay-negative.


In a general screening population, concerns about excessive HPV test positives among women 30 and older are not borne out.


While it has successfully reduced the burden of cervical cancer by 75% or more in the U.S.(1), Papanicolaou (Pap) smear/cervical cytology is insensitive for the detection of precancer and cancer of the cervix (2) and must be repeated frequently to achieve programmatic effectiveness (3). A more efficient and accurate screen could greatly reduce the billions of dollars (4) spent annually on the U.S. cytology-based system.

Based on the central role of persistent, carcinogenic human papillomavirus (HPV) in cervical carcinogenesis, carcinogenic HPV testing has recently been introduced into cervical cancer screening. Carcinogenic HPV testing has proven greater reproducibility (5;6) and greater sensitivity for detection of cervical precancer (cervical intraepithelial neoplasia grade 3 [CIN3]) and cancer (together, abbreviated here as ≥CIN3)(2;710) than cytology.

Carcinogenic HPV testing is now commonly used in the U.S. to triage equivocal cytology for colposcopic referral. Carcinogenic HPV testing with cytology is also approved for primary screening of women aged 30 years and older (11), who are past the peak of self-limited infections (12). Women aged 30 years and older who test negative for carcinogenic HPV and are cytologically normal are at an extremely low risk for incipient precancer and cancer of the cervix for the subsequent 10 years or more (13;14). Therefore the recommended screening interval for these women is no less than 3 years in the United States.

Despite the ability of HPV testing to detect 25–50% of lesions missed by a single cytology screen, there are concerns about the addition of HPV testing because of the number of women 30 and older who would test carcinogenic HPV positive but cytologic negative and therefore would require increased surveillance and clinical follow-up per current guidelines (11). Recent epidemiological data (15;16) has raised concerns that the addition of HPV testing was undesirable because many cytologically-normal women will be labeled and therefore stigmatized as being HPV positive, despite the utility of HPV testing to detect the 25–50% of the precancer and cancer missed by a single cytologic screen. To estimate the prevalence of hc2 positive results in cytologically-normal women aged 30 and older in a representative general screening population with a much larger sample size, we analyzed the data collected at Kaiser Permanente Northern California, which instituted co-testing with hc2 and conventional cytology in women aged 30 and older in 2003.


With the permission of Kaiser and National Cancer Institute Institutional Review Boards, results of all Pap smears with HPV DNA tests collected within 7 days of one another (“cotests”) between January, 2003 and April 2008 were assembled and tabulated from the laboratory databases. HPV DNA testing for 13 carcinogenic HPV genotypes (HPV16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 68) was performed using the Food and Drug Administration-approved Hybrid Capture 2 (hc2; Qiagen Corporation, Gaithersburg, MD, USA) according to the manufacturer’s instructions. Cotests were excluded if the HPV testing was performed in duplicate or no result was available, or the Pap result was unsatisfactory or “other” (the 2001 Bethesda System general categorization used for “exfoliated endometrial cells present in a woman >40”). Paps that were interpreted as atypical squamous cells of undetermined significance (ASC-US), the threshold for referral to colposcopy (without an HPV test)(11;17) or more severe cytology (≥ASC-US) were considered screen positives.

During the study period 812,598 cotests were identified in 580,289 women age 30 and older, of which 1,376 cotests were excluded for HPV results (none available or duplicate), and 13,295 cotests were excluded for Pap results of “other” or “unsatisfactory”, leaving 797,927 cotests (98.2%) for analysis. These data included multiple cotests from some women, the results of which were included in the analysis because the primary focus was the screening results in the general population over a period of time rather than the point prevalence.

Individual and paired test results were compared to patient age, categorized into 5-year age groups from age 30 to 79 and grouping all women 80 older into an 80 and older (80+) category. Cotesting was done according to KPNC cervical cancer screening guidelines (18), including the screening of a small percentage of women 65 and older (approximately 6.5% of all women cotested), for whom screening is recommended if they have either not had three or more documented, consecutive, technically satisfactory normal/negative cervical cytology tests after the age of 55 or had an abnormal/positive cytology test for which HPV testing was indicated. Continued screening is also left to the discretion of the clinician if a woman 65 or older tests HPV positive. These guidelines are consistent with national screening guidelines that recommend discontinuing cervical cancer screening above the age of 65 ( or 70 (18) only when these women have had adequate recent screening with normal Pap smears and are not otherwise at high risk for cervical cancer.

Prevalence ratios (HPV/Pap) with 95% confidence intervals (95%CI) were calculated to show the relative contribution of HPV to Pap for screening positive by cotesting. McNemar’s chi square test was used to test for statistical differences (p < 0.05) for testing HPV positive versus testing positive by Pap smears for all women and by age group. Binomial exact 95%CI were calculated for the overall and age group-specific HPV prevalence. NCSS 2004 (Kaysville, Utah) was used for statistical analyses.


The average and median age of women at the time of undergoing cotesting were 46 years and 44 years, respectively. The mean per capita and household incomes were $27,869 and $56,795, respectively. Self reported race is available for approximately 2% of the reported cotests, and is very similar to the racial distribution in the 2006 census for the counties that Northern California Kaiser facilities serve. Table 1 shows the distribution of self-reported race, with 50.2% of women reported being white, 22.4% reported being Asian or Pacific Islander, 14.9% reported being Hispanic.

Table 1
Distribution of self-reported race at KPNC by 2% of 580,280 women 30 and older who underwent cotesting with conventional Pap smears and carcinogenic HPV testing by Hybrid Capture 2 from January 2003 through April 2008

The results for hc2 testing and conventional Pap smears by age are shown in Table 2. Overall, 6.27% (95%CI = 6.21%–6.32%) of 797,927 cotests were hc2 positive at Kaiser. Women aged 30–34 were the most likely (10.82%) to be hc2 positive, and women aged 60–64 were the least likely (3.67%) to be hc2 positive. There was a slight rise in testing hc2 positive among women aged 70 and older (4.31%–5.27%) compared to women aged 60–64. Only 3.99% (95%CI = 3.94%–4.03%) cotests had normal cytology and were hc2 positive. Cytologically normal women aged 30–34 were the most likely (6.76%) to test hc2 positive while women aged 60–64 were the least likely (2.56%). The age-specific percentages of testing hc2 positive with 95% confidence intervals are shown in Figure 1.

Figure 1
Percentage of woman with normal Papanicolaou (Pap) tests who tested positive for carcinogenic human papillomavirus (HPV) by Hybrid Capture 2 (hc2+) by age group (black squares) and for all women 30 and older (white squares). Data from the Kaiser Permanente ...
Table 2
A summary of results from cotesting with conventional Pap smears and carcinogenic HPV testing by Hybrid Capture 2 by 5-year age groups. Data are from the Kaiser Permanente Northern California Health Plan from January 2003 through April 2008. Prev. Ratio ...

By comparison, 5.18% (95%CI = 5.13%–5.23%) of all cotests had ≥ASC-US cytology. Cotesting women aged 30–34 were the most likely (6.48%) to have an ≥ASC-US cytology, and cotesting women aged 60–64 were the least likely (3.17%) to test hc2 positive. Of note, 2.87% (95%CI = 2.84%–2.91%) of cotests in women 30 and older had ≥ASC-US cytology and tested hc2 negative. Women aged 45–49 were the most likely (3.77%) to have ≥ASC-US cytology and test hc2 negative.


In our experience of eight hundred thousand cotests, we found that the likelihood of testing hc2 positive was much less than was previously reported in smaller epidemiological studies or selected populations in the U.S. (15;16). The percentage of carcinogenic HPV test positives, as measured using hc2, was 6.27%. Not surprisingly, the highest percentage of hc2 positives was found in women 30–34 (10.82%) and women 35–39 (8.03%), in the age group of KPNC female membership with highest prevalence of CIN2/3 (data not shown). These data are consistent with the prevalence of HPV in women of those ages participating in the HPV Sentinel Surveillance project (15), in which more than half of the women enrolled in that study were between the ages of 30–39 and thus partially explaining the observed high HPV prevalence. There was the expected and pronounced decrease in HPV prevalence in the older KPNC female membershipThus, the concerns raised about introduction of HPV testing into clinical practice (19) may be seen to have been overstated when population screening data are considered.

Although these are data from a large population, we point out that these data may not be generalizeable to all populations worldwide. The likelihood of testing HPV positive in conjunction with cotesting is population specific and depends on the age and risk behaviors in that population.

The percentage of hc2 positive results among cytologically normal women observed at Kaiser (3.99%) was similar to the percentage (3.7%) of carcinogenic HPV positives in cytologically normal women reported in a population-based study of 44,102 women using a GP5+/6+ PCR assay, which has shown to have comparable clinical performance to hc2 (20). The percentage is also similar to the median percentage of HPV positives (4%) in all women 30 and older as reported in a survey conducted by the College of American Pathologists (21). Interestingly, we found that the likelihood of testing carcinogenic HPV positive but cytologic negative to be only slightly more common than the likelihood of testing carcinogenic HPV negative but cytologic positive (3.99% vs. 2.90%), which is primarily (HPV-negative) ASC-US cytology (82.8%) that bears a very low risk of CIN2/3 (22) but also requires increased surveillance and clinical follow-up according to current guidelines (11).

Although Kaiser uses conventional Pap smears for detection of cytologic abnormalities while ~90% of U.S. clinics rely on liquid-based cytology, a recent meta-analysis (23) indicates that liquid-based cervical cytology is not more sensitive and may be less specific for detection of high-grade cervical intraepithelial neoplasia than the Pap smear. Thus, the use of LBC, widely adopted in advance without evidence of greater screening accuracy versus convention Pap smears (24), would be expected to increase the proportion of test positives by cytology, including false positives. Regardless, the use of Pap smear at Kaiser does not alter our observations about HPV testing.

Recognition of cytologically-normal, HPV-negative women is important because extension of screening intervals from one to three years based on negative cytology alone, despite being preceded by three consecutive negative cytology results, triples the risk of invasive cervical cancer (25). While unfamiliar with the research, many women and providers intuitively understand that fewer Paps mean more cancer risk, and the majority of women and medical care providers participating in screening in our population and that of the Southern California Kaiser Permanente Medical Care Plan were unwilling to accept recommendations made by the Kaiser clinicians in the 1980s and 1990s to abandon annual screening with cytology alone in favor of longer screening intervals (data not shown).

As the morbidities associated with the treatment of dysplasia have become more apparent (2628), and it has been recognized that half of CIN2 (which is routinely treated) regresses in 24 months (29;30), the adverse consequences for the patient of annual screening come into sharper focus. Currently KPNC offers screening with Pap and HPV at 3-year intervals or screening with cytology at more frequent intervals to our female members age 30 and above. During the period from December 1, 2006 through February 26, 2007, 91.6% of KPNC members age 30 and older who participated in screening elected the cotesting option (screening every three years if Pap and HPV were both negative) instead of annual screening. Providing the reassurance required to move away from annual screening is one of the benefits of cotesting that we have observed.

We will be conducting subsequent analyses on the predictive values for ≥CIN2, ≥CIN3, and cancer of all pair-wise cotesting results. However, we already recognize that women who test positive for carcinogenic HPV and negative by cytology are at an elevated risk for cervical precancer and cancer compared to women who test negative on both (13;31), and yet the positive predictive value of a single Pap-negative HPV-positive cotest for ≥CIN3 remains less than ideal. Thus, the development of a viable strategy for identifying the subset of women at highest risk of ≥CIN3 would further improve the efficiency of secondary cervical cancer prevention. Future clinical research will need to focus on identifying the best strategies for managing women who test positive for carcinogenic HPV and negative by cytology, which may include HPV genotyping for HPV16, HPV18, and possibly HPV45 (11;32;33) or immunodetection of p16INK4a (34).


Dr. Castle was supported by the Intramural Research Program of the National Institutes of Health (NIH), National Cancer Institute.


Financial Disclosure: The authors did not report any potential conflicts of interest.

Reference List

1. Kitchener HC, Castle PE, Cox JT. Chapter 7: Achievements and limitations of cervical cytology screening. Vaccine. 2006 Aug 21;24(Suppl 3):S63–70. S63–S70. [PubMed]
2. Cuzick J, Clavel C, Petry KU, Meijer CJ, Hoyer H, Ratnam S, et al. Overview of the European and North American studies on HPV testing in primary cervical cancer screening. Int J Cancer. 2006 Sep 1;119(5):1095–101. [PubMed]
3. Cuzick J. Role of HPV testing in clinical practice. Virus Res. 2002 Nov;89(2):263–9. [PubMed]
4. Kurman RJ, Henson DE, Herbst AL, Noller KL, Schiffman MH. Interim guidelines for management of abnormal cervical cytology. The 1992 National Cancer Institute Workshop. JAMA. 1994 Jun 15;271(23):1866–9. [PubMed]
5. Castle PE, Wheeler CM, Solomon D, Schiffman M, Peyton CL. Interlaboratory reliability of Hybrid Capture 2. Am J Clin Pathol. 2004 Aug;122(2):238–45. [PubMed]
6. Carozzi FM, Del Mistro A, Confortini M, Sani C, Puliti D, Trevisan R, et al. Reproducibility of HPV DNA Testing by Hybrid Capture 2 in a Screening Setting. Am J Clin Pathol. 2005 Nov;124(5):716–21. [PubMed]
7. Arbyn M, Sasieni P, Meijer CJ, Clavel C, Koliopoulos G, Dillner J. Chapter 9: Clinical applications of HPV testing: A summary of meta-analyses. Vaccine. 2006 Aug 21;24(Suppl 3):S78–89. S78–S89. [PubMed]
8. Mayrand MH, Duarte-Franco E, Rodrigues I, Walter SD, Hanley J, Ferenczy A, et al. Human papillomavirus DNA versus Papanicolaou screening tests for cervical cancer. N Engl J Med. 2007 Oct 18;357(16):1579–88. [PubMed]
9. Naucler P, Ryd W, Tornberg S, Strand A, Wadell G, Elfgren K, et al. Human papillomavirus and Papanicolaou tests to screen for cervical cancer. N Engl J Med. 2007 Oct 18;357(16):1589–97. [PubMed]
10. Bulkmans N, Berkhof J, Rozendaal L, van KF, Boeke A, Bulk S, et al. Human papillomavirus DNA testing for the detection of cervical intraepithelial neoplasia grade 3 and cancer: 5-year follow-up of a randomised controlled implementation trial. Lancet. 2007 Oct 3 [PubMed]
11. Wright TC, Jr, Massad LS, Dunton CJ, Spitzer M, Wilkinson EJ, Solomon D. 2006 consensus guidelines for the management of women with abnormal cervical cancer screening tests. Am J Obstet Gynecol. 2007 Oct;197(4):346–55. [PubMed]
12. Wright TC, Jr, Schiffman M, Solomon D, Cox JT, Garcia F, Goldie S, et al. Interim guidance for the use of human papillomavirus DNA testing as an adjunct to cervical cytology for screening. Obstet Gynecol. 2004 Feb;103(2):304–9. [PubMed]
13. Sherman ME, Lorincz AT, Scott DR, Wacholder S, Castle PE, Glass AG, et al. Baseline cytology, human papillomavirus testing, and risk for cervical neoplasia: a 10-year cohort analysis. J Natl Cancer Inst. 2003 Jan 1;95(1):46–52. [PubMed]
14. Kjaer S, Hogdall E, Frederiksen K, Munk C, van den BA, Svare E, et al. The absolute risk of cervical abnormalities in high-risk human papillomavirus-positive, cytologically normal women over a 10-year period. Cancer Res. 2006 Nov 1;66(21):10630–6. [PubMed]
15. Datta SD, Koutsky LA, Ratelle S, Unger ER, Shlay J, McClain T, et al. Human papillomavirus infection and cervical cytology in women screened for cervical cancer in the United States, 2003–2005. Ann Intern Med. 2008 Apr 1;148(7):493–500. [PubMed]
16. Dunne EF, Unger ER, Sternberg M, McQuillan G, Swan DC, Patel SS, et al. Prevalence of HPV infection among females in the United States. JAMA. 2007 Feb 28;297(8):813–9. [PubMed]
17. Wright TC, Jr, Cox JT, Massad LS, Twiggs LB, Wilkinson EJ. 2001 Consensus Guidelines for the management of women with cervical cytological abnormalities. JAMA. 2002 Apr 24;287(16):2120–9. [PubMed]
18. Saslow D, Runowicz CD, Solomon D, Moscicki AB, Smith RA, Eyre HJ, et al. American Cancer Society guideline for the early detection of cervical neoplasia and cancer. CA Cancer J Clin. 2002 Nov;52(6):342–62. [PubMed]
19. Sawaya GF. Adding human papillomavirus testing to cytology for primary cervical cancer screening: shooting first and asking questions later. Ann Intern Med. 2008 Apr 1;148(7):557–9. [PubMed]
20. Bulkmans NW, Berkhof J, Rozendaal L, van Kemenade FJ, Boeke AJ, Bulk S, et al. Human papillomavirus DNA testing for the detection of cervical intraepithelial neoplasia grade 3 and cancer: 5-year follow-up of a randomised controlled implementation trial. Lancet. 2007 Nov 24;370(9601):1764–72. [PubMed]
21. Moriarty AT, Schwartz MR, Eversole G, Means M, Clayton A, Souers R, et al. Human papillomavirus testing and reporting rates: practices of participants in the College of American Pathologists Interlaboratory Comparison Program in Gynecologic Cytology in 2006. Arch Pathol Lab Med. 2008 Aug;132(8):1290–4. [PubMed]
22. Safaeian M, Solomon D, Wacholder S, Schiffman M, Castle P. Risk of precancer and follow-up management strategies for women with human papillomavirus-negative atypical squamous cells of undetermined significance. Obstet Gynecol. 2007 Jun;109(6):1325–31. [PubMed]
23. Arbyn M, Bergeron C, Klinkhamer P, Martin-Hirsch P, Siebers AG, Bulten J. Liquid compared with conventional cervical cytology: a systematic review and meta-analysis. Obstet Gynecol. 2008 Jan;111(1):167–77. [PubMed]
24. Sawaya GF. Evidence-based medicine versus liquid-based cytology. Obstet Gynecol. 2008 Jan;111(1):2–3. [PubMed]
25. Sawaya GF, McConnell KJ, Kulasingam SL, Lawson HW, Kerlikowske K, Melnikow J, et al. Risk of cervical cancer associated with extending the interval between cervical-cancer screenings. N Engl J Med. 2003 Oct 16;349(16):1501–9. [PubMed]
26. Kyrgiou M, Koliopoulos G, Martin-Hirsch P, Arbyn M, Prendiville W, Paraskevaidis E. Obstetric outcomes after conservative treatment for intraepithelial or early invasive cervical lesions: systematic review and meta-analysis. Lancet. 2006 Feb 11;367(9509):489–98. [PubMed]
27. Arbyn M, Kyrgiou M, Simoens C, Raifu AO, Koliopoulos G, Martin-Hirsch P, et al. Perinatal mortality and other severe adverse pregnancy outcomes associated with treatment of cervical intraepithelial neoplasia: meta-analysis. BMJ. 2008 Sep 18;337:a1284. doi: 10.1136/bmj.a1284.:a1284. [PubMed] [Cross Ref]
28. Albrechtsen S, Rasmussen S, Thoresen S, Irgens LM, Iversen OE. Pregnancy outcome in women before and after cervical conisation: population based cohort study. BMJ. 2008 Sep 18;337:a1343. doi: 10.1136/bmj.a1343.:a1343. [PubMed] [Cross Ref]
29. ASCUS-LSIL Triage Study (ALTS) Group. A randomized trial on the management of low-grade squamous intraepithelial lesion cytology interpretations. Am J Obstet Gynecol. 2003 Jun;188(6):1393–400. [PubMed]
30. ASCUS-LSIL Triage Study (ALTS) Group. Results of a randomized trial on the management of cytology interpretations of atypical squamous cells of undetermined significance. Am J Obstet Gynecol. 2003 Jun;188(6):1383–92. [PubMed]
31. Castle PE, Sideri M, Jeronimo J, Solomon D, Schiffman M. Risk assessment to guide the prevention of cervical cancer. Am J Obstet Gynecol. 2007 Oct;197(4):356. [PMC free article] [PubMed]
32. Khan MJ, Castle PE, Lorincz AT, Wacholder S, Sherman M, Scott DR, et al. The elevated 10-year risk of cervical precancer and cancer in women with human papillomavirus (HPV) type 16 or 18 and the possible utility of type-specific HPV testing in clinical practice. J Natl Cancer Inst. 2005 Jul 20;97(14):1072–9. [PubMed]
33. Castle PE. Invited commentary: is monitoring of human papillomavirus infection for viral persistence ready for use in cervical cancer screening? Am J Epidemiol. 2008 Jul 15;168(2):138–44. [PubMed]
34. Carozzi F, Confortini M, Palma PD, Del MA, Gillio-Tos A, De ML, et al. Use of p16-INK4A overexpression to increase the specificity of human papillomavirus testing: a nested substudy of the NTCC randomised controlled trial. Lancet Oncol. 2008 Sep 8 [PubMed]