PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of pubhealthrepLink to Publisher's site
 
Public Health Rep. 2008 Jan-Feb; 123(1): 39–44.
PMCID: PMC2099324
The San Diego Immunization Survey: A Model for Local Vaccination Coverage Assessment
Jill C. Davila, MSPH,ab Wendy Wang, MPH,c Kathe W. Gustafson, MPH,c and Philip J. Smith, PhDa
aNational Center for Immunization and Respiratory Diseases, Centers for Disease Control and Prevention, Atlanta, GA.
bLogistics Health Incorporated, La Crosse, WI.
cSan Diego Health and Human Services Agency, Immunization Branch, San Diego, CA
Address correspondence to: Jill C. Davila, MSPH, National Center for Immunization and Respiratory Diseases, Centers for Disease Control and Prevention, 1600 Clifton Rd. NE, MS-C25, Atlanta, GA 30333, Phone: 404-639-4059, Fax: 404-639-3059, ; eaq9/at/cdc.gov
Objective
Assessing vaccination coverage as part of a comprehensive intervention has been demonstrated to result in increased coverage rates. The National Immunization Survey provides coverage estimates at the national level and selected urban areas. However, it is important for other localities to understand vaccination coverage in their areas. The San Diego Immunization Branch conducts the San Diego Immunization Survey (SDIS) to gather vaccination coverage information in San Diego County. This article describes the methodology and results of the SDIS.
Methods
The SDIS is a two-phase immunization survey. The first phase is a random-digit-dialing survey in which vaccination information is obtained by phone. The second phase involves the verification of this information and/or obtaining vaccination information via the registry or the child's provider(s).
Results
In 2005, the sample size included 839 respondents. From 1995 to 2005, coverage for the following individual vaccines increased: diphtheria and tetanus toxoids, and acellular pertussis (92.0% to 96.5% for ≥3 doses, and 75.0% to 89.0% for ≥4 doses), polio (83.0% to 94.7%), measles-mumps-rubella (85.0% to 95.8%), Haemophilus influenzae type b (87.0% to 93.2%), and hepatitis B (67.0% to 93.6%).
Conclusion
The results of the SDIS demonstrate that San Diego County has exceeded the Healthy People 2010 goal to reach at least 80% coverage for the series of universally recommended vaccinations.
Evidence suggests that assessing vaccination coverage, as part of a comprehensive approach, leads to increased vaccination coverage levels.13 The Advisory Committee on Immunization Practices and the Task Force on Community Preventive Medicine have identified assessment as an important tool toward increasing immunization coverage.4,5 To understand improvement toward reaching the Healthy People 2010 goal of achieving and sustaining effective coverage for universally recommended vaccines, the Centers for Disease Control and Prevention (CDC) has monitored vaccination coverage using the National Immunization Survey (NIS) for the 50 states, District of Columbia, and selected large urban areas since 1994.6 However, vaccination coverage estimates from the large geographic areas surveyed by the NIS may not be representative of certain areas within the state because coverage may vary among a state's localities. Therefore, it is important for local health departments to be aware of other methods to estimate their own coverage.
The San Diego Immunization Survey (SDIS) is conducted annually by the County of San Diego Health and Human Services Agency's Immunization Branch (SDIB). Since 1995, the SDIS has provided annual vaccination coverage estimates for 19- to 35-month-old children living in San Diego County, California. The SDIS uses a combination of parental input, registry data, and provider verification to estimate coverage in San Diego. San Diego County uses annual estimates of vaccination coverage obtained from the SDIS to monitor and improve immunization services in its community.
This survey could be used by other localities to assess coverage to improve immunization services and vaccination rates. The resources a locality would need to dedicate to performing such a survey may be validated by the benefit it can have toward decreasing the risk of vaccine-preventable diseases in the community.
The methodology of the SDIS is a modification of the methods used by the NIS.6 Data obtained from the SDIS are collected in two phases: a telephone survey followed by verification of immunization information when necessary.
In the first phase, a random-digit-dialing (RDD) telephone survey is conducted annually between March and June. The RDD methodology is used to identify households in San Diego that have a 19- to 35-month-old child. When a household with an appropriately aged child is identified, demographic information about the household is obtained from the RDD respondent. Eighty-five percent (711/839) of the 2005 SDIS respondents were the mothers of the age-eligible children identified in the household. If the respondent has a state-issued written immunization record for the child, he/she is asked to read from that record the dates when the child received doses of diphtheria, tetanus toxoids, and acellular pertussis (DTaP), polio, measles-mumps-rubella (MMR), Haemophilus influenzae type b (Hib), hepatitis B (HepB), varicella (VAR), pneumococcal conjucate vaccine (PCV), hepatitis A (HepA), and influenza (flu) vaccine. The respondent is also asked to read the name and contact information for the provider that administered each dose. If the written immunization record used during the RDD interview indicates that the child was fully vaccinated, the SDIB considers the report to be a sufficient documentation of immunization history and further information is not requested from either the child's vaccination provider or the registry.
If an immunization record is not available, then the number of doses is recorded from the respondent's memory. In the 2005 SDIS, a child was considered to be fully vaccinated if information from the immunization record showed that the child had received doses approximately at the recommended ages and intervals of ≥4 doses of DTaP, ≥3 doses of polio, ≥1 dose of MMR, ≥3 doses of Hib, ≥3 doses of HepB, ≥1 dose of VAR (or history of varicella disease), ≥3 doses of PCV, 1 dose of HepA if the child was ≥24 months of age or 2 doses of HepA if the child was ≥30 months of age and more than six months had passed since his/her first dose, and ≥1 dose of flu vaccine. If the immunization record did not indicate that one dose of flu vaccine was administered, then the respondent's recall was accepted. Surveys in years prior to 2004 do not include all of these vaccines. As new vaccines become available and recommended, the SDIB adds them to the list of vaccines that it monitors through the SDIS.
The second phase of data collection is conducted if the RDD respondent's report of the child's vaccination history is not read from an immunization record or if data from the immunization record do not show that the child is fully vaccinated. Consent to contact the child's provider is requested verbally from all respondents during the telephone interview. If consent is obtained and second-phase data collection is warranted, the San Diego Regional Immunization Registry (SDIR) is queried to verify the child's vaccination history. If a complete immunization record cannot be acquired using SDIR, then it is requested from the child's medical provider(s). The SDIB attempts to contact local, out-of-state, and out-of-country providers for verification. Although providers typically comply with the request for verification, some ask for documentation. In these situations, SDIB sends a form with the interviewer's signature on it stating that verbal consent was received from the respondent during the telephone interview. If the provider insists on receiving written consent from the respondent, SDIB is not able to obtain the information necessary to verify immunization status.
Survey data collected by the SDIS are weighted to represent the target population of children 19 to 35 months of age living in San Diego County. The statistical weighting methods account for the probability of being sampled, households that do not have a telephone, and nonresponse from medical providers. Initial weights are constructed using poststratification so that the distribution of the weighted sample with respect to the selected demographic characteristics is identical to the same distribution in the population in San Diego. Nonresponse from medical providers is handled in the same way it is handled in the NIS.7
The interview completion rate for the SDIS is the number of RDD interviews completed divided by the total number of households identified with an age-eligible child. This rate ranged from 70.0% in 2002 to 89.1% in 1995; in 2005, it was 79.2%. An interview was considered complete if the majority of the questions were answered. The final 2005 unweighted sample size of completed interviews was 839; from 1995 to 2004, it ranged from 400 to 902. Among the 839 children for whom completed RDD interviews were obtained in 2005, vaccination histories that could be used to estimate vaccination coverage were obtained for 714 (85.1%) of the children. Provider-reported vaccination histories were not sought for 159 children because they were considered fully vaccinated based on their household written immunization records.
Estimates of vaccination coverage from the SDIS indicate that the estimated percentage of children who received at least the recommended number of doses for DTaP, MMR, polio, Hib, and HepB increased from 1995 to 2005 (Table 1). In 2005, coverage estimates for the 4:3:1 series (≥4 doses DTaP, ≥3 doses polio, ≥1 dose MMR), 4:3:1:3:3 series (≥4 doses DTaP, ≥3 doses polio, 1≥ dose MMR, ≥3 doses Hib, ≥3 doses HepB), and 4:3:1:3:3:1 series (≥4 doses DTaP, ≥3 doses polio, ≥1 dose MMR, ≥3 doses Hib, ≥3 doses HepB, ≥1 dose VAR) were 87.8%, 84.9%, and 82.8%, respectively. Children ≥24 months of age had higher coverage rates than children <24 month of age. From 2002 to 2005, coverage for ≥1 dose of VAR exceeded 90% annually. Additionally, a substantial increase from 68% to 86% for ≥3 doses of PCV from 2004 to 2005 was observed.
Table 1
Table 1
Weighted immunization coverage with individual vaccines and selected vaccination series, children aged 19–35 months in San Diego County, San Diego Immunization Survey, 1995–2005
Differences in 2005 SDIS coverage estimates between Hispanic and non-Hispanic white respondents were not significant for ≥3 doses of DTaP, ≥4 doses of DTaP, ≥1 dose of MMR, 2 doses of flu, the 4:3:1 series, and the 4:3:1:3:3 series (Table 2). Coverage estimates for ≥3 doses of polio, ≥3 doses of Hib, ≥3 doses of HepB, ≥1 dose of VAR, HepA, and the series 4:3:1:3:3:1 were significantly higher for Hispanic compared with non-Hispanic white respondents. Hispanic children had significantly lower coverage for PCV and 1 dose flu vaccine than non-Hispanic white children.
Table 2
Table 2
Weighted immunization coverage with individual vaccines and selected vaccination series, children aged 19–35 months in San Diego County, San Diego Immunization Survey, 2005
Our findings indicate that vaccination coverage in San Diego County is improving and exceeds the Healthy People 2010 goal to increase immunization coverage of all vaccines that have been universally recommended for at least five years (4 DTaP, 3 polio, 1 MMR, 3 Hib, and 3 HepB; 4:3:1:3:3) to exceed 80% in 19- to 35-month-old children.8 Additionally, the traditional gaps in vaccination coverage attributed to Hispanic ethnicity appear to be mostly eliminated in this age group, in San Diego County. Given that about 43.2% of births in San Diego County are Hispanic,9 this is an important finding.
Because the SDIS accepts a complete, valid immunization history read by the respondent from an immunization record as proof of immunization status, it relies less on obtaining vaccination histories from providers than the NIS. As a result, the SDIS is less resource intensive compared with the NIS.
Because the NIS is a survey that collects data monthly, it collects data on more birth cohorts than the survey conducted by San Diego, which collects data only from March through June. Therefore, the coverage estimates from these surveys are only approximately comparable with respect to the cohorts included in their samples. In 2000, 2002, 2003, and 2004, the estimated 4:3:1:3:3 coverage rates for the San Diego survey were significantly higher by 11.6%, 9.2%, 6.4%, and 5.7%, respectively, than national estimates produced by the NIS, while there was no significant difference in 2004.10
Limitations
The findings in this article are subject to several biases. The SDIS is a landline telephone survey that may not be representative of the entire population. Although weighted to be representative, the statistical adjustments may not accurately account for nonselected households, nonresponders, and households lacking a landline telephone. These adjustments make the assumption that nonresponding households are similar to responding households. Because the data from nonresponding households are not observed, this assumption cannot be confirmed.
The SDIS has been used to evaluate vaccination coverage in San Diego County since 1995. Results from the SDIS can be used to better understand what true vaccination coverage is in San Diego County. Additionally, it has been used to measure other age groups and to improve programmatic planning. The SDIS has posed questions that are of particular interest to San Diego, such as parents' attitudes toward and knowledge of vaccines. Data on those issues can be useful to better target areas of low coverage.
The information obtained by this survey has been used to improve immunization services and thus increase vaccination coverage in San Diego County. By decreasing the risk of children acquiring vaccine-preventable diseases, the cost of this study may be justified. Another benefit of the SDIS is that the data are collected in one quarter as opposed to a full year for the NIS. The shorter time frame allows the results to be available in a more timely fashion. These benefits suggest that the SDIS is a useful model of a county-level immunization survey that other health departments may wish to adopt.
Acknowledgments
In recognition of significant assistance in developing this article, the authors acknowledge the contributions of Q Li at the National Center for Immunization and Respiratory Diseases, Centers for Disease Control and Prevention, Atlanta, GA.
The findings and conclusions in this article are those of the authors and do not necessarily represent the views of the funding agency.
1. LeBaron CW, Chaney M, Baughman AL, Dini EF, Maes E, Dietz V, et al. Impact of measurement and feedback on vaccination coverage in public clinics, 1988-1994. JAMA. 1997;277:631–5. [PubMed]
2. Buffington J, Bell KM, LaForce FM. A target-based model for increasing influenza immunizations in private practice. J Gen Intern Med. 1991;6:204–9. [PubMed]
3. Massoudi MS, Walsh J, Stokley S, Rosenthal J, Stevenson J, Miljanovic B, et al. Assessing immunization performance of private practitioners in Maine: impact of the assessment, feedback, incentives, and exchange strategy. Pediatrics. 1999;103(6 Pt 1):1218–23. [PubMed]
4. Task Force on Community Preventive Services. Recommendations regarding interventions to improve vaccination coverage in children, adolescents, and adults. Am J Prev Med. 2000;18(1 Suppl):92–6. [PubMed]
5. Recommendations of the Advisory Committee on Immunization Practices: programmatic strategies to increase vaccination rates-assessment and feedback of provider-based vaccination coverage information. MMWR Morb Mortal Wkly Rep. 1996;45(10):219–20. [PubMed]
6. Smith PJ, Hoaglin DC, Battaglia MP, Khare M, Barker LE. Statistical methodology of the National Immunization Survey: 1994–2002. [cited 2006 Apr 28];Vital Health Stat 2. 2005 138:1–55. Also available from: URL: http://www.cdc.gov/nchs/data/series/sr_02/sr02_138.pdf. [PubMed]
7. Smith PJ, Rao JN, Battaglia MP, Ezzati-Rice TM, Daniels D, Khare M. Compensating for provider nonresponse using response propensities to form adjustment cells: the National Immunization Survey. National Center for Health Statistics. Vital Health Stat 2. 2001;133:1–17. [PubMed]
8. Department of Health and Human Services (US) Healthy people 2010: immunization and infectious disease. [cited 2007 Jan 20]. Available from: URL: http://www.healthypeople.gov/Document/HTML/Volume1/14Immunization.htm.
9. State of California Department of Health Services: Center for Health Statistics. Birth statistical master files. 2004
10. National, state, and urban area vaccination coverage among children aged 19–35 months—United States, 2004. MMWR Morb Mortal Wkly Rep. 2005;54(29):717–21. [PubMed]
Articles from Public Health Reports are provided here courtesy of
Association of Schools of Public Health