CONTEXT AND CAVEATS
Prior knowledge A recent policy change by the US. Department of Veterans Affairs (VA) has resulted in the underreporting of incident cancer cases to some cancer registries.
Study design Estimated numbers of missing VA cancer patients in 2005 were used to correct cancer incidence rates and trends in the Surveillance, Epidemiology, and End Results Program.
Contributions Due to the underreporting, overall cancer burden was underestimated by 1.6% for males and 0.05% for females. Changes in long-term incidence were modest and occurred mainly among black males.
Implications The reduced reporting of VA patients to central cancer registries led to an underestimation of cancer incidence that modestly changed long-term trends.
Limitations The variance in the estimated adjustment factors was not determined.
From the Editors
A recent policy change by the US Department of Veterans Affairs (VA) regarding the sharing of VA cancer data has resulted in incomplete reporting of VA hospital patients to some central cancer registries. For example, the state of California reported a lower than expected number of cancer patients for 2005, due to the underreporting of VA hospital patients (Robbins AS, Bates JA, Cress RD, Nadia Howlader, MS, Lynn A. Ries, MS, David G. Stinchcomb, MS, MA, Brenda K. Edwards, PhD., unpublished data, 2007). The Surveillance, Epidemiology, and End Results (SEER) Program of the National Cancer Institute (NCI) generates annual cancer statistics using data from population-based cancer registries covering approximately 26% of the US population. Underreporting of VA hospital patients potentially could distort population cancer incidence statistics (
1,
2) that were published by the SEER Program in April 2008 for patients diagnosed through 2005 (
3).
This report estimates the impact of these missing VA hospital patients in 2005 on SEER incidence rates and trends. We used patient counts from VA hospitals in SEER regions to establish baseline VA hospital patient counts in years with no known underreporting and to estimate missing VA hospital patients for 2005. We then adjusted final patient counts for selected primary cancer sites based on the estimated missing patients. Finally, we compared long-term trends summarized by annual percent change (APC) (
4) with and without the VA adjustment.
The de-identified data reported to SEER do not indicate whether a patient comes from a VA hospital. To estimate the underreporting, most SEER registries provided a special tabulation of VA hospital patient counts for 2000–2005 that were stratified by year of diagnosis, sex, primary cancer site, and 5-year age group, with no patient identifiers. VA patients may receive some treatment at non-VA facilities and would be reported by those facilities, but data provided by the SEER registries were for patients who were treated only at VA facilities. We excluded from our analysis four SEER registries that did not experience interruptions in VA reporting to state registries for cancers diagnosed through 2005. We also excluded the Louisiana Tumor Registry from our analysis. The Louisiana Tumor Registry submitted VA hospital patient counts, but population displacement following Hurricanes Katrina and Rita confounded the effects of the underreporting of 2005 VA hospital patients.
For each registry, we estimated the proportion of VA hospital patients by year of diagnosis (2000–2005) and sex. We used an average based on 2000–2003 proportions as a baseline for comparison with 2005. Differences between the 2005 proportions and the 2000–2003 average proportions were used to estimate the number of missing VA hospital patient counts in 2005 by registry, sex, age, and other covariates of interest, such as race and cancer site. We added the estimated numbers of missing patients for each age stratum to the total reported patients in 2005 to adjust for VA underreporting. Age-adjusted cancer incidence rates were then calculated with and without adjustment for VA underreporting. The ratio between these age-adjusted cancer incidence rates yielded a factor that was then used to adjust the 2005 overall incidence rates. We estimated VA adjustments based on nondelay adjusted counts. In addition, we estimated non–VA-adjusted rates using nondelay adjusted counts. Additional information on this calculation is available in the 2008 release of the SEER Cancer Statistics Review (
5).
We found that the underreporting of VA hospital patients led to the overall cancer burden in selected SEER registries to be underestimated by 1.6% for males () and 0.05% for females (data not shown). Because female patients are a small proportion of the total VA hospital caseload, we focused on male VA hospital patients and examined overall cancer (by race) and the 10 leading primary cancer sites. In 2000–2003, male VA hospital patients were 3.7% of the overall cancer patients (3.4% white and 8.4% black); by contrast, in 2005 VA hospital patients were 2.1% (1.9% white and 4.5% black). Therefore, we estimated that the percentage of missing patients was 1.6% overall (1.5% white and 3.9% black). Among the top 10 cancers, the percentage estimated to be missing ranged from 2.5% for liver cancer to 0.4% for melanoma of the skin. Adjustment factors for overall cancer to correct for the underreporting of 2005 age-adjusted incidence rates for SEER-17, excluding the Louisiana Tumor Registry regions, were 1.015, 1.012, and 1.035 for all races, white males, and black males, respectively ().
| Table 1Percentage of cancer patients from VA facilities by year of diagnosis, estimated percentage of missing cancer patients for 2005, and VA adjustment factors for 2005 age-adjusted incidence rates. All sites combined (all races, whites, blacks) and top 10 (more ...) |
We also derived adjustment factors for SEER-9 regions to investigate the impact of VA underreporting on long-term trends of delay-adjusted incidence rates. Trends for overall cancers and the 10 leading cancer sites with and without VA adjustment factors for the 2005 incidence data were compared (). Joinpoint statistical software (
6,7) was used to fit trends over time and to evaluate when changes in trends occurred. Results show that adjusting for VA underreporting raised the APC slightly in the most recent reporting years for all sites combined and for cancers of the prostate, lung and bronchus, and melanoma of the skin. Although the VA-adjusted incidence trends showed very little change in the interpretation and conclusion of long-term trends, we detected a new change point for overall trends in black males in 1995, when trends were stable. We also observed a statistically significant decrease in trends for black males in the final segment (1995–2005), when incidence decreased 1.3% per year.
| Table 2Comparison of long-term delay-adjusted incidence trends with and without VA adjustment for SEER-9 areas among males, 1975–2005* |
In summary, VA-adjusted incidence rates may be more accurate in capturing current SEER trends, even if the change in rates appears to be slight. A limitation of the adjustment factors is that they are not presented with the statistical uncertainty of the estimates. In reporting cancer trends, a change of as little as 1% per year demonstrates improvements or causes alerts in cancer control efforts. Such changes could easily be obscured by incomplete reporting of VA hospital data. Trends for black males in particular could be underestimated severely in the future. Our current analysis also shows that the number of patients missed in underreporting can be as large as those missed in the reporting delay that impacts national cancer incidence rates every year (
7). Reporting delay is predicted and adjusted for in the presentation of the annual cancer statistics. More importantly, unlike reporting delays in which patients are captured with the passage of time, underreporting of the VA patients could result in patients being permanently missed. Thus, the absence of VA data could compromise the accuracy and completeness of estimates of the US national cancer burden. The VA and the cancer registry community therefore must continue their efforts to restore integration of cancer data on VA patients with data from state and regional population-based registries. This should not be an impossible task. The cancer registry community has a strong commitment to and experience in protecting patient confidentiality while advancing cancer control and surveillance research.