PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of bmjThis ArticleThe BMJ
 
BMJ. 2007 May 19; 334(7602): 1014–1015.
PMCID: PMC1871738

The value of administrative databases

Mohammed A Mohammed, senior research fellow and Andrew Stevens, professor

Is improving but their contribution to improving quality of care remains unclear

Modern health care involves the routine collection of administrative data primarily for management and accounting purposes. Such databases include some clinical data (such as type of surgery, diagnosis, length of stay) that might be useful in monitoring quality of care.1 2 3 4 In this week's BMJ, Aylin and colleagues5 have used hospital episode statistics (HES) data, which are routinely collected by the UK National Health Service, to develop statistical models for predicting hospital mortality adjusted for case mix in three well defined clinical areas—cardiac surgery, aortic aneurysm repair, and colorectal cancer.

Previous comparisons of administrative databases and clinical databases or medical notes (chart review) have found administrative databases to be lacking in three important ways—scope (the relevant data not available), data quality, and ability to adjust for factors relating to patient case mix.1 2 3 4 5 6 This has led to the credibility of administrative databases being questioned, but as a result of several high profile events, this view of HES data may be changing.

In 2001, Dr Foster7 used HES data to produce standardised mortality ratios adjusted for case mix using methodology proposed by Jarman and colleagues.8 The methodology was later adopted by the Institute for Healthcare Improvement in the United States in its drive to reduce hospital mortality.9 In 2002, the inquiry into the high death rates after paediatric cardiac surgery in Bristol used HES (as well as a clinical database) to show that Bristol was a statistical outlier.10 The inquiry report stated that HES “was [sic] not recognised as a valuable tool for analysing the performance of hospitals. It is now, belatedly.” Furthermore, the inquiry also remarked that the “dual” system (HES and the clinical database) of collecting data in the health service was “wasteful and anachronistic.”11 In 2004, Harley and colleagues12 also used HES data retrospectively to show that Rodney Ledward, the discredited gynaecologist who was the subject of the Ritchie Inquiry, was also a statistical outlier. Also in 2004, the BMJ started publishing Dr Foster case notes,13 which draw on analyses of HES data undertaken by the Dr Foster Research Unit.7

The present study by Aylin and colleagues5 shows that HES based models to predict hospital mortality, in three well defined conditions, compare favourably with dedicated clinical databases. Although the choice and interpretation of some of the variables (such as year and deprivation) may be questionable, in statistical terms HES based models predict hospital mortality as well as their clinical counterparts. Clinical databases are often more costly; so are they still necessary?

In our view, it would be premature to discard clinical databases, because their purpose is not limited to predicting mortality. They may also measure longer term outcomes, incorporate rapid changes in treatments (administrative databases are constrained by inertia), and include other outcomes (such as quality of life) that are not often found on administrative databases. Furthermore, administrative databases seldom (without linkage) cover mortality adequately. In-hospital mortality is a key outcome only in a few important diseases. Other potentially useful process outcomes such as length of stay are also limited. Crucially, clinical databases are clinically owned vehicles driven to improve quality of care through a peer led educational process, as exemplified by the Department of Veterans Affairs.14 Currently, HES data are not.

We advocate that where HES based analyses are accurate they should be incorporated into the existing quality improvement framework alongside clinical databases. This would help clinicians to test their usefulness in delivering quality improvement and so develop trust in the quality of HES data. Only when HES based analyses are considered fit for purpose, after extensive comparison with clinical databases, would the criticism about “dual” databases be valid.11 Dual databases can be useful, however. For example, hospital death rates adjusted for case mix after surgery for congenital heart disease in the UK identified Oxford Radcliffe Hospital as a high outlier using HES data, but this was explained by incomplete case ascertainment in HES, which recorded 20% fewer cases than the central cardiac audit database.15

Another routinely collected data set—which unlike administrative databases has not been closely scrutinised—that is fit for purpose, clinically meaningful, and has no apparent credibility problems is laboratory data. Prytherch and colleagues16 17 showed that models for predicting hospital mortality produced from laboratory data were as good as the best models reported by Aylin and colleagues.5 This is even more remarkable as Prytherch and colleagues predicted deaths in general surgery and general medicine and not the specific areas selected by Aylin and colleagues.5 Most modern hospitals now have computerised laboratory databases so further research into the use of these databases is needed.

Ultimately a key purpose of data (and analyses) is to support continual quality improvement. While clinical databases have a track record in delivering improvement, the extent to which administrative databases can be incorporated into clinical quality improvement processes remains, by and large, to be seen.

Notes

Competing interests: None declared.

Provenance and peer review: Commissioned; not externally peer reviewed.

References

1. Iezzoni L. Assessing quality using administrative data. Ann Intern Med 1997;127:666-74. [PubMed]
2. Mcloughlin V, Millar J, Mattke S, Franca M, Jonsson PA, Somekh D, et al. Selecting indicators for patient safety at the health system level in OECD countries. Int J Qual Health Care 2006;(suppl 1):14-20.
3. Williams JG, Mann RY. Hospital episode statistics: time for clinicians to get involved? Clin Med 2002;2:34-7. [PubMed]
4. Gordon HS, Johnson ML, Wray NP, Petersen NJ, Henderson WG, Khuri SF, et al. Mortality after noncardiac surgery. Prediction from administrative versus clinical data. Med Care 2005;43:159-67. [PubMed]
5. Aylin P, Bottle A, Majeed A. Use of administrative data or clinical databases as predictors of risk of death in hospital: comparison of models. BMJ 2007. doi: 10.1136/bmj.39168.496366.55
6. Marshall W. Administrative databases: fact or fiction? CMAJ 1998;158:489-90. [PMC free article] [PubMed]
7. Dr Foster. Homepage www.drfoster.co.uk/.
8. Jarman B, Gault S, Alves B, Hider A, Dolan S, Cook A, et al. Explaining differences in English hospital death rates using routinely collected data. BMJ 1999;318:1515-20. [PMC free article] [PubMed]
9. The Institute for Healthcare Improvement. Move your dot: measuring, evaluating, and reducing hospital mortality rates. 2005. www.ihi.org/IHI/Results/WhitePapers/MoveYourDotMeasuringEvaluatingandReducingHospitalMortalityRates.htm.
10. Department of Health. Report of the public inquiry into children's heart surgery at the Bristol Royal Infirmary 1984-1995: learning from Bristol. (The Kennedy Report.) London: Stationery Office, 2001
11. Bristol Royal Infirmary Inquiry. Learning from Bristol: the report of the public inquiry into children's heart surgery at the Bristol Royal Infirmary 1984-1995 July 2001. www.bristol-inquiry.org.uk/.
12. Harley M, Mohammed MA, Hussain S, Yates J, Almasri A. Was Rodney Ledward a statistical outlier? Retrospective analysis using routine hospital data to identify gynaecologists' performance. BMJ 2005;330:929. [PMC free article] [PubMed]
13. Clark J. Dr Foster case notes. BMJ 2004;328:362
14. Khuri SF, Daley J, Henderson WG. The comparative assessment and improvement of quality of surgical care in the Department of Veterans Affairs. Arch Surg 2002;137:20-7. [PubMed]
15. Keogh B. Surgery for congenital heart conditions in Oxford. BMJ 2005;330:319-3. [PMC free article] [PubMed]
16. Prytherch DR, Sirl JS, Weaver PC, Schmidt P, Higgins B, Sutton GL. Towards a national clinical minimum data set for general surgery. Br J Surg 2003;90:1300-5. [PubMed]
17. Prytherch DR, Sirl JS, Schmidt P, Featherstone PI, Weaver PC, Smith GB. The use of routine laboratory data to predict in-hospital death in medical admissions. Resuscitation 2005;66:203-7. [PubMed]

Articles from The BMJ are provided here courtesy of BMJ Publishing Group