PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of brjgenpracRCGP homepageJ R Coll Gen Pract at PubMed CentralBJGP at RCGPBJGP at RCGP
 
Br J Gen Pract. Jul 1, 2010; 60(576): 495–500.
PMCID: PMC2894378
Validating the prediction of lower urinary tract infection in primary care: sensitivity and specificity of urinary dipsticks and clinical scores in women
Paul Little, MD, FRCGP, MRCP, Professor
Community Clinical Sciences Division (CCS), Southampton University, Southampton
Kate Rumsby, BA
Community Clinical Sciences Division (CCS), Southampton University, Southampton
Rachel Jones*
Community Clinical Sciences Division (CCS), Southampton University, Southampton
*The authors would like to dedicate this paper to Dr Rachel Jones who recently died unexpectedly
Greg Warner, MA, MRCGP, DCH, DRCOG, DSEM, GP
Nightingale Surgery, Romsey
Michael Moore, BMed Sci, MSc, MRCP, MRCGP, GP
Three Swans Surgery, Salisbury
J Andrew Lowes, BSc, MRCP, FRCPath
Southampton Health Protection Agency Laboratory, Southampton
Helen Smith, MSc, MD, MRCGP, FFPHM, Professor
Community Clinical Sciences Division (CCS), Southampton University, Southampton
Catherine Hawke, Public Health Physician
Hastings and St Leonard Primary Care Trust, St Leonards-on-Sea
Geraldine Leydon, Senior Research Fellow
Community Clinical Sciences Division (CCS), Southampton University, Southampton
Mark Mullee, MSc, CStat
Community Clinical Sciences Division (CCS), Southampton University, Southampton
Address for correspondence Professor P Little, University of Southampton, Aldermoor Health Centre, Aldermoor Close, Southampton, SO16 5ST. E-mail: p.little/at/soton.ac.uk
Background
Dipsticks are one of the most commonly used near-patient tests in primary care, but few clinical or dipstick algorithms have been rigorously developed.
Aim
To confirm whether previously documented clinical and dipstick variables and algorithms predict laboratory diagnosis of urinary tract infection (UTI).
Design of study
Validation study.
Setting
Primary care.
Method
A total of 434 adult females with suspected lower UTI had bacteriuria assessed using the European Urinalysis Guidelines.
Results
Sixty-six per cent of patients had confirmed UTI. The predictive values of nitrite, leucocyte esterase (+ or greater), and blood (haemolysed trace or greater) were confirmed (independent multivariate odds ratios = 5.6, 3.5, and 2.1 respectively). The previously developed dipstick rule — based on presence of nitrite, or both leucocytes and blood — was moderately sensitive (75%) but less specific (66%; positive predictive value [PPV] 81%, negative predictive value [NPV] 57%). Predictive values were improved by varying the cut-off point: NPV was 76% for all three dipstick results being negative; the PPV was 92% for having nitrite and either blood or leucocyte esterase. Urine offensive smell was not found to be predictive in this sample; for a clinical score using the remaining three predictive clinical features (urine cloudiness, dysuria, and nocturia), NPV was 67% for none of the features, and PPV was 82% for three features.
Conclusion
A clinical score is of limited value in increasing diagnostic precision. Dipstick results can modestly improve diagnostic precision but poorly rule out infection. Clinicians need strategies to take account of poor NPVs.
Keywords: algorithms, clinical scoring; diagnosis, urinary tract infection; primary care; urinalysis
Acute urinary tract infection (UTI) is one of the most common acute bacterial infections among adult females.1,2
Empiric antibiotic treatment has been advocated as cost-effective,3 but unselective antibiotic use will result in a growing problem of antibiotic resistance, which has been identified in 20% of laboratory specimens.4,5 There are current proposals to make courses of trimethoprim available over the counter. This potential overuse of antibiotics for UTI creates an urgent need to address the question: can we use history and physical examination, or near-patient tests, for better diagnosis and targeting of antibiotics?
A systematic review of the role of symptoms in diagnosis identified few high-grade studies (those with ≥50 consecutive patients, and independent blind comparison of symptoms and signs with a gold standard among patients with suspected UTI), none of which were based in primary care.6 Only one study, which had poor methodology, assessed the predictive value of combining symptoms; and all previous studies used a very insensitive cut-off for laboratory diagnosis, whereas recent laboratory diagnosis standards suggest colony counts down to 103 cfu/ml (colony-forming units per millilitre) are classified as UTI.7
How this fits in
This is one of the few adequately powered studies in primary care to confirm which clinical variables and range of dipstick variables independently predict rigorous laboratory diagnosis of urinary tract infection (UTI), and to validate clinical decision rules based on these independent predictors. Among female patients presenting with suspected uncomplicated UTI in primary care, those with dysuria, cloudy urine, and nocturia are very likely to have UTI, but even when all these features are absent, 33% of patients presenting with suspected uncomplicated UTI have UTI. A clinical decision rule based on either nitrite or both leucocytes and blood could also be used to target investigations or treatment, but the negative predictive values are poor: even when all these dipstick results are negative, 24% of female patients still have UTI.
Clinicians commonly use dipsticks to rule out infection, and they are the most widely used simple near-patient test in primary care.811 Although summary data are available for studies that assessed nitrite and leucocyte esterase separately, primary data are needed to assess the independent predictive value of all dipstick results.12 The evidence base for dipstick use in primary care is poor, due to the paucity of studies and ‘spectrum bias’.6,11,13
Studies from primary care have a range of one or more limitations:9,11,1418 they have either not assessed the independent value of dipstick results and symptoms (hence potentially over-complicating clinical decision rules); and/or not used the range of dipstick variables (most include nitrite and leucocyte but not blood); and/or failed to develop and then test algorithms in separate samples (McIsaac et al being the exception16); and/or had low power. Only the most recent dipstick studies have used the recent more rigorous laboratory guidelines for diagnosis.16,18
The current authors have reported a study where a clinical score and a dipstick score were developed for women presenting with suspected UTI.19 The independent predictive values of symptoms and of dipsticks results were assessed. Based on accumulating evidence and recent international consensus, the latter study used more sensitive laboratory gold standards to include lower colony counts.19 However, the predictive value of any scoring system that is tested in the same sample used to calculate the scoring system is likely to have artificially inflated predictive values: both a training and a validation set are needed. To estimate the more realistic predictive values of these scores, this study assessed the predictive value of the scores and the component variables of the scores in a new validation sample.
Setting
Between January 2002 and February 2005, 117 primary care clinicians (doctors or practice nurses) from 62 practices in the south of England recruited 434 patients following informed, written consent. The clinicians recruited consecutive patients, and most recruited only a few patients before stopping recruitment.
Data collection
Structured clinical information was recorded by the clinician at the time of consultation. Patients were asked to rate each symptom they experienced as a slight problem, a moderately severe problem, or a severe problem.20,21 Midstream urine (MSU) was examined for cloudiness to the naked eye and offensive smell prior to performing a dipstick test (Bayer Multistix® 8 SG),9 which was performed according to the manufacturer's instructions.
Inclusion criteria
Inclusion criteria were adult female patients (aged 18 to 70 years) with suspected UTI — which in practice usually meant patients with a history of dysuria and frequency. Exclusions were where other diagnoses were considered likely; (for example, patients with vaginal symptoms);6 pregnant women; age over 70 years since the relation between symptoms and bacteriuria is likely to be different in older age groups;2226 and also current severe mental problems (for example, dementia) where patients would have difficulty with consenting and answering questions.
Laboratory analysis
MSU was transported as in routine practice (which takes normally 1 day to reach the lab);19 10 μl of MSU was cultured onto cystine-lactose-electrolyte-deficient agar and incubated overnight at 37°C. The European Urinalysis Guidelines were used as the main reference standard.7 MSU was analysed by individuals who were blind to the clinic dipstick results.
Rationale for laboratory diagnosis
The American Society for Microbiology guidelines suggest reporting down to 102 cfu/ml of E. coli; however, European Urinalysis Guidelines acknowledge the problem of preventing multiplication of bacteria in transit, and advocate reporting counts down to 103 cfu/ml, or pure growth of E. coli, and suggest using higher counts for more unusual organisms or mixed growths.7
Postal questionnaire
The postal questionnaire asked patients about their demographics and medical history (including past history of UTI).
Sample size
For the sample size (α = 0.05; β = 0.2; NQuery sample size programme) it was assumed 50% of urine samples are infected,14 and the prevalence of predictive variables is 20–70%; to detect an odds ratio (OR) of 2 required 403 patients. For a sensitivity or specificity of 50% a total of 400 patients will provide 95% confidence intervals [CIs] of 43% to 57%, and for 80% sensitivity or specificity 74% to 86%.
Analysis
The variables found to be predictive from the previous study were assessed in multivariate logistic regression using Stata 9. Previously developed clinical scores were also assessed by cross-tabulation; any new scores were calculated based on simple counts of the rounded logistic coefficients, and the receiver operator curve was determined for each score. Performance of each score for different cut-offs in the score was assessed. At each cut-off, the sensitivity, specificity, positive and negative predictive values, likelihood ratios (LRs) for a positive test (sensitivity/[1—specificity]), LRs for a negative test ([1—sensitivity]/specificity), and the number above the cut-off were determined.
Study population
Less than 10% of eligible patients who were approached declined to participate. Of the 434 who agreed to participate, dipstick information was available for 429 (99%), and clinical information for 431 (99%); 219 (50%) patients were found to have high colony counts (≥105 cfu/ml), and 287 (66%) fulfilled the more sensitive criteria of lower colony counts (≥103 cfu/ml) according to European Urinalysis Guidelines.7 Of the 269 patients who returned the demographic questionnaire, 200 (74%) reported a previous UTI, 152 (57%) were married, and 152 (57%) were reported as having an educational qualification of GCSE (secondary intermediate qualification) or equivalent.
Assessing the predictive value of dipstick variables
Nitrites were found to be most predictive of UTI, followed by blood and then leucocytes (Table 1), with ORs very similar to those of the previous derivation study.19 The previously developed dipstick rule — based on having nitrite, or both leucocytes and blood19 — was moderately sensitive at 75% (95% CI = 71% to 78%) but less specific (66%; 95% CI = 60% to 72%) with a positive predictive value (PPV) of 81%, (95% CI = 77% to 84%) and a negative predictive value (NPV) of 57% (95% CI = 52% to 62%).
Table 1
Table 1
Dipstick predictors of laboratory diagnosis of urinary tract infection (UTI).
Predictive values were improved by varying the cut-off point: NPV was 76% (95% CI = 66% to 84%) for all three dipstick results being negative (see Table 2: cut-off point ≥1); PPV was 92% (95% CI = 86% to 96%) for having nitrite and either blood or leucocyte esterase (see Table 2: cut-off point ≥3).
Table 2
Table 2
Validation of dipstick score to predict laboratory diagnosis of urinary tract infection (UTI).a
Clinical variables
Only two of the original four predictive variables that were found to predict laboratory diagnosis from the derivation sample independently predicted UTI: cloudy urine, and dysuria rated as a moderately severe problem (Table 3). Moderately severe nocturia and offensive smell of urine were no longer significant. The original clinical decision rule from the derivation sample based on two or more of the above features was now found to have a sensitivity of 65% (95% CI = 62% to 68%), which was previously 65%; and a specificity of 59% (95% CI = 53% to 65%), which was previously 69% (see Table 4: cut-off point ≥2).
Table 3
Table 3
Clinical predictors of laboratory diagnosis of urinary tract infection (UTI).
Table 4
Table 4
Validation of clinical score to predict laboratory diagnosis of urinary tract infection (UTI).a
However, as the presence of nocturia to any degree was independently predictive (OR = 1.60, 95% CI = 1.01 to 2.55), a modified score was assessed so that simply the presence of the symptoms nocturia and dysuria were included without the need for severity rating. This resulted in increased sensitivity, but NPVs were still poor (Table 5): NPV was 67% for none of the features, and the PPV was 82% for three features.
Table 5
Table 5
Modified clinical score based on cloudy/burning any degree/night frequency any degree.a
Summary of main findings
This study confirms both the potential and the limitations of using dipstick and clinical information in routine clinical practice to predict laboratory diagnosis.
The previous clinical decision rule did not perform as well as in this derivation sample. PPVs remained quite similar to those found in the derivation study, but the NPV was poor. Not all the variables found to be predictive in the first study were as predictive in this study (urine smell was not found to be predictive in this sample). However, even using a modified score (Table 5) based on the variables confirmed to be predictive in this study (cloudiness, dysuria, nocturia) did not greatly improve the predictive values. The implications of this for practice are that clinicians can be reasonably confident that patients with suspected UTI who have dysuria, nocturia, and cloudy urine do have UTI, but they should be cautious about excluding patients based on the absence of these features.
Three dipstick variables identified previously to be most independently predictive of UTIs in the derivation sample were tested in a new dataset by multivariate analysis, and the multivariate ORs were similar to the previous study.19 The dipstick score performed significantly better than the clinical score. At a cut-off point in the score of ≥2 (equivalent to having nitrite, or both leucocytes and blood), both the sensitivity and specificity of the score was very similar to that found previously,19 as was PPV, but the NPV decreased from 65% (derivation sample) to 57% in this sample.
Although the predictive values could be improved by varying the cut-off points, the NPVs remained low. Thus, in practice, clinicians cannot rule out the diagnosis of UTI using either clinical information or dipstick results, and will need to use appropriate strategies, such as delayed prescription, to take account of the relatively low NPVs.
Strengths and limitations of the study
To the authors' knowledge, this study is the first to confirm the predictive value of a rigorously developed dipstick algorithm and of a clinical score in an adequately powered primary care sample, and the first to combine this with use of a rigorous laboratory standard for diagnosis. The recommended group was chosen, that is, those patients where UTI was the suspected diagnosis,6 and the sample had similar characteristics to UK national attending samples.2 The sample had a similar incidence of UTI to the authors' previous derivation study19 and to previous primary care studies.14
Limitations include the fact that multiple variables were used in developing the models, but type I error is less likely since the results were highly significant for most variables that were tested, and this is the second sample in which these findings apply.19 Results from this study may not apply to other groups (for example, where vaginal infection is suspected).6
Comparison with existing literature
Two recent studies in primary care have used the more rigorous lower colony count standards for the diagnosis of UTI.16,18 The validation study by McIsaac et al, which combined clinical information and dipstick results (two or more of dysuria, leucocytes, and nitrites) did not weight these variables, did not use dipstick haematuria, and demonstrated modest predictive values (LR +ve test = 1.73 and LR –ve test = 0.43).16 This supports the present authors' previous findings that clinical information is unlikely to add greatly to the predictive value when all three predictive variables from dipsticks are used.19
The study by Hummers-Pradier et al had similar limitations (it did not use dipstick haematuria, did not weight variables, and had no separate derivation and validation samples) and also found modest predictive values.9
However, even though the present study has confirmed modestly better predictive values, they are still far from optimal. Predictive values can be maximised by varying the cut-off points in the score: with all three dipstick variables being negative, it would be reasonable to say that UTI would be unlikely (NPV = 76%); however, even with this higher NPV, 24% of patients would be told they have no UTI when in fact they do.
Implications for clinical practice and future research
The pattern of clinical information in suspected UTI is of limited value in increasing diagnostic precision: although UTI is likely among patients with dysuria, nocturia, and urine cloudiness, the absence of these features performs poorly in ruling out UTI. A dipstick rule does improve diagnostic precision; but in applying the results of dipsticks, clinicians will still need to take account of the limited NPVs, which are low: even when all results are negative, 24% of female patients will still have UTI. This means that in practice clinicians should consider using strategies such as delayed prescribing for such patients,27,28 or alternatively advising a review consultation, if symptoms are not settling. Research into the practice implications of such strategies is also needed.
Acknowledgments
We are very grateful for the time given by GPs and nurses and all the patients who agreed to take part. We are also grateful to Bayer for provision of the 8SG strips.
Notes
Funding body
This study was funded by the Health Technology Programme of UK NHS Research and Development (reference 97/14/06).
Ethical approval
The study had South West MReC ethical committee approval (reference 03/6/11).
Competing interests
All authors except J Andrew Lowes have no competing interests and therefore have nothing to declare. J Andrew Lowes has been paid to attend consultancy workshops by Bayer and is currently working in collaboration with Bayer in an unpaid capacity.
Discuss this article
Contribute and read comments about this article on the Discussion Forum: http://www.rcgp.org.uk/bjgp-discuss
1. Foxman B. Epidemiology of urinary tract infections: incidence, morbidity, and economic costs. Am J Med. 2002;113(1) suppl 1:5s–13s. [PubMed]
2. HMSO, OPCS. Morbidity statistics from general practice: fourth national study 1991. London: HMSO; 1994.
3. Fenwick E, Briggs A, Hawke C. Management of urinary tract infection in general practice: a cost-effectiveness analysis. Br J Gen Pract. 2000;50(457):612–613. [PMC free article] [PubMed]
4. House of Lords, editor. House of Lords Select Committee on Science and Technology: 7th report. Occasional Report 1998. London: House of Lords; 1998.
5. Standing Medical Advisory Committee. Standing Medical Advisory Committee (SMAC) report: The path of least resistance. Occasional report 1998. London: Department of Health; 1998.
6. Bent S, Nallamothu B, Simel D, et al. Does this woman have an acute uncomplicated urinary tract infection? JAMA. 2002;287(20):2701–2710. [PubMed]
7. European Confederation of Laboratory Medicine. ECLM — European Urinanalysis Group European Analysis guidelines. Scand J Clin Lab Invest. 2000;60:1–96. [PubMed]
8. Bailey B. Urinanalysis predictive of urine culture results. J Fam Pract. 1995;40(1):45–50. [PubMed]
9. Ditchburn R, Ditchburn J. A study of microscopical and chemical tests for the rapid diagnosis of urinary tract infections in general practice. Br J Gen Pract. 1990;40(339):406–408. [PMC free article] [PubMed]
10. Schulz H, McCaffrey T, et al. Acute cystitis: a prospective study of laboratory tests and duration of therapy. Mayo Clin Proc. 1984;59(6):91–397. [PubMed]
11. Winkens RA, Leffers P, Trienekens TA, Stobberingh EE. The validity of urine examination for urinary tract infections in daily practice. Fam Pract. 1995;12(3):290–293. [PubMed]
12. Hurlburt T, Littenberg B. The diagnostic accuracy of rapid dipstick tests to predict urinary tract infection. Am J Clin Pathol. 1991;96(5):582–588. [PubMed]
13. Hobbs R, Delaney B, Fitzmaurice D. A systematic review of near patient testing in primary care. Health Technol Assess. 1997;1(5):1–229. i–iv. [PubMed]
14. Dobbs FF, Fleming DM. A simple scoring system for evaluating symptoms, history and urine dipstick testing in the diagnosis of urinary tract infection. J R Coll Gen Pract. 1987;37(296):100–104. [PMC free article] [PubMed]
15. McIsaac W, Low D, Biringer A, et al. The impact of empiric management of acute cystitis on unnecessary antibiotic use. Arch Intern Med. 2002;162(5):600–605. [PubMed]
16. McIsaac W, Moineddin R, Ross S. Validation of a decision aid to assist physicians in reducing unnecessary antibiotic drug use for acute cystitis. Arch Intern Med. 2007;167(20):2201–2206. [PubMed]
17. Nysl S, van Merode T, Bartelds A, Stobberinghl E. Urinary tract infections in general practice patients: diagnostic tests versus bacteriological culture. J Antimicrob Chemother. 2006;57(5):955–958. [PubMed]
18. Hummers-Pradier E, Ohse A, Kochena M. Management of urinary tract infections in female general practice patients. Fam Pract. 2005;22(1):75–77. [PubMed]
19. Little P, Turner S, Rumsby K, et al. Developing clinical rules to predict urinary tract infection in primary care settings: sensitivity and specificity of near patient tests (dipsticks) and clinical scores. Br J Gen Pract. 2006;56(529):606–612. [PMC free article] [PubMed]
20. Jackson S, Donovan J, Brooks S, et al. The Bristol Female Lower Urinary Tract Symptoms Questionnaire: development and psychometric testing. Br J Urol. 1996;77(6):805–812. [PubMed]
21. Watson L, Little P, Williamson I, et al. Validation study of a diary for use in acute lower respiratory tract infection. Fam Pract. 2001;18(5):553–554. [PubMed]
22. Baladassarre J, Kaye D. Special problems of urinary tract infection in the elderly. Med Clin North Am. 1991;75(2):375–390. [PubMed]
23. Childs S, Egan R. Bacteriuria and urinary infections in the elderly. Urol Clin North Am. 1996;23(1):43–54. [PubMed]
24. Clague JE, Horan MA. Urine culture in the elderly: scientifically doubtful and practically useless. Lancet. 1994;344(8929):1035–1036. [PubMed]
25. McBryde C, Redington J. Diagnosis and management of urinary tract infections: Asymptomatic bacteriuria, cystitis, and pyelonephritis. Primary Care Case Reviews. 2001;4:3–14.
26. Smaill F. Antibiotics for asymptomatic bacteriuria in pregnancy. Cochrane Database Syst Rev. 1996;(4) CD000490. [PubMed]
27. Little P, Gould C, Williamson I, et al. A pragmatic randomised controlled trial of two prescribing strategies for acute otitis media. BMJ. 2001;322(7282):336–342. [PMC free article] [PubMed]
28. Little PS, Williamson I, Warner G, et al. An open randomised trial of prescribing strategies for sore throat. BMJ. 1997;314(7082):722–727. [PMC free article] [PubMed]
Articles from The British Journal of General Practice are provided here courtesy of
Royal College of General Practitioners