Compliance with QUOROM and quality of reporting of overlapping meta-analyses on the role of acetylcysteine in the prevention of contrast associated nephropathy: case study

doi:10.1136/bmj.38693.516782.7C

BMJ. 2006 January 28; 332(7535): 202–209.

PMCID: PMC1352049

Compliance with QUOROM and quality of reporting of overlapping meta-analyses on the role of acetylcysteine in the prevention of contrast associated nephropathy: case study

Giuseppe G L Biondi-Zoccai, interventionist, PhD student,^1,² Marzia Lotrionte, cardiologist,³ Antonio Abbate, internal medicine resident,⁴ Luca Testa, cardiology fellow,³ Enrico Remigi, postdoctoral fellow,⁵ Francesco Burzotta, assistant professor,³ Marco Valgimigli, PhD student,⁶ Enrico Romagnoli, interventionist,⁷ Filippo Crea, director,³ and Pierfrancesco Agostoni, research fellow⁸

¹ Hemodynamics and Cardiovascular Radiology Service, Policlinico San Donato, Via Morandi 30, 20097 San Donato Milanese, Italy

² Institute of Medical Statistics and Biometrics, University of Milan, Milan, Italy

³ Institute of Cardiology, Catholic University, Rome, Italy

⁴ Department of Medicine, Virginia Commonwealth University, Medical College of Virginia Campus, Richmond, VA, USA

⁵ School of Engineering, University of KwaZulu-Natal, Durban, South Africa

⁶ Thorax Center, Erasmus University Medical Center, Rotterdam, the Netherlands

⁷ Department of Cardiology, Catholic University Hospital, Campobasso, Italy

⁸ AZ Middelheim Hospital, Antwerp, Belgium

Correspondence to: G G L Biondi-Zoccai gbiondizoccai/at/gmail.com

Accepted November 14, 2005.

This article has been cited by other articles in PMC.

Abstract

Objective To appraise multiple systematic reviews on the same clinical topic, focusing on predictors and correlates of quality of reporting of meta-analysis (QUOROM) scores.

Design Case study.

Setting Reviews providing at least individual quantitative estimates on role of acetylcysteine in the prevention of contrast associated nephropathy.

Data sources PubMed, the database of abstracts of reviews of effects, and the Cochrane database of systematic reviews (updated March 2005).

Main outcome measures Funding, compliance with the QUOROM checklist, scores on the Oxman and Guyatt quality index, and authors' recommendations.

Results 10 systematic reviews, published August 2003 to March 2005, were included. Nine pooled events despite heterogeneity and five recommended routine use of acetylcysteine, whereas the remaining studies called for further research. Compliance with the 18 items on the QUOROM checklist was relatively high (median 16, range 11 to 17), although shorter manuscripts had significantly lower scores (R = 0.73; P = 0.016). Reviewers who reported previous not for profit funding were more likely to score higher on the Oxman and Guyatt quality index. No association was found between QUOROM and Oxman and Guyatt scores (R = -0.06; P = 0.86), mainly because of greater emphasis of the Oxman and Guyatt scores on the appraisal of bias in selection and validity assessment (inadequate in five reviews).

Conclusions Multiple systematic reviews on the same clinical topic varied in quality of reporting and recommendations. Longer manuscripts and previous not for profit funding were associated with higher quality.

Introduction

Systematic reviews incorporating meta-analytic methods provide a unique means of searching, appraising, and summarising the results of several studies to enable informed decision making.¹^,2 Since 1976 a large number of such systematic reviews have been published, varying widely in quality and standards.³^-⁸ Anecdotal reports of multiple reviews focusing on the same clinical topic have differed in quality and methods used, leading to conflicting conclusions.⁷^,9^,10

In 1999 several authorities proposed the quality of reporting of meta-analysis (QUOROM) statement to improve and standardise reporting, as previously done with randomised controlled trials with the consolidated standards of reporting trials (CONSORT) statement.¹¹ The aim of the QUOROM checklist was to improve the standards of reporting, not strictly to avoid duplicated systematic reviews.

Since then many journal editors and reviewers, including those involved in the Cochrane Collaboration, have pursued compliance with the QUOROM checklist to provide sound and reproducible results.¹ The effect of the QUOROM guidelines on the design, conduct, and reporting of systematic reviews is, however, unclear.

Several randomised controlled trials have investigated the role of acetylcysteine in the prevention of contrast associated nephropathy, but with conflicting results. In light of this, a systematic review was carried out to provide more comprehensive and robust conclusions and reported in August 2003.¹² In the following months other systematic reviews on the same topic were published, with different findings.

We appraised the cluster of duplicate systematic reviews on the role of acetylcysteine to prevent contrast nephropathy published in peer reviewed journals, focusing on predictors and correlates of QUOROM quality scores. We explored the association between compliance with the QUOROM statement and characteristics of the manuscripts, such as length, number of trials and patients, and funding source.

Methods

We searched for systematic reviews in PubMed according to a defined strategy,¹³ and in the Cochrane database of systematic reviews and the database of abstracts of reviews of effects (updated March 2005). Key terms included “acetylcysteine”, “contrast”, “meta-analysis”, “nephropathy”, and “systematic review”.¹⁴ We included systematic reviews of randomised controlled trials that compared acetylcysteine with control for the prevention of contrast associated nephropathy, reviews published as complete reports, and reviews that reported quantitative estimates at least for individual studies. We excluded systematic reviews embedded in editorials, correspondence, or reports of randomised controlled trials and those published only in abstract form. We also excluded incompletely reported reviews (for example, those reported in an editorial or in the discussion section of another study type or reported as part of a controlled trial) to avoid limiting the chance of the article complying with the QUOROM statement and thus undermining the quality of reporting of such reviews. We applied no language restrictions.

Study abstraction and appraisal

We abstracted data on the journal in which the systematic reviews were published, dates of initial submission and publication, number of authors, article length in pages search strategies (including database searched language restrictions), study design (randomised and non-randomised controlled trials), number of trials and patients, journal impact factor,¹⁵ and whether estimates were pooled (with pertinent methods, summary estimates, and results). We also checked for use of funnel plots to appraise small sample size effects, whether heterogeneity was explored and discussed, methods used, and whether formal metaregression had been carried out and the control event rate had been used as covariate.²^,16 We contacted the corresponding authors for details of funding sources (any previous for profit or not for profit funding or specific funding for the review).

As a measure of study quality we appraised the compliance of each systematic review with the QUOROM checklist.¹¹ We considered that the study had complied with any of the 18 specific items if over 50% of the requirements for each item had been met. We also used the Oxman and Guyatt index for scientific quality of research reviews, a validated score with established inter-rater agreement (see bmj.com).²^,17 Finally, we assessed the main findings and conclusions and distinguished these as supporting the role of acetylcysteine in preventing contrast associated nephropathy, not supporting its role, or calling for further research. We then extracted excerpts from the authors' recommendations. Two unblinded reviewers (GGLB-Z, PA) independently appraised the studies. Discrepancies were resolved by consensus.

Statistical analysis

We used Fisher's exact test to compare the proportions of categorical variables (for example, funding source and authors' recommendations) and Mann-Whitney U or Kruskal-Wallis tests to compare the means (ranges) for continuous variables (for example, QUOROM scores according to funding source). Pearson and Spearman tests were used to assess correlations. We used Cohen κ and [var phi]

to determine the agreement between QUOROM scores, funding source, and authors' recommendations before consensus.¹⁸ Analyses were carried out using SPSS version 11.0.

Results

Figure 1 shows the flow of reviews through the study. After exclusions from the 52 citations initially identified (double hits, non-systematic or incompletely reported reviews,¹⁹ reviews that lacked quantitative effect estimates, and an ongoing Cochrane review (due for publication in late 2006),²⁰ 10 articles were included (table 1).¹²^,21^-²⁹ All were originally submitted between May 2003 and July 2004, published between August 2003 and March 2005, and with no overlap in authorship (49 investigators). Table 2 gives details of the randomised controlled trials that were pooled for each included systematic review. Reviews carried out later could identify and pool randomised controlled trials reported after the publication of the earliest reviews. In three cases the journal in which articles appeared was a general medicine journal, in three cases a cardiology journal, and in four cases a nephrology journal. The median impact factor was 3.9 (range 18.3 to 0). All the studies used the same primary end point of contrast associated nephropathy (defined as > 44.2 μmol/l or > 25% increase in serum creatinine concentration from baseline to 48 hours).

Fig 1

Flow of reviews through study

Table 1

Included systematic reviews comparing acetylcysteine with controls for the prevention of contrast associated nephropathy

Table 2

Pooled randomised controlled trials (RCTs) for each of included systematic reviews^*

Funding was from for profit sources in five cases, not for profit sources in seven cases, and specific for the review in one case (table 1).

Search strategies varied from extensive (five databases in one case) to relying on only Medline. Summary estimates used for pooling were odds ratios (three reviews), relative risks (six), and risk differences (one), by means of random effects (eight) or fixed effects (one) methods (table 3). Quantitative results were reported using both P values and confidence intervals in all cases, the practice supported by most reviewers.¹^,2 Exploratory metaregression was carried out in light of statistical heterogeneity in six studies. Although most metaregressions included covariates likely to accommodate variability in underlying risk, none formally tested as covariate the role of control group event rates, a practice advocated by some authors and criticised by others.¹⁶^,30

Table 3

Methodological characteristics of included studies

Five reviews recommended routine, or almost routine, use of acetylcysteine in the prevention of contrast nephropathy. The other five were more cautious and, although not dismissing the potential benefit and limited toxicity and costs of acetylcysteine, called for further well designed randomised controlled trials on the subject (table 4). These discrepancies occurred despite similar pooled effect estimates.

Table 4

Authors' recommendations on current role of acetylcysteine in prevention of contrast associated nephropathy

Compliance with the QUOROM statement

Agreement before consensus between reviewers was high for compliance with the QUOROM items (174/180 (91%), κ = 0. 89, 95% confidence interval 0.80 to 0.97; [var phi]

= 0.89), and 100% (10 reviews) for authors' recommendations. The median compliance with the QUOROM checklist was 16 (range 11 to 17; table 5).

Table 5

Compliance of included studies with quality of reporting of meta-analyses (QUOROM) checklist and Oxman and Guyatt index^*

In only three cases could the report be identified from the title as a meta-analysis or systematic review of randomised controlled trials. A structured abstract was available in seven reviews, and objectives and conclusions were explicitly stated in 10 and nine, respectively. In the abstract sections, data sources, review methods, and results complied with the QUOROM statement in only six cases.

All the studies fulfilled the QUOROM requirements for the introduction and discussion sections, as they reported search strategies, selection criteria, and methods for quantitative data synthesis employed for the systematic review. Most of the studies complied with the recommendations for reporting of the assessment of the methodological quality of the primary studies (seven reviews), data abstraction (eight), and study characteristics (nine).

Despite thorough reporting of methods by most studies, no review quantified the agreement between reviewers on selection and appraisal of the methodological quality of the primary studies. A diagram showing the flow of the trial was provided in only three cases. Details on study characteristics and quantitative data synthesis in the results section were, however, provided in enough detail in all the reviews.

Quantitative analyses and predictors of QUOROM score

A significant association was found between number of published pages and overall QUOROM score (Pearson R = 0.73, P = 0.016, Spearman ρ = 0.64, P = 0.046), suggesting that the longer the manuscript, the greater the likelihood of complying with the QUOROM statement (fig 2). Although this finding might have relevant implications for editorial policies, it should be interpreted with caution given the small sample size and the fact that two studies largely drive the hypothesis tests.

Fig 2

Scatter plot showing relation between manuscript length and quality of reporting of meta-analyses (QUOROM) score. Thorough and complete reports achieved higher scores

Language restrictions were associated with fewer trials analysed (7, range 5-11 v 15, range 7-21, P = 0.040) and fewer patients analysed (805, range 643-1207 patients v 1539, 805-2420; P = 0.033) (tables (tables11 and and33).

Studies from reviewers reporting previous not for profit funding were more likely to score higher on the Oxman and Guyatt index (6, range 3-7 v 2, range 1-4; P = 0.037), to search more databases for original articles (4, 3-5 v 1.3, 1-2; P = 0.014), and to be published in a journal with a greater impact factor (4.9, 3.1-18.3 v 1.3, 1.2-1.5; P = 0.020). Conversely, funding was not significantly associated with authors' recommendations supporting the routine use of acetylcysteine (43% (three of seven) for studies reporting previous not for profit funding compared with 66% (two of three) for the others; P = 0.42) or QUOROM score (16, range 11-17 for studies with previous not for profit funding compared with 14, range 12-16 for the others; P = 0.38).

Journal readership on the basis of type of journal was significantly associated with quality of reporting, with a significant trend towards increasing QUOROM scores from reviews published in cardiology journals compared with those published in general medicine and nephrology journals. Moreover, QUOROM scores and Oxman and Guyatt scores were not associated (Pearson R = -0.06, P = 0.86, Spearman ρ = -0.11, P = 0.76). In most cases this was due to lack of assessment of bias in selecting and abstracting studies (six reviews) or lack of appraisal of internal validity of individual randomised controlled trials (five).

Limits of the included studies

Clinical and statistical heterogeneity are a major source of discordance in meta-analyses. A thorough appraisal of this issue is paramount in any research synthesis. Moreover, some authorities consider heterogeneity (P < 0.05 to 0.10 with hypothesis tests or I² > 50%) a potential hurdle to the completion of a formal meta-analysis.¹^,2 Heterogeneity was appraised in most of the included meta-analyses (nine reviews), by means of Cochran Q, Der Simonian-Laird, Breslow-Day, or χ² tests. In all cases evidence for statistical heterogeneity was present (P values ranging from 0.05 to < 0.001), and in all studies except one²³ reviewers computed pooled effect size, on the basis of random effects methods (seven reviews), on fixed effects (one), and on both fixed and random effects (one).

A major source of bias in meta-analyses is small study size, which predisposes to a higher probability of publishing, quoting, and disseminating the results of randomised controlled trials with significant or positive results. This leads to pooled effect estimates being skewed to more positive findings, as small but significant randomised controlled trials are not counterbalanced in the statistical pooling procedure by similarly small but negative or non-significant studies, as shown graphically by funnel plots.¹^,2 Bias due to small study size was acknowledged and explicitly tested in most (eight) reviews, using Begg, Egger, or Rosenthal tests. Such tests provided significant results, suggesting the potential presence of such bias in five cases, prompting reporting and discussion of funnel plots in four of the five, plus another review that had none the less reported a non-significant test (table 1). Despite checking for small study bias among the same pool of seven studies, Birck et al¹² and Isenbarger et al²¹ reached disparate conclusions, respectively in favour and against the likely presence of such bias, a finding that can be partly explained by the use of risk ratios by Birck et al and odds ratios by Isenbarger et al. Moreover, despite such likelihood (P < 0.10) for small study bias at specific tests, all meta-analyses went forward with the pooled estimates thus providing potentially biased results. Duong et al carried out two separate analyses, the first limited to randomised controlled trials published as complete reports and the second also including randomised controlled trials available only as abstracts.²⁹ They thus showed that bias due to small study size was likely when selecting studies published only as complete reports (P = 0.02), but that it was no longer evident when including studies reported only as abstracts (P = 0.22).²⁹

Discussion

Overall compliance with the QUOROM checklist was relatively good by the investigators of 10 overlapping systematic reviews on the role of acetylcysteine in the prevention of contrast associated nephropathy. Shorter manuscripts were of significantly lower quality and previous not for profit funding was associated with higher quality.

Less rigorous reviews have reported positive conclusions more often than more robust reviews focusing on the same topic,¹⁰ even if other studies did not corroborate the hypothesis.⁵^,31^,32 More recently a qualitative comparison of overlapping yet heterogeneous systematic reviews on complementary medicine showed that reviews differed greatly, mainly because of subjective decisions during the planning, carrying out, and interpretation of the reviews.³³ Despite these data, the phenomenon of overlapping systematic reviews seems to become more prevalent, as highlighted by the present study series. The time has come for an open debate on this issue.

Systematic reviews have the inherent drawback that several independent meta-analysts may conceive, carry out, and submit a review on the same topic at the same time. This phenomenon of overlapping systematic reviews has already occurred.³⁴^,35 Some may welcome this as a means of highlighting the subjective choices and different perspectives available in carrying out research synthesis. The risk of wasting resources and providing the general medical readership with contradictory conclusions should not, however, be dismissed.

Potential reasons for the publication of 10 overlapping systematic reviews in less than two years are the preference given by investigators, editors, and readers of systematic reviews,³⁶ the lack of a pivotal large randomised controlled trial, and the potential for a dose-response gradient.³⁷

In the present study series, 49 investigators were involved in analysing the same clinical topic, exemplifying the waste of time and duplication of efforts in such research. Too many systematic reviews are being produced for diseases with a limited global burden, whereas many other potentially more relevant clinical conditions are not undergoing a thorough and systematic research synthesis.³⁸ Constraints on space reflected by manuscript length (number of pages in our study) and abstract length are one of the most important hurdles faced by meta-analysts wanting to document their work thoroughly. Our findings suggest that no meta-analysis can achieve optimal quality scores unless sufficient space is provided for all its sections. Countermeasures for this problem seem straightforward, and range from increasing limits on space for systematic overviews of randomised controlled trials to the provision of online data supplements whenever room is limited. The Cochrane Collaboration does not impose any space limit for its systematic reviews.

Funding might influence outcomes and quality of research.³⁹ Reviewers who reported previous not for profit funding were more likely to carry out higher quality systematic reviews. The association is not, however, synonymous to causality, and other explanations for our results include greater experience and expertise among review teams that have already carried out systematic reviews.

Although the QUOROM statement concerns reporting quality, the Oxman and Guyatt index was designed to focus on methodological quality.¹⁷ The relative disagreement between the scores in our study obviously stems from the different purposes of the checklists. Indeed, lack of reporting on the assessment of the internal validity of single randomised controlled trials may restrict Oxman and Guyatt scores to the low 1-3 range, even for well reported meta-analyses.²

One major difference between the systematic reviews we appraised was the number of primary studies included, with some reviews analysing as few as five studies,²⁷ despite being submitted for publication almost one year after publication of a review of 12 studies.²² Potential explanations for such discrepancies might be the extent of database searches (whether or not conference proceedings were handsearched), language restrictions, whether selection was restricted to randomised controlled trials or included non-randomised studies, and timing of review. We cannot exclude the possibility that some search strategies missed eligible trials.

Finally, almost all reviewers carried out and reported formal meta-analyses in the presence of heterogeneity and small study size. Although metaregression and sensitivity analyses were employed to tackle these issues, the conflicting recommendations may in part be a consequence of such discrepancies and, more likely in the present case, biased publication of primary studies.

What is already known on this topic

Multiple systematic reviews on the same clinical topic may produce conflicting results

The quality of reporting of meta-analysis (QUOROM) statement was developed to improve the quality of reviews, yet its effect is uncertain

What this study adds

Ten overlapping systematic reviews on acetylcysteine to prevent contrast nephropathy varied in quality of reporting and recommendations

Longer manuscripts and previous not for profit funding were associated with higher quality

Preventive strategies for multiple overlapping reviews

The best approach to avoid multiple overlapping reviews is probably that of the Cochrane Collaboration, which mandates prospective registration of titles and protocols.¹ Another option might be online registration of meta-analyses already accepted for publication by a journal, as this would not disseminate findings before completion of the study but would forewarn other researchers involved in the same topic and allow investigators to refocus on their work. Such recommendations come from personal experience, as our group has already been involved in several potential cases of overlapping meta-analyses.⁴⁰^-⁴² Nonetheless, these preventive measures are likely to impose logistical and financial hurdles potentially proving counterproductive. Finally, some of the problems raised by our work are likely inherent practical drawbacks of systematic reviews.

Practical implications for the clinical use of acetylcysteine

Although the clinical use of acetylcysteine was not a formal goal of our work, some broad recommendations can be gleaned from the available evidence. The studies found no evidence of toxicity or adverse effects from using acetylcysteine. However the real preventive size effect cannot be definitively inferred, given the clinical and statistical heterogeneity and the lack of clear explanations for such an inconsistency.¹²^,21^,23^,24^,26^,29

Study limitations

Limitations of our study include its design, its scope for generating the hypothesis, and the risk of α and β errors.⁴³ Moreover, most of this study involved the appraisal of published meta-analyses using the QUOROM checklist. Although scientific evidence supports only a subset of the items on the checklist, we believe that it can and should be used as a standard in the preparation, reporting, and appraisal of meta-analyses of randomised controlled trials on the basis of its wide dissemination and endorsement and the relative ease with which compliance can be achieved. It should be borne in mind that the QUOROM checklist was not developed as a quality measurement tool, and validation of this novel application is lacking.

Supplementary Material

[extra: Additional references]

Click here to view.

Notes

An external file that holds a picture, illustration, etc.
Object name is webplus.f3.gif

Description of Oxman and Guyatt index is on bmj.com

This study is part of a senior training project from the Center for Overview, Meta-analysis, and Evidence-based medicine Training (COMET) (http://it.geocities.com/comet_milano/Home.htm). We thank the authors of the systematic reviews for their help.

Contributors: GB-Z and PA participated in the study design, data acquisition, analysis, and interpretation, and provided statistical expertise. GB-Z drafted the manuscript and is guarantor. PA critically revised the manuscript. AA, FB, ML, ER, LT, ER, FC, and MV participated in data analysis, interpretation, and critical revisions of the manuscript. AA and FB provided statistical expertise.

Funding: None.

Competing interests: None declared.

Ethical approval: Not required.

References

1. In: Clarke M, Oxman A, eds. Cochrane reviewers' handbook 4.2.0. www.cochrane.org/resources/handbook/handbook.pdf (accessed 30 June, 2005).

2. In: Egger M, Davey Smith G, Altman DG, eds. Systematic reviews in health care: meta-analysis in context. 2nd ed. London: BMJ Publishing Group, 2001.

3. Glass G. Primary, secondary and meta-analysis of research. Educ Res 1976;5: 3-8.

4. Chalmers TC, Berrier J, Sacks HS, Levin H, Reitman D, Nagalingam R. Meta-analysis of clinical trials as scientific discipline. II: replicate variability and comparison of studies that agree and disagree. Stat Med 1987;6: 733-44. [PubMed]

5. Assendelft WJJ, Koes BW, Knipschild PG, Bouter LM. The relationship between methodological quality and conclusions in reviews of spinal manipulation. JAMA 1995;274: 1942-8. [PubMed]

6. Moher D, Olkin I. Meta-analysis of randomized controlled trials: a concern for standards. JAMA 1995;274: 1962-4. [PubMed]

7. Cook DJ, Reeve BK, Guyatt GH, Griffith LE, Heyland DK, Tryba M. Stress ulcer prophylaxis in the critically ill: resolving discordant meta-analyses. JAMA 1996;275: 308-14. [PubMed]

8. Hopayian K. The need for caution in interpreting high quality systematic reviews. BMJ 2001;323: 681-4. [PMC free article] [PubMed]

9. Jadad AR, Cook DJ, Browman GP. A guide to interpreting discordant systematic reviews. CMAJ 1997;156: 1411-6. [PMC free article] [PubMed]

10. Jadad AR, Moher M, Browman GP, Booker L, Sigouin C, Fuentes M, et al. Systematic reviews and meta-analysis on treatment of asthma: critical review. BMJ 2000;320: 537-40. [PMC free article] [PubMed]

11. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF, for the QUOROM Group. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Lancet 1999;354: 1896-1900. [PubMed]

12. Birck R, Krzossovk S, Markowetz F, Schulle P, van der Woude FJ, Braun C. Acetylcysteine for prevention of contrast nephropathy: meta-analysis. Lancet 2003;362: 598-603. [PubMed]

13. Shojania KG, Bero LA. Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy. Effect Clin Pract 2001;4: 157-62. [PubMed]

14. PubMed search strategy. http://it.geocities.com/comet_milano/manuscript1-2004.htm (accessed 30 Nov 2005).

15. ISI journal citation reports. http://isiknowledge.com (accessed 30 Nov 2005).

16. Lau J, Ioannidis JPA, Schmid CH. Summing up evidence: one answer is not always enough. Lancet 1998;351: 123-7. [PubMed]

17. Oxman AD, Guyatt GH. Validation of an index of the quality of review articles. J Clin Epidemiol 1991;44: 1271-8. [PubMed]

18. McGinn T, Guyatt G, Cook R, Meade M. Diagnosis: measuring agreement beyond chance. In: Guyatt G, Rennie D, eds. Users' guide to the medical literature. A manual for evidence-based clinical practice. Chicago, IL: AMA Press, 2002: 461-70.

19. Goldenberg I, Shechter M, Matetzky S, Jonas M, Adam M, Pres H, et al. Oral acetylcysteine as an adjunct to saline hydration for the prevention of contrast-induced nephropathy following coronary angiography. A randomized controlled trial and review of the current literature. Eur Heart J 2004;25: 1-9. [PubMed]

20. Lesniak W, Bala M, Dubiel B, Duong MH, Pardala A, Gajewski P. Interventions for preventing contrast-induced nephropathy. Cochrane Database Syst Rev 2004;(2): CD004755.pub2. DOI:. doi: 10.1002/14651858.CD004755.pub2. [Cross Ref]

21. Isenbarger DW, Kent SM, O'Malley PG. Meta-analysis of randomized clinical trials on the usefulness of acetylcysteine for prevention of contrast nephropathy. Am J Cardiol 2003;92: 1454-8. [PubMed]

22. Alonso A, Lau J, Jaber BL, Weintraub A, Sarnak MJ. Prevention of radiocontrast nephropathy with N-acetylcysteine in patients with chronic kidney disease: a meta-analysis of randomized, controlled trials. Am J Kidney Dis 2004;43: 1-9. [PubMed]

23. Kshirsagar AV, Poole C, Mottl A, Shoham D, Franceschini N, Tudor G, et al. N-acetylcysteine for the prevention of radiocontrast induced nephropathy: a meta-analysis of prospective controlled trials. J Am Soc Nephrol 2004;15: 761-9. [PubMed]

24. Pannu N, Manns B, Lee H, Tonelli M. Systematic review of the impact of N-acetylcysteine on contrast nephropathy. Kidney Int 2004:65: 1366-74. [PubMed]

25. Guru V, Fremes SE. The role of N-acetylcysteine in preventing radiographic contrast-induced nephropathy. Clin Nephrol 2004;62: 77-83. [PubMed]

26. Bagshaw SM, Ghali WA. Acetylcysteine for prevention of contrast-induced nephropathy after intravascular angiography: a systematic review and meta-analysis. BMC Med 2004;2: 38. [PMC free article] [PubMed]

27. Misra D, Leibowittz K, Gowda RM, Shapiro M, Khan IA. Role of N-acetylcysteine in prevention of contrast-induced nephropathy after cardiovascular procedures: a meta-analysis. Clin Cardiol 2004;27: 607-10. [PubMed]

28. Nallamothu BK, Shojania KG, Saint S, Hofer TP, Humes HD, Moscucci M, et al. Is acetylcysteine effective in preventing contrast-related nephropathy? A meta-analysis. Am J Med 2004;117: 938-47. [PubMed]

29. Duong MH, MacKenzie TA, Malenka DJ. N-acetylcysteine prophylaxis significantly reduces the risk of radiocontrast-induced nephropathy: comprehensive meta-analysis. Catheter Cardiovasc Interv 2005;64: 471-9. [PubMed]

30. Sharp SJ, Thompson SG, Altman DG. The relation between treatment benefit and underlying risk in meta-analysis. BMJ 1996;313: 735-8. [PMC free article] [PubMed]

31. Jadad AR, McQuay HJ. Meta-analyses to evaluate analgesic interventions: a systematic qualitative review of their methodology. J Clin Epidemiol 1996;49: 235-43. [PubMed]

32. Katerndahl DA, Lawler WR. Variability in meta-analytic results concerning the value of cholesterol reduction in coronary heart disease: a meta-analysis. Am J Epidemiol 1999;129: 429-41. [PubMed]

33. Linde K, Willich SN. How objective are systematic reviews? Differences between reviews on complementary medicine. J R Soc Med 2003;96: 17-22. [PMC free article] [PubMed]

34. Babapulle MN, Joseph L, Belisle P, Brophy JM, Eisenberg MJ. A hierarchical Bayesian meta-analysis of randomised clinical trials of drug-eluting stents. Lancet 2004;364: 583-91. [PubMed]

35. Hill RA, Dundar Y, Bakhai A, Dickson R, Walley T. Drug-eluting stents: an early systematic review to inform policy. Eur Heart J 2004;25: 902-19. [PubMed]

36. Patsopoulos NA, Analatos AA, Ioannidis JP. Relative citation impact of various study designs in the health sciences. JAMA 2005;293: 2362-6. [PubMed]

37. Briguori C, Colombo A, Violante A, Balestrieri P, Manganelli F, Paolo Elia F, et al. Standard vs double dose of N-acetylcysteine to prevent contrast agent associated nephrotoxicity. Eur Heart J 2004;25: 206-11. [PubMed]

38. Swingler GH, Volmink J, Ioannidis JPA. Number of published systematic reviews and global burden of disease: database analysis. BMJ 2003;327: 1083-4. [PMC free article] [PubMed]

39. Lexchin J, Bero LA, Djulbegovic B, Clark O. Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ 2003;326: 1167. [PMC free article] [PubMed]

40. Biondi-Zoccai GGL, Abbate A, Agostoni P, Testa L, Burzotta F, Lotrionte M, et al. Longterm benefits of an early invasive management in acute coronary syndromes significantly depend on intracoronary stenting and aggressive antiplatelet treatment: a metaregression. Am Heart J 2005;149: 504-11. [PubMed]

41. Agostoni P, Biondi-Zoccai GGL, Gasparini G, Anselmi M, Morando G, Turri M, et al. Is bare-metal stenting superior to balloon angioplasty for small vessel coronary artery disease? Evidence from a meta-analysis. Eur Heart J 2005;26: 881-9. [PubMed]

42. Testa L, Biondi-Zoccai GGL, Dello Russo A, Bellocci F, Andreotti F, Crea F. Rate-control vs rhythm-control in patients with atrial fibrillation: a meta-analysis. Eur Heart J 2005;26: 2000-6. [PubMed]

43. Biondi-Zoccai GGL, Agostoni P, Abbate A. Parallel hierarchy of scientific studies in cardiovascular medicine. Ital Heart J 2003;4: 819-20. [PubMed]

Articles from BMJ : British Medical Journal are provided here courtesy of
BMJ Publishing Group