PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of bmjBMJ helping doctors make better decisionsSearch bmj.comLatest content
 
BMJ. Oct 26, 2002; 325(7370): 925.
PMCID: PMC130055
Interventions used in disease management programmes for patients with chronic illness—which ones work? Meta-analysis of published reports
Scott R Weingarten, president,a James M Henning, associate director,b Enkhe Badamgarav, clinical project leader,a Kevin Knight, research manager,a Vic Hasselblad, associate research professor,c Anacleto Gano, Jr, research associate,a and Joshua J Ofman, senior vice president researcha
aZynx Health, 9100 Wilshire Boulevard 665E, Beverly Hills, CA 90212, USA, bTAP Pharmaceutical Products, Lake Forest, IL, USA, cDuke Clinical Research Institute, Duke University, Durham, NC, USA
Contributed by
Contributors: SRW, the principal investigator and guarantor for the study, initiated and designed the study, contributed to data analysis and interpretation, and oversaw the study. JMH advised on and helped with the study design, contributed to data interpretation, discussed core ideas, and obtained funding for the study. EB helped design data collection protocols, coordinated data collection, discussed core ideas, was data manager, analysed data, and contributed to data interpretation. KK contributed to the study methods, advised on research measures, discussed core ideas, commented on data analysis, and helped with data interpretation. VH guided and conducted the statistical analysis and commented on data analyses and interpretation. AG Jr helped with data collection and management and data analyses and interpretation. JJO conceived the study and design, obtained funding, advised on and helped with study design, discussed core ideas, designed data collection protocols, and helped with data interpretation. SRW, JMH, KK, JJO, and EB jointly wrote, revised, and edited the paper.
Correspondence to: S Weingarten sweingarten/at/cerner.com
Accepted September 6, 2002.
Objective
To systematically evaluate the published evidence regarding the characteristics and effectiveness of disease management programmes.
Design
Meta-analysis.
Data sources
Computerised databases for English language articles during 1987-2001.
Study selection
102 articles evaluating 118 disease management programmes.
Main outcome measures
Pooled effect sizes calculated with a random effects model.
Results
Patient education was the most commonly used intervention (92/118 programmes), followed by education of healthcare providers (47/118) and provider feedback (32/118). Most programmes (70/118) used more than one intervention. Provider education, feedback, and reminders were associated with significant improvements in provider adherence to guidelines (effect sizes (95% confidence intervals) 0.44 (0.19 to 0.68), 0.61 (0.28 to 0.93), and 0.52 (0.35 to 0.69) respectively) and with significant improvements in patient disease control (effect sizes 0.35 (0.19 to 0.51), 0.17 (0.10 to 0.25), and 0.22 (0.1 to 0.37) respectively). Patient education, reminders, and financial incentives were all associated with improvements in patient disease control (effect sizes 0.24 (0.07 to 0.40), 0.27 (0.17 to 0.36), and 0.40 (0.26 to 0.54) respectively).
Conclusions
All studied interventions were associated with improvements in provider adherence to practice guidelines and disease control. The type and number of interventions varied greatly, and future studies should directly compare different types of intervention to find the most effective.
What is already known on this topic
Disease management programmes have gained popularity in recent years as a means of improving the quality and efficiency of care of patients with chronic diseases
A limited number of trials have documented the effectiveness of disease management in specific situations, but uncertainty remains about its overall value and which interventions are most effective
What this study adds
Programmes using education, feedback, or reminders for healthcare providers produced significant improvements in provider adherence to care guidelines
Programmes using the provider strategies or education, reminders, or financial incentives for patients improved disease control
Further study is needed to assess the relative effectiveness of the different strategies
Chronic diseases account for billions of dollars in annual medical expenditures. In the United States asthma, depression, and diabetes are estimated to account for $5.1bn (£3.4bn, €5.2bn), $12.4bn, and $44bn respectively, in annual direct medical costs.13 Loss of work time and decreased worker productivity contribute to indirect costs. Unsurprisingly, therefore, there has been much interest in systematically improving the quality and reducing the cost of caring for patients with chronic illness.
Disease management programmes have proliferated recently as a means of improving the quality and efficiency of care for patients with chronic illness. Ellrodt et al defined disease management as a multidisciplinary approach to care for chronic diseases that coordinates comprehensive care along the disease continuum across healthcare delivery systems.4 Epstein defined disease management as a population based approach to health care that identifies patients at risk, intervenes with specific programmes of care, and measures outcomes.5 These programmes may represent an important improvement in the quality and value of health care for patients with chronic illnesses. However, disease management programmes can be costly to develop, implement, and evaluate. According to the Disease Management Association of America, an estimated $1bn was spent in 1999 to develop and implement disease management programmes.6 Despite the investment, evidence supporting the effectiveness of disease management is sparse. A limited number of published trials have documented the effectiveness of disease management in specific situations, but uncertainty remains about its overall value. Understanding which interventions are most effective could guide the development of disease management programmes.
Several qualitative reviews have described the effects of interventions such as educational programmes, giving feedback to healthcare providers, and patient financial incentives to promote adherence to practice guidelines. Oxman et al reviewed 102 trials and concluded that a wide range of interventions may improve practice but that there are no “magic bullets.”7 Davis et al showed that educational interventions improved physician performance and possibly patient outcomes.8 Mugford found provider feedback effective when part of an overall implementation strategy.9 There have also been some qualitative descriptions of interventions to implement practice guidelines.1012 Although these reviews covered a wide range of interventions, no review focused on interventions used in disease management programmes for patients with chronic illness. Additionally, there have been only limited evaluations of the quantitative effects of specific types of interventions to complement qualitative and descriptive information. This study reviews the types of interventions used in published trials of disease management programmes and provides quantitative and qualitative evaluation of the evidence regarding the effectiveness of different types of intervention.
Literature review
We performed a systematic review of the medical literature to identify studies evaluating the effectiveness of disease management programmes in improving care or reducing costs for patients with common chronic conditions. In collaboration with a librarian experienced in searching computerised bibliographic databases, we conducted a search of the Medline, HealthStar, and Cochrane databases for English language articles published between January 1987 and June 2001. The search used the following medical subject heading (MeSH) terms: patient care team, patient care planning, primary nursing care, case management, critical pathways, primary health care, continuity of patient care, guidelines, practice guidelines, disease management, comprehensive health care, ambulatory care, and the title words “disease state management” and “disease management” (see appendix 1 on bmj.com). Hand searches of bibliographies from relevant articles and reviews and consultations with experts in the subject yielded further references.
Our working definition of disease management was “an intervention designed to manage or prevent a chronic condition using a systematic approach to care and potentially employing multiple treatment modalities.” We defined a guideline or systematic approach to care as systematically developed statements to assist practitioner and patient decisions about appropriate health care for a specific clinical circumstance.4,13 To determine whether a programme incorporated a systematic approach to care, we searched for keywords such as guidelines, protocols, algorithms, quality improvement programmes, care plans, and standardised patient and provider education. We excluded programmes aimed exclusively at evaluations of single treatment methods (such as psychotherapy or specific drugs) and drug compliance programmes. We rejected articles if they included only paediatric cases or if they were reviews, case reports, editorials, letters, or meeting abstracts. We also rejected articles if they did not use acceptable experimental or quasi-experimental study designs as defined by the Cochrane Effective Practice and Organisation of Care (EPOC) Group's criteria for acceptable study designs,14 or if they did not report sufficient information to allow for estimation of at least one relevant measure of programme effect and its variance. Failure to meet this criterion could be due to inadequate reporting of results or to lack of an appropriate comparison group.
Based on these explicit inclusion and exclusion criteria for titles, abstracts, and articles, two reviewers trained in health services research and the principles of critical appraisal independently reviewed random samples of titles, abstracts, and reviews. Inter-rater agreement was assessed using the κ statistic, and reviews were split between reviewers if a sufficient level of agreement was achieved (κ>0.7). Results from accepted articles reporting results for disease management programmes were used to address study objectives.
Classification of interventions
Intervention components were classified as follows:
  • Provider education—Materials or instruction given to healthcare providers regarding appropriate care for patients with the condition targeted by the programme
  • Provider feedback—Information given to healthcare providers regarding the specific care or results of care received or experienced by their patients
  • Provider reminders—Prompts given to providers to perform specific patient care tasks
  • Patient education—Materials and instructions issued to patients providing information on their condition and how it could be managed
  • Patient reminders—Prompts given to patients to perform specific tasks related to care for their condition
  • Patient financial incentives—Payments (direct monetary payments, discounts, or services) made to patients for achieving specific treatment related goals.
We also searched for programmes using provider financial incentives but found no such interventions. The proportions of interventions using each of the different interventions were described, as were the proportions with one, two, three, or four components (no intervention included more than four components).
Classification of process measures or outcomes
Our analyses focused on measures of provider adherence to guidelines as key processes of care and on measures of disease control as key outcomes of care.
Extraction of data
Using a standardised abstraction form, we collected data describing interventions, components used, study design, population characteristics, sample size, intervention strategies, and measures of programme effects on processes and outcomes of care from unmasked articles that met our inclusion criteria. For each disease and condition, we had a defined method for selecting each disease specific process or outcome indicator as a measure of disease control (see appendix 2 on bmj.com). We treated multiple reports of results from the same study as a single programme evaluation. Reports with multiple intervention arms contributed one observation for each. When separate results were reported for mutually exclusive subgroups, each subgroup contributed an observation, and the overall results were not included.
When appropriate, we used changes over baseline values rather than follow up values in our analyses. Variances for changes over baseline were often not reported, in which case we assumed that the variance for the change was equal to the average of the variances of the baseline and follow up distributions if both were given. If the baseline variance was not provided, we assumed that the variance for the change was equal to the variance of the follow up distribution.
Meta-analysis
We calculated effect sizes—defined as a difference between the means of the treatment and control arms divided by the pooled estimate of the standard deviation (continuous variables) or the log odds ratio multiplied by a constant variance term (binary outcomes)15—for each study outcome to allow pooling of similar outcomes.1619 We constructed effect sizes so that positive numbers denoted treatment benefit. The method of interpreting the clinical importance of different effect sizes has been reported previously.20
We used the more conservative random effects, empirical bayesian method of Hedges and Olkin to pool the estimated effects.18 We pooled results for interventions incorporating each intervention component for disease control measures.21 For measures of provider adherence to care, we pooled results for interventions containing each intervention component except patient education (we concluded a priori that patient education would have minimal effect on provider adherence to guidelines). We also pooled results for each of these measures for interventions containing one, two, three, and four intervention components. When more than one process or outcome result within a category was reported for the same group of subjects, we used the one associated with the smallest effect size. Results are reported as pooled effect sizes with 95% confidence intervals.
Literature review
Our initial search strategy identified 16 917 references published between January 1987 and June 2001 (figure). We accepted 2963 titles for further screening, and 581 abstracts met our explicit inclusion criteria. Of these abstracts, 493 (85%) failed to meet our inclusion criteria when the articles were reviewed. Bibliographic hand searches and expert consultation yielded an extra 51 articles for review, of which 14 were accepted. In total 102 studies met our criteria for inclusion. Multiple reports of the same intervention reduced the count of studies by 17.
The 102 accepted studies evaluated 118 discrete intervention programmes and reported 352 estimates of programme effect. In 67 (19%) cases, these estimates were selected from two or more reported results within a single subdomain based on rules delineated in the methods section. Selected programmes were heterogeneous with regard to the types of intervention they used (table (table1).1). Of the 118 programmes, 92 used patient education, 47 used provider education, 32 used provider feedback, 28 used patient reminders, 19 used provider reminders, and only six used financial incentives for patients.
Table 1
Table 1
 Types of interventions including specific components
Patient education was an integral part of most programmes studied (9/9 for congestive heart failure, 3/3 for chronic pain, 6/7 for back pain, 6/7 for chronic obstructive pulmonary disease, and 21/26 for diabetes). However, provider education was widely used for only a few conditions—depression (17/25), diabetes (9/26), hypertension (5/8), and hyperlipidaemia (4/7). The six programmes that used financial incentives for patients were for asthma, depression, hyperlipidaemia, and hypertension. Patient reminders were often used in programmes for patients with congestive heart failure (4/9), coronary artery disease (3/6), and diabetes (9/26).
The number of different interventions included in each disease management programme varied, with 48 programmes using a single intervention, 41 using two, 22 using three, and seven using four interventions (table (table2).2).
Table 2
Table 2
 Number of different interventions used in disease management programmes for chronic diseases
Impact of programmes with provider interventions
Disease control
We identified 32 programmes addressing six conditions that included provider education and evaluated disease control (table (table33).2242,51,54,56,57,76,85 Twelve of these (38%) produced significant improvements in disease control.24,30,31,33,34,3642 Disease management for depression and diabetes had the highest percentage of programmes that produced significant benefits (40% (6/15) and 25% (2/8), respectively). Overall, programmes that included provider education showed a modest but significant improvement in disease control (effect size 0.35 (95% confidence interval 0.19 to 0.51)).
Table 3
Table 3
 Effects of disease management programmes with interventions directed at healthcare providers on disease control
Twenty three programmes addressing asthma, depression, diabetes, renal disease, hyperlipidaemia, and hypertension included provider feedback and evaluated disease control (table (table33).23,24,27,29,3133,4252,54,84 Of these, nine (39%) showed significant improvements in disease control (eight of which were depression programmes).24,31,33,42,4447,84 Overall, programmes with provider feedback produced a small but significant improvement in disease control (effect size 0.17 (0.1 to 0.25)).
Fourteen programmes incorporating provider reminders evaluated disease control (table (table33).2931,36,39,43,50,5355,85 Of these, six (43%) significantly improved disease control.30,31,36,39,53,55 Programmes with provider reminders were effective for patients with diabetes and hyperlipidaemia. Overall, the programmes made a small but significant improvement in disease control (effect size 0.22 (0.1 to 0.37)).
Provider adherence to guidelines
Twenty four programmes that included provider education assessed measures of provider adherence to guidelines,24,25,2833,41,42,54,5661 of which 12 (50%) significantly improved these measures (table (table44).28,30,31,33,41,42,5861 Disease management for depression had the highest percentage of programmes with significant benefit (9/14). Overall, programmes with provider education components significantly improved provider adherence to guidelines (effect size 0.44 (0.19 to 0.68)).
Table 4
Table 4
 Effects of disease management programmes with interventions directed at healthcare providers on provider adherence to guidelines
Sixteen programmes with provider feedback evaluated provider adherence to guidelines (table (table44).24,29,3133,42,46,49,54,58,59,62,63 Nine of these (56%) significantly improved provider adherence,31,33,42,46,58,59 with programmes for depression being most successful (8/12). Overall, these programmes were effective in improving provider adherence (effect size 0.61 (0.28 to 0.93)).
Ten programmes with provider reminders examined provider adherence (table (table44).2931,54,59,63,64 Six (60%) significantly improved adherence,30,31,59,64 with programmes for depression being most successful (5/8). Overall, these programmes were also effective in improving provider adherence (effect size 0.52 (0.35 to 0.69)).
Impact of programmes with patient interventions on disease control
Fifty five programmes included patient education and evaluated disease control (table (table55).2227,2931,33,34,36,37,42,4447 49,50,52,53,56,6588,91 Of these, 24 (44%) significantly improved disease control.24,30,31,33,34,36,37,42,4447,53,66,67,69,70 73,74,79,8284,88 The highest percentage of programmes producing significant improvements were among those for depression (10/18), asthma (2/3), and hypertension (2/2). Overall, patient education produced a small but significant improvement in disease control (effect size 0.24 (0.07 to 0.40)).
Table 5
Table 5
 Effects of disease management programmes with interventions directed at patients on disease control
Sixteen programmes including patient reminders evaluated disease control (table (table55).22,34,43,46,47,49,53,54,68,71,81,82,87,89,90 Six (38%) significantly improved disease control.34,46,47,53,82,89 The highest percentage of programmes producing significant improvements were among those for depression (2/3) and diabetes (4/7). Overall, programmes with patient reminders produced a small but significant improvement in disease control (effect size 0.27 (0.17 to 0.36)).
Four programmes incorporating patient financial incentives evaluated disease control (table (table55).33,52,83,91 Three, including one depression programme33 and two hypertension programmes,83,91 significantly improved disease control. Overall, these programmes seemed effective in improving disease control (effect size 0.40 (0.26 to 0.54)).
Our study showed that many different interventions—including provider education, provider feedback, provider reminders, patient education, patient reminders, and patient financial incentives—were associated with improvements in provider adherence to guidelines and patient disease control. However, since existing studies do not directly compare different interventions, less is known about which interventions produce the greatest relative improvements in care.
There should be careful consideration of the most effective strategies for changing provider and patient behaviour, since it is difficult to postulate any improvements in patient care if both provider and patient behaviour remains unchanged. Our study showed that many different types of intervention are being used in disease management programmes, with patient education being the commonest. Also, 59% of disease management programmes used two or more interventions, possibly because multiple interventions are thought to be more likely to be successful than single interventions. The wide variety interventions used may reflect the paucity of available information to guide programme development and to define an optimal strategy. It is ironic that disease management programmes are designed to reduce unexplained variations in care, yet there are large and unexplained variations in the design, development, and implementation of disease management programmes.
Because of the promise that disease management holds for improving patient care, about $1bn is invested in disease management programmes in the United States each year.4 The National Committee on Quality Assurance (NCQA) in the United States requires health plans to submit data on two disease management programmes each year for consideration of accreditation. However, this investment in disease management should be guided by information on how to optimise the benefits of these programmes. Unfortunately, disease management programme developers have had limited qualitative or quantitative information about which interventions achieve the greatest benefits, and programmes are therefore highly variable in design.
Strengths and limitations of study
To the best of our knowledge, our study is the first comprehensive attempt to evaluate the effectiveness of different disease management programmes for patients with chronic illness. Our study brought together disparate information of disease management, to allow for qualitative and quantitative interpretation. We evaluated 16 917 different article titles and identified 102 different disease management studies. We evaluated multiple potential implementation strategies for many different diseases and conditions, and we evaluated both the process of care (provider adherence to guidelines) and the outcome of care (disease control). Disease control measures were carefully selected and related to the key clinical goals of the treatment of each disease. In addition, our study provided both qualitative and quantitative information to assess the effectiveness of different interventions; most other studies have evaluated only qualitative findings.4,7,8,1013 Therefore, in addition to integrated information on the effect sizes of interventions on patient disease control and adherence to guidelines,20 we have provided detailed descriptions of each study (see authors' website www.zynx.com\research\disease_management.htm).
Our study has several limitations, most importantly the quality, quantity, and heterogeneity of the original studies. The studies included great variation in interventions used, patient populations, provider populations, and measured processes and outcomes of care. Many provided insufficient detail in the methods section for us to understand the quality of the interventions and the intensity or duration of each intervention. For example, a study might report that provider education was used, but provide insufficient information for readers to understand how the educational process was performed and how to replicate the process.
The clinical significance of effect sizes may be unclear and need to be interpreted with caution and related to the measured clinical effects reported in the trials.20 Few studies directly compared the effectiveness of different interventions, and without direct comparisons of interventions in trials it is difficult to evaluate each intervention's relative effectiveness.
Conclusions
The available published literature shows that most disease management programmes directed at providers and patients are associated with improvements in care. However, little is known about the relative effectiveness and costs associated with different implementation strategies, and few studies have directly compared intervention strategies. Further research is needed to determine the effectiveness and costs of different implementation strategies that could be used in disease management programmes. These studies should adhere to methodological standards and be described in peer reviewed literature in sufficient detail to enable others to understand and reproduce the results in different patient populations, and to understand the relative effectiveness of different disease management interventions for improving the care of patients with chronic diseases.
Figure
Figure
Selection process for including studies in systematic review
Supplementary Material
[extra: Extra references]
Acknowledgments
We thank David Nash, David Shulkin, and Mark Zitter for providing extra references for our review.
Footnotes
Funding: This work was partially supported by a research grant from TAP Pharmaceutical Products.
Competing interests: SRW has been reimbursed for speaking at conferences on the topic of disease management and was a member of the NCQA Disease Management Advisory Committee. At the time of the study Zynx Health was owned by Cedars-Sinai Health System and affiliated with the UCLA School of Medicine; it is now a subsidiary of Cerner Corporation. At no time has it derived revenue from selling or providing services for disease management programmes.
Further details of this review appear on bmj.com and details of the studies reviewed appear on the authors' website
1. Smith DH, Malone DC, Lawson KA, Okamoto LJ, Battista C, Saunders WB. A national estimate of the economic costs of asthma. Am J Respir Crit Care Med. 1997;156:787–793. [PubMed]
2. Greenberg PE, Stiglin LE, Finkelstein SN, Berndt ER. The economic burden of depression in 1990. J Clin Psychiatry. 1993;54:405–418. [PubMed]
3. American Diabetes Association. Economic consequences of diabetes mellitus in the US in 1997. Diabetes Care. 1998;21:296–309. [PubMed]
4. Ellrodt G, Cook DJ, Lee J, Cho M, Hunt D, Weingarten S. Evidence-based disease management. JAMA. 1997;278:1687–1692. [PubMed]
5. Epstein WA, Sanchez M, Kechijian P. Conjunctivitis. Arch Dermatol. 1985;121:838. [PubMed]
6. Wehrwein P. What happens when politicians play doctor. Manag Care. 1997;6:28–34. [PubMed]
7. Oxman AD, Thomson MA, Davis DA, Haynes RB. No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. CMAJ. 1995;153:1423–1431. [PMC free article] [PubMed]
8. Davis DA, Thomson MA, Oxman AD, Haynes RB. Evidence for the effectiveness of CME. A review of 50 randomized controlled trials. JAMA. 1992;268:1111–1117. [PubMed]
9. Mugford M, Banfield P, O'Hanlon M. Effects of feedback of information on clinical practice: a review. BMJ. 1991;303:398–402. [PMC free article] [PubMed]
10. Grol R. Beliefs and evidence in changing clinical practice. BMJ. 1997;315:418–421. [PMC free article] [PubMed]
11. Davis DA, Taylor-Vaisey A. Translating guidelines into practice. A systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines. CMAJ. 1997;157:408–416. [PMC free article] [PubMed]
12. Grimshaw JM, Russell IT. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993;342:1317–1322. [PubMed]
13. Committee to Advise the Public Health Service on Clinical Practice Guidelines; Institute of Medicine. Clinical practice guidelines: directions for a new program. Washington DC: National Academy Press; 1990.
14. Cochrane Effective Practice and Organisation of Care Group (EPOC) information page. Cochrane Database of Systematic Reviews website. http://gateway.ovid.com/rel410/server1/ovidweb.cgi (accessed 19 Jul 2000).
15. Rosenthal R, Rubin D. Combining results from independent studies. Psychol Bull. 1979;85:185–193.
16. Glass G. Summarizing effect sizes. New directions for methodology of social and behavioral science: quantitative assessment of research domains. San Francisco CA: Jossey-Bass; 1980.
17. Rosenthal R. Meta-analytic procedures for social research. Beverly Hills CA: Sage Publications; 1984.
18. Hedges LV, Olkin I. Statistical methods for meta-analysis. Orlando FL: Academic Press; 1985.
19. Hasselblad V, Hedges LV. Meta-analysis of screening and diagnostic tests. Psychol Bull. 1995;117:167–178. [PubMed]
20. Kazis LE, Anderson JJ, Meenan RF. Effect size for interpreting changes in health status. Med Care. 1989;27:S178–S189. [PubMed]
21. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7:177–188. [PubMed]
22. DeBusk RF, Miller NH, Superko HR, Dennis CA, Thomas RJ, Lew HT, et al. A case-management system for coronary risk factor modification after acute myocardial infarction. Ann Intern Med. 1994;120:721–729. [PubMed]
23. Hunkeler EM, Meresman JF, Hargreaves WA, Fireman B, Berman WH, Kirsch AJ, et al. Efficacy of nurse telehealth care and peer support in augmenting treatment of depression in primary care. Arch Fam Med. 2000;9:700–708. [PubMed]
24. Katon W, Rutter C, Ludman EJ, Von K, Lin E, Simon G, et al. A randomized trial of relapse prevention of depression in primary care. Arch Gen Psychiatry. 2001;58:241–247. [PubMed]
25. Lin EH, Simon GE, Katon WJ, Russo JE, Von K, Bush TM, et al. Can enhanced acute-phase treatment of depression improve long-term outcomes? A report of randomized trials in primary care. Am J Psychiatry. 1999;156:643–645. [PubMed]
26. Llewellyn-Jones RH, Baikie KA, Smithers H, Cohen J, Snowdon J, Tennant CC. Multifaceted shared care intervention for late life depression in residential care: randomised controlled trial. BMJ. 1999;319:676–682. [PMC free article] [PubMed]
27. Whooley MA, Stone B, Soghikian K. Randomized trial of case-finding for depression in elderly primary care patients. J Gen Intern Med. 2000;15:293–300. [PMC free article] [PubMed]
28. Worrall G, Angel J, Chaulk P, Clarke C, Robbins M. Effectiveness of an educational strategy to improve family physicians' detection and management of depression: a randomized controlled trial. CMAJ. 1999;161:37–40. [PMC free article] [PubMed]
29. Callahan CM, Hendrie HC, Dittus RS, Brater DC, Hui SL, Tierney WM. Improving treatment of late life depression in primary care: a randomized clinical trial. J Am Geriatr Soc. 1994;42:839–846. [PubMed]
30. Katon W, Robinson P, Von KM, Lin E, Bush T, Ludman E, et al. A multifaceted intervention to improve treatment of depression in primary care. Arch Gen Psychiatry. 1996;53:924–932. [PubMed]
31. Katon W, Von Korff M, Lin E, Walker E, Simon GE, Bush T, et al. Collaborative management to achieve treatment guidelines. Impact on depression in primary care. JAMA. 1995;273:1026–1031. [PubMed]
32. Thompson C, Kinmonth AL, Stevens L, Peveler RC, Stevens A, Ostler KJ, et al. Effects of a clinical-practice guideline and practice-based education on detection and outcome of depression in primary care: Hampshire depression project randomised controlled trial. Lancet. 2000;355:185–191. [PubMed]
33. Wells KB, Sherbourne C, Schoenbaum M, Duan N, Meredith L, Unutzer J, et al. Impact of disseminating quality improvement programs for depression in managed primary care: a randomized controlled trial. JAMA. 2000;283:212–220. [PubMed]
34. Aubert RE, Herman WH, Waters J, Moore W, Sutton D, Peterson BL, et al. Nurse case management to improve glycemic control in diabetic patients in a health maintenance organization. A randomized, controlled trial. Ann Intern Med. 1998;129:605–612. [PubMed]
35. Benjamin EM, Schneider MS, Hinchey KT. Implementing practice guidelines for diabetes care using problem-based learning. A prospective controlled trial using firm systems. Diabetes Care. 1999;22:1672–1678. [PubMed]
36. Vinicor F, Cohen SJ, Mazzuca SA, Moorman N, Wheeler M, Kuebler T, et al. DIABEDS: a randomized trial of the effects of physician and/or patient education on diabetes patient outcomes. J Chronic Dis. 1987;40:345–356. [PubMed]
37. Erickson SR, Slaughter R, Halapy H. Pharmacists' ability to influence outcomes of hypertension therapy. Pharmacotherapy. 1997;17:140–147. [PubMed]
38. Gourley GA, Portner TS, Gourley DR, Rigolosi EL, Holt JM, Solomon DK, et al. Humanistic outcomes in the hypertension and COPD arms of a multicenter outcomes study. J Am Pharm Assoc. 1998;38:586–597. [PubMed]
39. Bogden PE, Koontz LM, Williamson P, Abbott RD. The physician and pharmacist team. An effective approach to cholesterol reduction. J Gen Intern Med. 1997;12:158–164. [PMC free article] [PubMed]
40. Katz S, Vignos PJ, Jr, Moskowitz RW, Thompson HM, Svec KH. Comprehensive outpatient care in rheumatoid arthritis. A controlled study. JAMA. 1968;206:1249–1254. [PubMed]
41. Rost K, Nutting P, Smith J, Werner J, Duan N. Improving depression outcomes in community primary care practice: a randomized trial of the quEST intervention. Quality enhancement by strategic teaming. J Gen Intern Med. 2001;16:143–149. [PMC free article] [PubMed]
42. Katzelnick DJ, Simon GE, Pearson SD, Manning WG, Helstad CP, Henk HJ, et al. Randomized trial of a depression management program in high utilizers of medical care. Arch Fam Med. 2000;9:345–351. [PubMed]
43. Integrated care for asthma: a clinical, social, and economic evaluation. Grampian asthma study of integrated care (GRASSIC) BMJ. 1994;308:559–564. [PMC free article] [PubMed]
44. Simon GE, VonKorff M, Rutter C, Wagner E. Randomised trial of monitoring, feedback, and management of care by telephone to improve treatment of depression in primary care. BMJ. 2000;320:550–554. [PMC free article] [PubMed]
45. Tutty S, Simon G, Ludman E. Telephone counseling as an adjunct to antidepressant treatment in the primary care system. A pilot study. Eff Clin Pract. 2000;3:170–178. [PubMed]
46. Walker EA, Katon WJ, Russo J, Von K, Lin E, Simon G, et al. Predictors of outcome in a primary care depression trial. J Gen Intern Med. 2000;15:859–867. [PMC free article] [PubMed]
47. Katon W, Von K, Lin E, Simon G, Walker E, Unutzer J, et al. Stepped collaborative care for primary care patients with persistent symptoms of depression: a randomized trial. Arch Gen Psychiatry. 1999;56:1109–1115. [PubMed]
48. Kulkarni K, Castle G, Gregory R, Holmes A, Leontos C, Powers M, et al. Nutrition practice guidelines for type 1 diabetes mellitus positively affect dietitian practices and patient outcomes. The Diabetes Care and Education Dietetic Practice Group. J Am Diet Assoc. 1998;98:62–70. , quiz 71-2. [PubMed]
49. Piette JD, Weinberger M, Kraemer FB, McPhee SJ. Impact of automated calls with nurse follow-up on diabetes treatment outcomes in a department of Veterans Affairs health care system: a randomized controlled trial. Diabetes Care. 2001;24:202–208. [PubMed]
50. Harris LE, Luft FC, Rudy DW, Kesterson JG, Tierney WM. Effects of multidisciplinary case management in patients with chronic renal insufficiency. Am J Med. 1998;105:464–471. [PubMed]
51. Hetlevik I, Holmen J, Kruger O. Implementing clinical guidelines in the treatment of hypertension in general practice. Evaluation of patient outcome related to implementation of a computer-based clinical decision support system. Scand J Prim Health Care. 1999;17:35–40. [PubMed]
52. Fielding JE, Mason T, Kinght K, Klesges R, Pelletier KR. A randomized trial of the IMPACT worksite cholesterol reduction program. Am J Prev Med. 1995;11:120–123. [PubMed]
53. De Sonnaville J, Bouma M, Colly LP, Deville W, Wijkel D, Heine RJ. Sustained good glycaemic control in NIDDM patients by implementation of structured care in general practice: 2-year follow-up study. Diabetologia. 1997;40:1334–1340. [PubMed]
54. Hurwitz B, Goodman C, Yudkin J. Prompting the clinical care of non-insulin dependent (type II) diabetic patients in an inner city area: one model of community care. BMJ. 1993;306:624–630. [PMC free article] [PubMed]
55. Bogden PE, Abbott RD, Williamson P, Onopa JK, Koontz LM. Comparing standard care with a physician and pharmacist team approach for uncontrolled hypertension. J Gen Intern Med. 1998;13:740–745. [PMC free article] [PubMed]
56. Kinmonth AL, Woodcock A, Griffin S, Spiegal N, Campbell MJ. Randomised controlled trial of patient centred care of diabetes in general practice: impact on current wellbeing and future disease risk. The Diabetes Care From Diagnosis Research Team. BMJ. 1998;317:1202–1208. [PMC free article] [PubMed]
57. Montgomery AA, Fahey T, Peters TJ, MacIntosh C, Sharp DJ. Evaluation of computer based clinical decision support system and risk chart for management of hypertension in primary care: randomised controlled trial. BMJ. 2000;320:686–690. [PMC free article] [PubMed]
58. Heller RF, D'Este C, Lim LL, O'Connell RL, Powell H. Randomised controlled trial to change the hospital management of unstable angina. Med J Aust. 1988;174:217–221. [PubMed]
59. Smith JL, Rost KM, Nutting PA, Elliott CE, Duan N. A primary care intervention for depression. J Rural Health. 2000;16:313–323. [PubMed]
60. Donohoe ME, Fletton JA, Hook A, Powell R, Robinson I, Stead JW, et al. Improving foot care for people with diabetes mellitus—a randomized controlled trial of an integrated care approach. Diabet Med. 2000;17:581–587. [PubMed]
61. Browner WS, Baron RB, Solkowitz S, Adler LJ, Gullion DS. Physician management of hypercholesterolemia. A randomized trial of continuing medical education. West J Med. 1994;161:572–578. [PMC free article] [PubMed]
62. Gattis WA, Hasselblad V, Whellan DJ, O'Connor CM. Reduction in heart failure events by the addition of a clinical pharmacist to the heart failure management team: results of the pharmacist in heart failure assessment recommendation and monitoring (PHARM) study. Arch Intern Med. 1999;159:1939–1945. [PubMed]
63. Magruder-Habib K, Zung WW, Feussner JR. Improving physicians' recognition and treatment of depression in general medical care. Results from a randomized clinical trial. Intervention for minor depression in primary care patients. Med Care. 1990;28:239–250. [PubMed]
64. Litzelman DK, Slemenda CW, Langefeld CD, Hays LM, Welch MA, Bild DE, et al. Reduction of lower extremity clinical abnormalities in patients with non-insulin-dependent diabetes mellitus. A randomized, controlled trial. Ann Intern Med. 1993;119:36–41. [PubMed]
65. Mulloy E, Donaghy D, Quigley C, McNicholas WT. A one-year prospective audit of an asthma education program in an out-patient setting. Ir Med J. 1996;89:226–228. [PubMed]
66. Ignacio-Garcia JM, Gonzalez-Santos P. Asthma self-management education program by home monitoring of peak expiratory flow. Am J Respir Crit Care Med. 1995;151:353–359. [PubMed]
67. Sont JK, Willems LN, Bel EH, van Krieken J, Vandenbroucke JP, Sterk PJ. Clinical control and histopathologic outcome of asthma when using airway hyperresponsiveness as an additional guide to long-term treatment. The AMPUL Study Group. Am J Respir Crit Care Med. 1999;159:1043–1051. [PubMed]
68. Lidell E, Fridlund B. Long-term effects of a comprehensive rehabilitation program after myocardial infarction. Scand J Caring Sci. 1996;10:67–74. [PubMed]
69. Hedback B, Perk J, Wodlin P. Long-term reduction of cardiac mortality after myocardial infarction: 10-year results of a comprehensive rehabilitation program. Eur Heart J. 1993;14:831–835. [PubMed]
70. Peters JL, Large RG. A randomised control trial evaluating in- and outpatient pain management programs. Pain. 1990;41:283–293. [PubMed]
71. Ries AL, Kaplan RM, Limberg TM, Prewitt LM. Effects of pulmonary rehabilitation on physiologic and psychosocial outcomes in patients with chronic obstructive pulmonary disease. Ann Intern Med. 1995;122:823–832. [PubMed]
72. Troosters T, Gosselink R, Decramer M. Short- and long-term effects of outpatient rehabilitation in patients with chronic obstructive pulmonary disease: a randomized trial. Am J Med. 2000;109:207–212. [PubMed]
73. Banerjee S, Shamash K, Macdonald AJ, Mann AH. Randomised controlled trial of effect of intervention by psychogeriatric team on depression in frail elderly people at home. BMJ. 1996;313:1058–1061. [PMC free article] [PubMed]
74. D'Eramo-Melkus GA, Wylie-Rosett J, Hagan JA. Metabolic impact of education in NIDDM. Diabetes Care. 1992;15:864–869. [PubMed]
75. Diabetes Integrated Care Evaluation Team. Integrated care for diabetes: clinical, psychosocial, and economic evaluation. BMJ. 1994;308:1208–1212. [PMC free article] [PubMed]
76. De Weerdt I, Visser AP, Kok GJ, de Weerdt O, van der Veen EA. Randomized controlled multicentre evaluation of an education program for insulin-treated diabetic patients: effects on metabolic control, quality of life, and costs of therapy. Diabet Med. 1991;8:338–345. [PubMed]
77. Domenech MI, Assad D, Mazzei ME, Kronsbein P, Gagliardino JJ. Evaluation of the effectiveness of an ambulatory teaching/treatment program for non-insulin dependent (type 2) diabetic patients. Acta Diabetol. 1995;32:143–147. [PubMed]
78. Franz MJ, Monk A, Barry B, McClain K, Weaver T, Cooper N, et al. Effectiveness of medical nutrition therapy provided by dietitians in the management of non-insulin-dependent diabetes mellitus: a randomized, controlled clinical trial. J Am Diet Assoc. 1995;95:1009–1017. [PubMed]
79. Jaber LA, Halapy H, Fernet M, Tummalapalli S, Diwakaran H. Evaluation of a pharmaceutical care model on diabetes management. Ann Pharmacother. 1996;30:238–243. [PubMed]
80. Mazzuca SA, Moorman NH, Wheeler ML, Norton JA, Fineberg NS, Vinicor F, et al. The diabetes education study: a controlled trial of the effects of diabetes patient education. Diabetes Care. 1986;9:1–10. [PubMed]
81. Ridgeway NA, Harvill DR, Harvill LM, Falin TM, Forester GM, Gose OD. Improved control of type 2 diabetes mellitus: a practical education/behavior modification program in a primary care clinic. South Med J. 1999;92:667–672. [PubMed]
82. Weinberger M, Kirkman MS, Samsa GP, Shortliffe EA, Landsman PB, Cowper PA, et al. A nurse-coordinated intervention for primary care patients with non-insulin-dependent diabetes mellitus: impact on glycemic control and health-related quality of life. J Gen Intern Med. 1995;10:59–66. [PubMed]
83. Fielding JE, Knight K, Mason T, Klesges RC, Pelletier KR. Evaluation of the IMPACT blood pressure program. J Occup Med. 1994;36:743–746. [PubMed]
84. Ellis SL, Carter BL, Malone DC, Billups SJ, Okano GJ, Valuck RJ, et al. Clinical and economic impact of ambulatory care clinical pharmacists in management of dyslipidemia in older adults: the IMPROVE study. impact of managed pharmaceutical care on resource utilization and outcomes in Veterans Affairs medical centers. Pharmacotherapy. 2000;20:1508–1516. [PubMed]
85. Keyserling TC, Ammerman AS, Davis CE, Mok MC, Garrett J, Simpson RJ. A randomized controlled trial of a physician-directed treatment program for low-income patients with high blood cholesterol: the southeast cholesterol project. Arch Fam Med. 1997;6:135–145. [PubMed]
86. Bell MJ, Lineker SC, Wilkins AL, Goldsmith CH, Badley EM. A randomized controlled trial to evaluate the efficacy of community based physical therapy in the treatment of people with rheumatoid arthritis. J Rheumatol. 1998;25:231–237. [PubMed]
87. Schned ES, Doyle MA, Glickstein SL, Schousboe JT, Reinertsen JL, Baglioni AJ, et al. Team managed outpatient care for early onset chronic inflammatory arthritis. J Rheumatol. 1995;22:1141–1148. [PubMed]
88. Vliet Vlieland TP, Zwinderman AH, Vandenbroucke JP, Breedveld FC, Hazes JM. A randomized clinical trial of in-patient multidisciplinary treatment versus routine out-patient care in active rheumatoid arthritis. Br J Rheumatol. 1996;35:475–482. [PubMed]
89. O'Connor PJ, Rush WA, Peterson J, Morben P, Cherney L, Keogh C, et al. Continuous quality improvement can improve glycemic control for HMO patients with diabetes. Arch Fam Med. 1996;5:502–506. [PubMed]
90. Hyman DJ, Ho KS, Dunn JK, Simons-Morton D. Dietary intervention for cholesterol reduction in public clinic patients. Am J Prev Med. 1998;15:139–145. [PubMed]
91. Hypertension Detection and Follow-up Program Cooperative Group. Five-year findings of the hypertension detection and follow-up program. II. Mortality by race-sex and age. JAMA. 1979;242:2572–2577. [PubMed]
Articles from BMJ : British Medical Journal are provided here courtesy of
BMJ Group