PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Med Care. Author manuscript; available in PMC 2012 July 22.
Published in final edited form as:
PMCID: PMC3401560
NIHMSID: NIHMS310480

Quality Improvement Implementation and Disparities: The Case of the Health Disparities Collaboratives

Abstract

Background

The Health Disparities Collaboratives (HDC), a quality improvement collaborative incorporating rapid quality improvement (QI), a chronic care model, and learning sessions, have been implemented in over 900 community health centers across the country.

Objectives

To determine the HDC’s effect on clinical processes and outcomes, their financial impact, and factors important for successful implementation.

Research Design

Systematic review of the literature.

Results

The HDC improve clinical processes of care over short-term 1–2 year periods, and clinical processes and outcomes over longer 2–4 year periods. Most participants perceive that the HDC are successful and worth the effort. Analysis of the Diabetes Collaborative reveals that it is societally cost-effective with an incremental cost-effectiveness ratio of $33,386/quality-adjusted life year (QALY), but that consistent revenue streams for the initiative do not exist. Common barriers to improvement include lack of resources, time, and staff burnout. Highest ranked priorities for more funding are money for direct patient services, data entry, and staff time for QI. Other common requests for more assistance are help with patient self-management, information systems, and getting providers to follow guidelines. Relatively low-cost ways to increase staff morale and prevent burnout include personal recognition, skills development opportunities, and fair distribution of work.

Conclusions

The HDC have successfully improved quality of care and the Diabetes Collaborative is societally cost-effective, but policy reforms are necessary to create a sustainable business case for these health centers that serve many uninsured and underinsured populations.

Keywords: quality improvement, community health center, health disparities, cost, diabetes

Quality improvement implementation is challenging under the best of circumstances, and efforts to reduce racial and socioeconomic disparities in health care with QI techniques have additional barriers to hurdle. Many minority patients and patients of lower socioeconomic status receive their care in settings that have limited resources. In addition, vulnerable populations have a variety of economic, educational, and social difficulties that make it harder for them to improve self-management of chronic illnesses. While equity is one of the six fundamental domains of the Institute of Medicine’s definition of quality,1 it has generally received less attention compared with other elements such as effectiveness.2 Moreover, in the health disparities field,3 most of the existing literature documents disparities but a much smaller body of work seeks to develop and evaluate interventions to reduce these disparities.4

Community health centers (HCs) are vanguard providers of health care for vulnerable populations,5, 6 serving 16 million Americans in 5000 sites.7 Forty percent of HC patients are uninsured, 36% have Medicaid coverage, over 60% are racial or ethnic minorities, and 71% are at or below the federal poverty line.8 Nationally, HCs serve 1 out of every 4 people in poverty, 1 out of 10 minorities, and 1 out of 9 rural Americans. HCs are truly a critical provider of health care to underserved populations and a vital part of efforts to reduce national disparities in care.

Therefore, the Health Disparities Collaboratives,9 a massive state-of-the-art effort by the Health Resources and Services Administration’s Bureau of Primary Health Care (HRSA’s BPHC) to improve the quality of care in community health centers across the country, are an important case example to study for using quality improvement techniques to decrease disparities. As of December 2007, 915 HCs have participated in the HDC [personal communication: Charles Daly, Health Resources and Services Administration, December 10, 2007]. In this paper, I describe the HDC and then review the evidence for their impact on quality of care, the financial ramifications for society and the individual HC, and factors important for organizational change at the HCs. I end with summary conclusions and recommendations for future research questions.

The Health Disparities Collaboratives

In the 1990s, it became known that the quality of care in health centers for conditions such as diabetes was similar to other settings such as private doctors’ offices, academic medical centers, and managed care organizations but still needed to be improved.10, 11 In addition, wide variation in the quality of care was apparent across centers, with some centers performing extremely well and some poorly.10 The 1990s also saw the rise of the MacColl Chronic Care Model as one of the most popular paradigms for approaching chronic disease management,12 and increasing interest in quality improvement collaboratives to improve care across multiple organizations.13, 14 In the QI collaborative model, different organizations learn QI techniques in joint learning sessions, and then share best practices over the ensuing year or longer to leverage and multiply the learning.15 Before-after studies of the QI collaborative model were promising although a controlled trial of HIV care was largely negative.16, 17 HRSA’s BPHC decided to adopt and implement the QI collaborative model in 1998 in an initiative they called the HDC. The HDC have three main components that have been in described in more detail elsewhere: Model for Improvement, MacColl Chronic Care Model, Learning Sessions / Support.18, 19

Each HC creates a HDC team that works to improve the quality of care of the target condition with the support of senior administrative leadership. A critical component is the creation of a patient registry to help track clinical care. Initially a difficult task for many HCs, the BPHC eventually offered standard patient registry software. A Model for Improvement developed by Associates in Learning based upon the Plan, Do, Study, Act (PDSA) cycle was introduced into each HC.20 This Model takes the standard PDSA cycle from continuous quality improvement and emphasizes the goal of rapid cycle improvement – testing an intervention on a small group of patients to allow assessment and then revision of the intervention.

The HDC use the MacColl Chronic Care Model, which aims to create practical, supportive interactions between an informed, activated patient and a proactive, prepared clinical team.12 The Chronic Care Model’s domains become the targets for the rapid PDSA cycles: patient self-management, delivery system redesign, decision support, clinical information systems, leadership and health system organization, and community outreach.

The Model for Improvement and Chronic Care Model are embedded within regional and national support structures provided by the BPHC. At learning sessions, team members and administrators from groups of 15–20 health centers learn QI techniques and share lessons among themselves, hence the collaborative nature of this QI process. Regional cluster coordinators provide additional assistance through telephone conference calls, a computer listserv, feedback on required monthly progress reports, patient registry and information systems support, and regional meetings. The first year of a given Collaborative involves four regional or national meetings and monthly followup. Subsequent years of participation generally include one regional meeting and quarterly reports to the BPHC. The BPHC paid travel expenses of participants attending the learning sessions. BPHC is currently transitioning HDC infrastructural support from the regions to state Primary Care Associations.

Methods

The author systematically reviewed PubMed for articles on the HDC using the key words “Health Disparities Collaborative”, “quality improvement”, “disparities”, and “collaboratives”. He also searched the reference lists of the websites of the Health Disparities Collaboratives and National Association of Community Health Centers (NACHC), and spoke to key informants at BPHC, NACHC, and the research community to ensure that the search was complete.

Description of the HDC

HC personnel spent considerable time working on the HDC. Team leaders worked nearly 11 hours per week on the HDC, team members 8 hours, chief executive officers 3 hours, and physicians 5 hours.21 Most participants found the Chronic Care Model and PDSA system to be useful, although many used the PDSA system qualitatively rather than quantitatively.18 They would try an intervention in a small number of patients and get a sense of whether it was working or not rather than performing a formal quantitative analysis of the intervention. On average, teams implemented 44 QI activities between 2000–2002. The most common areas of interventions were patient registries and community linkages for patients.22 Implementation of the elements of the Chronic Care Model was reasonably good as measured by the Assessment of Chronic Illness Care (ACIC) survey.23 ACIC scores ranged from 6.7 to 8.1 for target areas in the Chronic Care Model, where 0 is worst and 11 is best.19

HDC Participants’ Perceptions of Outcomes

Survey and interview studies indicate that HDC participants generally perceive that the HDC have improved outcomes.18 Over 90% of surveyed Diabetes Collaborative participants believe that the collaborative has been a success and worth the effort.18 Qualitative interviews of team leaders and team members are consistent with these survey results; most interviewees were very proud of their accomplishments.18

Clinical Processes of Care and Outcomes

Two general types of studies are in the literature: evaluations using the existing patient registry data and those employing chart review of randomly selected patients. Most studies assess short-term (1–2 years) processes and outcomes while fewer examine long-term (4-year) results. Patient registry studies highlight the de facto “population of focus.” HDC participants are taught to initially focus on a small group of patients (e.g. – patients of one provider) rather than the entire center’s patients. After initial experience with the population of focus, the center is supposed to spread the initiative to other patients and providers in the center. The major criticisms of patient registry studies are that who is in the registry and when they enter the registry are not random processes and possibly biases towards positive results. In addition, over time the ultimate goal of the HDC is to improve the care of all patients in the center. Therefore, several recent studies utilize random chart reviews as their assessment tool.18, 19, 24

Patient Registry Studies

Registry studies of the Diabetes Collaborative in the early 2000s show absolute reductions in hemoglobin A1c values ranging from 0.8% to 4.2% (Table 1).25, 26

Table 1
Clinical Process and Outcomes Studies*

Short-term Chart Review Studies

A pre-post study of the first year of the Diabetes Collaborative in the Midwest region showed improvements in seven processes of care but no intermediary processes.18 For example, rates of performing the hemoglobian A1c test increased but actual hemoglobin A1c value did not improve. A controlled pre-post (1 year pre and 1 year post) national study of the Asthma, Diabetes, and Hypertension Collaboratives showed improvements in processes of care for asthma and diabetes, but no improvements in intermediary outcome measures.24

Long-term Chart Review Studies

A four year pre-post study of the Diabetes Collaborative in Midwestern and West Central states showed improvement in 11 processes of care and lowering of hemoglobin A1c and LDL cholesterol values.19 A randomized controlled trial comparing the standard HDC to the HDC plus additional organizational support, training of providers in communication and facilitation of patient behavioral change, and videos and brochures that empowered patients to become more actively involved in their care showed marginal benefit to the more intensive intervention, but the standard HDC appeared to account for the majority of the improvements in quality of care seen over time.19

Cost

Societal cost-effectiveness analysis of the Diabetes Collaborative using a NIH computer simulation model and outcomes data from the HDC showed that the Diabetes Collaborative is societally cost-effective with an incremental cost-effectiveness ratio (ICER) of $33,386/ quality-adjusted life year (QALY), with ICERs remaining below $100,000/QALY across a variety of sensitivity analyses regarding secular trends, clinical outcomes, and program costs (Table 2).27 The NIH simulation model incorporates epidemiological data from population-based studies and clinical trials and calculates the health effects and costs of interventions to improve risk factor control and the quality of diabetes care.28, 29 Increased use of angiotensin-converting enzyme inhibitors was the most powerful driver of the cost-effectiveness ($23,653/QALY), with glucose control ($104,811/QALY), aspirin use ($151,767/QALY), and cholesterol control ($416,850/QALY) contributing less strongly.

Table 2
Cost and Resource Studies*

The business case financial analysis from the perspective of the CEO was investigated in a case study of five Midwestern health centers examining administrative and clinical costs, as well as changes in payor mix.30, 31 HDC administrative costs/year ranged from $6.41-$21.93 per patient. The balance of diabetes clinical costs and revenues was variable; the balance of costs and revenues did not clearly improve. In addition, the payor mix of diabetes patients, that is the relative proportions of uninsured, poorly insured, and well insured patients, did not improve either. Overall the HDC introduced new costs without new revenues. However, the HDC program for this Diabetes Collaborative example was a small percentage of the overall HC budget, ranging from 1.9% to 8.2%

In a survey of 74 CEOs participating in the Diabetes Collaborative, most thought that the HDC increased patient costs and overall health center costs without changing reimbursement or government or private foundation funding.30 A related analysis of 100 CEOs engaging in any Health Disparities Collaborative found that one-third, especially those leading centers with a higher proportion of uninsured patients, believed that the HDC had a negative financial impact on their health center.32

Organizational Change and Implementation

In a detailed analysis of interventions recorded in monthly reports, Grossman et al. were unable to determine which interventions within the Chronic Care Model are correlated with improvements in quality of care and outcomes.22 Common barriers to improvement included lack of resources, time, and staff burnout.21, 33 When asked to rank their number priority for more funding, HDC participants listed money for direct patient resources (44%), data entry (34%), and staff time for QI (26%). They also requested more assistance with patient self-management (73%), information systems (77%), and getting providers to follow guidelines (64%).21 Insurance type was associated with the quality of diabetes care within health centers. Patients with no insurance or Medicaid insurance tended to have lower quality of care than patients with private insurance.34 In a case study of six health centers in North Carolina participating in the Diabetes Collaborative, staff indicated that shared problem solving and peer learning among HDC teams greatly aided implementation of patient registries.33

Graber et al. examined predictors of staff morale and burnout.35 Some of the predictors were relatively low-cost and modifiable such as receiving personal recognition, career promotion, skills development opportunities, fair distribution of work, effective training of new hires, and regular provider participation. More expensive predictors included sufficient funding and personal.

Summary Conclusions

The Health Disparities Collaboratives provide an important case example for efforts to use quality improvement techniques to reduce racial, ethnic, and socioeconomic disparities in care. HCs serve predominantly vulnerable patients, and thus the primary focus of the HDC has been improving the quality of care and outcomes of all patients they serve rather than reducing intra-center variation in care across different subgroups. In addition, most HDC studies do not use controls external to the health center setting because it is frequently difficult to find a feasible comparison group comparable to federally qualified health centers. Several conclusions can be drawn from this systematic review of the literature:

  1. The HDC improve clinical processes of care over short-term 1–2 year time periods and improve both processes of care and outcomes over longer 2–4 year periods. Processes of care such as measuring hemoglobin A1c are easier to increase than intermediary outcome measures such as improving actual hemoglobin A1c values. The former may respond to relatively straightforward system interventions such as improved tracking of diagnostic test ordering whereas outcomes improvement frequently requires behavioral change on the part of patients and providers. One of the key factors contributing to the success of the HDC is that the BPHC remained committed to the initiative over a 10 year period and provided a variety of support such as the cluster coordinators and information technology assistance.
  2. The Diabetes Collaborative is societally cost-effective, but no consistent financial streams exist for individual health centers, raising concerns about whether there is a business case for CEOs to adopt and sustain the HDC over the longterm. The cost of a particular HDC is a relatively small part of a HC’s total budget. However, over time the goal is to move from a QI approach targeting a single disease to spread of the overall methodology to multiple diseases, conditions, and processes. If spread is successful, then a more substantial percentage of a HC’s total budget would be involved. Without changes in the fundamental reimbursement schemes and incentive systems, HCs that tend to serve many uninsured and underinsured patients may lose money by providing high-quality care. While health centers have a mission to care for the underserved, ultimately they need to stay within budget and thus financial considerations are an important part of their strategic planning.
  3. Some methods to enhance implementation of the HDC are low-cost and feasible. For example, Graber et al. note a number of factors to increase staff morale and prevent burnout such as receiving personal recognition, skills development opportunities, fair distribution of work, and effective training of all newly hired employees.35
  4. Some methods to enhance implementation of the HDC will require more resources and work. The highest priority requests for more resources were to fund direct patient care services and time for data entry and QI work. Given the high numbers of uninsured patients cared for at HCs and that high quality evidence-based care often means the provision of more diagnostic tests and treatments, only so much QI can be done before HCs will need more funding to survive. Other complex requests for assistance from HCs include facilitating patient behavioral change, getting provider buy-in for HDC efforts, and encouraging providers to follow practice guidelines.

Several important research questions remain and include:

  1. How to tailor implementation of the HDC to different HCs that may be at different stages of organizational readiness to change and that may have different strengths, weaknesses, organizational contexts, and patient populations?36
  2. How to create a viable long-term business case for the HDC to complement the analysis demonstrating that the Diabetes Collaborative is societally cost-effective?
  3. How to successfully spread the HDC across multiple diseases, conditions, and processes? How can information systems adapt from being stand-alone disease specific patient registries to data and tracking systems relevant for the totality of a patient’s health? What kinds of infrastructure are necessary to support spread of the HDC as the BPHC transitions responsibility from the regions to the state primary care associations? For example, a demonstration project improved cancer screening practices in four health centers by combining elements of the basic HDC model with local and regional communities of practice.37 These networks mobilized community resources and also led to the sharing of best practices.
  4. How to sustain the HDC over time? What types of booster shots, incentives, and assistance are necessary to allow the HDC to succeed over the longterm?
  5. How to integrate the general QI process of the HDC with menus of specific model programs to help with difficult challenges such as facilitating patient behavioral change? The HDC combine the rapid cycle quality improvement process, MacColl Institute Chronic Care Model, and learning sessions. However, they do not dictate the use of specific interventions. While health centers like the flexibility of the process, they also appreciate seeing best practices and model programs they can consider adapting to their settings. For example, what are ways to improve patient self-management, how can a center use group cluster visits successfully, and what are the best ways to organize and run community health worker programs?

The HDC are one of the boldest efforts to improve quality of care and reduce disparities for vulnerable populations. The HDC are also the largest example of implementation of the QI collaborative approach. The HDC demonstrate that such approaches can be successful, but that thoughtful policy and managerial initiatives will be necessary to complement clinical leadership for longterm viability.38

Acknowledgments

Grant Support: This project was supported by the National Institute of Diabetes and Digestive and Kidney Diseases Diabetes Research and Training Center (P60 DK20595). Dr. Chin is supported by a Midcareer Investigator Award in Patient-Oriented Research from the National Institute of Diabetes and Digestive and Kidney Diseases (K24 DK071933).

References

1. Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, D.C.: National Academies Press; 2001. [PubMed]
2. Chin MH, Chien AT. Reducing racial and ethnic disparities in health care: an integral part of quality improvement scholarship. Qual Saf Health Care. 2006;15:79–80. [PMC free article] [PubMed]
3. Smedley B, Stith A, Nelson A, editors. Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care. Washington, D.C.: The National Academies Press; 2003.
4. Chin MH, Walters AE, Cook SC, Huang ES. Interventions to reduce racial and ethnic disparities in health care. Med Care Res Rev. 2007;64(5 Suppl):7S–28S. [PMC free article] [PubMed]
5. Lefkowitz B. The health center story: forty years of commitment. J Ambul Care Manage. 2005;28:295–303. [PubMed]
6. Proser M. Deserving the spotlight: health centers provide high-quality and cost-effective care. J Ambul Care Manage. 2005;28:321–330. [PubMed]
7. National Association of Community Health Centers. [Accessed February 4, 2008]; http://www.nachc.org/about/
8. National Association of Community Health Centers. [accessed February 4, 2008];A Sketch of Community Health Centers: Chart Book 2006. http://www.nachc.org/about/
9. Bureau of Primary Health Care. [accessed August 30, 2008];Health Disparities Collaboratives. http://www.healthdisparities.net/hdc/html/home.aspx.
10. Chin MH, Auerbach SB, Cook S, et al. Quality of diabetes care in community health centers. Am J Public Health. 2000;90:431–434. [PubMed]
11. Hicks LS, O'Malley AJ, Lieu TA, et al. The quality of chronic disease care in U.S. community health centers. Health Aff (Millwood) 2006;25:1712–1723. [PubMed]
12. Wagner EH, Austin BT, Von Korff M. Organizing care for patients with chronic illness. Milbank Q. 1996;74:511–544. [PubMed]
13. Ovretveit J, Gustafson D. Evaluation of quality improvement programmes. Qual Saf Health Care. 2002;11:270–275. [PMC free article] [PubMed]
14. Wilson T, Berwick DM, Cleary PD. What do collaborative improvement projects do? Experience from seven countries. Jt Comm J Qual Saf. 2003;29:85–93. [PubMed]
15. Mittman BS. Creating the evidence base for quality improvement collaboratives. Ann Intern Med. 2004;140:897–901. [PubMed]
16. Wagner EH, Glasgow RE, Davis C, et al. Quality improvement in chronic illness care: a collaborative approach. Jt Comm J Qual Improv. 2001;27:63–80. [PubMed]
17. Landon BE, Wilson IB, McInnes K, et al. Effects of a quality improvement collaborative on the outcome of care of patients with HIV infection: the EQHIV study. Ann Intern Med. 2004;140:887–896. [PubMed]
18. Chin MH, Cook S, Drum ML, et al. Improving diabetes care in midwest community health centers with the health disparities collaborative. Diabetes Care. 2004;27:2–8. [PubMed]
19. Chin MH, Drum ML, Guillen M, et al. Improving and sustaining diabetes care in community health centers with the health disparities collaboratives. Med Care. 2007;45:1135–1143. [PubMed]
20. Langley G, Nolan K, Nolan TW, et al. The Improvement Guide: A Practical Approach to Enhancing Organizational Performance. San Francisco: Jossey-Bass; 1996.
21. Chin MH, Kirchhoff AC, Schlotthauer AE, et al. Sustaining quality improvement in community health centers: perceptions of leaders and staff. J Ambul Care Manage. In press. [PMC free article] [PubMed]
22. Grossman E, Keegan T, Lessler AL, et al. Inside the health disparities collaboratives: a detailed exploration of quality improvement at community health centers. Med Care. 2008;46:489–496. [PubMed]
23. Bonomi AE, Wagner EH, Glasgow RE, VonKorff M. Assessment of chronic illness care (ACIC): a practical tool to measure quality improvement. Health Serv Res. 2002;37:791–820. [PMC free article] [PubMed]
24. Landon BE, Hicks LS, O'Malley AJ, et al. Improving the management of chronic disease at community health centers. N Engl J Med. 2007;356:921–934. [PubMed]
25. Smith DA, Money EB., Jr Community health centers and their role in reducing healthcare disparities in North Carolina. N C Med J. 2004;65:363–367. [PubMed]
26. Wang A, Wolf M, Carlyle R, Wilkerson J, Porterfield D, Reaves J. The North Carolina experience with the diabetes health disparities collaboratives. Jt Comm J Qual Saf. 2004;30:396–404. [PubMed]
27. Huang ES, Zhang Q, Brown SE, Drum ML, Meltzer DO, Chin MH. The cost-effectiveness of improving diabetes care in U.S. federally qualified community health centers. Health Serv Res. 2007;42(6 Pt 1):2174–2193. [PMC free article] [PubMed]
28. Eastman RC, Javitt JC, Herman WH, et al. Model of complications of NIDDM. I. Model construction and assumptions. Diabetes Care. 1997;20:725–734. [PubMed]
29. Eastman RC, Javitt JC, Herman WH, et al. Model of complications of NIDDM. II. Analysis of the health benefits and cost-effectiveness of treating NIDDM with the goal of normoglycemia. Diabetes Care. 1997;20:735–744. [PubMed]
30. Huang ES, Brown SE, Zhang JX, et al. The cost consequences of improving diabetes care: the community health center experience. Jt Comm J Qual Patient Saf. 2008;34:138–146. [PMC free article] [PubMed]
31. Brown SE, Chin MH, Huang ES. Estimating costs of quality improvement for outpatient healthcare organisations: a practical methodology. Qual Saf Health Care. 2007;16:248–251. [PMC free article] [PubMed]
32. Cheung K, Moiduddin A, Chin MH, et al. The perceived financial impact of quality improvement efforts in community health centers. J Ambul Care Manage. 2008;31:111–119. [PMC free article] [PubMed]
33. Helfrich CD, Savitz LA, Swiger KD, Weiner BJ. Adoption and implementation of mandated diabetes registries by community health centers. Am J Prev Med. 2007;33(1 Suppl):S50–S58. quiz S59–65. [PubMed]
34. Zhang JX, Huang ES, Drum ML, et al. The quality of diabetes care by insurance status at community health centers. American Journal of Public Health. In press. [PMC free article] [PubMed]
35. Graber JE, Huang ES, Drum ML, et al. Predicting changes in staff morale and burnout at community health centers participating in the health disparities collaboratives. Health Serv Res. 2008;43:1403–1423. [PMC free article] [PubMed]
36. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629. [PubMed]
37. Taplan SH, Haggstrom D, Jacobs T, et al. Implementing colorectal cancer screening in community health centers: addressing cancer health disparities through a regional cancer collaborative. Med Care. 2008;46:S74–S83. [PubMed]
38. Chin MH. Improving care and outcomes of uninsured persons with chronic disease… now. Ann Intern Med. 2008;149:206–208. [PMC free article] [PubMed]