Search tips
Search criteria 


Logo of diacareAmerican Diabetes AssociationSubscribeSearchDiabetes Care Journal
Diabetes Care. 2011 July; 34(7): 1651–1659.
Published online 2011 June 17. doi:  10.2337/dc11-0735
PMCID: PMC3120200

Diabetes Performance Measures: Current Status and Future Directions


Just as treatment guidelines for diabetes care were at the forefront of medical guideline development (1), diabetes has been a prominent focus of performance measurement and quality improvement initiatives for well over a decade. However, the constraints of pre-electronic health records (EHRs) data systems have consistently limited the clinical scope and sophistication of current diabetes quality measures. The U.S. health care system is nearing a tipping point in the use of more sophisticated EHR-based information systems, and widespread use of these systems will usher in a new era for diabetes quality measurement. New information system capabilities will enable improvements to existing measures and enable development of much more sophisticated measures that can accommodate personalization of clinical goals, patient preferences, and patient-reported data, thus moving both guidelines and measures toward personalization based on sophisticated assessment of the risks and benefits of certain clinical actions for a given patient at a given clinical encounter.

To facilitate discussion of the future of performance measurement in diabetes in this era of rapid transition to EHRs, the American Diabetes Association (ADA) convened a consensus development conference in December 2010. Participating experts identified and discussed the following questions:

  • 1.
    What is the evidence that measuring quality, benchmarking, and providing feedback or incentives improve diabetes care?
  • 2.
    What are the limitations, burdens, and consequences (intended or unintended) of diabetes quality measures as currently structured?
  • 3.
    What should be the role of shared decision making, patient preferences, and patient-reported data in quality measures?
  • 4.
    What is the future of quality measurement in diabetes?
  • 5.
    How can quality monitoring be integrated into population surveillance efforts?

This report summarizes the consensus meeting, and represents the expert opinion of its authors and not the official position of the ADA or any other participating organization.

1. What is the evidence that measuring quality, benchmarking, and providing feedback or incentives improve diabetes care?

The first national effort to develop a set of performance measures for diabetes was convened by the Center for Medicare and Medicaid Services (CMS), the National Committee on Quality Assurance (NCQA), and the ADA in 1995 (2). Evidence showed that complications of diabetes can be reduced by controlling hemoglobin A1c (A1C), blood pressure, and LDL cholesterol, but health system performance was suboptimal and highly variable (24). The Diabetes Quality Improvement Program (DQIP) groups specified a set of eight process and outcomes measures that were measured at the individual patient level and aggregated across the patient samples of health plans, physicians, or other units. The DQIP measures were specified for use in the Healthcare Effectiveness Data and Information Set (HEDIS) measure established by NCQA and subsequently widely adopted for performance assessment in commercial, Medicare, and Medicaid health plans. Other health plans and some government agencies, such as the Veterans Health Administration (VHA) and CMS, also adopted the core measure set for use at physician or group practice level. Most of the measures were subsequently endorsed by the National Quality Forum (NQF) and are included in payment programs such as the Physician Quality Reporting System (PQRS) and Meaningful Use. Simple processes, such as periodic testing for A1C, LDL cholesterol, or microalbuminuria, or periodic retinal examination, are relatively easy to identify in either medical records or health care claims. Periodic performance of these processes is appropriate for nearly all patients, with the possible exception of very elderly patients for whom limited life span may preclude the need to screen for complications if they have not already appeared.

During the past decade, the proportion of patients receiving these processes of care has increased across a range of settings (57). For several measures, including A1C, LDL cholesterol, and microalbuminuria testing, proportions are approaching 90%, at least in commercial health maintenance organizations and Veterans Administration populations. However, quality of care improvements with performance measurement does not seem to generalize to aspects of care beyond diabetes. For example, the U.S. Department of Veterans Affairs, which implemented aggressive measurement and quality improvement strategies in the 1990s, has been shown to have better quality of diabetes care than the private sector, but has care comparable to the private sector in clinical domains without performance measures (8,9).

Several studies demonstrate that although it is relatively easy to improve performance for simple processes of care, improvements in important intermediate outcomes such as A1C, blood pressure, and LDL cholesterol do not necessarily follow (10,11). Some care systems with intense disease management programs have improved processes of care but not necessarily intermediate outcomes (12), and correlations between system-level performance for processes of care and for intermediate outcomes such as risk factor control are weak (13). This disconnect between processes and outcomes of care raises the question of whether process measures are valid indicators of quality and point to the need to emphasize intermediate outcomes or to develop alternative process indicators more closely linked to intermediate outcomes of care.

Indicators of intermediate outcomes of care (control of blood pressure, A1C, and LDL cholesterol) were also among the original DQIP measures and have been included in most subsequent diabetes quality measurement sets. Unlike simple process measures, adequate control of these risk factors is related to improved clinical outcomes including cardiovascular events, microvascular complications, and mortality. Assuming that safe, evidence-based treatments are used (14), it is likely that populations with better risk factor control or greater improvements in risk factor control over time are receiving better quality care and are benefiting clinically. In fact, as process measures and measures of risk factor control have improved in the U.S., a concomitant reduction in several major adverse outcomes (kidney failure, amputation) has been documented among the population with diabetes (6,1517).

Are these measureable improvements due, at least in part, to initiatives related to performance measurement, quality assessment, and quality improvement? A number of small randomized controlled trials of performance measurement suggest that measurement and feedback can lead to improvements in some quality indicators. This effect is more evident with process measures than with risk factor control, and observed improvements generally wane over time, especially once feedback ceases (18). Pay for Performance (PfP) initiatives have been implemented in multiple systems, and their effect on quality of care remains controversial. (19,20) “Real world” data suggest that the aggressive U.K. PfP initiative markedly improved control of glucose and cholesterol for several years after its implementation (21). However, once targets were reached, further improvements in quality of diabetes care slowed, and quality of care for conditions with no incentives declined. In the Kaiser Permanente system, financial incentives for diabetic retinopathy screening increased screening rates modestly from 85 to 88%. However, when financial incentives and other care supports were removed, retinopathy screening rates fell by 3% per year to levels below baseline (80%) (22). In a cluster-randomized trial, incentives and feedback linked to EHR-based diabetes clinical decision support modestly improved glucose and blood pressure control, but effects waned after incentives and feedback were removed, even though the clinical decision support continued (23).

In summary, various combinations of performance measurement, feedback to clinicians, quality improvement programs, public reporting, and financial incentives have been associated with sustained improvements in some aspects of diabetes care in many settings. These strategies tend to change specific aspects of care that are being measured and/or paid for, and improvements, which are difficult to maintain, do not necessarily extend to other aspects of care.

2. What are the limitations, burdens, and consequences (intended or unintended) of diabetes quality measures as currently structured?

Dichotomous quality measures based on thresholds for continuous variables.

Research now demonstrates that sole reliance on measuring and reporting simple processes is unlikely to have a substantial impact on patient outcomes, and improvement in process measures can no longer be taken as evidence that quality of care has improved (24). Performance measures based on control of risk factors such as A1C, blood pressure, and LDL cholesterol are appealing because these risk factors predict clinical outcomes, but this approach presents measurement complexities and challenges. Control of these risk factors is influenced not only by provider actions, but also by factors such as patient behaviors, comorbidity, and concerns about medication safety and cost. Current performance measures identify thresholds for A1C, blood pressure, and LDL cholesterol control and usually dichotomized performance measures based on these threshold levels. The use of thresholds is easily understood and simple to report, but selection of an appropriate threshold is difficult, especially in the light of recent clinical trial results and subsequent guideline recommendations to individualize clinical goals for A1C and blood pressure (2529).

Dichotomous threshold-based measures suggest that all patients above the threshold need additional pharmacologic or lifestyle intervention. Setting high threshold goals (such as A1C <9%, or systolic blood pressure [sBP] <160 mmHg) reduces poor quality care and can be appropriately applied to all patients eligible for the measure. However, in most care systems, only a small fraction of patients will fail to meet such a high threshold. As threshold goals are lowered, an increasing proportion of patients require additional treatment to reach the more stringent threshold goals. However, the marginal benefits of increased treatment diminish as patients approach the goal, while the likelihood of treatment-related side effects and costs of treatment typically increase.

If the risks associated with more intensive treatment are substantive, then setting low thresholds for accountability measures (such as A1C <7% or sBP <130 mmHg) may actually do more harm than good for many patients—clearly an undesirable situation (30). Lack of benefit or unintended harm is possible, especially for those above the accountability threshold but already on high dose therapy, those with terminal illness or limited life expectancy, and those susceptible to serious side effects of aggressive therapy such as hypoglycemia or hypotension (3134). In the past, some guidelines have adopted blood pressure or A1C goals more stringent than those validated in clinical trials (25,35). While low blood pressure or A1C levels may benefit some subsets of patients, incorporating low threshold goals in accountability measures is problematic (36). Finally, aiming for stringent targets in every patient ignores patient preferences (37).

Since 2008, many diabetes clinical guidelines recommend individualization of A1C and blood pressure goals. In response, some quality measures now include a complex set of exemptions and exclusions that may remain challenging to implement even when EHRs data are available. Alternative approaches discussed below are to increase the accountability threshold to a value that is appropriated for nearly all patients, to move from goal-based to risk-based measures, or to implement new “clinical action” measures, which are more tightly linked to outcomes than some current measures.

Composite diabetes quality measures.

Composite performance scores have been widely adopted and may improve the reliability of performance measurement and ranking compared with single measures (3840). However, various approaches to combining indicators (averaging by indicator, averaging by patient, or simply measuring all indicators across all patients) may yield somewhat different rankings (41). Composite measures convey less granular clinical information and should be supplemented by providing individual measure data to the physicians. Current composite scores typically weight each indicator equally, so that simple process measures contribute as much to the score as having risk factors in control. This problem can be remedied by weighting the components of a composite measure based on clinical importance.

One variant of the composite score is the “all-or-none” score, which is the proportion of patients for whom all of a set of process indicators are met. It has been suggested that the all-or-nothing approach is the best way to drive toward excellence (42). However, because the score reduces a set of indicators to a single dichotomous score for each patient, all-or-none measures discard a large amount of information. Consequently they lack sensitivity for distinguishing between plans or physicians and tend to have poor reliability (41). All-or-none measures may be more useful for evaluating a multistep process (e.g., diagnosing and treating pneumonia), in which each step is necessary to achieve a successful outcome. They have less to offer in assessing or improving the parallel and often independent processes of diabetes care, especially since not all care components are of equal importance to individual patients.

3. What should be the role of shared decision making, patient preferences, and patient-reported data in quality measures?

Patient self-management is an essential aspect of diabetes care and requires health care systems and providers to actively support their patients’ “performance.” Many experts have suggested that clinical performance measures evaluate how diabetes patients are doing—on both processes (such as self care and behaviors) and outcomes (such as health status) (43). Patient-reported information may be useful to identify patient preferences and goals, decision making, action plans and follow-up, behavioral risk factors, psychosocial functioning and distress, self-care behaviors, and to assess specific aspects of care such as aspirin use, influenza vaccinations, foot examinations, and comorbid conditions such as depression (34,4447).

Patient-reported information could be derived in part from electronic medical records, and in part through surveys or other evolving technologies. Patient-reported information could also be used to assess other aspects of care quality, including care experiences, care transitions, continuity of care (47), patient-provider interactions, as well as some adverse events, such as hypoglycemic episodes (48). Patient decisions not to follow provider advice can be documented and may provide an opportunity for the provider to understand the reasons and respond in a mutually satisfactory way. Health literacy, numeracy, out-of-pocket costs, and social environment, which may mediate health disparities by influencing patient preferences and adherence to treatment, may serve as case-mix adjusters for quality measures.

The British National Health Service (NHS) has pioneered the use of patient-reported outcomes of care by having all patients undergoing certain elective surgeries fill out pre- and postsurgery reports of their health status, functional status, and other information. In the U.S., the Health Outcomes Survey (HOS) and Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey include a number of performance measurements, functional assessments, and other patient-reported measures (PRMs). Collecting PRMs via efficient and user-friendly modalities (e.g., kiosks, cell phones, Internet, automated phone systems) may facilitate use of a standardized set of behavioral and psychosocial PRMs with high clinical value that could be incorporated in the EHR and then be extracted as performance measures (49).

Methodological considerations in selecting PRMs that merit further research include reliability, validity, sensitivity to change, feasibility, importance to clinicians, importance to public health, actionability, and user friendliness (50). The National Institutes of Health (NIH)-funded Patient Reported Outcomes Measurement Information System (PROMIS) initiative is an important example of the potential of PRMs. PROMIS uses analytic techniques such as item response theory to create and validate very brief measures that assess a range of symptoms and quality of life–related issues (51). In summary, changing technology, including broader use of EHRs, will likely usher in a new era in patient-reported performance measures, which will broaden the scope and usefulness of existing performance measure sets (5254).

4. What is the future of quality measurement in diabetes?

The advent of EHR technology will open new options for diabetes quality measurement, as already noted. Several of the new opportunities that deserve further attention are highlighted below, and Table 1 briefly outlines some of the advantages and challenges of selected innovations.

Table 1
Summary of selected opportunities for new or improved diabetes performance measures based on increasingly sophisticated electronic data systems and including patient-reported measures

Clinical action measures.

One possible refinement of dichotomous intermediate outcome measures is the clinical action measure. Clinical action measures are of two types: 1) those that combine a threshold measure for an intermediate outcome with a process of care for those above the threshold, and 2) those that suggest a high-benefit evidence-based clinical action in certain clinical circumstances (55,56). Examples of these measures include prescribing moderate dose statins to patients with diabetes over age 40 years, or prescribing an ACE-inhibitor or angiotensin receptor blocker to patients with albuminuria. Clinical action measures could take exclusions into account by removing patients for whom care may be contraindicated or not beneficial from the denominator (e.g., women of childbearing potential, patients with end-stage renal disease). By focusing on the clinical treatment (e.g., statins) rather than only a threshold intermediate outcome value (e.g., LDL cholesterol <100 mg/dL), these measures are less likely to motivate treatment with nonevidence-based treatments (e.g., ezetimibe) in order to reach a clinical threshold (14,57).

For example, clinical action measures may credit the clinician for appropriate care if 1) the threshold is met (e.g., blood pressure below the measure threshold), or 2) the provider takes an appropriate clinical action (e.g., starting or increasing the dose of an appropriate medication) for a patient above threshold, or 3) the risk factor returns to below the threshold within a given time frame without changes in therapy, or 4) the patient has a contraindication to further therapy intensification (e.g., a very low diastolic blood pressure) or is already on high-dose therapy despite an elevated risk factor level.

Clinical action measures have several strengths. They direct attention to patients most likely to benefit from added therapy, and they point directly to the appropriate treatment rather than just the risk factor level. Thus, they help providers do the “right” thing for the right patient. They also give credit when the appropriate clinical action is to not intensify medications, thereby diminishing the potential for unintended consequences related to overtreatment. Finally, they take known variation in measurement into account by giving credit for values that return to target within a specified time period. Because many clinical action measures require access to detailed clinical data, they depend on evolved electronic data systems (56,58,59).

Weighted quality measures.

Some have expressed concern that threshold-based performance measures could focus clinician attention inordinately on patients currently just above the target and away from those who are further from the target and may benefit more (60). Others are concerned that performance thresholds could also increase health disparities because vulnerable patients are often further from control, although one recent study allays this concern (61). In general, current use of threshold measures may discard important information compared with considering the full distribution of values in physician or health plan populations (62).

If an A1C threshold measure for “good care” is set at 7%, a provider could get full credit for moving a patient from 7.1 to 6.9%, but no credit for improving control in another patient from 8.8 to 7.1%, despite the fact that the latter patient's risk has been reduced much more than the former's (63,64). These concerns and others may be somewhat allayed by giving “partial credit” to clinicians or systems for treatment efforts, even when a patient does not reach the target.

Credit is assigned based on predicted clinical benefit gained by moving patients from prior poor control to a more favorable clinical level. This requires specifying a threshold for poor control (e.g., A1C >8%) above which no credit is given, and a threshold for good control (e.g., A1C <7%) at which point full credit is given. Some experts have suggested that benefits be quantified using quality-adjusted life-years saved (65). Other methods to assign partial credit have also been proposed and deserve careful consideration (66).

Personalized risk-based quality measures.

The use of risk-based prediction models can extend the concept of risk and benefit in performance measurement by considering each patient's calculated risk for an adverse outcome and defining the benefit a patient is likely to obtain from a specific clinical action based on the UK Propective Diabetes Study (UKPDS), QRISK, Framingham, or other risk engines (6769). Depending on known evidence, the selected risk engine integrates age, comorbidity, other risk factors (e.g., smoking), and current treatments to predict the patient's risk for a poor outcome. This approach facilitates a patient-specific performance measurement across the continuum of benefit and risk. Such performance measures might assess 1) whether patients above a certain threshold of high risk (where benefit of therapy would clearly outweigh potential harms of treatment) received the therapy in question; 2) whether those below a certain threshold of low risk (where benefit is lower than potential harms) did not receive the therapy; and 3) whether those in between the two thresholds had a documented discussion of risk and benefit of the therapy and engaged in shared or informed decision making (70). Before this approach is ready for prime time, more work needs to be done to assure that the risk and benefit estimates provided by the risk engines are accurate and based on evidence from intervention trials whenever possible. At present, some risk engines overestimate benefits by relying too heavily on epidemiological rather than clinical trial evidence.

Measures of overtreatment.

While the suggestions outlined above are likely to maximize appropriate care and minimize unintended consequences of performance measures (60,7176), an additional fruitful area lies in constructing and testing direct measures of potential overtreatment, inappropriate treatment, or harm (74,77). Creating and reporting such measures could serve to counter any pressure to intensify therapy inappropriately in the name of performance improvement. Such measures might identify suboptimal practices such as further intensification of therapy for patients with low diastolic blood pressure and moderate sBP levels (e.g., <140/65 mmHg); use of glyburide among the elderly or those with impaired renal function; falls or episodes of hypoglycemia severe enough to require emergency care or hospitalization in patients on complex glucose-lowering regimens or insulin; or on high doses of blood pressure medications. Patient-reported data regarding symptoms and treatment burden may enhance our future ability to quantify overtreatment or potential harm.

Quality measures for primary prevention of diabetes.

Currently, diabetes quality measures focus on the treatment of those with diagnosed diabetes. The Diabetes Prevention Program (DPP) demonstrated that either intensive lifestyle change leading to 7% weight loss or use of metformin substantially reduced the incidence of type 2 diabetes in a diverse U.S. population with impaired glucose tolerance (78). Both interventions were cost-effective from the perspective of the health system and society as delivered in the DPP (79), and similar weight loss and exercise outcomes have been achieved when the DPP lifestyle intervention is implemented in a much less costly form in community settings (80). New performance measures could be designed to assess 1) appropriate implementation of diagnostic tests to identify those at high risk of diabetes; 2) appropriate referral to lifestyle programs and/or metformin therapy; and 3) relative quality and efficacy of lifestyle programs designed to achieve weight loss. Such measures would not only foster the implementation of proven interventions of tremendous public health significance, but would be important models of measuring community-based public health initiatives designed to address weight management, healthy eating, and physical activity.

Incorporating measures of adherence into performance measures.

An estimated 20–50% of patients with chronic disease do not take their medications as prescribed (81). Poor medication adherence contributes to poor diabetes control, disability, unnecessary hospitalization, and death (82,83). A meta-analysis of 63 studies with over 19,000 participants reported that higher adherence rate decreases the risk for poor treatment outcome by 26% (84). Measures of patient adherence are impeded by 1) lack of agreement on the best methods to measure medication adherence, 2) paucity of integrated data systems that include both prescription and medication dispensing data, and 3) a sparse body of research on interventions to improve medication adherence (85). As information systems evolve and more effective interventions to improve adherence are identified, quality measures related to medication adherence may catalyze new efforts to improve adherence and patient health outcomes.

Incorporating costs into quality measurement.

Patients with diabetes generate medical care costs that are on average two to three times higher than age- and gender-matched patients without diabetes. Cardiovascular complications remain the principal driver of high diabetes care costs; medication costs are also rising more rapidly than overall inflation (8688). Diabetes and other medical expenditures vary greatly across care systems in relation to the benefits achieved, and a substantial portion of expenditures does not appear to provide any net benefit to the patient (89). These services are usually labeled as wasteful, inappropriate, or inefficient.

NCQA has recently developed diabetes relative resource use measures at the plan level and is testing them at the group practice level. These measures are designed to look at resource use in diabetes care and, when combined with quality measures, can provide an overview of efficiency (high resource use–low quality vs. low resource use–high quality). Barriers to expanding such measures include the need for large sample sizes, the difficulty of accurately quantifying expenditures, and the need for accurate risk adjustment. A measure of total expenditures per patient is now available within the Medicare program and is based on administrative claims data. The information can be further categorized as hospital inpatient, outpatient, or pharmacy-related (medications). Expenditures can be compared with a set of outcome-related quality measures as an initial step toward trying to define the value (benefit per unit of expenditure) of care in diabetes.

Over the short term, we need more analysis and understanding of which elements of resource use have positive or negative correlations with measures of quality and outcomes of care. Currently most diabetes performance measures only assess whether tests or examinations are being underused. Development of measures that look at overuse of tests, examinations, procedures, or technology may be useful in evaluating and maximizing efficiency of care. Measures that encourage the use of generic medications, when available, may also conserve resources. Care provided by various subspecialties for patients with advanced complications of diabetes may be variably efficient or inefficient. With further refinement of both quality and cost-related measures, diabetes could become the poster child for efficient and effective health care.

Using performance measurement to reduce, not worsen, health disparities.

As with many chronic diseases, diabetes is marked by disparities in both treatment and outcomes. Such disparities are primarily based on socioeconomic status (SES), race, and ethnicity, but also exist by sex and age. Because patients of lower SES often have more barriers to self care and worse control of risk factors, clinicians who provide care to many such patients may have lower quality-of-care scores publicly reported, or lose income or incentives related to unadjusted measures of clinical performance. Currently, the HEDIS data are grouped by Medicare, Medicaid, and commercial insurance. In the future, quality measures could be adjusted in more sophisticated ways to account for variation in patient SES, health literacy, or other factors related to disparities in care. Possible methods include geo-coding, case-mix adjustment, or use of other metrics for SES. On the other hand, “overadjusting” for race/ethnicity and SES could mask real differences in quality of care provided to different groups; such disparities can only be corrected if they are identified.

5. How can quality monitoring be integrated into population surveillance efforts?

Population surveillance of quality of diabetes care provides a crucial complement to health system monitoring (e.g., HEDIS) by assessing care in the full population, including persons with limited or no health insurance. Appropriately selected performance measures may serve well as measures for population-based diabetes care surveillance and enable more detailed examination of geographic and other disparities in patterns of care. In addition, surveillance systems are important to monitor risks, adverse events, and resource use in the population, and to guide the design and implementation of strategies to improve quality and outcomes of care.

Existing population-level monitoring of diabetes care include the National Health Interview Survey (NHIS); the Behavior Risk Factor Surveillance System (BRFSS), which assesses care processes; and the National Health and Nutrition Examination Surveys (NHANES), which assess both processes of care and risk factor control. All three of these systems include extensive PRMs and provide a useful foundation for further development of such PRMs for diabetes care. Data from these sources also provide estimates of diabetes care quality that inform national quality and disparity reports and development of the Healthy People Objectives for 2010 and 2020. Other systems such as the National Ambulatory Medical Care Survey (NAMCS), and the National Hospital Discharge Survey (NHDS) provide additional population data on costs and outcomes of care. With the exception of the Dartmouth Health Atlas and selected metropolitan area surveys and laboratory-based registries in New York and Vermont, there is limited population-based data in the U.S. today within smaller geographic areas (90,91).

Expansion of existing surveillance systems to include measures of risk factor control, patient characteristics and behaviors, risk preferences, indicators of primary prevention, and other measures could serve several useful purposes such as 1) permit more accurate assessment of care quality for patients at different levels of risk, insurance, and socioeconomic status and to assess geographic variations in care; 2) promote monitoring of patient safety, drug safety, costs, adverse outcomes and unintended consequences (e.g., hypoglycemia and polypharmacy), and medication adherence; 3) prove useful within networks of Patient Centered Medical Homes or Accountable Care Organizations; and 4) facilitate systematic assessment of prevention efforts. Some of these innovations could be based on the modification of current population-based surveys. Others, such as clinical action measures, weighted quality measures, or risk-based quality measures may require fundamentally new surveillance systems.

Integration with health system–based data could augment the depth of public health systems and extend the representativeness of health system–based data. The growing use of EHRs presents an opportunity to assess variation in intensity and quality of diabetes care. Prototypes for the use of EHRs data for national surveillance include surveillance systems for vaccine safety, selected infectious diseases, and bioterrorism threats. Diabetes care surveillance might be carefully expanded in phases, perhaps with a “sentinel” system or a distributed data system as initial steps (92). An essential step is to develop and validate a common set of diabetes quality measures. Key data elements might include laboratory results, pharmaceutical use, utilization of services, and selected patient characteristics and experiences of care, including elements collected by patient self-report.


The growing availability of sophisticated electronic health data systems will revolutionize diabetes performance measurement. The use of a rich set of clinical, patient-reported, and claims data will strengthen existing measures and enable development and efficient use of new measures that much more closely mirror the clinical care of patients, accommodate the need to customize care based on individual patient risk and benefit profiles, and incorporate assessment of resource use and patient experience of care. For example, development of measures that encourage clinicians to take into account individual patients’ risk status and the relative benefits of various treatments would support clinicians’ efforts to make the right decision for a particular patient while minimizing risk of overtreatment or other unintended consequences. Wider recognition of the importance of patient preferences is also important, especially when the clinical benefit associated with clinical actions is small or uncertain. Several of the newer approaches to quality measurement outlined here could be implemented in the near term, while others need some additional intermediate-term development prior to wide-scale dissemination.


The consensus development conference was supported by an unrestricted grant from sanofi-aventis. The company had no input into the content of the report. No other potential conflicts of interest relevant to this article were reported.

The contributions to this manuscript by Noni Bodkin (Centers for Medicare and Medicaid Services, Baltimore, Maryland) were carried out in her personal capacity.


The views and opinions expressed in this article are those of the authors and do not reflect those of the American Diabetes Association, the U.S. Centers for Disease Control and Prevention, the U.S. Department of Veterans Affairs, the Centers for Medicare and Medicaid Services, the U.S. Department of Health and Human Services, the U.S. government, or other organizations with which particular authors are affiliated.


1. American Diabetes Association Standards of medical care for patients with diabetes mellitus (Position Statement). Diabetes Care 1989;12:365–368 [PubMed]
2. Fleming BB, Greenfield S, Engelgau MM, Pogach LM, Clauser SB, Parrott MA. The Diabetes Quality Improvement Project: moving science into health policy to gain an edge on the diabetes epidemic. Diabetes Care 2001;24:1815–1820 [PubMed]
3. Bell RA, Camacho F, Goonan K, et al. Quality of diabetes care among low-income patients in North Carolina. Am J Prev Med 2001;21:124–131 [PubMed]
4. Quenan L, Remington P, Gohre F, Zapp P. The Wisconsin Collaborative Diabetes Quality Improvement Project. WMJ 2000;99:48–52 [PubMed]
5. Kerr EA, Fleming B. Making performance indicators work: experiences of US Veterans Health Administration. BMJ 2007;335:971–973 [PMC free article] [PubMed]
6. Saaddine JB, Cadwell B, Gregg EW, et al. Improvements in diabetes processes of care and intermediate outcomes: United States, 1988-2002. Ann Intern Med 2006;144:465–474 [PubMed]
7. Saaddine JB, Engelgau MM, Beckles GL, Gregg EW, Thompson TJ, Narayan KMV. A diabetes report card for the United States: quality of care in the 1990s. Ann Intern Med 2002;136:565–574 [PubMed]
8. Kerr EA, Gerzoff RB, Krein SL, et al. Diabetes care quality in the Veterans Affairs Health Care System and commercial managed care: the TRIAD study. Ann Intern Med 2004;141:272–281 [PubMed]
9. Asch SM, McGlynn EA, Hogan MM, et al. Comparison of quality of care for patients in the Veterans Health Administration and patients in a national sample. Ann Intern Med 2004;141:938–945 [PubMed]
10. Landon BE, Hicks LS, O'Malley AJ, et al. Improving the management of chronic disease at community health centers. N Engl J Med 2007;356:921–934 [PubMed]
11. Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD. Does telling people what they have been doing change what they do? A systematic review of the effects of audit and feedback. Qual Saf Health Care 2006;15:433–436 [PMC free article] [PubMed]
12. Mangione CM, Gerzoff RB, Williamson DF, et al. ; TRIAD Study Group The association between quality of care and the intensity of diabetes disease management programs. Ann Intern Med 2006;145:107–116 [PubMed]
13. Ackermann RT, Thompson TJ, Selby JV, et al. ; Translating Research into Action for Diabetes (TRIAD) Study Group Is the number of documented diabetes process-of-care indicators associated with cardiometabolic risk factor levels, patient satisfaction, or self-rated quality of diabetes care? The Translating Research into Action for Diabetes (TRIAD) study. Diabetes Care 2006;29:2108–2113 [PubMed]
14. Krumholz HM, Lee TH. Redefining quality—implications of recent clinical trials. N Engl J Med 2008;358:2537–2539 [PubMed]
15. Beaulieu N, Cutler D, Ho K, et al. The business case for diabetes disease management for managed care organizations. Forum Health Econ Policy 2007;9:Article 1
16. Centers for Disease Control and Prevention Centers for Disease Control and Prevention: National Diabetes Surveillance System [Internet], 2008. Available from Accessed on 4 March 2011
17. Burrows NR, Li Y, Geiss LS. Incidence of treatment for end-stage renal disease among individuals with diabetes in the U.S. continues to decline. Diabetes Care 2010;33:73–77 [PMC free article] [PubMed]
18. Tierney WM, Overhage JM, Murray MD, et al. Can computer-generated evidence-based care suggestions enhance evidence-based management of asthma and chronic obstructive pulmonary disease? A randomized, controlled trial. Health Serv Res 2005;40:477–497 [PMC free article] [PubMed]
19. Ryan AM, Blustein J. The effect of the MassHealth hospital pay-for-performance program on quality. Health Serv Res 2011;46: 712,– 728 [PMC free article] [PubMed]
20. Serumaga B, Ross-Degnan D, Avery AJ, et al. Effect of pay for performance on the management and outcomes of hypertension in the United Kingdom: interrupted time series study. BMJ 2011;342:d108. [PubMed]
21. Oluwatowoju I, Abu E, Wild SH, Byrne CD. Improvements in glycaemic control and cholesterol concentrations associated with the Quality and Outcomes Framework: a regional 2-year audit of diabetes care in the UK. Diabet Med 2010;27:354–359 [PubMed]
22. Lester H, Schmittdiel J, Selby J, et al. The impact of removing financial incentives from clinical quality indicators: longitudinal analysis of four Kaiser Permanente indicators. BMJ 2010;340:c1898. [PubMed]
23. O'Connor PJ, Sperl-Hillen JM, Rush WA, et al. Impact of electronic health record clinical decision support on diabetes care: a randomized trial. Ann Fam Med 2011;9:12–21 [PubMed]
24. Selby JV, Swain BE, Gerzoff RB, et al. ; TRIAD Study Group Understanding the gap between good processes of diabetes care and poor intermediate outcomes: Translating Research into Action for Diabetes (TRIAD). Med Care 2007;45:1144–1153 [PubMed]
25. Gerstein HC, Riddle MC, Kendall DM, et al. ; ACCORD Study Group Glycemia treatment strategies in the Action to Control Cardiovascular Risk in Diabetes (ACCORD) trial. Am J Cardiol 2007;99:34i–43i [PubMed]
26. Cushman WC, Evans GW, Byington RP, et al. ; ACCORD Study Group Effects of intensive blood-pressure control in type 2 diabetes mellitus. N Engl J Med 2010;362:1575–1585 [PMC free article] [PubMed]
27. Patel A, MacMahon S, Chalmers J, et al. ; ADVANCE Collaborative Group Intensive blood glucose control and vascular outcomes in patients with type 2 diabetes. N Engl J Med 2008;358:2560–2572 [PubMed]
28. American Diabetes Association Standards of medical care in diabetes—2011. Diabetes Care 2011;34(Suppl. 1):S11–S61 [PMC free article] [PubMed]
29. Institute for Clinical Systems Improvement Health Care Guidelines: Diabetes Mellitus in Adults, Type 2; Diagnosis and Management of (Guideline) [Internet], 2010. Available from Accessed 17 November 2010
30. Zoungas S, Patel A, Chalmers J, et al. ; ADVANCE Collaborative Group Severe hypoglycemia and risks of vascular events and death. N Engl J Med 2010;363:1410–1418 [PubMed]
31. Choe HM, Bernstein SJ, Standiford CJ, Hayward RA. New diabetes HEDIS blood pressure quality measure: potential for overtreatment. Am J Manag Care 2010;16:19–24 [PubMed]
32. Hayward RA. Performance measurement in search of a path. N Engl J Med 2007;356:951–953 [PubMed]
33. Kerr E. Assessing Quality of Care for Diabetes: Conference Final Report [Internet], 2008. Rockville, MD, U.S. Department of Health and Human Services, Agency for Healthcare Research and Quality. Available from Accessed on 15 January 2011
34. Greenfield S, Billimek J, Pellegrini F, et al. Comorbidity affects the relationship between glycemic control and cardiovascular outcomes in diabetes: a cohort study. Ann Intern Med 2009;151:854–860 [PubMed]
35. Cushman WC, Grimm RH, Jr, Cutler JA, et al. ; ACCORD Study Group Rationale and design for the blood pressure intervention of the Action to Control Cardiovascular Risk in Diabetes (ACCORD) trial. Am J Cardiol 2007;99:44i–55i [PubMed]
36. Pogach L, Engelgau M, Aron D. Measuring progress toward achieving hemoglobin A1c goals in diabetes care: pass/fail or partial credit. JAMA 2007;297:520–523 [PubMed]
37. Sox HC, Greenfield S. Quality of care—how good is good enough? JAMA 2010;303:2403–2404 [PubMed]
38. Kaplan SH, Griffith JL, Price LL, Pawlson LG, Greenfield S. Improving the reliability of physician performance assessment: identifying the “physician effect” on quality and creating composite measures. Med Care 2009;47:378–387 [PubMed]
39. Scholle SH, Roski J, Adams JL, et al. Benchmarking physician performance: reliability of individual and composite measures. Am J Manag Care 2008;14:833–838 [PMC free article] [PubMed]
40. National Committee for Quality Assurance NCQA Recognition Directory [Internet], 2003. Available from Accessed 15 May 2007
41. Reeves D, Campbell SM, Adams J, Shekelle PG, Kontopantelis E, Roland MO. Combining multiple indicators of clinical quality: an evaluation of different analytic approaches. Med Care 2007;45:489–496 [PubMed]
42. Nolan T, Berwick DM. All-or-none measurement raises the bar on performance. JAMA 2006;295:1168–1170 [PubMed]
43. Sequist TD, Schneider EC, Anastario M, et al. Quality monitoring of physicians: linking patients’ experiences of care to clinical quality and outcomes. J Gen Intern Med 2008;23:1784–1790 [PMC free article] [PubMed]
44. Glasgow RE, Christiansen S, Smith KS, Stevens VJ, Toobert DJ. Development and implementation of an integrated, multi-modality, user-centered interactive dietary change program. Health Educ Res 2009;24:461–471 [PMC free article] [PubMed]
45. National Institutes of Health Patient Reported Outcomes Measurement Information System [Internet],. Available from Accessed on 23 February 2011
46. Glasgow RE, Peeples M, Skovlund SE. Where is the patient in diabetes performance measures? The case for including patient-centered and self-management measures. Diabetes Care 2008;31:1046–1050 [PMC free article] [PubMed]
47. Parchman ML, Burge SK.; Residency Research Network of South Texas Investigators Continuity and quality of care in type 2 diabetes: a Residency Research Network of South Texas study. J Fam Pract 2002;51:619–624 [PubMed]
48. Fisher L, Glasgow RE, Mullan JT, Skaff MM, Polonsky WH. Development of a brief diabetes distress screening instrument. Ann Fam Med 2008;6:246–252 [PubMed]
49. Krist AH, Woolf SH. A vision for patient-centered health information systems. JAMA 2011;305:300–301 [PMC free article] [PubMed]
50. Fisher EB, Fitzgibbon ML, Glasgow RE, et al. Behavior matters. Am J Prev Med 2011;40:e15–e30 [PMC free article] [PubMed]
51. Boers M. Standing on the promises: first wave validation reports of the Patient-Reported Outcome Measurement Information System. J Clin Epidemiol 2010;63:1167–1168 [PubMed]
52. Society of Behavioral Medicine The public health need for patient-reported measures and health behaviors in electronic medical records: a policy statement of the Society of Behavioral Medicine [article online], 2010. Available from Accessed on 23 February 2011 [PMC free article] [PubMed]
53. Fernald DH, Froshaug DB, Dickinson LM, et al. Common measures, better outcomes (COMBO): a field test of brief health behavior measures in primary care. Am J Prev Med 2008;35(Suppl.S414–S422 [PubMed]
54. McCormack LA, Williams-Piehota PA, Bann CM, et al. Development and validavtion of an instrument to measure resources and support for chronic illness self-management: a model using diabetes. Diabetes Educ 2008;34:707–718 [PubMed]
55. Kerr EA, Krein SL, Vijan S, Hofer TP, Hayward RA. Avoiding pitfalls in chronic disease quality measurement: a case for the next generation of technical quality measures. Am J Manag Care 2001;7:1033–1043 [PubMed]
56. Kerr EA, Smith DM, Hogan MH, Hofer TP, Krein SL, Hayward RA. Building a better quality measure: are some patients with poor intermediate outcomes really getting good quality care? Med Care 2003;41:1173–1182 [PubMed]
57. Hayward RA. All-or-nothing treatment targets make bad performance measures. Am J Manag Care 2007;13:126–128 [PubMed]
58. Persell SD, Kho AN, Thompson JA, Baker DW. Improving hypertension quality measurement using electronic health records. Med Care 2009;47:388–394 [PubMed]
59. Rodondi N, Peng T, Karter AJ, et al. Therapy modifications in response to poorly controlled hypertension, dyslipidemia, and diabetes mellitus. Ann Intern Med 2006;144:475–484 [PMC free article] [PubMed]
60. Moscucci M, Eagle KA, Share D, et al. Public reporting and case selection for percutaneous coronary interventions: an analysis from two large multicenter percutaneous coronary intervention databases. J Am Coll Cardiol 2005;45:1759–1765 [PubMed]
61. Bainbridge KE, Cowie CC, Rust KF, Fradkin JE. Mitigating case mix factors by choice of glycemic control performance measure threshold. Diabetes Care 2008;31:1754–1760 [PMC free article] [PubMed]
62. Guthrie B. Measuring the quality of healthcare systems using composites. BMJ 2008;337:a639. [PubMed]
63. CDC Diabetes Cost-effectiveness Group Cost-effectiveness of intensive glycemic control, intensified hypertension control, and serum cholesterol level reduction for type 2 diabetes. JAMA 2002;287:2542–2551 [PubMed]
64. Vijan S, Hofer TP, Hayward RA. Estimated benefits of glycemic control in microvascular complications in type 2 diabetes. Ann Intern Med 1997;127:788–795 [PubMed]
65. Pogach LM, Rajan M, Aron DC. Comparison of weighted performance measurement and dichotomous thresholds for glycemic control in the Veterans Health Administration. Diabetes Care 2006;29:241–246 [PubMed]
66. Vogt TM, Feldstein AC, Aickin M, Hu WR, Uchida AR. Electronic medical records and prevention quality: the prevention index. Am J Prev Med 2007;33:291–296 [PubMed]
67. D'Agostino RBVR, Sr, Vasan RS, Pencina MJ, et al. General cardiovascular risk profile for use in primary care: the Framingham Heart Study. Circulation 2008;117:743–753 [PubMed]
68. Eddy DM, Schlessinger L. Archimedes: a trial-validated model of diabetes. Diabetes Care 2003;26:3093–3101 [PubMed]
69. UK Prospective Diabetes Study Group UKPDS Risk Engine [Internet], 2004. Available from Accessed on 9 March 2011
70. McNutt RA. Shared medical decision making: problems, process, progress. JAMA 2004;292:2516–2518 [PubMed]
71. Boyd CM, Darer J, Boult C, Fried LP, Boult L, Wu AW. Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases: implications for pay for performance. JAMA 2005;294:716–724 [PubMed]
72. Burack JH, Impellizzeri P, Homel P, Cunningham JN., Jr Public reporting of surgical mortality: a survey of New York state cardiothoracic surgeons. Ann Thorac Surg 1999;68:1195–1200; discussion 1201–1192 [PubMed]
73. Casalino LP. The unintended consequences of measuring quality on the quality of medical care. N Engl J Med 1999;341:1147–1150 [PubMed]
74. Snyder L, Neubauer RL.; American College of Physicians Ethics, Professionalism and Human Rights Committee Pay-for-performance principles that promote patient-centered care: an ethics manifesto. Ann Intern Med 2007;147:792–794 [PubMed]
75. Wachter RM, Flanders SA, Fee C, Pronovost PJ. Public reporting of antibiotic timing in patients with pneumonia: lessons from a flawed performance measure. Ann Intern Med 2008;149:29–32 [PubMed]
76. Werner RM, Asch DA, Polsky D. Racial profiling: the unintended consequences of coronary artery bypass graft report cards. Circulation 2005;111:1257–1263 [PubMed]
77. Pogach L, Aron D. Balancing hypoglycemia and glycemic control: a public health approach for insulin safety. JAMA 2010;303:2076–2077 [PubMed]
78. Knowler WC, Hamman RF, Edelstein SL, et al. ; Diabetes Prevention Program Research Group Prevention of type 2 diabetes with troglitazone in the Diabetes Prevention Program. Diabetes 2005;54:1150–1156 [PMC free article] [PubMed]
79. Herman WH, Hoerger TJ, Brandle M, et al. ; Diabetes Prevention Program Research Group The cost-effectiveness of lifestyle modification or metformin in preventing type 2 diabetes in adults with impaired glucose tolerance. Ann Intern Med 2005;142:323–332 [PMC free article] [PubMed]
80. Ackermann RT, Marrero DG. Adapting the Diabetes Prevention Program lifestyle intervention for delivery in the community: the YMCA model. Diabetes Educ 2007;33:69, 74–65, 77–68 [PubMed]
81. Cramer JA, Benedict A, Muszbek N, Keskinaslan A, Khan ZM. The significance of compliance and persistence in the treatment of diabetes, hypertension and dyslipidaemia: a review. Int J Clin Pract 2008;62:76–87 [PMC free article] [PubMed]
82. Lau DT, Nau DP. Oral antihyperglycemic medication nonadherence and subsequent hospitalization among individuals with type 2 diabetes. Diabetes Care 2004;27:2149–2153 [PubMed]
83. Ho PM, Rumsfeld JS, Masoudi FA, et al. Effect of medication nonadherence on hospitalization and mortality among patients with diabetes mellitus. Arch Intern Med 2006;166:1836–1841 [PubMed]
84. DiMatteo MR, Giordani PJ, Lepper HS, Croghan TW. Patient adherence and medical treatment outcomes: a meta-analysis. Med Care 2002;40:794–811 [PubMed]
85. Parchman ML, Pugh JA, Romero RL, Bowers KW. Competing demands or clinical inertia: the case of elevated glycosylated hemoglobin. Ann Fam Med 2007;5:196–201 [PubMed]
86. Selby JV, Ray GT, Zhang D, Colby CJ. Excess costs of medical care for patients with diabetes in a managed care population. Diabetes Care 1997;20:1396–1402 [PubMed]
87. Gilmer TP, O'Connor PJ, Manning WG, Rush WA. The cost to health plans of poor glycemic control. Diabetes Care 1997;20:1847–1853 [PubMed]
88. Gilmer TP, O'Connor PJ, Rush WA, et al. Predictors of health care costs in adults with diabetes. Diabetes Care 2005;28:59–64 [PubMed]
89. Orszag PR, Ellis P. The challenge of rising health care costs—a view from the Congressional Budget Office. N Engl J Med 2007;357:1793–1795 [PubMed]
90. Chamany S, Silver LD, Bassett MT, et al. Tracking diabetes: New York City's A1C registry. Milbank Q 2009;87:547–570 [PubMed]
91. Maclean CD, Gagnon M, Callas P, Littenberg B. The Vermont diabetes information system: a cluster randomized trial of a population based decision support system. J Gen Intern Med 2009;24:1303–1310 [PMC free article] [PubMed]
92. Brown JS, Holmes JH, Shah K, Hall K, Lazarus R, Platt R. Distributed health data networks: a practical and preferred approach to multi-institutional evaluations of comparative effectiveness, safety, and quality of care. Med Care 2010;48(Suppl.):S45–S51 [PubMed]

Articles from Diabetes Care are provided here courtesy of American Diabetes Association