To evaluate the impact of a locally adapted evidence-based quality improvement (EBQI) approach to implementation of smoking cessation guidelines into routine practice.
Data Sources/Study Setting
We used patient questionnaires, practice surveys, and administrative data in Veterans Health Administration (VA) primary care practices across five southwestern states.
In a group-randomized trial of 18 VA facilities, matched on size and academic affiliation, we evaluated intervention practices’ abilities to implement evidence-based smoking cessation care following structured evidence review, local priority setting, quality improvement plan development, practice facilitation, expert feedback, and monitoring. Control practices received mailed guidelines and VA audit-feedback reports as usual care.
To represent the population of primary care-based smokers, we randomly sampled and screened 36,445 patients to identify and enroll eligible smokers at baseline (n = 1,941) and follow-up at 12 months (n = 1,080). We used computer-assisted telephone interviewing to collect smoking behavior, nicotine dependence, readiness to change, health status, and patient sociodemographics. We used practice surveys to measure structure and process changes, and administrative data to assess population utilization patterns.
Intervention practices adopted multifaceted EBQI plans, but had difficulty implementing them, ultimately focusing on smoking cessation clinic referral strategies. While attendance rates increased (p<.0001), we found no intervention effect on smoking cessation.
EBQI stimulated practices to increase smoking cessation clinic referrals and try other less evidence-based interventions that did not translate into improved quit rates at a population level.
Smoking cessation; quality of health care; veterans
We documented organizational costs for depression care quality improvement (QI) to develop an evidence-based, Veterans Health Administration (VA) adapted depression care model for primary care practices that performed well for patients, was sustained over time, and could be spread nationally in VA.
Data Sources and Study Setting
Project records and surveys from three multistate VA administrative regions and seven of their primary care practices.
We documented project time commitments and expenses for 86 clinical QI and 42 technical expert support team participants for 4 years from initial contact through care model design, Plan–Do–Study–Act cycles, and achievement of stable workloads in which models functioned as routine care. We assessed time, salary costs, and costs for conference calls, meetings, e-mails, and other activities.
Over an average of 27 months, all clinics began referring patients to care managers. Clinical participants spent 1,086 hours at a cost of $84,438. Technical experts spent 2,147 hours costing $197,787. Eighty-five percent of costs derived from initial regional engagement activities and care model design.
Organizational costs of the QI process for depression care in a large health care system were significant, and should be accounted for when planning for implementation of evidence-based depression care.
Quality improvement; depression; primary care
Depression is a major cause of morbidity and cost in primary care patient populations. Successful depression improvement models, however, are complex. Based on organizational readiness theory, a practice’s commitment to change and its capability to carry out the change are both important predictors of initiating improvement. We empirically explored the links between relative commitment (i.e., the intention to move forward within the following year) and implementation capability.
The DIAMOND initiative administered organizational surveys to medical and quality improvement leaders from each of 83 primary care practices in Minnesota. Surveys preceded initiation of activities directed at implementation of a collaborative care model for improving depression care. To assess implementation capability, we developed composites of survey items for five types of organizational factors postulated to be collaborative care barriers and facilitators. To assess relative commitment for each practice, we averaged leader ratings on an identical survey question assessing practice priorities. We used multivariable regression analyses to assess the extent to which implementation capability predicted relative commitment. We explored whether relative commitment or implementation capability measures were associated with earlier initiation of DIAMOND improvements.
All five implementation capability measures independently predicted practice leaders’ relative commitment to improving depression care in the following year. These included the following: quality improvement culture and attitudes (p = 0.003), depression culture and attitudes (p <0.001), prior depression quality improvement activities (p <0.001), advanced access and tracking capabilities (p = 0.03), and depression collaborative care features in place (p = 0.03). Higher relative commitment (p = 0.002) and prior depression quality improvement activities appeared to be associated with earlier participation in the DIAMOND initiative.
The study supports the concept of organizational readiness to improve quality of care and the use of practice leader surveys to assess it. Practice leaders’ relative commitment to depression care improvement may be a useful measure of the likelihood that a practice is ready to initiate evidence-based depression care changes. A comprehensive organizational assessment of implementation capability for depression care improvement may identify specific barriers or facilitators to readiness that require targeted attention from implementers.
Electronic supplementary material
The online version of this article (doi:10.1186/s13012-014-0173-1) contains supplementary material, which is available to authorized users.
Depression; Primary care; Quality improvement; Readiness; Measurement
Increasingly, primary care practices include nurse practitioners (NPs) in their staffing mix to contain costs and expand primary care. To achieve these aims in U.S. Department of Veterans Affairs medical centers (VAMCs), national policy endorsed involvement of NPs as primary care (PC) providers.
To evaluate the degree to which VAMCs incorporated NPs into PC practices between 1996 and 1999, and to identify the internal and external practice environment features associated with NP use.
We surveyed 131 PC directors of all VAMCs in 1996 and 1999 to ascertain the staffing and characteristics of the PC practice and parent organization (e.g., academic affiliation, level of physician staffing, use of managed care arrangements), and drew on previously published studies and HRSA State Health Workforce Profiles to characterize each practice's regional health care environment (e.g., geographic region, state NP practice laws, state managed care penetration). Using multivariate linear regression, we evaluate the contribution of these environmental and organizational factors on the number of NPs/10,000 PC patients in 1999, controlling for the rate of NP use in 1996.
From 1996–1999, NP use increased from 75 percent to 90 percent in VA PC practices. The mean number of NPs per practice increased by about 60 percent (2.0 versus 3.2; p<.001), while the rate of NPs/10,000 PC patients trended upward (2.2 versus 2.7; p=.09). Staffing of other primary care clinicians (e.g., physicians and physician assistants per practice) remained stable, while the NP-per-physician rate increased (0.2 versus 0.4; p<.001). After multivariate adjustment, greater reliance on managed-care-oriented provider education programs (p=.02), the presence of NP training programs (p=.05), and more specialty-trained physicians/10,000 PC patients (p=.09) were associated with greater NP involvement in primary care.
Staffing models in VA PC practices have, in fact, changed, with NPs having a greater presence. However, we found substantial practice-based variations in their use, suggesting that more research is needed to better understand how they have been integrated into practice and what impact their involvement has had on the VA's ability to achieve its restructuring goals.
Nurse practitioner; primary care staffing; practice characteristics; environmental characteristics
As the Veterans Health Administration (VHA) reorganizes providers into the patient-centered medical home, questions remain whether this model of care can demonstrate improved patient outcomes and cost savings.
We measured adoption of medical home features by VHA primary care clinics prior to widespread implementation of the patient-centered medical home and examined if they were associated with lower risk and costs of potentially avoidable hospitalizations.
Secondary patient data was linked to clinic administrative and survey data. Patient and clinic factors in the baseline year (FY2009) were used to predict patient outcomes in the follow-up year.
2,853,030 patients from 814 VHA primary care clinics
Patient outcomes were measured by hospitalizations for an ambulatory care sensitive condition (ACSC) and their costs and identified through diagnosis and procedure codes from inpatient records. Clinic adoption of medical home features was obtained from the American College of Physicians Medical Home Builder®.
The overall mean home builder score in the study clinics was 88 (SD = 13) or 69 %. In adjusted analyses an increase of 10 points in the medical home adoption score in a clinic decreased the odds of an ACSC hospitalization for patients by 3 % (P = 0.032). By component, higher access and scheduling (P = 0.004) and care coordination and transitions (P = 0.020) component scores were related to lower risk of an ACSC hospitalization, and higher population management was related to higher risk (P = 0.023). Total medical home features was not related to ACSC hospitalization costs among patients with at least one (P = 0.074).
Greater adoption of medical home features by VHA primary care clinics was found to be significantly associated with lower risk of avoidable hospitalizations with access and scheduling and care coordination/transitions in care as key factors.
medical home; avoidable hospitalizations; access; care coordination
To examine quality improvement (QI) implementation in nursing homes, its association with organizational culture, and its effects on pressure ulcer care.
Data Sources/Study Settings
Primary data were collected from staff at 35 nursing homes maintained by the Department of Veterans Affairs (VA) on measures related to QI implementation and organizational culture. These data were combined with information obtained from abstractions of medical records and analyses of an existing database.
A cross-sectional analysis of the association among the different measures was performed.
Data Collection/Extraction Methods
Completed surveys containing information on QI implementation, organizational culture, employee satisfaction, and perceived adoption of guidelines were obtained from 1,065 nursing home staff. Adherence to best practices related to pressure ulcer prevention was abstracted from medical records. Risk-adjusted rates of pressure ulcer development were calculated from an administrative database.
Nursing homes differed significantly (p<.001) in their extent of QI implementation with scores on this 1 to 5 scale ranging from 2.98 to 4.08. Quality improvement implementation was greater in those nursing homes with an organizational culture that emphasizes innovation and teamwork. Employees of nursing homes with a greater degree of QI implementation were more satisfied with their jobs (a 1-point increase in QI score was associated with a 0.83 increase on the 5-point satisfaction scale, p<.001) and were more likely to report adoption of pressure ulcer clinical guidelines (a 1-point increase in QI score was associated with a 28 percent increase in number of staff reporting adoption, p<.001). No significant association was found, though, between QI implementation and either adherence to guideline recommendations as abstracted from records or the rate of pressure ulcer development.
Quality improvement implementation is most likely to be successful in those VA nursing homes with an underlying culture that promotes innovation. While QI implementation may result in staff who are more satisfied with their jobs and who believe they are providing better care, associations with improved care are uncertain.
Quality improvement; quality of care; nursing homes; decubitus ulcers
To assess the impacts of the characteristics of quality improvement (QI) teams and their environments on team success in designing and implementing highquality, enduring depression care improvement programs in primary care (PC) practices.
Study Setting/Data Sources
Two nonprofit managed care organizations sponsored five QI teams tasked with improving care for depression in large PC practices. Data on characteristics of the teams and their environments is from observer process notes, national expert ratings, administrative data, and interviews.
Comparative formative evaluation of the quality and duration of implementation of the depression improvement programs developed by Central Teams (CTs) emphasizing expert design and Local Teams (LTs) emphasizing participatory local clinician design, and of the effects of additional team and environmental factors oneach type of team. Both types of teams depended upon local clinicians for implementation.
The CT intervention program designs were more evidence-based than those of LTs. Expert team leadership, support from local practice management, and support from local mental health specialists strongly influenced the development of successful team programs. The CTs and LTs were equally successful when these conditions could be met, but CTs were more successful than LTs in less supportive environments.
The LT approach to QI for depression requires high local support and expertise from primary care and mental health clinicians. The CT approach is more likely to succeed than the LT approach when local practice conditions are not optimal.
Quality improvement; depression; primary care; health care provider teams
To explore reasons for clinical inertia in the management of persistent depression symptoms.
We characterized patterns of treatment adjustment in primary care and their relation to the patient’s clinical condition by modeling transition to a given treatment “state” conditional upon the current state of treatment. We assessed associations of patient, clinician, and practice barriers with adjustment decisions.
Survey data on patients in active care for major depression was collected at six-month intervals over a two-year period for the Quality Improvement for Depression (QID) studies.
Patient and clinician characteristics were collected at baseline. Depression severity and treatment were measured at each interval.
Approximately one-third of the observation periods ending with less than a full response resulted in an adjustment recommendation. Clinicians often respond correctly to the combination of severe depression symptoms and less than maximal treatment by changing the treatment. Appropriate adjustment is less common, however, in management of less severely depressed patients who do not improve after starting treatment, particularly if their care already meets minimal treatment intensity guidelines.
Our findings suggest that quality improvement efforts should focus on promoting appropriate adjustments for patients with persistent depression symptoms, particularly those with less severe depression.
Depression; Clinical inertia; Evidence-based medicine; Physician practice patterns
Healthcare systems and their primary care practices are redesigning to achieve goals identified in Patient-Centered Medical Home (PCMH) models such as Veterans Affairs (VA)’s Patient Aligned Care Teams (PACT). Implementation of these models, however, requires major transformation. Evidence-Based Quality Improvement (EBQI) is a multi-level approach for supporting organizational change and innovation spread.
To describe EBQI as an approach for promoting VA’s PACT and to assess initial implementation of planned EBQI elements.
Regional and local interdisciplinary clinical leaders, patient representatives, Quality Council Coordinators, practicing primary care clinicians and staff, and researchers from six demonstration site practices in three local healthcare systems in one VA region.
EBQI promotes bottom-up local innovation and spread within top-down organizational priorities. EBQI innovations are supported by a research-clinical partnership, use continuous quality improvement methods, and are developed in regional demonstration sites.
We developed a logic model for EBQI for PACT (EBQI-PACT) with inputs, outputs, and expected outcomes. We describe implementation of logic model outputs over 18 months, using qualitative data from 84 key stakeholders (104 interviews from two waves) and review of study documents.
Nearly all implementation elements of the EBQI-PACT logic model were fully or partially implemented. Elements not fully achieved included patient engagement in Quality Councils (4/6) and consistent local primary care practice interdisciplinary leadership (4/6). Fourteen of 15 regionally approved innovation projects have been completed, three have undergone initial spread, five are prepared to spread, and two have completed toolkits that have been pretested in two to three sites and are now ready for external spread.
EBQI-PACT has been feasible to implement in three participating healthcare systems in one VA region. Further development of methods for engaging patients in care design and for promoting interdisciplinary leadership is needed.
Electronic supplementary material
The online version of this article (doi:10.1007/s11606-013-2703-y) contains supplementary material, which is available to authorized users.
quality improvement; primary care; patient-centered medical home; logic model; interdisciplinary leadership
Depression management can be challenging for primary care (PC) settings. While several evidence-based models exist for depression care, little is known about the relationships between PC practice characteristics, model characteristics, and the practice’s choices regarding model adoption.
We examined three Veterans Affairs (VA)-endorsed depression care models and tested the relationships between theoretically-anchored measures of organizational readiness and implementation of the models in VA PC clinics.
1) Qualitative assessment of the three VA-endorsed depression care models, 2) Cross-sectional survey of leaders from 225 VA medium-to-large PC practices, both in 2007.
We assessed PC readiness factors related to resource adequacy, motivation for change, staff attributes, and organizational climate. As outcomes, we measured implementation of one of the VA-endorsed models: collocation, Translating Initiatives in Depression into Effective Solutions (TIDES), and Behavioral Health Lab (BHL). We performed bivariate and, when possible, multivariate analyses of readiness factors for each model.
Collocation is a relatively simple arrangement with a mental health specialist physically located in PC. TIDES and BHL are more complex; they use standardized assessments and care management based on evidence-based collaborative care principles, but with different organizational requirements. By 2007, 107 (47.5 %) clinics had implemented collocation, 39 (17.3 %) TIDES, and 17 (7.6 %) BHL. Having established quality improvement processes (OR 2.30, [1.36, 3.87], p = 0.002) or a depression clinician champion (OR 2.36, [1.14, 4.88], p = 0.02) was associated with collocation. Being located in a VA regional network that endorsed TIDES (OR 8.42, [3.69, 19.26], p < 0.001) was associated with TIDES implementation. The presence of psychologists or psychiatrists on PC staff, greater financial sufficiency, or greater spatial sufficiency was associated with BHL implementation.
Both readiness factors and characteristics of depression care models influence model adoption. Greater model simplicity may make collocation attractive within local quality improvement efforts. Dissemination through regional networks may be effective for more complex models such as TIDES.
Electronic supplementary material
The online version of this article (doi:10.1007/s11606-012-2217-z) contains supplementary material, which is available to authorized users.
primary care; mental health; depression; collaborative care; implementation; readiness
Alcohol problems may impede adaptive, proactive responses to disaster-related injury and loss, thus prolonging the adverse impact of disasters on mental health. Previous work suggests that veterans of the U.S. armed forces have a relatively high prevalence of alcohol misuse and other psychiatric disorders. This is the first study to estimate the impact of pre-disaster alcohol problems on post-disaster depressed mood among veterans, using data that were collected before and after the 1994 Northridge, California earthquake. We assessed the impact of alcohol problems on post-disaster depressed mood in an existing clinical cohort of veterans who experienced the 6.7-magnitude earthquake that struck Northridge in January 1994. One-to-three months after the disaster, interviewers contacted participants by telephone to administer a follow-up questionnaire based on a survey that had been done pre-earthquake. Post-earthquake data were obtained on 1144 male veterans for whom there were pre-earthquake data. We tested a predictive path model of the relationships between latent variables for pre-disaster alcohol problems, functional limitations, and depressed mood on latent variables representing post-disaster “quake impact” and depressive mood. Results showed that veterans who had more alcohol problems before the earthquake experienced more earthquake-related harms and severely depressed mood after the earthquake, compared with those who had fewer alcohol problems. Programs serving veterans with a high prevalence of alcohol problems should consider designing disaster response protocols to locate and assist these patients in the aftermath of disasters.
alcohol; disasters; mental health; structural equation modeling; longitudinal studies
More women are using Veterans’ Health Administration (VHA) Emergency Departments (EDs), yet VHA ED capacities to meet the needs of women are unknown.
We assessed VHA ED resources and processes for conditions specific to, or more common in, women Veterans.
Cross-sectional questionnaire of the census of VHA ED directors
Resources and processes in place for gynecologic, obstetric, sexual assault and mental health care, as well as patient privacy features, stratified by ED characteristics.
All 120 VHA EDs completed the questionnaire. Approximately nine out of ten EDs reported having gynecologic examination tables within their EDs, 24/7 access to specula, and Gonorrhea/Chlamydia DNA probes. All EDs reported 24/7 access to pregnancy testing. Fewer than two-fifths of EDs reported having radiologist review of pelvic ultrasound images available 24/7; one-third reported having emergent consultations from gynecologists available 24/7. Written transfer policies specific to gynecologic and obstetric emergencies were reported as available in fewer than half of EDs. Most EDs reported having emergency contraception 24/7; however, only approximately half reported having Rho(D) Immunoglobulin available 24/7. Templated triage notes and standing orders relevant to gynecologic conditions were reported as uncommon. Consistent with VHA policy, most EDs reported obtaining care for victims of sexual assault by transferring them to another institution. Most EDs reported having some access to private medical and mental health rooms. Resources and processes were found to be more available in EDs with more encounters by women, more ED staffed beds, and that were located in more complex facilities in metropolitan areas.
Although most VHA EDs have resources and processes needed for delivering emergency care to women Veterans, some gaps exist. Studies in non-VA EDs are required for comparison. Creative solutions are needed to ensure that women presenting to VHA EDs receive efficient, timely, and consistently high-quality care.
Electronic supplementary material
The online version of this article (doi:10.1007/s11606-012-2327-7) contains supplementary material, which is available to authorized users.
veterans’ health; women’s health; emergency medicine; organization of care
The promise of widespread implementation of efficacious interventions across the cancer continuum into routine practice and policy has yet to be realized. Multilevel influences, such as communities and families surrounding patients or health-care policies and organizations surrounding provider teams, may determine whether effective interventions are successfully implemented. Greater recognition of the importance of these influences in advancing (or hindering) the impact of single-level interventions has motivated the design and testing of multilevel interventions designed to address them. However, implementing research evidence from single- or multilevel interventions into sustainable routine practice and policy presents substantive challenges. Furthermore, relatively few multilevel interventions have been conducted along the cancer care continuum, and fewer still have been implemented, disseminated, or sustained in practice. The purpose of this chapter is, therefore, to illustrate and examine the concepts underlying the implementation and spread of multilevel interventions into routine practice and policy. We accomplish this goal by using a series of cancer and noncancer examples that have been successfully implemented and, in some cases, spread widely. Key concepts across these examples include the importance of phased implementation, recognizing the need for pilot testing, explicit engagement of key stakeholders within and between each intervention level; visible and consistent leadership and organizational support, including financial and human resources; better understanding of the policy context, fiscal climate, and incentives underlying implementation; explication of handoffs from researchers to accountable individuals within and across levels; ample integration of multilevel theories guiding implementation and evaluation; and strategies for long-term monitoring and sustainability.
Many patients who should be treated for depression are missed without effective routine screening in primary care (PC) settings. Yearly depression screening by PC staff is mandated in the VA, yet little is known about the expected yield from such screening when administered on a practice-wide basis.
We characterized the yield of practice-based screening in diverse PC settings, as well as the care needs of those assessed as having depression.
Baseline enrollees in a group randomized trial of implementation of collaborative care for depression.
Randomly sampled patients with a scheduled PC appointment in ten VA primary care clinics spanning five states.
PHQ-2 screening followed by the full PHQ-9 for screen positives, with standardized sociodemographic and health status questions.
Practice-based screening of 10,929 patients yielded 20.1% positive screens, 60% of whom were assessed as having probable major depression based on the PHQ-9 (11.8% of all screens) (n = 1,313). In total, 761 patients with probable major depression completed the baseline assessment. Comorbid mental illnesses (e.g., anxiety, PTSD) were highly prevalent. Medical comorbidities were substantial, including chronic lung disease, pneumonia, diabetes, heart attack, heart failure, cancer and stroke. Nearly one-third of the depressed PC patients reported recent suicidal ideation (based on the PHQ-9). Sexual dysfunction was also common (73.3%), being both longstanding (95.1% with onset >6 months) and frequently undiscussed and untreated (46.7% discussed with any health care provider in past 6 months).
Practice-wide survey-based depression screening yielded more than twice the positive-screen rate demonstrated through chart-based VA performance measures. The substantial level of comorbid physical and mental illness among PC patients precludes solo management by either PC or mental health (MH) specialists. PC practice- and provider-level guideline adherence is problematic without systems-level solutions supporting adequate MH assessment, PC treatment and, when needed, appropriate MH referral.
depression; screening; primary care; health care delivery; veterans
Meta-analyses show collaborative care models (CCMs) with nurse care management are effective for improving primary care for depression. This study aimed to develop CCM approaches that could be sustained and spread within Veterans Affairs (VA). Evidence-based quality improvement (EBQI) uses QI approaches within a research/clinical partnership to redesign care. The study used EBQI methods for CCM redesign, tested the effectiveness of the locally adapted model as implemented, and assessed the contextual factors shaping intervention effectiveness.
The study intervention is EBQI as applied to CCM implementation. The study uses a cluster randomized design as a formative evaluation tool to test and improve the effectiveness of the redesign process, with seven intervention and three non-intervention VA primary care practices in five different states. The primary study outcome is patient antidepressant use. The context evaluation is descriptive and uses subgroup analysis. The primary context evaluation measure is naturalistic primary care clinician (PCC) predilection to adopt CCM.
For the randomized evaluation, trained telephone research interviewers enrolled consecutive primary care patients with major depression in the evaluation, referred enrolled patients in intervention practices to the implemented CCM, and re-surveyed at seven months.
Interviewers enrolled 288 CCM site and 258 non-CCM site patients. Enrolled intervention site patients were more likely to receive appropriate antidepressant care (66% versus 43%, p = 0.01), but showed no significant difference in symptom improvement compared to usual care. In terms of context, only 40% of enrolled patients received complete care management per protocol. PCC predilection to adopt CCM had substantial effects on patient participation, with patients belonging to early adopter clinicians completing adequate care manager follow-up significantly more often than patients of clinicians with low predilection to adopt CCM (74% versus 48%%, p = 0.003).
Depression CCM designed and implemented by primary care practices using EBQI improved antidepressant initiation. Combining QI methods with a randomized evaluation proved challenging, but enabled new insights into the process of translating research-based CCM into practice. Future research on the effects of PCC attitudes and skills on CCM results, as well as on enhancing the link between improved antidepressant use and symptom outcomes, is needed.
Research-based queries about patients’ experiences often uncover suicidal thoughts. Human subjects review requires suicide risk management (SRM) protocols to protect patients, yet minimal information exists to guide researchers’ protocol development and implementation efforts. The purpose of this study was to examine the development and implementation of an SRM protocol employed during telephone-based screening and data collection interviews of depressed primary care patients. We describe an SRM protocol development process and employ qualitative analysis of de-identified documentation to characterize protocol-driven interactions between research clinicians and patients. Protocol development required advance planning, training, and team building. Three percent of screened patients evidenced suicidal ideation; 12% of these met protocol standards for study clinician assessment/intervention. Risk reduction activities required teamwork and extensive collaboration. Research-based SRM protocols can facilitate patient safety by (1) identifying and verifying local clinical site approaches and resources and (2) integrating these features into prevention protocols and training for research teams.
Depression; Patient safety; Suicide; Primary care; Research participants; Collaborative care
The evidence base for quality improvement (QI) interventions is expanding rapidly. The diversity of the initiatives and the inconsistency in labeling these as QI interventions makes it challenging for researchers, policymakers, and QI practitioners to access the literature systematically and to identify relevant publications.
We evaluated search strategies developed for MEDLINE (Ovid) and PubMed based on free text words, Medical subject headings (MeSH), QI intervention components, continuous quality improvement (CQI) methods, and combinations of the strategies. Three sets of pertinent QI intervention publications were used for validation. Two independent expert reviewers screened publications for relevance. We compared the yield, recall rate, and precision of the search strategies for the identification of QI publications and for a subset of empirical studies on effects of QI interventions.
The search yields ranged from 2,221 to 216,167 publications. Mean recall rates for reference publications ranged from 5% to 53% for strategies with yields of 50,000 publications or fewer. The 'best case' strategy, a simple text word search with high face validity ('quality' AND 'improv*' AND 'intervention*') identified 44%, 24%, and 62% of influential intervention articles selected by Agency for Healthcare Research and Quality (AHRQ) experts, a set of exemplar articles provided by members of the Standards for Quality Improvement Reporting Excellence (SQUIRE) group, and a sample from the Cochrane Effective Practice and Organization of Care Group (EPOC) register of studies, respectively. We applied the search strategy to a PubMed search for articles published in 10 pertinent journals in a three-year period which retrieved 183 publications. Among these, 67% were deemed relevant to QI by at least one of two independent raters. Forty percent were classified as empirical studies reporting on a QI intervention.
The presented search terms and operating characteristics can be used to guide the identification of QI intervention publications. Even with extensive iterative development, we achieved only moderate recall rates of reference publications. Consensus development on QI reporting and initiatives to develop QI-relevant MeSH terms are urgently needed.
The term continuous quality improvement (CQI) is often used to refer to a method for improving care, but no consensus statement exists on the definition of CQI. Evidence reviews are critical for advancing science, and depend on reliable definitions for article selection.
As a preliminary step towards improving CQI evidence reviews, this study aimed to use expert panel methods to identify key CQI definitional features and develop and test a screening instrument for reliably identifying articles with the key features. We used a previously published method to identify 106 articles meeting the general definition of a quality improvement intervention (QII) from 9427 electronically identified articles from PubMed. Two raters then applied a six-item CQI screen to the 106 articles.
Per cent agreement ranged from 55.7% to 75.5% for the six items, and reviewer-adjusted intra-class correlation ranged from 0.43 to 0.62. ‘Feedback of systematically collected data’ was the most common feature (64%), followed by being at least ‘somewhat’ adapted to local conditions (61%), feedback at meetings involving participant leaders (46%), using an iterative development process (40%), being at least ‘somewhat’ data driven (34%), and using a recognised change method (28%). All six features were present in 14.2% of QII articles.
We conclude that CQI features can be extracted from QII articles with reasonable reliability, but only a small proportion of QII articles include all features. Further consensus development is needed to support meaningful use of the term CQI for scientific communication.
Continuous quality improvement; healthcare quality improvement; organisation; PDSA; research
Depression and anxiety frequently co-occur with pain and may affect treatment outcomes. Early identification of these co-occurring psychiatric conditions during routine pain screening may be critical for optimal treatment.
To determine aspects of pain related to psychological distress, and, among distressed patients, to determine whether pain factors are related to provider identification of distress.
Cross-sectional interview of primary care patients and their providers participating in a Veteran’s Administration HELP-Vets study.
A total of 528 predominately male Veterans
MEASUREMENTS AND MAIN RESULTS
We measured self-reported pain, including a 0-10 numeric rating scale and interference items from the Brief Pain Inventory. To evaluate distress, brief indicators of depression, anxiety and PTSD were combined. A substantial number of patients had psychological distress (41%), which was even higher (62%) among patients with moderate-severe current pain. Only 29% of those with distress reported talking to their provider about emotional problems during their visit. In multivariate analyses, other pain factors related to distress included interference with enjoyment of life and relationships with others, pain in multiple locations and joint pains. Prior diagnoses of depression and anxiety were also related to current distress. Only prior diagnosis and patient reported headaches and sleep interference because of pain were related to provider identification of distress.
VA patients with moderate-severe pain are at high risk for psychological distress, which often goes unrecognized. Providers need to be more vigilant to mental health problems in patients experiencing high pain levels. Targeted screening for co-occurring conditions is warranted.
targeted screening for pain and distress; depression; anxiety
Depression treatment requires close monitoring to achieve optimal, long-term control. Use of multiple sources of health care can affect coordination and continuity of treatment for depression.
To assess levels of non-Veterans Health Administration (VA) use among depressed primary care patients by service type and examine patient factors associated with non-VA use.
Cross-sectional comparison of dual and VA-only users among depressed primary care patients. Depression was defined as PHQ-9 ≥10.
Five hundred fifty depressed patients from the baseline sample of a group-randomized trial of collaborative care for depression in ten VA primary care practices.
VA and non-VA outpatient utilization for physical and emotional health problems in the prior 6 months, patient demographics, and co-morbid conditions. All measures were self-reported and obtained at the baseline interview.
Overall, 46.8% of VA depressed primary care patients utilized non-VA care. Dual users were more likely to use acute care services (emergency room or inpatient), especially for physical health problems. Dual users of physical health services had more total visits, but fewer VA visits than VA-only users, while dual users of emotional health services had fewer total and VA visits. Factors associated with dual use were urban clinic location, having other insurance coverage, and dissatisfaction with physical health care in general.
Almost half of depressed primary care patients used non-VA care, with most of their non-VA use for physical rather than emotional health problems. Care management strategies for depressed patients should include communication and coordination with non-VA providers.
dual use; depression; primary care; veterans
Collaborative care models for depression in primary care are effective and cost-effective, but difficult to spread to new sites. Translating Initiatives for Depression into Effective Solutions (TIDES) is an initiative to promote evidence-based collaborative care in the U.S. Veterans Health Administration (VHA). Social marketing applies marketing techniques to promote positive behavior change. Described in this paper, TIDES used a social marketing approach to foster national spread of collaborative care models.
TIDES social marketing approach
The approach relied on a sequential model of behavior change and explicit attention to audience segmentation. Segments included VHA national leadership, Veterans Integrated Service Network (VISN) regional leadership, facility managers, frontline providers, and veterans. TIDES communications, materials and messages targeted each segment, guided by an overall marketing plan.
Depression collaborative care based on the TIDES model was adopted by VHA as part of the new Primary Care Mental Health Initiative and associated policies. It is currently in use in more than 50 primary care practices across the United States, and continues to spread, suggesting success for its social marketing-based dissemination strategy.
Discussion and conclusion
Development, execution and evaluation of the TIDES marketing effort shows that social marketing is a promising approach for promoting implementation of evidence-based interventions in integrated healthcare systems.
Reduction in cervical cancer incidence and mortality is not only dependant on promoting cervical cancer screening but also on providing appropriate follow-up and treatment of abnormal cervical cytology.
The objective of this study was to determine variations in guideline adherence for women requiring abnormal cervical cytology follow-up.
Subjects of the study are women 18 years or older with an abnormal Pap test in 2000 within a large county healthcare system (n = 8,571).
Guideline adherence was determined by the presence or absence of the appropriate follow-up procedure within an acceptable time interval for each degree of cytological abnormality. Patients with no follow-up studies were deemed to be lost to follow-up.
Of study subjects, 18.5% were lost to follow-up care. Of the remaining 6,987 women, 60.3% received optimal care, 9.4% received suboptimal care, and 30.3% received poor care. Follow-up rates were higher for patients with higher degree of cytological abnormality (OR, 1.29, 95% CI, 1.17–1.42), older patients (OR, 1.03, 95% CI, 1.02–1.030) and those receiving the index Pap test at a larger healthcare facility (OR, 1.13; 95% CI, 1.01–1.27). Receiving optimal care was positively correlated with higher degree of cytological abnormality (p < .0001) and larger facility size (p = .002). Regional variations in care demonstrated the largest cluster having the lowest lost to follow-up rate and the most optimal care.
A significant number of women with abnormal cervical cytology are receiving less than optimal care. Further studies are required to determine the specific healthcare delivery practices that need to be targeted to improve guideline adherence for follow-up of abnormal cytology.
cytology; quality of care; practice guidelines; cervical cancer
Little is known about effective strategies for disseminating and implementing complex clinical innovations across large healthcare systems. This paper describes processes undertaken and tools developed by the U.S. Department of Veterans Affairs (VA) Mental Health Quality Enhancement Research Initiative (MH-QUERI) to guide its efforts to partner with clinical leaders to prepare for national dissemination and implementation of collaborative care for depression.
An evidence-based quality improvement (EBQI) process was used to develop an initial set of goals to prepare the VA for national dissemination and implementation of collaborative care. The resulting product of the EBQI process is referred to herein as a "National Dissemination Plan" (NDP). EBQI participants included: a) researchers with expertise on the collaborative care model for depression, clinical quality improvement, and implementation science, and b) VA clinical and administrative leaders with experience and expertise on how to adapt research evidence to organizational needs, resources and capacity. Based on EBQI participant feedback, drafts of the NDP were revised and refined over multiple iterations before a final version was approved by MH-QUERI leadership. 'Action Teams' were created to address each goal. A formative evaluation framework and related tools were developed to document processes, monitor progress, and identify and act upon barriers and facilitators in addressing NDP goals.
The National Dissemination Plan suggests that effectively disseminating collaborative care for depression in the VA will likely require attention to: Guidelines and Quality Indicators (4 goals), Training in Clinical Processes and Evidence-based Quality Improvement (6 goals), Marketing (7 goals), and Informatics Support (1 goal). Action Teams are using the NDP as a blueprint for developing infrastructure to support system-wide adoption and sustained implementation of collaborative care for depression. To date, accomplishments include but are not limited to: conduct of a systematic review of the literature to update VA depression treatment guidelines to include the latest evidence on collaborative care for depression; training for clinical staff on TIDES (Translating Initiatives for Depression into Effective Solutions project) care; spread of TIDES care to new VA facilities; and integration of TIDES depression assessment tools into a planned update of software used in delivery of VA mental health services. Thus far, common barriers encountered by Action Teams in addressing NDP goals include: a) limited time to address goals due to competing tasks/priorities, b) frequent turnover of key organizational leaders/stakeholders, c) limited skills and training among team members for addressing NDP goals, and d) difficulty coordinating activities across Action Teams on related goals.
MH-QUERI has partnered with VA organizational leaders to develop a focused yet flexible plan to address key factors to prepare for national dissemination and implementation of collaborative care for depression. Early indications suggest that the plan is laying an important foundation that will enhance the likelihood of successful implementation and spread across the VA healthcare system.
Compared to those with depression alone, depressed patients with posttraumatic stress disorder (PTSD) experience more severe psychiatric symptomatology and factors that complicate treatment.
To estimate PTSD prevalence among depressed military veteran primary care patients and compare demographic/illness characteristics of PTSD screen-positive depressed patients (MDD-PTSD+) to those with depression alone (MDD).
Cross-sectional comparison of MDD patients versus MDD-PTSD+ patients.
Six hundred seventy-seven randomly sampled depressed patients with at least 1 primary care visit in the previous 12 months. Participants composed the baseline sample of a group randomized trial of collaborative care for depression in 10 VA primary care practices in 5 states.
The Patient Health Questionnaire-9 assessed MDD. Probable PTSD was defined as a Primary Care PTSD Screen ≥ 3. Regression-based techniques compared MDD and MDD-PTSD+ patients on demographic/illness characteristics.
Thirty-six percent of depressed patients screened positive for PTSD. Adjusting for sociodemographic differences and physical illness comorbidity, MDD-PTSD+ patients reported more severe depression (P < .001), lower social support (P < .001), more frequent outpatient health care visits (P < .001), and were more likely to report suicidal ideation (P < .001) than MDD patients. No differences were observed in alcohol consumption, self-reported general health, and physical illness comorbidity.
PTSD is more common among depressed primary care patients than previously thought. Comorbid PTSD among depressed patients is associated with increased illness burden, poorer prognosis, and delayed response to depression treatment. Providers should consider recommending psychotherapeutic interventions for depressed patients with PTSD.
depression; PTSD; primary care; clinical practice guidelines