PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of jgimedspringer.comThis journalToc AlertsSubmit OnlineOpen Choice
 
J Gen Intern Med. 2013 March; 28(3): 353–362.
Published online 2012 October 5. doi:  10.1007/s11606-012-2217-z
PMCID: PMC3579970

Determinants of Readiness for Primary Care-Mental Health Integration (PC-MHI) in the VA Health Care System

Evelyn T. Chang, MD,corresponding author Danielle E. Rose, PhD, MPH, Elizabeth M. Yano, PhD, MSPH, Kenneth B. Wells, MD, MPH, Maureen E. Metzger, PhD, MPH, Edward P. Post, MD, PhD, Martin L. Lee, PhD, and Lisa V. Rubenstein, MD, MSPH

ABSTRACT

BACKGROUND

Depression management can be challenging for primary care (PC) settings. While several evidence-based models exist for depression care, little is known about the relationships between PC practice characteristics, model characteristics, and the practice’s choices regarding model adoption.

OBJECTIVE

We examined three Veterans Affairs (VA)-endorsed depression care models and tested the relationships between theoretically-anchored measures of organizational readiness and implementation of the models in VA PC clinics.

DESIGN

1) Qualitative assessment of the three VA-endorsed depression care models, 2) Cross-sectional survey of leaders from 225 VA medium-to-large PC practices, both in 2007.

MAIN MEASURES

We assessed PC readiness factors related to resource adequacy, motivation for change, staff attributes, and organizational climate. As outcomes, we measured implementation of one of the VA-endorsed models: collocation, Translating Initiatives in Depression into Effective Solutions (TIDES), and Behavioral Health Lab (BHL). We performed bivariate and, when possible, multivariate analyses of readiness factors for each model.

KEY RESULTS

Collocation is a relatively simple arrangement with a mental health specialist physically located in PC. TIDES and BHL are more complex; they use standardized assessments and care management based on evidence-based collaborative care principles, but with different organizational requirements. By 2007, 107 (47.5 %) clinics had implemented collocation, 39 (17.3 %) TIDES, and 17 (7.6 %) BHL. Having established quality improvement processes (OR 2.30, [1.36, 3.87], p = 0.002) or a depression clinician champion (OR 2.36, [1.14, 4.88], p = 0.02) was associated with collocation. Being located in a VA regional network that endorsed TIDES (OR 8.42, [3.69, 19.26], p < 0.001) was associated with TIDES implementation. The presence of psychologists or psychiatrists on PC staff, greater financial sufficiency, or greater spatial sufficiency was associated with BHL implementation.

CONCLUSIONS

Both readiness factors and characteristics of depression care models influence model adoption. Greater model simplicity may make collocation attractive within local quality improvement efforts. Dissemination through regional networks may be effective for more complex models such as TIDES.

Electronic supplementary material

The online version of this article (doi:10.1007/s11606-012-2217-z) contains supplementary material, which is available to authorized users.

KEY WORDS: primary care, mental health, depression, collaborative care, implementation, readiness

INTRODUCTION

Depression affects 5–10 % of individuals1,2 and is projected to be the second leading cause of disability worldwide by 2020.3 Depression is also the largest single contributor to impaired mental health (MH) in primary care (PC) populations. Most patients with depression are cared for in PC rather than MH specialty settings, yet recognition and quality of care for depressive disorders in PC are lower than for other major chronic illnesses.46 Methods for improving depression care in PC have been extensively studied and shown to be effective714 and cost-effective.1519 Uptake of evidence-based models for improving depression care for PC populations, however, has been slow.2024 This paper aims to improve understanding of the uptake of depression care improvement models by investigating the determinants of adoption of three alternative, Veterans Affairs (VA) system-endorsed approaches to improving routine depression care.

Theories of innovation dissemination postulate that innovation characteristics affect adoption rates.25,26 However, the process of adopting an approach to improvement is affected not only by the characteristics of an innovation, but by the fit between the innovation and organizational characteristics. Accordingly, theories of organizational readiness suggest that characteristics of the adopting organization will also predict whether and when organizations will adopt a given innovation.27 Organizational readiness for change has been defined as “the extent to which organizational members are psychologically and behaviorally prepared to implement organizational change.”27 Within this framework, researchers have identified organizational characteristics that favor adoption of MH innovations.25,2729

This study takes advantage of the natural experiment created by VA’s endorsement of three substantively different depression care improvement models to meet system primary care-mental health integration (PC-MHI) goals. These models served as alternatives for PC practices to choose for screening and managing common MH disorders in the PC setting. We assess the proportion of practices that had adopted each of the three depression care models after official endorsement, and relate practice choice among the endorsed models to local readiness characteristics. These VA-endorsed models include collocation of mental health specialists (MHS) in PC settings, the Translating Initiatives in Depression (TIDES) model, and the Behavioral Health Laboratory (BHL) model. By the time these models were formally endorsed and incentivized in 2006, they had already been in development and/or spread to additional practices within the VA for over a decade. Adoption of at least one of these models was later mandated (in 2008, after the period of this study) through VA’s Uniform Services Package for Mental Health.30

The three models have varying levels of evidence support and requirements for organizational redesign. Collaborative care models, such as TIDES31,32 or BHL,3335 are highly evidence-based in terms of effectiveness. However, they require significant system redesign and training,3638 with or without the addition of collocation. Collocation alone, on the other hand, requires little system redesign. It has also been studied less often and, when studied, has not been found to improve patient outcomes over standard MH specialty care.3942

In this study, we used a qualitative assessment of the VA-endorsed models and a nationwide cross-sectional survey to measure the organizational readiness of 225 VA PC practices in relationship to which depression care improvement model the practices chose to adopt. We address the following questions:

  1. How do the three depression care improvement models differ by the organizational demands placed on PC practices for system redesign?
  2. One year after VA endorsement, what was the prevalence of the three depression care models?
  3. Do local organizational readiness factors predict PC practice choice regarding which model to adopt? If so, which readiness factors are associated with the decision to implement each model?

METHODS

Overview and Theoretical Models

To address organizational readiness factors in relationship to depression care improvement model adoption, we adapted the Organizational Readiness for Change (ORC) model29,43 as the framework for this study (Figure 1). Lehman, et al. developed the ORC to study how factors influence the adoption of innovation25,26,44 on an organizational level as used here, rather than on an individual or group level. We assessed which readiness characteristics predicted adoption of any model and of each model separately.

Figure 1.
Conceptual model of independent variables derived from organizational readiness for change framework with hypothesized linkages to implementation of VA-endorsed depression care improvement models. + indicates positive relationship; - indicates negative ...

To qualitatively explore depression care improvement model characteristics in relationship to our findings on model adoption, we used Rogers’ Diffusion of Innovation Theory.44 We assessed individual model characteristics for each VA-endorsed model, specifically focusing on model complexity in terms of the demands placed on practices for system redesign.

Study Sample

We used data from the 2007 VA Clinical Practice Organization Survey (CPOS) Primary Care Directors Module, a nationwide survey of PC directors on organization-level characteristics for their respective practices,45 to assess PC practice readiness.

The sample included all VA PC practices with ≥ 4,000 unique patients and ≥ 20,000 outpatient visits. The resulting survey sample comprised 250 VA PC practices, including 152 based in VA medical centers (VAMC) and 97 that were community-based outpatient clinics (CBOC). Survey packets were mailed as well as e-mailed; an electronic version was available for online completion. We achieved a 90 % response rate for a total sample of 225 out of 250 PC practices.

Measures

For dependent variables, we assessed which, if any, of the three endorsed models had been chosen for implementation by each PC practice based on a CPOS survey question asking about the degree of implementation of collocated care, TIDES, or BHL. We dichotomized responses (“fully” or “partially” implemented versus “planned but not yet implemented” or “not implemented”).

Some PC practices reported the implementation of more than one model. We assigned practices to a single model using a hierarchy such that they were first assigned to BHL; then if not BHL, to TIDES; then if not TIDES or BHL, to collocation. This reflected the specificity of the BHL model informatics, such that practices reporting BHL were likely to be using BHL software, even if they used additional TIDES training. Collocation is non-specific regarding program components and could co-exist with either TIDES or BHL programs.

For independent variables, we assessed practice readiness characteristics29,43 assessed in the CPOS 2007 survey. We developed scales using exploratory factor analysis guided by theory.46,47 Cronbach’s alpha coefficients48 were > 0.65 for each scale (Online Appendix Table 1).

We studied four components of adequacy of resources: financial insufficiency, clinical provider insufficiency, space sufficiency, and sufficiency for information technology (IT) support.

We studied two components of motivation for change: retreat for depression training and regional endorsement. The latter was based on whether or not the practice was located in one of three regional health system networks nationwide that had endorsed TIDES (no other models were regionally endorsed in 2007).

We studied two components of staff attributes: presence of a clinician champion for depression treatment (proxy for staff influence) and presence of psychiatrist, psychologist, and social worker on primary care staff (proxy for staff efficacy).

We studied seven components of organizational climate: orientation towards quality improvement (QI), competing demands and stress, communication and cooperation, teamwork, internal authority over the PC clinic, external authority over relationships with specialists, and resistance.

As descriptive characteristics, we assessed practice demographic characteristics. These included practice type as hospital-based vs. community-based (VAMC vs. CBOC) and practice size based on patient utilization data for fiscal year (FY) 2007 from the VA National Patient Care Database (Austin data); practice location in urban/rural settings based on the Area Resource File,49 and academic affiliation based on the VA Office of Academic Affiliation website.50 We used practice size as a covariate in regression analysis.

For the exploratory qualitative analysis of the three improvement models as they existed in 2007, we identified key model characteristics based on author (EC) review of the literature, review of VA intranet descriptions, and interviews with model developers.

STATISTICAL ANALYSIS

To explore associations between practice demographic characteristics and choice of depression care improvement model, we tested for significant differences between models using Pearson Chi-squared tests (and Fisher’s Exact tests51 for factors with cell counts < 5). To assess associations between readiness characteristics and each of the three improvement models, and between readiness and adopting none of the models, we used bivariate regression analysis. These analyses identified statistically important (p < 0.10) predictors of model choice. To further assess the predictors of model choice, we constructed separate multivariate logistic regression models, also controlling for practice size. BHL had an insufficient sample size for multivariable regression. All dependent variables used in predictive analyses had < 5 % missing data, obviating the need for imputation. All statistical analysis was performed with STATA 11/IC.

QUALITATIVE ANALYSIS

We used simplified cross-case analysis to generate hypotheses about the relationships between the characteristics of the three improvement models and the readiness characteristics that predicted them. We focused on key model characteristics, including goals, history, complexity, and elements of the Chronic Care Model used to improve depression care in the PC setting (i.e., self-management, clinical information systems, delivery system design).52,53

RESULTS

Table 1 shows the characteristics of the three VA-endorsed depression care improvement programs. The alternative collaborative care models, TIDES and BHL, were each associated with developed programs that included distinct VA-tested implementation methods, tools and training.31,32,34,39 These programs were open to any VA PC practice through national trainings, ongoing program support staff, and sharing of technologies. These two programs, however, had different histories and goals; TIDES was initially developed and tested through regional networks, whereas BHL was developed at a single site. As for collocated care, while the 2006 VA endorsement referenced a more complex collocated collaborative care model, no implementation program or tools were broadly available for the complex approach.

Table 1
Qualitative Differences Between the BHL=Behavioral Health Laboratory, TIDES=Translating Initiatives for Depression into Effective Solutions, and Collocated Care Models

As shown in Figure 2, in 2007, 124 of all 225 (55.1 %) PC practices had voluntarily implemented a VA-endorsed PC-MHI model. Of the 124 practices, 107 (86.3 %) had implemented collocated care, 39 (31.5 %) had implemented TIDES, and 17 (13.7 %) had implemented BHL. Only 17 of the 124 (14 %) implemented TIDES or BHL without also implementing collocation (Figure 2).

Figure 2.
Number of primary care practices indicating implementation of each model. Numbers represent primary care practices adopting the model or combination of models. Models depicted are Collocated Care, TIDES=Translating Initiatives for Depression into Effective ...

Although almost half (44.9 %) of the practices had not yet implemented any depression care improvement model, the majority were planning to do so, particularly collocated care. Of the 116 practices (missing = 2) that had not yet chosen to implement collocation, 63 (54.3 %) planned to implement it. Among the 171 practices (missing = 15) that had not yet implemented TIDES, 20 (11.7 %) planned to implement it. Among the 195 practices (missing = 13) that had not yet implemented BHL, 23 (11.8 %) planned to implement it.

Table 2 shows the PC practice organizational demographics in relationship to implementation of collocated care (Co), TIDES (Ti), BHL (BH), or no model (NM). Regarding MHS staffing on the PC staff, practices with a PC-based psychologist were more likely to have implemented an improvement model (41 % Co, 31 % Ti, 53 % BH, 20 % NM, p < 0.006). Practices with a psychiatrist on the PC staff were more likely to have implemented BHL (29 % Co, 29 % TI, 71 % BH, p < 0.001). There were no significant differences for social workers. The only other significant difference was that practices located in VA regional networks that had endorsed TIDES were more likely to have implemented TIDES (15 % Co, 49 % TI, 12 % BH, 6 % NM, p < 0.001). Descriptively, collocation had been in place in practices longer on average (6.2 years) compared to TIDES (2.7 years) or BHL (1.2 years).

Table 2
Demographic Characteristics of Primary Care Practices in Relationship to Implementation of Each Alternative Depression Care Improvement Model*, n = 225

As shown in Table 3, having more established quality improvement (QI) processes (OR 2.25, 95 % CI [1.36, 3.72], p = 0.002), a clinician champion for depression treatment (OR 2.37, 95 % CI [1.17, 4.78], p = 0.02), or a psychologist on the PC staff (OR 1.92, 95 % CI [1.06, 3.48], p = 0.03) were significantly associated with collocation. Being in a VA region that had endorsed TIDES (OR 8.5, 95 % CI [3.76, 19.20], p < 0.001) or having sufficient IT support (OR 1.61, 95 % CI [1.01, 2.57], p = 0.04) were significantly associated with TIDES. Having a psychologist (OR 2.80, 95 % CI [1.03, 7.64], p = 0.04) or psychiatrist on the PC staff (OR 7.57, 95 % CI [2.53, 22.61], p < 0.001), less financial insufficiency (OR 0.35, 95 % CI [0.17, 0.72], p = 0.004), or more sufficient space (OR 1.91, 95 % CI [1.07, 3.38], p = 0.03) were significantly linked with BHL. Having poorer communication among PC staff (OR 0.60, 95 % CI [0.38, 0.97], p = 0.04), fewer QI processes (OR 0.44, 95 % CI [0.28, 0.70], p < 0.001), insufficient financial resources (OR 1.43, 95 % CI [1.00, 2.03], p = 0.045), lacking a psychologist (OR 0.38, 95 % CI [0.21, 0.70], p = 0.002) or psychiatrist (OR 0.53, 95 % CI [0.29, 0.97], p = 0.04) on PC staff, and being in a VA region that did not endorse TIDES (OR 0.20, 95 % CI [0.08, 0.50], p = 0.001) were associated with having adopted none of the models.

Table 3
Bivariate Analysis* of Organizational Readiness Factors and Primary Care Practice Setting Demographics Against Adoption of Collocation, TIDES†, BHL‡, or No Depression Care Improvement Model

Table 4 shows results of multivariate regression for predicting collocation, TIDES, and no model implementation. Being a PC practice with strongly established processes for QI (OR 2.30, 95 % CI [1.36, 3.87], p = 0.002), or with a clinician champion for depression treatment (OR 2.36, 95 % CI [1.14, 4.88], p = 0.02), significantly predicted collocation. Being a PC practice located in a regional network that had endorsed TIDES (OR 8.42, 95 % CI [3.69, 19.26], p < 0.001) significantly predicted TIDES implementation. Overall, practices with fewer established QI processes (OR 0.47, 95 % CI [0.27, 0.85], p = 0.01), without a psychologist on staff (OR 0.37, 95 % CI [0.17, 0.80], p = 0.01), and located in regional networks that did not endorse TIDES (OR 0.22, 95 % CI [0.08. 0.57], p = 0.002) significantly predicted adopting none of the models. The direction, magnitude, and significance did not change when the models were adjusted for practice size (not shown).

Table 4
Multivariate Regression‡ Results Predicting Adoption of Collocation or TIDES† or No Depression Care Improvement Model

DISCUSSION

This study shows that pre-existing demographic and readiness characteristics of PC practices are associated with whether the practice chooses to implement a depression care improvement model and with what type of model the practice chooses among alternatives. As such, the study validates the concept that both practice context and the differing characteristics of alternative innovation models shape model adoption. Our findings also extend the concept of organizational readiness to improve MH care toward a consideration of the specific readiness factors that may make implementation of alternative models more or less attractive. Our work thus provides a framework for additional investigation and a refined set of readiness factors for managers to consider in achieving improved depression care.

Of the three approaches, PC practices appear most ready to implement collocation. Collocation had been present the longest (average 6.2 years) in practices adopting it, and the majority of practices that had not adopted it planned to do so. These findings suggest that collocation is easier to adopt than other models, supporting our qualitative analysis showing few requirements for redesign to implement this model. Having a depression clinical champion or a QI-oriented culture independently predicted collocation. Consistent with theories of innovation diffusion, greater model simplicity may have made collocation particularly attractive within the context of local QI efforts.

In contrast to the local readiness factors associated with collocation, regional endorsement of the TIDES model independently predicted adoption of TIDES, as well as any depression care improvement model. The regional endorsement reflected VA administration and financing, which flows through regional administration.32 Given the spread approach for TIDES was regional, this finding suggests that model dissemination through regional networks may be effective, particularly for improvements that require substantial redesign.

There were insufficient BHL practices in 2007 to support multivariable analysis. Among the 17 practices reporting BHL implementation, the model had been in place an average of 1.2 years. Based on bivariate results, these early BHL practices had significantly more MHS, space, and financial resources, as well as a culture of better communication and collaboration. It may be that this model, which requires creation of a laboratory capable of assessing, triaging and arranging or providing treatment for any MH condition, is easiest to adopt when resources are more sufficient.

It is of some concern that collocation remained the most common approach in 2007. As originally envisioned by VA policymakers in 2006, collocated care was to be collocated collaborative care, based on the White River Junction VA literature.5457 This model offers open access to MH and has demonstrated improvement in depression care. Operational definitions of collocated collaborative care in the field, however, required only collocating one or more MHS (i.e., psychiatrists, psychologists, social workers or advanced practice nurses) in PC. There is no evidence that collocation alone improves depression outcomes.4042

There are limitations to our analyses. First, the analysis was cross-sectional, and causal relationships between organizational factors and implementation of various models cannot be proven. For instance, the implementation of collocation may increase the awareness of depression treatment among clinical leaders or increase the presence of psychologists in PC. However, organizational climate tend to remain stable despite short-term organizational change efforts, which suggests that some ORC measures may have a causal relationship with model adoption.5860 Second, assessment of organizational features relied on a single respondent, the PC clinic director, and may not reflect the practice as a whole. However, directors’ responses have been highly correlated with staff responses in prior work.29 Third, we were not able to analyze combinations of models or assess independent predictors of BHL adoption due to sample size limitations, despite a relatively large (for organizational surveys) sample size of 225 observations. Fourth, the results here may not generalize to PC clinics outside of the VA, although we expect findings to apply to other managed care systems. Fifth, we do not measure implementation fidelity to published models; the analyses reported here focus only on understanding the practice’s choice for implementing a PC-MHI model. Similarly, we cannot determine the superiority of one model over another. In addition, some of the collocated MHS may not be employed by PC, and are therefore unaccounted for in this PC-based survey. Finally, we expect that model adoption has changed substantially between 2007 and today.

In summary, this is one of the few studies to explore the relationships between organizational readiness factors and implementation of depression care improvement approaches. We found that several readiness factors should be considered by policymakers and system leaders, based on their significant relationships with model implementation. These include local PC practice orientation towards QI, presence of a clinician champion for depression, financial and space sufficiency, IT support sufficiency, and regional endorsement of the improvement model. Based on our study findings, better understanding of the determinants of model adoption will be essential for achieving more effective designs and dissemination strategies for improving care for depression and other MH conditions in PC practice populations.

Electronic supplementary material

ESM 1(62K, pdf)

(PDF 62 kb)

Acknowledgements

Contributors

Contributors include Steven Asch, MD MPH, Ann Chou, PhD, Johanna Klaus, PhD, Edmund Chaney, PhD, John McCarthy, PhD, Michael Mitchell, PhD, Susan Stockdale, PhD, and Brian Mittman, PhD.

The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs, or the US government, or other affiliated institutions.

Funders

Funding support provided by VA Office of Academic Affiliations, Health Services Research and Development through the Health Services Fellowship Training Program (TMP 65-020). Dr. Yano’s time was funded by the VA HSR&D Service through a Research Career Scientist Award (Project # RCS 05-195). The project was also supported by VA HSR&D Project #09-082 (Yano, PI).

Prior Presentations

Oral abstracts summarizing these findings were presented at the Society of General Internal Medicine 35th Annual Meeting on May 9-12, 2012 in Orlando, Florida, and the Academy Health Annual Research Meeting on June 25–27, 2012 in Orlando, Florida.

Conflict of Interest

The authors declare that they do not have a conflict of interest.

REFERENCES

1. Kessler R, Chiu W, Demler O, Walters E. Prevalence, severity, and comorbidity of twelve-month DSM-IV disorders in the National Comorbidity Survey Replication (NCS-R) Arch Gen Psychiat. 2005;62(6):617–627. doi: 10.1001/archpsyc.62.6.617. [PMC free article] [PubMed] [Cross Ref]
2. Singleton N, Bumpstead R, O’Brien M, Lee A, Meltzer H. Office of National Statistics: Psychiatric morbidity among adults living in private households, 2000. London: Her Majesty’s Stationery Office; 2001.
3. World Health Organization. Mental health: Depression. 2011; http://www.who.int/mental_health/management/depression/definition/en/. Accessed August 21, 2012.
4. Simon G, Von Korff M. Recognition and management of depression in primary care. Arch Fam Med. 1995;4:99–105. doi: 10.1001/archfami.4.2.99. [PubMed] [Cross Ref]
5. Young A, Klap R, Sherbourne C, Wells K. The quality of care for depressive and anxiety disorders in the United States. Arch Gen Psychiat. 2001;58(1):55–61. doi: 10.1001/archpsyc.58.1.55. [PubMed] [Cross Ref]
6. Wang P, Lane M, Olfson M, Pincus H, Wells K, Kessler R. Twelve-month use of mental health services in the United States. Arch Gen Psychiat. 2005;62:629–640. doi: 10.1001/archpsyc.62.6.629. [PubMed] [Cross Ref]
7. Alexopoulos G, Reynolds C, Bruce M, et al. Reducing suicidal ideation and depression in older primary care patients: 24-month outcomes of the PROSPECT study. Am J Psychiat. 2009;166:882–890. doi: 10.1176/appi.ajp.2009.08121779. [PMC free article] [PubMed] [Cross Ref]
8. Reiss-Brennan B, Briot P, Savitz L, Cannnon W, Staheli R. Cost and quality impact of Intermountain’s Mental Health Integration Program. J Healthc Manag. 2010;55(2):97–114. [PubMed]
9. Unutzer J, Katon W, Callahan C, et al. Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. JAMA. 2002;288(22):2836–2845. doi: 10.1001/jama.288.22.2836. [PubMed] [Cross Ref]
10. Katon W, Von Korff M, Lin E, et al. Stepped collaborative care for primary care patients with persistent symptoms of depression: a randomized trial. Arch Gen Psychiat. 1999;56(12):1109–1115. doi: 10.1001/archpsyc.56.12.1109. [PubMed] [Cross Ref]
11. Katon W, Von Korff M, Lin E, et al. Collaborative management to achieve treatment guidelines: impact on depression in primary care. JAMA. 1995;273:1026–1031. doi: 10.1001/jama.1995.03520370068039. [PubMed] [Cross Ref]
12. Wells K, Sherbourne C, Schoenbaum M, et al. Five-year impact of quality improvement for depression. Arch Gen Psychiat. 2001;61:378–386. doi: 10.1001/archpsyc.61.4.378. [PubMed] [Cross Ref]
13. Gilbody S, Bower P, Fletcher J, Richards D, Sutton AJ. Collaborative care for depression. Arch Intern Med. 2006;166:2314–2321. doi: 10.1001/archinte.166.21.2314. [PubMed] [Cross Ref]
14. Bower P, Gilbody S, Richards D, Fletcher J, Sutton A. Collaborative care for depression in primary care. Br J Psychiat. 2006;189:484–493. doi: 10.1192/bjp.bp.106.023655. [PubMed] [Cross Ref]
15. Simon GE, Katon WJ, VonKorff M, et al. Cost-effectiveness of a collaborative care program for primary care patients with persistent depression. Am J Psychiat. 2001;158:1638–1644. doi: 10.1176/appi.ajp.158.10.1638. [PubMed] [Cross Ref]
16. Unutzer J, Katon WJ, Fan M-Y, et al. Long-term cost effects of collaborative care for late-life depression. Am J Manag Care. 2008;14:95–100. [PMC free article] [PubMed]
17. Liu C-F, Hedrick SC, Chaney EF, et al. Cost-effectiveness of collaborative care for depression in a primary care veteran population. Psychiat Serv. 2003;54(5):698–704. doi: 10.1176/appi.ps.54.5.698. [PubMed] [Cross Ref]
18. Lave J, Frank R, Schulberg H, Kamlet M. Cost-effectiveness of treatments for major depression in primary care practice. Arch Gen Psychiat. 1998;55:645–651. doi: 10.1001/archpsyc.55.7.645. [PubMed] [Cross Ref]
19. Schoenbaum M, Unutzer J, Sherbourne C, et al. Cost-effectiveness of practice-initiated quality improvement for depression: results of a randomized controlled trial. JAMA. 2001;286(11):1325–1330. doi: 10.1001/jama.286.11.1325. [PubMed] [Cross Ref]
20. Nutting P, Rost K, Dickinson M, et al. Barriers to initiating depression treatment in primary care. J Gen Intern Med. 2002;17:103–111. doi: 10.1046/j.1525-1497.2002.10128.x. [PMC free article] [PubMed] [Cross Ref]
21. Henke R, McGuire T, Zaslavsky A, Ford D, Meredity L, Arbelaez J. Clinician- and organization-level factors in the adoption of evidence-based care for depression in primary care. Health Care Manag Rev. 2008;33(4):289–299. doi: 10.1097/01.HCM.0000318766.29277.49. [PubMed] [Cross Ref]
22. Nutting P, Gallagher K, Riley K, et al. Care management for depression in primary care practice: findings from the RESPECT-depression trial. Ann Fam Med. 2008;6:30–37. doi: 10.1370/afm.742. [PubMed] [Cross Ref]
23. Kilbourne A, Schulberg H, Post E, Rollman B, Belnap B, Pincus H. Translating evidence-based depression management services to community-based primary care practices. Milbank Q. 2004;82(4):631–659. doi: 10.1111/j.0887-378X.2004.00326.x. [PubMed] [Cross Ref]
24. Belnap BH, Kuebler J, Upshur C, et al. Challenges of implementing depression care management in the primary care setting. Adm Policy Ment Health. 2006;33(1):65–75. doi: 10.1007/s10488-005-4237-z. [PubMed] [Cross Ref]
25. Scott WR. Innovation in medical care organizations: a synthetic review. Med Care Res Rev. 1990;47(165):165–192. doi: 10.1177/107755879004700203. [PubMed] [Cross Ref]
26. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in Service Organizations: systematic review and recommendations. Milbank Q. 2004;82(2):581–629. doi: 10.1111/j.0887-378X.2004.00325.x. [PubMed] [Cross Ref]
27. Weiner B, Amick H, Lee SD. Review: conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008;65:379–436. doi: 10.1177/1077558708317802. [PubMed] [Cross Ref]
28. Hamilton AB, Cohen AN, Young AS. Organizational readiness in specialty mental health care. J Gen Intern Med. 2009;25(Suppl 1):27–31. [PMC free article] [PubMed]
29. Lehman W, Greener J, Simpson D. Assessing organizational readiness for change. J Subst Abus Treat. 2002;22:197–209. doi: 10.1016/S0740-5472(02)00233-7. [PubMed] [Cross Ref]
30. VHA Handbook 1160.01 Uniform Mental Health Services in VA Medical Centers and Clinics. Washington, DC: Department of Veterans Affairs: Office of Patient Care Services; 2008.
31. Rubenstein L, Meredith L, Parker L, et al. Impacts of evidence-based quality improvement on depression in primary care. J Gen Intern Med. 2006;21:1027–1035. doi: 10.1111/j.1525-1497.2006.00549.x. [PMC free article] [PubMed] [Cross Ref]
32. Rubenstein L, Chaney E, Ober S, et al. Using evidence-based quality improvement methods for translating depression collaborative care research into practice. Fam Syst Health. 2010;28:91–113. doi: 10.1037/a0020302. [PubMed] [Cross Ref]
33. Zanjani F, Miller B, Turiano N, Ross J, Oslin D. Effectiveness of telephone-based referral care management, a brief intervention to improve psychiatric treatment engagement. Psychiatr Serv. 2008;59:776–781. doi: 10.1176/appi.ps.59.7.776. [PubMed] [Cross Ref]
34. Oslin D, Ross J, Sayers S, Murphy J, Kane V, Katz I. Screening, assessment, and management of depression in VA primary care clinics: The Behavioral Health Laboratory. J Gen Intern Med. 2006;21:46–50. doi: 10.1111/j.1525-1497.2005.0267.x. [PMC free article] [PubMed] [Cross Ref]
35. Oslin D, Sayers S, Ross J, et al. Disease management for depression and at-risk drinking via telephone in an older population of veterans. Psychosom Med. 2003;65(6):931–937. doi: 10.1097/01.PSY.0000097335.35776.FB. [PubMed] [Cross Ref]
36. Liu C-F, Rubenstein LV, Kirchner JE, et al. Organizational cost of quality improvement for Depression Care. Heal Serv Res. 2009;44(1):225–244. doi: 10.1111/j.1475-6773.2008.00911.x. [PMC free article] [PubMed] [Cross Ref]
37. Rubenstein LV, Jackson-Triche M, Unutzer J, et al. Evidence-based care for depression in managed primary care practices. Heal Aff. 1999;18(5):89–105. doi: 10.1377/hlthaff.18.5.89. [PubMed] [Cross Ref]
38. Post EP, Kilbourne AM, Bremer RW, Solano FX, Jr, Pincus HA, Reynolds CF, III.Organizational factors and depression management in community-based primary care settings. Implement Sci. 2009;4:84. [PMC free article] [PubMed]
39. Tew J, Klaus J, Oslin D. The behavioral health laboratory: building a stronger foundation for the Patient-centered medical home. Fam Syst Health. 2010;28(2):130–145. doi: 10.1037/a0020249. [PubMed] [Cross Ref]
40. Thielke S, Vannoy S, Unutzer J. Integrating mental health and primary care. Prim Care Clin Office Pract. 2007;34:571–592. doi: 10.1016/j.pop.2007.05.007. [PubMed] [Cross Ref]
41. Bower P, Knowles S, Coventry PA, Rowland N.Counselling for mental health and psychosocial problems in primary care (Review). Cochrane Database of Syst Rev. 2011(9). [PubMed]
42. Krahn DD, Bartels SJ, Coakley E, et al. PRISM-E: comparison of integrated care and enhanced specialty referral models in depression outcomes. Psychiat Serv. 2006;57(7):946–953. doi: 10.1176/appi.ps.57.7.946. [PubMed] [Cross Ref]
43. Simpson D. A conceptual framework for transferring research to practice. J Subst Abus Treat. 2002;22:171–182. doi: 10.1016/S0740-5472(02)00231-3. [PubMed] [Cross Ref]
44. Rogers E. Diffusion of innovations. New York: The Free Press; 1995.
45. Yano E, Fleming B, Canelo, et al.National Survey Results for the Primary Care Director Module of the VHA Clinical Practice Organizational Survey. Sepulveda, CA: VA HSR&D Center for the Study of Healthcare Provider Behavior; 2008.
46. Chou A, Rose D, Farmer M, Canelo I, Rubenstein L, Yano E.Organizational Factors Affecting the Likelihood of CancerScreening among VA Patients. Paper presented at: 13th Annual Healthcare Organizational Research Association (HORA) ConferenceJune 2011; Seattle, WA.
47. Kline R. Principles and practice of structural equation modeling. New York: The Guilford Press; 2005.
48. Groves R, Fowler F, Jr, Couper M, Lepkowski J, Singer E, Tourangeau R. Survey methodology. 2. Hoboken: Wiley; 2009.
49. Area Resource File (ARF). Rockville, MD: US Department of Health and Human Services, Health Resources and Services Administration, Bureau of Health Professions; 2008.
50. Department of Veterans Affairs. Office of Academic Affiliations. http://www.va.gov/oaa/. Accessed Aug 21, 2012.
51. Agresti A, Franklin C. Statistics: The art and science of learning from data. Upper Saddle River: Pearson Prentice Hall; 2009.
52. Wagner E, Austin B, Davis C, Hindmarsh M, Schafer J, Bonomi A. Improving chronic illness care: translating evidence into action. Heal Aff. 2001;20(6):64–78. doi: 10.1377/hlthaff.20.6.64. [PubMed] [Cross Ref]
53. Improving Chronic Illness Care. 1996-2012; The MacColl Center. The Improving Chronic Illness Care program is supported by The Robert Wood Johnson Foundation, with direction and technical assistance provided by Group Health’s MacColl Center for Health Care Innovation. Available at: http://www.improvingchroniccare.org/. Accessed Aug 21, 2012.
54. Pomerantz A, Shiner B, Watts B, et al. The White River Model of colocated collaborative care. Fam Syst Health. 2010;28(2):114–129. doi: 10.1037/a0020261. [PubMed] [Cross Ref]
55. Pomerantz AS, Cole BH, Watts BV, Weeks WB. Improving efficiency and access to mental health care: combining integrated care and advanced clinical access. Gen Hosp Psychiat. 2008;30:546–551. doi: 10.1016/j.genhosppsych.2008.09.004. [PubMed] [Cross Ref]
56. Pomerantz A, Sayers S. Primary care-mental health integration in healthcare in the Department of Veterans Affairs. Fam Syst Health. 2010;28(2):78–82. doi: 10.1037/a0020341. [PubMed] [Cross Ref]
57. Watts B, Shiner B, Pomerantz A, Stender P, Weeks W. Outcomes of a quality improvement project integrating mental health into primary care. Qual Saf Health Care. 2007;16:378–381. doi: 10.1136/qshc.2007.022418. [PMC free article] [PubMed] [Cross Ref]
58. Parker V, Wubbenhorst W, Young G, Desai KR, Charns MP. Implementing quality improvement in hospitals: the role of leadership and culture. Am J Med Qual. 1999;14:64–69. doi: 10.1177/106286069901400109. [PubMed] [Cross Ref]
59. Hemmelgarn A, Glisson C, James L. Organizational culture and climate: implications for services and interventions research. Clin Psychol Sci Pract. 2006;13(1):73–89. doi: 10.1111/j.1468-2850.2006.00008.x. [Cross Ref]
60. Shortell S, O’Brien J, Carman J, et al. Assessing the impact of continuous quality improvement/total quality management: concept vs implementation. Heal Serv Res. 1995;30(2):377–401. [PMC free article] [PubMed]
61. Collaborative Care for Depression in the Primary Care Setting: a primer on VA’s Translating Initiatives for Depression into Effective Solutions (TIDES) Project. In: VA Health Services Research and Development Service, Office of Research and Development, Dept of Veterans Affairs, ed. Washington, DC 2008.

Articles from Journal of General Internal Medicine are provided here courtesy of Society of General Internal Medicine