PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of bmchsrBioMed Centralsearchsubmit a manuscriptregisterthis articleBMC Health Services Research
 
BMC Health Serv Res. 2017; 17: 230.
Published online 2017 March 23. doi:  10.1186/s12913-017-2170-y
PMCID: PMC5364669

A structural model of treatment program and individual counselor leadership in innovation transfer

Abstract

Background

A number of program-level and counselor-level factors are known to impact the adoption of treatment innovations. While program leadership is considered a primary factor, the importance of leadership among clinical staff to innovation transfer is less known. Objectives included explore (1) the influence of two leadership roles, program director and individual counselor, on recent training activity and (2) the relationship of counselor attributes on training endorsement.

Methods

The sample included 301 clinical staff in 49 treatment programs. A structural equation model was evaluated for key hypothesized relationships between exogenous and endogenous variables related to the two leadership roles.

Results

The importance of organizational leadership, climate, and counselor attributes (particularly counseling innovation interest and influence) to recent training activity was supported. In a subset of 68 counselors who attended a developer-led training on a new intervention, it was found that training endorsement was higher among those with high innovation interest and influence.

Conclusions

The findings suggest that each leadership level impacts the organization in different ways, yet both can promote or impede technology transfer.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-017-2170-y) contains supplementary material, which is available to authorized users.

Keywords: Innovation transfer, Leadership, Staff attributes, Change agents, Drug treatment programs

Background

Because each organizational environment represents a complex human activity system that directly impacts technology/innovation transfer, studies of innovation transfer within drug treatment programs can benefit from understanding its organizational factors [1]. Organizational [2, 3], systemic (e.g., workplace stress perceptions), and idiographic variables (e.g., longer service tenure [4]) have been shown to predict implementation and adoption attitudes.

Many frameworks and models have been proposed for understanding this issue [510]. One literature review of 81 studies on quantitative and qualitative factors affecting implementation [11] identified five essential areas (innovations, providers, communities, organizational capacity, training/technical assistance) with conclusions summarized in a hierarchical framework consisting of three nested ovals. Adaptability of the innovation in the proposed environment is central among innovation characteristics addressed in the innermost oval [7, 11] where implementation is hypothesized to be a function of organizational capacity (e.g., leadership, a program champion/internal advocate, managerial/supervisory support) and training/technical assistance. The middle oval encompassed provider characteristics (e.g., perceived need and perceived benefits of the innovation, self-efficacy, and skill proficiency for the innovation). The outer oval consists of community factors (e.g., funding, community readiness for change). The emphasis on training and technical assistance as central to improvement efforts is one of the review’s important contributions.

Factors affecting organizational capacity include a positive work climate, organizational norms regarding change, new programming integration, and shared vision, while social context/work environment perceptions affect not only technical assistance usage [5, 8, 12, 13] but also adoption, implementation, sustainment and effectiveness [8]. Another relevant organizational process factor is absorptive capacity [14]. This addresses access and ability to use information effectively by the organization [15, 16]. It is enhanced by a professional workforce, engagement in environmental scanning (i.e., identification of training and professional development opportunities), and satisfaction data from the organization’s buyers and suppliers. Moreover, identification of individuals who serve as “information brokers” can enhance absorptive capacity.

While physical and perceived program resources have been shown to affect training exposure and utilization [17], it is program leadership that is considered the primary factor, as it affects the entire organizational environment and is instrumental in adoption decisions [18]. Strong leadership is particularly important to organizational climate in times of system and organizational change [19] by making the climate more open to change and by empowering staff to be participants in change [20]. Delegation of authority to competent people is important [21], for they can serve as effective change agents through working/bonding with treatment teams, administrators, key opinion leaders, and community stakeholders [6, 8, 22]. Valued characteristics for internal change agents include self-efficacy [2325] and adaptability [9, 26].

Similarly, interest in innovations and influence with other staff are likely important attributes [27, 28], as are growth, efficacy, influence, and adaptability. Being employed in organizational climates conducive to change (i.e., higher mission, cohesiveness, autonomy, communication, and openness to change, but lower stress) have been found to have more favorable attitudes about innovation training and its adoption [28]. Professional growth and influence predicts openness to the use of medications [27] while staff adaptability and influence significantly predicts opinions toward treatment manuals and integrated mental health services [27]. Thus, implementation of new practices is influenced directly by program leadership’s adoption decisions and indirectly through leadership’s shaping of the organizational climate, task delegation, and selection of change agents [1, 20].

Current study model

Of the many factors that have been proposed for better understanding innovation transfer, increased insight into the interrelationships among program leadership, organizational climate, and change agents would seem to be critical. Furthering knowledge about these change agents to whom transfer tasks are delegated with regard to what might be potential effective characteristics and their relationship to program leadership and climate is an area that requires additional study. For the current study, the proposed interrelationships of selected factors related to this concept are examined simultaneously in an implementation model for drug treatment innovations. The interrelated roles among program leadership, organizational environment, counselor leadership, and the clinical staff attributes are conceptualized in the path model presented in Fig. 1 and summarized by the hypotheses below. Principal are the effects of two leadership paths (director and staff).

Fig. 1
Conceptual model of counseling innovation interest on training participation and endorsements

Hypotheses

  1. Director Leadership will have direct effects on Organizational Climate (OC).
  2. Director Leadership will have an indirect positive relationship with Counseling Innovation Interest (CII) through its relationships with OC and Counselor Efficacy, which has a direct positive relationship with CII.
  3. Counselor Adaptability will have both direct and indirect (through Counselor Efficacy) positive relationships with CII.
  4. CII will be positively related to Counselor Influence and participation in recent trainings.
  5. Counselor Influence will moderate the relationship between CII and subsequent endorsements of innovation adoption following training.

Methods

Procedure

Data were collected in 2013 as part of the Treatment Readiness and Induction Program (TRIP) project funded by the National Institute on Drug Abuse (NIDA), National Institutes of Health (NIH), and Department of Health and Human Services. The project was structured as 2 phases. Effectiveness was examined in Phase 1 [29, 30]. Phase 2 examined implementation of TRIP in multiple juvenile-justice and community-based sites in the United States.

The current study is based on the phase 2 data. Regional Addiction Technology Transfer Centers (ATTCs), which are responsible for providing training and technical assistance to agencies and their staffs on best practices for substance use, assisted with program recruitment. With the help of four ATTCs (Great Lakes, South Southwest, Pacific Southwest, and Northeast and Caribbean), the implementation sample included 312 counselors from 52 adolescent treatment facilities located in 12 US states. Institutional Review Boards (IRBs) for the research center and treatment programs reviewed and approved study protocols.

Data collection procedures consisted of (a) pre-training survey of the organization (completed by director or director’s designee), (b) pre-training survey of counseling staff, (c) survey at the conclusion of the training by “trainees,” and (d) follow-up counseling staff survey at 4 months after the training.

Pre-training data were collected from February to July 2013. About 1–2 months prior to the training workshop, all counseling staff at the participating facilities with direct client contact (counselors, social workers, case managers, clinical supervisors, and therapists) were provided with information describing the study and informed consent was obtained. Participants were asked to complete the TCU Survey of Organizational Functioning and Leadership (SOFL; [31]), which as noted by Broome and his colleagues is the TCU Survey of Organizational Functioning (SOF) and 4 subscales (Encourages Innovation, Inspirational Motivation, Develops Others, Task Delegation) from the Survey of Transformational Leadership instrument [32]. The SOFL scales covered organizational climate, staff attributes, motivation for change, resources, job attitudes, workplace practices, transformational leadership, and training exposure and utilization. Additionally, one month prior to the training, the program director (or program designee) completed the TCU Survey of Structure and Operations (SSO) [33], which included organizational level information.

Approximately 1 month after staff surveys were administered, 1–2 clinical staff at each participating program were chosen by its program director to attend a 2-day developer-led workshop on use of the TRIP curriculum and serve as trainers. At the conclusion of the 2-day workshop (approximately 13 h), participants received a survey consent form and were asked to complete a 30-min TCU Workshop Evaluation Form (WEVAL) [34] addressing satisfaction with the workshop/materials, perceived adequacy of resources, training, and support for implementing TRIP at their treatment program. These data were collected anonymously onsite by research staff.

Participant samples

Two samples were examined in the current study: (a) counseling staff who completed the SOFL at Time 1 (used to examine the structural model), and (b) counseling staff trainees (used to examine the interaction of counselor innovation interest with attitudes on subsequent endorsement of TRIP). There were 312 counselors from 52 programs who completed the SOFL. Because of missing data on analysis variables, 11 staff representing 3 facilities were omitted. From the SSO, the counselors were classified into 6 treatment modality groups: secure juvenile justice settings (SJJ), residential or modified therapeutic community with 60% or more juvenile justice clients (R/TC + 60), other residential or modified therapeutic community (R/TC-60), outpatient with 60% or more juvenile justice clients (OP + 60), other outpatient (OP-60), or both outpatient and residential/modified therapeutic community (OP/TC). This was done to adjust for possible modality differences that might affect the results. The final sample for examining the structural model (hypotheses 1–4) included 301 clinical staff, representing 49 facilities (7 SJJ, 7 R/TC + 60, 13 R/TC-60, 5 OP + 60, 12 OP-60, and 5 OP/TC).

There were 75 counselors from 47 treatment programs who attended TRIP training and completed the WEVAL [34]. Of these clinical trainees, 68 had data on the WEVAL scales and the SOFL measure on counselor innovation interest that were used for examining post-training attitudes in hypothesis 5. They represented 43 treatment facilities [7 SJJ: 12 staff; 6 R/TC + 60: 10 staff; 9 R/TC-60: 12 staff; 11 OP-60: 19 staff; 5 OP + 60: 9 staff; 5 OP/TC: 6 staff]. Table 1 presents background information on both the sample used for the structural model and the subsample of clinical trainees. The table suggests there are similarities between the two samples. In both samples, the average age was approximately 41, the percentage of females was nearly two-thirds, Whites comprised a majority (although a smaller percentage in the TRIP training sample), and as expected, a majority had a bachelor’s degree or higher.

Table 1
Background characteristics of structural equation model and TRIP training samples

Measures

Organizational climate, staff attributes, and director leadership

The SOFL [31, 32] is a 165-item instrument. The SOFL includes the TCU Organizational Readiness for Change (ORC) instrument, which measures 18 dimensions covering four major areas: Program Needs/Pressures, Program Resources, Staff Attributes, and Organizational Climate [35]. The background and development of these scales have been discussed previously, emphasizing their intended link to organizational change [35]. In addition to the ORC, the SOFL includes 8 additional scales covering workplace practices and job attitudes as well as 4 scales from the TCU Survey of Transformational Leadership (STL) instrument: encourages innovation, inspirational motivation, develops others, and task delegation [32]. Each item was rated on a 5-point Likert scale [1 = disagree strongly, 2 = disagree, 3 = uncertain, 4 = agree, 5 = agree strongly; 32, 31]. In computing the scale scores, the responses on the items for a scale are averaged and then multiplied by 10. The present study uses items from the staff attributes, organizational climate, and transformational leadership scales to address the hypotheses. These scales are listed in Table 2.

Table 2
Scales and sample items included in estimated structural model

Recent training activity

Three items from the SOFL Training Exposure index addressed “active participation in training in last 6 months.” These included “learned new skills or techniques at a professional conference,” “how often attended training workshop within 50 miles,” and “how often attended training workshop over 50 miles.” The first item using the 5-point response format (disagree strongly/agree strongly) was dichotomized (disagree strongly, disagree, or uncertain = 0, agree or agree strongly = 1). The latter two items had a 5-point response format (1 = none, 2 = 1, 3 = 2, 4 = 3, and 5 = 4 or more) and they were also dichotomized (“none” = 0 or “at least 1” =1). This 3-item index had a coefficient alpha of .59.

Counseling innovation interest (CII)

This scale, counseling innovation interest, addressed both seeking professional growth and “openness to using new counseling technology” [36]. As an expression of innovation interest, it includes previous staff attendance at workshops [36] and growth-related personal activities, including willingness to try new therapeutic approaches [20]. This measure taps “leadership initiative” among counseling staff, paralleling the organizational absorptive capacity (identification of training and professional development ideas) at the individual level measure and may be indicative of an individual’s potential as an internal agent of change within the organization. It is hypothesized to serve as a mediator between counselor attributes (efficacy and adaptability) and indicators of implementation (e.g., positive training endorsement, adoption, use of new practices). The CII measure was created using 9 items (see Table 2) from the SOFL including reading about new treatment techniques, updating skills, and willingness to try new therapeutic approaches.

Training endorsements

The TCU Workshop Evaluation Form for TRIP Training (WEVAL) [34] consists of 42 items with a 5-point Likert response scale (1 = Disagree Strongly, 2 = Disagree, 3 = Uncertain, 4 = Agree, and 5 = Agree Strongly). Five scales (Table 3) were used and they addressed staff attitudes toward using TRIP within their treatment setting: Acceptability, Appropriateness, Adoption Expectation, Preparation Adequacy, and Leadership Engagement. Scores for each scale were calculated by averaging responses to its set of items and multiplying by 10.

Table 3
Scales and items from the TCU Workshop Evaluation Form (WEVAL)

Analytic plan

In order to account for treatment modality differences, a within-modality covariance matrix was used for the analysis of the structural model. This estimated matrix represents the covariance matrix common to the treatment modalities. It was obtained from SAS PROC DISCRIM [37], and the structural equation model was tested using SAS PROC CALIS [37]. Goodness-of-fit χ 2, normed χ 2, root mean square error of approximation (RMSEA), standardized root mean square residual (SRMSR), comparative fit index (CFI), and Normed fit index (NFI) were used to assess the fit of the model to the data. For goodness-of-fit χ 2, RMSEA, and SRMSR, smaller values indicate better fits. Because the goodness of fit χ 2 may be sensitive to sample sizes larger than 200, the normed χ 2 (χ 2 divided by its degrees of freedom) is considered a better χ 2 indicator of fit; that is, when less than 3.84 [38]. For RMSEA, values of .01, .05, and .08 indicate excellent, good, and mediocre fit, respectively [39]. For SRMSR, a value less than .08 is considered a good fit [40]. The CFI ranges from 0 to 1, with values above 0.9 indicating reasonable fit. For NFI, values of .90 to .95 reflect a good model fit. For hypothesis 5, SAS PROC GLM was used to address endorsement in terms of CII and Influence.

Results

Hypotheses 1–4: model for counseling innovation interest (CII)

Initial model

The initial structural model examined the first 4 hypotheses of the conceptual model outlined in Fig. 1 and was based on the sample of 301 counselors. While all estimated paths were significant, with the exception of the path from CII to Influence, this “basic model” (Time 1 measures only; excluding Training Endorsements and Future Implementation) had relatively “poor fit-statistics” [χ 2(11) = 44.6993, p < .0001; normed χ 2 = 4.06; RMSEA = .102; SRMSR = .072; CFI = .94; NFI = .92].

Revised model

An examination of the Lagrange Multiplier test indices suggested two modifications: a path from Counselor Adaptability to Counselor Influence and a path from Director Leadership to Recent Training Activity. These modifications were made, as well as the deletion of the path from CII to Influence, and this revised model was re-estimated. Results indicated a “good fit” since its RMSEA was under .05. All other fit criteria were also improved [χ 2(10) = 16.2064, p < .0939; normed χ 2 = 1.62; RMSEA = .046 (.000, .085); SRMSR = .044; CFI = .99; NFI = .97], and all hypothesized paths were significant at p < .01 or less. This final model is displayed in Fig. 2.

Fig. 2
Estimated structural model for leadership, climate, staff attributes, counseling innovation interest, and training activity relationships

The significant paths (standardized) were from Director Leadership to Organizational Climate (b = .67, se = .03, t = 20.84, p < .0001) and to Recent Training Activity (b = .17, se = .05, t = 3.21, p < .0013). From Counselor Adaptability there were significant paths to Counselor Efficacy (b = .53, se = .04, t = 13.01, p < .0001), CII (b = .18, se = .06, t = 3.13, p < .002), and Counselor Influence (b = .27, se = .06, t = 4.78, p < .0001). Organizational Climate had a significant path to Counselor Efficacy (b = .19, se = .05, t = 3.99, p < .0001). Counselor Efficacy had significant paths to CII (b = .42, se = .05, t = 7.68, p < .0001) and Counselor Influence (b = .32, se = .06, t = 5.71, p < .0001). CII had a significant path to Recent Training Activity (b = .30, se = .05, t = 5.86, p < .0001). Counselor Influence was significantly correlated with Training Activity (r = .13, se = .05 t = 2.90, p < .004).

Results suggested that both Counselor Efficacy and CII are pivotal endogenous variables. Counselor Efficacy carried an indirect path to CII and Counselor Influence through its relationship with Organizational Climate and Counselor Adaptability. CII was a key predictor of Recent Training Activity in the model but not Counselor Influence. The R2 values (which represent the proportions of variance that the predictors account for in each endogenous variable) ranged from .13 (Recent Training Activity) to .45 (Organizational Climate). The R2 for the two key endogenous variables (Counselor Efficacy and CII) were .34 and .30, respectively, indicating these two variables had fairly large percentages of variance being accounted for.

Hypothesis 5: effects of CII and counselor influence on training endorsement

While a fairly large sample was available to test the structural model, only the subset of 68 counselors selected to attend training on implementing TRIP were available to address endorsement. This subsample therefore does not represent a random sample of the total as they were selected by their treatment sites to attend the training. It might be expected that these counselors would be higher on some of the characteristics that are considered important in technology transfer compared to the remaining sample.

Indeed, it was found that the subsample was significantly higher on Counselor Influence [TRIP Training: mean = 40.0 (SD = 5.8); non-TRIP Training: mean = 36.8 (SD = 6.9), t = 3.36, p < .0009] and on Counselor Adaptability [TRIP Training: mean = 41.3 (SD = 4.4); non-TRIP Training: mean = 39.8 (SD = 5.3), t = 2.00, p < .046]. However, the two samples were not significantly different on Counselor Efficacy, Organizational Climate, Director Leadership, CII, or Recent Training Activity.

Even though the trainees were found to be higher on some of the characteristics that are considered important in technology transfer (Counselor Influence, Counselor Adaptability), it was expected that attribute variations existed within this trainee subsample and that level of counselor influence would moderate the relationship between CII and endorsement of innovation adoption. To display the relationships between training endorsement measures with Influence and CII (hypothesis 5), both Influence and CII were dichotomized at 35 or higher (agreement range) versus lower than 35 (disagreement range).

Of the four quadrants produced by these two dichotomous variables (high CII and high Influence; high CII but low Influence; low CII but high Influence; low CII and low Influence), two quadrants contained very few individuals [4 in the “both low” quadrant (5.9% of total); 6 in the high CII but low Counselor Influence quadrant (8.8% of total)]. Therefore, to test the “interaction hypothesis,” the individuals who possessed both high CII and Counselor Influence (n = 32) were compared with all other individuals (n = 36). It was hypothesized that the group who had high scores on both measures would show significantly greater workshop endorsements relating to Acceptability of workshop training, Appropriateness of TRIP for their setting, Adoption Expectations, and Preparation Adequacy. As shown in Fig. 3, the high CII-Influence group had significantly higher means than the remainder group for Acceptability {(43.1 vs. 41.1); [F(1, 66) = 7.26, p < .01, η2 = .10, ES = .33]}, Adoption Expectation {(47.8 vs. 43.1); [F(1, 66) = 10.95, p < .0009, η2 = .14, ES = .40]}, and Preparation Adequacy {(43.4 vs. 41.3); [F(1, 67) = 4.33, p < .041, η2 = .06, ES = .25]}. The two groups were not significantly different on Leadership Engagement {(38.9 vs. 38.4); [F(1, 66) = .21, p < .65, η2 = .00, ES = .00]} or Appropriateness {(43.1 vs. 41.5); [F(1, 67) = 2.25, p < .14, η2 = .03, ES = .18]}. The significant findings were associated with medium to large effect sizes [41].

Fig. 3
Future training (WEVAL) outcomes by CII and influence groups

Discussion

The present work is an exploratory study examining how “leadership” is important to the facilitation of implementation. It extends the work of Becan and colleagues [20] by conceptualizing change-oriented staff attributes (efficacy, adaptability, influence and professional growth) as “opinion leadership” and modeling the interrelationships of program leadership, organizational climate, opinion leadership and participation in recent trainings.

Two avenues of leadership and their potential effects on technology transfer were explored. The first was that overall leadership (represented by the director of the drug treatment organization) can affect implementation by instilling an organizational climate favorable to innovation adoption. The second was “opinion leadership” [6] among some counselors, as represented by an interest in innovation adoption and who have influence among co-workers within the organization. These counselors might serve as change agents, especially if they are delegated with some responsibility for orchestrating the new service implementation, and they might be candidates to become trainers in the train-the-trainer model for innovation implementation [4245].

In summary, there were two key exogenous variables (variables not predicted by any other variable in the model) and five key endogenous variables (variables predicted by a variable in the model). The exogenous variables – Director Leadership and Counselor Adaptability – had significant paths to CII, either indirectly (Director Leadership) or directly (Counselor Adaptability). Director leadership had a pervasive relationship on all of the endogenous variables through its path to the organizational climate of the treatment program. Counselor Adaptability was related to multiple variables in the model directly, including perceptions of Counselor Efficacy, CII, and Counselor Influence. The relationship of Counselor Adaptability to Counselor Efficacy was stronger than Organizational Climate to Counselor Efficacy.

These findings corroborate previous work documenting the cascading effect that director leadership has on the organizational environment and subsequently on counseling staff attributes [20]. The findings also support the importance of both program leadership and organizational environment in implementing change [2, 14, 46].

While the present results were promising, they are not definitive, as the model data were limited and collected in a single instrument. Therefore, the results only confirm that the paths for the constructs are consistent with their hypothesized relationships but not evidence for causality. That would require additional data collection and testing. Nevertheless, the study does provide evidence that leadership both at the management level and at the staff level deserve further consideration in implementation efforts. The delegation of implementation activities to key staff who have an “aptitude” (e.g., innovation interest, efficacy, adaptability, and influence) for assisting in implementation, and who can serve as a “champion of the innovation” among staff, is believed to be critical to success. The results are consistent with previous research that show unique connections between director leadership, climate, and staff level leadership attributes, and contribute to previous work showing organizational climate as a mediator of the relationship between leadership and staff turnover intentions and turnover [19].

The second analysis addressed counselor-level leadership (high counseling innovation interest and individual influence) effects on endorsement attitudes toward treatment innovations. While this subsample reported higher Counselor Influence and Counselor Adaptability compared to the total sample, reported differences in training endorsement were detected. The results support the idea that counselors who pursue clinical skills development and who have influence among other staff are likely to have a skill set that positions them to champion change in their organization [2]. Future studies are needed to examine the process by which the combined effect of strong program leadership and the presence of change agents (staff that avidly pursue clinical skill development and influence coworkers in the use of new innovations) can together promote the uptake of innovations among staff within their agency.

While there are several strengths of this study, including the potential to generalize these findings to a wide variety of adolescent treatment settings, limitations should be acknowledged. First, data for the estimated model are cross-sectional, thereby eliminating the possibility to examine causality. Second, the sample to evaluate the effect of counselor innovation interest and influence among coworkers on innovation endorsement was small. Third, the examination of this combined effect was conducted on a specific innovation, which limits generalizability to other innovations.

Conclusions

Leadership at the helm as well as within the ranks are important factors in technology transfer. Directors that involve staff in decision making and who delegate implementation tasks could bolster staff adaptability and self-identified influential staff. Key people leading change, supportive organizational culture, a positive pattern of managerial and clinical relations, and match between the core mechanisms of the innovation with the change agenda are important to successful change [47]. Absence of leadership at either level is a barrier to innovation adoption.

As noted by Flynn and Brown [48, 49], the knowledge base for guiding adoption and implementation of evidence-based practices (EBP) in the drug use treatment field is still modest. Treatment program resources are often limited, and programs are not likely to undertake change by themselves or allocate resources for an external change agent to guide implementation. Therefore, using internal personnel with “innovation leadership attributes” can help minimize costs associated with system change by serving as a resource in assisting implementation of certain manual-driven EBPs.

Acknowledgements

The authors would like to acknowledge the Great Lakes, Pacific Southwest, Northeast and Caribbean, and South Southwest ATTCs for their assistance with recruitment and training for the TCU Adolescent Project Implementation Study. We would also like to thank individuals from the participating programs (administrators and clinical staff) who participated in the assessments and training, and implemented the curriculum protocols with fidelity.

Funding

This work was funded by the National Institute on Drug Abuse (NIDA; Grant R01DA013093). The interpretations and conclusions, however, do not necessarily represent the position of the NIDA, National Institutes of Health, or Department of Health and Human Services.

Availability of data and materials

The datasets supporting the conclusions of this article are included as Additional file 1.

Authors’ contributions

GJ developed the initial conceptual model and performed the analyses. All authors (GJ, JB, DK, and PF) helped in writing the manuscript and in the revisions to the model and manuscript. All authors read and approved the manuscript.

Competing interests

The authors declare that they have no competing interests.

The authors report no conflicts of interest and the authors report no relevant financial conflicts. The authors alone are responsible for the content and writing of the article.

Consent for publication

Not applicable. The manuscript does not contain any individual person’s identifiable data.

Ethics approval and consent to participate

The Texas Christian University Institutional Review Board reviewed and approved the study protocol (S13-123-1603CR). The Texas Christian University Institutional Review Board approval number for the Implementation Phase was S12-41. The Institutional Review Boards (IRBs) for the treatment programs also reviewed and approved the study protocols. All counseling staff at the participating facilities with direct client contact (counselors, social workers, case managers, clinical supervisors, and therapists) were provided with information describing the study and informed consent was obtained.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Abbreviations

ATTC
Addiction Technology Transfer Centers
CFI
Comparative fit index
CII
Counseling innovation interest
EBP
Evidence-based practices
IRB
Institutional Review Board
NFI
Normed fit index
NIDA
National Institute on Drug Abuse
NIH
National Institutes of Health
OC
Organizational Climate
ORC
Organizational Readiness for Change
RMSEA
Root mean square error of approximation
SJJ
Secure juvenile justice
SOF
Survey of Organizational Functioning
SOFL
Survey of Organizational Functioning and Leadership
SRMSR
Standardized root mean square residual
SSO
Survey of Structure and Operations
STL
Survey of Transformational Leadership
TRIP
Treatment Readiness and Induction Program
WEVAL
Workshop Evaluation Form

Additional file

Additional file 1:(124K, doc)

Within groups covariance matrix used in modeling. Raw Data for subsample of counselors who did training. (DOC 123 kb)

Contributor Information

George W. Joe, Phone: 817-257-7226, ude.uct@eoj.g, http://www.ibr.tcu.edu.

Jennifer E. Becan, ude.uct@naceb.j.

Danica K. Knight, ude.uct@thgink.d.

Patrick M. Flynn, ude.uct@rbi.

References

1. Flynn PM, Knight DK, Godley MD, Knudsen HK. (Guest Eds.). Organizational dynamics within substance abuse treatment. J Subst Abuse Treat. 2012;42(2):109–230. [PubMed]
2. Redfern S, Christian S. Achieving change in health care practice. J Eval Clin Pract. 2003;9(2):225–38. doi: 10.1046/j.1365-2753.2003.00373.x. [PubMed] [Cross Ref]
3. Yano EM. The role of organizational research in implementing evidence-based practice: QUERI Series. Implemen Sci. 2008;3:29. doi: 10.1186/1748-5908-3-29. [PMC free article] [PubMed] [Cross Ref]
4. Hartzler B, Donovan DM, Tillotson CJ, Mongoue-Tchokote S, Doyle SR, McCarty D. A multilevel approach to predicting community addiction treatment attitudes about contingency management. J Subst Abuse Treat. 2012;42(2):213–21. doi: 10.1016/j.jsat.2011.10.012. [PMC free article] [PubMed] [Cross Ref]
5. Rogers EM. Diffusion of innovations. 4. New York: The Free Press; 1995.
6. Rogers EM. Diffusion of innovations. 5. New York: The Free Press; 2003.
7. Damschroder LJ, Hagedorn HJ. A guiding framework and approach for implementation research in substance use disorders treatment. Psychol Addict Behav. 2011;25(2):194–205. doi: 10.1037/a0022284. [PubMed] [Cross Ref]
8. Hemmelgarn AL, Glisson C, James LR. Organizational culture and climate: implications for services and intervention research. Clin Psych: Sci Pract. 2006;13(1):73–89.
9. Simpson DD, Flynn PM. Moving innovations into treatment: a stage-based approach to program change. J Subst Abuse Treat. 2007;33(2):111–20. doi: 10.1016/j.jsat.2006.12.023. [PMC free article] [PubMed] [Cross Ref]
10. Simpson DD. Organizational readiness for stage-based dynamics of innovation implementation. Res Soc Work Pract. 2009;19(5):541–51. doi: 10.1177/1049731509335589. [Cross Ref]
11. Durlak JA, DuPre EP. Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50. doi: 10.1007/s10464-008-9165-0. [PubMed] [Cross Ref]
12. Nadler DA, Tushman ML. A diagnostic model for organizational behavior. In: Hackman JR, Lawler EE III, Porter LW, editors. Perspectives on behavior in organizations. New York: McGraw Hill; 1977.
13. Rousseau DM. Technological differences in job characteristics, employee satisfaction and motivation: a synthesis job design research and sociotechnical systems theory. Organizational Behav Human Perf. 1977;19:18–42. doi: 10.1016/0030-5073(77)90052-6. [Cross Ref]
14. Knudsen HK, Roman PM. Modeling the use of innovations in private treatment organizations: the role of absorptive capacity. J Subst Abuse Treat. 2004;26(1):353–61. doi: 10.1016/S0740-5472(03)00158-2. [PubMed] [Cross Ref]
15. Cohen WW, Levinthal DA. Absorptive capacity: a new perspective on learning and innovation. Administrative Sci Qrtly. 1990;35:128–52. doi: 10.2307/2393553. [Cross Ref]
16. Zahra S, George G. Absorptive capacity: a review, reconceptualization, and extension. Acad Manage Rev. 2002;27:185–203.
17. Lehman WEK, Becan JE, Joe GW, Knight DK, Flynn PM. Resources and training in outpatient substance abuse treatment facilities. J Subst Abuse Treat. 2012;42(2):169–78. doi: 10.1016/j.jsat.2011.10.018. [PMC free article] [PubMed] [Cross Ref]
18. Flynn PM, Simpson DD. Adoption and implementation of evidence-based treatment. In: Miller PM, editor. Evidence-based addiction treatment. San Diego: Elsevier; 2009. pp. 419–37.
19. Aarons GA, Sommerfeld DH, Willging CE. The soft underbelly of system change: the role of leadership and organizational climate in turnover during statewide behavioral health reform. Psychol Services. 2011;8:269–81. doi: 10.1037/a0026196. [PMC free article] [PubMed] [Cross Ref]
20. Becan JE, Knight DK, Flynn PM. Innovation and adoption as facilitated by a change-oriented workplace. J Subst Abuse Treat. 2012;42(2):179–90. doi: 10.1016/j.jsat.2011.10.014. [PMC free article] [PubMed] [Cross Ref]
21. Martin TN, Huq Z. Realigning top management's strategic change actions for ERP implementation: how specializing on just cultural and environmental contextual factors could improve success. J Change Mgmt. 2007;7(2):121–47. doi: 10.1080/14697010701531749. [Cross Ref]
22. Evans R, Murphy S, Scourfield J. Implementation of a school-based social and emotional learning intervention: understanding diffusion processes within complex systems. Prev Sci. 2015;16(5):754–64. doi: 10.1007/s11121-015-0552-0. [PMC free article] [PubMed] [Cross Ref]
23. Bandura A. Social foundations of thought and action: a social cognitive theory. Englewood: Prentice-Hall; 1986.
24. Benerth J. Expanding our understanding of the change message. Human Resource Develop Rev. 2004;3(1):36–52. doi: 10.1177/1534484303261230. [Cross Ref]
25. Neves P. Readiness for change: contributions for employee's level of individual change and turnover intentions. J Change Mgmt. 2009;9(2):215–31. doi: 10.1080/14697010902879178. [Cross Ref]
26. McGovern M, Fox T, Xie H, Drake R. A survey of clinical practices and readiness to adopt evidence-based practices: dissemination research in an addiction treatment system. J Subst Abuse Treat. 2004;26:305–12. doi: 10.1016/j.jsat.2004.03.003. [PubMed] [Cross Ref]
27. Fuller BE, Rieckmann T, Nunes EV, Miller M, Arfken C, Edmundson E, et al. Organizational Readiness for Change and opinions toward treatment innovations. J Subst Abuse Treat. 2007;33(2):183–92. doi: 10.1016/j.jsat.2006.12.026. [PMC free article] [PubMed] [Cross Ref]
28. Joe GW, Broome KM, Simpson DD, Rowan-Szal GA. Counselor perceptions of organizational factors and innovations training experiences. J Subst Abuse Treat. 2007;33(2):171–82. doi: 10.1016/j.jsat.2006.12.027. [PMC free article] [PubMed] [Cross Ref]
29. Becan JE, Knight DK, Crawley RD, Joe GW, Flynn PM. Effectiveness of the Treatment Readiness and Induction Program for increasing adolescent motivation for change. J Subst Abuse Treat. 2015;50:38–49. doi: 10.1016/j.jsat.2014.10.002. [PMC free article] [PubMed] [Cross Ref]
30. Dansereau DF, Knight DK, Flynn PM. Improving adolescent judgment and decision making. Prof Psychol: Res Pract. 2013;44(4):274–82. doi: 10.1037/a0032495. [PMC free article] [PubMed] [Cross Ref]
31. Broome KM, Knight DK, Edwards JR, Flynn PM. Leadership, burnout, and job satisfaction in outpatient drug-free treatment programs. J Subst Abuse Treat. 2009;37:160–70. doi: 10.1016/j.jsat.2008.12.002. [PMC free article] [PubMed] [Cross Ref]
32. Edwards JR, Knight DK, Broome KM, Flynn PM. The development and validation of a Transformational Leadership Survey for substance use treatment programs. Subst Use Misuse. 2010;45:1279–302. doi: 10.3109/10826081003682834. [PMC free article] [PubMed] [Cross Ref]
33. Knight DK, Broome KM, Simpson DD, Flynn PM. Program structure and counselor-client contact in outpatient substance abuse treatment. Health Serv Res. 2008;43(2):616–34. doi: 10.1111/j.1475-6773.2007.00778.x. [PMC free article] [PubMed] [Cross Ref]
34. Bartholomew NG, Joe GW, Rowan-Szal GA, Simpson DD. Counselor assessments of training and adoption barriers. J Subst Abuse Treat. 2007;33(2):193–9. doi: 10.1016/j.jsat.2007.01.005. [PMC free article] [PubMed] [Cross Ref]
35. Lehman WEK, Greener JM, Simpson DD. Assessing organizational readiness for change. J Subst Abuse Treat. 2002;22(4):197–209. doi: 10.1016/S0740-5472(02)00233-7. [PubMed] [Cross Ref]
36. Aarons GA. Mental health provider attributes toward adoption of evidence-based practices: the Evidence-Based Practice Attitude Scale (EBPAS) Ment Hlth Services Res. 2004;6:61–74. doi: 10.1023/B:MHSR.0000024351.12294.65. [PMC free article] [PubMed] [Cross Ref]
37. SAS Institute Inc . SAS/STAT® 9.2 user’s guide. Cary: SAS Institute Inc; 2008.
38. Schumacker RE, Lomax RG. A beginner's guide to structural equation modeling. 3. New York: Routledge; 2010.
39. MacCallum RC, Browne MW, Sugawara HM. Power analysis and determination of sample size for covariance structure modeling. Psychol Methods. 1996;1:130–49. doi: 10.1037/1082-989X.1.2.130. [Cross Ref]
40. Hu L, Bentler PM. Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychol Methods. 1998;3:424–53. doi: 10.1037/1082-989X.3.4.424. [Cross Ref]
41. Cohen J. Statistical power analysis for the behavioral sciences. 2. Hillsdale: Lawrence Erlbaum; 1988.
42. Mandel-Ricci J, Bresnahan M, Sacks R, Farley SM. Training mental health professionals to treat tobacco dependence. Psychiatric Services. 2013;64(5):497. doi: 10.1176/appi.ps.004362012. [PubMed] [Cross Ref]
43. Riches VC, Harman AD, Keen D, Pennell D, Harley JH, Walker M. Transforming staff practice through active support. J Intellectual Develop Disability. 2011;36(3):156–66. doi: 10.3109/13668250.2011.598499. [PubMed] [Cross Ref]
44. Segre LS, Brock RL, O'Hara MW, Gorman LL, Engeldinger J. Disseminating perinatal depression screening as a public health initiative: a train-the-trainer approach. Maternal Child Hlth J. 2011;15(6):814–21. doi: 10.1007/s10995-010-0644-1. [PMC free article] [PubMed] [Cross Ref]
45. Williams DM. Preparing pharmacy students and pharmacies to provide tobacco cessation counseling. Drug Alc Rev. 2009;28:533–40. doi: 10.1111/j.1465-3362.2009.00109.x. [PubMed] [Cross Ref]
46. Iles V, Sutherland K. Organizational change: a review for health care managers, professionals and researchers. London: National Coordinating Centre for NHS Service Delivery and Organisation R&D, London School of Hygiene and Tropical Medicine; 2001.
47. Pettigrew AM, Ferlie E, McKee L. Shaping strategic change: making change in large organizations: the case of the National Health Service. Thousand Oaks: Sage; 1992.
48. Flynn PM, Brown BS. Implementation research: issues and prospects. Addict Behav. 2011;36:566–9. doi: 10.1016/j.addbeh.2010.12.020. [PMC free article] [PubMed] [Cross Ref]
49. Brown BS, Flynn PM. The federal role in drug abuse technology transfer: a history and perspective. J Subst Abuse Treat. 2002;22(4):245–57. doi: 10.1016/S0740-5472(02)00228-3. [PubMed] [Cross Ref]

Articles from BMC Health Services Research are provided here courtesy of BioMed Central