PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptNIH Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Clin Psychol (New York). Author manuscript; available in PMC Feb 28, 2011.
Published in final edited form as:
Clin Psychol (New York). 2008; 15(3): 243–253.
doi:  10.1111/j.1468-2850.2008.00134.x
PMCID: PMC3045729
NIHMSID: NIHMS64688
The Effect of Telephone-Administered Psychotherapy on Symptoms of Depression and Attrition: A Meta-Analysis
David C. Mohr, Lea Vella, Stacey Hart, Timothy Heckman, and Gregory Simon
David C. Mohr, Northwestern University, Hines Veterans Administration Hospital;
Address correspondence to David C. Mohr, Department of Preventive Medicine, Northwestern University, Feinberg School of Medicine, 680 North Lakeshore Drive, Suite 1220, Chicago, IL 60611. d-mohr/at/northwestern.edu
Increasingly, the telephone is being used to deliver psychotherapy for depression, in part as a means to reduce barriers to treatment. Twelve trials of telephone-administered psychotherapies, in which depressive symptoms were assessed, were included. There was a significant reduction in depressive symptoms for patients enrolled in telephone-administered psychotherapy as compared to control conditions (d = 0.26, 95% confidence interval [CI] = 0.14–0.39, p < .0001). There was also a significant reduction in depressive symptoms in analyses of pretreatment to posttreatment change (d = 0.81, 95% CI = 0.50–1.13, p < .0001). The mean attrition rate was 7.56% (95% CI = 4.23–10.90). These findings suggest that telephone-administered psychotherapy can produce significant reductions in depressive symptoms. Attrition rates were considerably lower than rates reported in face-to-face psychotherapy.
Keywords: depression, meta-analysis, psychotherapy, telemental health
The telephone was invented by Alexander Graham Bell in 1876. The first report of telemedicine in a major medical journal, which described the use of the telephone to diagnose a child's cough, occurred three years later in 1879 (“The Telephone as a Medium of Consultation and Medical Diagnosis,” 1879). The telephone quickly became a widely used tool in the practice of primary-care medicine. In contrast, providers of psychotherapy were slow to adopt the telephone to deliver mental health–related services. To the best of our knowledge, the first report of the use of the telephone in the administration of psychotherapy was published in 1949, 70 years after the first telemedicine report (Berger & Glueck, 1949). In 1996, a report developed by an American Psychological Association task force found that empirical evidence concerning telephone-administered psychotherapy was scant to non-existent (Haas, Benedict, & Kobos, 1996). In the last decade, this has changed considerably.
Most of the work in telephone-administered psychotherapy has focused on treating depressive symptoms. Depression is common and is a significant cause of disability (Murray & Lopez, 1997). Psychotherapy is an attractive treatment option for many patients, as evidenced by the finding that approximately two-thirds of depressed patients prefer psychotherapy over antidepressant medication (Bedi et al., 2000; Brody Khaliq, & Thompson, 1997; Dwight-Johnson, Sherbourne, Liao, & Wells, 2000; Priest, Vize, Roberts, Roberts, & Tylee, 1996). However, only 20% of all patients referred for psychotherapy ever enter treatment (Brody et al., 1997; Weddington, 1983) and, of those who enter, nearly one-half will drop out (Wierzbicki & Pekarik, 1993). One reason for this discrepancy between interest and failure to initiate or follow through with psychotherapy is that there are considerable barriers for many patients, including time constraints, transportation problems, caregiving responsibilities, stigma concerns, disability, or living in a rural area that lacks adequate mental health services (Alvidrez & Azocar, 1999; Hollon et al., 2002; Mohr et al., 2006; Yuen, Gerdes, & Gonzales, 1996). Indeed, a recent study of primary-care patients found that 74% of depressed patients identify one or more barriers that make it very difficult or impossible to attend regularly scheduled psychotherapy sessions (Mohr et al., 2006). Many of these barriers could potentially be mitigated through the use of the telephone in administering psychotherapy.
The telephone, found in 95.5% of all households in the United States (Federal Communications Commission, 2003), is the most widely available telecommunications medium. Recognizing the potential for outreach, many provider organizations, including insurance companies, health maintenance organizations, the United States Veterans Health Administration, and others, have begun implementing telemental health procedures, including telephone-administered psychotherapy (Maheu, Pulier, Wilhelm, McMenamin, & Brown-Connolly 2005; VHA Telemental Health Field Work Group, 2003). Furthermore, more than two-thirds of psychologists use telephone-administered psychotherapy to some extent in their practice (VandenBos & Williams, 2000).
Accordingly, telephone-administered psychotherapy—while slow to be developed and implemented—is now increasingly part of the mental health care landscape. There have also been a growing number of empirical studies evaluating the utility of telephone-administered psychotherapy. In light of these developments, it is time to take a first “snapshot” of this research. Accordingly, we have undertaken a meta-analytic review with the following aims:
  • To evaluate the efficacy of telephone-administered psychotherapies in reducing symptoms of depression. We planned to evaluate telephone-administered psychotherapy compared with treatment-as-usual (TAU) and, if significant, evaluate the magnitude of change in depressive symptoms from pretreatment to posttreatment in telephone-administered psychotherapy.
  • To obtain an estimate of the attrition rate from telephone- administered psychotherapy.
When analyses revealed significant unexplained variability, we planned to evaluate the effects of four potential moderators: treatment orientation, treatment format, specialization of therapist, and therapist level of training.
Identification of Studies
MEDLINE and PsycINFO were searched in March 2006, using key words “telephone” and “psychotherapy or counseling or therapy.” References from reviewed articles were checked. Requests for unpublished or prepublished data were made through list serves, including the American Psychological Association's Division 12 and Division 38 list serves and the Society for Behavioral Medicine.
Inclusion Criteria
A trial was included if it met the following conditions:
  • The study was a trial of a telephone-administered form of psychotherapy. Only randomized controlled trials (RCTs) were included in the analysis of controlled trials, while all trials, including single arm trials, were included in the evaluation of pretreatment versus posttreatment effects.
  • All contact between therapists and patients was over the telephone; no face-to-face contact between therapist and patient occurred.
  • Intervention had to include at least four sessions, thereby eliminating evaluations of telephone hotlines, crisis counseling services, etc.
  • Treatments had to include a treatment manual or have a clearly identified treatment approach.
  • Interventions had reduction in depressive symptoms as a treatment outcome.
  • A validated measure of depressive symptoms was required. Measures of depressive symptoms were selected on the basis of consistency with other studies in the trial (e.g., if two measures were used, the measure that was used most often in other studies was used for this meta-analysis). Self-report measures were selected where possible to avoid any potential effects of detection bias.
  • Participants were adults.
Data Extraction
Two investigators (DCM, LV) independently reviewed the identified studies for inclusion and pertinent data. All effect sizes, standard errors, and weights were calculated according to methods described by Lipsey and Wilson (2001). For analyses comparing telephone-administered psychotherapy to a control condition, the standardized mean difference of the posttreatment scores was computed as the effect size of interest. For all but one study, means and standard deviations were used in this calculation; the effect size from Lynch, Tamburrino, and Nagel (1997) was calculated using the means and t-value as Lynch did not provide standard deviations. The pre–post analyses of telephone-administered psychotherapy used the standardized mean gain computed from pretreatment and posttreatment depression scores as the effect sizes. Attrition analyses used the proportion of participants who dropped out of treatment from the time of randomization to the end of treatment (i.e., dropouts/total randomized).
When data were insufficient to calculate an effect size, study authors were contacted and data were requested. In two instances, requisite additional data were provided (Simon, Ludman, Tutty, Operskalski, & Von Korff, 2004; Tutty, Simon, & Ludman, 2000). Several studies included two control conditions, a TAU condition and a second control condition that included a minimal intervention (attention control or case management; Heckman et al., 2006; Sandgren & McCaul, 2003; Simon et al., 2004). In these cases, the TAU condition was used to improve consistency in control conditions across studies.
Statistical Analyses
Mean effect size across the studies for each of the three analyses was calculated using the mean effect size macro written for the statistical software program SPSS and found through Lipsey and Wilson (2001). Analyses of telephone-administered psychotherapy versus control condition effect sizes used the standardized mean difference effect size. Pretreatment versus posttreatment analysis effect sizes used the standardized mean gain. Attrition was calculated using the proportion of participants who dropped out of therapy with the number of subjects randomized to telephone treatment as the denominator. Subgroup analyses for a priori and post hoc hypotheses were performed using Lipsey and Wilson's anova macro in SPSS. These analyses included treatment orientation, treatment format, therapist specialization, and therapist level of training. A random effects model was used in both mean effect size analyses and subgroup analyses if the homogeneity analysis (Q-test) was significant, indicating significant heterogeneity between studies.
Fifty-one studies were identified and were reviewed in detail. Of these, 12 studies satisfied the inclusion criteria. Of those satisfying inclusion criteria, nine were RCTs (Bailey, Mishel, Belyea, Stewart, & Mohler, 2004; Heckman et al., 2006; Heckman & Carlson, 2007; Lynch et al., 1997; Miller & Weissman, 2002; Mohr et al., 2000; Napolitano et al., 2002; Sandgren & McCaul, 2003; Simon et al., 2004), one was an RCT that employed two different types of telephone-administered treatments, both of which qualified as bona fide telephone-administered psychotherapies under the criteria for this meta-analysis (Mohr et al., 2005), one was a controlled study but the comparison group was drawn from another study and thus was not randomized (Tutty et al., 2000), and one was a single arm outcome study (Mohr, Hart, & Marmar, 2006). The characteristics of the included studies are provided in Table 1. Of the 39 that were rejected, most were rejected for multiple reasons. The primary reasons for the exclusion of each study were as follows: 12 studies were not clinical trials (e.g., they were surveys, case studies, or nondata-driven papers), 5 studies included face-to-face meetings with the therapist, 4 studies did not include four sessions (they only included one or two), 10 studies examined interventions that did not target depression (these studies targeted behaviors such as adherence to medical regimens or cancer screening, change in health behaviors such as smoking cessation, and anxiety), and 4 studies did not provide sufficient data to calculate effect sizes, and the authors were unable to provide the data.
Table 1
Table 1
Characteristics of included studies
Telephone-Administered Psychotherapy versus Control Conditions
There were 10 studies that had control conditions that could be included in this analysis. There was no statistically significant evidence of heterogeneity across these studies (Q = 10.57, p = .31). The mean effect size was d = 0.26, 95% confidence interval (CI) = 0.14–0.39, p < .0001. These results are displayed in Table 2.
Table 2
Table 2
Effect sizes change in depressive symptoms
Pretreatment to Posttreatment Effects of Telephone-Administered Psychotherapy
There were 12 studies containing pre–post data that could be used in this analysis. This analysis found a pre–post effect size of d = 0.81, 95% CI = 0.50–1.13, p < .0001. These results are displayed in Table 2. There was significant heterogeneity among these studies (Q = 241.5, p < .0001). Because there was significant heterogeneity, we examined the potential role of the following moderators: treatment orientation, treatment format, therapist specialization, and therapist level of training.
Treatment Orientation
Eight studies had orientations that were coded as having a fundamental cognitive-behavioral orientation, while four had other orientations, including interpersonal psychotherapy (Miller & Weissman, 2002), supportive emotion-focused therapy (Mohr et al., 2005), emotional expression therapy (Sandgren & McCaul, 2003), and an uncertainty intervention (Bailey et al., 2004). The random effects model, including treatment orientation, reached only a trend level of significance for the between-group homogeneity Q value (Qb = 3.08, p = .08), suggesting but not confirming that cognitive-behavioral treatments were more effective (d = 1.01, p < .0001) than other treatment orientations (d = 0.45, p = .08).
Treatment Format
Ten studies used telephone intervention with individual patients while two applied the telephone intervention in groups (Heckman et al., 2006). We note that having only two studies in one comparison group may make these findings unreliable; however, the analyses are presented because they were part of the review's a priori hypotheses. The model, including treatment format, had a nonsignificant Qb (Qb = 2.62, p = .11), indicating that treatment format did not explain the heterogeneity.
Therapist Specialization
Ten studies used mental health specialists, while two used nurses (Bailey et al., 2004; Sandgren & McCaul, 2003). The random effects model, including mental health specialization, had a significant Qb (Qb = 4.06, p = .04) and the within-group homogeneity Q value (Qw) was not significant (p = .25), indicating that mental health specification is sufficient to account for the heterogeneity in the effect size distribution. The treatments administered by mental health professionals produced significantly greater reductions in depressive symptoms compared with other professionals. Therapists in the mental health professions produced effect sizes of d = 0.94 (95% CI = 0.63–1.26, p < .0001), while treatments provided by non-mental health professionals did not produce statistically significant changes (d = 0.17, 95% CI = −0.52–0.85, p = .63). Again, because there are only two studies using non-mental clinicians, these findings may be unreliable and appropriate caution should be taken when interpreting these results.
Therapist Level of Training
Of the eight studies that did not use only doctoral-level therapists, two used nurses (Bailey et al., 2004; Sandgren & McCaul, 2003), two used advanced graduate students in psychology (Mohr et al., 2000; Napolitano et al., 2002), two used master's-level therapists (Simon et al., 2004; Tutty et al., 2000), and two used a mixture of master's-level therapists and PhD-level therapists (Heckman et al., 2006; Heckman & Carlson, 2007). The random effects model, including level of training, had a nonsignificant Qb (Qb = 0.18, p = .67).
Number of Sessions
Analyses were conducted to examine a post hoc hypothesis that number of sessions might be related to outcomes. Number of sessions intended by the protocol was used; the mean number of sessions actually completed was not consistently available. The number of sessions by protocol was not related to depressive symptoms (p = .61).
Attrition
There were 12 studies containing attrition data on the telephone-administered psychotherapies that could be used in this analysis. For all but two studies, the attrition rate was the number of dropouts from therapy divided by the total number of subjects randomized to the therapy group. Napolitano et al. (2002) noted that 2 of the 40 participants randomized to telephone-administered psychotherapy were removed from the study after randomization but before initiating treatment because they received a medical procedure that excluded their participation. We, therefore, considered the number enrolled to be 38 and did not count these two patients as dropouts. Miller & Weissman (2002) reported that 15 subjects were randomized and 3 dropped out. However, Miller replaced the three dropouts. We, therefore, considered the number enrolled to be 18.
There was significant heterogeneity in attrition across these studies (Q = 32.43, p = .0006). As such, the mean attrition rate above was calculated using random effects estimation. These studies had a mean attrition rate of 7.56% (95% CI = 4.23–10.90, p < .0001). These results are displayed in Table 2. We examined the ability of the four variables noted above to explain the heterogeneity.
Treatment Orientation
Treatment orientation accounted for a significant portion of the variance in attrition (Qb = 14.17, p = .0002), but this variable did not sufficiently account for all the excess variability in the effect size distribution, because the within-group homogeneity Q value remained significant (Qw = 18.26, p = .05). Cognitive- behavioral treatment orientation was associated with significantly greater rates of attrition (M = 7.9%, 95% CI = 5.6–10.2, p < .0001), compared with other orientations (M = 2.1%, 95% CI = 0.09–4.03, p = .04).
Treatment Format
Treatment format accounted for a significant portion of the variance in attrition (Qb = 4.06, p = .04), and this variable did sufficiently account for all the excess variability in the effect size distribution, because the within-group homogeneity Q value was not significant (Qw = 14.61, p = .15). The group format was associated with significantly greater rates of attrition (M = 12.2%, 95% CI = 6.1–18.4, p = .0001), compared with the individual format (M = 5.4%, 95% CI = 2.9–7.9, p < .0001). However, as in the pre–post analysis, only two studies used a group format, rendering these findings as less reliable.
Therapist Specialization
The random effects model showed that mental health specialization explained a significant portion of the variability in attrition (Qb = 15.85, p = .0001). This variable also sufficiently accounted for all the excess variability in the effect size distribution, because the within-group homogeneity Q value was not significant (Qw = 16.58, p = .08). Studies with therapists in the mental health professions had a mean attrition rate of 7.6% (95% CI = 5.4–9.8, p < .0001), while those treated by non-mental health professionals had a nonsignificant mean attrition rate of 1.5% (95% CI = −0.57–3.6, p = .15).
Therapist Level of Training
The random effects model showed that level of interventionist training did not explain a significant portion of the variance (Qb = 0.04, p = .84).
Number of Sessions
The number of sessions indicated by protocol was not significantly related to attrition (p = .14).
Analysis for Publication Bias
The potential for publication bias was analyzed by correlating the study sample size with the effect size. A significant positive correlation would raise the possibility that larger studies with larger effect sizes were more likely to be published. The relationship between sample size and treatment–control condition comparisons was r = −.28, p = .43, while the relationship between sample size and pre–post treatment outcomes was r = .07, p = .83. Thus, there was no evidence that these findings were influenced by publication biases.
This meta-analysis found that psychotherapy administered over the telephone was associated with significant reductions in depressive symptoms. The comparison of telephone-administered psychotherapy with control conditions, while meeting statistical criteria for significance, found a mean effect size of d = 0.26, which is somewhat less than the d = 0.42 reported in a meta-analysis that compared face-to-face psychotherapy to no-treatment controls (Wampold et al., 1997). However, the pre–post finding of d = 0.82 for telephone-administered psychotherapy is in line with many findings of meta-analyses of pre–post outcomes for face-to-face therapies in the d = 0.71–0.73 range (Nietzel, Russell, Hemmings, & Gretter, 1987; Robinson, Berman, & Neimeyer, 1990). Part of this discrepancy may be due to the control conditions used. Many of the control conditions used in studies included in this meta-analysis provided patients with active treatment conditions. For example, patients in the TAU condition in Simon's and Tutty's studies (Simon et al., 2004; Tutty et al., 2000) were under the care of primary-care physicians who prescribed antidepressant medications. Most of the remaining studies were conducted with patients who had some form of severe medical condition (e.g., multiple sclerosis, lung cancer, breast cancer, AIDS), which put them in frequent contact with medical care providers who may or may not have prescribed medications (Bailey et al., 2004; Heckman et al., 2006; Mohr et al., 2000; Napolitano et al., 2002; Sandgren & McCaul, 2003). In contrast, many psychotherapy studies using no-treatment conditions prohibit any psychological or pharmacological intervention outside the study and/or do not include patients with medical conditions that bring them into frequent contact with physicians who could potentially identify and treat the depression.
The mean attrition rate was 7.6% across all the studies. A meta-analysis of 125 studies reporting dropout from face-to-face psychotherapy found a mean attrition rate of 46.9% (Wierzbicki & Pekarik, 1993). This figure may be somewhat higher than is found in clinical trials, as it included a broad range of studies. A review of 14 major clinical trials, including psychotherapy for depression, over the past 20 years found attrition rates ranging from 13.9% to 64.4% (Blackburn & Moore, 1997; DeRubeis et al., 2005; Elkin et al., 1989; Gallagher-Thompson & Steffen, 1994; Hollon et al., 1992; Keller et al., 2000; Miranda et al., 2003; Scott & Freeman, 1992; Shapiro et al., 1994; Thompson, Gallagher, & Breckenridge, 1987; Ward et al., 2000; Watson, Gordon, Stermac, Kalogerakos, & Steckley 2003; Williams et al., 2000). These attrition rates fall outside the 95% CI for attrition from telephone-administered psychotherapy reported in this review. Therefore, these findings support recent observations that telephone administration of psychotherapy may reduce attrition by overcoming barriers to care (Mohr et al., 2005; Simon et al., 2004). However, as with the efficacy findings, due to differences in samples used in telephone-administered and face-to-face administered psychotherapy studies, it is premature to draw any firm conclusions regarding the relative attrition rates between telephone-administered and face-to-face administered psychotherapies.
There was significant heterogeneity across the studies for both the pre–post treatment and attrition analyses. Secondary analyses suggested that some of this variability could be accounted for by therapist specialization and that attrition may be higher in group treatments. In addition, cognitive–behavioral treatments had higher attrition rates, although this may have been driven by the group treatments. The secondary analyses accounting for unexplained variance are based on small numbers of analyses and are at best suggestive.
There are several other potential explanations for the heterogeneity in outcomes, including variability in baseline severity of depressive symptoms and the wide variety of comorbid illnesses across studies. Unfortunately, these could not be controlled for. The variety of measures for depressive symptoms used made it difficult to reliably rank the baseline depressive symptom scores on severity, thereby eliminating the possibility of covarying the effect of severity. Likewise, the populations from which telephone-administered psychotherapy study samples are drawn include a wide variety of primarily medical populations with barriers to treatment. Unfortunately, due to the degree of heterogeneity in comorbidities (seven studies focused on five different specific severe illnesses, one study identified a variety of chronic illnesses, three studies focused on medical practices with unspecified medical comorbidities, and one study targeted chronic depression), it was not possible to account for these comorbidities statistically.
A potential limitation in the study is that the variability in medical comorbidities may have contributed to the heterogeneity in outcomes in at least two ways. First, the various medical illnesses may have had variable effects on depressive symptoms and/or may have had a moderating effect on the efficacy of psychotherapy. Prevalence of depression in some of these illnesses exceeds prevalence in the general population, and it is possible that some depressive symptoms may result from the pathology or pathogenic processes of the medical disorders (Feinstein et al., 2004; Mohr & Cox, 2001; Then Bergh, Kumpfel, Trenkwalder, Rupprecht, & Holsboer, 1999). While a growing number of studies indicate that for many medical illnesses, such as cancer, heart disease, HIV, multiple sclerosis, and others, face-to-face administered psychotherapies for depression are highly effective (Elliott & Roy-Byrne, 1998; Lett, Davidson, & Blumenthal, 2005; Meyer & Mark, 1995), it remains unclear if these medical illnesses moderate the effects of psychotherapy.
A related potential problem lies in the measurement of depressive symptoms. Many of these illnesses produce symptoms that are confounded with symptoms of depression, such as fatigue and diminished cognitive capacity. However, the comorbid illnesses targeted by the studies included in this meta-analysis are all chronic or have symptoms that continue longer than the treatment periods. Thus, while it is possible that medical illness may elevate depressive symptom scores at any single assessment time point, any decrease in depressive symptoms over time is most likely due to changes in depressive symptoms and not to the more chronic medical symptoms.
We also want to emphasize that it is premature to generalize the results of this meta-analysis broadly. Individual studies suggest specific uses under specific circumstances; for example, telephone therapies may provide added benefit compared to care for depressive symptoms by a primary-care physician or to no care at all. However, because the depression symptom outcomes used in this meta-analysis were self-report instruments, the generalizability of these findings to clinically diagnosable depressive disorders is limited (Kendall & Flannery-Schroeder, 1995). Furthermore, the measures of depression used in this study had a wide range of specificity and sensitivity (Minami, Wampold, Serlin, Kircher, & Brown, 2007). Thus, the aggregated effect size estimates for depressive symptom severity should not be used as any sort of benchmark. In addition, the level of heterogeneity across studies suggests that we do not yet understand the characteristics of patients for whom such telephone interventions may be effective, and those for whom telephone intervention may not be appropriate. The heterogeneity in the severity of depressive symptoms and in medical comorbidities in the samples also limits generalizability.
Another important limitation of the study is that attrition was not defined with any specificity beyond having dropped out at any point during the study. This was due to the fact that trial reports typically do not distinguish attrition early in treatment from attrition later in treatment. This may mask important differences in the effect that attrition at different stages of treatment may have on outcomes. For example, failure to initiate treatment after randomization, or dropout in the initial three to four weeks of treatment (failure to engage), likely has very different ramifications compared with patients who remain in treatment for many weeks, but fail to complete the total number of sessions as specified in the protocol. It would be useful if reports of clinical trials differentiated among these different forms of attrition.
Thus, the most appropriate conclusion of this meta-analysis is that delivery of psychotherapy for depressive symptoms is promising but requires more research. A few questions critical to our ability to make broader clinical recommendations remain unanswered. Most centrally, it is not clear whether telephone-administered psychotherapy is equivalent to face-to-face administered psychotherapy in reducing depression and whether telephone-administered psychotherapy can produce lower attrition rates, compared with equivalent face-to-face treatments. These conclusions can only be drawn from randomized trials directly comparing face-to-face and telephone-administered treatments. Telephone administration of psychotherapies may also have deleterious effects. It will be important to begin identifying specific populations for whom such treatments are useful, and perhaps more importantly, populations for whom telephone-administered psychotherapy is contraindicated. Trials addressing these questions are urgently needed, as organizations that provide mental health care have already begun implementing telemental health programs (Maheu et al., 2005).
Acknowledgments
This study was supported by National Institute of Mental Health grant R01 MH59708 to Dr. Mohr.
Contributor Information
David C. Mohr, Northwestern University, Hines Veterans Administration Hospital.
Lea Vella, San Diego State University.
Stacey Hart, Ryerson University.
Timothy Heckman, Ohio University.
Gregory Simon, Group Health Cooperative.
  • Alvidrez J, Azocar F. Distressed women's clinic patients: Preferences for mental health treatments and perceived obstacles. General Hospital Psychiatry. 1999;21:340–347. [PubMed]
  • Bailey DE, Mishel MH, Belyea M, Stewart JL, Mohler J. Uncertainty intervention for watchful waiting in prostate cancer. Cancer Nursing. 2004;27:339–346. [PubMed]
  • Bedi N, Chilvers C, Churchill R, Dewey M, Duggan C, Fielding K, et al. Assessing effectiveness of treatment of depression in primary care. Partially randomised preference trial. British Journal of Psychiatry. 2000;177:312–318. [PubMed]
  • Berger MM, Glueck BCJ. The telephone—its use as a psychiatric adjunct. Psychiatric Quarterly. 1949;23:522–529.
  • Blackburn IM, Moore RG. Controlled acute and follow-up trial of cognitive therapy and pharmacotherapy in out-patients with recurrent depression. British Journal of Psychiatry. 1997;171:328–334. [PubMed]
  • Brody DS, Khaliq AA, Thompson TL. Patients' perspectives on the management of emotional distress in primary care settings. Journal of General Internal Medicine. 1997;12:403–406. [PMC free article] [PubMed]
  • Cortez DA, Boudewyn AC, Huang L, Mohr DC. Validation of the Cognitive Beliefs Questionnaire for multiple sclerosis. Paper presented at the American Psychological Association; Boston. 1999.
  • Cox D, Mohr DC. Managing difficulties with adherence to injectable medications due to blood, injection, and injury phobia and self-injection anxiety. American Journal of Drug Delivery. 2003;1:215–221.
  • DeRubeis RJ, Hollon SD, Amsterdam JD, Shelton RC, Young PR, Salomon RM, et al. Cognitive therapy versus medications in the treatment of moderate to severe depression. Archives of General Psychiatry. 2005;62:409–416. [PubMed]
  • Dwight-Johnson M, Sherbourne CD, Liao D, Wells KB. Treatment preferences among depressed primary care patients. Journal of General Internal Medicine. 2000;15:527–534. [PMC free article] [PubMed]
  • Elkin I, Shea MT, Watkins JT, Imber SD, Sotsky SM, Watkins JT, et al. National Institute of Mental Health treatment of depression collaborative research program: General effectiveness of treatments. Archives of General Psychiatry. 1989;46:802–808.
  • Elliott AJ, Roy-Byrne PP. Major depressive disorder and HIV-1 infection: A review of treatment trials. Seminars in Clinical Neuropsychiatry. 1998;3:137–150. [PubMed]
  • Federal Communications Commission. Supplemental telephone penetration report. Washington, DC: Author; 2003.
  • Feinstein A, Roy P, Lobaugh N, Feinstein K, O'Connor P, Black S. Structural brain abnormalities in multiple sclerosis patients with major depression. Neurology. 2004;62:586–590. [PubMed]
  • Gallagher-Thompson D, Steffen AM. Comparative effects of cognitive–behavioral and brief psychodynamic psychotherapies for depressed family caregivers. Journal of Consulting and Clinical Psychology. 1994;62:543–549. [PubMed]
  • Haas LJ, Benedict JG, Kobos JC. Psychotherapy by telephone: Risks and benefits for psychologists and consumers. Professional Psychology: Research and Practice. 1996;27:154–160.
  • Heckman TG, Barcikowski R, Ogles B, Suhr J, Carlson B, Holroyd K, et al. A telephone-delivered coping improvement group intervention for middle-aged and older adults living with HIV/AIDS. Annals of Behavioral Medicine. 2006;32:27–38. [PubMed]
  • Heckman TG, Carlson B. A randomized clinical trial of two telephone-delivered, mental health interventions for HIV-infected persons in rural areas of the United States. AIDS and Behavior. 2007;11:5–14. [PubMed]
  • Hollon SD, DeRubeis RJ, Evans MD, Wiemer MJ, Garvey MJ, Grove WM, et al. Cognitive therapy and pharmacotherapy for depression: Singly and in combination. Archives of General Psychiatry. 1992;49:774–781. [PubMed]
  • Hollon S, Munoz R, Barlow D, Beardslee W, Bell C, Bernal G, et al. Psychosocial intervention development for the prevention and treatment of depression: Promoting innovation and increasing access. Biological Psychiatry. 2002;52:610. [PubMed]
  • Keller MB, McCullough JP, Klein DN, Arnow B, Dunner DL, Gelenberg AJ, et al. A comparison of nefazodone, the cognitive behavioral-analysis system of psychotherapy, and their combination for the treatment of chronic depression. New England Journal of Medicine. 2000;342:1462–1470. [PubMed]
  • Kendall PC, Flannery-Schroeder EC. Rigor, but not rigor mortis, in depression research. Journal of Personality and Social Psychology. 1995;68:892–894. [PubMed]
  • Lett HS, Davidson J, Blumenthal JA. Nonpharmacologic treatments for depression in patients with coronary heart disease. Psychosomatic Medicine. 2005;67(Suppl. 1):S58–62. [PubMed]
  • Lipsey MW, Wilson DB. Practical meta-analysis. Thousand Oaks, CA: Sage; 2001.
  • Lynch DJ, Tamburrino MB, Nagel R. Telephone counseling for patients with minor depression: Preliminary findings in a family practice setting. Journal of Family Practice. 1997;44:293–298. [PubMed]
  • Maheu MM, Pulier ML, Wilhelm FH, McMenamin JP, Brown-Connolly NE. The mental health professional and the new technologies: A handbook for practice today. Mahwah, NJ: Lawrence Erlbaum Associates; 2005.
  • Meyer TJ, Mark MM. Effects of psychosocial interventions with adult cancer patients: A meta-analysis of randomized experiments. Health Psychology. 1995;14:101–108. [PubMed]
  • Miller L, Weissman M. Interpersonal psychotherapy delivered over the telephone to recurrent depressives. A pilot study. Depression and Anxiety. 2002;16:114–117. [PubMed]
  • Minami T, Wampold BE, Serlin RC, Kircher JC, Brown GS. Benchmarks for psychotherapy efficacy in adult major depression. Journal of Consulting and Clinical Psychology. 2007;75:232–243. [PubMed]
  • Miranda J, Chung JY, Green BL, Krupnick J, Siddique J, Revicki DA, et al. Treating depression in predominantly low-income young minority women: A randomized controlled trial. Journal of the American Medical Association. 2003;290:57–65. [PubMed]
  • Mohr DC, Cox D. Multiple sclerosis: Empirical literature for the clinical health psychologist. Journal of Clinical Psychology. 2001;57:479–499. [PubMed]
  • Mohr DC, Hart SL, Howard I, Julian L, Vella L, Catledge C, et al. Barriers to psychotherapy among depressed and nondepressed primary care patients. Annals of Behavioral Medicine. 2006;32:254–258. [PubMed]
  • Mohr DC, Hart SL, Julian L, Catledge C, Honos-Webb L, Vella L, et al. Telephone-administered psychotherapy for depression. Archives of General Psychiatry. 2005;62:1007–1014. [PubMed]
  • Mohr DC, Hart SL, Marmar CM. Telephone administered cognitive-behavioral therapy for the treatment of depression in a rural primary care clinic. Cognitive Therapy and Research. 2006;30:29–37.
  • Mohr DC, Likosky W, Bertagnolli A, Goodkin DE, Van Der Wende J, Dwyer P, et al. Telephone-administered cognitive-behavioral therapy for the treatment of depressive symptoms in multiple sclerosis. Journal of Consulting and Clinical Psychology. 2000;68:356–361. [PubMed]
  • Murray CJ, Lopez AD. Global mortality, disability and the contribution of risk factors: Global burden of disease study. Lancet. 1997;349:1436–1442. [PubMed]
  • Napolitano MA, Babyak MA, Palmer S, Tapson V, Davis RD, Blumenthal JA. Effects of a telephone-based psychosocial intervention for patients awaiting lung transplantation. Chest. 2002;122:1176–1184. [PubMed]
  • Nietzel MT, Russell RL, Hemmings KA, Gretter ML. Clinical significance of psychotherapy for unipolar depression: A meta-analytic approach to social comparison. Journal of Consulting and Clinical Psychology. 1987;55:156–161. [PubMed]
  • Priest RG, Vize C, Roberts A, Roberts M, Tylee A. Lay people's attitudes to treatment of depression: Results of opinion poll for defeat depression campaign just before its launch. British Medical Journal. 1996;313:858–859. [PMC free article] [PubMed]
  • Robinson LA, Berman JS, Neimeyer RA. Psychotherapy for the treatment of depression: A comprehensive review of controlled outcome research. Psychological Bulletin. 1990;108:30–49. [PubMed]
  • Sandgren AK, McCaul KD. Short-term effects of telephone therapy for breast cancer patients. Health Psychology. 2003;22:310–315. [PubMed]
  • Scott AI, Freeman CP. Edinburgh primary care depression study: Treatment outcome, patient satisfaction, and cost after 16 weeks. British Medical Journal. 1992;304:883–887. [PMC free article] [PubMed]
  • Shapiro DA, Barkham M, Rees A, Hardy GE, Reynolds S, Startup M. Effects of treatment duration and severity of depression on the effectiveness of cognitive-behavioral and psychodynamic-interpersonal psychotherapy. Journal of Consulting and Clinical Psychology. 1994;62:522–534. [PubMed]
  • Simon GE, Ludman EJ, Tutty S, Operskalski B, Von Korff M. Telephone psychotherapy and telephone care management for primary care patients starting antidepressant treatment: A randomized controlled trial. Journal of the American Medical Association. 2004;292:935–942. [PubMed]
  • The telephone as a medium of consultation and medical diagnosis. British Medical Journal. 1879;2:897.
  • Then Bergh F, Kumpfel T, Trenkwalder C, Rupprecht R, Holsboer F. Dysregulation of the hypothalamo-pituitary-adrenal axis is related to the clinical course of MS. Neurology. 1999;53:772–777. [PubMed]
  • Thompson LW, Gallagher D, Breckenridge JS. Comparative effectiveness of psychotherapies for depressed elders. Journal of Consulting and Clinical Psychology. 1987;55:385–390. [PubMed]
  • Tutty S, Simon G, Ludman E. Telephone counseling as an adjunct to antidepressant treatment in the primary care system. A pilot study. Effective Clinical Practice. 2000;3:170–178. [PubMed]
  • VandenBos GR, Williams S. The internet versus the telephone: What is tele-health, anyway? Professional Psychology: Research and Practice. 2000;31:490–492.
  • VHA Telemental Health Field Work Group. Telemental health toolkit. Washington, DC: Veterans Health Administration; 2003.
  • Wampold BE, Mondin GW, Moody M, Stich F, Benson K, Ahn H. A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically, “All must have prizes” Psychological Bulletin. 1997;122:203–215.
  • Ward E, King M, Lloyd M, Bower P, Sibbald B, Farrelly S, et al. Randomised controlled trial of non-directive counselling, cognitive-behaviour therapy, and usual general practitioner care for patients with depression. I: Clinical effectiveness. British Medical Journal. 2000;321:1383–1388. [PMC free article] [PubMed]
  • Watson JC, Gordon LB, Stermac L, Kalogerakos F, Steckley P. Comparing the effectiveness of process-experiential with cognitive–behavioral psychotherapy in the treatment of depression. Journal of Consulting and Clinical Psychology. 2003;71:773–781. [PubMed]
  • Weddington WW., Jr Adherence by medical-surgical inpatients to recommendations for outpatient psychiatric treatment. Psychother Psychosom. 1983;39:225–235. [PubMed]
  • Wierzbicki M, Pekarik G. A meta-analysis of psychotherapy dropout. Professional Psychology: Research and Practice. 1993;24:190–195.
  • Williams JW, Jr, Barrett J, Oxman T, Frank E, Katon W, Sullivan M, et al. Treatment of dysthymia and minor depression in primary care: A randomized controlled trial in older adults. Journal of the American Medical Association. 2000;284:1519–1526. [PubMed]
  • Yuen EJ, Gerdes JL, Gonzales JJ. Patterns of rural mental health care. An exploratory study. General Hospital Psychiatry. 1996;18:14–21. [PubMed]