PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of jgimedspringer.comThis journalToc AlertsSubmit OnlineOpen Choice
 
J Gen Intern Med. Jun 2006; 21(6): 584–589.
PMCID: PMC1924631
What Drives Referral from Primary Care Physicians to Mental Health Specialists? A Randomized Trial Using Actors Portraying Depressive Symptoms
Richard L Kravitz, MD, MSPH,1 Peter Franks, MD,2 Mitchell Feldman, MD, MPhil,3 Lisa S Meredith, PhD,4 Ladson Hinton, MD,5 Carol Franz, PhD,6 Paul Duberstein, PhD,7 and Ronald M Epstein, MD8
1Center for Health Services Research in Primary Care and Department of Internal Medicine, University of California, Sacramento, CA, USA
2Center for Health Services Research in Primary Care and Department of Family and Community Medicine, University of California Davis, Davis, CA, USA
3Department of Internal Medicine, University of California, San Francisco, CA, USA
4RAND, Santa Monica, CA, USA
5Center for Health Services Research in Primary Care and Department of Psychiatry, University of California Davis, Davis, CA, USA
6Center for Health Services Research in Primary Care, University of California Davis, Davis, CA, USA
7Department of Psychiatry and Oncology, University of Rochester, Rochester, NY, USA
8Department of Family Medicine and Psychiatry and Center to Improve Communication in Health Care, University of Rochester, Rochester, NY, USA
Address correspondence and requests for reprints to Dr. Kravitz: Center for Health Services Research in Primary Care and Department of Internal Medicine, University of California Davis, 2103 Stockton Blvd., Grange Building, Suite 2224, Sacramento, CA 95817 (e-mail: rlkravitz/at/ucdavis.edu).
The authors have no conflicts of interest to declare.
Received August 17, 2005; Revised October 4, 2005; Accepted December 15, 2005.
BACKGROUND
Referral from primary care to the mental health specialty sector is important but poorly understood.
OBJECTIVE
Identify physician characteristics influencing mental health referral.
DESIGN
Randomized controlled trial using Standardized Patients (SPs).
SETTING
Offices of primary care physicians in 3 cities.
PARTICIPANTS
One hundred fifty-two family physicians and general internists recruited from 4 broad practice settings; 18 middle aged Caucasian female actors.
INTERVENTION
Two hundred and ninety-eight unannounced SP visits, with assignments constrained so physicians saw 1 SP with major depression and 1 with adjustment disorder.
MEASUREMENTS
Mental health referrals via SP written reports; physician and system characteristics through a self-administered physician questionnaire.
RESULTS
Among 298 SP visits, 107 (36%) resulted in mental health referral. Referrals were less likely among physicians with greater self-confidence in their ability to manage antidepressant therapy (adjusted odds ratio [AOR] 0.39, 95% confidence interval [CI] 0.17 to 0.86) and were more likely if physicians typically spent ≥10% of professional time on nonclinical activities (AOR 3.42, 95% CI 1.45 to 8.07), had personal life experience with psychotherapy for depression (AOR 2.74, 95% CI 1.15 to 6.52), or usually had access to mental health consultation within 2 weeks (AOR 2.94, 95% CI 1.26 to 6.92).
LIMITATION
The roles portrayed by SPs may not reflect the experience of a typical panel of primary care patients.
CONCLUSIONS
Controlling for patient and health system factors, physicians' therapeutic confidence and personal experience were important influences on mental health referral. Research is needed to determine if addressing these factors can facilitate more appropriate care.
Keywords: mental health, primary care, referral patterns, specialty consultation, health services research
Brief psychotherapies are beneficial in depressive disorders, 15 but generalist physicians are not typically trained in their use. 6 Primary care depression guidelines therefore emphasize mental health referral as a valid option for most patients. 7 Although some patients with depression seek mental health specialty care directly, referral is a critically important yet poorly understood mechanism of access. 8
Referrals may driven by patient factors, physician factors, the patient–physician interaction, or features of the health care delivery system. Many studies have examined system and patient factors affecting mental health referrals 923 but few have assessed physician factors. Glied 24 reported that family physicians were more likely than internists to diagnose and refer patients with mental health disorders. Alvidrez and Areán 25 found that physicians who were female, considered psychotherapy effective, or frequently employed “psychosocial techniques” were more willing to refer older depressed patients. Williams et al. 26 reported that physicians with greater self-reported knowledge of depression and greater confidence in their ability to treat mental illness were less likely to refer. These studies were limited by incomplete adjustment for patient factors such as condition severity and visit expectations as well as for system factors like availability of specialty mental health services.
We used unannounced Standardized Patients (SPs) to examine the antecedents of mental health referral. We focused on critical clinician-level “risk factors” (personal and professional characteristics, diagnostic process, and self-efficacy) for mental health referral while controlling experimentally for patient factors, namely depression severity (major depression vs adjustment disorder with depressed mood) and request making. A secondary objective was to examine health system factors by describing the process of mental health referral in 4 diverse practice settings.
Design Overview
The study was designed as a randomized controlled trial. 27 Eighteen SPs were trained to portray 6 roles, created by crossing 2 clinical conditions (symptoms consistent with major depression or adjustment disorder) with 3 medication request types (brand-specific, general, or none). Participating physicians gave advanced consent to see 2 unannounced SPs presenting with physical and psychological symptoms. The study protocol was approved by the institutional review boards at all participating institutions.
Sampling of Practices
Details of sampling procedures are described elsewhere. 27 Internists and family physicians were recruited from: (1) an academically affiliated primary care network in inland Northern California (CA-PCN); (2) a group-model health maintenance organization in inland Northern California (CA-HMO); (3) an independent practice association in the San Francisco Bay area (CA-IPA); and (4) a regional health insurer in upstate New York (NY-RHI). Physicians in the CA-PCN see patients covered by multiple insurance plans, some of which “carve out” mental health coverage to a mental health benefits manager. Many of the CA-HMO offices offer on-site mental health consultation, while others utilize more traditional mechanisms of referral. Within the CA-IPA, affiliated physicians practice independently in solo-, single-specialty group, and multi-specialty group practices and have referral options limited by the patient's insurance. SPs presenting to the CA-IPA physicians were given an insurance plan with a mental health carve-out. Finally, the NY-RHI offers a variety of preferred provider organization (PPO) plans. Affiliated physicians practice independently of the insurer, and all mental health care is “carved-in.”
A total of 152 physicians participated in the study. Cooperation rates 28 by site ranged from 53% to 61%. The age and gender distributions of participating physicians were similar to those of non-participating physicians within each system. Six physicians saw only 1 SP, making a total of 298 SP visits.
Role Development and Standardization
Detailed clinical biographies were developed for the 2 presentations. Role 1 was a 48-year-old divorced, Caucasian woman with major depression of moderate severity and wrist pain consistent with carpal tunnel syndrome. Role 2 was a 45-year-old divorced Caucasian woman with adjustment disorder and low back pain. Actors were instructed to make: (1) a brand-specific request for Paxil® (paroxetine), (2) a general request for “medication that might help,” or (3) no specific request. While the prevalence of antidepressant requests on the first visit in general practice is not known, requests for new medications occur in 11% of primary care visits and requests for advertised medicines in up to 7% of such visits. 2931 Key elements of each role have been summarized in the paper by Kravitz et al. 27; details are available by request.
Visit Conduct and Data Collection
By random assignment, physicians had 1 encounter with an SP portraying major depression with wrist pain and another encounter with an SP portraying adjustment disorder with back pain. Immediately following the visit, SPs completed an SP Reporting Form that captured a list of clinician behaviors. Overall agreement between the SP and an independent judge on 36 randomly selected visit audiorecordings was 92% (mean κ, 0.82). Using a detection form faxed to the doctor's office within 2 weeks, physicians reported that 12.8% of visits “probably or definitely” involved an actor. 27, 32
Main Measures
Referral to a mental health professional was assessed by asking: “Did the physician you saw today suggest or recommend that you seek care from a mental health professional?” There was good correspondence between SP reports on this item and the judgment of the independent audiotape reviewer (agreement 94.4%, κ=0.88). If the SP responded affirmatively, she was asked to indicate whether the doctor or staff: (1) “suggested I see a mental health provider but did not give me any information on how to do so”; (2) “told me to call my health plan”; (3) “recommended a specific person” or “gave me a list of specific places to call”; or (4) “helped me to make an appointment.” Standardized patients were also asked to record whether the referral was to a psychiatrist, psychologist, social worker, marriage and family counselor, or “other/unspecified” mental health professional.
Antidepressant prescribing decisions were classified as: (1) prescription for Paxil®; (2) prescription for other antidepressant (including a newer generation antidepressant in any dose or a heterocyclic antidepressant in a final (target) dose equivalent to at least 75 mg of amitriptyline); or (3) no antidepressant. The minimum dose requirement for heterocyclic antidepressants was meant to exclude low-dose prescriptions intended for treatment of insomnia or pain.
Physicians' personal and professional characteristics and attitudes were ascertained from a self-administered questionnaire mailed at the end of the study. Relatively stable characteristics included age, gender, race/ethnicity, and medical specialty. For analytic purposes physicians were classified as Caucasian or nonCaucasian. Potentially mutable factors included percentage of time providing patient care and confidence (self-efficacy) in managing antidepressant therapy (measured by 2 questions, each on a scale from 1 [not at all confident] to 4 [very confident]). One question referred to simple (1 medication) therapy, and the other to complex therapy (2 or more medications). We dichotomized the total score (maximum of 8) as very confident (≥7) versus not (<7).
Personal experience and biographical factors may inform clinical decision making. 33 We inquired about physicians' previous experiences with depression in their personal life by asking: “Have you, an immediate family member, or a close friend ever been treated for symptoms of depression, and if so, were they treated with ‘medication, psychotherapy, both or neither?’” For the analyses, responses were classified as: (1) no experience with depression in personal life; (2) some experience with depression in personal life, treated with medication only; or (3) some experience with depression in personal life, treated with psychotherapy (with or without medication). We also asked “how would you describe the results of treatment?” (excellent, good, fair, or poor).
Perceived access to mental health services was assessed by asking, “When you refer a patient for evaluation of moderately severe depression, how soon is that patient typically able to see a licensed mental health professional?” (1=within 24 hours, 2=within a few days, 3=more than a few days but less than 2 weeks, 4=2 to 4 weeks, 5=at least 4 weeks, 6=usually unable to obtain access). For analytic purposes responses were dichotomized as <2 weeks versus otherwise.
Chart Recorded Diagnoses
To assess the physicians' diagnostic process, a physician reviewed SPs' medical records and classified physicians' dictated or handwritten assessments as (1) depression or dysthymia (n=178); (2) adjustment disorder or reactive/situational depression (n=19); or 3) other diagnosis (including no mental health diagnosis) (n=101). For analytic purposes the latter 2 categories were collapsed.
Statistical Analysis
Analyses were performed using STATA version 8.2 (StataCorp, College Station, TX). In addition to χ2 tests of the relationships among factors affecting referral likelihood, we used logistic mixed models to examine the relationships between the dependent variable (mental health referral or not) and patient, physician, and health system factors. Patient factors included: condition (depression vs adjustment disorder) and prompting (any medication request vs none). Physician factors included age, gender, race/ethnicity, medical specialty, percentage time in patient care, perceived access to mental health referral, confidence in managing antidepressant therapy, and prior experience with depression in self, family or friends. The latter was represented by 2 dummy variables: 1 for experience with pharmacological treatment for depression versus no experience with depression, and another for experience with psychotherapy for depression versus no experience with depression. Analyses were conducted with each SP-physician encounter as an observation. Random intercept, mixed effects regression analyses evaluated both SPs and physicians as random effects and other covariates as fixed effects. Ancillary analyses adjusted for whether or not the physician was “suspicious” that the patient was an SP. The detection variable was not significant, did not materially affect the other parameter estimates, and is not further reported.
Overall Referral Patterns
Among 298 visits by SPs with depressive symptoms, 107 (36%) resulted in a suggestion or recommendation for mental health referral: 4% to psychiatrists, 39% to clinical psychologists, 10% to social workers, and 47% to counselors or unspecified mental health providers. The physician or clinic staff helped secure a mental health appointment in 18% of referrals, recommended a specific person or provided a list of qualified mental health professionals in 34%, told the patient to call their health plan in 20%, and offered no active assistance in 28%.
Effect of Patient and Health System Factors
As reported previously, 27 referral rates varied little by clinical condition (P =.18, Table 1). In visits for major depression, MH referral was more commonly recommended when SPs prompted the physician by making a request for antidepressant medication than when they simply presented with symptoms (50% vs 19%, P<.001, Table 1). In contrast, during visits for adjustment disorder, the likelihood of MH referral did not vary significantly according to whether SPs requested medication (40% vs 32%, P =.18, Table 1). Irrespective of requests, the likelihood of MH referral was significantly higher when SPs received an antidepressant prescription (as opposed to no prescription) in major depression (P =.014) but not in adjustment disorder (P =.20) (Table 1).
Table 1
Table 1
Mental Health Referral as a Function of Psychiatric Condition, Patient Prompting, and Antidepressant Prescribing
Mental health referral rates converged to a narrow range (36% to 42%) at 3 of 4 study sites but were significantly lower within the CA-PCN (17%, P<.001). Use of doctoral-level health professionals (psychiatrists and psychologists) ranged from 14% (CA-PCN) to 72% (CA-HMO) (P<.001). Provision of “active assistance” (helped to make an appointment or recommended a specific person or list of persons) ranged from 0% (CA-PCN) to 88% (CA-HMO). The percentage of physicians able to obtain mental health consultation within 2 weeks ranged from 7% (CA-PCN) to 73% (CA-HMO) (P<.001).
Physician-Level Predictors of Referral
In unadjusted analyses, physicians who were male or Caucasian, who spent less than 90% of their professional time providing direct patient care, who reported being able to obtain mental health consultation within 2 weeks, who were less than “very confident” about their ability to manage antidepressant therapy, or who had experience in their personal lives with psychotherapy for depression were significantly more likely to make a mental health referral (P<.05 in each case, Table 2). Referral rates did not vary significantly by age or specialty (Table 2).
Table 2
Table 2
Physician Characteristics Related to Referral
Multivariable Analysis
In a random intercepts mixed-effects logistic regression model focusing on main effects and examining physician characteristics while controlling for patient and health system factors, making an antidepressant medication request was significantly associated with mental health referral (adjusted odds ratio [AOR] 3.53, 95% confidence interval [CI] 1.65 to 7.55, P =.001; Table 3). In ancillary analyses, there was a significant interaction between mental health condition and making a medication request (P =.04); stratifying on condition showed that the AOR for mental health referral associated with making a medication request was greater in major depression (AOR 5.5, 95% CI 2.0 to 15.1) than in adjustment disorder (AOR 1.4, 95% CI 0.6 to 3.3) (data not shown in table).
Table 3
Table 3
Influence of Patient, Physician, and System Characteristics on Referral for Mental Health Care (n =294)
Physicians spending at least 10% time on nonclinical activities (teaching, research, or administration) were much more likely to refer, as were those who reported being able to obtain mental health consultation within 2 weeks. Those with a high level of confidence in their ability to manage antidepressant therapy were less likely to refer (Table 3). Physicians reporting previous personal or vicarious experience with psychotherapy (but not antidepressant medication alone) were also more likely to refer to a mental health professional (Table 3). These estimates were unaffected by adjusting for the physician's report of whether their experience with psychotherapy resulted in a good outcome (data not shown). The physician random effect was significant (ρ=0.31, P =.012), indicating that individual physicians differed in their propensity to refer.
To explore the mediating effect of mental health diagnosis on physicians' clinical decisions, we calculated the percentage of visits in which a) an antidepressant was prescribed or b) a mental health referral was made, stratified by SP role and by chart-recorded diagnosis. Among 298 visits, physicians diagnosed depression or dysthymia in 119 of 149 (80%) of SPs portraying major depression and 59 of 149 (40%) of SPs portraying adjustment disorder (Table 4). Antidepressant prescribing was strongly associated with chart-recorded diagnosis regardless of the role portrayed (Table 4). Mental health referral rates, conversely, were sensitive to diagnosis among SPs portraying major depressive disorder (MDD) (referral recommended in 52% of MDD visits in which depression was diagnosed versus 23% when depression was not diagnosed, P<.01) but not among those portraying adjustment disorder (48% vs 39%, P =NS, Table 4).
Table 4
Table 4
Proportion of Standardized Patients Receiving an Antidepressant Prescription or a Mental Health Referral, Stratified on SP Role and Recorded Diagnosis
The probability of referring to a mental health provider in this study was higher for physicians who devoted more time to nonclinical activities, perceived mental health consultation to be more readily available, had less confidence in their ability to manage antidepressants, and had personal life experience with psychotherapy for depression.
The idea that physicians with academic or administrative responsibilities practice differently than full-time clinicians is consistent with the work of Borowsky et al. 34 who found that mental health referrals are extremely common in academic generalist practices
The association between availability of health care services availability and utilization is a time-honored theme in health services research. 35, 36 Physician-reported availability of mental health consultation within a 2-week window varied 4-fold across study sites and was, after adjustment, associated with a 3-fold increase in the odds of recommending care from a mental health professional.
Increased knowledge in a particular clinical domain usually increases referrals, 37, 38 possibly because more knowledgeable doctors are more attuned to clinical complexities. 39 However, consistent with Williams et al. 26 we found that physicians with greater confidence in their ability to manage antidepressant therapy were substantially less likely to recommend consultation with a mental health provider. Perhaps therapeutic self-efficacy 40 operates differently than diagnostic sophistication, in which recognition of the complexities of a topic might lead to greater appreciation of the value of consultation.
Seventy percent of participating physicians reported that they (or a close friend or relative) had been treated for depression, and nearly half had direct or vicarious experience with psychotherapy. Physicians reporting such experience were more likely to offer patients a mental health referral. The association does not owe to enhanced outcomes expectancies, 41 because referral rates were high regardless of perceived effectiveness. Although these observational results do not prove that exposing health professional students to psychotherapy would alter their propensity to make mental health referrals once in practice, the hypothesis deserves further exploration. Alternatively, a common predisposing factor (such as a tendency toward self-reflection) 42 may bring physicians to acquire greater familiarity with psychotherapy and to recommend it to patients.
Taken as a whole, relatively stable physician characteristics (age, gender, race/ethnicity, and primary care specialty) have little influence on mental health referral while more mutable conditions of practice, self-efficacy, and life experiences carry greater weight. Curiously, referral decisions were associated with chart-recorded diagnosis when SPs portrayed major depression but not adjustment disorder. This suggests that physicians view the basis for referral differently in the 2 conditions, perhaps seeking specific management assistance in major depression and diagnostic validation or general psychosocial support in adjustment disorder.
Apart from identifying factors influencing referral, our study highlights important aspects of the referral process. Psychiatrists were rarely consulted, perhaps reflecting the “occupational transformation of the mental health system.” 43, 44 In addition, except in the CA-HMO (fully integrated) system, a minority of patients were given meaningful assistance with making an appointment. Most were told to call a toll-free number, call their health plan, or use the phone book.
This study has several limitations. The SP roles represent a narrow spectrum of primary care practice. Only first visits were studied, precluding conclusions about referral behavior over time. Future therapeutic decision making (including whether to refer) would ordinarily hinge on the patients' response to initial therapy, among other factors. Furthermore, referral is a process that extends far beyond the primary care physician's recommendation. We only examined the most proximal part of the procedure, so our estimated referral rates represent an upper bound on actual referral. Finally, the small number of sites limits generalizability to other geographic regions and conditions of practice.
In summary, this study indicates that primary care physicians' perceptions of mental health services availability, personal life experiences, and therapeutic self-confidence are important influences on mental health referral in depression. Further research is needed to determine whether interventions designed to enhance the referral process can lead to better outcomes, especially for patients with more severe depression, in whom the need for combined therapy with medication and psychotherapy might be most compelling.
Acknowledgments
The authors wish to thank Debbie Sigal, Arthur Brown, Kit Miller, Alison Venuti, Lesley Sept, Jun Song, Sheila Krishnan, Henry Young, PhD, Wayne Katon, MD, Patricia Carney, PhD, Fiona Wilson, MD, Debra Roter, PhD, Steven Kelly-Reif, MD, Jeff Rideout, MD, Robert Bell, PhD, Debra Gage, and Phil Raimondi, MD. Special appreciation goes to Blue Shield of California, the UCD Primary Care Network, Western Health Advantage (Sacramento), Kaiser Permanente (Sacramento), Brown & Toland IPA (San Francisco), and Excellus BlueCross BlueShield (Rochester). We are also indebted to the 18 actors (SPs) and to participating physicians and their office staffs. This work was supported by a grant (R01 MH064683) from the National Institute of Mental Health and was presented as an oral presentation at the 2005 SGIM Annual Meeting in New Orleans, Louisiana.
The design, conduct, data collection, analysis, and interpretation of the results of this study were performed independently of the funders. The funding agency also played no role in review or approval of the manuscript.
1. Ackermann RT, Williams JW., Jr Rational treatment choices for non-major depressions in primary care: an evidence-based review. J Gen Intern Med. 2002;17:293–301. [PMC free article] [PubMed]
2. Churchill R, Hunot V, Corney R, et al. A systematic review of controlled trials of the effectiveness and cost-effectiveness of brief psychological treatments for depression. Health Technol Assess. 2001;5:1–173. [PubMed]
3. Butter R, Carney S, Cipriani A, et al. Clinical Evidence Concise. Vol. 13. London: BMJ Publishing Group; 2005. Depressive disorders.
4. Lam RW, Kennedy SH. Evidence-based strategies for achieving and sustaining full remission in depression: focus on metaanalyses. Can J Psychiatry. 2004;49(3) Suppl 1:17S–26S. [PubMed]
5. Wampold BE, Minami T, Baskin TW, Callen Tierney S. A meta-(re)analysis of the effects of cognitive therapy versus ‘other therapies’ for depression. J Affect Disord. 2002;68:159–65. [PubMed]
6. Kessler RC, Berglund P, Demler O, et al. The Epidemiology of Major Depressive Disorder: results from the national comorbidity survey replication (NCS-R) JAMA. 2003;289:3095–105. [PubMed]
7. Sydney E, Hahn S. Depression. 2005. PIER: Physicians' Information and Education Resource. Accessed October 27, 2005.
8. Grembowski DE, Martin D, Patrick DL, et al. Managed care, access to mental health specialists, and outcomes among primary care patients with depressive symptoms. J Gen Intern Med. 2002;17:258–69. [PMC free article] [PubMed]
9. Alegria M, McGuire T. Rethinking a universal framework in the psychiatric symptom-disorder relationship. J Health Soc Behav. 2003;44:257–74. [PubMed]
10. Jorm A. Mental health literacy. Brit J Psychiatry. 2000;177:396–401. [PubMed]
11. Lin EH, Von Korff M, Katon W, et al. The role of the primary care physician in patients' adherence to antidepressant therapy. Med Care. 1995;33:67–74. [PubMed]
12. Miranda J, Munoz R. Intervention for minor depression in primary care patients. Psychosom Med. 1994;56:136–41. [PubMed]
13. Mitchell J, Baker M. Religious commitment and the construal of sources of help for emotional problems. Br J Med Psychol. 2000;73:289–301. [PubMed]
14. Sadavoy J, Meier R, Ong AY. Barriers to access to mental health services for ethnic seniors: the Toronto study. Can J Psychiatry. 2004;49:192–9. [PubMed]
15. Arean PA, Miranda J. Do primary care patients accept psychological treatments? Gen Hosp Psychiatry. 1996;18:22–7. [PubMed]
16. Olfson M. Primary care patients who refuse specialized mental health services. Arch Intern Med. 1991;151:129–32. [PubMed]
17. Van Voorhees BW, Cooper LA, Rost KM, et al. Primary care patients with depression are less accepting of treatment than those seen by mental health specialists. J Gen Intern Med. 2003;18:991–1000. [PMC free article] [PubMed]
18. Kushner K, Diamond R, Beasley JW, Mundt M, Plane MB, Robbins K. Primary care physicinas' experience with mental health consultation. Psychiatr Serv. 2001;52:838–40. [PubMed]
19. Meredith LS, Rubenstein LV, Rost K, et al. Treating depression in staff-model versus network-model managed care organizations. J Gen Intern Med. 1999;14:39–48. [PMC free article] [PubMed]
20. Trude S, Stoddard JJ. Referral gridlock: primary care physicians and mental health services. J Gen Intern Med. 2003;18:442–9. [PMC free article] [PubMed]
21. Valenstein M, Klinkman M, Becker S, et al. Concurrent treatment of patients with depression in the community: provider practices, attitudes, and barriers to collaboration. J Fam Pract. 1999;48:180–7. [PubMed]
22. Van Voorhees BW, Wang NY, Ford DE. Managed care organizational complexity and access to high-quality mental health services: perspective of U.S. primary care physicians. Gen Hosp Psychiatry. 2003;25:149–57. [PubMed]
23. Simon GE, Fleck M, Lucas R, Bushnell DM. Prevalence and predictors of depression treatment in an international primary care study. Am J Psychiatry. 2004;161:1626–34. [PubMed]
24. Glied S. Too little time? The recognition and treatment of mental health problems in primary care. Health Serv Res. 1998;33(4 Part 1):891–910. [PMC free article] [PubMed]
25. Alvidrez J, Arean PA. Physician willingness to refer older depressed patients for psychotherapy. Int J Psychiatry Med. 2002;32:21–35. [PubMed]
26. Williams JW, Jr, Rost K, Dietrich AJ, Ciotti MC, Zyzanski SJ, Cornell J. Primary care physicians' approach to depressive disorders. Effects of physician specialty and practice structure. Arch Fam Med. 1999;8:58–67. [PubMed]
27. Kravitz RL, Epstein RM, Feldman MD, et al. Influence of patients' requests for direct-to-consumer advertised antidepressants: a randomized controlled trial. JAMA. 2005;293:1995–2002. [PMC free article] [PubMed]
28. The American Association for Public Opinion Research. Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys. Lenexa, KS: AAPOR; 2000.
29. Kravitz RL, Bell RA, Azari R, Kelly-Reif S, Krupat E, Thom DH. Direct observation of requests for clinical services in office practice: what do patients want and do they get it? Arch Intern Med. 2003;163:1673–81. [PubMed]
30. Mintzes B, Barer ML, Kravitz RL, et al. How does direct-to-consumer advertising (DTCA) affect prescribing? A survey in primary care environments with and without legal DTCA. Can Med Assoc J. 2003;169:405–12. [PMC free article] [PubMed]
31. Weissman JS, Blumenthal D, Silk AJ, et al. Physicians report on patient encounters involving direct-to-consumer advertising. Health Aff (Millwood) 2004;(Suppl Web Exclusives:W4):219–33. [PubMed]
32. Franz CE, Epstein RM, Miller K, et al. Caught in the act? Prevalence, predictors, and consequences of detection in a study using standardized patients. Health Serv Res. In press. [PMC free article] [PubMed]
33. Funder DC. Toward a social psychology of person judgments: implications for person perception accuracy and self-knowledge. In: Forgas JP, Williams KD, editors. Social Judgments: Implicit and Explicit Processes. New York: Cambridge University Press; 2003. pp. 115–33.
34. Borowsky SJ, Rubenstein LV, Skootsky SA, Shapiro MF. Referrals by general internists and internal medicine trainees in an academic medicine practice. Am J Manage Care. 1997;3:1679–87. [PubMed]
35. Fisher ES, Wennberg DE, Stukel TA, Gottlieb DJ, Lucas FL, Pinder EL. The implications of regional variations in Medicare spending. Part 1: the content, quality, and accessibility of care. Ann Intern Med. 2003;138:273–87. [PubMed]
36. Roland M, Morris R. Are referrals by general practitioners influenced by the availability of consultants? BMJ. 1988;297:599–600. [PMC free article] [PubMed]
37. Calman N, Hyman R, Licht W. Variability in consultation rates and practitioner level of diagnostic certainty. J Fam Pract. 1992;35:31–8. [PubMed]
38. Reynolds G, Chitnis J, Roland M. General practitioner outpatient referrals: do good doctors refer more patients to hospital. BMJ. 1991;25:1250–2. [PMC free article] [PubMed]
39. Franks P, Williams G, Zwanziger J, Mooney C, Sorbero M. Why do physicians vary so widely in their referral rates? J Gen Intern Med. 2000;15:163–8. [PMC free article] [PubMed]
40. Bandura A. Social Foundations of Thought and Action: A Social Cognitive Theory. Englewood Cliffs, NJ: Prentice-Hall; 1986.
41. Eccles JS, Wigfield A. Motivational beliefs, values, and goals. Annu Rev Psychol. 2002;53:109–32. [PubMed]
42. Epstein RM. Mindful practice. JAMA. 1999;282:833–9. [PubMed]
43. Scheffler R, Kirby P. The occupational transformation of the mental health system. Health Aff (Millwood) 2003;22:177–88. [PubMed]
44. Rao NR. Psychiatric workforce: past legacies, current dilemmas, and future prospects. Acad Psychiatr. 2003;27:238–40. [PubMed]
Articles from Journal of General Internal Medicine are provided here courtesy of
Society of General Internal Medicine