PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptNIH Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Med Care. Author manuscript; available in PMC Sep 1, 2013.
Published in final edited form as:
PMCID: PMC3466108
NIHMSID: NIHMS393862
Risk Factors for Reporting Poor Cultural Competency Among Patients with Diabetes in Safety-Net Clinics
Hilary K. Seligman, MD,1 Alicia Fernandez, MD,1 Rachel J. Stern, BS,1 Robert Weech-Maldonado, PhD,2 Judy Quan, PhD,1 and Elizabeth A. Jacobs, MD3
1Division of General Internal Medicine, University of California, San Francisco
2Department of Health Services Administration, University of Alabama, Birmingham
3Division of General Medicine and Health Innovation Program, University of Wisconsin, Madison
Corresponding Authors’ contact information: Hilary Seligman, MD, MAS, University of California, San Francisco, Box 1364, San Francisco, CA 94143-1364, Phone: (415) 206-4448; Fax: (415) 206-5586; hseligman/at/medsfgh.ucsf.edu
Background
The Consumer Assessment of Healthcare Providers and Systems Cultural Competency (CAHPS-CC) Item Set assesses patient perceptions of aspects of the cultural competence of their health care.
Objective
To determine characteristics of patients who identify the care they receive as less culturally competent
Research Design
Cross-sectional survey consisting of face-to-face interviews
Subjects
Safety-net population of patients with type 2 diabetes (n=600) receiving ongoing primary care
Measures
Participants completed the CAHPS-CC and answered questions about their race/ethnicity, gender, age, education, health status, depressive symptoms, insurance coverage, English proficiency, duration of relationship with primary care provider, and co-morbidities.
Results
In adjusted models, depressive symptoms were significantly associated with poor cultural competency in the Doctor Communication – Positive Behaviors domain (OR 1.73, 95%CI 1.11, 2.69). African-Americans were less likely than Whites to report poor cultural competence in the Doctor Communication – Positive Behaviors domain (OR 0.52, 0.28–0.97). Participants who reported a longer relationship (≥3 years) with their primary care provider were less likely to report poor cultural competence in the Doctor Communication – Health Promotion (OR 0.35, 0.21–0.60) and Trust domains (OR 0.4, 0.24–0.67), while participants with lower educational attainment were less likely to report poor cultural competence in the Trust domain (OR 0.51, 0.30–0.86). Overall, however, sociodemographic and clinical differences in reports of poor cultural competence were insignificant or inconsistent across the various domains of cultural competence examined.
Conclusions
Cultural competence interventions in safety-net settings should be implemented across populations, rather than being narrowly focused on specific sociodemographic or clinical groups.
Culturally competent care is increasingly recognized as a critical component of high-quality and cost-effective health care in the US. The National Quality Forum defines the provision of culturally competent care as care that is “safe, patient and family centered, evidence based, and equitable” for diverse populations.(1) Accurate and broad-scale measurement of cultural competency from the patient’s perspective may help focus cultural competency interventions and elucidate how a lack of organizational and provider cultural competency contributes to disparities in health care. However, the measurement of this construct has been limited by the lack of valid, reliable cultural competency measurement tools.
A rigorously evaluated and valid tool was recently developed as an extension to the Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey to allow for widespread measurement of cultural competency. This tool, the Consumer Assessment of Healthcare Providers and Systems Cultural Competency Item Set (CAHPS—CC), assesses multiple aspects of care thought to be related to cultural competency. Our goal was to evaluate the extent to which patients’ reports of poor cultural competency, as assessed by three CAHPS—CC domains, are associated with sociodemographic and clinical characteristics. We chose to examine the Doctor Communication – Positive Behaviors, Doctor Communication – Health Promotion, and Trust domains because these domains had acceptable psychometric properties in our participant sample based on the authors’ previous work.(2) The Doctor Communication – Positive Behaviors and Doctor Communication – Health Promotion domains measure aspects of patient-provider communication. Items in the Doctor Communication – Positive Behaviors domain ask patients the extent to which their provider exhibited various aspects of good communication, including explaining things in a way that is easy to understand, listening carefully, spending adequate time with you, and showing respect. Items in the Doctor Communication – Health Promotion domain ask patients the extent to which their provider discussed with them various aspects of health and wellness, including healthy diet, physical activity, and depression. Effective communication between patient and provider is a critical component of providing high-quality and culturally competent care, and previous work has shown that some vulnerable populations (including racial/ethnic minorities and populations with low education, low literacy, or low income) are less likely to report their providers communicate with them effectively.(3)
Like effective patient-provider communication, patient trust in their provider is also thought to be a critical component of culturally competent care. Patients who trust their providers demonstrate greater adherence to treatment plans and report greater satisfaction with their health care. Racial/ethnic minorities are less likely than Whites to report they trust the health care system.(4) The Trust domain includes items which ask patients to report the extent to which they feel they can tell their provider anything, trust their provider with their medical care, and feel their provider tells the truth about their health. It also asks patients how much their provider really cares about them as a person and their health.
Our focus was on determining which sociodemographic and clinical characteristics are associated with poor cultural competency, because these are the groups to which clinical or policy interventions might be appropriately targeted. We chose diabetes as a disease model because patients with diabetes generally have repeated and ongoing contact with the health care system, and because effective patient-provider communication, one important aspect of cultural competency, is essential to high-quality diabetes care.(57) This communication often revolves around ongoing medication adherence, diet, and exercise, each of which are highly influenced by culture. There is therefore great opportunity for poor cultural competency to reduce the quality of diabetes care.
Study design and participants
We conducted a cross-sectional survey among patients recruited from academic and non-academic hospital- and community-based safety-net clinics in Chicago and the San Francisco Bay Area. Clinics were staffed by a mixture of attending physicians, resident physicians in training, and non-academic physicians and mid-level providers. Patients were recruited into the study to allow for adequate representation of African-American, White, and Mexican-American patients whose primary language was either English or Spanish. Of those approached, 91% (n=711) agreed to participate. Inclusion criteria included age ≥ 18 years, a diagnosis of type 2 diabetes, and fluency in English or Spanish. Exclusion criteria included active substance use, cognitive impairment, or psychosis severe enough to preclude survey participation. Because the measurement of cultural competency includes evaluation of a primary care provider, we analyzed data only for participants who reported having a regular primary care provider (n=600).
After participants provided informed consent in English or Spanish, they participated in a face-to-face standardized interview with a trained, bilingual, and bicultural research assistant. The Institutional Review Boards of the participating institutions in Chicago and the San Francisco Bay Area approved all study activities.
Design and Measures
We used CAHPS-CC to determine participant perceptions of the cultural competency of their usual health care provider. Details of the development of CAHPS—CC can be found elsewhere.(4) We present the three CAHPS-CC domains that were psychometrically sound among both English and Spanish speakers in our participant population.(2) These domains include Doctor Communication - Positive Behaviors (5 items), Doctor Communication - Health Promotion (4 items), and Trust (5 items).
Responses to the fourteen items in the three domains were transformed to a 0 to 100 scale (Supplementary Appendix), with a score of 100 representing the most culturally competent response for each item. We derived a domain score by calculating the mean of all items in the domain; therefore, a domain score of 100 indicates no responses on any item in the domain consistent with poor cultural competence. If participants skipped or declined to answer some items in the domain, we calculated the domain score as the mean of the answered items (rather than the mean of all items). There were few non-respondents (<1% of the sample) for all items except one item in the Doctor Communication: Positive Behaviors domain (19%, see Supplementary Appendix). Because scores in each of the domains were highly positively skewed, a known phenomenon in patient assessments of provider quality, we arranged scores into quartiles.(8) We refer to domain scores in the lowest quartile as “poor cultural competency”.
We identified potential risk factors for poor cultural competency from the communication and patient satisfaction literature and our personal experience working in safety-net institutions. Potential risk factors included race/ethnicity (African-American, White, or Mexican-American), gender, age (18–34, 35–64 or 65+ years), educational attainment (<high school degree), self-reported health status (fair, poor, or very poor vs good, very good, or excellent), depressive symptoms, insurance coverage (Medicare with or without additional Medicaid coverage, Medicaid only, privately insured, or uninsured), English proficiency, length of relationship with provider (<1 year, 1–2 years, 3 years or more), and self-reported co-morbidity burden.(912)
We determined depressive symptoms using the Patient Health Questionnaire (PHQ-9).(13) This nine-item scale is based directly on the diagnostic criteria for major depressive disorder in the Diagnostic and Statistical Manual Fourth edition (DSM-IV). It asks respondents how often over the previous two weeks they have been bothered by each of the nine symptom clusters identified in the DSM-IV. Points are accumulated based on symptom frequency. By established convention, we considered scores ≥10 indicative of clinically significant depressive symptoms. Scores of 10–14 are often described as minor depression, dysthymia, or a mild case of major depression, while higher scores are often described as moderate to severe cases of major depression. We refer to scores ≥10 as “depressive symptoms” as the scale does not allow us to determine a definitive diagnosis of depression.
We considered participants to be English proficient if they reported either that English was their primary language, or that English was not their primary language but they spoke English “well” or “very well”.
We included six co-morbidities: heart attack, stroke, cancer (other than skin cancer), high blood pressure, arthritis, and high cholesterol. We summed the number of co-morbidities to determine co-morbidity burden (range 0–6). We describe co-morbidity burden as a continuous variable for regression analyses.
Statistical Analysis
We used logistic regression analyses to determine whether potential sociodemographic and clinical risk factors were associated with odds of poor cultural competency (domain scores in the lowest quartile). Participants with missing values for one of the sociodemographic variables were excluded from analyses examining that variable only, which represented 0.3% or less of participants in all analyses. We then generated multivariate logistic regression models adjusting for all of our potential risk factors of interest in order to determine which were independently associated with poor cultural competency. We included recruitment site (Chicago or San Francisco) in regression analyses to adjust for clustering. We considered p-values <0.05 to be statistically significant. All analyses were performed using SAS 9.2 (Cary, North Carolina).
The sample included a racially and ethnically diverse group of participants with diabetes who were predominantly between the ages of 35 and 64 years (Table 1). Almost half of participants were uninsured. Overall the mean number of co-morbidities reported by participants was 2.26 (SD 1.08, range 0–5). Whites (mean 2.49, SD 1.04) and African-Americans (mean 2.46, SD 1.02) reported the greatest number of co-morbidities, and Mexican-Americans the fewest number of co-morbidities (mean 2.07, SD 1.10, p<0.001).
Table 1
Table 1
Baseline characteristics of participants (n=600)
We used unadjusted logistic regression models to explore which sociodemographic and clinical groups reported the lowest cultural competency scores in each of the domains. African-Americans and participants with better health status were significantly less likely to report poor cultural competency in the Doctor Communication – Positive Behaviors domain compared to Whites and participants with poorer health status. Younger participants and participants with depressive symptoms were significantly more likely to report poor cultural competency in the Doctor Communication – Positive Behaviors domain compared to older participants and those without depressive symptoms (Table 2). Participants with a lengthier relationship with their primary care provider were significantly less likely to report poor cultural competency in the Doctor Communication – Health Promotion domain. These participants and participants with less educational attainment were significantly less likely to report poor cultural competency in the Trust domain.
Table 2
Table 2
Sociodemographic correlates of poor cultural competency scores (unadjusted), OR (95% CI)
In fully adjusted models including race/ethnicity, gender, age, education, health status, depressive symptoms, insurance coverage, English proficiency, duration of relationship with primary care provider, co-morbidity burden as a continuous variable, and clinic location, depressive symptoms remained significantly associated with being in the lowest quartile of cultural competency in the Doctor Communication - Positive Behaviors domain (Table 3). African-Americans remained significantly less likely than Whites to report poor cultural competency scores. In the Doctor Communication - Health Promotion domain, only duration of relationship with primary care provider remained significantly associated with cultural competency; participants who had a relationship with their provider of three or more years were less likely than those in a relationship less than a year to report poor cultural competency scores. In the Trust domain, participants with less educational attainment and a longer relationship with their primary care provider were less likely to report poor cultural competency than those with higher educational attainment and a shorter relationship with their health care provider.
Table 3
Table 3
Multivariate model of association between sociodemographic characteristics and low scores on CAHPS-CC domains among patients with diabetes receiving care in safety-net clinics, OR (95% CI)
In this sample of patients with diabetes receiving care in safety-net outpatient clinics, race/ethnicity, age, educational attainment, self-reported health status, depressive symptoms, and length of relationship with one’s primary care provider were significantly associated with specific aspects of culturally competent care. After full adjustment, participants with depressive symptoms were significantly more likely than those without depressive symptoms to report poor cultural competency in the Doctor Communication – Positive Behaviors domain, while African-Americans were significantly less likely than Whites to report poor cultural competency in the Doctor Communication – Positive Behaviors domain. Participants who reported a 3 year or longer relationship with their primary care provider were less likely than those with a briefer relationship with their primary care provider to report poor cultural competence in the Doctor Communication – Health Promotion and Trust domains, while participants with lower educational attainment were less likely than those with higher educational attainment to report poor cultural competence in the Trust domain. Overall, however, sociodemographic and clinical differences in reports of poor cultural competence were insignificant or inconsistent across the various domains of cultural competence. Our data suggests that cultural competence interventions in safety-net settings should be broadly implemented across populations, rather than being narrowly focused on specific sociodemographic or clinical groups.
There may be a number of factors contributing to our surprising finding that African-Americans were less likely than Whites to report poor cultural competency in the Doctor Communication – Positive Behaviors domain. First, all of our patients were recruited from the safety-net setting. Our clinical experience suggests that, compared to Mexican-American and African-American patients, many more White patients seeking care in these settings are homeless, use illicit substances, or have ongoing psychiatric illness. It may be that White patients experience less culturally competent care not because of their race but because of these other co-morbidities. Second, different racial/ethnic groups may have different expectations of their care, and these differences may be reflected in their reports of cultural competency. To the extent that cultural competency is related to patient satisfaction, our results are consistent with research showing that African-Americans sometimes report greater satisfaction than Whites in certain domains of care and practice settings.(9, 14) However, studies focusing more narrowly on domains of cultural competency have been relatively consistent in their finding that Whites report care that is more culturally competent.(15, 16) Further research will be needed to fully understand why Whites reported less culturally competent care in this setting.
Duration of relationship with one’s primary care provider was highly associated with cultural competency in the Doctor Communication - Health Promotion and Trust domains. In the safety-net setting from which we recruited, patients with a brief relationship with their primary care provider are more likely to receive care from a resident physician or mid-level health professional. It is therefore unclear from this data whether duration of relationship with one’s provider or provider level of experience is really the important predictor of cultural competency experiences. Although interventions may certainly be targeted toward extending the duration of patient-provider relationships (for example, by preventing discontinuous insurance enrollment), our data may also indicate the importance of focusing cultural competency training efforts on providers with the least clinical experience.
We observed a strong relationship between depressive symptoms and poor cultural competency in the Doctor Communication – Positive Behaviors domain. Studies examining patient satisfaction or perceptions of providers’ communication quality have also demonstrated associations with depressive symptoms,(1721) including among patients with diabetes.(22) Medicare beneficiaries with depressive symptoms are significantly more likely to report worse experiences of care in other CAHPS domains as well.(23) Although there is little research specifically focusing on perceptions of cultural competency among patients with depressive symptoms in the primary care setting, it is plausible that the association we observed between depression and poor cultural competency has multiple mechanisms. First, the manifestations of depression are culturally bound, and therefore providing optimal care to a patient with depression may require a higher level of cultural competency than providing care to a patient with a less culturally bound illness. Second, the perception of poor cultural competence may be a manifestation of the depression itself, i.e. patients with depression are more likely to report all aspects of their care as poor simply because they are depressed. Finally, patients with depression are “often disengaged, unassertive, and poorly informed”,(23) which may limit providers’ opportunities for establishing rapport or demonstrating the cultural competence of their care. Based on these hypothetical pathways, it seems reasonable that cultural competency training courses for providers practicing in safety-net settings should specifically address the provision of culturally competent care to patients with depression, and the manifestations of depression in diverse populations. Although it may also seem reasonable to target cultural competency efforts to patients with depressive symptoms, such a narrow focus may miss a large number of patients experiencing less culturally competent care. Finally, improving treatment of depression may change patients’ perceptions of the cultural competence of their care. However, we are aware of no studies which specifically test the effects of these kinds of interventions on patient perceptions of cultural competence.
Our results have a number of limitations. Health care providers who are more values-motivated may gravitate toward jobs in safety-net settings, as these settings often present the greatest opportunity to interact with patients of diverse cultural backgrounds.(24) Therefore cultural competence skills of providers in our sample may be higher than cultural competence skills of less highly selected providers. Similarly, practice organization and systems-based health care in the safety-net setting may respond to increased patient diversity with an increased emphasis on providing culturally competent care. Patient perceptions of cultural competence in settings outside the safety-net and large, diverse urban areas may therefore be lower. Patients without diabetes, and particularly those without health conditions that require highly effective and ongoing patient-provider communication, may exhibit different socioeconomic and clinical associations with cultural competence. Finally, we are not able to determine from this data whether perceptions of cultural competency explain any sociodemographic inequalities in health care outcomes.
Although some sociodemographic and clinical sub-groups in the safety-net setting report less culturally competent care, in general differences among groups are inconsistent across various domains of cultural competency. These findings suggest that cultural competency efforts in safety-net settings should be broadly targeted, rather than focusing on specific population subgroups.
Supplementary Material
Acknowledgments
Funds were provided by the Russell Sage Foundation and the Commonwealth Fund.
1. National Quality Forum (NQF) A Comprehensive Framework and Preferred Practices for Measuring and Reporting Cultural Competency: A Consensus Report. Washington DC: 2009.
2. Stern RJ, Fernandez A, Jacobs EA, et al. Advances in Measuring Culturally Competent Care: A Confirmatory Factor Analysis of the CAHPS--CC in a Safety-Net Population. (In progress) [PMC free article] [PubMed]
3. Collins KS, Hughes DL, Doty MM, et al. Diverse Communities, Common Concerns: Assessing Health Care Quality for Minority Americans. The Commonwealth Fund. 2002
4. Weech-Maldonado R, Carle A, Weidmer B, et al. Assessing Cultural Competency from the Patient’s Perspective: The CAHPS Cultural Competency (CC) Survey. (manuscript pending publication). in progress.
5. Piette JD, Schillinger D, Potter MB, et al. Dimensions of Patient-provider Communication and Diabetes Self-care in an Ethnically Diverse Population. Journal of General Internal Medicine. 2003;18:624–633. [PMC free article] [PubMed]
6. Aikens JE, Bingham R, Piette JD. Patient-Provider Communication and Self-care Behavior Among Type 2 Diabetes Patients. The Diabetes educator. 2005;31:681–690. [PubMed]
7. Heisler M, Bouknight RR, Hayward RA, et al. The relative importance of physician communication, participatory decision making, and patient understanding in diabetes self-management. J Gen Intern Med. 2002;17:243–252. [PMC free article] [PubMed]
8. Zweifler J, Hughes S, Lopez RA. Controlling for race/ethnicity: a comparison of California commercial health plans CAHPS scores to NCBD benchmarks. International journal for equity in health. 9:4. [PMC free article] [PubMed]
9. Lurie N, Zhan C, Sangl J, et al. Variation in racial and ethnic differences in consumer assessments of health care. The American Journal of Managed Care. 2003;9:502–509. [PubMed]
10. Fongwa MN, Cunningham W, Weech-Maldonado R, et al. Reports and ratings of care: black and white Medicare enrollees. Journal of health care for the poor and underserved. 2008;19:1136–1147. [PubMed]
11. Sisk JE, Gorman SA, Reisinger AL, et al. Evaluation of Medicaid managed care. Satisfaction, access, and use JAMA: the journal of the American Medical Association. 1996;276:50–55. [PubMed]
12. Keenan PS, Elliott MN, Cleary PD, et al. Quality assessments by sick and healthy beneficiaries in traditional Medicare and Medicare managed care. Medical Care. 2009;47:882–888. [PubMed]
13. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–613. [PMC free article] [PubMed]
14. Morales LS, Elliott MN, Weech-Maldonado R, et al. Differences in CAHPS adult survey reports and ratings by race and ethnicity: an analysis of the National CAHPS benchmarking data 1. 0. Health Services Research. 2001;36:595–617. [PMC free article] [PubMed]
15. Johnson RL, Saha S, Arbelaez JJ, et al. Racial and Ethnic Differences in Patient Perceptions of Bias and Cultural Competence in Health Care. Journal of General Internal Medicine. 2004;19:101–110. [PMC free article] [PubMed]
16. Blanchard J, Lurie N. R-E-S-P-E-C-T: patient reports of disrespect in the health care setting and its impact on care. J Fam Pract. 2004;53:721–730. [PubMed]
17. Rutten LJ, Augustson E, Wanke K. Factors associatedwith patients’ perceptions of health care providers’ communication behavior. J Health Commun. 2006;11 (Suppl 1):135–146. [PubMed]
18. Jackson JL, Chamberlin J, Kroenke K. Predictors of patient satisfaction. Soc Sci Med. 2001;52:609–620. [PubMed]
19. Hopton JL, Howie JG, Porter AM. The need for another look at the patient in general practice satisfaction surveys. Fam Pract. 1993;10:82–87. [PubMed]
20. Bui QU, Ostir GV, Kuo YF, et al. Relationship of depression to patient satisfaction: findings from the barriers to breast cancer study. Breast Cancer Res Treat. 2005;89:23–28. [PubMed]
21. Wyshak G, Barsky A. Satisfaction with and effectiveness of medical care in relation to anxiety and depression. Patient and physician ratings compared. Gen Hosp Psychiatry. 1995;17:108–114. [PubMed]
22. Swenson SL, Rose M, Vittinghoff E, et al. The influence of depressive symptoms on clinician-patient communication among patients with type 2 diabetes. Med Care. 2008;46:257–265. [PubMed]
23. Martino SC, Elliott MN, Kanouse DE, et al. Depression and the health care experiences of Medicare beneficiaries. Health Serv Res. 2011;46:1883–1904. [PMC free article] [PubMed]
24. Curlin FA, Dugdale LS, Lantos JD, et al. Do religious physicians disproportionately care for the underserved? Ann Fam Med. 2007;5:353–360. [PubMed]