|Home | About | Journals | Submit | Contact Us | Français|
The Consumer Assessment of Healthcare Providers and Systems Cultural Competency (CAHPS-CC) Item Set assesses patient perceptions of aspects of the cultural competence of their health care.
To determine characteristics of patients who identify the care they receive as less culturally competent
Cross-sectional survey consisting of face-to-face interviews
Safety-net population of patients with type 2 diabetes (n=600) receiving ongoing primary care
Participants completed the CAHPS-CC and answered questions about their race/ethnicity, gender, age, education, health status, depressive symptoms, insurance coverage, English proficiency, duration of relationship with primary care provider, and co-morbidities.
In adjusted models, depressive symptoms were significantly associated with poor cultural competency in the Doctor Communication – Positive Behaviors domain (OR 1.73, 95%CI 1.11, 2.69). African-Americans were less likely than Whites to report poor cultural competence in the Doctor Communication – Positive Behaviors domain (OR 0.52, 0.28–0.97). Participants who reported a longer relationship (≥3 years) with their primary care provider were less likely to report poor cultural competence in the Doctor Communication – Health Promotion (OR 0.35, 0.21–0.60) and Trust domains (OR 0.4, 0.24–0.67), while participants with lower educational attainment were less likely to report poor cultural competence in the Trust domain (OR 0.51, 0.30–0.86). Overall, however, sociodemographic and clinical differences in reports of poor cultural competence were insignificant or inconsistent across the various domains of cultural competence examined.
Cultural competence interventions in safety-net settings should be implemented across populations, rather than being narrowly focused on specific sociodemographic or clinical groups.
Culturally competent care is increasingly recognized as a critical component of high-quality and cost-effective health care in the US. The National Quality Forum defines the provision of culturally competent care as care that is “safe, patient and family centered, evidence based, and equitable” for diverse populations.(1) Accurate and broad-scale measurement of cultural competency from the patient’s perspective may help focus cultural competency interventions and elucidate how a lack of organizational and provider cultural competency contributes to disparities in health care. However, the measurement of this construct has been limited by the lack of valid, reliable cultural competency measurement tools.
A rigorously evaluated and valid tool was recently developed as an extension to the Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey to allow for widespread measurement of cultural competency. This tool, the Consumer Assessment of Healthcare Providers and Systems Cultural Competency Item Set (CAHPS—CC), assesses multiple aspects of care thought to be related to cultural competency. Our goal was to evaluate the extent to which patients’ reports of poor cultural competency, as assessed by three CAHPS—CC domains, are associated with sociodemographic and clinical characteristics. We chose to examine the Doctor Communication – Positive Behaviors, Doctor Communication – Health Promotion, and Trust domains because these domains had acceptable psychometric properties in our participant sample based on the authors’ previous work.(2) The Doctor Communication – Positive Behaviors and Doctor Communication – Health Promotion domains measure aspects of patient-provider communication. Items in the Doctor Communication – Positive Behaviors domain ask patients the extent to which their provider exhibited various aspects of good communication, including explaining things in a way that is easy to understand, listening carefully, spending adequate time with you, and showing respect. Items in the Doctor Communication – Health Promotion domain ask patients the extent to which their provider discussed with them various aspects of health and wellness, including healthy diet, physical activity, and depression. Effective communication between patient and provider is a critical component of providing high-quality and culturally competent care, and previous work has shown that some vulnerable populations (including racial/ethnic minorities and populations with low education, low literacy, or low income) are less likely to report their providers communicate with them effectively.(3)
Like effective patient-provider communication, patient trust in their provider is also thought to be a critical component of culturally competent care. Patients who trust their providers demonstrate greater adherence to treatment plans and report greater satisfaction with their health care. Racial/ethnic minorities are less likely than Whites to report they trust the health care system.(4) The Trust domain includes items which ask patients to report the extent to which they feel they can tell their provider anything, trust their provider with their medical care, and feel their provider tells the truth about their health. It also asks patients how much their provider really cares about them as a person and their health.
Our focus was on determining which sociodemographic and clinical characteristics are associated with poor cultural competency, because these are the groups to which clinical or policy interventions might be appropriately targeted. We chose diabetes as a disease model because patients with diabetes generally have repeated and ongoing contact with the health care system, and because effective patient-provider communication, one important aspect of cultural competency, is essential to high-quality diabetes care.(5–7) This communication often revolves around ongoing medication adherence, diet, and exercise, each of which are highly influenced by culture. There is therefore great opportunity for poor cultural competency to reduce the quality of diabetes care.
We conducted a cross-sectional survey among patients recruited from academic and non-academic hospital- and community-based safety-net clinics in Chicago and the San Francisco Bay Area. Clinics were staffed by a mixture of attending physicians, resident physicians in training, and non-academic physicians and mid-level providers. Patients were recruited into the study to allow for adequate representation of African-American, White, and Mexican-American patients whose primary language was either English or Spanish. Of those approached, 91% (n=711) agreed to participate. Inclusion criteria included age ≥ 18 years, a diagnosis of type 2 diabetes, and fluency in English or Spanish. Exclusion criteria included active substance use, cognitive impairment, or psychosis severe enough to preclude survey participation. Because the measurement of cultural competency includes evaluation of a primary care provider, we analyzed data only for participants who reported having a regular primary care provider (n=600).
After participants provided informed consent in English or Spanish, they participated in a face-to-face standardized interview with a trained, bilingual, and bicultural research assistant. The Institutional Review Boards of the participating institutions in Chicago and the San Francisco Bay Area approved all study activities.
We used CAHPS-CC to determine participant perceptions of the cultural competency of their usual health care provider. Details of the development of CAHPS—CC can be found elsewhere.(4) We present the three CAHPS-CC domains that were psychometrically sound among both English and Spanish speakers in our participant population.(2) These domains include Doctor Communication - Positive Behaviors (5 items), Doctor Communication - Health Promotion (4 items), and Trust (5 items).
Responses to the fourteen items in the three domains were transformed to a 0 to 100 scale (Supplementary Appendix), with a score of 100 representing the most culturally competent response for each item. We derived a domain score by calculating the mean of all items in the domain; therefore, a domain score of 100 indicates no responses on any item in the domain consistent with poor cultural competence. If participants skipped or declined to answer some items in the domain, we calculated the domain score as the mean of the answered items (rather than the mean of all items). There were few non-respondents (<1% of the sample) for all items except one item in the Doctor Communication: Positive Behaviors domain (19%, see Supplementary Appendix). Because scores in each of the domains were highly positively skewed, a known phenomenon in patient assessments of provider quality, we arranged scores into quartiles.(8) We refer to domain scores in the lowest quartile as “poor cultural competency”.
We identified potential risk factors for poor cultural competency from the communication and patient satisfaction literature and our personal experience working in safety-net institutions. Potential risk factors included race/ethnicity (African-American, White, or Mexican-American), gender, age (18–34, 35–64 or 65+ years), educational attainment (<high school degree), self-reported health status (fair, poor, or very poor vs good, very good, or excellent), depressive symptoms, insurance coverage (Medicare with or without additional Medicaid coverage, Medicaid only, privately insured, or uninsured), English proficiency, length of relationship with provider (<1 year, 1–2 years, 3 years or more), and self-reported co-morbidity burden.(9–12)
We determined depressive symptoms using the Patient Health Questionnaire (PHQ-9).(13) This nine-item scale is based directly on the diagnostic criteria for major depressive disorder in the Diagnostic and Statistical Manual Fourth edition (DSM-IV). It asks respondents how often over the previous two weeks they have been bothered by each of the nine symptom clusters identified in the DSM-IV. Points are accumulated based on symptom frequency. By established convention, we considered scores ≥10 indicative of clinically significant depressive symptoms. Scores of 10–14 are often described as minor depression, dysthymia, or a mild case of major depression, while higher scores are often described as moderate to severe cases of major depression. We refer to scores ≥10 as “depressive symptoms” as the scale does not allow us to determine a definitive diagnosis of depression.
We considered participants to be English proficient if they reported either that English was their primary language, or that English was not their primary language but they spoke English “well” or “very well”.
We included six co-morbidities: heart attack, stroke, cancer (other than skin cancer), high blood pressure, arthritis, and high cholesterol. We summed the number of co-morbidities to determine co-morbidity burden (range 0–6). We describe co-morbidity burden as a continuous variable for regression analyses.
We used logistic regression analyses to determine whether potential sociodemographic and clinical risk factors were associated with odds of poor cultural competency (domain scores in the lowest quartile). Participants with missing values for one of the sociodemographic variables were excluded from analyses examining that variable only, which represented 0.3% or less of participants in all analyses. We then generated multivariate logistic regression models adjusting for all of our potential risk factors of interest in order to determine which were independently associated with poor cultural competency. We included recruitment site (Chicago or San Francisco) in regression analyses to adjust for clustering. We considered p-values <0.05 to be statistically significant. All analyses were performed using SAS 9.2 (Cary, North Carolina).
The sample included a racially and ethnically diverse group of participants with diabetes who were predominantly between the ages of 35 and 64 years (Table 1). Almost half of participants were uninsured. Overall the mean number of co-morbidities reported by participants was 2.26 (SD 1.08, range 0–5). Whites (mean 2.49, SD 1.04) and African-Americans (mean 2.46, SD 1.02) reported the greatest number of co-morbidities, and Mexican-Americans the fewest number of co-morbidities (mean 2.07, SD 1.10, p<0.001).
We used unadjusted logistic regression models to explore which sociodemographic and clinical groups reported the lowest cultural competency scores in each of the domains. African-Americans and participants with better health status were significantly less likely to report poor cultural competency in the Doctor Communication – Positive Behaviors domain compared to Whites and participants with poorer health status. Younger participants and participants with depressive symptoms were significantly more likely to report poor cultural competency in the Doctor Communication – Positive Behaviors domain compared to older participants and those without depressive symptoms (Table 2). Participants with a lengthier relationship with their primary care provider were significantly less likely to report poor cultural competency in the Doctor Communication – Health Promotion domain. These participants and participants with less educational attainment were significantly less likely to report poor cultural competency in the Trust domain.
In fully adjusted models including race/ethnicity, gender, age, education, health status, depressive symptoms, insurance coverage, English proficiency, duration of relationship with primary care provider, co-morbidity burden as a continuous variable, and clinic location, depressive symptoms remained significantly associated with being in the lowest quartile of cultural competency in the Doctor Communication - Positive Behaviors domain (Table 3). African-Americans remained significantly less likely than Whites to report poor cultural competency scores. In the Doctor Communication - Health Promotion domain, only duration of relationship with primary care provider remained significantly associated with cultural competency; participants who had a relationship with their provider of three or more years were less likely than those in a relationship less than a year to report poor cultural competency scores. In the Trust domain, participants with less educational attainment and a longer relationship with their primary care provider were less likely to report poor cultural competency than those with higher educational attainment and a shorter relationship with their health care provider.
In this sample of patients with diabetes receiving care in safety-net outpatient clinics, race/ethnicity, age, educational attainment, self-reported health status, depressive symptoms, and length of relationship with one’s primary care provider were significantly associated with specific aspects of culturally competent care. After full adjustment, participants with depressive symptoms were significantly more likely than those without depressive symptoms to report poor cultural competency in the Doctor Communication – Positive Behaviors domain, while African-Americans were significantly less likely than Whites to report poor cultural competency in the Doctor Communication – Positive Behaviors domain. Participants who reported a 3 year or longer relationship with their primary care provider were less likely than those with a briefer relationship with their primary care provider to report poor cultural competence in the Doctor Communication – Health Promotion and Trust domains, while participants with lower educational attainment were less likely than those with higher educational attainment to report poor cultural competence in the Trust domain. Overall, however, sociodemographic and clinical differences in reports of poor cultural competence were insignificant or inconsistent across the various domains of cultural competence. Our data suggests that cultural competence interventions in safety-net settings should be broadly implemented across populations, rather than being narrowly focused on specific sociodemographic or clinical groups.
There may be a number of factors contributing to our surprising finding that African-Americans were less likely than Whites to report poor cultural competency in the Doctor Communication – Positive Behaviors domain. First, all of our patients were recruited from the safety-net setting. Our clinical experience suggests that, compared to Mexican-American and African-American patients, many more White patients seeking care in these settings are homeless, use illicit substances, or have ongoing psychiatric illness. It may be that White patients experience less culturally competent care not because of their race but because of these other co-morbidities. Second, different racial/ethnic groups may have different expectations of their care, and these differences may be reflected in their reports of cultural competency. To the extent that cultural competency is related to patient satisfaction, our results are consistent with research showing that African-Americans sometimes report greater satisfaction than Whites in certain domains of care and practice settings.(9, 14) However, studies focusing more narrowly on domains of cultural competency have been relatively consistent in their finding that Whites report care that is more culturally competent.(15, 16) Further research will be needed to fully understand why Whites reported less culturally competent care in this setting.
Duration of relationship with one’s primary care provider was highly associated with cultural competency in the Doctor Communication - Health Promotion and Trust domains. In the safety-net setting from which we recruited, patients with a brief relationship with their primary care provider are more likely to receive care from a resident physician or mid-level health professional. It is therefore unclear from this data whether duration of relationship with one’s provider or provider level of experience is really the important predictor of cultural competency experiences. Although interventions may certainly be targeted toward extending the duration of patient-provider relationships (for example, by preventing discontinuous insurance enrollment), our data may also indicate the importance of focusing cultural competency training efforts on providers with the least clinical experience.
We observed a strong relationship between depressive symptoms and poor cultural competency in the Doctor Communication – Positive Behaviors domain. Studies examining patient satisfaction or perceptions of providers’ communication quality have also demonstrated associations with depressive symptoms,(17–21) including among patients with diabetes.(22) Medicare beneficiaries with depressive symptoms are significantly more likely to report worse experiences of care in other CAHPS domains as well.(23) Although there is little research specifically focusing on perceptions of cultural competency among patients with depressive symptoms in the primary care setting, it is plausible that the association we observed between depression and poor cultural competency has multiple mechanisms. First, the manifestations of depression are culturally bound, and therefore providing optimal care to a patient with depression may require a higher level of cultural competency than providing care to a patient with a less culturally bound illness. Second, the perception of poor cultural competence may be a manifestation of the depression itself, i.e. patients with depression are more likely to report all aspects of their care as poor simply because they are depressed. Finally, patients with depression are “often disengaged, unassertive, and poorly informed”,(23) which may limit providers’ opportunities for establishing rapport or demonstrating the cultural competence of their care. Based on these hypothetical pathways, it seems reasonable that cultural competency training courses for providers practicing in safety-net settings should specifically address the provision of culturally competent care to patients with depression, and the manifestations of depression in diverse populations. Although it may also seem reasonable to target cultural competency efforts to patients with depressive symptoms, such a narrow focus may miss a large number of patients experiencing less culturally competent care. Finally, improving treatment of depression may change patients’ perceptions of the cultural competence of their care. However, we are aware of no studies which specifically test the effects of these kinds of interventions on patient perceptions of cultural competence.
Our results have a number of limitations. Health care providers who are more values-motivated may gravitate toward jobs in safety-net settings, as these settings often present the greatest opportunity to interact with patients of diverse cultural backgrounds.(24) Therefore cultural competence skills of providers in our sample may be higher than cultural competence skills of less highly selected providers. Similarly, practice organization and systems-based health care in the safety-net setting may respond to increased patient diversity with an increased emphasis on providing culturally competent care. Patient perceptions of cultural competence in settings outside the safety-net and large, diverse urban areas may therefore be lower. Patients without diabetes, and particularly those without health conditions that require highly effective and ongoing patient-provider communication, may exhibit different socioeconomic and clinical associations with cultural competence. Finally, we are not able to determine from this data whether perceptions of cultural competency explain any sociodemographic inequalities in health care outcomes.
Although some sociodemographic and clinical sub-groups in the safety-net setting report less culturally competent care, in general differences among groups are inconsistent across various domains of cultural competency. These findings suggest that cultural competency efforts in safety-net settings should be broadly targeted, rather than focusing on specific population subgroups.
Funds were provided by the Russell Sage Foundation and the Commonwealth Fund.