PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Health Expect. Author manuscript; available in PMC 2013 March 1.
Published in final edited form as:
Health Expect. 2012 March; 15(1): 63–77.
Published online 2011 January 11. doi:  10.1111/j.1369-7625.2010.00654.x
PMCID: PMC3570254
NIHMSID: NIHMS438758

The Patient-reported Clinicians’ Cultural Sensitivity Survey (CCSS): A Field Test among Older Latino Primary Care Patients

Anna M. Nápoles, PhD, MPH,1 Jasmine Santoyo-Olsson, MS,1,2 Georgianna Farren, MD, MEd,3 Jill Olmstead, MSN, NP-C,4 Ruben Cabral, MD,5,6 Barry Ross, RN, MPH, MBA,6 Steven E. Gregorich, PhD,1 and Anita L. Stewart, PhD2

Abstract

Background

Patient-reported measures of clinicians’ cultural sensitivity are important to assess comprehensively quality of care among ethnically diverse patients and may help address persistent health inequities.

Objective

Create a patient-reported, multidimensional survey of clinicians’ cultural sensitivity to cultural factors affecting quality of care.

Design

Using a comprehensive conceptual framework, items were written and field-tested in a cross-sectional telephone survey. Multitrait scaling and factor analyses were used to develop measures.

Setting and Participants

Latino patients ≥ age 50 from primary care practices in California.

Main Variables Studied

35 items hypothesized to assess clinicians’ sensitivity

Main Outcomes Measures

Validity and reliability of cultural sensitivity measures.

Results

Twenty-nine of 35 items measuring 14 constructs were retained. Eleven measures assessed sensitivity issues relevant to all participants: complementary and alternative medicine; mind-body connections; causal attributions; preventive care; family involvement; modesty; prescription medications; spirituality; physician discrimination due to education; physician discrimination due to race/ethnicity; and staff discrimination due to race/ethnicity. Three measures were group specific: two to limited English proficient patients (sensitivity to language needs and discrimination due to language) and one to immigrant (sensitivity to immigrant status). Twelve multi-item scales demonstrated adequate reliability (alpha ≥ .68 except for Spanish discrimination due to education) and evidence of construct validity (item-scale correlations for all scales > .40 except for sensitivity to immigrant status). Two single item measures demonstrated sufficient construct validity to retain for further development.

Discussion and Conclusions

The Clinicians’ Cultural Sensitivity Survey can be used to assess the quality of care of older Latino patients.

Keywords: cultural sensitivity, cultural competence, Latinos, Hispanics, quality of care

INTRODUCTION

Providing culturally competent health care is congruent with providing high quality care and can contribute to reducing ethnic disparities in health care and patient outcomes. The U.S. Department of Health and Human Services based the Culturally and Linguistically Appropriate Services standards on the following definition of cultural and linguistic competence: “a set of congruent behaviors, attitudes, and policies that come together in a system, agency, or among professionals that enables effective work in cross-cultural situations.” 1 To successfully address persistent disparities, valid and reliable measures of cultural and linguistic competence of health care that incorporate the perspectives of ethnically diverse patients are needed. Measures of cultural competence have been developed at the health plan or system level, but less has been done to develop valid consumer reported measures based on the perspectives of ethnically diverse groups. 2

Quality of care indicators used in the U.S. have been developed by the National Committee on Quality Assurance, the Agency for Healthcare Research and Quality, and the Foundation for Accountability, however, these generally do not address cultural factors. They typically include only a few single items on access to interpreters. In a comprehensive review of conceptual frameworks of cultural competence, 5 of 9 domains reflected topics that need to be operationalized and validated as consumer reported indicators: values and attitudes; cultural sensitivity; communication; intervention and treatment models; and family and community participation. 3 Most measures of these domains consist of health care professional and staff self-assessments of their own cultural competence or of system-level factors, such as the extent to which medical interpreters are available. 4-6

Recently, two patient-reported measures of clinician cultural competence appeared in the literature. 7, 8 These instruments differ in their approach and the constructs included. Tucker and associates developed ethnic group-specific surveys of patient-centered culturally sensitive care that included the following domains: Provider Behaviors and Attitudes, Office Staff Behaviors and Attitudes, and Center Policies and Physical Environment Characteristics. 7 Respondents were asked to indicate how much they agreed or disagreed that their providers, staff, or health care center demonstrated the characteristic described by the items. Lucas, et. al., designed a cultural competence instrument to be suitable for any ethnic group. 8 Their 9-item survey was based on a three-factor theoretical model of perceived cultural competency of mental health services that assesses Cultural Knowledge, Cultural Awareness, and Cultural Skill of providers. 9 Patients were asked to rate the extent of knowledge, awareness, or skill of their most recent provider on a 7-point Likert scale.

Our research group developed the Interpersonal Processes of Care Survey that includes measures of three major domains: communication; patient-centered decision making; and the interpersonal style of clinicians. 10, 11 In these studies, although we conceptualized cultural sensitivity as a key subdomain of the interpersonal style of clinicians, in confirmatory factor analyses of the hypothesized cultural sensitivity items, they tended to load on other constructs such as friendliness and respect. Thus, their unidimensionality was not supported. We further explored this concept in our second study using qualitative methods to perform a detailed analysis of 19 focus groups conducted with African American, Latino, and White patients in which patients were asked about cultural factors that affected the quality of their medical encounters. Results led to a multidimensional conceptual framework of cultural sensitivity as consisting of sensitivity and attention to a variety of cultural factors. 12

In this paper, we describe several patient-reported measures of cultural sensitivity based on our published multidimensional conceptual framework. We developed the survey so that it could be incorporated into standard patient-reported encounter-level measures of quality of care. We included both general and group-specific cultural constructs because both types of factors may be important in patient assessments of their care and as potential mechanisms of health disparities. 11 For example, evidence suggests that for Spanish-speaking Latinos, sensitivity to language needs may help explain ethnic disparities in patient outcomes. 13, 14

We report here the psychometric properties of the Patient-reported Clinicians’ Cultural Sensitivity Survey (CCSS) measures within Spanish- and English-speaking Latinos. We nested this initial field test of the measures in a study of colorectal cancer screening. We selected Latinos for this study because they represent the largest and fastest growing minority ethnic group in the U.S., and typically report poorer quality health care and communication with their clinicians than Whites. 13, 15, 16

METHODS

Conceptual Framework of Cultural Sensitivity

As noted above, from our published multidimensional conceptual framework of cultural factors 12 we selected a subset of cultural factors pertaining to interpersonal processes of care, e.g., physicians’ knowledge and acceptance of non-Western or holistic approaches to health such as herbal treatments, sensitivity to patients’ preferences for involving their families in health care decision making, and discrimination due to ethnicity or education. We did not include a few domains from that framework because they could not be operationalized as interpersonal processes, for example, physician-patient ethnic concordance (a system factor) and patient submissiveness (not a process of care). We incorporated two additional dimensions from our original IPC study10 pertaining to preventive care and prescription medications. These dimensions were included because patients in our focus groups indicated having cultural values which influenced their use of these health care services and products that they felt were important for clinicians to know about.

The resulting framework became the basis for developing survey items. The framework includes two general domains relevant to all minority patients: 1) sensitivity of doctors to patients’ cultural beliefs and practices (e.g., complementary and alternative medicine); and 2) discrimination by physicians and office staff (e.g., discrimination due to race/ethnicity). Additional domains pertain to special subgroups: for limited English proficient persons (LEP), we conceptualized sensitivity to language needs and for immigrants, sensitivity to immigrant status.

Survey Development

Survey items for the Patient-reported Clinicians’ Cultural Sensitivity Survey (CCSS) were developed to assess each domain, drawn from the focus group data that was the basis for the conceptual framework, 12 our earlier work attempting to measure cultural sensitivity, 10, 11 and a review of recent cultural competence literature. Prior surveys and frameworks of cultural competence were reviewed to identify interpersonal constructs that could be operationalized via medical encounter level patient reports. An item pool of over 200 items was created and all items were translated into Spanish using rigorous translation methods. Translation was accomplished using forward-backward translations by bilingual-bicultural research staff of Mexican, Central American, and South American origin. Discrepancies were reconciled by expert team review by bilingual-bicultural investigators of Mexican, Central American, South American, and Caribbean origin.

English and Spanish items were then subjected to cognitive pretesting (N=15; 3 in English and 12 in Spanish). We developed open-ended probe questions for each item that were designed to determine if the items were understood as intended. 17 Respondents’ comments were aggregated by item and reviewed by the research team. The team then discussed the comments and reached consensus on whether they supported the need to drop, modify, or retain the original item.

Based on pretest results, we selected 35 items for the final field test. The response options for all items were: 1=never; 2=rarely; 3=sometimes; 4=usually; and 5=always.

Sample

Our sample included adult general medicine patients from a large, Southern California multi-specialty physician group practice and three community clinics, one in Southern California and two in Northern California. The community clinics were safety net clinics meaning they tended to see a majority of uninsured or underinsured, low-income patients. The proportion of Latino patients seen at the community clinics ranged from 56%-80%, while the multi-specialty group practice tended to see a more socioeconomically and ethnically diverse patient population.

The sampling frame was derived from medical records databases that contained information on patient’s name, address, phone number, ethnicity, age, gender, date of most recent primary care visit, name of clinic site, name of primary care doctor, and type of health insurance. The sampling frame consisted of Latino adults aged 50 and older who had made at least one visit between January 1, 2007 and September 2, 2008, to one of the participating sites of care. Inclusion criteria were: 1) at least 50 years or older; 2) Latino or Hispanic (confirmed by self-identification); 3) spoke English or Spanish; and 4) no personal history of colorectal cancer. Stratifying by clinic site, we randomized people in the sampling frame in batches of 100 per clinic site. We selected 6 batches from the multi-specialty group practice, 5 batches from the Northern California community clinics, and all 239 people from the Southern California community clinic because there were fewer patients at this site. Our aim was to complete approximately 500 interviews with equal representation from each site.

Telephone Survey

Telephone interviews were conducted by bilingual-bicultural interviewers between October 2008 and May 2009 using computerized telephone-assisted survey (CATI) technology. Interviews were conducted in the respondent’s preferred language (English or Spanish). Interviewers and respondents were matched on gender for most interviews. On average, interviews lasted about 30 minutes. Interviewers obtained verbal informed consent prior to the interview. All procedures were approved by the academic health center’s Institutional Review Board.

Methods of Analysis

The goal of the analysis was to determine whether the hypothesized domains and subdomains could be measured by structured items and scored as scales that were reliable and yet relatively independent. Multitrait scaling analysis, a confirmatory approach, was performed to examine the psychometric properties of the hypothesized scales 18 and factor analysis was used to confirm the final structure.

Multitrait scaling analysis assessed whether the assumptions on which Likert scales are based are met, namely, item convergence, item discrimination, items in the same scale contribute a similar proportion of information about the construct, and items measuring the same construct have approximately equal variances. 19 Item convergence (items are substantially linearly related to the underlying concept) was considered adequate if the item correlated .30 or more with its hypothesized scale (item-scale correlation corrected for overlap), which is adequate for summated scales. 18

Item discrimination was determined to be adequate if the item correlated more highly with its own hypothesized scale than with other scales. Item-scale correlations within a hypothesized scale were examined to see if they were roughly equal and contributed a similar proportion of information. Item standard deviations were examined to see if item variance was approximately equal. The reliability of the scales was assessed using Cronbach’s alpha coefficient with .60 as the criterion which is considered adequate for group comparisons, as well as in the early stages of scale development. 18, 20 We also conducted item-level analysis, e.g., skewness, missing data. SAS version 9.1 was used for all analyses.

The multitrait analysis was conducted separately for the general scales applicable to all groups and for the scales that were group-specific. For the group-specific analyses, Sensitivity to Language Needs scales were assessed among limited English proficient (LEP) respondents only (speaks English not at all, poorly or fairly) and Sensitivity to Immigrant Status was assessed for recent immigrants only (those living in the U.S. 10 years or less).

Initial exploratory factor analysis (EFA) models with ML factor extraction and Harris-Kaiser oblique rotation were fit to the data. Subsequently, a confirmatory factor analysis (CFA) model was fit to the EM covariance matrix of the retained items; each item loaded on only one factor, all item residual covariances were fixed to equal zero, and all inter-factor covariances were freely estimated. Group-specific CCSS scales (nine items specific to limited English proficient or immigrant subgroups) were not included in the factor analyses).

To assess construct validity, a priori hypotheses about the correlations of the hypothesized scales with previously validated scales assessing interpersonal processes of care (IPC-29 Survey scales of elicitation, respect, patient-centered decision making, and explained results) 11 and a single-item measure of patient satisfaction (“In general, how would you rate the care you received at ‘name of clinic’, poor, fair, good, very good, or excellent?”) were specified and used to test the construct validity of the cultural sensitivity scales. One of the IPC-29 scales, elicitation, was modified by adding two items based on the focus group data that demonstrated excellent scaling properties in this sample (“How often did doctors make you feel comfortable enough to ask questions?” and “How often did doctors make you feel comfortable enough to share your opinions about your health care?”).

We examined the correlations between the final CCSS measures (inter-scale correlations) to assess redundancy of the constructs. Finally, mean scale scores were compared between English- and Spanish-speaking respondents.

RESULTS

Sample Characteristics

Of those contacted and eligible (N = 817), 62% or 505 people participated in the survey. Of the total sampling frame composed of 1,311 people who were mailed an invitation letter, 39% participated in the survey. Compared to non-respondents, respondents were significantly more likely to be women (p < .01) and uninsured (p < .01). There was no difference on age between respondents and non-respondents.

The mean age of the sample was 61 years, almost 70% were women, 70% had ≥ a high school education, and most were foreign-born (Table 1). About 40% were publicly insured or uninsured and almost 50% were in fair or poor health. Patients reported an average of six medical visits in the past 12 months.

Table 1
Sample Characteristics by Language of Survey

Spanish-speakers were more likely to be women, single, less educated, unemployed, foreign-born, shorter term U.S. residents, LEP, publicly or non-insured, and in fair or poor health (p < .01 or smaller). Spanish-speakers were significantly less likely to have seen a doctor in the past 12 months who speaks their preferred language (p < .001).

Scaling Analyses

The final conceptual framework of the Patient-reported Clinicians’ Cultural Sensitivity Survey (CCSS) is depicted in Figure 1. Cultural sensitivity is conceptualized as an Interpersonal Style domain of the Interpersonal Processes of Care Conceptual Framework. 10, 11 Final CCSS items are listed in an online appendix (Table A1). Scales were scored as the mean of non-missing items with possible scale scores ranging from 1 to 5. A higher score indicates reports of more experiences of the labeled construct, i.e., more cultural sensitivity or discrimination. In the online appendix, for multi-item measures, we present the range of item-scale correlations, and internal consistency reliability for the total sample and by survey language (Table A2). Next, we describe psychometric results by survey domain.

Figure 1
Cultural Sensitivity as an Interpersonal Style Domain of the Interpersonal Processes of Care Conceptual Framework1

Clinicians’ Cultural Sensitivity Survey-General: Sensitivity to Cultural Beliefs and Practices

Eight measures of cultural beliefs and practices were retained. Six of these were retained as multi-item scales based on results of psychometric analyses (complementary and alternative medicine, mind-body connections, causal attributions, preventive care, family involvement, and modesty). For these six scales, item-scale correlations exceeded our criterion of ≥ .30, supporting their convergent validity. All of the final items except for one item of the preventive care scale correlated significantly higher with their hypothesized scale than with other scales, supporting the discriminant validity of these scales (results not shown). We retained the preventive care item for further development because the correlation with its own scale was equal to its correlation with only one other item from the causal attribution scale. Furthermore, Cronbach’s alpha for each of the six scales was ≥ .70, exceeding our criterion of .60 for internal consistency. Finally, with a few exceptions, inter-scale correlations among the six scales were all less than .50, indicating that they assessed relatively independent constructs. Two correlations were > .60, those between causal attributions and preventive care and causal attributions and modesty.

Two measures originally hypothesized as multi-item scales did not demonstrate adequate psychometric properties for summated scales, prescription medications and spirituality. These were both retained as single item measures.

Originally, two items were hypothesized to assess sensitivity to patients’ concerns about taking prescription medications. One focused on elicitation of patients’ concerns (doctors asked if they might have concerns about taking prescription medicines) and the other was about giving explanations (doctors told them why the medicine they were prescribing was important for them to take). These items did not meet item convergence or reliability criteria. We retained the first item as a single-item measure because it was important in the formative qualitative studies and has face validity, i.e., it is important for physicians to identify any cultural barriers to taking prescription medications.

Similarly, originally two items were hypothesized to assess spirituality: one asked how often doctors respected their faith, religion or spiritual beliefs and the other asked how often doctors asked if they had any religious or spiritual beliefs that might affect their health or health care. The item asking about whether doctors respected their faith had a sizeable proportion of “don’t know” (26%) and “not applicable” responses (7%), indicating that the construct, although relevant, did not typically surface in the context of the medical encounter. The item asking about the frequency with which doctors asked about religious beliefs that might affect their care had less missing data (6% combined for “don’t know,” “not applicable,” and “refused”) so this was retained as a single item indicator given its importance in our earlier work. This item, however, had a skewed distribution indicating that doctors asked infrequently about religious beliefs that might affect patient care (84% responded never/rarely). Thus, response options or the item may need to be modified to capture greater variability.

In summary, six items from the Sensitivity to Cultural Beliefs and Practices scales were dropped. Two items from the complementary and alternative medicine scale were dropped due to a high proportion of missing data (20% and 29%). These items asked how often doctors made them feel comfortable enough to talk about alternative medicines and were open to talking about alternative medicines. The high proportion of missing values consisted largely of “not applicable” responses. One item from the mind-body connections scale was dropped because it had poor discriminant validity; it correlated more highly with three of the other scales than with its hypothesized scale. We dropped one item from the causal attributions scale and one item from the prescription medications three discrimination scales ranged from .28 to .42 supporting that they measured unique constructs.

Clinicians’ Cultural Sensitivity Survey-For Limited English Proficient (LEP) Persons

Two scales assessing sensitivity to language needs were originally hypothesized, one assessing the physician’s sensitivity and the other the staff’s sensitivity; both contained positively and negatively worded items. Rather than being viewed as separate constructs about physicians or scale because they were weakly correlated with their hypothesized scales (item-scale correlations < .20). We dropped one item from the spirituality scale due to the high proportion of “don’t know” responses to the item, which asked how often doctors respected their faith, religion or spiritual beliefs.

Clinicians’ Cultural Sensitivity Survey-General: Discrimination

All three discrimination scales were confirmed, although the discrimination due to education scale performed less well than did the discrimination due to race/ethnicity and staff discrimination due to race/ethnicity scales because it performed worse in Spanish-speakers. Item-scale correlations exceeded .30 for all scales in this domain, supporting their convergent validity. All of the final items correlated significantly higher with their hypothesized scale than with other scales, supporting the discriminant validity of these scales (results not shown). Cronbach’s alpha for the three scales was ≥ .70 in all cases except for the Spanish version of the discrimination due to education scale (alpha = .54). Correlations between the staff, the item-scale correlations revealed that these constructs were viewed as distinct by patients based on whether the items were worded positively (sensitivity to the need for interpreters) or negatively (discrimination due to limited English fluency). Thus, the final two scales for LEP groups consist of sensitivity to language needs and discrimination due to language needs. Item-scale correlations were > .40 for both scales, supporting their convergent validity. All of the final items correlated significantly higher with their hypothesized scale than with other scales, supporting the scales’ discriminant validity (results not shown). Cronbach’s alpha = .69 for sensitivity to language needs and .76 for discrimination due to language needs. The correlation between these two scales was .01. The language sensitivity scale asked about the patient’s need for an interpreter, while the discrimination scale asked about discrimination due to limited proficiency in English.

Clinicians’ Cultural Sensitivity Survey-For Recent Immigrants

The scale specific to immigrants was confirmed. Item-scale correlations for the sensitivity to immigrant status scale ranged between .34 – .62 and the final items correlated significantly higher with their hypothesized scale than with other scales. Cronbach’s alpha was 0.68, exceeding our criterion. Correlations between this scale and the sensitivity to language needs and discrimination due to language needs scales were .28 and .18 indicating that it is unique from these other group-specific constructs.

Correlations between CCSS Measures and Interpersonal Processes of Care (IPC) and Patient Satisfaction

Correlations between the 14 CCSS measures, four IPC scales, and patient satisfaction are presented in Table 2. Of the 56 correlations between the CCSS measures and the four IPC measures, 45 were in the expected direction. The remaining 11 correlations were not hypothesized to be significantly correlated with specific IPC scales when in fact they were related. For example, we did not expect that mind-body connections and causal attributions would be related to explaining test results, but they were positively correlated (.27 and .45, p < .0001). Although we hypothesized that all 14 of the CCSS measures would be positively related to patient satisfaction, three of the scales did not correlate significantly with satisfaction (spirituality, sensitivity to language needs, and sensitivity to immigrant status). Causal attributions and modesty were most strongly associated with patient satisfaction.

Table 2
Correlations between Validity Variables and the Patient-reported Clinicians’ Cultural Sensitivity Survey Measures

Summary of Multitrait Scaling Analysis

Twenty-nine of 35 original items representing fourteen constructs were retained, supporting generally the adequacy of our conceptual framework for the instrument. The construct validity and reliability of 12 multi-item scales were supported and results tended to be similar for English and Spanish versions of the survey. The construct validity of two single-item measures was also supported, prescription medications and spirituality. Eleven of the measures assessed constructs relevant to all participants and three measures were specific to LEP or immigrant groups.

Summary of Factor Analysis

In the initial EFA models of the items hypothesized as belonging to the general cultural sensitivity scales, three of the initial 26 items were dropped because of a high rate of “don’t know” or “not-applicable” responses. These items asked how often doctors made them feel comfortable enough to talk about alternative medicines, how often doctors were open to talking about alternative medicines, and how often doctors respected their faith, religion, or spiritual beliefs. This resulted in one single-item factor, which was also dropped (the spirituality item that was retained in the multitrait scaling). In subsequent EFA models, four additional items were dropped because of low factor loadings. These items asked about how often doctors asked if they might have concerns about taking prescription medications, how often doctors told them why the medicine they were prescribing was important to take, how often doctors took the time to get to know them a little better, and how often doctors jumped to a conclusion without giving them a chance to describe their health problem. All 4 items were also dropped in multitrait scaling analyses.

Subsequently, a CFA model with 9 factors was fit to the EM covariance matrix of the 18 retained items. The model fit the data well: χ2(99) = 122.06, p = .06. The standardized factor loadings (Table A3) and inter-factor correlations (Table A4) from the CFA model are presented in the online appendix. Factor analyses essentially confirmed the multitrait scaling results and suggested dropping the same items from the general cultural sensitivity scales.

Descriptive Statistics: CCSS Mean Scores

First, we describe scales where a higher score indicates greater cultural sensitivity. On the Sensitivity to Cultural Beliefs and Practices Scales, 5 of 8 mean scale scores were below 3 on a scale of 1-5 suggesting that providers are not often practicing cultural sensitivity (i.e., less than “sometimes”). Mean scores were highest for causal attributions (mean = 3.75) and modesty (mean = 3.63). In general, Spanish-speaking Latinos tended to report less culturally competent care than English-speakers. Compared to English-speakers, Spanish-speakers reported less sensitivity to beliefs and practices about complementary and alternative medicine (p < .05), mind-body connections (p < .01), causal attributions (p < .05), and modesty (p < .001).

Next, we describe mean scores on scales where a higher score indicates less cultural sensitivity. Mean scores were lowest for discrimination due to race/ethnicity (mean = 1.18) and discrimination due to language needs (mean = 1.20) indicating that discrimination from all sources tended to be reported less than “rarely.” Spanish-speakers reported significantly higher scores on discrimination due to education than English-speakers; there were no differences between groups on discrimination due to race-ethnicity.

DISCUSSION

We successfully developed a Patient-reported Clinicians’ Cultural Sensitivity Survey (CCSS), a multi-dimensional patient-reported survey of clinicians’ cultural sensitivity. Patients were able to distinguish between clinicians’ sensitivity to a variety of cultural beliefs and practices ranging from those related to complementary and alternative medicine to attitudes about preventive care and experiences of discrimination. We were able to operationalize a number of cultural domains that affect health care from the patient perspective that have not been previously addressed in patient-reported measures of cultural competence. The construct validity and reliability of the English and Spanish versions of the CCSS measures were generally supported. Furthermore, the measures were viewed as conceptually distinct from each other and from other measures of clinicians’ interpersonal processes of care, such as elicitation of patients’ concerns, respect, and patient-centered decision making. For the most part, they were also associated with patient satisfaction.

The CCSS fills a gap in the availability of measures of cultural competence by adding many cultural dimensions from the perspectives of ethnically diverse patients that can influence the quality of medical encounters. Much of the research exploring racial/ethnic differences in quality of care has used ethnic and language concordance of clinicians and patients as explanatory factors, both of which are crude markers of specific cultural differences between providers and patients related to language, norms, health practices, preferred interpersonal styles, and experiences of discrimination. This study advances work on cultural sensitivity measures in several ways: it includes cultural constructs important to the quality of health care from the perspectives of White, Latino and African American patients; it includes cultural factors that are universal (can be generally applied) to these groups along with factors that are group-specific (relevant only for a specific cultural or ethnic group); it disentangles clinicians’ cultural sensitivity from cultural sensitivity of the health care environment and patient-centered care; and it includes English- and Spanish-speaking Latinos. We included both general and group-specific cultural constructs because both types of factors may be important in patient assessments of their care and as potential mechanisms of health disparities. 11 For example, evidence suggests that for Spanish-speaking Latinos, sensitivity to language needs may help explain ethnic disparities in patient outcomes. 13, 14

Reflecting the variability of ethnic groups in the U.S., the measures include cultural factors that are generally applicable to ethnically diverse patients along with factors that are group-specific. These new measures should help advance investigation of how clinicians’ sensitivity to specific cultural factors affects health outcomes or explains observed health disparities.

Two concepts, sensitivity to patients’ beliefs about taking prescription medications and spirituality, were challenging to operationalize and require further developmental work to improve their content validity. Additional items need to be tested to ensure that the content validity or breadth of these constructs is adequately represented.

Results for the prescription medications items suggest that this construct may be composed of two constructs, elicitation of patients’ concerns and providing explanations about their medications. We retained the elicitation of patients’ concerns about use of prescription medications item as a single-item measure to assess how well the clinician elicits any culturally mediated beliefs about medications so that any misconceptions can be addressed.

Spirituality, while important and relevant to health from the perspective of patients, is rarely discussed in the context of medical encounters based on our findings. However, for certain ethnic minority groups its role in coping with illness and promoting healing is important. 21-23 Assessing patients’ religious orientations is important for delivering culturally relevant care. 24 Thus, greater attention to the assessment of patients’ perceptions of clinicians’ sensitivity to spiritual issues is warranted.

The relatively low levels of cultural sensitivity on many of the measures suggests that there is significant room for improvement on these physician practices, especially from the perspective of Spanish-speaking patients. This is consistent with a previous study of patient-reported cultural sensitivity measures. 7 In addition, reports of worse cultural sensitivity among Spanish-speaking compared to English-speaking Latinos could reflect the effects of language barriers between patients and clinicians or less acculturation to mainstream beliefs. From the patient perspective, physicians tended to do best on eliciting causal attributions for their illness and being sensitive to modesty issues; reports of discrimination also tended to be low. According to patients, physicians did less well with eliciting patient preferences regarding involving family members and discussing spiritual beliefs that might be related to care.

Since our survey consists of reports of the frequency of specific clinician behaviors, it has the potential to identify specific targets for clinician training and quality improvement. Evidence suggests that providing physicians with cultural competence training can lead to self-reported improvements in specific behaviors, such as asking patients about the use of folk remedies and examining patients in a culturally appropriate manner. 6 Thus, assessing these behaviors from the patient’s point of view could result in higher quality care for patients who typically have experienced poorer care. The CCSS can complement existing quality of care measures by expanding their content to include cultural factors that are important to racially and ethnically diverse patients.

Results of this study may not generalize to people who are younger or non-Latino since only older Latinos were included in this study. Although this initial study only involved Latinos, the original qualitative work that guided the framework and development of items was conducted in African Americans and Whites, as well as Latinos. 12 A strength of this study is that it involved a variety of clinic settings (three community clinics and a large multi-specialty group practice) and locations (Southern and Northern California). However, the relevance of these measures for populations outside of California and for various Asian groups is unknown. Our approach, which asks patients to report the frequency of clinicians’ culturally sensitive behaviors, differs from another cultural competency survey that asks patients to rate the cultural awareness and skills of physicians. 8 Future studies can explore the relationships between reports and ratings of culturally sensitive care and patient outcomes.

Ultimately, tools such as this can be used to assess the impact of clinicians’ cultural sensitivity on the outcomes of ethnically diverse patients. One of these outcomes, patient satisfaction, is a metric that is becoming part of many organizations’ and third-party payers’ pay for performance criteria. With the current emphasis on patient-centered care and pay for performance, it is important to ascertain if the health care needs of culturally diverse populations are being met. To do so, the health care industry must be certain that current measures of quality of care are capturing aspects of quality that are relevant for ethnically diverse patients.

Though many minority patients prefer ethnic and language concordant physicians, 25 such physicians are seldom available due to their underrepresentation in the health care work force. 26 With such shortages of ethnically and linguistically diverse physicians, directed efforts are required to provide high quality care to multi-ethnic populations that is sensitive to their culturally-mediated preferences. These groups tend to experience poorer quality of care and greater communication problems during their visits than their White counterparts, which, in turn, contribute to health disparities and higher health care costs. The 2009 U.S. health care system costs of racial and ethnic disparities associated with preventable diseases is estimated to be $23.9 billion dollars. 27 In light of these costs, expansion of cultural competence measures makes sense not only on the grounds of equity, but also financially. With projected changes in the age and racial/ethnic composition of the U.S. population, culturally competent health care will continue to increase in importance.

Supplementary Material

Supp Appendix

Acknowledgements

We are indebted to the staff and patients at Marin Community Clinics, St. Jude Heritage Medical Center, and St. Jude Neighborhood Health Center who made this study possible.

Source of Funding: This research was supported by grant no. R21CA121176 from the National Cancer Institute; grant no. P30-AG15272 from the Resource Centers for Minority Aging Research program of the National Institute on Aging, the National Institute of Nursing Research, and the National Center on Minority Health and Health Disparities; and grant no. U01-CA86117 from the National Cancer Institute; National Institutes of Health, Bethesda, MD, USA.

Footnotes

Conflicts of Interest: The authors have no financial conflicts of interest to disclose.

REFERENCES

1. IQ Solutions I National standards for culturally and linguistically appropriate services in health care. Office of Minority Health; Rockville, MD: 2001. pp. 1–139.
2. Bethell C, Carter K, D. L, Latzke B, Gowen K. Measuring and interpreting health care quality across culturally-diverse populations: A focus on consumer-reported indicators of health care quality. Foundation for Accountability; Portland, OR: 2003. pp. 1–40.
3. The Lewin Group Inc Health Resources and Services Administration Study on Measuring Cultural Competence in Health Care Delivery Settings: A Review of the Literature. Vol. 2004. Health Resources and Services Administration, U.S. Department of Health and Human Services; 2001.
4. Betancourt JR, Green AR, Carrillo JE, Ananeh-Firempong O., 2nd Defining cultural competence: a practical framework for addressing racial/ethnic disparities in health and health care. Public Health Reports. 2003;118:293–302. [PMC free article] [PubMed]
5. Brach C, Fraser I. Can cultural competency reduce racial and ethnic health disparities? A review and conceptual model. Med Care Res Rev. 2000;57(Suppl 1):181–217. [PubMed]
6. Khanna SK, Cheyney M, Engle M. Cultural competency in health care: evaluating the outcomes of a cultural competency training among health care professionals. J Natl Med Assoc. 2009;101:886–92. [PubMed]
7. Tucker CM, Mirsu-Paun A, Van den Berg JJ, et al. Assessments for measuring patient-centered cultural sensitivity in community-based primary care clinics. J Natl Med Assoc. 2007;99:609–19. [PMC free article] [PubMed]
8. Lucas T, Michalopoulou G, Falzarano P, Menon S, Cunningham W. Healthcare provider cultural competency: development and initial validation of a patient report measure. Health Psychol. 2008;27:185–93. [PubMed]
9. Sue S, Zane N, Nagayama Hall GC, Berger LK. The case for cultural competency in psychotherapeutic interventions. Annu Rev Psychol. 2009;60:525–48. [PMC free article] [PubMed]
10. Stewart AL, Napoles-Springer A, Perez-Stable EJ. Interpersonal processes of care in diverse populations. Milbank Q. 1999;77:305–39. 274. [PubMed]
11. Stewart AL, Napoles-Springer AM, Gregorich SE, Santoyo-Olsson J. Interpersonal processes of care survey: patient-reported measures for diverse groups. Health Serv Res. 2007;42:1235–56. [PMC free article] [PubMed]
12. Nápoles-Springer AM, Santoyo J, Houston K, Perez-Stable EJ, Stewart AL. Patients’ perceptions of cultural factors affecting the quality of their medical encounters. Health Expectations. 2005;8:4–17. [PubMed]
13. Morales LS, Cunningham WE, Brown JA, Liu H, Hays RD. Are Latinos less satisfied with communication by health care providers? J Gen Intern Med. 1999;14:409–17. [PMC free article] [PubMed]
14. Wilson E, Chen AH, Grumbach K, Wang F, Fernandez A. Effects of limited English proficiency and physician language on health care comprehension. J Gen Intern Med. 2005;20:800–6. [PMC free article] [PubMed]
15. Napoles AM, Gregorich SE, Santoyo-Olsson J, O’Brien H, Stewart AL. Interpersonal processes of care and patient satisfaction: do associations differ by race, ethnicity, and language? Health Serv Res. 2009;44:1326–44. [PMC free article] [PubMed]
16. Weech-Maldonado R, Morales LS, Elliott M, Spritzer K, Marshall G, Hays RD. Race/ethnicity, language, and patients’ assessments of care in Medicaid managed care. Health Serv Res. 2003;38:789–808. [PMC free article] [PubMed]
17. Napoles-Springer AM, Santoyo-Olsson J, O’Brien H, Stewart AL. Using cognitive interviews to develop surveys in diverse populations. Med Care. 2006;44:S21–30. [PubMed]
18. Stewart AL, Hays RD, Ware JE. Methods of constructing health measures. In: Stewart AL, Ware JE, editors. Measuring Functioning and Well-being:The Medical Outcomes Study Approach. Duke University Press; Durham, NC: 1992. pp. 67–85.
19. Hays RD, Hayashi T, Carson S, Ware JE., Jr. The Multitrait Analysis Program (MAP) User’s Guide. The RAND Corporation; Santa Monica CA: 1988.
20. Nunnally JC. Psychometric Theory. McGraw-Hill; New York, NY: 1978.
21. Connell CM, Gibson GD. Racial, ethnic, and cultural differences in dementia caregiving: review and analysis. Gerontologist. 1997;37:355–64. [PubMed]
22. Harvey IS, Silverman M. The role of spirituality in the self-management of chronic illness among older African and Whites. J Cross Cult Gerontol. 2007;22:205–20. [PubMed]
23. Jones AC, Kwoh CK, Groeneveld PW, Mor M, Geng M, Ibrahim SA. Investigating racial differences in coping with chronic osteoarthritis pain. J Cross Cult Gerontol. 2008;23:339–47. [PMC free article] [PubMed]
24. Chatters LM, Bullard KM, Taylor RJ, Woodward AT, Neighbors HW, Jackson JS. Religious participation and DSM-IV disorders among older African Americans: findings from the National Survey of American Life. Am J Geriatr Psychiatry. 2008;16:957–65. [PMC free article] [PubMed]
25. Saha S, Taggart SH, Komaromy M, Bindman AB. Do patients choose physicians of their own race? Health Affairs. 2000;19:76–83. [PubMed]
26. Cohen JJ, Gabriel BA, Terrell C. The case for diversity in the health care workforce. Health Affairs. 2002;21:90–102. [PubMed]
27. Waidman T. Estimating the Cost of Racial and Ethnic Health Disparities. The Urban Institute; Washington, D.C.: 2009. p. 18.