PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of jamiaAlertsAuthor InstructionsSubmitAboutJAMIA - The Journal of the American Medical Informatics Association
 
J Am Med Inform Assoc. 2017 January; 24(1): 106–112.
Published online 2016 June 6. doi:  10.1093/jamia/ocw062
PMCID: PMC5201183

Computer use, language, and literacy in safety net clinic communication

Abstract

Objective: Patients with limited health literacy (LHL) and limited English proficiency (LEP) experience suboptimal communication and health outcomes. Electronic health record implementation in safety net clinics may affect communication with LHL and LEP patients.

We investigated the associations between safety net clinician computer use and patient-provider communication for patients with LEP and LHL.

Materials and Methods: We video-recorded encounters at 5 academically affiliated US public hospital clinics between English- and Spanish-speaking patients with chronic conditions and their primary and specialty care clinicians. We analyzed changes in communication behaviors (coded with the Roter Interaction Analysis System) with each additional point on a clinician computer use score, controlling for clinician type and visit length and stratified by English proficiency and health literacy status.

Results: Greater clinician computer use was associated with more biomedical statements (+12.4, P = .03) and less positive affect (−0.6, P < .01) from LEP/LHL patients. In visits with patients with adequate English proficiency/health literacy, greater clinician computer use was associated with less positive patient affect (−0.9, P < .01), fewer clinician psychosocial statements (−3.5, P < .05), greater clinician verbal dominance (+0.09, P < .01), and lower ratings on quality of care and communication.

Conclusion: Higher clinician computer use was associated with more biomedical focus with LEP/LHL patients, and clinician verbal dominance and lower ratings with patients with adequate English proficiency and health literacy.

Discussion: Implementation research should explore interventions to enhance relationship-centered communication for diverse patient populations in the computer era.

Keywords: electronic health records, health communication, limited English proficiency, health literacy, chronic disease, primary care, specialty care, safety net providers

BACKGROUND AND SIGNIFICANCE

US safety net clinics serve many patients with limited English proficiency (LEP) and limited health literacy (LHL), vulnerable populations shown to experience disparities in access to care, receipt of preventive services, treatment adherence, adverse safety events, and health outcomes.1–12 Communication barriers during medical encounters may potentiate these health disparities, with studies showing that providers engage with these patients less effectively.13–16

Electronic health records (EHRs) complicate patient-clinician communication. With the 2009 Health Information Technology for Economic and Clinical Health Act, clinics began implementing EHRs, requiring intensive computer use for maintaining documentation, prescribing medications, ordering and reviewing tests, and providing interdisciplinary communication.17,18 Evidence for how EHRs impact quality of care is mixed,18–23 with little known about their effects on safety net patient-clinician communication. Research suggests that clinician EHR use may change the patterns and patient-centeredness of clinician-patient communication,24–28 but no studies have focused on LEP or LHL populations or patients with chronic disease seeking specialty care. EHRs could facilitate communication with LEP and LHL patients by providing information about care received across multiple settings or visual tools for patient education. Alternatively, computer use could amplify the communication challenges vulnerable patients experience. Thus, it is important to study how safety net EHR use may affect communication with ethnically diverse, vulnerable populations with chronic disease.

OBJECTIVE

In a recent observational study in safety net primary and specialty care, we reported that higher clinician computer use was associated with lower patient ratings of quality of care, greater patient-clinician chitchat, and more disagreements between clinicans and patients.29 In this analysis, we examined associations between clinician computer use and communication behaviors for patients with LEP and LHL.

METHODS

Study setting and population

We conducted this observational study from November 1, 2011, to November 30, 2013, at a large, urban, academically affiliated US public hospital using a “basic EHR,” prior to implementation of a “fully functional EHR” certified by the federal incentive program.30 Eligible patients included English- or Spanish-speaking adults (age >18) with at least 1 of 3 chronic medical conditions (diabetes, congestive heart failure, or rheumatoid arthritis) who received primary care in the adult internal medicine or family medicine clinic AND subspecialty care at a diabetes, cardiology, or rheumatology clinic. During this study, all clinicians used the EHR to review diagnostic test results, track health care maintenance delivery, prescribe medications, and submit electronic referrals. The adult internal medicine and diabetes clinics mandated documentation of EHR visit notes, while this was optional in family medicine, cardiology, and rheumatology. Eligible clinicians included physicians, nurse practitioners, fellows, and residents.

Participant recruitment

Eligible participants were informed that the study focused on “how using computers affects the way patients and clinicians talk to each other.” We emailed eligible clinicians lists of eligible patients generated from upcoming appointments, as well as 3 preexisting cohorts of patients with diabetes, congestive heart failure, or rheumatoid arthritis from prior studies.31–34 Clinicians could decline participation for themselves or designate particular patients as ineligible based on the criteria above.

We mailed letters to eligible patients offering the opportunity to decline participation. Research assistants then enrolled patients and obtained informed consent by phone before scheduled visits.

Clinicians and patients gave written informed consent. A native Spanish-speaking research analyst translated all patient materials and consent forms into Spanish. The University of California, San Francisco (UCSF) Committee on Human Research approved this study.

Data collection

During patient enrollment calls, research assistants conducted structured previsit interviews. During the subsequent visit, the clinician- patient encounter was videotaped, and post-visit patient interviews occurred in person or via telephone. Native Spanish speakers translated and back-translated Spanish interview items into English.

Clinician participants also completed baseline and post-visit paper or online questionnaires.

LEP and LHL: We measured patient English proficiency and health literacy using scales previously validated in similar populations.2,35,36 We categorized Spanish-speaking patients who reported English proficiency as less than “very well” as having LEP.2 We categorized patients who were “somewhat,” “a little bit,” or “not at all” “confident filling out medical forms by yourself” as having LHL.2,35,36

Clinician Computer Use: The independent variable was clinician computer use, rated by video coders using an instrument developed from a literature review of computer use behaviors.24–28 For this score, 4 ratings were summed: amount of computer use to review data, amount of typing/clicking, eye contact with the patient, and noninteractive pauses. Scale response options range from none (0) to high (3), with “eye contact” reversed. Scores ranged from 0–12 (Cronbach’s α 0.67). Higher scores indicated more computer use. On 4 videos, the average interrater reliability was 0.90 by Pearson correlation coefficient. To validate this measure, we also calculated the correlation (0.66) between this computer rating and the total number of statements that included concurrent clinician computer use during 33 encounters. We did not use these statement counts as the predictor, because they omitted computer use during silences.

Patient and Clinician Communication Behaviors: We analyzed videos using the Roter Interaction Analysis System (RIAS), a valid and reliable system to assess patient and clinician communication behaviors during encounters.37–40 Analysts assigned 1 of 37 mutually exclusive and exhaustive categories to each complete thought expressed by patients and clinicians. Codes were combined in categories including rapport-building, biomedical talk (illness and therapy), and psychosocial/lifestyle talk (patient experience and life situation). Five investigators coded 71 visits. A native Spanish speaker coded encounters with spoken Spanish. The average interrater reliability was 0.74 by Spearman’s correlation coefficient on 4 videos.

Patient-centeredness is calculated by summing RIAS codes promoting the patient’s socioemotional, psychosocial, and biomedical agenda and dividing this by the sum of codes related to the clinician’s biomedical agenda. Values greater than 1 are more patient-centered and values less than 1 are more clinician-centered biomedically oriented encounters.41–45 A clinician verbal dominance ratio was calculated by dividing all clinician statements by all patient statements.46 Finally, clinician and patient positive affect was calculated by summing coders’ overall ratings for “attentiveness,” “friendliness,” “engagement,” and “empathy”; for clinicians, the score was totaled after subtracting the rating for “hurried.”40,46,47

Patient Perceptions: Patients rated clinician communication over the prior 6 months using the Interpersonal Processes of Care (IPC) instrument, which averages items over 6 domains: communicating clearly, eliciting/responding to concerns, explaining results, sharing decision-making, having a compassionate/respectful style, and experiencing discrimination.48,49 Higher subscale averages (range 0–5) for “lacks clarity” and “perceives discrimination” were worse, while higher averages for other domains represented better communication. IPC subscale differences ranging from 0.06–0.47 have been reported as significant beta-coefficients associated with patient satisfaction with physicians and care in a diverse patient sample.50

Data Analysis

All regression analyses used generalized estimating equations (GEEs) to account for within-clinician correlations.52 Multilevel regression to investigate within-patient correlations yielded nearly identical results to GEE analyses; given the non-nested nature of the sample levels and the minimal effects of within-patient correlations, we chose GEE as a more accurate approach. We controlled for observable patient, clinician, and relationship characteristics (P < .10) associated with clinician computer use in bivariate analyses, except for educational attainment, which can over-adjust and obscure differences with health literacy/English proficiency.53 As is standard in RIAS analyses, we also controlled for visit length, although it was not associated with amount of computer use. Analyses were conducted using Stata/SE Version 12.1 (College Station, TX, USA).

We first stratified all analyses by English proficiency and health literacy separately. Because findings were similar across analyses and 6 patients (8%) had BOTH LEP and LHL, we created a separate indicator for patients with LEP OR LHL (21 patients in 34 encounters). Thus, the final analyses examined the association between computer use and the outcomes, stratified by LEP OR LHL vs patients with adequate English proficiency AND health literacy.

RESULTS

Participants

Among 78 primary care clinicians, 44 lacked eligible consenting patients. Among the remaining 34, 28 (82%) participated and 6 (18%) declined. Among 22 specialty care clinicians, 9 lacked eligible consenting patients. Among the remaining 13, 11 (85%) participated and 2 (15%) declined. Among 165 initially screened patients, clinicians deemed 33 of them ineligible and 7 were deceased. Among the remaining 125 patients, 47 (38%) participated, 1 (1%) dropped out prior to full enrollment, 13 (10%) declined, and 64 (51%) could not be contacted.

We recorded 71 encounters among 47 patients and 39 clinicians. Table 1 describes the characteristics of patients and clinicians, and their relationships.

Table 1.
Patients and clinicians in a study of communication behaviors by clinician computer use in safety net encounters

Among patients, 13 (28%) had LEP and 14 (30%) had LHL. Six (8%) had both LEP and LHL. Twenty-one (45%) had limited English proficiency, inadequate health literacy, or both. Analyses below were stratified across encounters for these 21 patients vs the 26 patients who had adequate English proficiency AND adequate health literacy.

Amount of clinician computer use

Observed scores covered the 0–12 range. The average and median clinician computer use scores were 6.3 (SD 2.9) and 6. In bivariate analyses, higher computer use was associated with P < .10 with nurse practitioners (vs physicians), fewer clinician years in practice, and certain clinics (general medicine, family medicine, and diabetes). Thus we controlled for these variables and visit length in multivariate analyses.

Differences from low computer use encounters

Tables 2 and and33 show differences in communication behaviors and patient ratings with each additional point in the clinician computer use score, stratified by patient English proficiency/health literacy.

Table 2.
Differences in communication behaviors with each increasing point in clinician computer use score, stratified by limited vs adequate English proficiency/health literacy (n = 71)
Table 3.
Differences in patient ratings with increasing each point in clinician computer use score, stratified by limited vs adequate English proficiency/health literacy (n = 71)

In encounters for patients with limited English proficiency OR health literacy, greater clinician computer use was associated with more patient biomedical statements (+12.4, P = .03) and less positive patient affect (−0.6, P < .01). Patient ratings were not significantly associated with clinician computer use.

In encounters with patients with adequate English proficiency AND health literacy, greater clinician computer use was associated with less positive patient affect (−0.9, P < .01), fewer clinician psychosocial statements (−3.5, P < .05), and greater verbal dominance by clinicians (+0.09, P < .01). Greater clinician computer use was also associated with lower patient ratings for eliciting/responding to concerns (−0.11, P < .01), explaining results (−0.19, P < .01), sharing decision-making (−0.16, P < .01), demonstrating compassion/respect (−0.11, P < .01), and overall quality of care (AOR for “excellent” rating 0.46, P < .01)

DISCUSSION

In this safety net study of chronic disease communication, for patients at the highest risk for communication challenges, greater clinician computer use was associated with greater focus on biomedical information and less positive affect during the encounter. However, patients with adequate health literacy and English proficiency experienced greater verbal dominance and offered lower ratings of their clinicians.

This study adds to the growing communication literature about EHR use, which suggests complex effects on patient-provider communication.25,28 EHR implementation may amplify the positive aspects of clinicians’ baseline communication style (eg, clinicians using computers to engage and educate patients) or the negative aspects (eg, distracting them from patients even more than paper records do).25 On the positive side, keyboarding has been associated with increased patient education and patient disclosure of medical information.27 However, a recent Veterans Affairs study found that more primary care providers with longer computer gaze times were rated as less patient-centered.24

Our cross-sectional study cannot draw causal inferences, but our findings suggest that greater clinician computer use could amplify communication challenges for LHL and LEP patients. Greater computer use by clinicians was associated with more biomedical information given by LHL/LEP patients. Because LHL and LEP patients are more vulnerable to misinformation and misunderstandings,2–12 high- computer-use clinicians may be eliciting or clarifying information related to perceived gaps in patient knowledge revealed by the EHR. However, these exchanges could represent a high “health literacy demand” for patients.54 In addition, a strong biomedical focus may shift the agenda away from patients’ psychosocial concerns, values, and goals.27 Prior studies have shown that LEP patients receive less facilitation and more often have their statements ignored by their providers,13 while LHL patients ask fewer questions during encounters14,15 and experience less shared decision-making.14,16

Thus, while EHRs may enhance clinician access to patient health information and patient educational materials, it is important to consider whether diverse patients can comprehend the content of these discussions or materials. Studies have found that health information available at the point of care and via online resources exceeds the literacy levels of the average US adult,55–59 and one study found that patients have low levels of recall of the content of a typical EHR-generated after-visit summary.59 Future research should study the spoken health literacy demands of EHR-driven conversations and whether health technologies are increasing rather than decreasing the confusion of vulnerable patients.

Moreover, our findings on patients with adequate English proficiency and health literacy are consistent with research showing differences in patient satisfaction associated with clinician computer use.24 This may relate to the greater verbal dominance in greater computer use encounters with these patients. Although patients felt early-generation EHRs improved quality of care and remained satisfied with their providers’ communication,26,59,60 a more recent study found that patients rated their primary care providers as less effective when the providers spent more time looking at the computer.24 Although patient affect was lower with greater clinician computer use for both groups, we did not find significant differences in LEP/LHL patient ratings by clinician computer use. In our prior research, ethnic minorities and LEP patients had more positive attitudes than their counterparts about the impact of computers on clinician communication.61 Our findings suggest that future EHR research should not simply survey patients about their perspectives on computer use, but should use multimethod approaches, paying attention to measuring experiences in different populations.

Limitations of the study should be noted. First, our results may be affected by volunteer bias. Our sample size and participation rate are comparable to other studies using this video-recording methodology,25,27 but the declining or nonreachable patients may have differed from our sample. Second, the computer use score includes 2 items (pausing and eye contact) that could be affected by noncomputer factors, such as the use of paper charts. In addition, pausing and eye contact represent specific types of clinician behaviors in the context of computer use, and a multitasking clinician with fluent typing skills could maintain conversation and eye contact with patients while using the computer. However, the computer use score’s correlation with coding of computer use with concurrent statements suggests validity, and an advantage of the observer rating scale is that it accounts for computer use in the absence of verbal statements. Future research should explore how communication is affected by the style of computer use, as distinct from the degree of computer use, particularly to inform potential interventions for improving how clinicians use computers during patient encounters. (See Appendices 1 and 2 for the associations in the entire cohort between each score item and select communications outcomes and patient ratings.) Third, confounding by unmeasured factors, particularly at the clinic level, may have affected the results. However, overadjustment by some factors included in the multivariate analysis may obscure other differences attributable to computer use. Fourth, patient ratings had a 6-month recall time frame, but provider computer use may have varied over 6 months. Fifth, our sample size may not have been powered to detect modest differences by degree of computer use in stratified analyses, and the findings in this paper should be considered exploratory. Future research with larger numbers of patients is needed to determine whether the findings in this small study are replicable. Finally, this cross-sectional study cannot be used to make causal inferences.

The study strengths include the use of a validated communication coding system; communication scales validated for use in diverse populations; primary care and specialty care providers; physicians and nurse practitioners; and a socioeconomically and linguistically diverse safety net population.

CONCLUSION

In summary, greater clinician computer use in safety net primary and specialty care was associated with greater focus on biomedical information exchange for LEP/LHL patients, but with greater clinician verbal dominance and lower ratings by patients with adequate English proficiency and health literacy status.

Future implementation research should explore how clinician computer use impacts health outcomes among patients with communication barriers and whether EHR interfaces, infrastructural interventions, and skills-based curricula can foster relationship-centered communication with diverse patient populations.62,63

CONTRIBUTORS

N.R. had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: N.R., E.H.Y., D.S.

Acquisition, analysis, and interpretation of data: N.R., J.L.B., C.R.L., M.W., D.M.

Drafting of the manuscript: N.R., E.H.Y.

Critical revision of the manuscript for important intellectual content: J.L.B., C.R.L., M.W., E.H.Y., D.M., D.S.

Statistical analysis: N.R., E.H.Y.

Obtained funding: N.R., D.S.

Administrative, technical, or material support: J.L.B, C.R.L., M.W., D.M., D.S.

Study supervision: N.R., E.H.Y., D.S.

FUNDING

Research reported in this publication was supported by AHRQ grants 1K08HS022561 and K99HS022408, National Institute of Arthritis and Musculoskeletal and Skin Diseases grant 1K23AR064372-01A1, the Hellman Family Foundation, and the National Center for Advancing Translational Sciences of the NIH under Award Number KL2TR000143. Dr Schillinger is supported by the Health Delivery Systems Center for Diabetes Translational Research, funded through NIDDK grant 1P30-DK092924. The contents are solely the responsibility of the authors and do not necessarily represent the official views of AHRQ or the NIH. Drs Ratanawongsa and Barton were fellows supported by the Pfizer Medical Academic Partnership Fellowship in Health Literacy, under the mentorship of Drs Schillinger and Yelin. Pfizer had no role in the design and conducting of the study; collection, management, analysis, and interpretation of the data; or preparation, review, or approval of the manuscript.

COMPETING INTERESTS

None declared.

REFERENCES

1. Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med. 2011;155:97–107. [PubMed]
2. Wilson E, Chen AH, Grumbach K, Wang F, Fernandez A. Effects of limited English proficiency and physician language on health care comprehension. J Gen Intern Med. 2005;20:800–806. [PMC free article] [PubMed]
3. Lopez-Quintero C, Berry EM, Neumark Y. Limited English proficiency is a barrier to receipt of advice about physical activity and diet among Hispanics with chronic diseases in the United States. J Am Diet Assoc. 2009;109:1769–1774. [PubMed]
4. DuBard CA, Gizlice Z. Language spoken and differences in health status, access to care, and receipt of preventive services among US Hispanics. Am J Public Health. 2008;98:2021–2028. [PubMed]
5. Jacobs EA, Karavolos K, Rathouz PJ, Ferris TG, Powell LH. Limited English proficiency and breast and cervical cancer screening in a multiethnic population. Am J Public Health. 2005;95:1410–1416. [PubMed]
6. Kripalani S, Jacobson TA, Mugalla IC, Cawthon CR, Niesner KJ, Vaccarino V. Health literacy and the quality of physician-patient communication during hospitalization. J Hosp Med. 2010;5:269–275. [PMC free article] [PubMed]
7. Wolf MS, Davis TC, Osborn CY, Skripkauskas S, Bennett CL, Makoul G. Literacy, self-efficacy, and HIV medication adherence. Patient Educ Couns. 2007;65:253–260. [PubMed]
8. Sarkar U, Karter AJ, Liu JY, Moffet HH, Adler NE, Schillinger D. Hypoglycemia is more common among type 2 diabetes patients with limited health literacy: The Diabetes Study of Northern California (DISTANCE). J Gen Intern Med. 2010;25:962–8. [PMC free article] [PubMed]
9. Schillinger D, Grumbach K, Piette J, et al. Association of health literacy with diabetes outcomes. JAMA. 2002;288:475–482. [PubMed]
10. Dewalt DA, Berkman ND, Sheridan S, Lohr KN, Pignone MP. Literacy and health outcomes: a systematic review of the literature. J Gen Intern Med. 2004;19:1228–1239. [PMC free article] [PubMed]
11. Sanders LM, Federico S, Klass P, Abrams MA, Dreyer B. Literacy and child health: a systematic review. Arch Pediatr Adolesc Med. 2009;163:131–140. [PubMed]
12. Fernandez A, Schillinger D, Warton EM, et al. Language barriers, physician-patient language concordance, and glycemic control among insured Latinos with diabetes: the Diabetes Study of Northern California (DISTANCE). J Gen Intern Med. 2011;26:170–176. [PMC free article] [PubMed]
13. Rivadeneyra R, Elderkin-Thompson V, Silver RC, Waitzkin H. Patient centeredness in medical encounters requiring an interpreter. Am J Med. 2000;108:470–474. [PubMed]
14. Aboumatar HJ, Carson KA, Beach MC, Roter DL, Cooper LA. The impact of health literacy on desire for participation in healthcare, medical visit communication, and patient reported outcomes among patients with hypertension. J Gen Intern Med. 2013;28:1469–1476. [PMC free article] [PubMed]
15. Katz MG, Jacobson TA, Veledar E, Kripalani S. Patient literacy and question-asking behavior during the medical encounter: a mixed-methods analysis. J Gen Intern Med. 2007;22:782–786. [PMC free article] [PubMed]
16. Schillinger D, Bindman A, Wang F, Stewart A, Piette J. Functional health literacy and the quality of physician-patient communication among diabetes patients. Patient Educ Couns. 2004;52:315–323. [PubMed]
17. Jha AK. Meaningful use of electronic health records: the road ahead. JAMA. 2010;304:1709–1710. [PubMed]
18. Cebul RD, Love TE, Jain AK, Hebert CJ. Electronic health records and quality of diabetes care. N Engl J Med. 2011;365:825–833. [PubMed]
19. Kern LM, Kaushal R. Measuring the impact of “meaningful use” on quality of care. JAMA Intern Med. 2014;174:998–999. [PubMed]
20. Samal L, Wright A, Healey MJ, Linder JA, Bates DW. Meaningful use and quality of care. JAMA Intern Med. 2014;174:997–998. [PubMed]
21. Kern LM, Barron Y, Dhopeshwarkar RV, Edwards A, Kaushal R, Investigators HITEC. Electronic health records and ambulatory quality of care. J Gen Intern Med. 2013;28:496–503. [PMC free article] [PubMed]
22. Poon EG, Wright A, Simon SR, et al. Relationship between use of electronic health record features and health care quality: results of a statewide survey. Med Care. 2010;48:203–209. [PubMed]
23. Walsh MN, Albert NM, Curtis AB, et al. Lack of association between electronic health record systems and improvement in use of evidence-based heart failure therapies in outpatient cardiology practices. Clin Cardiol. 2012;35:187–196. [PubMed]
24. Street RL, Jr, Liu L, Farber NJ, et al. Provider interaction with the electronic health record: the effects on patient-centered communication in medical encounters. Patient Educ Couns. 2014;96:315–319. [PMC free article] [PubMed]
25. Frankel R, Altschuler A, George S, et al. Effects of exam-room computing on clinician-patient communication: a longitudinal qualitative study. J Gen Intern Med. 2005;20:677–682. [PMC free article] [PubMed]
26. Rouf E, Whittle J, Lu N, Schwartz MD. Computers in the exam room: differences in physician-patient interaction may be due to physician experience. J Gen Intern Med. 2007;22:43–48. [PMC free article] [PubMed]
27. Margalit RS, Roter D, Dunevant MA, Larson S, Reis S. Electronic medical record use and physician-patient communication: an observational study of Israeli primary care encounters. Patient Educ Couns. 2006;61: 134–141. [PubMed]
28. Pearce C, Kumarpeli P, de Lusignan S. Getting seamless care right from the beginning—integrating computers into the human interaction. Stud Health Technol Inform. 2010;155:196–202. [PubMed]
29. Ratanawongsa N, Barton JL, Lyles CR, et al. Association between clinician computer use and communication with patients in safety-net clinics. JAMA Intern Med. 2016;176:125–128. [PMC free article] [PubMed]
30. Hsiao CJ, Hing E, Socey TC, Cai B. Electronic Medical Record / Electronic Health Record Systems of Office-based Physicians: United States, 2009 and Preliminary 2010 State Estimates. Atlanta, GA: CDC National Center of Health Statistics; 2010.
31. Ratanawongsa N, Handley MA, Sarkar U, et al. Diabetes health information technology innovation to improve quality of life for health plan members in urban safety net. J Ambul Care Manage. 2014;37:127–137. [PMC free article] [PubMed]
32. Barton JL, Trupin L, Tonner C, et al. English language proficiency, health literacy, and trust in physician are associated with shared decision making in rheumatoid arthritis. J Rheumatol. 2014;41:1290–1297. [PMC free article] [PubMed]
33. Barton JL, Trupin L, Schillinger D, et al. Racial and ethnic disparities in disease activity and function among persons with rheumatoid arthritis from university-affiliated clinics. Arthritis Care Res. 2011;63: 1238–1246. [PMC free article] [PubMed]
34. DeWalt DA, Broucksou KA, Hawk V, et al. Comparison of a one-time educational intervention to a teach-to-goal educational intervention for self-management of heart failure: design of a randomized controlled trial. BMC Health Serv Res. 2009;9:99. [PMC free article] [PubMed]
35. Sarkar U, Schillinger D, Lopez A, Sudore R. Validation of self-reported health literacy questions among diverse English and Spanish-speaking populations. J Gen Intern Med. 2011;26:265–271. [PMC free article] [PubMed]
36. Chew LD, Griffin JM, Partin MR, et al. Validation of screening questions for limited health literacy in a large VA outpatient population. J Gen Intern Med. 2008;23:561–566. [PMC free article] [PubMed]
37. Roter DL, Hall JA, Katz NR. Relations between physicians' behaviors and analogue patients' satisfaction, recall, and impressions. Med Care. 1987;25: 437–451. [PubMed]
38. Roter DL, Stewart M, Putnam SM, Lipkin M, Jr, Stiles W, Inui TS. Communication patterns of primary care physicians. JAMA. 1997;277: 350–356. [PubMed]
39. Levinson W, Roter DL, Mullooly JP, Dull VT, Frankel RM. Physician-patient communication. The relationship with malpractice claims among primary care physicians and surgeons. JAMA. 1997;277:553–559. [PubMed]
40. Cooper LA, Roter DL, Johnson RL, Ford DE, Steinwachs DM, Powe NR. Patient-centered communication, ratings of care, and concordance of patient and physician race. Ann Intern Med. 2003;139:907–915. [PubMed]
41. Ford S, Fallowfield L, Lewis S. Doctor-patient interactions in oncology. Soc Sci Med. 1996;42:1511–1519. [PubMed]
42. Mead N, Bower P. Measuring patient-centredness: a comparison of three observation-based instruments. Patient Educ Couns. 2000;39:71–80. [PubMed]
43. Paasche-Orlow M, Roter D. The communication patterns of internal medicine and family practice physicians. J Am Board Fam Pract. 2003;16: 485–493. [PubMed]
44. Ratanawongsa N, Roter D, Beach MC, et al. Physician burnout and patient-physician communication during primary care encounters. J Gen Intern Med. 2008;23:1581–1588. [PMC free article] [PubMed]
45. Beach MC, Saha S, Korthuis PT, et al. Patient-Provider Communication Differs for Black Compared to White HIV-Infected Patients. AIDS Behav. 2011;15:805–811. [PMC free article] [PubMed]
46. Roter D, Larson S. The Roter interaction analysis system (RIAS): utility and flexibility for analysis of medical interactions. Patient Educ Couns. 2002;46: 243–251. [PubMed]
47. Beach MC, Roter DL, Wang NY, Duggan PS, Cooper LA. Are physicians' attitudes of respect accurately perceived by patients and associated with more positive communication behaviors? Patient Educ Couns. 2006;62:347–354. [PMC free article] [PubMed]
48. Stewart AL, Napoles-Springer AM, Gregorich SE, Santoyo-Olsson J. Interpersonal processes of care survey: patient-reported measures for diverse groups. Health Serv Res. 2007;42:1235–1256. [PMC free article] [PubMed]
49. Schillinger D, Handley M, Wang F, Hammer H. Effects of self-management support on structure, process, and outcomes among vulnerable patients with diabetes: a three-arm practical clinical trial. Diabetes Care. 2009;32: 559–566. [PMC free article] [PubMed]
50. Napoles AM, Gregorich SE, Santoyo-Olsson J, O'Brien H, Stewart AL. Interpersonal processes of care and patient satisfaction: do associations differ by race, ethnicity, and language? Health Ser Res. 2009;44:1326–1344. [PMC free article] [PubMed]
51. Ratanawongsa N, Korthuis PT, Saha S, et al. Clinician Stress and Patient-Clinician Communication in HIV Care. J Gen Intern Med. 2012;27: 1635–1642. [PMC free article] [PubMed]
52. Zeger SL, Liang KY. Longitudinal data analysis for discrete and continuous outcomes. Biometrics. 1986;42:121–130. [PubMed]
53. DeWalt DA, Pignone MP. “Reading is fundamental: the relationship between literacy and health.” Arch Intern Med. 2005;165(17):1943–1944. [PubMed]
54. Roter DL. Oral literacy demand of health care communication: challenges and solutions. Nurs Outlook. 2011;59:79–84. [PubMed]
55. Brigo F, Erro R. The readability of the English Wikipedia article on Parkinson's disease. Neurol Sci. 2015;36:1045–1046. [PubMed]
56. Moccia M, Carotenuto A, Massarelli M, Lanzillo R, Brescia Morra V. Can people with multiple sclerosis actually understand what they read in the Internet age? J Clin Neurosci. 2015;25:167–168. [PubMed]
57. Stossel LM, Segar N, Gliatto P, Fallar R, Karani R. Readability of patient education materials available at the point of care. J Gen Intern Med. 2012;27: 1165–1170. [PMC free article] [PubMed]
58. Pavlik V, Brown AE, Nash S, Gossey JT. Association of patient recall, satisfaction, and adherence to content of an electronic health record (EHR)–generated after visit summary: a randomized clinical trial. J Am Board Fam Med. 2014;27:209–218. [PubMed]
59. Callen JL, Bevis M, McIntosh JH. Patients' perceptions of general practitioners using computers during the patient-doctor consultation. HIM J. 2005;34:8–12. [PubMed]
60. Garrison GM, Bernard ME, Rasmussen NH. 21st-century health care: the effect of computer use by physicians on patient satisfaction at a family medicine clinic. Fam Med. 2002;34:362–368. [PubMed]
61. Ratanawongsa N, Barton JL, Schillinger D, Yelin EH, Hettema JE, Lum PJ. Ethnically diverse patients' perceptions of clinician computer use in a safety-net clinic. J Health Care Poor Underserved. 2013;24:1542–1551. [PMC free article] [PubMed]
62. Duke P, Frankel RM, Reis S. How to integrate the electronic health record and patient-centered communication into the medical visit: a skills-based approach. Teach Learn Med. 2013;25:358–365. [PubMed]
63. Frankel RM. Computers in the Examination Room. JAMA Intern Med. 2016; 176:128–129. [PubMed]

Articles from Journal of the American Medical Informatics Association : JAMIA are provided here courtesy of American Medical Informatics Association