Does the presence of a pharmacist in primary care clinics improve diabetes medication adherence?

doi:10.1186/1472-6963-12-391

BMC Health Serv Res. 2012; 12: 391.

Published online 2012 November 13. doi: 10.1186/1472-6963-12-391

PMCID: PMC3537712

Does the presence of a pharmacist in primary care clinics improve diabetes medication adherence?

Beverly Mielke Kocarnik,¹ Chuan-Fen Liu,^2,³ Edwin S Wong,^2,³ Mark Perkins,² Matthew L Maciejewski,^4,⁵ Elizabeth M Yano,^6,⁷ David H Au,^2,⁸ John D Piette,^9,¹⁰ and Chris L Bryson^1,²

¹Division of General Internal Medicine, University of Washington, 329 Ninth Ave, Campus Box 359780, Seattle, WA, 98104, USA

²Northwest Center for Outcomes Research in Older Adults, VA Puget Sound Health Care System, 1100 Olive Way, Suite 1400, Seattle, WA, 98101, USA

³Department of Health Services, University of Washington, Box 357660, Seattle, WA, 98195, USA

⁴Center for Health Services Research in Primary Care, Durham VA Medical Center, 508 Fulton St, Durham, NC, 27705, USA

⁵Division of General Internal Medicine, Duke University Medical Center, 2301 Erwin Rd, Durham, NC, 27710, USA

⁶Center for the Study of Healthcare Provider Behavior, Los Angeles VA 16111 Plummer St (152), Los Angeles, CA, 91343, USA

⁷Department of Health Services, University of California, 650 Charles Young Dr. S. 31-269 CHS, Box 951772, Los Angeles, CA, 90095, USA

⁸Department of Medicine, University of Washington, RR-512 Health Sciences, Box 356420, Seattle, WA, 98195, USA

⁹VA Center for Clinical Management Research, VA Ann Arbor Healthcare System, 2215 Fuller Rd., Mail Stop 152, Ann Arbor, MI, 48105, USA

¹⁰Department of Internal Medicine, University of Michigan School of Medicine, 1500 E. Medical Center Drive, Ann Arbor, MI, 48109, USA

Corresponding author.

Beverly Mielke Kocarnik: bmielke/at/uw.edu; Chuan-Fen Liu: chuan-fen.liu/at/va.gov; Edwin S Wong: edwin.wong/at/va.gov; Mark Perkins: mark.perkins2/at/va.gov; Matthew L Maciejewski: matthew.maciejewski/at/va.gov; Elizabeth M Yano: elizabeth.yano/at/va.gov; David H Au: david.au/at/va.gov; John D Piette: jpiette/at/umich.edu; Chris L Bryson: christopher.bryson/at/va.gov

Received May 18, 2012; Accepted November 4, 2012.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

This article has been cited by other articles in PMC.

Abstract

Background

Although oral hypoglycemic agents (OHAs) are an essential element of therapy for the management of type 2 diabetes, OHA adherence is often suboptimal. Pharmacists are increasingly being integrated into primary care as part of the move towards a patient-centered medical home and may have a positive influence on medication use. We examined whether the presence of pharmacists in primary care clinics was associated with higher OHA adherence.

Methods

This retrospective cohort study analyzed 280,603 diabetes patients in 196 primary care clinics within the Veterans Affairs healthcare system. Pharmacists presence, number of pharmacist full-time equivalents (FTEs), and the degree to which pharmacy services are perceived as a bottleneck in each clinic were obtained from the 2007 VA Clinical Practice Organizational Survey—Primary Care Director Module. Patient-level adherence to OHAs using medication possession ratios (MPRs) were constructed using refill data from administrative pharmacy databases after adjusting for patient characteristics. Clinic-level OHA adherence was measured as the proportion of patients with MPR >= 80%. We analyzed associations between pharmacy measures and clinic-level adherence using linear regression.

Results

We found no significant association between pharmacist presence and clinic-level OHA adherence. However, adherence was lower in clinics where pharmacy services were perceived as a bottleneck.

Conclusions

Pharmacist presence, regardless of the amount of FTE, was not associated with OHA medication adherence in primary care clinics. The exact role of pharmacists in clinics needs closer examination in order to determine how to most effectively use these resources to improve patient-centered outcomes including medication adherence.

Keywords: Pharmacist, Medication adherence, Diabetes mellitus, Oral hypoglycemic agent, Patient-centered medical home

Background

Oral hypoglycemic agents (OHA) are a therapeutic mainstay for type 2 diabetes patients with mild to moderate disease [1]. However, a systematic review of 20 studies indicated that OHA adherence rates range from 36-93% [2]. More recent studies have found that 65-78% of patients have an adherence rate of greater than 80% for oral hypoglycemic agents, which is a commonly accepted threshold for clinical effectiveness [1,3,4].

Tasks typically done by clinical pharmacists, including following a diabetes care algorithm [5], diabetes education, medication counseling, education about home glucose monitoring [6,7], adjustment of hypoglycemic regimens [6] and patient refill reminders, [8] have all been associated with improved medication adherence. A systematic review found that pharmacist-provided patient care was associated with reductions in hemoglobin A1c, LDL cholesterol, blood pressure and adverse drug events [9]. However, these studies usually evaluated specific pharmacy-based interventions rather than the influence of pharmacists in uncontrolled, “real-world” primary care practices.

Like many health systems nationally, the Veterans Health Administration (VA) is undergoing a major transformation of primary care to team-based care, by implementing a patient centered medical home (PCMH) model system wide [10,11] to improve access, coordination, and continuity of care. Pharmacists have been recommended as a standard component of patient-centered medical homes [12], but their impact on OHA adherence has not been studied. Pharmacists in VA primary care clinics may have a clinically oriented role by providing counseling and education to patients taking diabetes medications. However, pharmacists in VA may also be limited to a purely dispensing role or simultaneously manage both clinical and dispensing tasks. VA is a particularly good system for studying this question due to its nationally integrated computerized patient medical records, including pharmacy refill information, which provides an estimate for medication adherence. In VA, primary care is provided through clinics based at VA hospitals and their affiliated community based outpatient clinics [13]. A VA parent hospital and its affiliated community clinics share the management structure and support, such as administration, feedback regarding treatment quality, and centralized support for care management.

The purpose of this study was to examine whether the presence of pharmacists in VA primary care clinics was associated with improved adherence to OHAs among patients with type 2 diabetes. We hypothesized that the proportion of patients within a primary care clinic who would be adherent to OHAs was higher when a pharmacist was present, since these staff would be able to focus on barriers to obtaining refills and improvements in adherence counseling. We also examined the relationship between the degree of bottleneck in pharmacy services at the primary care clinics as reported by directors of primary care clinics and clinic-level medication adherence.

Methods

Data

This study used data from VA’s national administrative and pharmacy databases linked with a national survey of 196 primary care clinics focused on staffing and organizational barriers to care. Patient demographics, diagnoses, and utilization data from Fiscal Years (FYs) 2005–2007 were obtained from the VA Vital Status File, and medication adherence measures were constructed using pharmacy records from the FY2007 Decision Support System (DSS) National Outpatient Pharmacy Extracts. All data were measured prior to VA’s implementation of PCMH in April 2010.

To assess whether the integration of pharmacy staff in primary care clinics, as indicated by the PCMH model, improves adherence to OHAs, we obtained data on pharmacist presence and the number of full-time equivalent (FTE) pharmacists in a clinic from the 2007 Veterans Health Administration (VHA) Clinical Practice Organizational Survey—Primary Care Director Module [14]. The survey was sent to 250 VA primary care clinics, which included 153 hospital-based clinics and 97 community-based satellite clinics. The overall survey response rate was 93% [14,15]. Our study sample included 196 clinics that provided complete responses to the questions about pharmacists and pharmacy services. Human Subjects approval was obtained from Seattle, Durham and Ann Arbor VA Medical Centers.

Study sample

Patients with type 2 diabetes were identified using a previously validated algorithm based on two or more outpatient or one inpatient diabetes related ICD-9 diagnosis in FY2005 or FY2006 [16]. Users of OHAs, including sulfonylureas, metformin, and thiazolidinediones, were defined as those who had at least two non-partial (>30 day) fills of the same OHA in FY2006. Selection of these three OHAs was driven by the VA formulary and constituted over 98% of all OHA prescriptions in VA. For inclusion in our study, patients were required to be non-institutionalized, prescribed at least one class of OHA, and be alive through the end of FY2007. Patients were excluded if they were prescribed any insulin except neutral protamine Hagedorn (NPH) to remove those who may have transitioned to insulin therapy during the observation period. We did not exclude patients on NPH insulin because it was frequently used as an adjunct to oral therapy. Further exclusion criteria included: patients with a nursing home or extended hospital stay in FY2007, patients seen in VA clinics outside the continental United States, or patients treated at VA contracted clinics. If patients were seen at multiple VA primary care clinics, they were assigned to the one with the most visits or, if the numbers of visits were equal, were randomly assigned to one of the clinics. The final study sample included 280,603 diabetes patients who received care from 196 primary clinics for which data were also available from the primary care survey. These patients were a subset of a sample documented in a prior study [17].

Adjusted clinic-level medication adherence

Adherence to OHAs was estimated at the patient level using ReComp, a validated medication-possession ratio (MPR) algorithm described previously [18,19]. MPR has been shown to be correlated with hemoglobin A1c values in patients with diabetes [20]. Adherence was measured for each class of OHA in 90-day increments for all of FY2006 and FY2007 and the adherence values for the first quarter of FY2007 were used as the dependent variable. The 90-day time period was chosen since refill adherence for this 90-day duration is associated with physiologic outcomes [18]. Patients were considered adherent if they had medication available for 80 percent or more of the period, i.e., MPR>=80%. If patients were taking more than one OHA, the proportion of days covered during the period for each medication class was averaged into an overall adherence value. For example, a patient on both metformin and a sulfonylurea who had three 30-day fills (100%) of the sulfonylurea with one 30-day fills (33%) of metformin would have an average adherence score of 66.5%, which would be considered nonadherent to the overall regimen. Patients in VA obtain medication refills by either phoning the pharmacy, using an online patient portal (My HealtheVet), using automated calling systems, or making a clinic appointment.

Clinic-level adherence measures were then calculated based on the proportion of OHA adherent patients within a clinic. For example, if 140 of 200 patients in a clinic had 80% or greater adherence, then the clinic would have an adherence rate of 70%. To account for differences in patient characteristics across clinics that might influence clinic-level adherence scores, we risk adjusted clinic-level adherence scores using a hierarchical logistic regression model (see Wong, Piette et al. [17] for more details). Specifically, the model first estimated adherence at the patient level adjusting for patient characteristics known to impact adherence such as race and the presence of comorbid depression. Random intercepts were also included for parent hospitals and primary care clinics affiliated (i.e., nested) with each parent hospital to account for other facility characteristics that might influence adherence, such as the presence of automated phone systems for prescription refills. Predicted clinic-level adherence was then obtained from the patient-level model using the mean characteristics for a given clinic.

Measuring the role of pharmacists in the clinic

We used four measures, including presence of pharmacists, two pharmacist FTEs measures, and perception of pharmacy services as a bottleneck in primary care clinics, derived from the VHA Clinical Practice Organizational Survey.

Questions pertaining to the role of the pharmacist were completed by the primary care director at each clinic. In the survey, respondents were asked:with “pharmacists” among the listed options. If pharmacists were indicated, respondents were asked:

"“Which of the following types of clinicians or other staff are included as members of your primary care program?”"

"“What is the combined total of whole and part full-time equivalent employees (FTEs) currently allocated to your primary care program for this type of clinician?”"

For the current study, we measured the availability of pharmacists in each clinic in three ways: 1) a binary variable indicating whether any pharmacists were noted in the survey as included in the primary care program; 2) pharmacist FTE per 10,000 primary care patients to account for clinic size; and 3) pharmacist FTE per 100,000 primary care patient encounters to account for clinic workload.

For the perception of pharmacy services, respondents were asked: with “Pharmacy services” among the list of services. Questions regarding bottlenecks in primary clinics were adapted from clinic manager surveys administered by the Minimizing Error, Maximizing Outcome Study [21]. In their study, questions measuring the degree of bottleneck in different areas of a primary care clinic were asked after physicians pointed out process factors affecting quality and errors during focus groups [21,22]. These factors included inadequate resources, ambiguous or nonexistent policies, poor communication and errors in information systems [23]. We constructed a categorical measure of the pharmacy as a perceived bottleneck using the response options “little/no extent,” “some extent,” “moderate extent”, and “large extent”. We included all clinics because patients receiving primary care at clinics with no pharmacist have alternative means of obtaining medications from VA. However, none of these measures could delineate the exact role of pharmacists in primary care clinics (i.e. anticoagulation management, medication titration for chronic diseases such as hypertension and diabetes, patient medication counseling, facilitation of refills, patient consultation, etc.).

"“To what extent are each of the following a patient flow ‘bottleneck’ for your primary care clinic?”"

Statistical analysis

The level of analysis was the clinic (n=196). We performed ordinary least squares (OLS) regression with adjusted clinic-level medication adherence, i.e., proportion of OHA adherent patient in a clinic, as the outcome variable and pharmacist availability as the exposure of interest. Four separate analyses were performed, one for each of four different measures of pharmacist exposure described above.

Several auxiliary analyses were performed to evaluate model robustness and sensitivity to characteristics of the sample. Community-based clinics were significantly more likely to report having pharmacists than hospital-based clinics, therefore we performed sensitivity analysis of the effect of pharmacist availability separately within those two clinic-type subgroups. Results were similar, so we report the pooled sample results below. We also performed a sensitivity analysis using a 1-year adherence measure with similar results using a 90-day adherence measure, therefore we presented the results of 90-day adherence in this paper. We performed the Breusch-Pagan test [24] of heteroskedasticity to determine if clinic size affected the error variance, and found no evidence of heteroskedasticity. Also, a post-hoc power analysis by simulation [25] was performed to determine our statistical power to discern an effect of pharmacist presence in OLS models. Results indicated that with a sample of 196 clinics, assuming an alpha level of 0.05 (two-tailed) and a 1% effect size for clinic-level adherence, the estimated power was greater than 99%. For an assumed effect size of 0.5%, the estimated power was 95.5%. All analyses were performed using SAS Version 9.2 (SAS Corporation, Cary, NC USA).

Results

Descriptive statistics of adherence and pharmacist resources in primary care clinics

Among the 196 clinics, the number of patients with diabetes ranged from 241 to 7,399. Community based clinics on average had fewer diabetes patients than hospital-based clinics (1,019 versus 1,641, p<0.001). The average adjusted clinic-level adherence to OHAs was 70.7% and ranged from 57.5% to 79.1%. The average adjusted clinic-level adherence for primary care clinics with and without a pharmacist was 70.4% and 71.3%, respectively. Pharmacists were present in 70.4% of primary care clinics, with no significant difference in pharmacist availability between hospital-based clinics and community-based clinics (67.7% versus 75.8%, p=0.245). For those clinics that reported having a pharmacist, the average pharmacist FTE was 3.13 and ranged from 0.2 to 13 (Standard Deviation (SD)=2.43).

Descriptive statistics of patients in primary care clinics

Patients were predominantly older and male (Table (Table1).1). The average number of primary care visits per year was 3.9. The two most common comorbidities were hypertension (64.1%) and coronary artery disease (19.1%). Patients seen in clinics with a pharmacist differed from those seen in clinics without a pharmacist across a number of characteristics including race and incidence of chronic obstructive pulmonary disease and post-traumatic stress disorder.

Table 1

Descriptive statistics of study sample

Regression results

The model testing the effect on adherence of any pharmacist presence showed no statistically significant relationship (p=0.227). When adjusting for clinic size, pharmacist FTE per 10,000 primary care patients (p=0.494) and pharmacist FTE per 100,000 primary care encounters (p=0.723) were also not associated with clinic-level adherence (Table (Table2,2, Figures Figures11 and and2).2). The amount of variation in clinic-level adherence explained by pharmacist presence or pharmacist FTE was small with R-squared values ranging from 0.0009 to 0.0074. All results were similar when examining community-based and hospital-based clinics separately.

Table 2

Associations between clinic-level medication adherence and pharmacist presence and pharmacy is a bottleneck

Figure 1

Association between pharmacist full-time equivalents (FTE) per 10,000 primary care clinic patients and the proportion of patients adherent in primary care clinics.

Figure 2

Association between pharmacist full-time equivalents (FTE) per 100,000 primary care clinic patient visits and the proportion of patients adherent in primary care clinics.

Pharmacy bottleneck

Of the 196 clinics in our sample, those where pharmacy services were perceived as a bottleneck had poorer adherence (Wald statistic for trend, p=0.004). Adherence scores for clinics with a high degree of bottleneck (p=0.010), a moderate degree of bottleneck (p=0.031) and a small degree of bottleneck (p=0.057) were lower compared to clinics with little or no bottleneck (Table (Table2,2, Figure Figure3).3). The amount of variation in clinic-level adherence explained by pharmacy bottleneck measures was 4.2%.

Figure 3

Association between the perception of pharmacy services as a bottleneck and the proportion of patients adherent in primary care clinics.

Discussion

This study assessed the association between the presence of pharmacists and the proportion of diabetes patients adherent to OHAs within VA primary care clinics. The results indicate that adherence scores are not significantly better within clinics that have a pharmacist present, regardless of the amount of FTE pharmacist staff available. However, the perception of pharmacy services as a bottleneck was associated with lower clinic-level medication adherence. While the percent of variation in clinic-level adherence explained by each pharmacy measure was generally small (< 5%), relative to pharmacist presence measures, the perception of the pharmacy as a bottleneck had substantially greater explanatory power.

Our clinic-level findings generally differ from prior patient-level studies demonstrating the value of having pharmacists present in primary care clinics [9,26-29]. Most often, these studies evaluated a specific function or task related to the pharmacist as a mechanism for improving diabetes care. In contrast, the current study evaluated pharmacist presence and therefore characterizes their impact on adherence in more “real world” settings.

As the structure of clinics changes towards a multi-disciplinary team approach using the PCMH, there will be an increasing component of healthcare provided by the non-physician care management team [30]. The PCMH calls for pharmacists to be part of this team and pharmacists have been included in prior PCMH demonstration projects [31]. The goals of including pharmacists in the PCMH are to optimize medication regimens, improve management of chronic diseases, and lower barriers to adherence through assisting in refilling and renewal of medications [12,32]. VA is working towards complete implementation of a PCMH within all primary care clinics and has routinely included pharmacists in primary care clinics since 2010 [33]. Our results suggest that without a clearly defined role, simply including pharmacists in clinics may not improve adherence to OHAs.

As in other healthcare systems, several organizational factors in VA that are beyond pharmacists influence may contribute to adherence problems. For example, barriers in refilling medications could potentially mitigate the benefits of pharmacists. These barriers include trouble getting through on phone lines [34], lower health related internet use among veterans living in rural locations [35], and difficulty getting to clinics [36,37]. Although the role of a pharmacist in the PCMH model should ideally include helping to decrease barriers to accessing or refilling medications, pharmacists may currently have much different job functions. For example, if pharmacists are staffing anti-coagulation clinics, spending time dispensing medications, or completing other such tasks, then they will not have the ability to engage in activities such as medication education and counseling which have been shown to positively impact medication adherence for patients with diabetes.

The association between the degree of bottleneck in pharmacy services and clinic-level medication adherence suggests factors related to pharmacy services as perceived by the primary care director impair the timely dispensing of medications to patients. This result is consistent with a prior study showing pharmacy processes such as communication between inpatient discharge team, outpatient physicians and pharmacists were associated with a reduction in health care visits and readmission [38]. Although prior studies have shown the value of including pharmacists on general medicine teams [36,39], our results suggest that the mere presence of a pharmacist is not enough to improve medication adherence. Instead, organization resources, policies and procedures must be in place in order for pharmacists to effectively perform job duties.

Our study has several strengths. Data were drawn from a large, national administrative data system that includes information on several important confounding patient-level variables. The power for our study was excellent, with a greater than 99% ability to detect a 1% difference in clinic-level adherence between clinics with and without a pharmacist. Also, we were able to link administrative data to a nationwide clinic-level survey of pharmacist availability that is rarely available in other health systems and had a 93% response rate from 250 clinic representatives.

Several limitations exist in our study. First, we are unable to distinguish pharmacists based on variation across clinics in their training, duties, or activities. If pharmacists have more clinically-oriented roles at some locations, but are limited to only dispensing medications at other locations, then our findings are biased towards the null hypothesis, masking potential pharmacist benefits in facilities that have a more clearly defined adherence-support role for their pharmacists. Future research should also examine the exact roles of pharmacists within VA and whether there is any association with medication adherence based on specific clinical functions. Second, the measures of pharmacist availability and FTEs used in the study are reported by primary care directors, but have not been validated. However, these measures are the best that are currently available because administrative data do not indicate whether pharmacists are specifically assigned to a primary care clinic. Third, the number of community-based clinics reporting the presence of a pharmacist was higher than we expected, and some clinics may have reported on pharmacists at parent VA facilities who may have little day to day involvement in that community clinic. However, the results remain the same when we conducted the analysis including hospital-based clinics only, so we cannot attribute the observed null findings exclusively to reporting on off-site pharmacists. Finally, this study was conducted prior to the implementation of PCMH in VA. Further studies should examine the functions of pharmacists in that new primary care model.

Conclusions

In summary, the study shows that the proportion of patients adherent to OHAs in VA primary care clinics was not associated with the availability of pharmacists in that clinic. However, pharmacy services perceived as bottlenecked are associated with lower adherence. Our results call for further research disentangling the role of pharmacists in VA primary clinics and an examination of how these roles can most efficiently affect patient outcomes such as improved medication adherence.

Competing interests

DHA reports serving as a consultant for Bosch Inc. and receiving grants from Gilead Sciences. All other authors declare that they have no competing interests.

Authors’ contributions

BMK and CLB conceived the study. BMK, CFL, ESW, MP and CLB participated in its design. MP prepared the data for analysis and performed the statistical analyses. BMK drafted the manuscript. All authors participated in the analysis and interpretation of data and the critical revision of the manuscript for important intellectual content. CFL and CLB obtained funding for this project. All authors have read and approve the final manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6963/12/391/prepub

Acknowledgements

This research was supported by an Investigator Initiated Research Award (IIR 07-068-2) from the Department of Veterans Affairs, Health Services Research and Development. Dr. Wong is supported by VA Health Services Research and Development Postdoctoral Fellowship TPP 61–024. Dr. Piette is a VA Senior Research Career Scientist; Dr. Maciejewski and Dr. Yano are VA Research Career Scientists. Dr. Bryson was supported by VA Career Development Award 03–177.

The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs, the University of Washington, Duke University, the University of Michigan, and the University of California, Los Angeles.

References

Rozenfeld Y, Hunt JS, Plauschinat C, Wong KS. Oral antidiabetic medication adherence and glycemic control in managed care. Am J Manag Care. 2008;14(2):71–75. [PubMed]
Cramer JA. A systematic review of adherence with medications for diabetes. Diabetes Care. 2004;27(5):1218–1224. doi: 10.2337/diacare.27.5.1218. [PubMed] [Cross Ref]
Ho PM, Rumsfeld JS, Masoudi FA, McClure DL, Plomondon ME, Steiner JF, Magid DJ. Effect of medication nonadherence on hospitalization and mortality among patients with diabetes mellitus. Arch Intern Med. 2006;166(17):1836–1841. doi: 10.1001/archinte.166.17.1836. [PubMed] [Cross Ref]
Yeaw J, Benner JS, Walt JG, Sian S, Smith DB. Comparing adherence and persistence across 6 chronic medication classes. J Manag Care Pharm. 2009;15(9):728–740. [PubMed]
Davidson MB, Karlan VJ, Hair TL. Effect of a pharmacist-managed diabetes care program in a free medical clinic. Am J Med Qual. 2000;15(4):137–142. doi: 10.1177/106286060001500403. [PubMed] [Cross Ref]
Coast-Senior EA, Kroner BA, Kelley CL, Trilli LE. Management of patients with type 2 diabetes by pharmacists in primary care clinics. Ann Pharmacother. 1998;32(6):636–641. doi: 10.1345/aph.17095. [PubMed] [Cross Ref]
Jaber LA, Halapy H, Fernet M, Tummalapalli S, Diwakaran H. Evaluation of a pharmaceutical care model on diabetes management. Ann Pharmacother. 1996;30(3):238–243. [PubMed]
Skaer TL, Sclar DA, Markowski DJ, Won JK. Effect of value-added utilities on prescription refill compliance and health care expenditures for hypertension. J Hum Hypertens. 1993;7(5):515–518. [PubMed]
Chisholm-Burns MA, Kim Lee J, Spivey CA, Slack M, Herrier RN, Hall-Lipsy E, Graff Zivin J, Abraham I, Palmer J, Martin JR. et al. US pharmacists' effect as team members on patient care: systematic review and meta-analyses. Med Care. 2010;48(10):923–933. doi: 10.1097/MLR.0b013e3181e57962. [PubMed] [Cross Ref]
Jha AK, Perlin JB, Kizer KW, Dudley RA. Effect of the transformation of the Veterans Affairs Health Care System on the quality of care. N Engl J Med. 2003;348(22):2218–2227. doi: 10.1056/NEJMsa021899. [PubMed] [Cross Ref]
Kizer KW, Dudley RA. Extreme makeover: transformation of the Veterans Health Care System. Annu Rev Public Health. 2009;30:313–339. doi: 10.1146/annurev.publhealth.29.020907.090940. [PubMed] [Cross Ref]
Smith M, Bates DW, Bodenheimer T, Cleary PD. Why pharmacists belong in the medical home. Health Aff. 2010;29(5):906–913. doi: 10.1377/hlthaff.2010.0209. [PubMed] [Cross Ref]
Chapko MK, Borowsky SJ, Fortney JC, Hedeen AN, Hoegle M, Maciejewski ML, VanDeusen Lukas C. Evaluation of the department of veterans affairs community-based outpatient clinics. Med Care. 2002;40(7):555–560. doi: 10.1097/00005650-200207000-00001. [PubMed] [Cross Ref]
Yano EM, Fleming B, Canelo I, Lanto AB, Yee T, Wang M, Wright S, Cuerdon T. Results for the primary care director module of the VHA Clinical Practice Organizational Survey. Sepulveda, CA: VA HSR&D Center for the Study of Healthcare Provider Behavior; 2008.
Yano EM, Soban LM, Parkerton PH, Etzioni DA. Primary care practice organization influences colorectal cancer screening performance. Health Serv Res. 2007;42(3 Pt 1):1130–1149. [PMC free article] [PubMed]
Miller DR, Safford MM, Pogach LM. Who has diabetes? Best estimates of diabetes prevalence in the Department of Veterans Affairs based on computerized patient data. Diabetes Care. 2004;27(Suppl 2):B10–B21. [PubMed]
Wong ES, Piette JD, Liu CF, Perkins M, Maciejewski ML, Jackson GL, Blough DK, Fihn SD, Au DH, Bryson CL. Measures of adherence to oral hypoglycemic agents at the primary care clinic level: the role of risk adjustment. Med Care. 2012;50(7):591–598. doi: 10.1097/MLR.0b013e318249cb74. [PubMed] [Cross Ref]
Bryson CL, Au DH, Young B, McDonell MB, Fihn SD. A refill adherence algorithm for multiple short intervals to estimate refill compliance (ReComp) Med Care. 2007;45(6):497–504. doi: 10.1097/MLR.0b013e3180329368. [PubMed] [Cross Ref]
Kim N, Agostini JV, Justice AC. Refill adherence to oral hypoglycemic agents and glycemic control in veterans. Ann Pharmacother. 2010;44(5):800–808. doi: 10.1345/aph.1M570. [PMC free article] [PubMed] [Cross Ref]
Cohen HW, Shmukler C, Ullman R, Rivera CM, Walker EA. Measurements of medication adherence in diabetic patients with poorly controlled HbA(1c) Diabet Med. 2010;27(2):210–216. doi: 10.1111/j.1464-5491.2009.02898.x. [PubMed] [Cross Ref]
Linzer M, Baier Manwell L, Mundt M, Williams E, Maguire A, McMurray J, Plane MB. In: Advances in Patient Safety: From Research to Implementation. Henriksen K, Battles JB, Marks ES, Lewin DI, editor. Rockville, MD: Agency for Healthcare Research and Quality; 2005. Organizational climate, stress, and error in primary care; pp. 65–77. (Research findings. AHRQ Publication No. 05-0021-1). Volume 1.
Varkey AB, Manwell LB, Williams ES, Ibrahim SA, Brown RL, Bobula JA, Horner-Ibler BA, Schwartz MD, Konrad TR, Wiltshire JC. et al. Separate and unequal: clinics where minority and nonminority patients receive primary care. Arch Intern Med. 2009;169(3):243–250. doi: 10.1001/archinternmed.2008.559. [PubMed] [Cross Ref]
Manwell LB, Williams ES, Babbott S, Rabatin JS, Linzer M. Physician perspectives on quality and error in the outpatient setting. WMJ. 2009;108(3):139–144. [PubMed]
Breusch TS, Pagan AR. A simple test for heteroscedasticity and random coefficient variation. Econometrica. 1979;47(5):1287–1294. doi: 10.2307/1911963. [Cross Ref]
Feiveson AH. Power by simulation. Stata J. 2002;2(2):107–124.
Nkansah NT, Brewer JM, Connors R, Shermock KM. Clinical outcomes of patients with diabetes mellitus receiving medication management by pharmacists in an urban private physician practice. Am J Health Syst Pharm. 2008;65(2):145–149. doi: 10.2146/ajhp070012. [PubMed] [Cross Ref]
Lindenmeyer A, Hearnshaw H, Vermeire E, Van Royen P, Wens J, Biot Y. Interventions to improve adherence to medication in people with type 2 diabetes mellitus: a review of the literature on the role of pharmacists. J Clin Pharm Ther. 2006;31(5):409–419. doi: 10.1111/j.1365-2710.2006.00759.x. [PubMed] [Cross Ref]
Al Mazroui NR, Kamal MM, Ghabash NM, Yacout TA, Kole PL, McElnay JC. Influence of pharmaceutical care on health outcomes in patients with Type 2 diabetes mellitus. Br J Clin Pharmacol. 2009;67(5):547–557. doi: 10.1111/j.1365-2125.2009.03391.x. [PubMed] [Cross Ref]
Brooks AD, Rihani RS, Derus CL. Pharmacist membership in a medical group's diabetes health management program. Am J Health Syst Pharm. 2007;64(6):617–621. doi: 10.2146/ajhp060095. [PubMed] [Cross Ref]
Friedberg MW, Lai DJ, Hussey PS, Schneider EC. A guide to the medical home as a practice-level intervention. Am J Manag Care. 2009;15(10 Suppl):S291–S299. [PubMed]
Reid RJ, Fishman PA, Yu O, Ross TR, Tufano JT, Soman MP, Larson EB. Patient-centered medical home demonstration: a prospective, quasi-experimental, before and after evaluation. Am J Manag Care. 2009;15(9):e71–e87. [PubMed]
Bates DW. Role of pharmacists in the medical home. Am J Health Syst Pharm. 2009;66(12):1116–1118. doi: 10.2146/ajhp080667. [PubMed] [Cross Ref]
Department of Veterans Affairs Patient Centered Medical Home Model Concept Paper. http://www1.va.gov/PrimaryCare/docs/pcmh_ConceptPaper.doc.
Day TE, Li WM, Ingolfsson A, Ravi N. The use of queueing and simulative analyses to improve an overwhelmed pharmacy call center. J Pharm Pract. 2010;23(5):492–495. doi: 10.1177/0897190009358772. [PubMed] [Cross Ref]
McInnes DK, Gifford AL, Kazis LE, Wagner TH. Disparities in health-related internet use by US veterans: results from a national survey. Inform Prim Care. 2010;18(1):59–68. [PubMed]
Welty TE, Willis SL, Welty EA. Effect of limited transportation on medication adherence in patients with epilepsy. J Am Pharm Assoc. 2010;50(6):698–703. doi: 10.1331/JAPhA.2010.09081. [PubMed] [Cross Ref]
LaVela SL, Smith B, Weaver FM, Miskevics SA. Geographical proximity and health care utilization in veterans with SCI&D in the USA. Soc Sci Med. 2004;59(11):2387–2399. doi: 10.1016/j.socscimed.2004.06.033. [PubMed] [Cross Ref]
Stowasser DA, Collins DM, Stowasser M. A randomised controlled trial of medication liaison services, I: patient outcomes. J Pharm Pract Res. 2002;32(2):133–140.
Haig GM, Kiser LA. Effect of pharmacist participation on a medical team on costs, charges, and length of stay. Am J Hosp Pharm. 1991;48(7):1457–1462. [PubMed]

Articles from BMC Health Services Research are provided here courtesy of
BioMed Central