|Home | About | Journals | Submit | Contact Us | Français|
To conduct a systematic review to address the following key questions: (1) what interventions have been successful in improving access for veterans with reduced health care access? (2) Have interventions that have improved health care access led to improvements in process and clinical outcomes?
OVID MEDLINE, CINAHL, PsychINFO.
English language articles published in peer-reviewed journals from 1990 to June 2010. All interventions designed to improve access to health care for US veterans that reported the impact of the intervention on perceived (e.g., satisfaction with access) or objective (e.g., travel time, wait time) access were included.
Investigators abstracted data on study design, study quality, intervention, and impact of the intervention on access, process outcomes, and clinical outcomes.
Nineteen articles (16 unique studies) met the inclusion criteria. While there were a small number of studies in support of any one intervention, all showed a positive impact on either perceived or objective measures of access. Implementation of Community Based Outpatient Clinics (n=5 articles), use of Telemedicine (n=5 articles), and Primary Care Mental Health Integration (n=6 articles) improved access. All 16 unique studies reported process outcomes, most often satisfaction with care and utilization. Four studies reported clinical outcomes; three found no differences.
Included studies were largely of poor to fair methodological quality.
Interventions can improve access to health care for veterans. Increased access was consistently linked to increased primary care utilization. There was a lack of data regarding the link between access and clinical outcomes; however, the limited data suggest that increased access may not improve clinical outcomes. Future research should focus on the quality and appropriateness of care and clinical outcomes.
The online version of this article (doi:10.1007/s11606-011-1849-8) contains supplementary material, which is available to authorized users.
Access to health care has been identified as a critical issue by the Department of Veterans Affairs (VA) and the larger medical community.1–4 Historically, VA has defined access as an individual's ability to obtain the health care they need within an appropriate time frame.4 Researchers within the VA have begun to develop an updated conceptualization of access that distinguishes access from downstream outcomes (e.g., utilization, quality of care, symptom levels, functioning).5 Nevertheless, it is important to examine the impact of improved access on these downstream outcomes. The VA has continued its commitment to improving access for veterans and has implemented several programs designed to improve access.6,7 As such, we sought to conduct a review of the literature that would examine the efficacy of interventions designed to improve access and the impact of such interventions on process and clinical outcomes.
The key questions addressed in this review were: (1) what interventions have been successful in improving access for veterans with reduced health care access? (2) Have interventions that have improved health care access led to improvements in downstream process and clinical outcomes? In order to answer the key questions, we examined studies of US veterans who had received any intervention designed to increase access to health care provided by the VA. All study design types were included; thus, there were no specifications for comparison groups. We examined the impact of the interventions on perceived (self-reported; e.g., satisfaction with access) and objective (observable; e.g., travel distance, wait times) access to health care, as well as process (e.g., utilization, satisfaction with care, receipt of evidence-based care) and clinical (e.g., quality of life, functioning, symptomology, mortality) outcomes.
The key questions for this review were developed in consultation with the Planning Committee for the 2010 VA Health Services Research & Development State of the Art Conference on “Improving Access to VA Care,” the VA HSR&D Evidence Synthesis Program (ESP), and a Technical Expert Panel (TEP). The ESP review, which can be found at the VA HSR&D Evidence Synthesis Program website (www.hsrd.research.va.gov/publications/esp/), includes more articles for this key question (due to a broader definition of access outcomes) and an additional key question.
We searched MEDLINE (OVID), CINAHL, and PsycINFO for studies published from 1990 to June 2010. We limited the search to articles involving human subjects ages 18 and older published in English language. We used the following MEDLINE search terms: Health Services Accessibility, Access, Veterans, United States Department of Veteran Affairs, and Hospitals, Veterans (Appendix A, available online). Similar search terms were used in the CINAHL and PsycINFO searches. Additional references were identified by searching the reference lists and by suggestions from the TEP and other peer reviewers.
One of two investigators reviewed titles and abstracts to identify potentially eligible articles. A portion of abstracts were examined by both investigators to ensure uniformity in decisions. Inclusion criteria were as follows: (1) English language; (2) US veteran population; (3) published from 1990 to June 2010; (4) examined interventions to improve access to VA health care; (5) reported access outcomes of interest; (6) peer reviewed. In keeping with the updated conceptualization of access presented by Fortney, we defined access outcomes as both directly observable (geographical, temporal, digital, financial, and culture factors) and perceived measures of access (veteran’s self-reported satisfaction with access).5 This is a narrower definition of access outcome than we utilized in the ESP report, in which we included initiation of care (either first VA contact or initiation of specialty care) and referrals to specialty care. The downstream outcomes of interest were process outcomes (e.g., utilization, satisfaction with care, receipt of evidence-based care) and clinical (e.g., quality of life, functioning, symptomology, mortality) outcomes. Satisfaction was both an access and process outcome; satisfaction with access was categorized as an access outcome, while satisfaction with other aspects of care was a process outcome.
Investigators abstracted data on study design, patient characteristics, intervention, and impact of the intervention on access, process outcomes, and clinical outcomes. Data were abstracted by an investigator directly onto summary tables created for this review.
All studies were assessed for methodological quality. Randomized control trials (RCTs) and cohort studies were assigned a methodological rating of good, fair, or poor using the United States Preventative Services Task Force (USPSTF) criteria.8 Observational studies were rated in the domains of participant selection (e.g., appropriate recruitment of subjects/choice of database, response rate, representativeness), outcomes assessment (e.g., valid and reliable measures, no differential or overall high loss to follow-up), and analysis (e.g., potential confounders equally distributed or adjusted for in analysis). If all three criteria were rated as adequate, the study received an overall methodological rating of fair. All other observational studies were rated as poor. Observational studies were not eligible for a methodological quality rating of good.
The MEDLINE search yielded 209 references, with 10 duplicates for a total of 199 unique references (Fig. 1). The CINAHL search yielded 212 additional references and the PsycINFO search yielded 252 additional references. A total of 34 articles were eligible for inclusion in the ESP report; however, 13 of those articles were for a key question not included in this manuscript. Thus, 21 articles were eligible for inclusion in the ESP report for the key question of interest. An additional seven articles were identified through hand searching reference lists and TEP member or reviewer suggestions; 28 articles (25 unique studies) were included in the ESP report for this key question. We followed a narrower definition of access outcome for the manuscript than for the ESP report, which resulted in the exclusion of 11 articles. Reviewers for this manuscript identified an additional four articles for inclusion. Thus, 19 articles (16 unique studies) were reviewed for this manuscript (Table A, available online). During abstraction, we found that the articles reported on three distinct types of interventions. The results are grouped by those interventions.
In order to increase access to primary care for veterans living in rural or other underserved geographical areas, the VA opened satellite primary care clinics, known as CBOCs. We identified five articles (four studies) that examined the implementation of CBOCS.9–13 Three of the studies were rated as fair methodological quality,9–12 while 1 was rated as poor methodological quality.13
Impact on Access Four articles utilized either quasi-experimental or cohort designs to examine the impact of the opening of CBOCs on access factors (Table 1).9–12 The studies found that the opening of CBOCs resulted in a decrease in travel distance to the closest VA facility for those in CBOC catchment areas. However, CBOCs did not have a significant impact on a number of reported access outcomes (e.g., days between discharge and outpatient follow-up).9 One study examined veterans' satisfaction with access at CBOCs; veterans using CBOCs reported better access/timeliness.13 The same study found that veterans using CBOCS were more likely to report waits of less than 20 min than veterans getting care at VA Medical Centers (VAMCs).13
Impact on Downstream Outcomes CBOCs attracted more new VA users than the parent VAMCs and led to higher rates of primary care utilization in counties with a CBOC.9–11 Findings regarding the utilization of specialty care were mixed, although in counties with CBOCs that offered specialty mental health services, more veterans accessed mental health services.9–11 The impact on some process outcomes was small and may not be clinically significant. For example, Fortney et al. reported that those in the CBOC catchment area only had 0.5 more primary care visits in the 18 months post-implementation than pre-implementation.10 Veterans using CBOCs reported fewer problems in a variety of areas (e.g., preferences, care coordination, education), greater satisfaction with care, and were more likely to have an overall reported rating of good or excellent visits than veterans getting care at VAMCs.12,13 No clinical outcomes were reported.
Five articles (four unique studies) examined the impact of primary care mental health (PCMH) integration on veterans' access to health care services.14–19 One study was rated as good,17 two as fair,15,16 and two as of low methodological quality.14,18,19
Impact on Access Watts et al. examined a primary care clinic before and after PCMH integration at a VAMC and associated CBOCs.15 After PCMH integration wait times for appointments in the mental health clinic decreased substantially. None of these differences were significant at the CBOCs.15 Shiner et al. reported on the effect of implementing four different models of PCMH integration at one VAMC and four CBOCs.14 The clinics in which integration included onsite mental health care with advance or open access experienced increases in the number of veterans receiving mental health care within both 4 and 30 days.14Druss et al. conducted a RCT to examine the efficacy of integrating primary care into a mental health clinic.16 Veterans randomized to the PCMH integrated clinic reported significantly better satisfaction with access. Saxon et al. conducted a similar study in which veterans receiving care in a substance use clinic were randomized to receive primary care from a clinic located within the substance use clinic or through a medical clinic (treatment as usual).17 The integrated clinic fared better on measures of access, including length of wait for initial primary care visit.17 Finally, one study reported on the effort to integrate primary care, mental health, and social services for homeless veterans.18,19 The intervention resulted in shorter wait times for an initial primary care appointment; the integration group had on average less than a day lapse, while the usual care group waited approximately 2 months for their initial visit.18,19
Impact on Downstream Outcomes In regard to process outcomes, Watts et al. found that more veterans at the VAMC received "optimal depression treatment" following integration.15 Similarly, Shiner et al. found that more veterans at the VAMC received care for depression, fewer veterans received no depression treatment, more veterans received care in mental health clinics, and more veterans received optimal care.14 When implementing primary care into mental health clinics, Druss et al. found that veterans in the PCMH condition had more primary care visits, fewer ER visits, received more preventative services, and reported greater satisfaction with care across a number of domains.16 Saxon et al. reported that those assigned to the PCMH integrated condition were more likely to attend return primary care visits and had more primary care visits during the study period, were less likely to seek non-VA care, and were more likely to remain engaged in substance use treatment at 60 days (although not at 6 or 12 months).17 When primary care, mental health, and homeless services were integrated, the PCMH group received more preventative services, had a higher number of primary care visits, and had lower levels of ER use.19,20 There were no differences on rates of admission, inpatient days, or the number of veterans receiving primary care.19,20Three of the studies examined clinical outcomes. Druss et al. reported that veterans assigned to PCMH integration had better physical component SF-36 scores at 1-year post randomization; however, there was no difference on the mental component score.16 The other two studies that report clinical outcomes found no differences between intervention and control clinics.17–19
Impact on Access Five articles (four studies) examined the use of telemedicine.20–24 Two studies were of fair quality20–22 and two were of poor quality.23,24 All four telemedicine studies examined the utility of telemedicine in receiving consultations from specialty providers. Agha et al. conducted a RCT in which veterans in need of consultation were randomly assigned to receive consultation in person at the hub VAMC or via telemedicine from a remote site.20 Veterans who received their consultation via telemedicine reported that their care was significantly more convenient than those who attended in-person appointments. Similarly, Wakefield et al. examined the use of telehealth to receive a variety of consultations from specialists at a VAMC for veterans in a long-term care facility, while Wilkins et al. evaluated the feasibility of using telehealth to receive consultations from a multidisciplinary wound care team for veterans at a VAMC without such a team.23,24 Both Wakefield and Wilkins found that the veterans reported that telemedicine was easier and more convenient than traveling to meet with a specialist.23,24Whited et al. conducted a RCT in which in-person consultations were compared to teledermatology for veterans being referred for dermatology consultation.21,22 In the teledermatology condition, providers electronically viewed a still digital image of the lesion, a standardized history, and the standard consultation. Dermatologists could then decide to see the veteran in person, or send a diagnosis and treatment plan back to the referring provider without seeing the veteran. Veterans assigned to teledermatology initiated treatment significantly more quickly (73.8 vs 114.3 days).22
Impact on Downstream Outcomes All four studies examined process outcomes. Agha et al. found that veterans’ perceptions of physician communication (patient-centeredness, clinical competence, interpersonal skills) were not inferior to physician communication during in-person consultations, suggesting that veterans’ found interactions conducted via telemedicine as satisfying as in-person interactions.20 Whited et al. found that 18.5% of veterans in the teledermatology condition did not require a follow-up in-person consultation.22 Whited et al., Wilkens et al., and Wakefield et al. all found that a large majority of veterans were satisfied with telemedicine care; in support of its use, Whited et al. did not find a difference in satisfaction with care between telemedicine and in-person consultation.21–24 No clinical outcomes were assessed.
Weinberger et al. conducted a RCT in which hospitalized veterans with chronic health conditions, who did not have ongoing primary care, were assigned to either treatment as usual or an intensive primary care program.25 The intensive case management program had a number of goals, including increasing access to primary care following hospitalization. The intervention included both inpatient (doctor and nurse visits, discharge planning, plan for primary care appointment) and outpatient (reminder and check in calls) components. For those in the intensive care condition, the median time from hospital discharge to primary care was shorter and self-reported satisfaction with access was higher.25 The two groups differed on process outcomes, with intervention veterans being more satisfied with care, more likely to visit a general medicine clinic, and less likely to visit specialty care.25 Those in the intervention condition were more likely to be readmitted to the hospital, readmitted sooner, and have more days of rehospitalization.25 There were no differences on clinical outcomes.
Rodriguez et al. conducted a qualitative study to examine elderly African American veterans' reaction to a mobile geriatric care unit (MGU).27 The MGU was a vehicle with a patient education room and examination room equipped to perform standard preventative care. The qualitative analyses revealed that veterans commented on the accessibility of care 26 times in 18 interviews.27 The access-related comments were positive and related to geographic proximity, hours of operation, and wait time.27 In regard to process outcomes, veterans mentioned quality of care 28 times.27 Comments focused on the helpfulness and friendliness of staff and the accommodations.27 No clinical outcomes were assessed.
Finally, Wray et al. examined the impact of six mobile primary care clinics for veterans who lived over 100 miles from the nearest VAMC.26 The vast majority of veterans experienced a decrease in travel distance; 94% of veterans lived with 50 miles of a mobile clinic, while 80% lived at least 100 miles from the closest VAMC.26 In regard to process outcomes, the mobile clinics drew new users (56% of veterans were new users), and for those within 30 miles of the mobile clinics, utilization increased by 40%.26 No clinical outcomes were assessed.
The results suggest that access to health care can be improved through structural/organizational interventions. All of the articles reported an association between the intervention and at least one measure of access (either perceived or objective). The evidence was strongest for the implementation of PCMH, which consistently resulted in shorter wait times for both primary care and mental health appointments.14,15,17–19 A finding of particular interest in the PCMH literature was that integration at varying levels (e.g., colocation versus walk in access 1 day per week) resulted in improved access, suggesting that a range of models may yield positive effects.14 The opening of CBOCs and the use telemedicine each had four studies showing that they resulted in improved access for veterans. As would be expected, the opening of CBOCs led to decreased travel time/distance for veterans in CBOC catchment areas.9–11 Researchers examining the use of telemedicine were primarily interested in veterans’ perceived access; they consistently found that veterans reported that specialists were easier to access using telemedicine than traditional in-person meetings.
It is important to note that for many access interventions, it would be impossible for the target access outcome not be impacted. For example, building a VA clinic in a rural area will always decrease the travel distance to the nearest VA clinic for those in that rural community. We required that studies report on the impact of the intervention on either perceived or objective access because we thought that while an access intervention may have a positive impact on the target access outcome, it could negatively impact other aspects of access. For example, while using telemedicine may have a positive impact on geographic access barriers, it could create digital (e.g., connectivity or usability) or cultural (e.g., perceived lack of understanding) barriers. However, few studies included in the review reported on more than the target access outcome. We suggest that future studies include measures on a variety of perceived and objective measures of access. This will provide a more thorough understanding of access barriers and will help researchers identify new barriers that may arise as access interventions are implemented.
All of the 16 unique studies reported process outcomes. The most frequently reported process outcomes were satisfaction with care and utilization. The implementation of CBOCs led to increases in the initiation of care and primary care visits.9–11 PCMH integration also led to an increase in primary care visits and increases in preventative care.16–19 Across the interventions, findings regarding the use of specialty care and hospitalization were mixed.9–11,16,18,19,25 Across interventions, increases in access were associated with satisfaction with care.12,16 The telemedicine studies consistently found that veterans are as satisfied with their care and communication with providers when appointments are delivered via telemedicine as when they are delivered in person.20–22 These findings are important given the accumulating data showing that in-person and telemedicine interventions yield equivalent outcomes for high-priority conditions, such as posttraumatic stress disorder.28
Finally, only 4 of the 16 unique studies reported clinical outcomes.16–19,25 Three found no difference between intervention and control conditions. The RCT by Druss and colleagues was the only study to show that improvements in access led to improvements in clinical outcomes, specifically greater improvements in physical component scores on the SF-36.16 Veterans had a nearly five point increase on their physical component score in the year following integration, while those in the usual care condition had a 0.3 point decrease over the same time period.16 Research on clinical outcomes must be a priority in the future. Such work will be challenging because there are a number of variables that might impact both access and outcomes (e.g., comorbidities). Rigorous, highly controlled research, such as that conducted by Druss et al., will be needed to clarify whether increased access results in improved health for veterans.
In addition to measuring clinical outcomes, we recommend that future research examine process outcomes beyond service utilization. The data regarding utilization are difficult to interpret as it is unclear whether increased utilization led to improved patient outcomes. In one study that did link access and outcomes, increased access to primary care resulted in increased rates and length of hospitalization.25 While the increase in hospitalization was not necessarily a negative outcome, the study highlights the complicated association between utilization and patient health. Thus, we recommend a decreased focus on utilization as an outcome and suggest that if utilization is included as an outcome, it is either specific to the type of care received (e.g., receipt of evidence-based care) or linked to clinical outcomes.
There were important limitations to this study. First, the studies included in this review were primarily of poor to fair methodological quality. Further, we identified a number of well-designed studies that examined access interventions, but they were not included in our review because they did not include data regarding either actual or perceived access outcomes.29–40 Therefore, there are studies that report on the impact of access interventions on downstream outcomes that are not included in this review. As discussed above, we suggest that future research examining access interventions collect and compare a broad range of perceived and actual access outcomes across groups. In conclusion, interventions can improve access to health care for veterans. Increased access was consistently linked to increased primary care utilization and satisfaction with care; however, there was a lack of data regarding the link between access and clinical outcomes. Future research should focus on the quality and appropriateness of care and clinical outcomes.
Below is the link to the electronic supplementary material.
(DOC 62 kb)
This report is based on research conducted by the Evidence-based Synthesis Program (ESP) Center located at the Minneapolis VA Health Care System, Minneapolis, MN, funded by the Department of Veterans Affairs, Veterans Health Administration, Office of Research and Development, Health Services Research and Development. The findings and conclusions in this document are those of the author(s) who are responsible for its contents; the findings and conclusions do not necessarily represent the views of the Department of Veterans Affairs or the United States government. Therefore, no statement in this article should be construed as an official position of the Department of Veterans Affairs. This material is the result of work supported with resources and the use of facilities at the Minneapolis VA Medical Center, Minneapolis, MN. Dr. Kehle is supported by a VA Health Services Research & Development Career Development Award.
Conflict of Interest None disclosed.