PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
AIDS. Author manuscript; available in PMC 2012 June 11.
Published in final edited form as:
PMCID: PMC3372417
NIHMSID: NIHMS359022

Quality of HIV care provided by non-physician clinicians and physicians in Mozambique: a retrospective cohort study

Abstract

Objectives

To compare HIV care quality provided by non-physician clinicians (NPC) and physicians.

Design

Retrospective cohort study assessing the relationship between provider cadre and HIV care quality among non-pregnant adult patients initiating antiretroviral therapy (ART) in the national HIV care programme.

Methods

Computerized medical records from patients initiating ART between July 2004 and October 2007 at two HIV public HIV clinics in central Mozambique were used to develop multivariate analyses evaluating differences in process and care continuity measures for patients whose initial provider was a NPC or physician.

Results

A total of 5892 patients was included in the study, including 4093 (69.5%) with NPC and 1799 (30.5%) with physicians as initial providers. Those whose initial provider was a NPC were more likely to have a CD4 cell count 90–210 days [risk ratio (RR) 1.13, 1.04<RR<1.23] and 330–390 days (RR 1.12, 0.96<RR<1.31) after initiating ART. A large majority of patients adhered well to care, although patients whose initial provider was a NPC had more frequent clinical visits in the first year post-ART initiation (RR 1.02, 1.00<RR<1.05) and higher levels of adherence to antiretroviral medicines in the first 6 months after initiating ART (RR1.05, 1.02<RR<1.09). Patients of NPC were less likely to be lost to follow-up than those seen by physicians (RR 0.86, 0.73<RR<1.02).

Conclusion

NPC performance was similar to or better than that of physicians for the HIV care quality study measures. Our results highlight the important role of NPC in scaling up ART in Mozambique, and argue for using all relevant clinical resources to meet the large demands for care in countries with high HIV burdens.

Keywords: antiretroviral therapy, Mozambique, non-physician clinicians, scale-up, task shifting

Introduction

Since the UN General Assembly on HIV/AIDS in 2001, global investment directed to controlling the HIV epidemic has greatly increased, resulting in over US$10 billion in funding for HIV programmes in resource-limited countries in 2008 [1]. This political and financial commitment facilitated the rapid expansion of antiretroviral therapy (ART) in the most highly HIV-affected countries in the world. An estimated 70% of eligible patients, however, still had not received ART by the end of 2007, largely because weak health systems hamper efforts to reach universal coverage [2].

The scarcity of human resources is a prominent feature of weak health system capacity, impeding the absorption of increased development aid and threatening efforts to achieve an ambitious global health agenda [3,4]. The World Health Organization estimates that an additional 4 million health workers are required to achieve the 2015 millennium development goals, including 1 million in sub-Saharan Africa, which has both the lowest density of health workers and the highest disease burden in the world [5]. In conjunction with comprehensive efforts to build human resource capabilities, task shifting, or delegating clinical and programme responsibilities to existing lower-level cadres such as non-physician clinicians (NPC), has been recommended as a strategy for meeting the demands of priority health initiatives, such as universal access to ART [68].

The use of NPC is not new in sub-Saharan Africa, although there is little uniformity in their regulatory status and nomenclature, with titles such as health officers, clinical officers, physician assistants, nurse practitioners, and in Mozambique, técnicos de medicina. The imperative to increase access to clinical HIV services has placed particular emphasis on expanding the scope of NPC activities, and in Mozambique expansion of HIV care, including ART management, has greatly relied on this clinical cadre [9].

Despite the increased reliance on NPC, questions remain about their ability to provide safe and effective care [1013], especially in developing country settings where fewer evaluations have been conducted. Results from randomized controlled trials [14,15] and meta-analyses [1620] conducted in industrialized nations have shown that safe, quality care is provided by NPC compared with physicians. One study from the United States found NPC provided statistically equivalent HIV care quality when compared with physicians [21].

In contrast, in resource-limited countries, most studies have been descriptive, typically assessing aggregate patient outcomes when NPC work along with physicians compared with physician-only care [2225]. When comparative studies have been conducted, most focus on obstetric services. Those studies have found similar postoperative outcomes for both NPC and physicians [2630]. Research on HIV care in Africa found similar results for NPC-led clinics compared with other settings [31,32], whereas results from a training evaluation in Mozambique described inadequate preparation for NPC [33]; however, both studies lacked appropriate comparison groups. Persistent uncertainty about HIV care quality provided by NPC hampers their use for further scaling up HIV care [34]. To help expand knowledge about the effect of provider cadre on HIV care quality in resource-limited settings, we examined a retrospective cohort study of patients initiating ART between July 2004 and October 2007 in Mozambique.

Methods

Study setting

Two public sector ambulatory HIV clinics in central Mozambique (Beira Central Hospital and Chimoio Provincial Hospital), the region that has consistently had the highest adult HIV prevalence in Mozambique, were the setting for this study. The HIV clinics opened in 2002 (Beira) and 2003 (Chimoio), although accelerated expansion of ART began in July 2004 when Mozambique adopted a public health approach to ART based on standard treatment protocols with fixed-dosed combination antiretroviral drugs provided free of charge at the point of care [10].

Study population

Study subjects included consecutive ART-naive adult patients initiating ART at the study clinics between July 2004 and October 2007. Patients were excluded from the study if they were less than 15 years of age upon ART initiation, pregnant at the time of clinic enrollment, or enrolled in a pilot ART programme (MTCT-Plus, Columbia University Mailman School of Public Health), as these patients were primarily seen by physicians. In order to ensure comparability of training between study providers, patients were excluded if their initial provider was an expatriate clinician.

Data sources

The study primarily used data from computerized databases capturing patient sociodemographic information and data from clinical, laboratory, pharmacy and social worker visits. Dedicated data entry staff maintained the databases as part of routine care, and they have built-in ranges and cross-checks to minimize data entry error. These databases were found to agree highly with patient charts (Cohen kappa scores >0.83 for key study variables). Information on study providers, such as sociodemographic characteristics, training and work experience, was collected by individual interviews by the study team. Clinic receptionists also logged clinic staff presence during a 4-week period in the second quarter of 2007 to estimate clinic full-time equivalents (FTE) for both cadres.

Variable definition and statistical analysis

Clinician classification

Study patients were grouped according to their initial assignment of primary care provider at time of clinic enrollment (NPC or physician). Designation of either physician or NPC was left to clinic discretion; however, care pathways were not designed to differ by cadre. Subanalysis was carried out among patients whose initial provider was a physician, with patients grouped by specialization (generalist/specialist). Transfers between providers were estimated from the routine clinic database to assess frequency and direction of transfer (NPC to physician, physician to NPC, or mixture), based on if a patient switched to a new provider for the duration of care at the clinic or if there was no discernable pattern.

Quality of HIV care measures

Five measures of quality of care were used, including three process measures based on ministry of health protocols [35] and two patient-level outcomes commonly used in evaluating HIV care. Outcomes were chosen based on availability and accuracy in the clinic databases, and based on their association with HIV quality of care measures in previous studies. Outcomes were assessed in a dichotomous form to facilitate analysis and interpretation.

Process outcomes included: (i) CD4 cell count evaluated between 90 and 210 days post-ART initiation; (ii) CD4 cell count evaluated 330–390 days post-ART initiation; and (iii) a clinical visit at least once per quarter for three of the first four quarters post-ART initiation. Because these measures only made sense if the patient met enrollment standards, we excluded patients from the analysis of CD4 cell count measurement at 90–210 days if they had initiated ART within 180 days before the end of the study period or if they left the clinic within the first 180 days after initiating ART for reasons not related to adherence to care (including death, transfer to another facility, or provider-initiated ART suspension). Similarly, patients were excluded from the analysis of CD4 cell count measurement 330–390 days and frequency of clinical visits during the first year of ART if they initiated ART within 365 days before the end of the study period or if they left the clinic within the first 365 days after initiating ART for reasons cited above.

The two patient-level HIV care outcomes included: (i) adherence to antiretroviral drug regimens; and (ii) patient loss to follow-up not caused by mortality. Adherence was evaluated during the first 180 days post-ART initiation, which is a commonly used timeframe [36] predictive of long-term ART adherence [37]. Using pharmacy refill data, adherence was calculated as the number of antiretroviral drug doses dispensed post-ART initiation to the first refill date after 180 days, divided by the number of doses prescribed in that period. ART adherence was classified as optimal for patients receiving 90% or more of their antiretroviral drugs, which is adequate to maintain viral suppression using drug regimens containing a non-nucleoside reverse transcriptase inhibitor (NNRTI), as is the case in Mozambique [38]. Patients lost to follow-up during the first 180 days post-ART initiation were considered to have non-optimal adherence. Patients initiating ART less than 180 days before the end of the study period and those leaving the clinic within the first 180 days of initiating ART as a result of death, transfer to another facility, or provider-initiated ART suspension were excluded from the analysis.

Patients were classified as lost to follow-up if they failed to return to the study clinic for 60 days or more after a scheduled monthly ART refill for reasons not related to patient death. The date of last pharmacy refill was used to define the endpoint for loss to follow-up. Although loss to follow-up as a result of patient death was assessed as a separate outcome, the primary outcome of interest was loss to follow-up for reasons not associated with patient death.

Covariates

Covariates were considered based on their theoretical potential to confound or modify the relationship between provider type and quality of care. Potential patient characteristics considered as confounding factors included age (calculated from date of birth to date of clinic enrollment), self-reported years of education at clinic enrollment, baseline CD4 cell count from the last CD4 cell count measurement before initiating ART, sex, socioeconomic status, distance of residence from the study clinics and study clinic.

Statistical analysis

Unadjusted analyses using chi-square for independence and two-tailed Student’s t-tests were conducted to describe bivariate associations between covariates and provider cadre. Individual multivariate generalized linear models extended to the binomial family were used to examine the association between provider type and four outcomes, with the exception of loss to follow-up, which is described below. Risk ratios were estimated using the log-link function. Life tables were developed to estimate patient loss to follow-up at 12 and 24 months. Cox proportional hazard regression was used to assess the relationship between provider cadre and patient loss to follow-up or death (as separate outcomes). Follow-up time began at ART initiation and ended with the last pharmacy refill date for patients who died or were lost to follow-up, or censored because of transferring out of the study clinic or provider-initiated ART suspension.

Patient-level covariates were assessed for inclusion in multivariate analysis using a forward stepwise approach based on whether the covariate changed the relevant coefficient terms by more than 10%. We evaluated the study clinic as a potential effect modifier by comparing strata-specific and aggregate risk estimates for the strength and direction of association and by including interaction terms in the multivariate models, and no effect modification was confirmed on the relative scale.

Data analysis was performed using Stata version 10 (College Station, Texas, USA). The study was approved by the institutional review boards of the Mozambique Ministry of Health and the University of Washington.

Results

Study clinics

Both clinics had a high volume of HIV-infected patients, with a combined average of 668 monthly new adult enrollees (Beira 375, Chimoio 293). An average of 174 adult patients initiated ART at the clinics per month (Table 1). During the 4-week clinic observation period, 23 physicians provided a total of 1.8 FTE based on a 35-h work week, compared with 3.9 FTE from 10 NPC. Over the study period, physicians were responsible for 44.5% of all clinical consults, including both patients who had initiated ART and those not yet on ART, compared with 55.6% for NPC.

Table 1
Characteristics of study clinics.

Study providers

There were 52 clinical providers in this study, including 15 (28.9%) NPC and 37 (71.2%) physicians, of whom 20 (54.1%) had completed a clinical specialty. A higher percentage of physicians were 35–44 years of age (67.7% versus 13.3%), whereas more NPC were younger than 35 (46.7% versus 11.8%) or older than 44 years (40.0% versus 20.6%) (Table 2). Physicians received more training on HIV care. Nearly three times as many NPC had less than 11 years experience in the National Health Service (NHS) at the end of the study period compared with physicians (53.3% versus 17.7%); however, similar percentages of physicians and NPC had worked for over 15 years in the NHS (35.3% versus 33.3%). NPC had more experience seeing patients at the HIV clinics, with more than twice as many NPC having had over 1500 clinical consults compared with physicians (53.3% versus 18.9%). In addition, NPC averaged nearly twice as many consults per day (9.4 versus 5.7) at the HIV clinics (data not shown).

Table 2
Characteristics of study providers.

Study participants

A total of 5892 patients, or 84.7% of all adults who initiated ART, met the inclusion criteria for the study and were considered in analysis. NPC were the initial provider for 4093 (69.5%) study patients, whereas physicians were the initial provider for 1799 (30.5%) patients. Of the sample, 1391 (23.6%) patients saw multiple providers, of which 548 (39.4%) whose initial provider was a physician but switched to a NPC, 375 (27.0%) whose initial provider was a NPC but switched to a physician, and 468 (33.6%) who saw a mixture of providers. Patients who transferred from a NPC to a physician were over three times more likely to have been from the Beira study clinic, were slightly older and were of a higher socioeconomic status (data not shown).

More patients were enrolled in the Beira HIV clinic than Chimoio (55.0% versus 45.0%). No differences were found between patients by provider cadre with regard to the patient’s CD4 cell count at clinic enrollment, average age, average years of education or sex (Table 3). Patients whose initial provider was a NPC were more likely to be enrolled in the Beira HIV clinic and a higher percentage lived 5–10 km from the study clinic. Patients whose initial provider was a physician were of higher socioeconomic status than those seen primarily by a NPC.

Table 3
Study patient characteristics by provider type.

Overall, 4002 (67.9%) study patients were alive and on ART at the study clinics at the conclusion of data collection. Of the remaining patients, 381 (6.5%) were transferred to another clinic, 690 (11.7%) were lost to follow-up and 819 (13.9%) died. The proportion of study patients surviving and on ART at the clinics at 12 and 24 months was 74.4% [95% confidence interval (CI) 73.2–75.6%] and 69.5% (68.0–70.9%), respectively.

Quality of HIV care by provider type

After controlling for relevant covariates, NPC had similar or statistically better performance measures as physicians for all five quality measures (Table 4). Although CD4 cell count levels were monitored in the minority of patients, those whose initial provider was a NPC were 12–13% more likely to have CD4 cell monitoring during the year after ART initiation. Independent of provider type, the large majority of patients were seen by clinicians during three of the four quarters after initiating ART. Patients with a NPC as their initial provider had similar adherence to antiretroviral medicines (78.9% versus 77.0%), and were somewhat less likely to have been lost to follow-up when compared with those with a physician as their initial provider (11.4% versus 12.5%). Patients with a NPC as their initial provider were also less likely to have died when compared with those who had a physician as their initial provider [hazard ratio (HR) 0.91, 0.79<HR<1.06; data not shown].

Table 4
HIV care quality measures by provider type.

In a subanalysis among study patients whose initial provider was a physician, comparable quality of care outcomes were found for patients initially seen by specialized and general physicians (Table 5). Patients whose initial provider was a generalist were 12% less likely to have a CD4 cell count 90–210 days after ART initiation, although little difference was found in CD4 cell count monitoring 330–390 days after ART initiation. The majority of patients of both provider groups were seen in clinic during three of four quarters after initiating ART and had similarly high levels of adherence to anti-retroviral medicines. Patients with a specialized physician as their initial provider were slightly more likely to have been lost to follow-up from care.

Table 5
HIV care quality measures by physician specialization.

Discussion

In this evaluation of the quality of HIV care provided by NPC and physicians, 69.5% of patients on ART had a NPC as their initial provider. The performance of NPC was similar to or better than that of physicians for the five measures of quality of HIV care that we employed. A large majority of patients in this study adhered well to care, including frequent clinical visits in the first year and high antiretroviral drug adherence in the first 6 months after initiating ART. A relatively low percentage of study patients, however, had their CD4 cell count monitored in the first year after ART initiation (41.9% in the first 90–210 days and 20.4% in the first 330–390 days).

The principal limitation of this study is the non-random assignment of provider type. One possible explanation for the observed differences in HIV care quality is that patients seen by NPC were different from those seen by physicians. Our data, however, do not suggest this. Patients seen by NPC were of lower socioeconomic status, had less education, and lived farther from the clinic than those seen by physicians – factors associated with poorer quality of care outcomes in previous studies [3941]. In addition, patients seen by physicians and NPC did not differ in terms of CD4 cell count at clinic enrollment, consistent with the conclusion that provider assignment was based on provider availability and not immunological status. Nonetheless, although measured patient characteristics were adjusted for in multivariate analysis, it is possible that unmeasured patient factors (including poorly diagnosed or documented clinical conditions) were associated with both provider assignment and quality of care measures.

A second limitation in this study is that we were unable to discern the motivation for patient transfers between clinician cadres, and it may be that patients changed providers from NPC to physicians as a result of clinical conditions that surpassed the technical competencies of the NPC providers. Of the 23.6% of patients who saw multiple providers, however, fewer switched from a NPC to a physician (27.0%) than from a physician to a NPC (39.4%), indicating that providers switched more frequently in the direction of referral of stable patients to a NPC rather than a complicated patient to a physician.

An additional limitation is the generalizability of the study results. The study clinics were chosen based on the availability of favourable study conditions, including well managed data sources, and are not a representative sample of HIV clinics in Mozambique. The number of providers was relatively small, and may not be representative of providers in general in terms of the HIV care they deliver. As a result, care should be taken when generalizing these findings to health settings beyond the study clinics.

Despite its limitations, this study is the first of its kind in resource-limited settings, and provides results that are relevant for other countries rapidly expanding ART. The observational design is stronger than cross-sectional assessments that have previously been reported, and the large cohort of patients on ART provided adequate power for our analyses. In addition, the reliance on process measures reflecting international HIV care norms provides interpretable, practical results. Finally, study outcomes, including both process and patient-level outcomes, are well captured in the clinic database, strengthening the validity of study findings.

In this study, the utilization of NPC for HIV care was three times that found in previous research from industrialized healthcare settings, showing a high reliance on NPC for HIV care, including ART. The overall quality of HIV care at the study clinics was similar to that found in other resource-constrained countries expanding ART services, including patient retention and survival [42,43]. The results are consistent with those found in the literature on NPC care quality from industrialized countries, which has found similar or better quality of care measures for NPC compared with physicians for numerous conditions, including HIV.

One potential explanation for the similarity in the process measures is that they reflect a standardized approach to HIV care that is continually reinforced via training and supervision, and the emphasis on following protocols may have led to similar process outcomes for both cadres. Another potential explanation is that NPC provide a continuous, daily presence in the clinic, which has been shown to impact HIV care quality in other studies [44,45]. This stability may reinforce relationships with other clinic staff (nurses, pharmacists, social workers, receptionists and other support staff), and the team-based approach may facilitate communication and attention to individual patient needs. Furthermore, because of their continuous presence and longer hours in the clinics, NPC may have more time to spend with patients, which could result in a stronger rapport, better understanding of individual patient problems and more effective adherence support. Notably, the frequency of clinical visits during the first year after ART initiation was high for patients of both provider cadres, indicating that the differences in other quality of care outcomes is probably not a result of the frequency of patient/provider interaction but other aspects of this interaction or provider characteristics.

Mozambique’s HIV care approach has shifted away from fewer large, specialized HIV clinics to many smaller clinics where HIV care is integrated into routine clinical services. Policymakers and health system managers would benefit from research focusing on clinic-level factors influencing HIV care quality relevant to smaller clinics where there may be only one clinician. Future research should endeavour to understand the interface between facility staff, the intraclinic management approach, and the importance of patient volume on HIV care quality.

Conclusion

This study of nearly 6000 patients initiating ART during the first 40 months of the Mozambique national ART programme found a similar or better quality of HIV care provided by NPC compared with physicians. These results highlight the key role that NPC play in driving ART scale-up, and argue for using all relevant clinical staff to meet the clinical demands in countries with a high HIV burden. The results also underscore the importance of considering NPC training and supervision needs when developing guidelines and regulations for HIV care. A low percentage of patients had CD4 cell counts monitored in the first year after initiating ART, suggesting the presence of general clinic-level barriers that could be improved through supportive approaches, including supervision tools, in-service training programmes and job aids. Furthermore, these results highlight the important role NPC could play in meeting the overall clinical needs of the Mozambique health system.

Acknowledgments

Sponsorship: Support for this research was provided through a grant from the Doris Duke Charitable Foundation’s Operations Research for AIDS Care and Treatment in Africa (ORACTA) initiative. The funding agency was not involved in any phase of the study, manuscript development, or in the decision to submit the manuscript for publication. All study researchers are independent from the funding agency.

Footnotes

Conflicts of interest: None.

The preliminary results were presented previously as an abstract at the XVIIth International AIDS Conference in Mexico City, Mexico (WEAX0105).

References

1. Cohen J. HIV/AID.S. The great funding surge. Science. 2008;321:512–519. [PubMed]
2. World Health Organization. Towards universal access: scaling up priority HIV/AIDS interventions in the health sector: progress report 2008. Geneva: WHO; 2008.
3. Kober K, Van Damme W. Scaling up access to antiretroviral treatment in southern Africa: who will do the job? Lancet. 2004;364:103–107. [PubMed]
4. Hosseinipour MC, Kazembe PN, Sanne IM, van der Horst CM. Challenges in delivering antiretroviral treatment in resource poor countries. AIDS. 2002;16 (Suppl 4):S177–S187. [PubMed]
5. Chen L, Evans T, Anand S, Boufford JI, Brown H, Chowdhury M, et al. Human resources for health: overcoming the crisis. Lancet. 2004;364:1984–1990. [PubMed]
6. World Health Organization. Task shifting: rational redistribution of tasks among health workforce teams: global recommendations and guidelines. Geneva: World Health Organization; 2007.
7. Marchal B, De Brouwere V, Kegels G. Viewpoint: HIV/AIDS and the health workforce crisis: what are the next steps? Trop Med Int Health. 2005;10:300–304. [PubMed]
8. Marchal B, Kegels G, De Brouwere V. Human resources in scaling up HIV/AIDS programmes: just a killer assumption or in need of new paradigms? AIDS. 2004;18:2103–2105. [PubMed]
9. Sherr K, Pfeiffer J, Mussa A, Vio F, Gimbel S, Micek M, Gloyd S. The role of nonphysician clinicians in the rapid expansion of HIV care in Mozambique. J Acquir Immune Defic Syndr. 2009;52 (Suppl 1):S20–S23. [PubMed]
10. Gilks CF, Crowley S, Ekpini R, Gove S, Perriens J, Souteyrand Y, et al. The WHO public-health approach to antiretroviral treatment against HIV in resource-limited settings. Lancet. 2006;368:505–510. [PubMed]
11. Hongoro C, McPake B. How to bridge the gap in human resources for health. Lancet. 2004;364:1451–1456. [PubMed]
12. Samb B, Celletti F, Holloway J, Van Damme W, De Cock KM, Dybul M. Rapid expansion of the health workforce in response to the HIV epidemic. N Engl J Med. 2007;357:2510–2514. [PubMed]
13. Philips M, Zachariah R, Venis S. Task shifting for antiretroviral treatment delivery in sub-Saharan Africa: not a panacea. Lancet. 2008;371:682–684. [PubMed]
14. Sackett DL, Spitzer WO, Gent M, Roberts RS. The Burlington randomized trial of the nurse practitioner: health outcomes of patients. Ann Intern Med. 1974;80:137–142. [PubMed]
15. Spitzer WO, Sackett DL, Sibley JC, Roberts RS, Gent M, Kergin DJ, et al. The Burlington randomized trial of the nurse practitioner. N Engl J Med. 1974;290:251–256. [PubMed]
16. Sox HC., Jr Quality of patient care by nurse practitioners and physician’s assistants: a ten-year perspective. Ann Intern Med. 1979;91:459–468. [PubMed]
17. Mundinger MO, Kane RL, Lenz ER, Totten AM, Tsai WY, Cleary PD, et al. Primary care outcomes in patients treated by nurse practitioners or physicians: a randomized trial. JAMA. 2000;283:59–68. [PubMed]
18. Brown SA, Grimes DE. Nurse practitioners and certified nurse-midwives: a meta-analysis of studies on nurses in primary care roles. ANA Publ. 1993;i–xx:1–105. [PubMed]
19. Office of Technology Assessment (US) Nurse practitioners, physician assistants, and certified nurse-midwives: a policy analysis. Kansas City, MO: American Nurses’ Association; 1989.
20. Horrocks S, Anderson E, Salisbury C. Systematic review of whether nurse practitioners working in primary care can provide equivalent care to doctors. BMJ. 2002;324:819–823. [PMC free article] [PubMed]
21. Wilson IB, Landon BE, Hirschhorn LR, McInnes K, Ding L, Marsden PV, Cleary PD. Quality of HIV care provided by nurse practitioners, physician assistants, and physicians. Ann Intern Med. 2005;143:729–736. [PubMed]
22. Vaz F, Bergstrom S, Vaz Mda L, Langa J, Bugalho A. Training medical assistants for surgery. Bull WHO. 1999;77:688–691. [PubMed]
23. Ofori-Adjei D, Arhinful DK. Effect of training on the clinical management of malaria by medical assistants in Ghana. Soc Sci Med. 1996;42:1169–1176. [PubMed]
24. Fenton PM, Whitty CJ, Reynolds F. Caesarean section in Malawi: prospective study of early maternal and perinatal mortality. BMJ. 2003;327:587. [PMC free article] [PubMed]
25. Pereira C, Cumbi A, Malalane R, Vaz F, McCord C, Bacci A, Bergstrom S. Meeting the need for emergency obstetric care in Mozambique: work performance and histories of medical doctors and assistant medical officers trained for surgery. Br J Obstet Gynaecol. 2007;114:1530–1533. [PubMed]
26. Warriner IK, Meirik O, Hoffman M, Morroni C, Harries J, My Huong NT, et al. Rates of complication in first-trimester manual vacuum aspiration abortion done by doctors and mid-level providers in South Africa and Vietnam: a randomised controlled equivalence trial. Lancet. 2006;368:1965–1972. [PubMed]
27. Chilopora G, Pereira C, Kamwendo F, Chimbiri A, Malunga E, Bergstrom S. Postoperative outcome of caesarean sections and other major emergency obstetric surgery by clinical officers and medical officers in Malawi. Hum Resource Health. 2007;5:17. [PMC free article] [PubMed]
28. Pereira C, Bugalho A, Bergstrom S, Vaz F, Cotiro M. A comparative study of caesarean deliveries by assistant medical officers and obstetricians in Mozambique. Br J Obstet Gynaecol. 1996;103:508–512. [PubMed]
29. Hounton SH, Newlands D, Meda N, De Brouwere V. A cost-effectiveness study of caesarean-section deliveries by clinical officers, general practitioners and obstetricians in Burkina Faso. Hum Resource Health. 2009;7:34. [PMC free article] [PubMed]
30. McCord C, Mbaruku G, Pereira C, Nzabuhakwa C, Bergstrom S. The quality of emergency obstetrical surgery by assistant medical officers in Tanzanian district hospitals. Health Affairs (Millwood) 2009;28:876–885. [PubMed]
31. Shumbusho F. Task shifting to achieve universal access to HIV care and treatment services in Rwanda: a nurse centered ART program at three rural health centres. HIV Implementer’s Meeting; Kampala, Uganda. June 3–7, 2008; p. Abstract 621.
32. Cohen R, Lynch S, Bygrave H, Eggers E, Vlahakis N, Hilderbrand K, et al. Antiretroviral treatment outcomes from a nurse-driven, community-supported HIV/AIDS treatment programme in rural Lesotho: observational cohort assessment at two years. J Int AIDS Soc. 2009;12:23. [PMC free article] [PubMed]
33. I-TECH. [Accessed: 8 November 2009];Evaluation of the training of Tecnicos de Medicina in Mozambique. Available at: http://www.go2itech.org/what-we-do/operations-research-and-evaluation/quality-improvement/qi-program-examples/evaluation-of-the-training-of-tecnicos-demedicina-in-mozambique.
34. Vasan A, Kenya-Mugisha N, Seung KJ, Achieng M, Banura P, Lule F, et al. Agreement between physicians and non-physician clinicians in starting antiretroviral therapy in rural Uganda. Hum Resource Health. 2009;7:75. [PMC free article] [PubMed]
35. Ministério da Saúde. Guião de bolso: tratamento antiretroviral e infecção oportunistas adulto e adolescente. Maputo: Ministry of Health; 2006.
36. Kitahata MM, Reed SD, Dillingham PW, Van Rompaey SE, Young AA, Harrington RD, Holmes KK. Pharmacy-based assessment of adherence to HAART predicts virologic and immunologic treatment response and clinical progression to AIDS and death. Int J STD AIDS. 2004;15:803–810. [PubMed]
37. Oyugi JH, Byakika-Tusiime J, Charlebois ED, Kityo C, Mugerwa R, Mugyenyi P, Bangsberg DR. Multiple validated measures of adherence indicate high levels of adherence to generic HIV antiretroviral therapy in a resource-limited setting. J Acquir Immune Defic Syndr. 2004;36:1100–1102. [PubMed]
38. Bangsberg DR. Less than 95% adherence to nonnucleoside reverse-transcriptase inhibitor therapy can lead to viral suppression. Clin Infect Dis. 2006;43:939–941. [PubMed]
39. Boileau C, Nguyen VK, Sylla M, Machouf N, Chamberland A, Traore HA, et al. Low prevalence of detectable HIV plasma viremia in patients treated with antiretroviral therapy in Burkina Faso and Mali. J Acquir Immune Defic Syndr. 2008;48:476–484. [PubMed]
40. Sarna A, Pujari S, Sengar AK, Garg R, Gupta I, Dam J. Adherence to antiretroviral therapy and its determinants amongst HIV patients in India. Indian J Med Res. 2008;127:28–36. [PubMed]
41. Golin CE, Liu H, Hays RD, Miller LG, Beck CK, Ickovics J, et al. A prospective study of predictors of adherence to combination antiretroviral medication. J Gen Intern Med. 2002;17:756–765. [PMC free article] [PubMed]
42. Brinkhof MW, Dabis F, Myer L, Bangsberg DR, Boulle A, Nash D, et al. Early loss of HIV-infected patients on potent antiretroviral therapy programmes in lower-income countries. Bull WHO. 2008;86:559–567. [PubMed]
43. Stringer JS, Zulu I, Levy J, Stringer EM, Mwango A, Chi BH, et al. Rapid scale-up of antiretroviral therapy at primary care sites in Zambia: feasibility and early outcomes. JAMA. 2006;296:782–793. [PubMed]
44. Shortell SM, Marsteller JA, Lin M, Pearson ML, Wu SY, Mendel P, et al. The role of perceived team effectiveness in improving chronic illness care. Med Care. 2004;42:1040–1048. [PubMed]
45. Grumbach K, Bodenheimer T. Can health care teams improve primary care practice? JAMA. 2004;291:1246–1251. [PubMed]