PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of bmcphBioMed Centralsearchsubmit a manuscriptregisterthis articleBMC Public Health
 
BMC Public Health. 2012; 12: 683.
Published online Aug 21, 2012. doi:  10.1186/1471-2458-12-683
PMCID: PMC3495221
Implementing new health interventions in developing countries: why do we lose a decade or more?
Alan Brooks,corresponding author1,2 Thomas A Smith,1,2 Don de Savigny,1,2 and Christian Lengeler1,2
1Swiss Tropical and Public Health Institute, Socinstrasse 57, Basel, CH-4002, Switzerland
2University of Basel, Petersplatz 1, Basel, CH-4003, Switzerland
corresponding authorCorresponding author.
Alan Brooks: AlanBrooks99/at/gmail.com; Thomas A Smith: Thomas-A.Smith/at/unibas.ch; Don de Savigny: D.deSavigny/at/unibas.ch; Christian Lengeler: Christian.Lengeler/at/unibas.ch
Received March 12, 2012; Accepted August 6, 2012.
Background
It is unclear how long it takes for health interventions to transition from research and development (R&D) to being used against diseases prevalent in resource-poor countries. We undertook an analysis of the time required to begin implementation of four vaccines and three malaria interventions. We evaluated five milestones for each intervention, and assessed if the milestones were associated with beginning implementation.
Methods
The authors screened World Health Organization (WHO) databases to determine the number of years between first regulatory approval of interventions, and countries beginning implementation. Descriptive analyses of temporal patterns and statistical analyses using logistic regression and Cox proportional hazard models were used to evaluate associations between five milestones and the beginning of implementation for each intervention. The milestones were: (A) presence of a coordinating group focused on the intervention; (B) availability of an intervention tailored to developing country health systems; (C) international financing commitment, and; (D) initial and (E) comprehensive WHO recommendations. Countries were categorized by World Bank income criteria.
Results
Five years after regulatory approval, no low-income countries (LICs) had begun implementing any of the vaccines, increasing to an average of only 4% of LICs after 10 years. Each malaria intervention was used by an average of 7% of LICs after five years and 37% after 10 years. Four of the interventions had similar implementation rates to hepatitis B vaccine (HepB), while one was slower and one was faster than HepB. A financing commitment and initial WHO recommendation appeared to be temporally associated with the beginning of implementation. The initial recommendation from WHO was the only milestone associated in all statistical analyses with countries beginning implementation (relative rate = 1.97, P < 0.001).
Conclusions
Although possible that four milestones were not associated with countries beginning implementation, we propose an alternative interpretation; that the milestones were not realized early enough in each intervention’s development to shorten the time to beginning implementation. We discuss a framework built upon existing literature for consideration during the development of future interventions. Identifying critical milestones and their timing relative to R&D, promises to help new interventions realize their intended public health impact more rapidly.
Keywords: Vaccine, Malaria, Intervention, Research and development, Implement, Access, Developing country
The GAVI Alliance (GAVI; formerly the Global Alliance for Vaccines and Immunization) and the Global Fund to Fight AIDS, Tuberculosis and Malaria (GFATM) were established in 2000 and 2002, respectively. Since then, they have committed more than USD 20 billion to address the divergence in health status and access to health interventions between developed and developing countries (DCs). In parallel, the past decade has seen unprecedented investments in research and development (R&D) for new health interventions for use in developing countries; approximately USD 3.2 billion was invested in 2009 alone, an increase of 8.2% from 2008 [1]. Product development partnerships (PDPs) have grown in number and are focused on developing drugs, rapid diagnostic tests, vaccines and other interventions for developing countries [2]. The use of such interventions might eventually be subsidized by GAVI, GFATM, and other financing mechanisms.
It is normal in R&D for a large percentage of candidate interventions to fail during development. However, the investments above will lead to some new interventions being approved by regulators and becoming available for use. A critical step is then how quickly they will begin to be implemented through national health systems of developing countries. Beginning implementation does not guarantee, but is on the critical path to, interventions becoming widely accessible to people in need in developing countries.
The progression from R&D to implementation through national health systems in developing countries can be broken down into a series of stages and parallel activities, although it may vary somewhat by type of intervention (Figure (Figure1).1). An intervention moves from R&D through a series of international and ultimately national policy decisions about use and financing. These decisions lead to the beginning of implementation, scaling-up over months or years to target levels, and ideally access as defined below. Regulatory, manufacturing, and supplemental study activities take place in parallel. The World Health Organization (WHO) plays a critical role, such as reviewing interventions to determine if they are suitable for purchase by agencies of the United Nations (UN) [3,4]. Figure Figure11 presents a process following a linear progression for clarity, however this may rarely be the actual case. The process varies according to the unique scientific, policy and other challenges of each intervention.
Figure 1
Figure 1
New interventions: From R&D to implementation (illustrative). *Drugs, Vaccines Diagnostics, Reproductive health supplies. **WHOPES: WHO Pesticide Evaluation Scheme
Access has been defined as the result of a set of coordinated activities needed to ensure that interventions will ultimately have an equitable public health impact [5]. A number of authors have studied access independently. Obrist et al. (2007) proposed an access framework focusing on consumer decisions, livelihood, and the assets of poor populations with regard to health interventions [6]. They reviewed five concepts determining access to health interventions: availability, accessibility, affordability, adequacy, and acceptability. Mahoney et al. (2007) identified four criteria for access to new vaccines: availability; affordability; acceptability; and adoptability [7]. They propose an access framework that acknowledges the role of decisions made during the R&D period on later implementation. PDPs generally agree on a similar set of access criteria relevant to many interventions [5,8].
Frost & Reich (2008) analyzed the history of access to six health interventions in the developing world: praziquantel; hepatitis B vaccine; malaria rapid diagnostic tests; Norplant; vaccine vial monitors; and female condoms [8]. They proposed that access depends on activities related to four key factors: architecture, availability, affordability, and adoption. Architecture encompasses the organizational structures and relationships that coordinate activities addressing availability, affordability and adoption (Figure (Figure2).2). They also provide a historical description of the R&D phase of each intervention, noting that developer choices are important for later policy decisions on use and implementation. Each concept Mahoney et al. (2007), Obrist et al. (2007), and PDPs use in their access frameworks is consistent with the ones identified by Frost & Reich [5-8]. For example, Obrist’s et al. concept of acceptability is consistent with Frost and Reich’s “end-user adoption and appropriate use”. The one exception, which is not relevant to national implementation of an intervention and therefore this analysis, is Obrist et al.’s adequacy concept, matching health service organization with individual client expectations [6].
Figure 2
Figure 2
Frost and Reich’s (2008) access framework. The figure presents access as depending on a coordinating architecture that ensures that availability, affordability and adoption considerations are addressed for an intervention. Architecture: Organizational (more ...)
These analyses of access are complemented by many analyses of strategies for the implementation of single or closely-related interventions [9,10]. Some of the literature focuses on the R&D period, including how clinical trials and regulatory processes impact implementation [11-15]. Much of the literature focuses on the period after regulatory approval, using qualitative [7,16-25] and quantitative approaches [26-30] (Table (Table1).1).
Table 1
Table 1
Considerations affecting access to new interventions
This paper hypothesizes that five high-level milestones, consistent with the research on access above, are associated with developing countries beginning implementation of interventions. If these milestones are associated, it follows that they could be targets of efforts by those developing new interventions in order for implementation to begin, and access to be achieved, more quickly. This paper explores this hypothesis by analyzing how long it took after regulatory approval, or equivalent, for countries to begin implementing each of seven interventions, and related implementation to when each of these five milestones took place for each intervention.
The number of years between initial approval of seven interventions by a stringent regulatory body and the beginning of implementation, considered to be the first year of reported use by each country through its national health system, was estimated from available data. Similar but more limited analyses have been applied to health interventions previously [16,47,48]. In addition, the timing of each of five hypothesized milestones was determined for each intervention. Descriptive and statistical analyses were used to assess associations between the timing of milestones and countries beginning implementation.
The year of approval by a stringent regulatory authority was intended to reflect the earliest time point at which it would have been ethical to begin implementation on a large scale outside of a controlled trial. This is especially critical for vaccines and drugs because of the issues of safety and quality. Some interventions, such as ITNs, while generally not overseen by regulatory authorities, have mechanisms in place for reviewing safety and more recently quality, which were considered as equivalent to the time of regulatory approval for this analysis [49,50]. In these cases, efficacy and effectiveness may be evaluated through the establishment of a scientific consensus between experts on the basis of existing trial experience [51,52].
Countries were categorized as low- (LIC), lower-middle- (LMIC), upper-middle- (UMIC), and high-income (HIC) according to the World Bank stratification, corresponding respectively to 2009 gross national income per capita of $995 or less, $996 - $3,945, $3,946 - $12,195, and $12,196 or more [53]. World Bank data were used as they provide a standardized categorization for countries, and are used by the GFATM in determining support to countries.
Estimating time from regulatory approval, or equivalent, to beginning implementation
Vaccines
Four vaccines were selected for inclusion in the study based on their public health importance, diversity in year of availability, similar ages of target populations and comparable delivery strategies. The diseases they target — hepatitis, pneumonia, meningitis, and diarrhea— are among the world’s leading causes of mortality and morbidity, especially in developing countries. Hepatitis B (HepB) and Haemophilus influenzae type b (Hib) vaccines have been available for decades while pneumococcal conjugate (PC) and rotavirus (RV) vaccines are among the newest.
The regulatory approval of the first rotavirus vaccine was a unique case. Licensed in 1998, it was removed from the market in 1999 due to concerns about intussusceptions (a potentially life threatening telescoping of the intestine within itself). A new rotavirus vaccine was licensed in 2004 in Mexico although WHO did not consider its NRA fully functional. The vaccine was then licensed by the European Medicines Agency (EMA) in 2006 [54]. This analysis considered 2006 to be the year of the rotavirus vaccine’s first stringent regulatory approval, although the history is considered further in the discussion.
WHO collects reports from 193 countries each year in order to assess vaccine implementation [55] (Table (Table2).2). These data were used to generate tables showing the first year of vaccine use and the number of years until coverage matched that of the third dose of diphtheria-tetanus-whole cell pertussis vaccines (DTP3), which is given to the same infant population at the same times as the other vaccines in this analysis. WHO’s data cover the years 1989–2009 for HepB, 1991–2009 for Hib, and 2008–09 for PC and RV. Data for the remaining years through March, 2011 and for missing dates in the WHO data were taken from the Vaccine Information Management System (VIMS), a database maintained at the International Vaccine Access Center, Johns Hopkins University [56].
Table 2
Table 2
Characteristics of countries included in the analysis and summary of responses
Malaria interventions
Malaria was selected for inclusion as it is one of the major causes of mortality and morbidity in children, and preventive, therapeutic and diagnostic interventions are available. Insecticide-Treated Nets (ITNs) and more recently developed Long-Lasting Insecticidal Nets (LLINs) prevent malaria. In this paper, “ITN” is used for both ITNs and LLINs. Immuno-chromatographic rapid diagnostic tests (RDTs) allow diagnosis of malaria with minimal training and hence are valuable for optimizing treatment strategies. Artemisinin-based combination therapies (ACTs) are the current standard for malaria treatment.
In the absence of a formal regulatory structure, regulatory approval of ITNs was based on a WHO expert committee concluding they were safe for individuals, and therefore could be used outside clinical trials [49]. For RDTs, regulatory approval was considered to be the point at which the first RDT became available in the developed world where there are strong quality assurance systems.
WHO provided data on country implementation in 104 malaria-endemic countries, taken from the 2010 survey of countries by the Global Malaria Program as part of the annual World Malaria Report [57] (Table (Table2).2). The survey asked respondents to identify the year WHO-recommended malaria policies began to be implemented. Respondents indicated the first year “ITNs distributed to all age groups” or “ITNs distributed free of charge”. For diagnostic tests, respondents indicated the first year “RDTs used in communities”, and for artemisinin-based combination therapies they indicated the first year “ACT is free of charge for under 5 years olds in the public sector” or “ACT is free to all”. Non-response to the specific questions about implementing the interventions, while other questions in the survey were answered, was classified as not implementing the intervention. Fourteen percent of countries did not respond for the ITN questions, 56% for RDTs, and 28% for ACTs. The earliest date was used in cases where different dates were given for each policy or if parts of countries (e.g. mainland Tanzania versus Zanzibar) reported different dates.
Five hypothesized milestones
Milestones consistent with and thought to be important to coordination, availability, affordability and adoption were hypothesized from the literature above (Table (Table1).1). This is not to suggest that these hypothesized milestones addressed all aspects of each access concept, nor that they always happened in a specific sequence. The timing and source document for each milestone is summarized in Table Table33.
Table 3
Table 3
Hypothesized access milestones for each intervention
Milestone A - Coordinating architecture
The establishment of an organization or international partnership focused on supporting development, establishment of technical consensus around, and/or use of the intervention was considered consistent with a coordinating architecture. Hep B, Hib, PC, RV, RDT, and ACT were supported by product-development partnerships. ITNs were supported by the Roll Back Malaria Partnership.
Milestone B - Intervention designed for developing country health systems
Each vaccine and two of the malaria interventions were improved over time to better align with the needs of DCs. The year a new version of each intervention that was intentionally designed to meet the needs of DCs was approved by regulators, or equivalent, was considered relevant for availability. HepB and Hib antigens were combined with the widely implemented DTP vaccines to create new “four in one” or “five-in-one” vaccines. New versions of pneumococcal conjugate vaccines included additional serotypes prevalent in the developing world and improved packaging. New rotavirus vaccines decreased the size of packaging, required two doses instead of the traditional three, and were more heat stable. ITNs were replaced by LLINs, and an ACT specifically formulated and packaged for use in infants was developed after the initial tablet formulation. No major improvements in RDTs were identified over the course of their deployment. VIMS provided information on product presentation and formulation of Hib in most countries, used in this analysis to consider if the speed of scaling-up changed when the presentation of the vaccine was better aligned with the needs of DCs.
Milestone C - Financing commitment
A major global financing commitment by an international organization was considered important for affordability to countries to begin implementation. All of the interventions have been supported by such financing. From 2000, GAVI supported 72 to 75 countries with less than $1000 gross national income (GNI)/capita to purchase and implement vaccines. From 2011, it increased the threshold to $1500 GNI/capita decreasing eligibility to 56 countries due to inflation. For malaria control, the GFATM is by far the most important donor, supporting low and middle income countries.
Milestones D and E - WHO recommendations
Recommendations by WHO to use each intervention were considered important for international-level support for adoption. WHO issued an initial, limited recommendation and then a more comprehensive recommendation some years later for five of the interventions. The timing of the initial recommendation was milestone D, while the comprehensive WHO recommendation was milestone E.
Statistical analysis
The year of country implementation of each intervention was extracted from the selected global databases into Microsoft Excel, and back-validated against the original databases for accuracy. Cox proportional hazard models were used to compare the rates of beginning implementation of interventions between countries, as functions of the intervention and income group of the country. The analysis for each country started with the year when the intervention was approved by a stringent regulatory authority, or equivalent. The data were treated as right-censored where the country had not introduced the intervention during the periods described previously. In this analysis the adoption rate corresponds to the hazard in a conventional survival analysis. Plots of the cumulative baseline hazard over time were used to assess time trends in the underlying rate of beginning implementation, allowing for the covariates of income level and milestones described previously. These analyses were carried out using the PHREG procedure in SAS (SAS Institute Inc., Cary, NC, USA, version 9.2 for Windows).
Years to beginning implementation
The implementation of all interventions is presented in Table Table44 for low and lower-middle-income countries after 5, 10 and 15 years. A decade after each studied vaccine or malaria intervention was approved by regulators, 33% or fewer low and lower-middle-income countries, and in most cases less than 15%, had begun to implement it. The exception was ACTs which 70% of low and 56% of lower-middle-income countries had begun to implement after 10 years.
Table 4
Table 4
Percentage of LICs and LMICs implementing interventions after 5, 10, and 15 years
The mean of the percentage of low-income countries beginning implementation of each intervention after five years was 3% and 20% after 10 years. However, malaria interventions were implemented sooner than vaccines, a mean percentage of 37% of countries at 10 years compared with only 4% for vaccines. No low-income country implemented any of the new vaccines in the first five years.
The mean of the percentage of lower-middle-income countries beginning implementation of each intervention after five years was 6% and 24% after 10 years. However, malaria interventions were implemented sooner than vaccines, a mean percentage of 35% of countries at 10 years compared with only 12% for vaccines. Figure Figure33 shows the cumulative percentages of countries beginning implementation of each intervention, by number of years after regulatory approval and for each income group.
Figure 3
Figure 3
Proportion of implementing countries over time in each income category, stratified by intervention. The figure presents the proportion of countries implementing each intervention by year since regulatory approval. Panel A = High income (more ...)
HepB, Hib and ITNs are approaching universal implementation, having been implemented by more than 80% of countries (Table (Table2).2). The mean time was 12.2 years across all malaria-endemic countries to begin implementing ITNs, and 14.6 years for Hib and 16.7 years for HepB across all countries (Table (Table5).5). Beginning implementation in low-income countries took an average of 12.2 years for ITNs, 18.8 years for Hib vaccine and 21.2 years for HepB vaccine as compared to 15.0, 9.0 and 13.2 years in high-income countries.
Table 5
Table 5
Mean number of years (range) until countries began implementation, by income group
Figure Figure44 presents the cumulative implementation of each intervention by countries, stratified by income group. Twenty-seven years after HepB vaccine was first approved, 93% of countries had begun to implement it for routine infant use, with low income countries appearing to accelerate implementation after GAVI began to provide financial support. A few HICs in Europe recommend it instead for adolescents or high-risk individuals. It has taken more than 20 years for 90% of low-income countries to use Hib, with implementation in LICs appearing to accelerate after a comprehensive WHO recommendation. The lowest coverage of Hib (76% of countries) was in the lower-middle-income countries, many of which are too wealthy to receive financing from GAVI.
Figure 4
Figure 4
Beginning implementation of each intervention by countries, by income group, including hypothesized milestones. Panels A-G present the proportion of countries beginning to implement each intervention by year since the year of regulatory approval. Panel (more ...)
For rotavirus vaccines, 15-20% of high, upper-middle, and lower-middle-income countries had begun to implement it after five years, an equality across country income levels that did not occur for other vaccines. It took more than 10 years for Hib and pneumococcal vaccines to reach a similar proportion of lower-middle-income countries. Upper-middle-income countries appear to have implemented Hib and pneumococcal vaccines in the same proportions, with the first countries beginning implementation after seven years and reaching approximately 20% of countries at ten years. No low-income country had implemented rotavirus vaccine as of March 2011, more than five year after regulatory approval, which appears consistent with HepB, Hib, and PC vaccines where low-income early adopters did not begin implementation until 8–10 years after the vaccines were available.
Malaria interventions were initially implemented by similar proportions or a slightly higher proportion of wealthier countries. However, six years after approval, ITNs and ACTs began to be used in notably greater proportions of low-income than wealthier countries. After 12 years, a greater proportion of low-income countries had begun implementing RDTs than wealthier countries. These findings are consistent with the differences in disease burden in these countries, with higher levels in the poorest countries.
There were significant statistical differences in rates of beginning implementation between interventions relative to hepatitis B vaccine in high income countries (likelihood ratio statistic (LRS): 30.6; 6 degrees of freedom (d.f.); P < 0.001, adjusted for effects of income level and of the different milestones) (Table (Table6).6). ACTs was the fastest intervention to begin implementation, with a rate 2.41 times that of HepB (95% CI 1.38-4.21) (Table (Table6).6). Rotavirus is being implemented at 1.99 times that of HepB, but the confidence interval is wide and includes zero (95% CI 0.85-4.66). The slowest was RDTs with a rate of 0.54 (95% CI 0.33-0.88). Hib, PC, and ITNs all had similar rates to HepB.
Table 6
Table 6
Relative rates of beginning implementation by intervention and country income (Cox proportional hazard)
There was a highly significant difference between level of income of countries and the rate of beginning implementation (LRS 27.2; 3 d.f.; P < 0.0001), this difference being almost entirely accounted for by the difference between high income countries and the others. There was very little difference in rates between the different categories of middle income countries, or between middle and low income countries (Table (Table6);6); each of these categories was associated with rates of beginning implementation only just over half that of high income countries.
Milestones
Table Table33 summarizes milestones for each intervention. Figure Figure44 indicates when each milestone from Table Table33 was reached relative to regulatory approval (i.e. time zero). Patterns of temporal associations between access milestones, and between milestones and beginning implementation, can be drawn from Figure Figure44.
Milestone A - Coordinating architecture
A coordinating architecture was put in place years prior to significant beginning of implementation, except for Hib and ITNs. Coordination was in place years before comprehensive WHO recommendations were made in all situations, and prior to initial WHO recommendations in all cases except for that of ITNs. It was also in place before a financing commitment in all cases, except RDTs and before an improved intervention in all cases except Hib.
Milestone B - Intervention designed for developing country health systems
Less than 10% of low-income countries began implementation of any of the vaccines prior to an improved intervention being available. No lower or upper-middle-income countries began implementing Hib prior to availability of an improved vaccine, but up to 40% of countries were already implementing HepB and 10-20% were implementing rotavirus and/or pneumococcal vaccines. For HepB and Hib vaccines it was possible to estimate the average time from beginning implementation until coverage matched DTP3 levels (data not shown). After combination vaccines became available in 1997, which allowed the antigens to be administered in a single injection with DTP, countries required approximately one year less for coverage to be scaled-up to match DTP than it did prior to a combined vaccine. Improved malaria interventions became available after 30-70% of countries had already begun implementing each type of intervention. These data suggest that many LMICs, UMICs and HICs did not wait for an improved, second-generation vaccine prior to starting implementation. And that once the second generations were available, they may have been scaled-up more rapidly. Countries frequently did not wait for improved malaria interventions before beginning implementation.
Milestone C - Financing commitment
There was a sharp increase in the proportion of low-income countries beginning implementation of HepB and Hib vaccines and low and lower-middle-income countries implementing pneumococcal vaccines after GAVI’s advent and associated financing commitments. There was a similar increase in the proportion of countries, particularly low-income, beginning implementation of malaria interventions after GFATM’s advent and associated financing commitments. For ITNs and Hib, financing commitments came after an initial WHO recommendation, but before a comprehensive recommendation. RDT financing came before any recommendation, and for RV, PC and ACTs, a recommendation and financing came in the same year. A financing commitment generally preceded a sharp increase in the proportion of countries beginning implementation.
Milestones D and E - WHO recommendations
The proportion of countries beginning implementation of HepB, Hib, PC, ITNs, and ACTs did not accelerate in low, lower-middle and upper-middle-income countries until after a WHO recommendation. Comprehensive WHO recommendations for use of the malaria interventions did not come until 40% or more of low-income countries had begun to implement the interventions, while for HepB, RV and PC, comprehensive recommendations came prior to any significant implementation in LICs.
Figure Figure55 shows the number of years from regulatory approval to initial and/or comprehensive WHO recommendation, and financing commitment, with the interventions listed in order from earliest to most recent year of regulatory approval. Five interventions had initial recommendations, which took a mean of 5.8 years (range 1–11). The additional time for those five interventions to receive a comprehensive recommendation was a mean of 6.0 years (range 2–12). HepB and PC had no initial recommendations, requiring 10 and 7 years respectively for WHO to issue comprehensive recommendations. For all seven interventions, the average time from regulatory approval to comprehensive recommendation was 10.9 years, with a range of 3–18 years. On average it took 8.4 years, with a range of 1–18 years, from regulatory approval to a financing commitment. The time required from regulatory approval to policy recommendations and financing commitments has decreased over the 22 year period represented by the interventions.
Figure 5
Figure 5
Time from regulatory approval to WHO recommendation and financing, by intervention. Interventions are presented from earliest to most recent year of regulatory approval. The year of regulatory approval and intervention name are indicated below each set (more ...)
An initial proportional hazard model analyzed the relative rates associated with each of the milestones separately, adjusting for levels of income groups of countries and interventions. Initial WHO recommendation (relative uptake rate 1.83; 95% confidence interval (CI) 1.26-2.64), coordinating group (relative uptake rate 2.19; CI 1.45-3.30), and financing commitment (relative uptake rate 1.78; CI 1.30-2.45) were all positively associated in this analysis, suggesting these where associated with countries beginning implementation earlier than occurred for HepB. On the other hand, a comprehensive WHO recommendation (relative uptake rate 0.45; CI 0.33-0.61) was negatively associated, suggesting it was associated with countries taking longer to begin implementation than with HepB. Availability of an improved intervention seemed to have little effect on the rate of beginning implementation (relative uptake rate 0.86; CI 0.62-1.18). Since the timing of these milestones was unlikely to be independent, a further analysis was conducted in which the effects were fitted simultaneously to adjust for possible confounding (Table (Table7).7). In this analysis the estimated effect sizes were similar to those in the unadjusted analysis, while the only statistically significant milestones were the positive effect of initial WHO recommendation (1.97. 95% CI 1.33-2.94), and the association of a comprehensive WHO recommendation with a slowing down of beginning implementation relative to HepB (0.45; 95% CI 0.31-0.64).
Table 7
Table 7
Effects of hypothesized access milestones on rate of beginning implementation (Cox proportional hazard)
Plots of the rate of beginning implementation (i.e. rate of adoption; cumulative baseline hazard from the Cox model) for analysis including only high income countries (Figure (Figure6A),6A), suggested a more or less linear increase with time. This corresponds to a constant underlying rate of beginning implementation, once the effects of the different milestones are allowed for. In contrast, the cumulative baseline hazard for low income countries (Figure (Figure6B)6B) increased with the time for which the intervention had been available, indicating a tendency for interventions to be more likely to be implemented the longer they were available, even allowing for the effects of the milestones.
Figure 6
Figure 6
Effect of time since regulatory approval on rate of beginning implementation. The vertical axis shows the rate of beginning implementation (i.e. adoption) of interventions according to the number of years since regulatory approval. All interventions are (more ...)
This paper analyzed the time between regulatory approval and beginning implementation of seven interventions; four vaccines and three malaria interventions. The interventions target diseases responsible for a substantial proportion of the overall global burden of disease, particularly for children in developing countries. According to WHO, each of these interventions should target a similar group of children, and be used globally in all countries or all malaria-endemic countries. We hypothesized that five milestones, consistent with the literature on access to interventions, were associated with the beginning of implementation in developing countries.
We found that during the five years after regulatory approval, interventions began to be used in only a tiny minority of developing countries. After 10 years, less than 1/3 of low and lower-middle-income countries had begun to use interventions. ACTs were the exception, being implemented earlier than the other interventions, likely due to the evolving crisis as resistance grew to antimalarial treatments. Even so, one may question if implementation of ACTs was fast enough. Vaccines and ITNs continue to be implemented in developing countries at approximately the same pace as HepB in the 1980s and 1990s, while RDTs are being implemented slower than HepB.
There is no international agreement on how quickly new interventions should be implemented. One option is to suggest that they should be introduced with minimal delay relative to the pace in high income countries. But that overlooks the much greater burdens of disease and numbers of lives lost in low income countries. These interventions should be implemented as fast as or faster than HICs. It is also hopeful that there appear to be shorter delays between regulatory approval and policy and financing decisions for more recent interventions. However, the history for RV, the most recent intervention, is more tangled than the more linear processes of the other interventions. During 2011, there was substantial, growing momentum through GAVI for use of rotavirus and pneumococcal conjugate vaccines [79]. This momentum cannot save the lives already lost over the many years that these vaccines have been available and not implemented, but hopefully the proportion of implementing countries will accelerate as suggested in Figure Figure6B6B.
The initial WHO recommendation and a financing commitment were most temporally associated with increasing the percentage of countries beginning implementation. A coordinating architecture was in place years before an increase in the percentage of countries beginning implementation for five of the interventions, suggesting it may contribute to but not trigger implementation. It appears that countries frequently did not wait for an improved intervention or a comprehensive WHO recommendation. This suggests that activities strengthening country decision-making may accelerate implementation.
Statistically, only the initial WHO recommendation was associated with beginning implementation in all analyses. This may not be surprising as countries and financing bodies often follow WHO’s guidance. This suggests that those developing new interventions should work systematically to anticipate the research questions WHO and international organizations, including financing bodies, will need addressed to make policy decisions. A more comprehensive WHO recommendation was associated with slower implementation. Wealth impacted implementation, differentiating high-income countries from all the developing countries which began implementation at slower, more similar rates.
Challenges and limitations to the analysis
The analysis focuses on implementation of interventions through national health systems as a way of reaching enough people to achieve an equitable public health impact, consistent with the definition of access. Future analyses could consider ways to reflect private sector provision, which is relatively modest for vaccines but can be significant for malaria interventions. Analyses could also consider ways that political pressure and advocacy inform and influence decisions (this may have especially speeded up the introduction of ACTs), such as through key opinion leaders or the media.
The analysis did not consider country characteristics apart from income group, given that each of the interventions has been recommended for use globally. The analysis is also likely to be conservative, understating the delays, given that it focused on beginning of implementation, not the time to reach nation-wide coverage. Coverage is already analyzed by WHO and others elsewhere [57,80].
Data used in the analysis are imperfect. However, we found no evidence of a systematic reporting gap or bias from any group of countries. Imperfect data were partially offset by including every country in the world. The only relatively small income group was HIC malaria-endemic countries, of which there are only four (Table (Table2).2). It is important to recognize that countries can choose not to implement any intervention, or use one in a different fashion which may not be captured in databases. Data on the year of beginning implementation of interventions ideally would be taken from multiple sources (e.g. surveys, WHO, national data.) Multiple sources would be particularly important if the analysis focused on coverage rates, for which precise estimates are difficult to confirm [28]. Using few data sources was mitigated by limiting the analysis to the year of beginning implementation, a single time point which should be more reliably reported. Relying primarily on WHO data also has the benefit of limiting variability associated with incorporating data from differently designed studies.
We combed a broad selection of literature to establish the timing of milestones for each intervention. The milestones for rotavirus vaccine and ITNs were perhaps the most challenging. As noted in the methods, a RV vaccine was first approved in 1998 and then withdrawn by the manufacturer due to safety concerns. A new rotavirus vaccine was licensed by Mexico in 2004, an NRA that was not considered by WHO to be fully functional, and began to be implemented in Latin America. It was licensed by the EMA in 2006. It may be the case that the availability of a licensed vaccine from 1998 to 1999, and a new vaccine licensed by some countries from 2004 accelerated milestones and implementation planning. However it is also possible that the safety questions and shadow over RV vaccines slowed milestones and implementation. ITNs were deemed safe for use in 1991, which was considered the point of regulatory approval for this analysis. However, the first recommendation for use of ITN’s based upon demonstrated efficacy was made by WHO in 1995 for Africa [70]. International organizations did not develop a shared commitment to initiate large scale implementation of ITNs until 1997 and later. Bias due to investigator judgment was minimized by scrupulous attention to documentation of sources (Table (Table33).
There is no reason to assume that the pattern of delays in the adoption of vaccines and malaria interventions is unique. It is possible that the delays for other interventions are longer than those for immunization and malaria, which enjoy a relatively high profile within public health arenas.
A revised hypothesis for accelerating access
One interpretation of the study’s findings is that the null hypothesis was disproved only for the initial WHO recommendation. However, the temporal associations and existing literature suggest caution in asserting that all the other milestones were not associated with developing countries beginning to implement interventions. An alternative interpretation, preferred by the authors, is that these milestones could be associated with countries beginning implementation if they took place earlier in the development and implementation of an intervention. And that by taking place earlier, they could shorten and increase the efficiency of the transition from R&D to decision-making and implementation (Figure (Figure11).
This analysis leads to a revised hypothesis which could be evaluated as new interventions are being developed. The hypothesis suggests that organizations need to begin working systematically on access-related issues earlier on, during the R&D stages, in order to shorten the time to begin implementation and realize equitable access in developing countries. Carefully paced activities during R&D could lead to decision-making processes at international and country levels and milestones being achieved shortly after regulatory approval, as has been proposed recently for malaria vaccines [81,82].
Figure Figure77 builds on Frost and Reich’s (2008) access framework. It proposes additional activities specifically intended to take place prior to regulatory approval and thereby accelerate the beginning of implementation and eventual access. It must be noted that there are risks to planning for access during the R&D phase. Interventions can always fail due to safety, efficacy or other considerations.
Figure 7
Figure 7
Proposed access framework incorporating R&D and implementation periods. The area in grey represents the original access framework as shown in Figure Figure2.2. Other areas are new to the framework. Actions that take place during the R&D (more ...)
The R&D process requires a coordinated, long-term and systematic approach to associated access activities; an approach which is specific to each intervention’s context. Available interventions need to be tailored to fragile developing country health systems and their users, and scientific questions resolved to facilitate eventual implementation. Affordability-related decisions during R&D seek to minimize future purchase and implementation costs, and incorporate interactions with international financing bodies, such as GAVI and the GFATM, years before funds are required. Adoption activities relate to planning by international organizations to identify and ensure that information needed for normative guidance and policy recommendations are developed at pace with, or as part of, clinical development [43].
A number of other activities that directly inform, and that may be directly informed by, access activities are reflected in the proposed framework. Regulatory oversight of clinical trials extends throughout R&D and evolves into regulatory monitoring and pharmacovigilance in the implementation period. Pre-clinical and clinical studies lead into phase four effectiveness studies and operational research. Epidemiological, economic and modeling studies may relate broadly to a disease area and/or may directly inform decisions on use of a specific intervention.
The analysis in this paper suggests that 10 years or more after a proven life-saving public health intervention becomes available, only a small fraction of countries in need in the developing world is likely to have access to it. As a result, lives are being lost unnecessarily. Investments in carrying out high-quality clinical trials and regulatory processes as fast as possible are at risk of being wasted. During this extended period, manufacturers may be left with idle capacity or may decide to exclude low and lower-middle-income countries entirely from their supply plans, in favor of more reliable markets in high-income countries.
This paper hypothesizes that the international community can accelerate implementation and access by systematically addressing access-related topics during the R&D period of new interventions. Such an approach raises challenges for organizations, asking them to identify ways they can contribute to new interventions during R&D, anticipating and beginning to address likely bottlenecks in advance. Identifying the key areas for early foresight in the development process has the potential to significantly shorten the time elapsed before developing countries benefit from new interventions, and as a consequence, reduce the unnecessary disease and loss of life that is experienced today.
ACT: Artemisinin-based combination therapies for treating malaria; Ar: Year of establishment of a group providing coordination (i.e. architecture); DC: Developing country; EMA: European Medicines Agency; Fi: Year of a global financing commitment, such as through GAVI or GFATM; GAVI: GAVI Alliance; GFATM: Global Fund to Fight AIDS, Tuberculosis and Malaria; CR: Year of comprehensive (i.e. global) WHO recommendation; HepB: Hepatitis B vaccine; Hib: Haemophilus influenzae type b vaccine; HIC: High-income country (World Bank defined); IPTi: Intermittent preventive treatment for malaria in infants; II: Year of availability of an improved intervention better aligned with the needs of developing countries; IR: Year of initial WHO recommendation; ITN: Insecticide treated net; LIC: Low-income country (World Bank defined); LLIN: Long-lasting insecticidal nets; LMIC: Lower-middle-income country (World Bank defined); PC: Pneumococcal conjugate vaccine; PDP: Product development partnership; RV: Rotavirus vaccine; R&D: Research and development; RDT: Rapid diagnostic test; UMIC: Upper-middle-income country (World Bank defined); WHO: World Health Organization.
Competing interests
AB, TS, DdS, and CL have no competing interests.
Authors’ contributions
AB developed the analysis strategy with input from TS, DdS, and CL. AB conducted the analysis and drafted the manuscript. TS conducted the statistical analysis. TS, DdS, and CL reviewed and critically edited the manuscript. All authors read and approved the final manuscript.
Pre-publication history
The pre-publication history for this paper can be accessed here:
Acknowledgments
We would like to thank the World Health Organization for making available its data on implementation of vaccines and malaria interventions. We would also like to thank the International Vaccine Access Center, Bloomberg School of Public Health, Johns Hopkins University for access to its data. We very much appreciated the thoughtful reviews and edits from Robin Biellik, John Marshall, and Amena Briet. This work was financially supported by the Swiss Tropical and Public Health Institute. No funder had a role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
  • Moran M, Guzman J, Henderson K, Abela-Oversteegen L, Wu L, The G-FINDER Report 2010: Neglected disease research and development: Is the global financing crisis changing R&D? London: Policy Cures; 2011.
  • Moran M. A breakthrough in R&D for neglected diseases: new ways to get the drugs we need. PLoS Med. 2005;2:e302. doi: 10.1371/journal.pmed.0020302. [PMC free article] [PubMed] [Cross Ref]
  • World Health Organization. Prequalification. www.who.int/topics/prequalification/en.
  • World Health Organization. WHO Pesticide Evaluation Scheme: “WHOPES”. www.who.int/whopes/en/. www.who.int/whopes/en/
  • Brooks AD, Wells WA, McLean TD, Khanna R, Coghlan R, Mertenskoetter T. et al. Ensuring that Developing Countries have Access to New Healthcare Products: The Role of Product Development Partnerships. Innovation Strategy Today. 2010;3:1–5.
  • Obrist B, Iteba N, Lengeler C, Makemba A, Mshana C, Nathan R. et al. Access to health care in contexts of livelihood insecurity: a framework for analysis and action. PLoS Med. 2007;4:1584–1588. [PMC free article] [PubMed]
  • Mahoney RT, Krattiger A, Clemens JD, Curtiss R III. The introduction of new vaccines into developing countries. IV: Global Access Strategies. Vaccine. 2007;25:4003–4011. [PubMed]
  • Frost LJ, Reich MR. Access: How do good health technologies get to the poor people in poor countries? Cambridge: Harvard Center for Population and Development Studies; 2008.
  • Net Gain. A new method for preventing malaria deaths. Geneva: World Health Organization; 1996.
  • Institute of Medicine. Assessment of the Role of Intermittent Preventive Treatment for Malaria in Infants: Letter Report. 2008.
  • Salako L. Artemisinin and its derivatives: the regulatory and policy implications for African countries. Med Trop (Mars) 1998;58:82–84. [PubMed]
  • World Health Organization. UNAIDS: Scientific considerations for the regulation and clinical evaluation of HIV/AIDS preventive vaccines: report from a WHO-UNAIDS Consultation 13–15 March 2001, Geneva, Switzerland. AIDS. 2002;16:W15–W25. doi: 10.1097/00002030-200207050-00028. [PubMed] [Cross Ref]
  • Brennan MJ, Fruth U, Milstien J, Tiernan R, de Andrade NS, Chocarro L. Development of new tuberculosis vaccines: a global perspective on regulatory issues. PLoS Med. 2007;4:e252. doi: 10.1371/journal.pmed.0040252. [PMC free article] [PubMed] [Cross Ref]
  • Mahoney R, Chocarro L, Southern J, Francis DP, Vose J, Margolis H. Dengue vaccines regulatory pathways: a report on two meetings with regulators of developing countries. PLoS Med. 2011;8:e1000418. doi: 10.1371/journal.pmed.1000418. [PMC free article] [PubMed] [Cross Ref]
  • Milstien J, Belgharbi L. Regulatory pathways for vaccines for developing countries. Bull World Health Organ. 2004;82:128–133. [PubMed]
  • Bosman A, Mendis KN. A major transition in malaria treatment: the adoption and deployment of artemisinin-based combination therapies. AmJTrop Med Hyg. 2007;77:193–197. [PubMed]
  • Cliff J, Lewin S, Woelk G, Fernandes B, Mariano A, Sevene E. et al. Policy development in malaria vector management in Mozambique, South Africa and Zimbabwe. Health Policy Plan. 2010;25:372–383. doi: 10.1093/heapol/czq008. [PMC free article] [PubMed] [Cross Ref]
  • DeRoeck D, Clemens JD, Nyamete A, Mahoney RT. Policymakers’ views regarding the introduction of new-generation vaccines against typhoid fever, shigellosis and cholera in Asia. Vaccine. 2005;23:2762–2774. doi: 10.1016/j.vaccine.2004.11.044. [PubMed] [Cross Ref]
  • Diap G, Amuasi J, Boakye I, Sevcsik AM, Pecoul B. Anti-malarial market and policy surveys in sub-Saharan Africa. Malar J. 2010;9(Suppl 1):S1. doi: 10.1186/1475-2875-9-S1-S1. [PMC free article] [PubMed] [Cross Ref]
  • Kramer RA, Dickinson KL, Anderson RM, Fowler VG, Miranda ML, Mutero CM. et al. Using decision analysis to improve malaria control policy making. Health Policy. 2009;92:133–140. doi: 10.1016/j.healthpol.2009.02.011. [PubMed] [Cross Ref]
  • Levine OS, Hajjeh R, Wecker J, Cherian T, O’Brien KL, Knoll MD. et al. A policy framework for accelerating adoption of new vaccines. Hum Vaccin. 2010;6:1021–1024. doi: 10.4161/hv.6.12.13076. [PMC free article] [PubMed] [Cross Ref]
  • Wenger JD, DiFabio J, Landaverde JM, Levine OS, Gaafar T. Introduction of Hib conjugate vaccines in the non-industrialized world: experience in four ‘newly adopting’ countries. Vaccine. 1999;18:736–742. doi: 10.1016/S0264-410X(99)00269-8. [PubMed] [Cross Ref]
  • Widdus R. Introduction of vaccines into the Third World. C R Acad Sci III. 1999;322:999–1010. doi: 10.1016/S0764-4469(00)87200-5. [PubMed] [Cross Ref]
  • World Health Organization. New perspective: Malaria Diagnosis. Report of a joint WHO/USAID informal consultation. Geneva: World Health Organization; 2000. (WHO/MAL/2000.1091).
  • Munira SL, Fritzen SA. What influences government adoption of vaccines in developing countries? A policy process analysis. Soc Sci Med. 2007;65:1751–1764. doi: 10.1016/j.socscimed.2007.05.054. [PubMed] [Cross Ref]
  • Glatman-Freedman A, Cohen ML, Nichols KA, Porges RF, Saludes IR, Steffens K. et al. Factors affecting the introduction of new vaccines to poor nations: a comparative study of the Haemophilus influenzae type B and hepatitis B vaccines. PLoS One. 2010;5:e13802. doi: 10.1371/journal.pone.0013802. [PMC free article] [PubMed] [Cross Ref]
  • Flaxman AD, Fullman N, Otten MW Jr, Menon M, Cibulskis RE, Ng M. et al. Rapid scaling up of insecticide-treated bed net coverage in Africa and its relationship with development assistance for health: a systematic synthesis of supply, distribution, and household survey data. PLoS Med. 2010;7:e1000328. doi: 10.1371/journal.pmed.1000328. [PMC free article] [PubMed] [Cross Ref]
  • GFATM. Technical evaluation reference group summary paper, study area 3: Health impact of scaling up against HIV, tuberculolsis, and malaria: Evaluation of the current situation and trends in 18 countries. Geneva: GFATM; 2009.
  • Miller MA, McCann L. Policy analysis of the use of hepatitis B, Haemophilus influenzae type b-, Streptococcus pneumoniae-conjugate and rotavirus vaccines in national immunization schedules. Health Econ. 2000;9:19–35. doi: 10.1002/(SICI)1099-1050(200001)9:1<19::AID-HEC487>3.0.CO;2-C. [PubMed] [Cross Ref]
  • Shearer JC, Stack ML, Richmond MR, Bear AP, Hajjeh RA, Bishai DM. Accelerating policy decisions to adopt haemophilus influenzae type B vaccine: a global, multivariable analysis. PLoS Med. 2010;7:e1000249. doi: 10.1371/journal.pmed.1000249. [PMC free article] [PubMed] [Cross Ref]
  • Alonso PL, Ballou R, Brown G, Chitnis C, Loucq C, Moorthy V. et al. A research agenda for malaria eradication: vaccines. PLoS Med. 2011;8:e1000398. [PMC free article] [PubMed]
  • Andre FE. Development and clinical application of new polyvalent combined paediatric vaccines. Vaccine. 1999;17:1620–1627. doi: 10.1016/S0264-410X(98)00426-5. [PubMed] [Cross Ref]
  • Braun LJ, Tyagi A, Perkins S, Carpenter J, Sylvester D, Guy M. et al. Development of a freeze-stable formulation for vaccines containing aluminum salt adjuvants. Vaccine. 2009;27:72–79. doi: 10.1016/j.vaccine.2008.10.027. [PubMed] [Cross Ref]
  • Capiau C, Poolman J, Hoet B, Bogaerts H, Andre F. Development and clinical testing of multivalent vaccines based on a diphtheria-tetanus-acellular pertussis vaccine: difficulties encountered and lessons learned. Vaccine. 2003;21:2273–2287. doi: 10.1016/S0264-410X(03)00107-5. [PubMed] [Cross Ref]
  • Milstien J, Munira SL, McKinney SL. Issues in selection of DTwP-based combination vaccines. Vaccine. 2003;21:1658–1664. doi: 10.1016/S0264-410X(02)00629-1. [PubMed] [Cross Ref]
  • Yates A, N’Guessan R, Kaur H, Akogbeto M, Rowland M. Evaluation of KO-Tab 1-2-3: a wash-resistant ‘dip-it-yourself’ insecticide formulation for long-lasting treatment of mosquito nets. Malar J. 2005;4:52. doi: 10.1186/1475-2875-4-52. [PMC free article] [PubMed] [Cross Ref]
  • Vaccine Presentation and Packaging Advisory Group. Generic preferred product profile for vaccines, Version 2.1. http://sites.google.com/site/vppagp/gppp.
  • Bresee JS, Glass RI, Ivanoff B, Gentsch JR. Current status and future priorities for rotavirus vaccine development, evaluation and implementation in developing countries. Vaccine. 1999;17:2207–2222. doi: 10.1016/S0264-410X(98)00376-4. [PubMed] [Cross Ref]
  • Glass RI, Bresee JS, Turcios R, Fischer TK, Parashar UD, Steele AD. Rotavirus vaccines: targeting the developing world. J Infect Dis. 2005;192(Suppl 1):S160–S166. [PubMed]
  • Goveia MG, Nelson CB, Ciarlet M. RotaTeq: Progress toward developing world access. J Infect Dis. 2010;202(Suppl):S87–S92. [PubMed]
  • Moorthy V, Reed Z, Smith PG. Measurement of malaria vaccine efficacy in phase III trials: report of a WHO consultation. Vaccine. 2007;25:5115–5123. doi: 10.1016/j.vaccine.2007.01.085. [PubMed] [Cross Ref]
  • Newton S, Owusu-Agyei S, Ampofo W, Zandoh C, Adjuik M, Adjei G. et al. Vitamin A supplementation enhances infants’ immune responses to hepatitis B vaccine but does not affect responses to Haemophilus influenzae type b vaccine. J Nutr. 2007;137:1272–1277. [PubMed]
  • Milstien J, Cardenas V, Cheyne J, Brooks A. WHO policy development processes for a new vaccine: case study of malaria vaccines. Malar J. 2010;9:182. doi: 10.1186/1475-2875-9-182. [PMC free article] [PubMed] [Cross Ref]
  • Moorthy VS, Reed Z, Smith PG. MALVAC 2008: Measures of efficacy of malaria vaccines in phase 2b and phase 3 trials–scientific, regulatory and public health perspectives. Vaccine. 2009;27:624–628. doi: 10.1016/j.vaccine.2008.11.034. [PubMed] [Cross Ref]
  • Wells WA, Brooks A. Adoption of New Health Products in Low and Middle Income Settings: How Product Development Partnerships Can Support Country Decision Making. Health Res Policy Syst. 2011;9:15. doi: 10.1186/1478-4505-9-15. [PMC free article] [PubMed] [Cross Ref]
  • Results for Development Institute. Synthesis report: New vaccine adoption in lower-middle income countries. Washington DC: Results for Development Institute; 2011.
  • Levine OS, Knoll MD, Jones A, Walker DG, Risko N, Gilani Z. Global status of Haemophilus influenzae type b and pneumococcal conjugate vaccines: evidence, policies, and introductions. Curr Opin Infect Dis. 2010;23:236–241. doi: 10.1097/QCO.0b013e328338c135. [PubMed] [Cross Ref]
  • Ojo LR, O’Loughlin RE, Cohen AL, Loo JD, Edmond KM, Shetty SS. et al. Global use of Haemophilus influenzae type b conjugate vaccine. Vaccine. 2010;28:7117–7122. doi: 10.1016/j.vaccine.2010.07.074. [PubMed] [Cross Ref]
  • World Health Organization. Technical Report Series: Safe use of pesticides. 14th report of the WHO expert committee on vector biology and control. 813. Geneva: World Health Organization; 1991.
  • World Health Organization. Report of the 5th WHOPES Working Group Meeting. 4. Geneva: World Health Organization; 2001. (WHO/CDS/WHOPES/2001).
  • World Health Organization. Insecticide-treated mosquito nets: a position statement. Geneva: World Health Organization; 2007.
  • Lengeler C. Insecticide-treated bed nets and curtains for preventing malaria. Cochrane Database Syst Rev. 2004;2:CD000363. [PubMed]
  • World Bank. Country and Lending Groups. www.data.worldbank.org/about/country-classifications/country-and-lending-groups.
  • European Medicines Agency. Rotarix, Product authorisation details. http://www.emea.europa.eu/ema/index.jsp?curl=pages/medicines/human/medicines/000639/human_med_001043.jsp.
  • World Health Organization. Immunization surveillance, assessment and monitoring. www.who.int/immunization_monitoring/data/data_subject/en/index.html.
  • Johns Hopkins University. Vaccine Information Management System. www.jhsph.edu/ivac/vims.html.
  • World Health Organization. World Malaria Report. Geneva: World Health Organization; 2010.
  • World Health Organization. Introduction of hepatitis B vaccine into childhood immunization services: Management guidelines, including information for health workers and parents. Geneva: World Health Organization; 2001. (WHO/V&B/01 2001).
  • Muraskin W. The War Against Hepatitis B: A History of the International Task Force on Hepatitis B Immunization. Philadelphia: University of Pennsylvania Press; 1995.
  • GAVI. Hepatitis B vaccine support. http://www.gavialliance.org/support/nvs/hepb/
  • World Health Organization. Expanded programme on immunization, Global Advisory Group. Weekly Epidemiological Record. 1991;66:9–16. [PubMed]
  • PATH. PATH’s Children’s Vaccine Program. http://www.path.org/vaccineresources/files/CVP_Global.pdf.
  • GAVI. Haemophilus influenzae type b vaccine support. http://www.gavialliance.org/support/nvs/hib/
  • GAVI. GAVI Board Teleconference, January 28, 2003: Summary report. http://fr.gavialliance.org/about/governance/boards/reports/index.php?theyear=2003.
  • European Medicines Agency. Assessment report for Rotarix. EMEA/CHMP/481664/2008. London: European Medicines Agencncy; 2008.
  • GAVI. GAVI Alliance Board Meeting, November 2006: Final summary report. http://fr.gavialliance.org/resources/19brd_report_nov2006.pdf.
  • European Medicines Agency. Assessment report for Synflorix. 2009.
  • Roll Back Malaria Partnership. RBM Mandate. http://www.rollbackmalaria.org/rbmmandate.html.
  • GFATM. Minutes: First Board meeting. 2002.
  • World Health Organization. 45th Session of the WHO Regional Committee for Africa: Final report. Geneva: World Health Organization; 1995.
  • National Institute of Allergy and Infectious Diseases. Technology Development. www.niaid.nih.gov/labsandresources/techdev/Pages/paraSight.aspx.
  • World Health Organization. Guidelines for the treatment of malaria. 2. Geneva: World Health Organization; 2010.
  • World Health Organization. The role of laboratory diagnosis to support malaria disease management: Focus on the use of rapid diagnostic tests in areas of high transmission. Report of a WHO Technical Consultation, 25–26 2004. Pre-publication copy. Geneva: World Health Organization; 2006.
  • Premji ZG. Coartem: the journey to the clinic. Malar J. 2009;8(Suppl 1):S3. doi: 10.1186/1475-2875-8-S1-S3. [PMC free article] [PubMed] [Cross Ref]
  • Medicines for Malaria Venture: FAQs. http://www.mmv.org/about-us/faqs.
  • Abdulla S, Sagara I. Dispersible formulation of artemether/lumefantrine: specifically developed for infants and young children. Malar J. 2009;8(Suppl 1):S7. doi: 10.1186/1475-2875-8-S1-S7. [PMC free article] [PubMed] [Cross Ref]
  • Medicines for Malaria Venture: Coartem® Dispersible. http://www.mmv.org/achievements-challenges/achievements/coartem-d?page=0.
  • World Health Organization. Guidelines for the treatment of malaria. Geneva: World Health Organization; 2006.
  • GAVI. Vaccines against major childhood diseases to reach 37 more countries. www.gavialliance.org/library/news/press-releases/2011/vaccines-against-major-childhood-diseases-to-reach-37-more-countries/
  • UNICEF. State of the World’s Children. New York: UNICEF; 2011.
  • Malaria vaccine decision-making framework. http://www.malvacdecision.net.
  • World Health Organization. Most advanced malaria vaccine candidate and timing for policy recommendations. www.who.int/vaccine_research/diseases/malaria/vaccine_candidate_policy/en/index.html.
Articles from BMC Public Health are provided here courtesy of
BioMed Central