|Home | About | Journals | Submit | Contact Us | Français|
Estimate the potential impact of Avahan, the India AIDS Initiative, among female sex workers (FSWs) and their clients in five districts of Karnataka state, south India.
Examination of time trends in sexually transmitted infection (STI)/HIV prevalence from serial cross-sectional surveys, combined with mathematical modelling.
Survey data from each district were used to monitor changes in FSW STI/HIV prevalence during Avahan. A deterministic model, parameterized with district-specific survey data, was used to simulate HIV/HSV-2/syphilis transmission among high-risk groups in each district. Latin hypercube sampling was used to obtain multiple parameter sets that reproduced district-specific HIV prevalence trends. A Bayesian framework tested whether self-reported increases in consistent condom use (CCU) during Avahan were more compatible with FSW HIV prevalence trends than assuming no or slow (preintervention rates) CCU increases, and were used to estimate HIV incidence and infections averted.
Declines in FSW HIV prevalence occurred over 5 years in all districts, and were statistically significant in three. Self-reported increases in CCU were more consistent with observed declines in HIV prevalence in three districts. In all five districts, an estimated 25–64% (32–70%) HIV infections were averted among FSWs (clients) over 5 years. This corresponded to 142–2092 FSW infections averted depending on the district (two-fold to nine-fold more among clients).
Empirical HIV prevalence trends combined with Bayesian modelling have provided plausible evidence that Avahan has reduced HIV transmission among FSWs and their clients. If current CCU levels are sustained, FSW HIV prevalence could decline to low levels by 2015, with many more infections averted.
The HIV epidemic in southern India is highly concentrated among high-risk groups (HRGs), particularly female sex workers (FSWs), their clients and MSM, who contribute disproportionately to HIV transmission compared to the general population [1–3]. Given this epidemiological context, Avahan, the India AIDS Initiative, was developed by the Bill & Melinda Gates Foundation and implemented from December 2003 [2–4]. Avahan's objective was to scale up targeted interventions to at least 80% of HRGs in Karnataka, Andhra Pradesh, Maharashtra and Tamil Nadu states, to reduce HIV transmission among them and subsequently in the general population [1–4]. The common prevention packages included peer-led outreach and education; free condoms; sexually transmitted infection (STI) treatment services; referrals for HIV and tuberculosis testing, and HIV care; empowerment and community mobilization to address local structural barriers; and mass communication programmes. Other services, including condom and STI treatment social marketing and behaviour change communication, were also targeted specifically to clients of FSWs [3–7].
As previously explained [3,8,9], the main Avahan impact evaluation on behavioural and HIV outcomes relies on Integrated Behavioural and Biological Assessments (IBBAs surveys) among targeted HRGs in selected intervention districts, complemented with mathematical modelling.
This paper evaluates the potential impact of Avahan on HIV transmission among FSWs and clients in five districts of Karnataka State – Bangalore urban, Bellary, Belgaum, Mysore and Shimoga, with different epidemiology and history of intervention. Karnataka state has an estimated 76000 urban FSWs, of whom 60000 are covered by Avahan in 18 of 27 districts (Supplementary material, Box 1i,) [10,11]. In Mysore and Shimoga, Avahan was and remains the first and only intervention implemented among HRGs [3,10,11]. In Belgaum and Bellary, Avahan was not the first HRG intervention but is now the only one. It is the major HRG intervention but not the only one in Bangalore Urban. Shimoga, Bellary and Bangalore Urban districts have lower FSW HIV prevalences compared to Belgaum and Mysore [6,7]. In these five districts, intervention activities were initiated and scaled up rapidly between January 2004 and June 2005, which prevented true baseline measurements [7,9,12,13]. As no comparable HIV data among FSWs in Karnataka are available for non-Avahan districts, there is no comparable control group [3,7,8,13–15].
The following main analyses are undertaken for each district. First, we determine whether decreases in FSW STI/HIV prevalence have been observed following Avahan implementation. Second, HIV/STI transmission modelling is calibrated (using behavioural and prevalence data) and used within a Bayesian framework to determine whether observed HIV prevalence trends support the evidence of self-reported increases in condom use during Avahan (hypothesis testing) and, if so, to estimate the likely impact of those increases in condom use on HIV prevalence, incidence and infections averted among FSWs and clients. The modelling results and strength of evidence provided by the hypothesis testing are discussed and interpreted in the light of additional evidence on implementation, coverage and intensity of the intervention and relationship between exposure of FSWs to the programme and associated changes in condom use.
HIV/STI trend analysis is based on serial rounds of IBBAs, involving random samples of FSWs, using traditional and time location cluster sampling [6,7]. Three rounds of IBBA have been conducted in all five districts between 2004 and the end of 2011 (Table 1). The first IBBA (R1) was conducted 7–19 months after programme initiation. Round 2 (R2) and Round 3 (R3) follow-up surveys occurred 28–37 and 56–73 months after R1, respectively. Crude and adjusted (for variables that differed significantly between rounds in each district) logistic regression analyses were performed using STATA, version 10.0 (Stata Corp., College Station, Texas, USA) and took into account the sampling weights and cluster sampling design. Logistic regression was used, instead of binomial regression, to avoid convergence issues when controlling for many confounding variables. The study was approved by the institutional review boards of St John's Medical College in Bangalore, India, and the University of Manitoba in Winnipeg, Canada. Additional details on data collection and statistical analyses are provided in Supplementary material (Methods A), [6,7].
A deterministic compartmental model was used to simulate HIV/herpes simplex virus type 2 (HSV-2)/syphilis (Tp) transmission between FSWs and their clients through commercial sex and through longer-term noncommercial partnerships . As chlamydia (R2: 2.8–12.0%) and gonorrhoea (R2: 1.3–3.1%) prevalence was deemed low, urine samples were not collected at R3 and, thus, these infections were not modelled (Table 1). FSWs were stratified by duration of selling sex (overall duration varied between 4 and 14 years across districts), two levels of commercial sexual activity (low and high) and three levels of consistent condom use (CCU) with occasional clients (‘never’, ‘sometimes’ and ‘every time’), which varied over time (Supplementary Table S1,). The fraction of sex acts protected by condoms was specified for each CCU level; low and high activity FSWs had specific frequencies of commercial sex, which could be varied across IBBA rounds. An adjustment factor, estimated using complementary data, was also applied to account for overreporting of FSW condom use (Table 2, Supplementary material, Methods B,) . Condom efficacy was also taken into account [13,17–22]. Occasional clients were stratified by the duration and frequency of commercial sex. Given the lack of sexual mixing data between FSWs and clients, random mixing was assumed according to availability (i.e. proportionately to total number of commercial sex partnerships reported by each risk group).
HIV was modelled with an initial phase of high-infectivity, a long low-infectivity phase and a pre-AIDS phase of increased infectivity [23–26]. Those with AIDS were assumed to cease being sexually active. Cocirculating HSV-2 was modelled dynamically with associated cofactors representing facilitation of HIV and HSV-2 acquisition and transmission [27–29]. Access to antiretroviral treatment (ART) was limited until recently (~8 and 20% of eligible patients with CD4 < 250 by end of 2005 and 2007, respectively); hence, it was not modelled [30,31]. Syphilis was modelled dynamically, including a transient immune stage and disease progression, with background treatment before Avahan, and Avahan-specific treatment and periodic presumptive treatment (PPT) [32–34]. Other than the stage of HIV and HSV-2/Tp cofactors, the force of HIV/STI infection also depended on gender, frequency of sex acts with different partnership types and condom use (details of the model and parameters in Table 2, supplementary material (Methods B), and supplementary tables S1-S2,). The mathematical model was used to simulate STI/HIV transmission in each district as follows.
Plausible uniform ranges for the prior distributions of biological and district-specific behavioural parameters were specified based on literature reviews and the FSW and client IBBA data, respectively (Table 2, Supplementary tables S1-S2,).
Given the lack of baseline and historical measurements, the model's prior distribution for time trends in CCU (i.e. fraction of FSWs who are ‘every time’ users) during commercial sex with occasional clients between the start of the epidemic and the start of Avahan was based on estimated CCU trends by Lowndes et al. – reconstructed by utilizing two IBBA survey questions that asked FSWs when they started using condoms consistently and when they started commercial sex work [9,13] (Supplementary material, Box1ii,). Following the start of Avahan, CCU with occasional clients in presence of the intervention (i.e. ‘estimated CCU trends’) was assumed to increase linearly up to levels reported in each IBBA survey and to remain constant after the last round. The validity of these trends is addressed in the discussion. The proportion of FSWs ‘sometimes’ using condoms after the start of the intervention was assumed to increase linearly from 0% to the estimates from each IBBA round (<10% in each district). The proportion of FSWs ‘never’ using condoms varied to ensure the sum of proportions always equals 1. In absence of the intervention, as no empirical control groups were available, two plausible control groups (i.e. counterfactuals) were defined for trends in CCU covering the period following Avahan initiation. ‘Control 1’ assumed no change in CCU (fixed at the CCU level at the start of Avahan), whereas ‘Control 2’ (more conservative than Control 1) assumed CCU would have continued to increase slowly at the preintervention rate suggested by the ‘estimated CCU trends’ analysis (Supplementary figure S5,). Based on available data, condom use in noncommercial long-term relationships between HRGs was assumed to be low and constant over time. Syphilis treatment and PPT were parameterized using Avahan's programme monitoring data.
Latin hypercube sampling was used to randomly select multiple parameter sets from the prior parameter distributions. The model was run with each parameter set between 1987 and 2015. Posterior parameter sets were selected if a set produced modelled FSW and client HIV prevalence projections that lay within the 95% confidence interval (95% CI) of the FSW and client HIV prevalence in all IBBA rounds and prespecified FSW HSV-2/Tp prevalence ranges (for R2 and R3, HIV prevalence figures were adjusted on the R1 distribution of prespecified key confounding variables, excluding those specifically varied over time in the mathematical model) (Supplementary material, Methods C,).
To test whether self-reported increases in condom use during Avahan were consistent with observed HIV prevalence trends (hypothesis testing), the fitting process was repeated for each CCU trend hypothesis (Estimated, Control 1, Control 2). Following previously used methods , the ‘estimated CCU trend’ hypothesis was deemed most likely only if it achieved a higher frequency of fits (proportion of prior parameter sets that produced model fits) than the two alternative control CCU trend hypotheses. The hypothesis testing stages were undertaken to validate the CCU trends as they were retrospectively estimated from self-reported CCU data. Our hypothesis testing method was validated on simulated data and showed good discriminating power (Supplementary material: Methods D,). The posterior parameter sets from the ’estimated CCU trends’ fitting results were then used to simulate the trends in HIV prevalence and incidence in presence of intervention, and in its absence by substituting the Control 1 or 2 CCU trends (all other parameters remaining the same). The number and prevented fraction of HIV infections since the start of Avahan were estimated from these simulated incidence trends with multiple posterior parameter sets being used to reflect the uncertainty in the model projections, using 95% credibility intervals (95% CrIs). The impact estimates using Control 2 are more conservative than those using Control 1 because Control 2 assumes CCU increases in the absence of an intervention. With either control group, no additional syphilis treatment by Avahan was assumed.
HIV prevalence declines occurred across rounds in all districts but were only statistically significant over 5 years (R1 to R3) in Mysore, Belgaum and Bellary in the adjusted analysis (Table 1). Chlamydia, gonorrhoea and syphilis prevalence also declined significantly between R1 and R2 or R3 in Mysore. Adjusted STI trends, between R1 and R2, were more variable in other districts. Declines in chlamydia prevalence were significant in Shimoga and Belgaum, nonsignificant in Bellary, but increased in Bangalore. Gonorrhoea declined significantly in Belgaum and Bellary but not significantly in Shimoga or Bangalore. No significant trends in syphilis prevalence occurred except in Mysore.
The ‘estimated CCU trends’ was most likely for Bellary, Shimoga, Mysore and Bangalore, with only Bangalore not receiving over 2.5 times more fits for these CCU trends than the two control CCU trends. However, Belgaum received less fits to the ‘estimated CCU trends’ than the ‘Control CCU trends’ (Table 3). These results suggest that large increases in CCU most probably occurred during Avahan in all districts other than Belgaum and possibly Bangalore.
Model projections based on the ’estimated CCU trends’ suggest that FSW HIV prevalence has been decreasing in all districts since 2004–2005. Indeed, the FSW HIV prevalence may decline to low levels by 2015 (<2–10% depending on district) without the need for any additional interventions (Fig. 1). However, prevalence peaked earlier in districts where Avahan was not the first intervention (Belgaum, Bellary) because condom use increased earlier than in other districts, and the Belgaum HIV epidemic was more mature at the start of Avahan than elsewhere (Supplementary figure S5,). Without condom use increasing after 2004 (Control 1 CCU trend), the FSW and client's HIV prevalence may have remained fairly stable or increased slightly for a few years in Mysore, Bellary and Bangalore; decreased in Belgaum; and increased in Shimoga (Fig. 1, Supplementary figure S6,).
At the R1 IBBA, the modelled FSW HIV incidence was lowest in Shimoga (2.6 per 100 person-years) and highest in Mysore (11.7 per 100 person-years), and reduced to 1.1 and 3.3 per 100 person-years at R2/R3, respectively (Supplementary table S4,). Table 4 shows the predicted prevented fraction and number of HIV infections averted among FSWs and clients for each district over different time periods, estimated by assuming either counterfactual (control groups 1 or 2). Using Control 2, the median prevented fraction among FSWs (among clients) increased from 16–20% (17–23%) in year 1 to more than 43% (>49%) over 5 years across all districts except Belgaum (Table 4B). The increase in condom use following Avahan is estimated to have prevented 36.7% (95% CrI 27.0–43.7%, Belgaum) to 55.4% (95% CrI 39.1–68.1%, Shimoga) of new HIV infections among FSWs from the start of Avahan to 2011, and between 46.0% (95% CrI 34.2–54.0, Belgaum) and 59.0% (95% CrI 47.3–72.8, Bangalore) among clients (Table 4B). Due to differences in population sizes across districts, this translates to between 220 (95% CrI 120–406, Shimoga) and 1255 (95% CrI 660–2530, Bangalore) new HIV infections being averted among FSWs by 2011. Two-fold to nine-fold more infections are averted in clients than FSWs (Table 4) in each district due to their larger population size. Lastly, syphilis treatment alone is estimated to prevent on average a maximum of 6% of new HIV infections over 10 years (Table 4C).
This is the first evaluation of the Avahan intervention among high-risk populations in Karnataka state using a preplanned evaluation framework . Our results suggest Avahan has been effective, particularly in Bellary, Shimoga and Mysore. FSW HIV prevalence declined in all districts, with statistical significance in three districts. The decline in HIV prevalence may have been facilitated by the fast turnover of sex workers. STI trends were less consistent than HIV trends potentially reflecting variation in programme effectiveness, degree of implementation (e.g. syphilis screening took off in 2008, except for Mysore where it started earlier), and different and faster transmission dynamics or a lack of statistical power. However, delays in conducting the first IBBA mean that the prevalence of curable STIs (especially those with short duration such as chlamydia or gonorrhoea) may have already decreased appreciably before the R1 IBBA [21,22,35]. Thus, the observed reduction in STI may underestimate the true decrease following programme implementation. Interestingly, Mysore, which had the earliest R1 IBBA, noted the largest declines in all STIs between R1 and R2. Lastly, a recent analysis combining the five Karnataka districts showed significant declines in HIV and all STIs between R1 and R2 IBBA .
Our Bayesian modelling analysis strongly suggests that the observed declines in FSW HIV prevalence in Shimoga, Mysore and Bellary are consistent with large self-reported increases in condom use during Avahan (’estimated CCU trends’). The evidence was moderate for Bangalore and weaker for Belgaum. Thus, CCU increases following Avahan are likely responsible for most of the decline in FSW HIV prevalence in all districts, except Belgaum. In Belgaum, HIV prevalence may have declined without condom use increasing during Avahan, partly due to the natural dynamics of the epidemic and pre-Avahan increases in condom use because Avahan was not the first intervention. This highlights how models can help interpret HIV time trends more cautiously when evaluating an intervention's impact.
Our modelling analysis highlights the time required to substantially avert infections among HRGs. Across the four districts with stronger evidence (excludes Belgaum) for increasing condom use during Avahan and using a conservative counterfactual (Control 2), we estimated that 36–68% of new HIV infections were prevented among FSWs over 7 years (until 2011) compared to 9–28% and 22–53 over 1 and 3 years, respectively. Interestingly, up to 20% larger fraction of infections were averted among clients.
Given the ‘real life’ evaluation challenges faced (no randomized control groups, delayed baseline measurements), our results have limitations, which have been partly circumvented through our analytic approach. First, our ‘estimated CCU trends’ in presence of intervention were based on reconstructed CCU trends from self-reported behavioural data, which were liable to recall and social desirability biases . However, our Bayesian modelling analysis showed that these ‘estimated CCU trends’ are generally more consistent with HIV prevalence trends than assuming no or slow increases in CCU, suggesting that these trends have some basis. Despite the modelling analysis suggesting that these increases in condom use partially caused the observed decline in HIV prevalence, it cannot directly attribute the CCU changes to Avahan without additional information (Supplementary material, Background section,). Complementary process monitoring data collected as part of Avahan indicate that the intervention has been rapidly implemented and scaled up in Karnataka (Supplementary material, Box 1i,) [10,11]. Consistent with our ‘estimated CCU trends’, additional evidence suggests that Avahan may have accounted for 88% of the abrupt increase in condom availability following the start of Avahan in these Karnataka districts (Supplementary material, Box 1ii,) . Importantly, analyses of R1 and R2 FSW behavioural data from Karnataka found a dose–response relationship between intervention exposure and self-reported condom use in commercial partnerships (Supplementary figure S4,) . In this dose–response analysis, the levels of CCU with occasional clients reported by those not in contact with the Avahan intervention were compatible with the CCU levels obtained from the average ‘estimated CCU trends’ around the time that Avahan started (Supplementary figure S3-S4,). Together, these results suggest that much of the CCU increases can be attributed to Avahan, especially in districts where Avahan has remained the only HRG programme (Mysore, Shimoga).
To minimize model misspecification, the model structure was carefully developed to reflect important sources of observed behavioural heterogeneity, based on analyses of the key determinants of HIV infection in the IBBA surveys. Nevertheless, as with any modelling analysis, simplifying assumptions were made. As no data on sexual mixing were available for commercial sex work partnerships, we assumed random mixing between clients and FSWs. Although sexual mixing influences the spread of infection, its effect on intervention impact projections is more modest when models of high-risk populations are fitted to detailed HIV prevalence data . In the absence of HIV incidence data, we fitted the model to FSW HIV prevalence data, and estimated infections averted using modelling. The modelled HIV incidence at the time of the first IBBA ranged between 2 and 12 per 100 person-years across districts, reflecting different intervention histories and condom use levels prior to Avahan, which is not directly comparable but is consistent with the only available HIV incidence estimate from Pune between 1993 and 2007 . Our Bayesian framework allows to reflect parameter uncertainty in our impact estimates – using only one parameter set could have produced overly optimistic or pessimistic estimates. Finally, in validation experiments, our hypothesis testing methods showed good discriminating power to identify or reject increasing CCU trends when it is true or false, respectively, especially for districts with four IBBA rounds or where the ratio of fits exceeds one appreciably (Supplementary table S5,).
Unfortunately, comparable data on HIV/STI prevalence and behaviour among FSWs over time were only available from intervention districts [3,8,14,15]. Given the lack of control group to indicate how condom use would have evolved without Avahan, we based our impact estimates on a conservative counterfactual, which assumed condom use would have increased at preintervention rates without Avahan. This is more conservative than assuming a stable condom use counterfactual as typically done. Despite the use of mapping and cluster random sampling, changes in the composition of the FSW population may have influenced the decline in HIV prevalence. However, we accounted for potential differences in two ways: by allowing the parameters for the frequency of commercial sex acts to change over time in the modelling analysis, and by accounting for other changes in key confounding factors by using adjusted HIV prevalence at the fitting stage. There was no evidence for a large reduction in FSW duration across IBBA rounds. We did not model ART because coverage was low during Avahan and unlikely to have influenced results.
Our analysis has several implications for future evaluations of HIV intervention programmes. Here, the Bayesian modelling approach was crucial for the success of the evaluation. Otherwise, the evaluation would have relied on trends in risk behaviour and HIV/STI prevalence from delayed IBBA surveys only. Our modelling analysis helped interpret trends and estimate impact while accounting for the natural dynamics of infection, past history of interventions, district-specific epidemiological contexts and uncertainty in the ‘estimated CCU trends’. The use of models for hypothesis testing provided a mechanism to grade the strength of evidence for intervention impact.
Our results have important policy implications. The empirical and modelling results provide plausible evidence that condom use during commercial sex has increased during Avahan, and contributed to reducing HIV transmission between FSWs and clients in Karnataka. These assertions are strengthened by strong evidence for the successful implementation of the Avahan programme, and that increases in condom use among FSWs are associated with programme exposure. Our study supports the notion that HIV prevention programmes targeted at HRGs are feasible and can have considerable impact.
The authors are very grateful to Supriya Verma who carried out the analysis to estimate the model parameters. They thank Alan Conghua for the help with figures.
M.C.B., P.V., M.A., C.M.L., S.M., B.M.R., J.B., R.W. and S.R.P. conceived the original evaluation design. All authors were involved in the study design. M.C.B., P.V. and M.P. designed the mathematical model with input from all authors. M.P. wrote the mathematical model and programmed it and performed the analysis. M.C.B., P.V., M.A., K.D., M.P., A.V. and K.M. were involved in the modelling analysis and interpretation of model results. S.M., J.B., B.M.R., S.R.P., R.W., M.A. and C.M.L. were involved in data collection. M.P., K.D., K.M., B.M.R. and K.D. performed statistical analyses. All authors contributed to the interpretation of data, statistical analysis and model results used in the study. M.C.B., with input from C.M.L., M.A., M.P., P.V. and A.V. wrote the first draft of the article. All authors contributed and reviewed subsequent drafts of the article.
This research was funded by the Bill & Melinda Gates Foundation (M.C.B., P.V., A.V., M.A., S.M., J.B.) – unrestricted grant. The views expressed herein are those of the authors and do not necessarily reflect the official policy or position of the Bill & Melinda Gates Foundation. IBBA data are accessible through an application process that can be found on the National AIDS Research Institute's (NARI) website: http://www.nari-icmr.res.in/.
All authors report no conflicts of interest.
Correspondence to Marie-Claude Boily, Department of Infectious Diseases Epidemiology, School of Public Health, Imperial College London, Norfolk Square, London W2 1PG, UK. E-mail: email@example.com