PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptNIH Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Am J Public Health. Author manuscript; available in PMC Jul 25, 2010.
Published in final edited form as:
PMCID: PMC2775758
NIHMSID: NIHMS218018
Mass Media as an HIV-prevention Strategy: Using Culturally-Sensitive Messages to Reduce HIV-associated Sexual Behavior of at-risk African-American Youth
Daniel Romer, Ph.D.,1 Sharon Sznitman, Ph.D.,1 Ralph DiClemente, Ph.D.,2 Laura F. Salazar, Ph.D.,2 Peter A. Vanable, Ph.D.,3 Michael P. Carey, Ph.D.,3 Michael Hennessy, Ph.D.,1 Larry K. Brown, M.D.,4 Robert F. Valois, Ph.D., M.P.H.,5 Bonita F. Stanton, M.D.,6 Thierry Fortune, M.B.A.,7 and Ivan Juzang, M.B.A.8
1Annenberg Public Policy Center, University of Pennsylvania
2Rollins School of Public Health, Emory University
3Department of Psychology, Center for Health & Behavior, Syracuse University
4Rhode Island Hospital, Brown University
5Arnold School of Public Health, University of South Carolina
6Department of Pediatrics, Wayne State University
7MEE Productions, Philadelphia, PA
8MEE Productions, Philadelphia, PA
Statement of author affiliation: Daniel Romer, Sharon Sznitman and Michael Hennessy are with the University of Pennsylvania, Philadelphia, PA. Ralph DiClemente and Laura F. Salazar are with Emory University, Atlanta, GA. Peter A. Vanable and Michael P. Carey are with Syracuse University, Syracuse, NY. Larry K. Brown is with Rhode Island Hospital, Providence, RI. Robert F. Valois is with the University of South Carolina, Columbia, SC. Bonita F. Stanton is with Wayne State University, Children's Hospital of Michigan, Detroit, MI. Thierry Fortune and Ivan Juzang are with MEE Productions, Philadelphia, PA.
Contributors Daniel Romer and Sharon R. Sznitman directed the analysis, interpreted the findings and were the principle authors of the paper. Ralph DiClemente, Laura F. Salazar, Peter A. Vanable, Michael P. Carey, Michael Hennessy, Larry K. Brown, Robert F. Valois, and Bonita F. Stanton, designed the study and contributed to the interpretation of the findings and writing of the paper. Thierry Fortune and Ivan Juzang directed the production of the mass media campaign.
Correspondent author information Sharon Sznitman Adolescent Risk Communication Institute Annenberg Public Policy Center University of Pennsylvania 3535 Market Street, Suite 550 Philadelphia, PA 19104 ; ssznitman/at/asc.upenn.edu Phone: (215) 870-0331 Fax: (215) 573-2667
The evidence-base and theoretical frameworks for mass media HIV-prevention campaigns in the U.S. are not well developed. In this paper we describe an intervention approach using culturally-sensitive mass media messages to enhance protective beliefs and behavior of African-American adolescents at-risk for HIV. This approach exploits the potential that mass media messages have, not only to reach a large segment of the adolescent population and thereby support normative change, but also to engage the most vulnerable segments of this audience to reduce HIV-associated risk behaviors. We illustrate the effectiveness of this intervention approach with results from an ongoing HIV-prevention trial implemented in two medium sized cities in the U.S.
The HIV incidence rate in the U. S. is seven times higher among African-Americans than among whites (1) with disproportionate transmission through heterosexual contact (2). Although adolescents with HIV/AIDS represent a minority of U. S. cases (approximately 5%), they constitute one of the fastest growing groups of newly infected persons in the country, and African-American adolescents are disproportionately affected. Of the estimated 18,849 people under the age of 25 who were diagnosed with HIV/AIDS during 2001–2004, 61% were black (3). Given these data, it is imperative that interventions focus on African-American adolescents and specifically address the concerns that are unique to this population. In addition, it is especially desirable for HIV-prevention interventions to reach as large an audience as possible.
Mass media campaigns are well-suited to meet these goals because media have wide reach (7,12); adolescents in general, and African-American adolescents in particular, are heavy users of media; and because media messages can be culturally targeted to this audience. Furthermore, experience from commercial marketing suggests that African Americans respond favorably to mass media messages designed to address their specific interests (4, 5).
Unfortunately, the evidence for the effectiveness of general HIV mass media prevention campaigns in the U. S. is weak (6), and this is particularly true for campaigns targeting African-American adolescents. This is partly because researchers face problems in isolating media effects in multi-component interventions (7, 8). In addition, most HIV prevention in the U. S. has been conducted on an individual level with small group counseling or school based programs (9). This practice has been justified through the belief that “face-to-face” interventions have greater power than mass media to alter HIV-associated risk behaviors (7) in part because these interventions permit greater opportunities for active participation (e.g., skills training, modeling, and rehearsal) relative to viewing a media message (10).
In this paper, we describe a culturally-sensitive approach to using mass media to promote greater acceptance of safer sexual behavior in the wider African-American youth audience and, more importantly, to encourage behavior change (condom use) in the youth most at risk of sexually transmitted infections (STI), including HIV. Interventions can be sensitive to the surface and/or deep structure of an audience's culture (11). Surface structure refers to the use of change agents whose background and use of language is similar to that of the audience and the use of channels of communication that can best reach the audience. Sensitivity to deep structure reflects an understanding of how members of the audience conceptualize the health risk in their lives and the barriers they encounter in reducing or managing the risk. We designed an intervention to be sensitive to both types of structures, and we argue that culturally-sensitive messages can be designed to actively engage youth, especially those who are most at risk of HIV infection. We also illustrate the approach with preliminary data from a randomized controlled trial that was designed to rigorously test the effectiveness of such an intervention. However, we first review what is known about the use of media to influence the adoption of HIV preventive behaviors.
Mass Media and HIV Prevention
Considerable experience with mass media HIV-prevention campaigns has been gained from the developing world. These interventions suggest that safer sexual behavior can be encouraged by media messages that promote favorable norms and behavior in entire communities. Furthermore, successful interventions have employed sufficiently intense schedules of television or radio to reach the youth audience. In South Africa, for instance, the LoveLife program found that mass media in combination with a face-to-face intervention was associated with a decreased risk of HIV infection, decreased number of partners, and increased use of condoms (12). Furthermore, a radio and TV HIV prevention campaign in Ghana directed to 15–30 year olds was successful in decreasing sexual initiation among the youngest cohort. More generally, the media campaign increased awareness of AIDS and condom use among the sexually active (13). Another study in Ghana examining the effect of a mass media campaign, directed to 15 to 24 year olds, found that the campaign increased personal risk perceptions, self-efficacy for condom use and lowered the perceived difficulties of obtaining a condom (14). More recently, a mass media campaign in Kenya was successful in increasing the utilization of HIV testing among 15 to 39 year olds (15).
Experience with media campaigns for adolescents in the U. S. and Europe suggests that similar effects can be achieved in developed countries. Media interventions were conducted early in the epidemic for adolescents and young adults in Switzerland and The Netherlands. In both countries, multi-media campaigns were associated with increased rates of consistent condom use, particularly among persons without steady sexual partners (1618).
Although media interventions designed to influence adolescent sexual behavior have been attempted in the U. S., evaluations have only recently been able to isolate the effects of the media from other intervention components. A multi-media campaign directed to youth ages 14 to 18 in Sacramento (California) was associated with a 4.3% population-based increase in condom use with steady partners (19). An intensive television campaign directed to youth ages 14 to 18 in Portland (Oregon) (20) was associated with a 10% increase in condom use for new partners. This finding was consistent with the emphasis in the campaign messages on new partners. Finally, in Lexington (Kentucky) a television campaign aimed at young adults who were above average in the sensation seeking trait resulted in greater condom use and condom use self-efficacy and intentions (21).
In several of these interventions, the mass media exerted greater influence on young people who were at higher risk for STIs, that is, sensation seekers (21) and people with new partners (16, 20). Despite these favorable findings, no evidence exists on the effects of media campaigns targeted to African-American adolescents, especially to segments of the target audience that are particularly at-risk. Here we outline an approach to developing a culturally-sensitive mass media program that was expected to produce a continuum of effects ranging from behavior change in the most at-risk segments to changes in beliefs and attitudes that support normative changes in the wider, and less at-risk, community.
Framework for Culturally-Sensitive Health Communication
Our approach to designing an effective culturally-sensitive public health media program involved three major components. First, it required an understanding of the deep structure (11) of African-American adolescents' culture. Indeed, culture, broadly defined as values, beliefs, norms, and behaviors shared by a group (22, 23), is important to HIV prevention because these factors influence sexual health behaviors. However, although African-American youth may experience unique barriers to reducing unsafe behavior, we did not assume that their adolescent culture has a uniform influence on individuals. Indeed, we assumed that the culture represents a dynamic range of beliefs (24, 25). To gain greater understanding of these beliefs, we conducted in-depth interviews with a diverse group of youth exhibiting the continuum from little sexual risk behavior to considerable risk behavior. These interviews enabled us to learn how youth conceptualize barriers to safer sexual behavior, as well as strategies for resisting pressures to engage in unsafe practices. Through this process, we identified “counter-narratives” that could inform the development of messages that enable youth to reject dominant arguments that support risk-taking behavior (26). These counter-narratives could provide all adolescents, and particularly those most at-risk, with strategies to resolve conflicts surrounding their own attempts to engage in safer behavior.
A second component of our approach was that in order to illustrate the use of effective counter-narratives, it was critical to employ dramatic depictions of youth modeling the use of these strategies. Mass media that simply lecture the audience about the benefits of safer behavior are less effective than dramatic formats (27, 28). Dramas provide the opportunity to embed arguments and counterarguments within a narrative that has personal relevance to the audience, especially those who are facing similar conflicts in their own lives (2931). Messages delivered as dramatic episodes use “learned self-relevance,” a process that promotes identification and vicarious participation in the narrative (27). Messages concerning high-risk behaviors should therefore have greater impact on youth at higher risk of STD/HIV infection.
Our culturally-sensitive approach is akin to the use of entertainment education, an approach that uses longer programming formats (e.g., telenovellas) to educate audiences about health-related topics (1315). This approach is designed to prompt a vicarious form of engagement (known as parasocial interaction) with media characters who elicit identification in audience members, in our case, those most at risk for STI/HIV. Although our use of television and radio media spots afforded less opportunity to develop elaborate story lines, our shorter vignettes were designed to speak directly to the segment of the audience most likely to adopt the recommended behavior.
The use of drama is also consistent with Bandura's Social Cognitive Theory of Mass Communication (32), which emphasizes the importance of media for modeling desirable behavior. Furthermore, Bandura's Social Cognitive Theory (32), which emphasizes the importance of beliefs about the consequences of adopting recommended behavior (outcome expectancies) and beliefs about personal ability to withstand opposition to the recommended behavior (self-efficacy) are critical mediators of change. Effective messages using drama should influence these beliefs as well as providing compelling models of safer behavior. Although the theory provides these conceptual guidelines, it was still critical to determine their content in designing a successful media intervention.
Media Message Development
To achieve the aims of an effective culturally-sensitive communication program, semi-structured interviews were conducted with 124 low-income African-American adolescents in the cities where the media intervention was to be aired (33). In addition, adult community advisory boards representing the cities made suggestions to the creative and research teams regarding media content (34). Media messages were also pretested and modified after feedback from African-American adolescents regarding the effectiveness and appropriateness of the messages.
Formative research was particularly important for understanding adolescents' beliefs regarding barriers to engaging in protective behavior (35). For example, it became evident that beliefs that condoms hinder sexual pleasure was common in the target audience (33). “… it takes the feeling away. So that's why they, they don't none of them use them” (17-year-old female). In order to produce media messages relevant to negative condom use outcome expectations we sought counter-arguments to the notion that condoms reduced sensation by analyzing what adolescents said was good about condoms. A few informants mentioned that condoms reduced stress. “They just safe to meI feel like I can't catch nothing(18-year-old male). Based on adolescents' feedback, media messages were designed to debunk myths that condoms are uncomfortable by emphasizing the ability of condoms to enhance pleasure by reducing stress and worry regarding pregnancy and HIV/STIs (theme 1). We expected this message to change beliefs surrounding condom use in the entire youth audience.
Second, our formative research indicated that it was important to counteract the belief that sex is necessary to maintain a relationship (33). Only 9 of the 59 males interviewed (15%) had not experienced vaginal intercourse. Those who had deliberately postponed engaging in sexual intercourse described being teased by peers for being unmanly. Girls who had postponed intercourse also perceived pressure indirectly, in their friends' explicit or implicit critiques of the masculinity of their partners: “They were like: Why won't I have sex with my first boyfriend? What's wrong with him? And they pushed me more than he did” (16-year-old female).
Given the centrality of masculinity in adolescents' discussions of pressures to pursue sexual experiences, we sought counterarguments engaging alternate positive views of masculinity. We found that arguments in favor of postponing sex hinged on notions of sexual etiquette and a view of masculinity based on mutual respect. “She was just like, no, we shouldn't do it yet. And I'm like, alright, I respect that” (18-year-old male). Based on this feedback, we designed messages to promote the norm that “waiting to initiate sex” shows respect for one's partner as well as reflecting maturity and concern for one's partner (theme 2). We expected this message to be particularly influential for those who were sexually active.
Third, our research indicated that it was important to counteract the belief that a steady partner is a “safe” partner by emphasizing that one cannot always know with whom a partner is having or has had sexual contact in the past. These messages emphasized that condoms should be used even with steady partners (33) (theme 3). For instance, one radio ad depicts the two themes regarding “condom use with safe partners” and “waiting to initiate sex” through a conversation between two young men. The first explains that his girlfriend is not ready to have sex, but that his friends are pressuring him: “The guys are like “Yo…you ain't hit that yet?” His friend responds, “Hey, forget those fellas. Consider yourself a lucky man … I actually prefer a girl who respects herself and waits until she's ready,” then emphasizes that using condoms represents self-respect. The tagline is delivered by an announcer at the conclusion of the vignette: “when you have sex with someone, you have sex with everyone they'd ever slept with” and followed by a reminder to use condoms correctly every time. We expected this message to be particularly effective for those who were at the highest risk of STI. Furthermore, we expected behavior change, as indicated by reports of unprotected sexual contacts, to be greatest among youth at highest risk of infection (i.e., STI positive adolescents).
As part of the message strategy of the media production team, all of the radio and TV spots featured Hip/Hop music and African-American adolescent actors, all stressed the importance of using condoms, and all featured the tag: Life is what you make it. Be safe. If you are sexually active, there's only one way to protect yourself for sure…use a condom correctly every time.
Study design
Data analyzed in this study are part of project iMPPACS1, a multisite project involving researchers and practitioners with a wide range of expertise in adolescent health promotion. An important part of the team was the media production company Motivational, Educational Entertainment that has expertise in the development and production of media materials for African-American youth (36). We conducted the study in two matched northeast (Providence, RI and Syracuse, NY) and two matched southeast U. S. cities (Columbia, SC and Macon, GA). All cities have sizable African-American communities with above average levels of poverty and high STI/HIV-prevalence rates. The cities were selected for this study because they did not have a history of recent HIV/AIDS media interventions or extensive school-based efforts to reduce risky sexual behavior. Syracuse and Macon were randomly assigned to receive the media campaign in the northeast and southeast, respectively, with Columbia and Providence serving as controls. The project recruited 1657 respondents (ages 14–17) between August 2006 and January 2008 through a variety of channels anchored in our collaboration with community based organizations (CBOs), such as Boys and Girls Clubs and community centers that provide recreational, social, and educational services for young people. We recruited 21% of our cohorts directly in those centers and 29% from participant referral. However, we also recruited youth using street outreach (9%), respondent driven sampling (15%), and referral from adults in the community (14%). Only 25 (1.5%) of the eligible adolescents refused or were unable to participate in the study. An attempt was made to over-sample females who were expected to have higher rates of STI (37). The recruitment procedures in the four participating cities produced relatively equivalent samples in terms of sexual risk behavior, gender and age (supplemental Table 1, available as supplement to the online article at http://www.ajph.org). Nevertheless, as described below, we also controlled for sample heterogeneity statistically by using a propensity weighting procedure in all tests of intervention effects.
The media campaign ran continuously during the 15-month recruitment period in each media city using three 30-second television ads and eight 60-second radio ads. The ads were placed on channels and during programming hours that were popular among African-American adolescents. Based on estimates provided by the media channels, the average adolescent in the media markets was exposed to three TV and three radio ads per month during the study period.
Following assent by each youth and informed consent by his/her parent(s)/guardian(s), participants completed an assessment using an audio, computer-assisted self-interview (ACASI). A test-retest study of the ACASI was undertaken with a sample of African-American adolescents prior to the trial and outcome measures were observed to have moderate to high levels of reliability (38). In addition to the media intervention, project iMPPACS also included a small group intervention component to which the participants were randomly assigned after completing the assessment. Upon completion of the project, participants will have completed follow-up assessments at 3, 6, 12 and 18 months after the small-group intervention. Because the initial surveys were done during the 15-month recruitment period while the campaign was running, we use the results of these interviews in the present paper to examine differences in core outcomes as a function of residence in either a media or non-media city. The result of the small group intervention in combination with the media using follow-up data will be examined in future studies.
Participants provided urine specimens to assess the presence of three prevalent STIs among adolescents: gonorrhea, chlamydia, and trichomoniasis. Chlamydia and gonorrhea were tested using Strand Displacement Amplification (39), whereas trichomoniasis was tested using a real-time PCR assay (40). Urine collection occurred in a private room. Specimens were stored in refrigerators until packed in approved biospecimen boxes and shipped via overnight courier to the Emory University Microbiology Laboratory for assay. Youth who tested positive for any STI were treated and counseled by a medical care provider. However, results of the testing were not known until about 2 weeks after the baseline ACASI had been completed. Youth received $30 for completing the assessments. The study was approved by the IRBs of the participating universities.
Data Analysis
We conducted a series of contingency table analyses to identify significant differences between intervention groups on sociodemographic variables and measures of sexual risk. For the multivariate analysis, we used negative binomial regression for count data, linear regression for normally distributed variables, and logistic regression for dichotomous variables. The multivariate analyses were conducted sequentially, starting with all simple effects (i.e., gender, age, media, time, risk groups) and the interaction of time and media in the model. We also included higher-order interactions (two- and three-way interactions) that were kept in the final models if they reached significance, and taken out in models were they did not. All analyses were conducted using Stata 10 (41).
Although the two pairs of participating cities were carefully matched and the media intervention was randomly assigned to one city in each pair, the small number of cities makes it possible that observed media campaign effects are biased by pre-existing city differences. To reduce this possible bias, we adjusted uncontrolled background factors using a propensity-score approach to construct weights for individual observations (42, 43). We obtained the weights by taking the inverse of the estimated probability that an individual was in a media city. This probability was calculated with a logistic regression predicting media city using 130 background factors that might differ between media and non-media cities but that could not be influenced by the media intervention, such as gender, age, native born status, number of siblings, and grades in school. The pweight Stata command was then used to enhance equivalence between media and non-media cities for all multivariate analyses. This weight option uses a robust variance estimation technique to correct variance, standard errors, and confidence intervals.
Predictors
Demographics and media exposure
Respondents were coded for presence in a media city (1 = yes; 0 = no). Because the media campaign could have a cumulative impact over time of its operation, we also entered the simple effect of time elapsed since the start of the media campaign (in 3-month intervals) and the interaction between this variable and media city. Respondent's age and gender were included in all models and their interactions with intervention variables were tested and kept when significant. The survey assessed exposure to the media campaign by asking respondents whether they had seen a TV ad or heard a radio ad in the last month that talked about the risks of STI/HIV (0=never seen (TV) or heard (radio) ads, 1=heard or seen ads, 2=heard and seen ads). Although a more sensitive measure would have been to assess awareness of actual segments of the media messages, such questioning was avoided at baseline because it might have introduced media influence in the non-media cities, confounding the interventions in the overall trial. However, these data were available at the 6-month follow-up assessment, and we also report these results (0=not seen any of the ads, 1=seen one or more of the ads).
Risk groups
Three levels of risk were examined in order to test the hypothesis that the media campaign would have particularly strong effects among those to whom the messages were most relevant. The risk groups were defined a priori based on their increasing risk of acquiring an STI: (a) not sexually active (no anal, oral and/or vaginal sex in the last three months) and STI negative, (b) sexually active and STI negative, and (c) already STI positive. We examined differences in media effects across these three groups and by gender within each group. Category (c) included both recently sexually active (n=91) and non-sexually active adolescents (n=15). Logistic regression analysis confirmed that STI-positive adolescents constituted a particularly risky group among the sexually active adolescents in that they were more likely to have had a previous STI test, they had lower condom use intentions, and they had had more sexual partners than the sexually active adolescents who tested negative for an STI. However, there were no differences in these risk factors across media and non-media cities, indicating that STI positive youth in the media cities were relatively comparable to those in the non-media cities.
Dependent variables
The effects of the three media themes were examined separately in five models. Two outcome variables measured the effect of the first media theme that attempted to counteract the belief that condoms hinder sexual pleasure. First, one item from the Condom Attitude Scale (44) asked respondents whether they agreed that condoms create a sense of safety: Respondents were categorized into two groups, those who strongly agreed (0) versus those who agreed less strongly or disagreed (1). Second, expectancies that condoms hinder pleasure were measured by summing agreement responses for the following items from the Condom Attitude Scale (44, 45): (a) Condoms take away the pleasure a guy has during sex; (b) condoms are messy; (c) condoms make sex hurt for girls; (d) condoms take away the pleasure of sex; and (e) using condoms takes “the wonder” out of sex (1=strongly disagree to 6=strongly agree). Cronbach's alpha (α) for the scale was .78.
The second media theme, “waiting to initiate sex shows respect for one's partner,” was assessed through two separate outcome variables. First, two items from the Outcome Expectancy and Perceived Vulnerability Scale was used (46). Respondents were asked how likely it would be that (1) the quality of and (2) love in a relationship would increase if they had vaginal sex in the next 3 months (1=very unlikely, 6=very likely). The sum of these variables was used to measure perceptions that sex improves a relationship. Alpha for the scale was .69. The second media theme was also assessed through the degree to which respondents considered themselves able to say no to having sex, a variable that took the sum of the following items from the Sex Refusal Self-Efficacy Scale (47): How sure are you that you would be able to say no to having vaginal sex: (a) if you have known the person for a few days or less, (b) if you want to date him or her again, (c) if you want the person to fall in love with you, and (d) if the person is pressuring you to have sex (1=I definitely could say no to 4=I definitely could not say no, scale range = 4–16; α = .84).
The third media theme, which counteracted the belief that a steady partner is a “safe” partner, was assessed using three items from the Condom Attitude Scale (44) that examines the perception that condoms are not needed with certain types of partners. This measure was based on the sum of the following items: condoms are not needed (a) if you are sure the other person does not have an STD, (b) if you know your partner and (c) if you and your partner agree not to have sex with anyone else (1=strongly disagree, 6=strongly agree; α =.85).
Unprotected sex contacts were measured using the sum of three items that asked respondents how many times in the last three months they (or their sexual partner) had not used condoms when having vaginal, oral, and anal sex. Such counts of unprotected sexual contacts are regarded as the best way to evaluate the risk of STI/HIV contraction (48). Unprotected vaginal contacts were correlated with anal (Spearman r = .231, P < .001) and oral (Spearman r = .282, P < .001) unprotected contacts. Because all three types of sexual behavior were correlated and they each pose a risk for acquiring an STI, we summed responses to the three types of exposures to create an overall score of unprotected sex (ranging from 0 to 72). Validity for this score was evident in a negative binomial regression predicting non-condom use contacts from STD infection, age, alcohol and cigarette use. To exclude potential media effects, we restricted the analysis to respondents from the non-media cities. Results showed that the unprotected sex score was significantly related to having tested positive for an STI (B = .587, P = .034).
Number of sexual contacts was measured using the sum of protected and unprotected vaginal and anal sexual contacts in the last three months. Responses ranged from 1–65.
To validate that media and non-media city differences were attributed to the media campaign and not a spurious relation, we examined city differences based on risk behaviors not mentioned in the media campaign. Outcome variables used were substance use attitudes [smoking/drinking would be very bad for me (1) to very good for me (4)], perceived health risks of cigarette use [smoking would be very risky for my health (1) to not at all risky (4)], and peer norms (how many friends smoke cigarettes: 1=none to 6=almost all). We also examined city differences in reported alcohol use (1=never drank to 7=drank on 100 or more days in lifetime), cigarette and cannabis use (0=never used vs. 1=used in lifetime). Lastly, since our intervention efforts did not attempt to increase condom availability, we examined city differences on a composite score that assessed differences in perceived difficulty of obtaining or carrying condoms (1=very hard to 6=very easy).
Media exposure
A fundamental premise behind the success of a media campaign is that the target audience is exposed to the campaign messages. A large proportion of the study participants watched TV (69%) and listened to radio (47%) two or more hours on a typical weekday making it clear that the media messages had the potential to reach the target population. Furthermore, throughout the study period, the mean reported exposure rate to HIV prevention messages was higher in the media cities (1.51) than in the non-media cites (1.35; B = .156, P <.001). Although these results indicate that campaign awareness was greater in the media than in the non-media cities, the results suggest that youth in the non-media cities also received HIV-prevention messages. At the 6-month follow-up, we probed for recognition of actual segments of the television and radio ads. We found that nearly all of the youth in the media cities (97%) had seen or heard a campaign ad while only 36% of youth in the non-media cities reported seeing or hearing a campaign ad. Thus, we have evidence that the campaign reached our intended target audience despite the presence of other messages that potentially originated from national sources such as MTV (there was no local media campaign directed to STD/HIV prevention in either non-media city).
A regression analysis based only on respondents in the media cities also showed that females reported more media exposure than males (B = .186, P <.001). However, media exposure did not differ by risk group (sexually active, STI negative adolescents: B = .040, P = .402, STI positive adolescents: B = .−006, P = .942).
Demography, sexual behavior, and comparability of conditions
Participants' ages ranged from 14 to 17 (M = 15, SD = 1.05) with 978 (60%) female respondents. Six males reported anal sex with males, two of whom also reported anal sex with women. Due to the low number, no separate analyses were conducted with this subsample. Furthermore, 16 adolescents tested positive for at least one STI but reported no prior sexual contact. Because these cases may have been false positives and were not asked about number of previous sexual contacts, they were excluded from further analysis. A total of 625 (38%) respondents were sexually active and STI negative, and 106 respondents were STI positive (6.5%). In addition to the relatively high STI prevalence, 29% of sexually active adolescents reported a history of HIV testing (49). Of those adolescents tested, six reported being positive for HIV (2.1%), and 39 did not know their results (14%). There were no significant differences between adolescents in the media cities and the non-media cities in terms of gender and sexual experience (supplemental Table 1, available as supplement to the online article at http://www.ajph.org). Proportionally more adolescents in one media city did, however, test positive for an STI, and participants in two cities were slightly younger than in the other two.
Relations between outcome variables
In order to assess the relations between the outcome variables, rank-order correlations were computed (see supplemental Table 2, available as supplement to the online article at http://www.ajph.org). Our message strategy to increase the acceptance of condoms appears to be justified because this outcome was significantly related to each of the other outcomes. That is, youth who thought that condoms hinder sexual pleasure were more likely to believe that condoms do not provide a feeling of safety, that they are not needed with safe partners, that having sex improves the quality of a relationship, and that they lacked sex-refusal self efficacy. Most importantly, they also tended to engage in more unprotected sex. Other outcomes that were also directly related to unprotected sex were the belief that condoms are not needed with a safe partner and that sex-refusal self-efficacy was lacking.
Media effects on outcome expectancies, sex refusal self-efficacy, and sexual behavior
With one exception, effects of the media intervention were more evident for youth who were sexually active (Supplement Table 3 available as supplement to the online article at http://www.ajph.org). Results show that the media message that was intended to increase acceptance of condoms (by reducing beliefs that condoms hinder sexual pleasure) was successful (theme 1) among all three risk groups (Model 1; Figure 1a). The first theme was also assessed through respondents' expectancies that condoms give a feeling of safety. For this outcome, media messages resonated particularly well among the sexually active adolescents who did not have an STI (Model 2; Figure 1b), although change among STI-positive youth may have been limited by a floor effect.
Figure 1
Figure 1
Weighted, unadjusted means of outcome expectancies and self-efficacy by media vs. non-media cities and risk groups.
The second theme which promoted the norm that “waiting to initiate sex” shows respect for one's partner had positive effects among the sexually active and the STI positive adolescents. Specifically, in the media cities these adolescents were more likely to report greater sex refusal self-efficacy (Model 3). However, as Figure 1c shows, the STI-positive adolescents scored low on this outcome even in the non-media cities. In regard to expectancies that sex need not improve a relationship (Model 4), results also showed that the theme resonated particularly well among the STI-positive adolescents (see Figure 1d).
The third campaign theme which attempted to counteract the belief that a steady partner is a safe partner with whom condoms are not necessary, was also particularly effective among the highest risk group. Model 5 shows that the media campaign successfully decreased the belief that condoms are unnecessary with safe partners. Yet, an interaction term with time suggests that the media effect leveled off over time (B = 1.203, P = .007).
Table 1 shows the results for unprotected sexual occasions. This analysis is based on sexually active adolescents only since details about protected sex were only asked of these adolescents. Results show that STI-positive females in the media cities reported fewer non-condom use occasions than their counterparts in the non-media cities. It should be noted that the estimates for males are unreliable because there were only 21 STI positive males. Number of sex occasions did not differ between media and non-media cities or by gender and STI status (results not shown).
Table 1
Table 1
Final models - weighted regression analysis of safe sex attitudes and sexual behavior among sexually active adolescents, N=706
Although the use of geographically-matched cities and propensity-score matching enhances the equivalence of the test versus control sites, we cannot rule out the possibility that the observed differences are attributable to trends that would have occurred in the absence of the media campaign (e.g., greater concern for risky behavior in the media cities). However, if this were the case, we would expect the media cities to exhibit lower levels of other risk attitudes and behaviors as well. In turn, we examined city differences in terms of substance use outcome expectancy, risk belief, norms and behavior. We did not find overall or subgroup differences in terms of any of these 18 outcomes (P < .05), except for one in which sexually active STI-negative adolescents in the media cities were less likely to smoke cigarettes. However, this one significant effect out of 18 tests could well be expected due to chance.
We also examined one sex-related outcome that was not mentioned in the media messages. Indeed, if the results we obtained were in fact a result of the media campaign, we would expect there to be little or no effect on responses to outcomes that were not directly targeted in the campaign. We thus examined media effects on a composite score that assessed differences in perceived difficulty of obtaining or carrying condoms. This outcome was not related to the media campaign overall or within any subgroup.
We have outlined an approach to developing culturally-sensitive HIV prevention media materials. With the epidemic growing disproportionately in low-income African-American communities, there is a need to implement such interventions to enable young people at highest risk to avoid continued risk taking and to encourage the entire youth community to support safer-sexual practices. Prevention practitioners and researchers agree that culturally- sensitive health communications are more effective than culturally-neutral information (5052). Indeed, cultural factors are important to HIV prevention because they can exert a powerful influence on sexual health behaviors. However, culture is dynamic and diverse, and dominant norms do not exert a uniform influence on individual behavior. As a result of careful formative research, it was possible to identify culturally-sensitive messages that could support safer sexual behavior in this audience. These messages used dramatic formats to illustrate health promoting behavior that would have high relevance to youth at greatest risk of infection (sexually active youth with pre-existing STI).
We anticipated and found that our media messages had a continuum of effects, ranging from improved outcome expectancies regarding condoms among all youth to reports of reduced unprotected sexual contacts among those who were already infected. Our stronger findings for females who were STI positive in regards to unprotected sexual contacts may reflect the fact that females were disproportionately represented among this highest risk group (85 out of 106) and that we also oversampled females because of their greater propensity to acquire STIs (37). Other differential effects were likely to result from the differing levels of relevance of the messages to the audience (2931). For example, acceptance of condom use should be relevant to all in the audience. However, messages designed to convince adolescents of the benefits of delaying sex in a relationship or using a condom even with partners who might otherwise seem safe might not be seem particularly relevant to non-sexually active adolescents who may not even have a romantic partner. Sexually active adolescents, on the other hand, are more likely to relate to the conflicts that the characters depicted are experiencing, thereby creating an opportunity for applying the situations to their own experience
A second element that may produce differential audience effects is the opportunity to change one's behavior. In a situation where the audience already agrees that condoms provide a feeling of safety, for instance, there is limited opportunity for the media campaign to achieve further change. Figures 1b–c suggest such a “floor effect” for STI-positive adolescents, and the same effect for adolescents who were not sexually active and STI negative is particularly evident in Figures 1d–e. On the other hand, although media messages might have effects that are currently difficult to detect due to floor effects, they may become more evident as adolescents mature. Indeed, Bandura (32) theorizes that media messages can have a prompting function that makes previously learned behavior salient, especially when it is relevant to the audience. This mechanism functions primarily to reinforce existing skills and behaviors that might otherwise lose salience. From this perspective, it is possible that effects of continued media exposure will become evident at later follow-up assessment when safer behavior is more relevant to adolescents. Indeed, the adolescents in the media cities who were not sexually active during the recruitment phase may adopt safer sexual practices and attitudes once they initiate sex than their counterparts in the non-media cities. This is a possibility that will be explored as the cohort ages.
Despite the differential effects of the media, we found that acceptance of condom use among all segments of the audience was strongly related to all other outcomes, particularly to reports of condom use among sexually active youth. It is noteworthy that this outcome appeared to have the widest response in our audience. Indeed, our intention was to produce widespread change in this belief so that support for use of condoms would be normative in the youth community (53). Although this belief alone was not sufficient to change behavior among all sexually active youth, it may nevertheless have helped to support change among the most vulnerable to infection and laid the groundwork for future protective behavior among audience members who would otherwise become vulnerable.
Research on mass media effects has been criticized for not incorporating particularly rigorous designs (8), and this might explain why several large community trials have identified only weak effects (54). One strength of the current study is that it explores a continuum of media effects. Previous evaluations of mass media prevention campaigns have often failed to do so, which may have reduced the sensitivity of the studies because the entire audience was treated as equally susceptible to the intervention when in reality effects ranged over a continuum representing differential risk to the audience (55).
Limitations
The present research design includes control groups that should hold constant regional and national differences in adolescent sexual behavior. Nevertheless, the design is limited by the fact that we did not have assessments for a period prior to the media campaign. Furthermore, we have a limited number of cities in our study, which makes it difficult to control random effects. We have, however, partly compensated for these factors through propensity score weighting and examining risk behavior and expectancies not directly linked to the media campaign. Since we found no city differences on these variables, we can be more confident that the differences in sexual attitudes and condom use behavior we observed are attributed to the media campaign and not to trends that were occurring apart from the campaign. In addition, the cities were selected because they did not have local campaigns directed to sexual behavior prior to their selection and pilot work indicated that youth were equally sexually active in the four cities, a finding that was also observed in this study. Thus, it seems unlikely that the differences we found were present prior to the media intervention.
Another limitation is that we relied upon self-report, which can be influenced by memory or motivational biases; however, the use of ACASI should have reduced some of this bias. In addition, reports of unprotected sex were related to existing levels of STI, suggesting that they do reflect valid variation in sexual risk behavior. Nevertheless, we are currently conducting follow-up surveys with the youth cohorts in the study for 18 months post-baseline with STI testing at six, 12, and 18 months. This provides an opportunity to determine the effects of the campaign on a biological outcome as well as on self-reports of safer behavior.
In the fields of public health and health communication, scholars believe that although mass media afford the broadest reach, interpersonal communication is more efficacious (7). This conclusion is based on the assumption that the use of mass media resembles a passive intervention, characterized by the presentation of material to an audience that has limited participation. Indeed, in a recent meta-analysis of HIV prevention interventions, Albarracín et al. (10) found that passive interventions are less effective than active interventions that employ exercises (e.g. role playing) to increase behavioral skills. Reardon and Rogers have, however, argued that the distinction between mass media and interpersonal communication may be a “false dichotomy” (56). Similarly, Horton and Wohl originally described the relationship between media characters and audience as para-social, in that the audience forms a relationship with a performer that is perceived as analogous to the interpersonal relationship of people in face-to-face interaction (57).
The present study proposes a similar characterization of mass media interventions. Although it is correct that the present media campaign does not actively engage the adolescents in role-play, it uses dramatic depictions of conflicts surrounding adolescent sexual behavior that model individual decision making processes and behavior in situations relevant to high-risk audience members. These were intended to engage the audience to adopt the role of the media characters and hence use the media messages as a template for their own decisions and behaviors. This is also akin to Bandura's theory of mass communication (32), which emphasizes that demonstrations of appropriate behavior by culturally relevant actors have the ability to teach audience members new ways of thinking and acting.
A substantial reduction in HIV incidence will require wide reaching dissemination of effective interventions. Because scarce resources for STI/HIV prevention strain communities, it is crucial that interventions achieve the largest possible impact among the largest possible segment of the target population and that they to do so in a financially sustainable manner (58). It has previously been established that the use of mass media is a cost effective HIV-prevention approach (59). It is also likely that media effects will be enhanced by appropriate face-to-face interventions delivered in community settings. Nevertheless, this study provides further evidence that if a media campaign achieves high exposure and is developed based on careful formative research, it can be an effective HIV-prevention tool for reaching high-risk youth within communities that need them the most.
Figure 2
Figure 2
Weighted, unadjusted means of number of unprotected sex occasions among sexually active adolescents by media and non-media cities and by STI status.
Supplementary Material
01
Acknowledgments
This study was conducted through the iMPPACS network supported by the National Institutes of Mental Health (Pim Brouwers, Project Officer) at the following sites and local contributors: Columbia, SC (MH66802, Robert Valois (PI), Naomi Farber, Andre Walker); Macon, GA (MH66807, Ralph DiClemente (PI), Gina Wingood, Laura Salazar, Rachel Joseph, Delia Lang; Philadelphia, PA (MH66809, Daniel Romer (PI), Sharon Sznitman, Bonita Stanton, Michael Hennessy, Susan Lee, Ivan Juzang, and Thierry Fortune); Providence, RI (MH-66785, Larry Brown (PI), Christie Rizzo, Nanetta Payne); Syracuse, NY (MH66794, Peter Vanable (PI), Michael Carey, Rebecca Bostwick).
Footnotes
Human participant protection Institutional Review Boards at each associated university approved the study protocols (Syracuse University, Brown University, University of South Carolina, Emory University and the University of Philadelphia).
1iMPPACS is the acronym developed for the project as a multi-city program “in Macon, Providence, Philadelphia, Atlanta, Columbia, and Syracuse.”
1. Hall HI, Song R, Rhodes P, Prejean J, An Q, Lee LM, Karon J, Brookmeyer R, Kaplan EH, McKenna MT, Janssen RS. Estimation of HIV incidence in the United States. JAMA. 2008;300(5):520–9. [PMC free article] [PubMed]
2. CDC HIV/AIDS Surveillance Report 2005. Atlanta: US Department of Health and Human Services, CDC; 2007.
3. CDC Racial/ethnic disparities in diagnoses of HIV/AIDS-33 states, 2001–2004. MMWR. 2006;55:121–125. [PubMed]
4. Grier SA, Briumbaugh AM. Noticing cultural differences: ad meanings created by target and non-target markets. J Advert. 1999;28:79–93.
5. Grier SA, Deshpande R. Social dimensions of consumer distinctiveness: the influence of social status on group identity and advertising persuasion. J Mark Res. 2001;38(2):216–224.
6. Palmgreen P, Noar SM, Zimmerman RS. Mass media campaigns as a tool for HIV prevention. In: Edgar T, Noar SM, Freimuth VS, editors. Communication Perspectives on HIV/AIDS for the 21st Century. Lawrence Erlbaum Associates; New York: 2008. pp. 221–253.
7. Noar MS. The utility of “old” and “new” media tools for HIV prevention. In: Pope C, White RT, Malow R, editors. HIV/AIDS global frontiers in prevention/interventions. Routledge; New York, NY: 2009.
8. Noar SM. A 10-year retrospective of research in health mass media campaigns: where do we go from here? J Health Commun. 2006;11(1):21–42. [PubMed]
9. CDC Updated Compendium of Evidence-Based Interventions. Centers for Disease Control and Prevention; Atlanta: 2001.
10. Albarracín D, Goillette JC, Earl AE, Glasman LR, Durantini MR, Ho M-H. A test of major assumptions about behavior change: a comprehensive look at the effects of passive and active HIV-prevention Interventions since the beginning of the epidemic. Psychol Bull. 2005;131(6):856–897. [PMC free article] [PubMed]
11. Resnicow K, DiIorio CK, Davis R. Culture and development of HIV prevention and treatment programs. In: Edgar T, Noar SM, Freimuth V, editors. Communication perspectives on HIV/AIDS for the 21st century. Lawrence Erlbaum; New York: 2008. pp. 193–220.
12. LoveLife LoveLife 2004 Report on Activities. 2004. Johannesburg South Africa: http://www.lovelife.org.za/corporate/research/AnnualReport_2004.pdf;
13. McCombie S, Hornik RC, Anarfi JH. Effects of a mass media campaign to prevent AIDS among young people in Ghana. In: C HR, editor. Public Health Communication, Evidence for Behavior Change. Lawrence Erlbaum Associates; Mahwah, New Jersey: 2002. pp. 147–162.
14. Agha S. The impact of a mass media campaign on personal risk perception, perceived self-efficacy and other behavioral predictors. AIDS Care. 2003;15(6):749–762. [PubMed]
15. Marum E, Morgan G, Hightower A, BNgare C, Taegtmeyer M. Using mass media campaigns to promote voluntary counseling and HIV-testing services in Kenya. AIDS. 2008;22(15):2019–2024. [PubMed]
16. deVroome EM, Paalman ME, Sandfort TGM, Sleutjes M, deVries KJM, Tielman RAP. AIDS in the Netherlands: The effects of several years of campaigning. Int J STD & AIDS. 1990;1:268–275. [PubMed]
17. Hausser D, Michaud PA. Does a condom-promoting strategy (the Swiss STOP-AIDS Campaign) modify sexual behavior among adolescents? Pediat. 1994;93:580–585. [PubMed]
18. Hausser D, Zimmermann E, Dubois-Arber F, Paccaud FE. Evaluation of the Swiss AIDS Prevention Policy (Third Assessment Report) 1989–1990. Institute Universitaire de Medecine Sociale et Preventive; Lausanne: 1990.
19. Kennedy MG, Mizuno Y, Seals BF, Myllyluoma J, Weeks-Norton K. Increasing condom use among adolescents with coalition-based social marketing. AIDS. 2000;14:1809–1818. [PubMed]
20. Polen MR. Outcome Evaluation of Project Action. Oregon Health Division; Portland, OR: 1995.
21. Zimmerman RS, Palmgreen PM, Noar SM, Lustria ML, Lu HY, Lee Horosewski M. Effects of a televised two-city safer sex mass media campaign targeting high-sensation-seeking and impulsive-decision-making young adults. Health Educ Behav. 2007;34(5):810–26. [PubMed]
22. Betancourt H, Lopez S. The study of culture, ethnicity and race in American psychology. Am Psychol. 1993;48(6):430–438.
23. Hughes D, Seidman E, Williams N. Cultural phenomena and the research enterprise: toward a culturally anchored methodology. Am J Commun Psychol. 1993;21(6):687–703. [PubMed]
24. Blackman S. Youth Subcultural Theory: A Critical Engagement with the Concept, its Origins and Politics, from the Chicago School to Postmodernism. J Youth Studies. 2005;8(1):1–20.
25. Lupton D. Toward the development of critical health communication praxis. Health Commun. 1994;6:55–67.
26. McGuire WJ. Inducing resistance to persuasion. In: Berkowitz L, editor. Advances in Experimental Social Psychology. Academic Press; New York: 1964. pp. 191–229.
27. Boller GW, Olsen JC. Experiencing Ad Meanings: Crucial aspects of narrative / drama processing. Adv Cons Res. 1991;18:172–175.
28. Deighton J, Romer D, McQueen J. Using drama to persuade. J Consum Res. 1989;16:335–343.
29. Papa MJ, Singhal A, Law S, Pant S, Sood S, Rogers EM, Shefner-Rogers CL. Entertainment-education and social change: an analysis of parasocial interaction, social learning, collective efficacy and paradoxical communication. J Commun. 2000;50(4):31–55.
30. Singhal A, Rogers EM. Entertainment-Education: a Communication Strategy for Social Change. Erlbaum; Mahwah, NJ: 1999.
31. Sood S. Audience involvement and entertainment-education. Commun Theor. 2002;12(2):153–172.
32. Bandura A. Social Foundations of Thought and Actions: a Social Cognitive Theory. Prentice Hall; Englewood Cliffs: NJ: 1986.
33. Horner JR, Romer D, Vanable PA, Salazar LF, Carey MP, Juzang I, Fortune T, DiClemente CC, Farber N, B S, Valois RF. Using culture-centered qualitative formative research to design broadcast messages for HIV-prevention for African American adolescents. J Health Comm. 2008;13(4):309–25. [PubMed]
34. Vanable PA, Carey MP, Bostwick RA, Romer D, DiClemente R, Stanton B. Community Partnership in Adolescent HIV Prevention Research: The Example of Project iMPPACS. In: Stanton B, Galbraith J, editors. The Uncharted Path from Clinic-Based to Community-Based Research. Nova; Hauppauge: NY: 2008. pp. 137–160.
35. Resnicow K, Ahluwalia JS, Butler J. Cultural sensitivity in substance use prevention. J Comm Psych. 2000;28(3):271–290.
36. MEE Motivational, Educational Entertainment. 2008. http://www.meeproductions.com;
37. CDC Trends in reportable sexually transmitted diseases in the United States, 2006. Centers for Disease Control and Prevention; Atlanta: 2006.
38. Vanable PA, Carey MP, Brown JL, DiClemente R, Salazar L, Brown L, Romer D, Valois R, Hennessy M, Stanton B. Test-Retest Reliability of Self-Reported HIV/STD-related Measures Among African-American Adolescents in Four U.S. Cities. J Adol Health. In Press, pending approval of minor revisions. [PMC free article] [PubMed]
39. Van der Pol B, Ferrero D, Buck-Barrington L, Hook E, III, Lenderman C, Quinn T, Gaydos CA, Lovchik J, Schachter J, Moncada J, Hall G, Tuohy MJ, Jones RB. Multicenter evaluation of the BDProbeTec ET system for detection of Chlamydia trachomatis and Neisseria gonorrhoeae in urine specimens, female endocervical swabs, and male urethral swabs. J Clin Microbiol. 2001;39(3):1008–1016. [PMC free article] [PubMed]
40. Caliendo AM, Jordan JA, Green AM, Ingersoll J, Wingood GM, DiClemente RJ. Real-Time PCR Provides Improved Detection of Trichomonas vaginalis Infection Compared to Culture Using Self-Collected Vaginal Swabs. Infect Dis Obstet Gynecol. 2005;13:145–150. [PMC free article] [PubMed]
41. StataCorp Stata Statistical Software: Release 10. StataCorp LP; College Station, TX: 2005.
42. Robins JM, Hernan M, Brumback B. Marginal structural models and causal inference in epidemiology. Epid. 2000;11:550–560. [PubMed]
43. Rubin DR. Estimating casual effects of treatments in randomized and nonrandomized studies. J Educ Psych. 1974;66:688–701.
44. St. Lawrenece J, Reitman D, Jefferson KW, Alleyne E, Brasfield TL, Shirley A. Factor Structure and Validation of an Adolescent Version of the Condom Attitude Scale: An Instrument for Measuring Adolescents' Attitudes Toward Condoms. Psychol Assess. 1994;6:352–359.
45. Stanton B, Black M, Feigelman S, Ricardo I, Galbraith J, Li X, Kaljee L, Keane J, Nesbitt R. Development of a culturally, theoretically and developmentally based survey instrument for assessing risk behaviors among African-American early adolescents living in urban low-income neighborhoods. AIDS Educ Prev. 1995;7:160–177. [PubMed]
46. Hennessy M, Bleakley A, Fishbein M, Jordan A. Validating an adolescent sexual behavior index using psychosocial theory and social trait correlates. AIDS and Behav. 2008;8:321–31. [PMC free article] [PubMed]
47. Cecil H, Pinkerton SD. Reliability and validity of a self-efficacy instrument for protective sexual behaviors. J Am Coll Health. 1998;47:113–121. [PubMed]
48. Schroder KE, Carey MP, Vanable PA. Methodological Challenges in Research on Sexual Risk Behavior: II. Accuracy of Self- Reports. Annals Behav Med. 2003;26(2):104–123. [PMC free article] [PubMed]
49. Swenson RR, Rizzo CJ, Brown LK, Payne N, DiClemente RJ, Salazar LF, Vanable PA, Carey MP, Valois RF, Romer D, Hennessy M. Prevalence and Determinants of HIV Testing among Sexually Active African American Adolescents. unpublished. [PMC free article] [PubMed]
50. Fishbein M, Cappella JN. The role of theory in developing effective health communications. J Commun. 2006;56:1–S17.
51. Fishbein M, Yzer MC. Using theory to develop effective health behavior interventions. Commun Theory. 2003;13:164–183.
52. Kreuter MW, Haughton LT. Integrating culture into health information for African American women. Am Behav Sci. 2006;49:794–811.
53. Romer D, Hornik R. HIV education for youth: the importance of social consensus in behavior change. AIDS care. 1992;4(3):285–303. [PubMed]
54. Hornik CR. Public health communication: making sense of contradictory evidence. In: R HC, editor. Public Health Communication. Lawrence Erlbaum Associates; Mahwah, NJ: 2002.
55. Hornik R. Epilogue: evaluation design for public health communication programs. In: R H, editor. Public Health Communication Evidence for Behavior Change. Lawrence Erlbaum Associates; Mahwah, NJ: 2002. pp. 385–405.
56. Reardon K, Rogers EM. Interpersonal versus mass media communication: a false dichotomy? Hum Commun Res. 1988;15:284–303.
57. Horton D, Wohl RR. Mass communication and para-social interaction. Psychiatry. 1956;19:215–229. [PubMed]
58. Glasgow E, Vogt TM, Boles SM. Evaluation of public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–1327. [PubMed]
59. Cohen DA, Wu S, Farley TA. Cost-effective allocation of government funds to prevent HIV infection. Health Affairs. 2005;24(4):975–926. [PubMed]