PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptNIH Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Contemp Clin Trials. Author manuscript; available in PMC Jul 1, 2013.
Published in final edited form as:
PMCID: PMC3361553
NIHMSID: NIHMS369789
Minority recruitment into clinical trials: Experimental findings and practical implications
Susan D. Brown, Ph.D.,a Katherine Lee, M.A.,a Danielle E. Schoffman, B.A.,a Abby C. King, Ph.D.,ab LaVera M. Crawley, M.D., M.P.H.,c and Michaela Kiernan, Ph.D.a
aStanford Prevention Research Center, Department of Medicine, Stanford School of Medicine, Stanford, CA
bDivision of Epidemiology, Department of Health Research & Policy, Stanford School of Medicine, Stanford, CA
cCenter for Biomedical Ethics, Department of Pediatrics, Stanford School of Medicine, Stanford, CA
Corresponding author: Susan D. Brown, Ph.D., Kaiser Permanente Northern California Division of Research, 2000 Broadway, Oakland, CA 94612. Telephone: (510) 891-3544. Fax: (510) 891-3606. susan.d.brown/at/kp.org
Susan D. Brown is now at the Kaiser Permanente Northern California Division of Research.
Danielle E. Schoffman is now at the University of South Carolina. Katherine Lee is now at the Johns Hopkins Bloomberg School of Public Health.
Racial and ethnic minorities in the US suffer disproportionately from obesity and related comorbidities, yet remain underrepresented in health research. To date, research on practical strategies to improve minority reach and recruitment into clinical trials is primarily descriptive rather than experimental. Within a randomized behavioral weight management trial for obese women, this recruitment experiment examined whether two characteristics of direct mail letters, an ethnically-targeted statement and personalization, increased the response rate among minority women. The ethnically-targeted statement noted ethnic-specific information about health risks of obesity. Personalized letters included recipients’ names/addresses in the salutation and a handwritten signature on high-quality letterhead. Of women sent direct mail letters (N=30,000), those sent letters with the ethnically-targeted statement were more likely to respond than women sent letters with the generic statement, 0.8% (n=121) vs. 0.6% (n=90) respectively, p=.03, a 34.4% increase. Women sent personalized letters were no more likely to respond than women sent non-personalized letters, p=.53. In the weight management trial itself, of 267 women randomized into the trial, 33.7% (n=90) were minorities. Of minority women randomized into the trial, 68.9% (n=62) were recruited by direct mail letters: 75.8% (n=47) of those were sent a letter and 24.2% (n=15) were referred by friends/family who were sent a letter. The results indicate that a simple modification to a standard recruitment letter can have a meaningful impact on minority reach and recruitment rates. Practical implications include using ethnically-targeted, non-personalized direct mail letters and recruiting through friends/family at no additional cost.
Keywords: Ethnic minorities, diversity, recruitment, clinical trials, weight management
Racial and ethnic minorities in the US suffer disproportionately from obesity and associated co-morbidities. Yet the clinical trial literature lacks sufficient attention to these populations [1]. Indeed, 86% of weight management studies between 1966 and 2003 failed to even report the race/ethnicity of recruited participants [2]. Successful “reach” to minority populations—with adequate representation in randomized clinical trials—is crucial to eliminating health disparities [3].
Research on minority recruitment for randomized clinical trials is primarily descriptive. Suggested strategies for clinical trials—which typically require a high level of participant commitment and thus pose unique recruitment challenges—include direct mail, community outreach, and mass media [4, 5]. Direct mail offers two unique advantages. First, and critical to minority engagement, direct mail can simultaneously reach different minority groups dispersed across wide geographical areas and/or living in ethnically integrated areas (i.e., contexts where in-person community outreach is less feasible), and can reach individuals without access to clinical trial gatekeepers (e.g., physicians) or to community organizations with strong in-person outreach (e.g., churches).
Second, direct mail can reach many individuals with relatively little staff time and effort [6]. Letters are typically sent to tens of thousands of individuals. Thus, even a very low response rate (due to the small proportion of recipients meeting trial-specific eligibility criteria [6]) can yield sufficient absolute numbers relative to recruitment goals [7]. Response efficiency can be improved using commercially-available, worksite, or clinic mailing lists that include key eligibility criteria such as gender or age [8]. Indeed, targeting (i.e., communications for specific audiences based on group-level characteristics) is used across consumer and health research arenas [913].
Descriptive research shows that direct mail is an effective clinical trial recruitment strategy for the general population [e.g., 14, 15], and more effective than mass media for recruiting minorities [16, 17]. However, experimental studies are scarce [18, 19]. A recent review [20] identified only six experimental studies of direct mail recruitment strategies tested within randomized clinical trials [7, 2125]; only two addressed minorities, described below [7, 21].
One direct mail characteristic tested experimentally within clinical trials is ethnically-targeted statements. While arguably “superficial,” social psychological research suggests that “surface-level” cues may affect minorities’ initial trust and desire to engage [26, 27]. Corporate recruitment materials with pro-diversity statements (where ethnicity was valued) increased trust among African Americans more than “colorblind” materials (where ethnicity was immaterial) [27]. Indeed, trial recruitment letters with ethnic-specific health risk information yielded a 40% higher response rate among Latinos than letters with generic information (although not statistically significant given limited sample size, N=561) [7]. This is consistent with evidence that effective recruitment strategies focus on recipients—their awareness of the health problem and potential impact on their own health [20]. In contrast, letters focusing on sender characteristics (e.g., same race/ethnicity as recipients) or general benefits for an ethnic group have not improved participation rates [21].
Another direct mail characteristic is personalization, e.g., addressing recipients by name [2831]. Experimental research within randomized clinical trials is sparse; two studies found an advantage [7, 32], whereas one did not [22]. However, all three compared personalized letters to shorter communications (e.g., flyers), leaving the influence of personalization unclear.
Here, we examined whether two characteristics of direct mail letters, an ethnically-targeted statement about minority health disparities and personalization, increased response rates.
This experiment was conducted within an 18-month randomized behavioral weight management trial [33]. In the weight management trial, women (N=267) were recruited from Northern California communities using multiple methods, e.g., direct mail, friend/family referral, and newspaper advertisements. Women were middle-aged (48.4±10.8 years old), obese (BMI=32.1±3.5), and 33.7% (n=90) were non-White including Latina/Hispanic (10.5%, n=28), multiethnic (≥2 races/ethnicities; 10.1%, n=27), Asian (9.4%, n=25), Black/African American (3.0%, n=8), and Native Hawaiian/Pacific Islander women (0.7%, n=2). The trial was approved by the Stanford University Human Subjects Committee.
Participants
For the experiment, a commercial direct marketing firm identified minority women ages 21–75 years (N=30,000) from each racial/ethnic category in 65 diverse zip codes (M proportion of minority residents=43%) representative of the local minority distribution [34]. Women self-identified their race/ethnicity and recruitment method (e.g., direct mail) in an online screening questionnaire. Recruitment via letters was confirmed by cross-checking self-reported and mailing list contact information.
Experimental Design
To experimentally test the effect of two direct mail characteristics, women were randomly assigned to one of four letter types based on a 2 × 2 factorial design: statement (ethnically-targeted vs. generic) × personalization (personalized vs. non-personalized). We tested the effect of one characteristic (e.g., statement) while adjusting for the other (e.g., personalization) using Cochran-Mantel-Haenszel chi-square tests. The experiment was not powered to detect a statement X personalization interaction. With a total sample size of 30,000 letters, the experiment had 80% power to detect a 50% increase in response rates (0.6% vs. 0.9%), two-tailed α=.025 (.05/2, adjusting for the two characteristics). Collapsing by characteristic, 15,000 of 30,000 letters had an ethnically-targeted statement whereas 15,000 had a generic statement; likewise, 15,000 letters were personalized whereas 15,000 were non-personalized. The primary outcome was response rate, i.e., proportion completing the online screening questionnaire.
Letter Characteristics
All letters included 10 recommended elements to increase response rates: the trial’s purpose/significance, benefits to recipients, recipients’ importance, how recipients were selected, sender’s appreciation, sender’s importance, institution’s importance, style, format/appearance, and brevity [7, 28, 29].
All letters noted weight loss reduces cardiovascular disease (CVD) risk. Letters with the generic statement described health risk information for the general population:
“[CVD], such as having a heart attack, kills more women in California than any other cause of death, including breast cancer.”
Letters with the ethnically-targeted statement included the statement above and an additional statement noting health disparity risk information for multiple minority groups:
“Less well known is that many ethnic minority women—including African American, Asian American, Latina, Native American, and Pacific Islander women—are at higher risk for [CVD].”
Expanding on an approach examined previously [7], this sentence was purposefully broad, reflecting the geographic area’s diversity.
Non-personalized letters were addressed “Dear Community Member” with black-and-white photocopies of the principal investigator’s signature and letterhead on standard quality paper (the ethnically-targeted, non-personalized letter is available upon request). Personalized letters included communication elements to increase response [28]: recipients’ names and addresses in the salutation and the principal investigator’s handwritten signature in blue ink on high-quality letterhead.
In the experiment, the overall response rate was 0.7% (n=211/30,000). Women sent letters with ethnically-targeted statements were more likely to respond than women sent letters with generic statements, 0.8% (n=121/15,000) vs. 0.6% (n=90/15,000), p=.03, a 34.4% increase. Women sent personalized letters were no more likely to respond than women sent non-personalized letters, p=.53. Of 211 respondents identified as minorities by the commercial firm’s algorithm, 148 self-identified as minorities (i.e., 70.5% concordance). Of self-identified minorities (n=148), those sent letters with ethnically-targeted statements were more likely to respond than those sent letters with generic statements, 59.5% (n=88) vs. 40.5% (n=60), p=.03, a 46.7% increase.
In the weight management trial itself, 68.9% (n=62) of minorities randomized into the trial were recruited via letters. Interestingly, of those, 75.8% (n=47) were sent a letter and 24.2% (n=15) were referred by friends/family who were sent a letter.
An ethnically-targeted statement in direct mail letters noting health disparities among multiple minority groups improved response rates to a weight management clinical trial. As a “surface-level” cue, the targeted statement may have suggested that ethnic identity [35] would be acknowledged in the trial setting, thereby increasing engagement [27]. Importantly, the targeted statement focused on recipients’ own health rather than sender characteristics or general benefits for an ethnic group [7, 20]. Personalized letters—costly and time-consuming to produce—did not improve response rates. Given proliferation of computerized direct mail marketing, recipients may be increasingly indifferent to seemingly disingenuous personalization.
Results suggest innovative avenues for future experimental research and replication: whether ethnically-targeted statements must be consciously perceived as personally salient, require a focus on recipients’ health, or are affected by ethnic identity [35, 36]; how to optimize recruitment through friends/family [13, 14]; and how to engage heterogeneous minority groups, such as Asian subgroups [37] and multiethnic individuals—an emerging yet understudied US demographic [38].
Study limitations included lack of data on men or on socioeconomic status and acculturation among recipients. The commercial firm’s race/ethnicity identification was not perfectly concordant with women’s self-identification (although high, 70.5%). The overall response rate was low given recipients had no affiliation with the research center. However, where recipients have established affiliations with senders (e.g., worksites, clinics), the overall response rate is likely to be higher [e.g., 6.5%; 7], and the differential effect of ethnically-targeted letters—a 34% increase with a simple, no-cost modification—is likely to have even greater potential impact. Despite study limitations, strengths included the experimental design, large sample size, breadth of minority groups recruited across a wide geographic and ethnically-integrated area, and context of an actual randomized clinical trial.
Undoubtedly, successful minority engagement depends upon substantively conveying respect, trustworthiness, and importance of diversity throughout a trial [39], not only during recruitment. Yet, these results suggest a simple modification to recruitment letters can meaningfully impact minority reach and initial engagement. Practical implications include using ethnically-targeted, non-personalized direct mail letters and recruiting through friends/family at no additional cost.
Acknowledgments
This research was supported by Public Health Service Grants R01 CA112594 (Michaela Kiernan) and T32 HL007034 (Stanford Prevention Research Center) from the National Institutes of Health. We gratefully thank the trial participants and research staff, and also thank Drs. Cynthia Castro, Joan Fair, Lisa Henriksen, Nancy Ellen Kiernan, and Alex McMillan for their insightful comments.
1. Kumanyika S. Ethnic minorities and weight control research priorities: Where are we now and where do we need to be? Prev Med. 2008;47:583–586. [PubMed]
2. Gibson CA, Kirk EP, LeCheminant JD, Bailey BW, Huang G, Donnelly JE. Reporting quality of randomized trials in the diet and exercise literature for weight loss. BMC Med Res Methodol. 2005;5 [PMC free article] [PubMed]
3. Glasgow RE, Lichtenstein E, Marcus AC. Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003;93:1261–1267. [PubMed]
4. National Institutes of Health. [Accessed May 20, 2008];Outreach Notebook for the Inclusion, Recruitment and Retention of Women and Minority Subjects in Clinical Research. http://orwh.od.nih.gov/pubs/outreach.pdf.
5. Yancey AK, Ortega AN, Kumanyika SK. Effective recruitment and retention of minority research participants. Annu Rev Public Health. 2006;27:1–28. [PubMed]
6. McDearmon M, Bradford RH. Recruitment by the use of mass mailings. Circulation. 1982;66:IV27–IV31. [PubMed]
7. Kiernan M, Edwards K, Fair JM, King AC. Using direct mail to recruit Hispanic adults into a dietary intervention: An experimental study. Ann Behav Med. 2000;22:89–93. [PubMed]
8. Castro CM, Pruitt LA, Campero I, King AC. Recruitment efforts to attract older Latinos to physical activity trials. Ann Behav Med. 2011;41:s126.
9. Kreuter MW, Strecher VJ, Glassman B. One size does not fit all: The case for tailoring print materials. Ann Behav Med. 1999;21:276–283. [PubMed]
10. Peppers D, Rogers M, Dorf B. Is your company ready for one-to-one marketing? Harvard Business Review. 1999;77:151–160. [PubMed]
11. Ramirez AG, Miller AR, Gallion K, San Miguel de Majors S, Chalela P, García Arámburo S. Testing three different cancer genetics registry recruitment methods with Hispanic cancer patients and their family members previously registered in local cancer registries in Texas. Community Genetics. 2008;11:215–223. [PubMed]
12. Satia JA, Galanko JA, Rimer BK. Methods and strategies to recruit African Americans into cancer prevention surveillance studies. Cancer Epidemiol Biomarkers Prev. 2005;14:718–721. [PubMed]
13. Kennedy BM, Kumanyika S, Ard JD, Reams P, Johnson CA, Karanja N, et al. Overall and minority-focused recruitment strategies in the PREMIER multicenter trial of lifestyle interventions for blood pressure control. Contemp Clin Trials. 2010;31:49–54. [PMC free article] [PubMed]
14. Fouad MN, Corbie-Smith G, Curb D, Howard BV, Mouton C, Simon M, et al. Special populations recruitment for the Women’s Health Initiative: Successes and limitations. Control Clin Trials. 2004;25:335–352. [PubMed]
15. Messer KL, Herzog AR, Seng JS, Sampselle CM, Diokno AC, Raghunathan TE, et al. Evaluation of a mass mailing recruitment strategy to obtain a community sample of women for a clinical trial of an incontinence prevention intervention. Int Urol Nephrol. 2006;38:255–261. [PubMed]
16. Katula JA, Kritchevsky SB, Guralnik JM, Glynn NW, Pruitt L, Wallace K, et al. Lifestyle Interventions and Independence for Elders pilot study: Recruitment and baseline characteristics. J Am Geriatr Soc. 2007;55:674–683. [PubMed]
17. Robinson JL, Fuerch JH, Winiewicz DD, Salvy SJ, Roemmich JN, Epstein LH. Cost effectiveness of recruitment methods in an obesity prevention trial for young children. Prev Med. 2007;44:499–503. [PMC free article] [PubMed]
18. Watson JM, Torgerson DJ. Increasing recruitment to randomised trials: A review of randomised controlled trials. BMC Med Res Methodol. 2006;6 [PMC free article] [PubMed]
19. UyBico SJ, Pavel S, Gross CP. Recruiting vulnerable populations into research: A systematic review of recruitment interventions. J Gen Intern Med. 2007;22:852–863. [PMC free article] [PubMed]
20. Caldwell PH, Hamilton S, Tan A, Craig JC. Strategies for increasing recruitment to randomised controlled trials: systematic review. PLoS Med. 2010;7:e1000368. [PMC free article] [PubMed]
21. Ford ME, Havstad SL, Davis SD. A randomized trial of recruitment methods for older African American men in the Prostate, Lung, Colorectal and Ovarian (PLCO) cancer screening trial. Clin Trials. 2004;1:343–351. [PubMed]
22. Tworoger SS, Yasui Y, Ulrich CM, Nakamura H, LaCroix K, Johnston R, et al. Mailing strategies and recruitment into an intervention trial of the exercise effect on breast cancer biomarkers. Cancer Epidemiol Biomarkers Prev. 2002;11:73–77. [PubMed]
23. Valanis B, Blank J, Glass A. Mailing strategies and costs of recruiting heavy smokers in CARET, a large chemoprevention trial. Control Clin Trials. 1998;19:25–38. [PubMed]
24. Nystuen P, Hagen KB. Telephone reminders are effective in recruiting nonresponding patients to randomized controlled trials. J Clin Epidemiol. 2004;57:773–776. [PubMed]
25. Kendrick D, Watson M, Dewey M, Woods AJ. Does sending a home safety questionnaire increase recruitment to an injury prevention trial? A randomised controlled trial. J Epidemiol Community Health. 2001;55:845–846. [PMC free article] [PubMed]
26. Murphy MC, Steele CM, Gross JJ. Signaling threat: How situational cues affect women in math, science, and engineering settings. Psychol Sci. 2007;18:879–885. [PubMed]
27. Purdie-Vaughns V, Steele CM, Davies PG, Ditlmann R, Crosby JR. Social identity contingencies: How diversity cues signal threat or safety for African Americans in mainstream institutions. J Pers Soc Psychol. 2008;94:615–630. [PubMed]
28. Erdos PL. Professional Mail Surveys. Malabar, FL: Krieger Publishing Co., Inc.; 1983.
29. Dillman DA. Mail and Telephone Surveys: The Total Design Method. New York: Wiley & Sons, Inc.; 1978.
30. Baines CJ. Impediments to recruitment in the Canadian National Breast Screening Study: Response and resolution. Control Clin Trials. 1984;5:129–140. [PubMed]
31. Gerace TA, George VA, Arango IG. Response rates to six recruitment mailing formats and two messages about a nutrition program for women 50–79 years old. Control Clin Trials. 1995;16:422–431. [PubMed]
32. Glasgow RE, Nelson CC, Kearney KA, Reid R, Ritzwoller DP, Strecher VJ, et al. Reach, engagement, and retention in an internet-based weight loss program in a multi-site randomized controlled trial. J Med Internet Res. 2007;9 [PMC free article] [PubMed]
33. Kiernan M, Moore SD, Schoffman D, Lee K, King AC, Taylor CB, et al. Promoting healthy weight with 'Stability First': 6-month results. Ann Behav Med. 2011;41:S48.
34. US Census Bureau. [Accessed June 15, 2006];American Fact Finder. 2000 http://factfinder.census.gov/.
35. Phinney JS, Ong AD. Conceptualization and measurement of ethnic identity. J Couns Psychol. 2007;54:271–281.
36. Resnicow K, Davis R, Zhang N, Tolsma D, Alexander G, Wiese C, et al. Tailoring a fruit and vegetable intervention on ethnic identity: Results of a randomized study. Health Psychol. 2009;28:394–403. [PMC free article] [PubMed]
37. Wenzel L, Bowen D, Habbal R, Leighton N, Vu T, Anton-Culver H. Testing targeted approaches to enhance cancer genetics network minority recruitment within Asian populations. Community Genetics. 2008;11:234–240. [PubMed]
38. Lopez A. The Population of Two or More Races in California. [Accessed December 9, 2009];Stanford: Center for Comparative Studies in Race and Ethnicity. 2001 http://www.stanford.edu/dept/csre/PUBL_demRep.htm.
39. Crawley LM. African-American participation in clinical trials: Situating trust and trustworthiness. J Natl Med Assoc. 2001;93:14S–17S. [PMC free article] [PubMed]