|Home | About | Journals | Submit | Contact Us | Français|
Primary care providers need effective strategies for substance use screening and brief counseling of adolescents. We examined the effects of a new computer-facilitated screening and provider brief advice (cSBA) system.
We used a quasi-experimental, asynchronous study design in which each site served as its own control. From 2005 to 2008, 12- to 18-year-olds arriving for routine care at 9 medical offices in New England (n = 2096, 58% females) and 10 in Prague, Czech Republic (n = 589, 47% females) were recruited. Patients completed measurements only during the initial treatment-as-usual study phase. We then conducted 1-hour provider training, and initiated the cSBA phase. Before seeing the provider, all cSBA participants completed a computerized screen, and then viewed screening results, scientific information, and true-life stories illustrating substance use harms. Providers received screening results and “talking points” designed to prompt 2 to 3 minutes of brief advice. We examined alcohol and cannabis use, initiation, and cessation rates over the past 90 days at 3-month follow-up, and over the past 12 months at 12-month follow-up.
Compared with treatment as usual, cSBA patients reported less alcohol use at follow-up in New England (3-month rates 15.5% vs 22.9%, adjusted relative risk ratio [aRRR] = 0.54, 95% confidence interval 0.38–0.77; 12-month rates 29.3% vs 37.5%, aRRR = 0.73, 0.57–0.92), and less cannabis use in Prague (3-month rates 5.5% vs 9.8%, aRRR = 0.37, 0.17–0.77; 12-month rates 17.0% vs 28.7%, aRRR = 0.47, 0.32–0.71).
Computer-facilitated screening and provider brief advice appears promising for reducing substance use among adolescent primary care patients.
Primary care settings provide an important venue for early detection of substance use and intervention, but adolescent screening rates need improvement. Screening and brief interventions appear effective in reducing adult problem drinking but evidence for effectiveness among adolescents is needed.
A computer-facilitated system for screening, feedback, and provider brief advice for primary care can increase adolescent receipt of substance use screening across a variety of practice settings, and shows promise for reducing adolescents’ use of alcohol and cannabis.
More than 40% of US adolescents are current alcohol drinkers, and more than 20% use cannabis (marijuana) or another drug.1 This is a serious national problem because substance use is strongly linked to the leading causes of adolescent mortality and many other health problems.2–5 Primary care offices are promising venues for screening, prevention, and early intervention.6 The American Academy of Pediatrics recommends that health care providers screen all adolescents for substance use as part of routine preventive care.7,8 Adherence to this recommendation, however, is low.9,10 Stated reasons include lack of time and personnel to perform the screening, unfamiliarity with screening tools, lack of training in how to deal with positive screens, and lack of effective interventions.11
The CRAFFT is a valid and reliable screener for adolescent medical patients, and is brief enough to be practical for busy medical offices.12–14 “CRAFFT” is a mnemonic acronym formed by the first letters of key words in the test’s 6 yes/no questions (Fig 1). Each “yes” scores 1 point; a total score of ≥2 has a sensitivity of 0.80 and specificity of 0.86 for identifying substance abuse or dependence.13 Although the CRAFFT can be conducted by clinician-interview or self-administered questionnaire, adolescents report being more likely to provide honest answers on questionnaires, even when they know the provider will receive the results.15
To meet the needs of both providers and patients, we developed a computer-facilitated screening and brief advice (cSBA) system consisting of a computerized screening and educational component before the visit, and provider advice during the visit. There is substantial evidence from studies conducted in the United States,16–22 and other countries17,20,23,24 supporting the effectiveness of screening and brief physician advice among adult primary care patients, especially in the reduction of harmful drinking and its associated consequences (eg, motor vehicle crashes, emergency department visits).16–19 It is unknown, however, whether these findings are generalizable to younger patients, as there have been fewer studies among adolescents in primary care.25,26 Existing studies suggest that primary care screening and brief interventions can positively impact adolescent health issues, such as tobacco use,27–30 nutrition and physical activity,31,32 and depression.33,34 A large longitudinal study of 14-year-old primary care patients26 found that screening and brief provider counseling significantly increased helmet use but did not reduce adolescent alcohol or drug use, suggesting the need to explore supplemental strategies to enhance effectiveness, such as the computerized education component that occurs before the provider visit in the cSBA system.
The primary objective of this study was to evaluate the immediate and short- and long-term effects of the cSBA system for adolescents in primary care. Immediate effects included providers’ brief counseling behaviors during the visit and adolescents’ reactions to it. Short- and long-term effects were adolescents’ use of alcohol and cannabis 3- and 12-months after the visit. We hypothesized that, compared with treatment as usual (TAU), more cSBA patients would report receiving provider advice, rate the quality of the advice as high, and report less substance use at the 3-month follow-up; however, without reinforcement, we hypothesized that the effect would be reduced by the 12-month follow-up. A secondary objective was to assess the separate effects of the cSBA intervention on preventing initiation of substance use by nonusers, and on promoting cessation among users.
We conducted the study at 9 primary care offices in 3 New England states, and in 10 pediatric generalist offices in Prague, Czech Republic (for more detail, see Supplemental Information). We used a quasi-experimental before-after design to compare cSBA and TAU. We first held a 1-hour orientation at each site to explain the study’s purpose, procedures, and safety protocol, and instructed providers to continue their usual practices during the TAU phase. For the ensuing 18 months, we recruited and assessed the TAU group. At the crossover point, we conducted a 1-hour provider training and initiated the cSBA protocol at all sites, then recruited and tested the cSBA group during the final 18 months.
Recruitment procedures were identical at each site during both study phases. Patients aged 12 to 18 years arriving for routine care, who were medically and emotionally stable on the day of the visit, able to read and understand the cSBA program, and available for follow-ups, were eligible. Czech Republic adolescents are seen for well-visits biannually, so we primarily recruited 13-, 15-, and 17-year-old patients there. Adolescents who participated in the TAU phase were excluded from the cSBA phase. In both TAU and cSBA phases, research assistants (RAs) contacted families before the visit to explain the study purpose, procedures, and confidentiality protection, and instructed interested patients to arrive 30 minutes early for their appointment. Upon arrival, RAs privately obtained informed participant assent (<18 years) or consent (≥18 years). Parents gave informed consent either in person, by phone, or sent a signed consent form in with the patient (Czech Republic). Participants then completed the baseline assessment and, for those receiving the intervention, the cSBA program, before seeing the provider. Participants received a merchandise certificate for completing each assessment ($5 United States, 200 Kč [$10–$12] Czech Republic). The institutional review boards of Children’s Hospital Boston, all New England sites, and the Charles University Second Faculty of Medicine Ethics Committee (Prague, Czech Republic) approved the study protocol.
The cSBA intervention began with a self-administered screening (Fig 1) that asks about lifetime and past-12-month use of substances followed by the CRAFFT questions. The CRAFFT screen had an embedded skip pattern, so that patients with no history of substance use completed the CAR question only. If the CRAFFT was completed, the program immediately displayed the individual’s CRAFFT score and risk-level (low, medium, high) on a thermometerlike graphic. All cSBA adolescents then viewed the same 10 pages of scientific information and true-life stories illustrating the health risks of substance use, which we created based on feedback from focus groups of adolescents who reported finding these types of information most compelling. All cSBA adolescents completed the same computer program before the medical visit, and the average completion time was 5 minutes. Providers received a report form with the screening results, risk level, and 6 to 10 “talking points” designed to prompt a 2- to 3-minute provider/teen conversation about the health effects of substance use, and that recommended abstinence. The talking points on health risks were the same regardless of patients’ substance use status but advice was individualized to either “not start” or “stop” using substances (see Supplemental Information). Provider training included a demonstration of the cSBA program, review of a sample provider report, and a 20-minute video demonstrating provider brief counseling. For the Czech Republic study, we translated, back-translated, culturally adapted, and validated the CRAFFT screen.35 We substituted 1 cSBA informational page on nonmedical use of prescription drugs with 1 on volatile inhalants, which is far more common there, and we translated/back-translated all other study materials.
The baseline assessment began with a past-90-day, modified timeline followback14,36 interview, separately recording frequency of use of each substance. Participants then self-administered a computerized questionnaire that assessed demographics and perceived substance use by peers, siblings, and parents (scales derived from the validated Personal Experience Inventory37,38). RAs recorded the office visit type and the provider’s gender and type. To evaluate potential historical confounding owing to the asynchronous study design, we asked respondents how often in the past 12 months they had heard information about alcohol or drugs in the news, in their school or community, or from friends or family.
Immediately after the visit, adolescents completed a post-visit checklist that assessed whether the provider gave advice not to use alcohol and drugs, their satisfaction with the visit, the likelihood of following their provider’s advice, and their rating of the way their provider gave the advice. At 3- and 12-month follow-up visits, participants completed assessments identical to the baseline either in person or by phone (>95%, because of the difficulty of scheduling in-person assessments). RAs ensured that participants could speak privately before conducting phone assessments. This difference in data collection mode occurred in both study arms equally and should not change any between-group effects.
We conducted all analyses using SUDAAN v.10.0 (Research Triangle Institute, Research Triangle Park, NC) with site as the nest variable to account for correlated error arising from our site cluster-sampling design. To assess immediate effects, we computed the proportions of patients who reported receiving provider advice not to use, receiving information regarding the health risks of substance use, being “very satisfied” with their visit, and being “very likely” to follow their provider’s advice generally, and, among those receiving advice about substance use, the percent rating the provider’s advice as “very good” or “excellent.”
The timeline followback–derived frequency-of-use variables were highly skewed, so we used a dichotomized use/no use as our primary short- and long-term outcome variable. Our a priori hypothesized outcome variables were rates of any use, initiation, and cessation. We defined initiation as any use at follow-up among those reporting no past-12-months use at baseline, and cessation as no use at follow-up among those reporting any past-12-months use at baseline. We compared any past-90-day use at the 3-month follow-up and any past-12-month use at the 12-month follow-up. We stratified analyses by country because of some different demographic variables, and by substance (alcohol, cannabis). We did not analyze use of drugs other than cannabis because of low prevalence (≤2%).
We used an “intent-to-treat” approach, analyzing cSBA adolescents regardless of whether they reported receiving provider advice. We excluded follow-up assessments completed >2 months late. We used χ2 tests for categorical variables and t tests for continuous variables to assess baseline group equivalence. We dichotomized race (white non-Hispanic versus other [United States only]), parents in home (2 versus other), parent education level (≥college graduate versus other), and type of visit (well-visit versus other) to ensure adequate cell sizes. For analysis of the intervention effect on initiation and cessation by 3- and 12-month follow-up, we used logistic regression modeling with generalized estimating equations (GEE) to compute adjusted relative risk ratios (aRRR) for cSBA compared with TAU, controlling for demographics, peer/family substance use, visit/provider characteristics, and the multisite sampling design. These analyses inherently controlled for baseline use through stratification of participants into baseline nonuser and user groups. We ran separate models for 3- and 12-month outcomes because of the different timeframes examined (past 90 days versus past 12 months). To examine the intervention effect on use at follow-up, we used 2 types of analysis. We conducted logistic regression analysis (with GEE to account for within-site clustering) to compare use probabilities between groups at each follow-up, with baseline data for each outcome variable entered as a covariate in the model. This method of longitudinal data analysis corresponds to a Markov chain transition model where subsequent observations are conditional on previous observations.39 We also conducted a repeated measures analysis that included data from all 3 time points in mixed effects regression analyses, which modeled subject-specific coefficients as random effects and used a generalized linear model owing to the binary outcome (use or no use). The findings from the mixed effects modeling and GEE logistic regression analyses were no different, so we are presenting the latter results only.
We used all available data to examine potential nonresponse bias. We performed missing data imputation by using multivariable regression and receiver operating characteristic curves to determine the optimal probability cut point (see Supplemental Information for more detail). The imputed analyses results were similar to the nonimputed, so we are reporting results from nonimputed models.
In New England, 2106 (86.5%) of 2435 eligible patients completed baseline assessments, with TAU participation rate slightly lower than cSBA (z-score = −4.01, P < .01) (Fig 2). TAU participants were older; more likely to be female; of “other” race; to have a parent who did not graduate college; and to report having a parent, sibling, or peer who uses substances (Table 1). They were less likely to be presenting for a well visit, and to have seen a nurse practitioner or a female provider. We controlled for these differences in all subsequent analyses. In Prague, 100% of eligible patients (589) participated, with no significant baseline between-group differences. There were no between-group differences in either country in the frequency of past-year exposure to substance-related messages outside the study. Follow-up rates were >70% in New England and >80% in Prague.
Provider brief advice rates doubled in New England, and quadrupled in Prague (Table 2). More providers in both countries advised patients without substance use not to start, than advised patients with substance use to stop. Compared with TAU, more cSBA adolescents rated the provider advice as “Excellent” or “Very Good,” and being “very likely” to follow the provider’s advice and “very satisfied” with the visit.
New England cSBA adolescents reported lower rates of any substance use compared with TAU at both follow-ups (3-months: aRRR=0.62 [95% confidence interval (CI) = 0.44–0.87], adjusted absolute risk difference [ARD] = 9.3%, number needed to treat [NNT] = 11; 12-month aRRR = 0.80 (0.64–0.99), ARD = 7.9%, NNT = 13), largely owing to lower drinking rates at both follow-ups. Among drinkers, there was significantly more cessation of drinking at 3 months, but the effect dissipated by 12 months (Table 3). In contrast, the effect on initiation was not significant at 3 months, perhaps because of small numbers, but robust and significant at 12 months: 44% fewer cSBA adolescents than TAU started drinking during the 12-month study period (ARD = 6%, NNT = 17). We found promising effect sizes in the hypothesized direction for any use and initiation of cannabis at 3 months, but they did not reach statistical significance and dissipated by 12 months.
There was no significant cSBA effect on any substance use or on alcohol use in Prague; however, there were significantly reduced cannabis use rates compared with TAU at both follow-ups (3-month ARD = 6%, NNT = 16; 12-month ARD = 15%, NNT = 7). At the 12-month follow-up, we found significant effects for cSBA on both initiation and cessation of cannabis. Compared with New England, Prague participants reported significantly higher drinking rates over lifetime (aRRR = 2.72, 95% CI 2.44–3.04), past-12-months (aRRR = 3.36, 95% CI 2.95–3.82), and past-90-days (aRRR = 4.84, 4.00-5.87). Cannabis use rates were similar between countries.
This study provides preliminary evidence of the efficacy of a structured cSBA system in both increasing primary care provider counseling regarding substance use, and reducing adolescent substance use. The cSBA system doubled the number of adolescents receiving brief counseling and increased patient satisfaction with the provider and the visit; however, providers still reached only ~70% in the cSBA group. We are unable to say why this number was not higher, nor why more providers gave advice not to start than to stop. The latter may be because of some providers’ desire to avoid confrontation with patients who are using substances.
We also found that, with only 2 to 3 minutes of provider time, the cSBA system reduced, relative to usual care, adolescent alcohol use in New England and cannabis use in Prague, with effects persisting through the 12-month study period. The natural trend for substance use prevalence, as shown in national surveys and seen in the current study, is to increase as adolescents age41; however, the cSBA group had significantly lower rates of use compared with TAU at each follow-up, resulting in a slower increase over time.
The effects on cannabis use in New England were smaller in apparent size, and all in the hypothesized direction, but they did not reach statistical significance. Cannabis use was far less prevalent than drinking in our sample, resulting in small numbers and lower power. Our sample size may have been inadequate to detect an intervention effect above that of assessment reactivity, which can have a substantial impact on substance use.40–42
In Prague, alcohol use was not affected. We suspect cultural factors played a substantial role. Alcohol use is highly normative in the Czech Republic, which has one of the highest per capita rates of beer consumption among all countries.43 Czech beer is inexpensive (between $1 and $2 US43), and the drinking age is lower than in the United States (18 years). In contrast, cannabis use is not a cultural norm. Our collaboration with the Czech Republic began with an e-mail from a Prague psychiatrist requesting permission to translate and use the CRAFFT screen in a Ministry of Health project to address a sharp rise in adolescent drug use after the 1989 “Velvet Revolution.”44 It is therefore gratifying to see that the Czech cSBA system had a powerful and lasting effect on cannabis use. The reasons for different findings in the United States and Czech Republic need further exploration, but underscore the value of multicultural studies.
To date, most studies evaluating screening and brief interventions with adolescents have been conducted in emergency departments,45–48 college campuses,21,49–53 or schools.54–57 The primary care office is a key setting for adolescent screening and brief intervention, with more than 22 million preventive care medical office visits by patients aged 15 to 24 each year,58 compared with 19 million emergency department visits.59 Also, primary care providers often have long-term relationships with patients and their families, potentially making brief advice more powerful. The use of computers to facilitate the process resulted in increased frequency and quality of physician brief advice, with minimal time burden on providers.
We could find no other published studies on primary care screening and brief intervention for adolescent substance use in English-language journals. We found 1 small study (n = 99) conducted in a single site by De Micheli and colleagues in Brazil.60 At 6-month follow-up, they found significantly lower rates of tobacco, alcohol, and cannabis use among youth receiving a prevention intervention. Our study expands this previous work to a larger sample, a variety of practice types, and 2 other countries, enhancing generalizability of the findings and supporting the feasibility of implementation across a range of settings. An additional strength of the current study is that we compared our intervention to TAU that often already included substance use screening and ad hoc advice. This conservative approach may have made it more difficult to detect an intervention effect, but it increased the likelihood that a detected effect is robust.
Our study had potential limitations. We used a nonrandomized, asynchronous study design in which historical trends or other unmeasured group differences may have confounded our results. The 2 groups in New England were not equivalent in baseline substance use, although we controlled for this in data analysis. All study sites were in New England and Prague. Other locations could be different. Our study relied on self-reported and interviewer-collected data, which may be prone to recall error and social desirability bias. Previous studies have shown self-report to be a valid method for measuring substance use among adolescents, however, and it compares favorably with other methods of substance use detection, such as laboratory testing.14,61,62 Although there was 25% to 30% loss to follow-up in our New England sample, attrition was similar between groups, both in the rates and the profile of those lost to follow-up, and we found that our results did not change after missing data imputation. Finally, we were unable to assess effects on use of drugs other than cannabis because of insufficient numbers.
Future studies should use larger samples and randomized designs, include more information on the negative health effects of substance use, and add new strategies designed to extend the intervention’s effect over time. They should also include strategies to improve intervention fidelity among providers, such as self-report adherence checklists and audiotaping of brief advice with review and feedback. Finally, studies are needed to determine the cost-effectiveness/cost-benefit of cSBA, as well as to elucidate its mechanisms of action so as to promote its effective implementation and dissemination.
Computer-facilitated screening and provider brief advice appears to be a promising strategy for reducing substance use among adolescent primary care patients, although replications of this study are needed with larger samples. The protocol involved only 1 hour of provider training, 5 minutes of patient time before the visit, and 2 to 3 minutes of provider time during the encounter, with some positive effects sustained up to a year later. Providers today face opposing pressures: recommendations to screen patients for more and more problems, and financial realities that require they see more patients quickly.14,63,64 Use of a computer-facilitated system such as this one may offer a way to improve both patient care and provider efficiency.
The authors thank the physicians and staff of The New England Partnership for Substance Abuse Research for assistance with study implementation, including Judy Shaw, RN, MPH, Executive Director, Vermont Child Health Improvement Program; Colleen Sheppard, RN, BSN and Julia Lee, PNP, Division of Pediatrics and Adolescent Medicine, Tufts Medical Center; Judy Casarella, PNP, and Elizabeth Blair, NP, Cambridge Health Alliance; Holly Vanwinkle, Milton Family Practice Clinical Practice Supervisor; and Donna Kaynor, Colchster Clinical Practice Supervisor. For their invaluable assistance in the Czech Republic, the authors thank Eva Cápová, the Executive Director of the Center for Evaluation, Prevention, and Research on Substance Abuse, and all of the participating physicians: MUDr Karel Holub, MUDr Alena Mottlová, MUDr Marie Schwarzová, MUDr Jitka Bĕlorová, MUDr Leona Tylingerová, MUDr Petra Vlková, MUDr Jaroslava Chaloupková, MUDr Jedličková Vĕra, and MUDr Marie Kolářová, and MUDr Renata Ruzková. The authors acknowledge research assistants Nohelani Lawrence, Joy Gabrielli, Ariel Berk, Melissa Rappo, Jessica Hunt, Stephanie Jackson, Amy Danielson, Jessica Randi, Michael Krauthamer, and Soumya Ashok for their help in data collection; and Janine Bacic, MS, and Emily Blood, PhD, for their biostatistical assistance. The authors thank the adolescent patients who agreed to participate and their parents who gave permission.
Drs Harris and Knight had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis; Drs Harris (study co-principal investigator), Csémy (Czech Republic principal investigator), Van Hook (study manager), Boulter (site principal investigator), Brooks (site principal investigator), Carey (site principal investigator), Kossack (site principal investigator), Kulig (site principal investigator), Van Vranken (site principal investigator), and Knight (study principal investigator) and Mr Sherritt (study data manager) and Ms Starostova (Czech Republic data manager) were responsible for study conception/design; Drs Harris, Van Hook, and Knight and Mr Sherritt obtained funding; Drs Harris, Csemy, Van Hook, Boulter, Brooks, Carey, Kossack, Kulig, Van Vranken, and Knight and Mr Sherritt, Ms Starostova, and Ms Johnson were responsible for acquisition of data; Drs Harris, Csemy, Van Hook, and Knight and Mr Sherritt, Ms Starostova, and Ms Johnson were responsible for analysis and interpretation of data; Drs Harris, Csemy, Van Hook, and Knight and Mr Sherritt, Ms Starostova, and Ms Johnson were responsible for manuscript preparation; Drs Harris, Csemy, Van Hook, Boulter, Brooks, Carey, Kossack, Kulig, Van Vranken, and Knight and Mr Sherritt, Ms Starostova, and Ms Johnson were responsible for critical revision of the manuscript for important intellectual content; Drs Harris, Csemy, Van Hook, Boulter, Brooks, Carey, Kossack, Kulig, Van Vranken, and Knight and Mr Sherritt, Ms Starostova, and Ms Johnson provided study supervision; Mr Sherritt, Ms Johnson, and Drs Van Hook, Boulter, Brooks, Carey, Kossack, Kulig, and Van Vranken provided administrative, technical, or material support; and Drs Harris, Csemy, Van Hook, Boulter, Brooks, Carey, Kossack, Kulig, Van Vranken, and Knight and Mr Sherritt, Ms Starostova, and Ms Johnson were responsible for final approval of the version to be published.
This trial has been registered at www.clinicaltrials.gov (identifier NCT00227877).
FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.
FUNDING: This study was supported by grant R01DA018848 from the National Institute on Drug Abuse, and included a competing supplement for international research on drug addiction (R01DA018848-03S1). Other support was provided by grant K07 AA013280 from the National Institute on Alcohol Abuse and Alcoholism to Dr Knight, and grant T20MC07462 to Drs Knight and Van Hook and grant T71NC0009 to Dr Harris from the Maternal and Child Health Bureau, the Davis Family Charitable Foundation, the Carl Novotny & Judith Swahnberg Fund, the Ryan Whitney Memorial Fund, and the J.F Maddox Foundation. Funded by the National Institutes of Health (NIH).