PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptNIH Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
J Am Board Fam Med. Author manuscript; available in PMC Dec 28, 2012.
Published in final edited form as:
PMCID: PMC3532040
NIHMSID: NIHMS427495
Evaluation of a screening and counseling tool for alcohol misuse: a Virginia Practice Support and Research Network (VaPSRN) trial
Scott M. Strayer, MD, MPH,1 Sandra L. Pelletier, PhD,2 Lisa K. Rollins, PhD,2 Steve W. Heim, MD, MSPH,2 Karen S. Ingersoll, PhD,3 Lee M. Ritterband, PhD,3 and John B. Schorling, MD, MPH4
1Department of Family and Preventive Medicine, University of South Carolina School of Medicine
2Department of Family Medicine, University of Virginia Health System
3Department of Psychiatry and Neurobehavioral Sciences, University of Virginia Health System
4Department of Medicine, University of Virginia Health System
Background
Surveys reveal limited screening and counseling for alcohol misuse by primary care physicians despite evidence-based recommendations. We developed and evaluated an alcohol screening and misuse counseling tool designed to assist clinicians at the point-of-care (POC).
Methods
Mixed methods, prospective cohort study conducted in a practice-based research network with licensed clinicians. A software tool was designed to guide clinicians through evidence-based alcohol misuse assessment and interventions.
Results
Participants (N=12) used the tool an average of 3 sessions and 71% were satisfied with the tool. Participants increased their ability to differentiate between patients who are “at risk” drinkers vs. those with alcohol use disorders including dependence/abuse (21%; t=2.4, p=.04). Thematic analysis of interviews suggest that barriers to overall use included perceptions of alcohol use; clinical need to intervene; time; and issues with use of technology generally at the POC. However, the tool added confidence and a valuable framework for interventions and was valued as an educational tool. Users felt that increased training and practice could increase comfort and impact future POC use. Increased POC usability may also be achieved through tool simplification and additional flexibility in POC use options.
Conclusions
A computer-assisted counseling tool for alcohol misuse and abuse can be implemented in primary care settings and shows promise for improving physician screening and interventions for alcohol misuse. To enhance utility in daily clinical practice we recommend design enhancements and strategies to enhance usage as described in this research.
Alcohol consumption is the leading cause of death in the United States among 15–45 year olds1 and is second only to tobacco use and unhealthy diet/physical inactivity in actual cause of death for all ages.2 An estimated 75,000 deaths per year are attributed to alcohol3 due to multiple adverse health consequences including increased risk of violence or injury, cirrhosis of the liver, cancer and other chronic illnesses, incurring $185 billion annually in healthcare expenditures in the U.S.2 The prevalence estimates for unhealthy alcohol use in primary care settings range from 2% to 9% of adults with alcohol dependence to a high of 29% with “risky use” of alcohol.4
Clinically appropriate and effective identification tools and treatment for alcohol problems have been developed.5 A U.S. Preventive Services Task Force review concluded that behavioral counseling interventions for risky/harmful alcohol use in primary care could reduce risky/harmful alcohol use.6 Brief interventions that include counseling, especially motivational interviewing approaches, have received empirical support7 and expert recommendation.8 Current recommendations are that all adults should be screened for unhealthy alcohol use with a validated screening instrument such as the CAGE or the AUDIT.9
Despite these recommendations, clinicians are not using valid identification tools and interventions for unhealthy alcohol in clinical practice and usage rates vary widely between locations and settings.10, 11 A survey of family physicians and internists found that only 64.9% of respondents screened 80–100% of their patients for unhealthy alcohol use during the initial visit and a mere 34.4% screened the same percentage of patients during an annual visit.12 Another national survey of primary care physicians reported similar findings: only 13% use a formal alcohol screening tool when asking new outpatients about alcohol use.13
Despite the proven success of physician-led interventions for alcohol misuse, ambitious efforts to implement primary care alcohol counseling have not succeeded.14, 15 These problems are caused by a number of barriers including: confusion as to what constitutes alcohol misuse16, fear that asking about drinking could harm the patient-provider relationship1719, stigmatization of substance abuse16, 20, skepticism about the effectiveness of alcohol counseling16, 19, 21, lack of time1719, 22, inadequate training16, 23, 24, and a belief that patients will not honestly disclose their drinking practices.18, 19, 25 These barriers may be exacerbated by evidence that moderate levels of drinking (1–2 drinks per day) have proven beneficial for health.26, 27
To address this clinical need and physician barriers to alcohol misuse and abuse counseling, we developed a point-of-care (POC) software tool to assist clinicians in providing patient-tailored alcohol counseling while facilitating provider adherence to evidence-based practice guidelines. While previous studies have examined electronic reminders,28, 29 electronic screening tools, 30 and internet-based programs for alcohol interventions,3133 our study is the first known investigation assessing a tool to assist primary care physicians with screening and subsequent counseling for alcohol misuse. Study aims were to establish the feasibility and technical merit of the Alcohol Misuse Intervention Tool (AMIT) prototype by: conducting formal usability testing of the prototype with clinicians in primary care settings; measuring utilization of the prototype and pre- to post-intervention changes in clinician behavior, knowledge, attitudes, and perceived self-efficacy in applying evidence based counseling strategies; and qualitative evaluation of physician tool use in primary care settings.
Development of the Alcohol Counseling Tool
The AMIT software tool was designed to assist clinicians in providing patient-tailored alcohol counseling while facilitating adherence to evidence-based practice guidelines. We have previously described our software development process in detail.34, 35 Briefly, a content development team was assembled and met bi-weekly for approximately four months. The team included three experts in behavioral change in addition to [Author 1], who led the team. The entire Content Development Team effort was coordinated and directed by [Author 1] who has led the development of several clinician behavioral change support tools. A prototype version of the tool was designed as an interactive, web-distributable, clinical decision support software application for computers running either the Palm® or Microsoft Pocket PC operating systems (e.g. personal digital assistants or PDA’s). The functionality was later extended during the trial to accommodate use on other computing systems (e.g. web-based for desktop PC and smartphone use). The tool included algorithms based on the 5 A’s, the Transtheoretical Model (TTM) of health behavior change, and Motivational Interviewing. Through a point-and-click interface, the AMIT was designed to: 1) guide clinicians in screening for alcohol abuse and dependence based on the National Institute on Alcohol Abuse and Alcoholism’s national guidelines36 2) assist them in delivering a scripted interview to assess the patient’s readiness to change; 3) provide a scripted motivational interview tailored to the patient’s stage of change; 4) provide stage-relevant tools including: risk calculators, drug information and dosing, abridged information on pertinent clinical guidelines, and local and national resources; and 5) track clinician behavior during the patient encounter (i.e., identify the clinician using the application, record a time and date stamp each time the application is opened, record which sections of the application are accessed, and time spent in each) (see figure 1).
Figure 1
Figure 1
AMIT screenshots
Study enrollment
This study was approved by the [Author 2’s Institution] Institutional Review Board (IRB). Clinicians were recruited from practices affiliated with the [PBRN], which includes 10 [Author 2’s Institution] academic practices and community-based practices in the [author 2’s location]. Clinicians who enrolled were consented and answered a pre-study questionnaire before they participated in a demonstration of features and functionality of the AMIT tool and role-play using the tool in a simulated patient encounter with the study coordinator.
Pre-/Post- Study Questionnaire
We administered a questionnaire to determine clinician knowledge, attitudes, comfort and behaviors related to alcohol counseling based on previous instruments we have developed35 and other previously validated instruments.12,13 The questionnaire also included basic information about enrolled clinicians’ clinical training and experience. Behavioral theories informing construction of questionnaire items included the 5 A’s (ask, advise, assess, assist and arrange),37 Stages of Change38 (based on the Transtheoretical Model) and Motivational Interviewing.39 Content experts [Author 7, Author 5, Author 1] reviewed the questionnaire for content validity. The final questionnaire consisted of 34 pre-post items, with an additional four items designed to measure usability in the post-questionnaire.
Tool use
Clinicians were asked to use the tool as they saw fit during the 12-month study period. Prototype usage was monitored during the study. For users of the PDA based tool, a data usage log was saved on the device and transmitted to a collection database via internet when the device was synchronized (synchronization is the process of connecting a handheld device to a desktop computer and updating data on both devices so that the information is the same in both locations). For participants who used the web-based tool this usage data was collected via web usage logs as each clinician had a unique username and password. Collective and individualized activity reports provided information on: synchronization, total synchronizations, and average sessions per synchronization. Data on each user’s total sessions, average pages viewed per session, unique pages viewed per session, and page contents was reviewed. Reviews of synchronizations and usage data were conducted and emails were sent to participants who had not synchronized offering assistance with technical or other barriers to use. At approximately 6–8 weeks after the web-based tool was introduced, an email reminder was sent to all participants who had limited or non-use of the tool. Another e-mail reminder was sent mid-way through the study offering technical support and additional practice. During the last half of the study, email reminders with tips and articles related to alcohol counseling were sent two additional times and a final reminder was sent two weeks before the study ended.
Qualitative Assessment of tool use
At the end of the study period, participants completed the post-study questionnaire and then participated in a 45 – 60 min interview about their use of and satisfaction with the tool. A semi-structured interview format was used by the study coordinator in one-on-one interviews with participants. Questions addressed use of tool, nature of use, strengths and weaknesses of the tool, barriers to use, and recommended changes. These interviews were audio recorded and transcribed by the study coordinator [author 2]. Content analysis and identification of themes was performed by the study coordinator and content and themes were reviewed and verified by content experts on the study team [author1, author 7]. Emergent design principles and an inductive approach40 were used due to limited data and theories on the use of clinical assessment and intervention tools for alcohol counseling by primary care physicians.
Statistical Analysis
In addition to qualitative analysis of the structured interview results to identify and report general themes, paired t-tests were performed to assess mean differences in the three main sub-scales (physician knowledge, behaviors and comfort with alcohol screening and intervention practices) from pre- to post-test. Because this was a pilot study designed a priori to determine feasibility (not efficacy), the sample size was too small to have adequate power to make statistical inferences from the data. Therefore, we examined the results of the t-tests to identify trends and generate hypotheses to be tested in a larger, randomized controlled trial. All quantitative analyses were conducted using SPSS for Windows version 11.
Initial recruitment began in Feb 2008. In May 2008 recruitment was broadened to include clinicians interested in using a web-based tool and recruitment ended in July 2008. A total of 19 licensed clinicians were enrolled, including two family medicine faculty development fellows, three residents (1-PGY3, 2-PGY2) and one nurse practitioner. Participants practiced in three university affiliated practices (two urban, one rural) and three community based practices. 12 participants (63%) completed the trial based on returning pre-post surveys (see table 1 for demographics). 16 participants (84%) completed a post-trial semi-structured interview. Reasons for drop-outs included family medical leave (1), loss of pre-survey by participant (1), and non-completion of post-survey (5). The drop outs included one resident, three academic faculty, three community physicians and included four males and three females. Communication at the end of the study indicated reluctance to participate in follow-up due to limited use of the tool and the time lag since the start of the trial.
Table 1
Table 1
Participant Demographics
Use of tool
Clinicians had access to the tool for an average of 8.5 months (range: 7 to 12 months). Technical issues related to PDA use as well as recruitment issues led to adapting the tool so it could be accessed on any web-enabled computing device in May 2008. Some physicians had difficulties installing the PDA software, synchronizing data, and experienced PDA crashes resulting in data loss. In addition, desktop computers were made available in every patient examination room, making a web-enabled version more attractive to some users. Ten of the participants had access to the web-based version of the tool and 2 participants had access to both versions. Details of participant tool use are fully described in Table 2.
Table 2
Table 2
AMIT tool use data
Knowledge, Comfort and Behaviors Pre and Post study questionnaire
No statistically significant mean differences were found for physician knowledge (mean increase=.70, p=.35), physician comfort (mean increase=.09, p=.93) and physician counseling behaviors (mean increase=.25, p=.96). We were only able to analyze 11 completed pre-post surveys as one pre-survey was lost by the participant. However, there was an increase in physicians distinguishing between patients who are “at risk” drinkers vs. those with alcohol use disorders (e.g.dependence/abuse) (21%; t=2.4, p=.04).
Qualitative assessment of tool use and satisfaction
Semi-structured interviews were conducted with 16 of the enrolled clinicians including nine of those analyzed in the pre/post analysis. We were able to analyze 12 interviews (four were unanalyzed due to technical problems with the audio recording) with five faculty physicians, two community-based physicians, two fellows, two residents and one nurse practitioner. Of these 12 participants, 7 had used the tool at least once during the trial, 2 only used it during training and we did not have use data for three of the participants due to technical issues with PDA use logs.
Overall, participants were satisfied with the tool (71%) and all participants stated they would use the tool if modified. Thematic analysis of interviews suggested that barriers to overall use included perceptions of alcohol use; clinical need to intervene; time; and issues with use of technology generally at the POC. However, the tool added confidence and a valuable framework for interventions and was valued as an educational tool. Users felt that increased training and practice could increase comfort and impact future POC use. Increased POC usability may also be achieved through tool simplification and additional flexibility in POC use options (see figure 2).
Figure 2
Figure 2
Summary of suggestions for tool modifications and barriers to use from qualitative analysis
Conclusions/Discussion
We developed a computer-assisted screening and counseling tool for alcohol misuse and studied its use and uptake in primary care settings. Our study uncovered important barriers and suggestions for improvement that are necessary to achieve more widespread use and clinical utility for this point of care tool in primary care settings. When clinicians used the tool, the frequency, length of time and page views were consistent with brief counseling sessions in primary care as well as using it as an educational reference. The majority of study participants were satisfied with the tool and all participants stated that they would use this tool in practice if it was modified based on the feedback from the study. Suggestions for tool modifications and barriers to use are described in Figure 2.
Although most of these barriers have been previously cited, we were struck by the dissonance physicians seemed to exhibit regarding perceived prevalence of alcohol misuse and abuse among their patients as contrasted with epidemiological data supporting the high death toll2 and high prevalence of risky alcohol use in the general population.8 We did not find this barrier previously reported in our literature review and would recommend exploring physicians’ perceptions as a part of interventions aimed at increasing screening and counseling for alcohol use and misuse. Based on their perceptions, there may be a need for further education and training on the prevalence and public health impacts of unsafe alcohol use.
Additional training and practice with the tool were also identified as important components of successful implementation. Finally, providing resources that add value to using the tool (see Figure 2) may be an important trigger for successful implementation. These are components and approaches that are being integrated into similar behavioral counseling tools for smoking cessation and diet/exercise that we are currently developing41, 42 and their effect on implementation will be evaluated.
There are several limitations of this study that should be considered in interpreting these results. Only a small percentage of PBRN clinicians (approx. 9%) enrolled in the pilot trial to test the tool, potentially limiting generalizability of our findings. In addition, approximately one-third (37%) of participants dropped out of the study, also limiting generalizability and introducing bias. Another potential source of bias may have been introduced by having study team members conduct the post-intervention semi-structured interviews. We didn’t find statistically significant differences between pre- and post-test physician assessment, however the study was not powered to see small differences in study measures and could represent Type II error. Finally, due to multiple comparisons in our analysis, there is the possibility of a type I error in our statistically significant finding that physicians were more likely to report assessing for “at risk” drinkers vs. dependence/abuse. This was a limitation of the study from the outset and underscores that it was designed as a pilot for hypothesis generation and identifying trends. Nevertheless, finding at least one change in physician behavior may be important and is consistent with our previously tested tools. In a previous study, we developed a Modular Lifestyle Intervention Tool to address smoking cessation and unhealthy weight and found that physicians were more likely to advise patients to stop smoking and were more likely to arrange follow-up for overweight patients who wanted to lose weight. In addition, the tool increased overall use of the 5 A’s during patient encounters and increased general counseling behaviors for both smoking cessation and weight loss.43 We recommend further evaluation of the AMIT tool in a larger sample with suggested improvements to definitively explore efficacy of this approach with alcohol use/misuse.
Computer-assisted behavioral change counseling has the potential to enhance interventions in primary care settings and can assist physicians with tailoring interventions for individual patients. Results from several studies indicate that providing people with unhealthy behaviors with a personalized report based on patient readiness to change enhances cessation rates.4450 A Cochrane review reported on a meta-analysis of seventeen trials using materials tailored to the characteristics of individual patients. While part of the effect could be due to the additional contact or assessment required to obtain individual data, there is evidence that tailored materials increase rates of addiction management rates over and above standard materials and untailored materials (OR 1.42, 95% CI 1.26 – 1.61).51 Implementing this approach using technologies such as smarthphones and integration with electronic medical records has the potential for increased reach of the intervention due to rapidly increasing physician adoption of these technologies at the point-of-care.
This pilot study illustrates challenges and potential solutions for implementing a computer-assisted counseling tool for alcohol misuse and abuse in primary care settings. Based on our experience with implementation we recommend evaluating integration of this tool within electronic medical records where it can be easily available during patient encounters and documentation can be accomplished automatically during the interview. We also recommend evaluating this approach with other medical staff and ancillary providers to determine if having other staff using this approach can augment and/or complement physician interventions. For example, other healthcare staff might complete a basic assessment and intervention with patients and have a tailored report that physicians could use to make key counseling points during an office visit. Our next steps are to conduct additional design enhancements and usability testing of the tool and test the tool in a randomized, controlled trial with sufficient power to determine differences in patient outcomes.
Acknowledgments
Funding: 1 R41 AA16030-01, NIAAA, Strayer, PI
Footnotes
Conflicting and Competing Interests: None
1. McGinnis JM, Foege WH. Actual causes of death in the united states. JAMA. 1993;270(18):2207–2212. [PubMed]
2. Mokdad AH, Marks JS, Stroup DF, Gerberding JL. Actual causes of death in the united states, 2000. JAMA. 2004;291(10):1238–1245. [PubMed]
3. Centers for Disease Control and Prevention (CDC). . Alcohol-attributable deaths and years of potential life lost--united states, 2001. MMWR Morb Mortal Wkly Rep. 2004;53(37):866–870. [PubMed]
4. Reid MC, Fiellin DA, O’Connor PG. Hazardous and harmful alcohol consumption in primary care. Arch Intern Med. 1999;159(15):1681–1689. [PubMed]
5. National Institute on Alcohol Abuse and Alcoholism. The tenth special report to the US congress on alcohol and health. Rockville, MD: pp. 429–443. NIH Publication No. 00–1583.
6. Whitlock EP, Green CA, Polen MR, et al. Behavioral counseling interventions in primary care to reduce Risky/Harmful alcohol use: a summary of the evidence for the U.S. Preventive Services Task Force. Annals of Internal Medicine. 2004;140(7):557–68. [PubMed]
7. Rubak S, Sandbaek A, Lauritzen T, Christensen B. Motivational interviewing: A systematic review and meta-analysis. Br J Gen Pract. 2005;55(513):305–312. [PMC free article] [PubMed]
8. Saitz R. Clinical practice. unhealthy alcohol use. N Engl J Med. 2005;352(6):596–607. [PubMed]
9. Fiellin DA, Reid MC, O’Connor PG. Screening for alcohol problems in primary care: A systematic review. Arch Intern Med. 2000;160(13):1977–1989. [PubMed]
10. Institute of Medicine. Broadening the base of treatment for alcohol problems. Washington, DC: National Academy Press; 1990.
11. NIAAA. Ninth special report to the US congress on alcohol and health from the secretary of health and human services. Rockville, MD: NIH; 1997. NIH Pub. No. 97–4017(NIH Pub. No. 97–4017)
12. Spandorfer JM, Israel Y, Turner BJ. Primary care physicians’ views on screening and management of alcohol abuse: Inconsistencies with national guidelines. J Fam Pract. 1999;48(11):899–902. [PubMed]
13. Friedmann PD, McCullough D, Chin MH, Saitz R. Screening and intervention for alcohol problems. A national survey of primary care physicians and psychiatrists. J Gen Intern Med. 2000;15(2):84–91. [PMC free article] [PubMed]
14. Babor TE, Higgins-Biddle J, Dauser D, Higgins P, Burleson JA. Alcohol screening and brief intervention in primary care settings: Implementation models and predictors. J Stud Alcohol. 2005;66(3):361–368. [PubMed]
15. Funk M, Wutzke S, Kaner E, et al. A multicountry controlled trial of strategies to promote dissemination and implementation of brief alcohol intervention in primary health care: Findings of a world health organization collaborative study. J Stud Alcohol. 2005;66(3):379–388. [PubMed]
16. Rush B, Ellis K, Crowe T, Powell L. How general practitioners view alcohol use. clearing up the confusion. Can Fam Physician. 1994;40:1570–1579. [PMC free article] [PubMed]
17. Arborelius E, Damstrom Thakker K. Why is it so difficult for general practitioners to discuss alcohol with patients? FamPract. 1995;12(4):419–422. [PubMed]
18. Lock CA, Kaner E, Lamont S, Bond S. A qualitative study of nurses’ attitudes and practices regarding brief alcohol intervention in primary health care. J Adv Nurs. 2002;39(4):333–342. [PubMed]
19. Beich A, Gannik D, Malterud K. Screening and brief intervention for excessive alcohol use: Qualitative interview study of the experiences of general practitioners. BMJ. 2002;325(7369):870. [PMC free article] [PubMed]
20. Bander KW, Goldman DS, Schwartz MA, Rabinowitz E, English JT. Survey of attitudes among three specialties in a teaching hospital toward alcoholics. J Med Educ. 1987;62(1):17–24. [PubMed]
21. Aira M, Kauhanen J, Larivaara P, Rautio P. Differences in brief interventions on excessive drinking and smoking by primary care physicians: Qualitative study. Prev Med. 2004;38(4):473–478. [PubMed]
22. Anderson P, Kaner E, Wutzke S, et al. Attitudes and managing alcohol problems in general practice: An interaction analysis based on findings from a WHO collaborative study. Alcohol Alcohol. 2004;39(4):351–356. [PubMed]
23. Cornuz J, Zwahlen S, Jungi WF, et al. A vaccine against nicotine for smoking cessation: A randomized controlled trial. PLoS ONE. 2008;3(6):e2547. [Electronic Resource] [PMC free article] [PubMed]
24. Cornuz J, Ghali WA, Di Carlantonio D, Pecoud A, Paccaud F. Physicians’ attitudes towards prevention: Importance of intervention-specific barriers and physicians’ health habits. Fam Pract. 2000;17(6):535–540. [PubMed]
25. Thom B, Tellez C. A difficult business: Detecting and managing alcohol problems in general practice. Br J Addict. 1986;81(3):405–418. [PubMed]
26. Thun MJ, Peto R, Lopez AD, et al. Alcohol consumption and mortality among middle-aged and elderly U.S. adults. N Engl J Med. 1997;337(24):1705–1714. [PubMed]
27. State of the science report on the effects of moderate drinking. NIAAA; 2003.
28. Williams EC, Lapham G, Achtmeyer CE, Volpp B, Kivlahan DR, Bradley KA. Use of an electronic clinical reminder for brief alcohol counseling is associated with resolution of unhealthy alcohol use at follow-up screening. J Gen Intern Med. 2010;25 (Suppl 1):11–17. [PMC free article] [PubMed]
29. Williams EC, Achtmeyer CE, Kivlahan DR, et al. Evaluation of an electronic clinical reminder to facilitate brief alcohol-counseling interventions in primary care. J Stud Alcohol Drugs. 2010;71(5):720–725. [PubMed]
30. Farrell SP, Mahone IH, Zerull LM, et al. Electronic screening for mental health in rural primary care: Implementation. Issues Ment Health Nurs. 2009;30(3):165–173. [PubMed]
31. Saitz R, Palfai TP, Freedner N, et al. Screening and brief intervention online for college students: The ihealth study. Alcohol Alcohol. 2007;42(1):28–36. [PubMed]
32. Kypri K, Saunders JB, Gallagher SJ. Acceptability of various brief intervention approaches for hazardous drinking among university students. Alcohol Alcohol. 2003;38(6):626–628. [PubMed]
33. Sinadinovic K, Berman AH, Hasson D, Wennberg P. Internet-based assessment and self-monitoring of problematic alcohol and drug use. Addict Behav. 2010;35(5):464–470. [PubMed]
34. Heim SW, Nadkarni M, Rollins LK, et al. Modular lifestyle intervention tool: A handheld tool to assist clinicians in providing patient-tailored counseling. Ann Fam Med. 2005;3 (Suppl 2):S65–7. [PubMed]
35. Strayer SM, Rollins LK, Martindale JR. A handheld computer smoking intervention tool and its effects on physician smoking cessation counseling. J Am Board Fam Med. 2006;19(4):350–357. [PubMed]
36. National Institute on Alcohol Abuse and Alcoholism, editor. Helping Patients Who Drink Too Much: A Clinician’s Guide. Rockville, MD: NIH; 2005. No. NIH Publication No. 07–3769.
37. Whitlock EP, Orleans CT, Pender N, Allan J. Evaluating primary care behavioral counseling interventions: An evidence-based approach. Am J Prev Med. 2002;22(4):267–284. [PubMed]
38. Prochaska JO, DiClemente CC. Stages and processes of self-change of smoking: Toward an integrative model of change. J Consult Clin Psychol. 1983;51(3):390–395. [PubMed]
39. Miller WR, Rollnick S. Motivational Interviewing: Preparing People for Change. 2. New York: Guilford Press; 2002.
40. Strauss A, Corbin J. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. 3. Thousand Oaks: Sage Pulications; 1998.
41. Strayer SM, Pelletier SL, Rollins LK, et al. Qualitative evaluation and usability of a web-based smoking cessation counseling tool based on motivational interviewing. Family Medicine. 2011;43(Suppl 1)
42. Strayer SM, Pelletier SL, Rollins LK, et al. Design and usability of a web-based weight loss counseling tool based on motivational interviewing. Family Medicine. 2011;43(Suppl 1)
43. Heim SW, Strayer SM, Nadkarni M, et al. Improving physician health behavior counseling. Family Medicine. 2006;38(Suppl 1)
44. Prochaska JO, Velicer WF, Redding C, et al. Stage-based expert systems to guide a population of primary care patients to quit smoking, eat healthier, prevent skin cancer, and receive regular mammograms. Prev Med. 2005;41(2):406–416. [PubMed]
45. Prochaska JO, Velicer WF, Fava JL, Rossi JS, Tsoh JY. Evaluating a population-based recruitment approach and a stage-based expert system intervention for smoking cessation. Addict Behav. 2001;26(4):583–602. [PubMed]
46. Strecher VJ, Shiffman S, West R. Moderators and mediators of a web-based computer-tailored smoking cessation program among nicotine patch users. Nicotine Tobacco Res. 2006;8(Suppl 1):S95–101. [PubMed]
47. Strecher VJ, Shiffman S, West R. Randomized controlled trial of a web-based computer-tailored smoking cessation program as a supplement to nicotine patch therapy. Addiction. 2005;100(5):682–688. [PubMed]
48. Strecher VJ, Marcus A, Bishop K, et al. A randomized controlled trial of multiple tailored messages for smoking cessation among callers to the cancer information service. J Health Commun. 2005;10 (Suppl 1):105–118. [PubMed]
49. Strecher VJ, Kreuter M, Den Boer DJ, et al. The effects of computer-tailored smoking cessation messages in family practice settings. J Fam Pract. 1994;39(3):262–268. [PubMed]
50. Dijkstra A, De Vries H, Roijackers J, et al. Tailored interventions to communicate stage-matched information to smokers in different motivational stages. J Consult Clin Psychol. 1998;66(3):549–557. [PubMed]
51. Lancaster T, Stead LF. Self-help interventions for smoking cessation. Cochrane Database Syst Rev. 2005;(3):CD001118. [PubMed]