Evidence on the effectiveness of printed educational messages in contributing to increasing evidence-based clinical practice is contradictory. Nonetheless, these messages flood physician offices, in an attempt to promote treatments that can reduce costs while improving patient outcomes.
This study evaluated the ability of printed educational messages to promote the choice of thiazides as the first-line treatment for individuals newly diagnosed with hypertension, a practice supported by good evidence and included in guidelines, and one which could reduce costs to the health care system.
The study uses a pragmatic, cluster randomized controlled trial (randomized by physician practice group).
The setting involves all Ontario general/family practice physicians.
Messages advising the use of thiazides as the first-line treatment of hypertension were mailed to each physician in conjunction with a widely read professional newsletter. Physicians were randomized to receive differing versions of printed educational messages: an “insert” (two-page evidence-based article) and/or one of two different versions of an “outsert” (short, directive message stapled to the outside of the newsletter). One outsert was developed without an explicit theory and one with messages developed targeting factors from the theory of planned behaviour or neither (newsletter only, with no mention of thiazides).
The percentage of patients aged over 65 and newly diagnosed with hypertension who were prescribed a thiazide as the sole initial prescription medication. The effect of the intervention was estimated using a logistic regression model estimated using generalized estimating equation methods to account for the clustering of patients within physician practices.
Four thousand five hundred four physicians (with 23,508 patients) were randomized, providing 97 % power to detect a 5 % absolute increase in prescription of thiazides. No intervention effect was detected. Thiazides were prescribed to 27.6 % of the patients who saw control physicians, 27.4 % for the insert, 26.8 % for the outsert and 28.3 % of the patients who saw insert + outsert physicians, p = 0.54.
The study conclusively failed to demonstrate any impact of the printed educational messages on increasing prescribing of thiazide diuretics for first-line management of hypertension.
Electronic supplementary material
The online version of this article (doi:10.1186/s13012-016-0486-3) contains supplementary material, which is available to authorized users.
Pragmatic trials of implementation interventions focus on evaluating whether an intervention changes professional behaviour under real-world conditions rather than investigating the mechanism through which change occurs. Theory-based process evaluations conducted alongside pragmatic randomised trials address this by assessing whether the intervention changes theoretical constructs proposed to mediate change. The Ontario Printed Educational Materials (PEM) cluster trial was designed to increase family physicians’ guideline-recommended prescription of thiazide diuretics. The trial found no intervention effect. Using the theory of planned behaviour (TPB), we hypothesised that changes in thiazide prescribing would be reflected in changes in intention, consistent with changes in attitude and subjective norm, with no change to their perceived behavioural control (PBC), and tested this alongside the RCT.
We developed and sent TPB postal questionnaires to a random sub-sample of family physicians in each trial arm 2 months before and 6 months after dissemination of the PEMs. We used analysis of covariance to test for group differences using a 2 × 3 factorial design. We content-analysed an open-ended question about perceived barriers to thiazide prescription. Using control group data, we tested whether baseline measures of TPB constructs predicted self-reported thiazide prescribing at follow-up.
Four hundred twenty-six physicians completed pre- and post-intervention questionnaires. Baseline scores on measures of TPB constructs were high: intention mean = 5.9 out of 7 (SD = 1.4), attitude mean = 5.8 (SD = 1.1), subjective norm mean = 5.8 (SD = 1.1) and PBC mean = 6.2 (SD = 1.0). The arms did not significantly differ post-intervention on any of the theory-based constructs, suggesting a possible ceiling effect. Content analysis of perceived barriers suggested post-intentional barriers to prescribing thiazides most often focused on specific patient clinical characteristics and potential side effects. Baseline intention (β = 0.63, p < 0.01) but not PBC (β = 0.04, p = 0.78) predicted 42.6 % of the variance in self-reported behaviour at follow-up in the control group.
Congruent with the Ontario Printed Educational Messages trial results and aligned with the TPB, we saw no impact of the intervention on any TPB constructs. The theoretical basis of this evaluation suggests possible explanations for the failure of the PEM intervention to change professional behaviour, which can directly inform the design and content of future theory-based PEM interventions to change professional behaviour.
ISRCTN, Canada ISRCTN72772651
Electronic supplementary material
The online version of this article (doi:10.1186/s13012-016-0485-4) contains supplementary material, which is available to authorized users.
Behaviour change interventions are likely to be reproducible only if reported clearly. We assessed whether the behaviour change technique taxonomy version 1 (BCTTv1), with and without training in identifying BCTs, improves the clarity and replicability of written reports of observed behaviour change interventions.
Three studies assessed effects of using and training in the use of BCTTv1 on the clarity and replicability of intervention descriptions written after observing videos of smoking cessation interventions. Study 1 examined the effects of using and not using BCTTv1. Study 2 examined the effects of using BCTTv1 and training in use of BCTTv1 compared no use and no training. Study 3 employed a within-group design to assess change in descriptions written before and after training. One-hundred and 66 ‘writers’ watched videos of behaviour change interventions and wrote descriptions of the active components delivered. In all studies, the participants’ written descriptions were evaluated by (i) 12 ‘raters’ (untrained in BCTTv1) for clarity and replicability and (ii) 12 ‘coders’ (trained in BCTTv1) for reliability of BCT coding. Writers rated the usability and accessibility of using BCTTv1 to write descriptions.
Ratings of clarity and replicability did not differ between groups in study 1 (all ps > 0.05), were poorer for trained users in study 2 (all ps < 0.01) and improved following training in study 3 (all ps < 0.05). BCT identification was more reliable from descriptions written by trained BCTTv1 users (p < 0.05; study 2) but not simple use of BCTTv1 (p = 0.93; study 1) or by writers who had written a description without BCTTv1, before training (p = 0.50; study 3). Writers reported that using BCTTv1 was difficult but ‘useful’, ‘good’ and ‘desirable’ and that their descriptions would be clear and replicable (all means above mid-point of the scale).
Effects of training to use BCTTv1 on the quality of written reports of observed interventions were mixed, with some suggestion of improved clarity and replicability of reporting in the within- (study 3) but not the between-group studies (studies 1 and 2). Potential benefits of using BCTTv1 may have been limited by the artificial nature and time constraints of the task.
Electronic supplementary material
The online version of this article (doi:10.1186/s13012-016-0448-9) contains supplementary material, which is available to authorized users.
Behaviour change; Reporting interventions; Taxonomy
Systematic reviews of behaviour change interventions for smoking cessation vary in scope, quality, and applicability. The current review aims to generate more accurate and useful findings by (1) a detailed analysis of intervention elements that change behaviour (i.e. behaviour change techniques (BCTs)) and potential moderators of behaviour change (i.e. other intervention and sample characteristics) and (2) assessing and controlling for variability in support provided to comparison groups in smoking cessation trials.
A systematic review will be conducted of randomized controlled trials of behaviour change interventions for smoking cessation in adults (with or without pharmacological support), with a minimum follow-up of 6 months, published after 1995. Eligible articles will be identified through the Cochrane Tobacco Addiction Group Specialized Register. Study authors will be asked for detailed descriptions of smoking cessation support provided to intervention and comparison groups. All data will be independently coded by two researchers. The BCT taxonomy v1 (tailored to smoking cessation interventions) and template for intervention description and replication criteria will be used to code intervention characteristics. Data collection will further include sample and trial characteristics and outcome data (smoking cessation rates). Multilevel mixed-effects meta-regression models will be used to examine which BCTs and/or BCT clusters delivered to intervention and comparison groups explain smoking cessation rates in treatment arms (and effect sizes) and what key moderators of behaviour change are. Predicted effect sizes of each intervention will be computed assuming all interventions are compared against comparison groups receiving the same levels of behavioural support (i.e. low, medium, and high levels). Multi-disciplinary advisory board members (policymakers, health care providers, and (ex-)smokers) will provide strategic input throughout the project to ensure the review’s applicability to policy and practice.
By capturing BCTs in intervention and comparison groups, this systematic review will provide more accurate estimates of the effectiveness of smoking cessation interventions, the most promising BCTs and/or BCT clusters associated with smoking cessation rates in intervention and comparison arms, and important moderators of behaviour change. The results could set new standards for conducting meta-analyses of behaviour change interventions and improve research, service delivery, and training in the area of smoking cessation.
Systematic review registration
Electronic supplementary material
The online version of this article (doi:10.1186/s13643-016-0253-1) contains supplementary material, which is available to authorized users.
Smoking cessation; Systematic review; Meta-analysis; Meta-regression; Behaviour change technique; Intervention; Comparison group; Control group; Randomized controlled trial; Tobacco
Stress in health care professionals may reflect both the work and appraisal of work and impacts on the individuals, their patients, colleagues and managers.
The purpose of the present study is to examine physiological and psychological effects of stressors (tasks) and theory-based perceptions of work stressors within and between nurses in real time.
During two work shifts, 100 nurses rated experienced stress, affect, fatigue, theory-based measures of work stress and nursing tasks on electronic diaries every 90 min, whereas heart rate and activity were measured continuously.
Heart rate was associated with both demand and effort. Experienced stress was related to demand, control, effort and reward. Effort and reward interacted as predicted (but only within people). Results were unchanged when allowance was made for work tasks.
Real-time appraisals were more important than actual tasks in predicting both psychological and physiological correlates of stress. At times when effort was high, perceived reward reduced stress.
Electronic supplementary material
The online version of this article (doi:10.1007/s12160-015-9746-8) contains supplementary material, which is available to authorized users.
Demand-control model; Effort-reward imbalance; Occupational stress; Heart rate; Ecological momentary assessment
To develop a digital intervention to prompt, support, and respond to the outcomes of total skin self-examinations (TSSEs) at home by people treated for cutaneous melanoma.
A complex intervention development study.
Semistructured scoping interviews; people previously treated for cutaneous melanoma (n=21). Pilot testing: people treated for melanoma stages 0–2C (n=20); general practitioners (n=6); and a nurse specialist in dermatology (n=1).
A tablet-based digital intervention designed to prompt and support TSSEs comprising instructional videos and electronic reporting (including photographs) to a clinical nurse specialist in dermatology, with subsequent clinical triage.
Primary and secondary outcome measures
Qualitative assessment of intervention feasibility and acceptability, and quantitative assessment of intentions and confidence to perform TSSEs in pilot participants.
The majority of pilot participants were strongly positive and adhered well to the intervention (n=15), with 7 of these reporting symptoms of concern at some point during the 6-month pilot. 4 patients complied intermittently, 3 reporting skin problems at least once during the pilot, and 1 withdrew. 2 patients underwent skin surgery as a result of participating in the pilot, with 1 diagnosed as having a recurrent melanoma and the other, a benign lesion. A number of practical issues to improve the usability of the intervention were identified. The proportion of participants reporting intention to check their skin at least monthly increased during the intervention as did confidence to conduct a skin check.
People previously treated for cutaneous melanoma are prepared to use digital technology to support them in conducting TSSE. An intervention has been developed which is practical, effective and safe, and after addressing minor practical issues, could now be evaluated for clinical outcomes in a randomised clinical trial.
The aim of the study was to explore and compare junior doctors' perceptions of their self-efficacy in prescribing, their prescribing errors and the possible causes of those errors.
A cross-sectional questionnaire study was distributed to foundation doctors throughout Scotland, based on Bandura's Social Cognitive Theory and Human Error Theory (HET).
Five hundred and forty-eight questionnaires were completed (35.0% of the national cohort). F1s estimated a higher daytime error rate [median 6.7 (IQR 2–12.4)] than F2s [4.0 IQR (0–10) (P = 0.002)], calculated based on the total number of medicines prescribed. The majority of self-reported errors (250, 49.2%) resulted from unintentional actions. Interruptions and pressure from other staff were commonly cited causes of errors. F1s were more likely to report insufficient prescribing skills as a potential cause of error than F2s (P = 0.002). The prescribers did not believe that the outcomes of their errors were serious. F2s reported higher self-efficacy scores than F1s in most aspects of prescribing (P < 0.001).
Foundation doctors were aware of their prescribing errors, yet were confident in their prescribing skills and apparently complacent about the potential consequences of prescribing errors. Error causation is multi-factorial often due to environmental factors, but with lack of knowledge also contributing. Therefore interventions are needed at all levels, including environmental changes, improving knowledge, providing feedback and changing attitudes towards the role of prescribing as a major influence on patient outcome.
junior doctors; human error theory; patient safety; prescribing errors; self-efficacy
To conduct a systematic review and meta-analysis examining the effectiveness of behavioural interventions targeting diet, physical activity or smoking in low-income adults.
Systematic review with random effects meta-analyses. Studies before 2006 were identified from a previously published systematic review (searching 1995–2006) with similar but broader inclusion criteria (including non-randomised controlled trials (RCTs)). Studies from 2006 to 2014 were identified from eight electronic databases using a similar search strategy.
MEDLINE, EMBASE, PsycINFO, ASSIA, CINAHL, Cochrane Controlled Trials, Cochrane Systematic Review and DARE.
Eligibility criteria for selecting studies
RCTs and cluster RCTs published from 1995 to 2014; interventions targeting dietary, physical activity and smoking; low-income adults; reporting of behavioural outcomes.
Main outcome measures
Dietary, physical activity and smoking cessation behaviours.
35 studies containing 45 interventions with 17 000 participants met inclusion criteria. At postintervention, effects were positive but small for diet (standardised mean difference (SMD) 0.22, 95% CI 0.14 to 0.29), physical activity (SMD 0.21, 95% CI 0.06 to 0.36) and smoking (relative risk (RR) of 1.59, 95% CI 1.34 to 1.89). Studies reporting follow-up results suggested that effects were maintained over time for diet (SMD 0.16, 95% CI 0.08 to 0.25) but not physical activity (SMD 0.17, 95% CI −0.02 to 0.37) or smoking (RR 1.11, 95% CI 0.93 to 1.34).
Behaviour change interventions for low-income groups had small positive effects on healthy eating, physical activity and smoking. Further work is needed to improve the effectiveness of behaviour change interventions for deprived populations.
PUBLIC HEALTH; PREVENTIVE MEDICINE; SOCIAL MEDICINE
Behaviour Change Technique Taxonomy v1 (BCTTv1) has been used to detect active ingredients of interventions. The purpose of this study was to evaluate effectiveness of user training in improving reliable, valid and confident application of BCTTv1 to code BCTs in intervention descriptions. One hundred sixty-one trainees (109 in workshops and 52 in group tutorials) were trained to code frequent BCTs. The following measures were taken before and after training: (i) inter-coder agreement, (ii) trainee agreement with expert consensus, (iii) confidence ratings and (iv) coding competence. Coding was assessed for 12 BCTs (workshops) and for 17 BCTs (tutorials). Trainees completed a course evaluation. Methods improved agreement with expert consensus (p < .05) but not inter-coder agreement (p = .08, p = .57, respectively) and increased confidence for BCTs assessed (both p < .05). Methods were as effective as one another at improving coding competence (p = .55). Training was evaluated positively. The training improved agreement with expert consensus, confidence for BCTs assessed, coding competence but not inter-coder agreement. This varied according to BCT.
Behaviour change techniques; Taxonomy; Training methods
Advancements in mobile phone technology offer huge potential for enhancing the timely delivery of health behavior change interventions. The development of smartphone-based health interventions (apps) is a rapidly growing field of research, yet there have been few longitudinal examinations of how people experience and use these apps within their day-to-day routines, particularly within the context of a hybrid Web- and app-based intervention.
This study used an in-depth mixed-methods design to examine individual variation in (1) impact on self-reported goal engagement (ie, motivation, self-efficacy, awareness, effort, achievement) of access to a weight management app (POWeR Tracker) when provided alongside a Web-based weight management intervention (POWeR) and (2) usage and views of POWeR Tracker.
Thirteen adults were provided access to POWeR and were monitored over a 4-week period. Access to POWeR Tracker was provided in 2 alternate weeks (ie, weeks 1 and 3 or weeks 2 and 4). Participants’ goal engagement was measured daily via self-report. Mixed effects models were used to examine change in goal engagement between the weeks when POWeR Tracker was and was not available and whether the extent of change in goal engagement varied between individual participants. Usage of POWeR and POWeR Tracker was automatically recorded for each participant. Telephone interviews were conducted and analyzed using inductive thematic analysis to further explore participants’ experiences using POWeR and POWeR Tracker.
Access to POWeR Tracker was associated with a significant increase in participants’ awareness of their eating (β1=0.31, P=.04) and physical activity goals (β1=0.28, P=.03). The level of increase varied between individual participants. Usage data showed that participants used the POWeR website for similar amounts of time during the weeks when POWeR Tracker was (mean 29 minutes, SD 31 minutes) and was not available (mean 27 minutes, SD 33 minutes). POWeR Tracker was mostly accessed in short bursts (mean 3 minutes, SD 2 minutes) during convenient moments or moments when participants deemed the intervention content most relevant. The qualitative data indicated that nearly all participants agreed that it was more convenient to access information on-the-go via their mobiles compared to a computer. However, participants varied in their views and usage of the Web- versus app-based components and the informational versus tracking tools provided by POWeR Tracker.
This study provides evidence that smartphones have the potential to improve individuals’ engagement with their health-related goals when used as a supplement to an existing online intervention. The perceived convenience of mobile access to information does not appear to deter use of Web-based interventions or strengthen the impact of app access on goal engagement. A mixed-methods design enabled exploration of individual variation in daily usage of the app-based tools.
qualitative research; weight loss; behavioral research; mobile apps; Internet; health; program acceptability; behavior; mixed-methods
Delay to presentation with symptoms of acute coronary syndrome (ACS) is common meaning many fail to achieve optimal benefit from treatments. Interventions have had variable success in reducing delay. Evidence suggests inclusion of behaviour change techniques (BCTs) may improve effectiveness of interventions but this has not yet been systematically evaluated. Data from other time-critical conditions may be relevant.
Methods and analysis
A systematic review will be undertaken to identify which BCTs are associated with effective interventions to reduce patient delay (or prompt rapid help-seeking) among people with time-critical conditions (eg, chest pain, ACS, lumps, stroke, cancer and meningitis). A systematic search of a wide range of databases (including Cochrane Library, MEDLINE, EMBASE, CINAHL, PsycInfo) and grey literature will be undertaken to identify all relevant intervention studies (randomised controlled trials, controlled clinical trials and cohort studies). Two independent reviewers will screen abstracts to identify relevant studies, apply inclusion criteria to full papers, assess methodological quality and extract data.
Primary outcome measure
Change in patient decision time BCTs reported in each of the included studies will be categorised and presented according to the latest reliable taxonomy. Results of included studies will be synthesised, exploring relationships between inclusion of each BCT and effectiveness of the overall intervention. Where possible, means and SDs for differences in delay time will be calculated and combined within meta-analyses to derive a standardised mean difference and 95% CI. Analysis of (1) all time-critical and (2) ACS-only interventions will be undertaken.
Ethics and dissemination
No ethical issues are anticipated. Results will be submitted for publication in a relevant peer-reviewed journal.
Quality of Care and Outcomes
Theory-based process evaluations conducted alongside randomized controlled trials provide the opportunity to investigate hypothesized mechanisms of action of interventions, helping to build a cumulative knowledge base and to inform the interpretation of individual trial outcomes. Our objective was to identify the underlying causal mechanisms in a cluster randomized trial of the effectiveness of printed educational materials (PEMs) to increase referral for diabetic retinopathy screening. We hypothesized that the PEMs would increase physicians’ intention to refer patients for retinal screening by strengthening their attitude and subjective norm, but not their perceived behavioral control.
Design: A theory based process evaluation alongside the Ontario Printed Educational Material (OPEM) cluster randomized trial. Postal surveys based on the Theory of Planned Behavior were sent to a random sample of trial participants two months before and six months after they received the intervention. Setting: Family physicians in Ontario, Canada. Participants: 1,512 family physicians (252 per intervention group) from the OPEM trial were invited to participate, and 31.3% (473/1512) responded at time one and time two. The final sample comprised 437 family physicians fully completing questionnaires at both time points. Main outcome measures: Primary: behavioral intention related to referring patient for retinopathy screening; secondary: attitude, subjective norm, perceived behavioral control.
At baseline, family physicians reported positive intention, attitude, subjective norm, and perceived behavioral control to advise patients about retinopathy screening suggesting limited opportunities for improvement in these constructs. There were no significant differences on intention, attitude, subjective norm, and perceived behavioral control following the intervention. Respondents also reported additional physician- and patient-related factors perceived to influence whether patients received retinopathy screening.
Lack of change in the primary and secondary theory-based outcomes provides an explanation for the lack of observed effect of the main OPEM trial. High baseline levels of intention to advise patients to attend retinopathy screening suggest that post-intentional and other factors may explain gaps in care. Process evaluations based on behavioral theory can provide replicable and generalizable insights to aid interpretation of randomized controlled trials of complex interventions to change health professional behavior.
Electronic supplementary material
The online version of this article (doi:10.1186/1748-5908-9-86) contains supplementary material, which is available to authorized users.
Process evaluation; Theory of planned behavior; Printed educational material; Healthcare professional behavior; Behavior change
New clinical research findings may require clinicians to change their behaviour to provide high-quality care to people with type 2 diabetes, likely requiring them to change multiple different clinical behaviours. The present study builds on findings from a UK-wide study of theory-based behavioural and organisational factors associated with prescribing, advising, and examining consistent with high-quality diabetes care.
To develop and evaluate the effectiveness and cost of an intervention to improve multiple behaviours in clinicians involved in delivering high-quality care for type 2 diabetes.
We will conduct a two-armed cluster randomised controlled trial in 44 general practices in the North East of England to evaluate a theory-based behaviour change intervention. We will target improvement in six underperformed clinical behaviours highlighted in quality standards for type 2 diabetes: prescribing for hypertension; prescribing for glycaemic control; providing physical activity advice; providing nutrition advice; providing on-going education; and ensuring that feet have been examined. The primary outcome will be the proportion of patients appropriately prescribed and examined (using anonymised computer records), and advised (using anonymous patient surveys) at 12 months. We will use behaviour change techniques targeting motivational, volitional, and impulsive factors that we have previously demonstrated to be predictive of multiple health professional behaviours involved in high-quality type 2 diabetes care. We will also investigate whether the intervention was delivered as designed (fidelity) by coding audiotaped workshops and interventionist delivery reports, and operated as hypothesised (process evaluation) by analysing responses to theory-based postal questionnaires. In addition, we will conduct post-trial qualitative interviews with practice teams to further inform the process evaluation, and a post-trial economic analysis to estimate the costs of the intervention and cost of service use.
Consistent with UK Medical Research Council guidance and building on previous development research, this pragmatic cluster randomised trial will evaluate the effectiveness of a theory-based complex intervention focusing on changing multiple clinical behaviours to improve quality of diabetes care.
Study objectives were to investigate the prevalence and causes of prescribing errors amongst foundation doctors (i.e. junior doctors in their first (F1) or second (F2) year of post-graduate training), describe their knowledge and experience of prescribing errors, and explore their self-efficacy (i.e. confidence) in prescribing.
A three-part mixed-methods design was used, comprising: prospective observational study; semi-structured interviews and cross-sectional survey. All doctors prescribing in eight purposively selected hospitals in Scotland participated. All foundation doctors throughout Scotland participated in the survey. The number of prescribing errors per patient, doctor, ward and hospital, perceived causes of errors and a measure of doctors' self-efficacy were established.
4710 patient charts and 44,726 prescribed medicines were reviewed. There were 3364 errors, affecting 1700 (36.1%) charts (overall error rate: 7.5%; F1:7.4%; F2:8.6%; consultants:6.3%). Higher error rates were associated with : teaching hospitals (p<0.001), surgical (p = <0.001) or mixed wards (0.008) rather thanmedical ward, higher patient turnover wards (p<0.001), a greater number of prescribed medicines (p<0.001) and the months December and June (p<0.001). One hundred errors were discussed in 40 interviews. Error causation was multi-factorial; work environment and team factors were particularly noted. Of 548 completed questionnaires (national response rate of 35.4%), 508 (92.7% of respondents) reported errors, most of which (328 (64.6%) did not reach the patient. Pressure from other staff, workload and interruptions were cited as the main causes of errors. Foundation year 2 doctors reported greater confidence than year 1 doctors in deciding the most appropriate medication regimen.
Prescribing errors are frequent and of complex causation. Foundation doctors made more errors than other doctors, but undertook the majority of prescribing, making them a key target for intervention. Contributing causes included work environment, team, task, individual and patient factors. Further work is needed to develop and assess interventions that address these.
Most individuals with lung cancer have symptoms for several months before presenting to their GP. Earlier consulting may improve survival.
To evaluate whether a theory-based primary care intervention increased timely consulting of individuals with symptoms of lung cancer.
Design and setting
Open randomised controlled trial comparing intervention with usual care in two general practices in north-east Scotland.
Smokers and ex-smokers aged ≥55 years were randomised to receive a behavioural intervention or usual care. The intervention comprised a single nurse consultation at participants’ general practice and a self-help manual. The main outcomes were consultations within target times for individuals with new chest symptoms (≤3 days haemoptysis, ≤3 weeks other symptoms) in the year after the intervention commenced, and intentions about consulting with chest symptoms at 1 and 6 months.
Two hundred and twelve participants were randomised and 206 completed the trial. The consultation rate for new chest symptoms in the intervention group was 1.19 (95% confidence interval [CI] = 0.92 to 1.53; P = 0.18) times higher than in the usual-care group and the proportion of consultations within the target time was 1.11 (95% CI = 0.41 to 3.03; P = 0.83) times higher. One month after the intervention commenced, the intervention group reported intending to consult with chest symptoms 31 days (95% CI = 7 to 54; P = 0.012) earlier than the usual care group, and at 6 months this was 25 days (95% CI = 1.5 to 48; P = 0.037) earlier.
Behavioural intervention in primary care shortened the time individuals at high risk of lung disease intended to take before consulting with new chest symptoms (the secondary outcome of the study), but increases in consultation rates and the proportions of consultations within target times were not statistically significant.
early detection of cancer; general practice; illness behaviour; lung neoplasms; randomised controlled trial
The SF-36 is a very commonly used generic measure of health outcome in osteoarthritis (OA). An important, but frequently overlooked, aspect of validating health outcome measures is to establish if items work in the same way across subgroup of a population. That is, if respondents have the same ‘true’ level of outcome, does the item give the same score in different subgroups or is it biased towards one subgroup or another. Differential item functioning (DIF) can identify items that may be biased for one group or another and has been applied to measuring patient reported outcomes. Items may show DIF for different conditions and between cultures, however the SF-36 has not been specifically examined in an osteoarthritis population nor in a UK population. Hence, the aim of the study was to apply the DIF method to the SF-36 for a UK OA population.
The sample comprised a community sample of 763 people with OA who participated in the Somerset and Avon Survey of Health. The SF-36 was explored for DIF with respect to demographic, social, clinical and psychological factors. Well developed ordinal regression models were used to identify DIF items.
DIF items were found by age (6 items), employment status (6 items), social class (2 items), mood (2 items), hip v knee (2 items), social deprivation (1 item) and body mass index (1 item). Although the impact of the DIF items rarely had a significant effect on the conclusions of group comparisons, in most cases there was a significant change in effect size.
Overall, the SF-36 performed well with only a small number of DIF items identified, a reassuring finding in view of the frequent use of the SF-36 in OA. Nevertheless, where DIF items were identified it would be advisable to analyse data taking account of DIF items, especially when age effects are the focus of interest.
Osteoarthritis; SF-36; Psychometrics; Item bias; Differential item functioning; Measurement equivalence
Lung cancer is the commonest cause of cancer in Scotland and is usually advanced at diagnosis. Median time between symptom onset and consultation is 14 weeks, so an intervention to prompt earlier presentation could support earlier diagnosis and enable curative treatment in more cases.
To develop and optimise an intervention to reduce the time between onset and first consultation with symptoms that might indicate lung cancer.
Design and setting
Iterative development of complex healthcare intervention according to the MRC Framework conducted in Northeast Scotland.
The study produced a complex intervention to promote early presentation of lung cancer symptoms. An expert multidisciplinary group developed the first draft of the intervention based on theory and existing evidence. This was refined following focus groups with health professionals and high-risk patients.
First draft intervention components included: information communicated persuasively, demonstrations of early consultation and its benefits, behaviour change techniques, and involvement of spouses/partners. Focus groups identified patient engagement, achieving behavioural change, and conflict at the patient–general practice interface as challenges and measures were incorporated to tackle these. Final intervention delivery included a detailed self-help manual and extended consultation with a trained research nurse at which specific action plans were devised.
The study has developed an intervention that appeals to patients and health professionals and has theoretical potential for benefit. Now it requires evaluation.
early diagnosis; health services research; lung cancer; primary health care
The Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) is a widely used patient reported outcome in osteoarthritis. An important, but frequently overlooked, aspect of validating health outcome measures is to establish if items exhibit differential item functioning (DIF). That is, if respondents have the same underlying level of an attribute, does the item give the same score in different subgroups or is it biased towards one subgroup or another. The aim of the study was to explore DIF in the Likert format WOMAC for the first time in a UK osteoarthritis population with respect to demographic, social, clinical and psychological factors.
The sample comprised a community sample of 763 people with osteoarthritis who participated in the Somerset and Avon Survey of Health. The WOMAC was explored for DIF by gender, age, social deprivation, social class, employment status, distress, body mass index and clinical factors. Ordinal regression models were used to identify DIF items.
After adjusting for age, two items were identified for the physical functioning subscale as having DIF with age identified as the DIF factor for 2 items, gender for 1 item and body mass index for 1 item. For the WOMAC pain subscale, for people with hip osteoarthritis one item was identified with age-related DIF. The impact of the DIF items rarely had a significant effect on the conclusions of group comparisons.
Overall, the WOMAC performed well with only a small number of DIF items identified. However, as DIF items were identified in for the WOMAC physical functioning subscale it would be advisable to analyse data taking into account the possible impact of the DIF items when weight, gender or especially age effects, are the focus of interest in UK-based osteoarthritis studies. Similarly for the WOMAC pain subscale in people with hip osteoarthritis it would be worthwhile to analyse data taking into account the possible impact of the DIF item when age comparisons are of primary interest.
Osteoarthritis; WOMAC; Psychometrics; Item bias; Differential item functioning; Measurement equivalence
In the field of implementation research, there is an increased interest in use of theory when designing implementation research studies involving behavior change. In 2003, we initiated a series of five studies to establish a scientific rationale for interventions to translate research findings into clinical practice by exploring the performance of a number of different, commonly used, overlapping behavioral theories and models. We reflect on the strengths and weaknesses of the methods, the performance of the theories, and consider where these methods sit alongside the range of methods for studying healthcare professional behavior change.
These were five studies of the theory-based cognitions and clinical behaviors (taking dental radiographs, performing dental restorations, placing fissure sealants, managing upper respiratory tract infections without prescribing antibiotics, managing low back pain without ordering lumbar spine x-rays) of random samples of primary care dentists and physicians. Measures were derived for the explanatory theoretical constructs in the Theory of Planned Behavior (TPB), Social Cognitive Theory (SCT), and Illness Representations specified by the Common Sense Self Regulation Model (CSSRM). We constructed self-report measures of two constructs from Learning Theory (LT), a measure of Implementation Intentions (II), and the Precaution Adoption Process. We collected data on theory-based cognitions (explanatory measures) and two interim outcome measures (stated behavioral intention and simulated behavior) by postal questionnaire survey during the 12-month period to which objective measures of behavior (collected from routine administrative sources) were related. Planned analyses explored the predictive value of theories in explaining variance in intention, behavioral simulation and behavior.
Response rates across the five surveys ranged from 21% to 48%; we achieved the target sample size for three of the five surveys. For the predictor variables, the mean construct scores were above the mid-point on the scale with median values across the five behaviors generally being above four out of seven and the range being from 1.53 to 6.01. Across all of the theories, the highest proportion of the variance explained was always for intention and the lowest was for behavior. The Knowledge-Attitudes-Behavior Model performed poorly across all behaviors and dependent variables; CSSRM also performed poorly. For TPB, SCT, II, and LT across the five behaviors, we predicted median R2 of 25% to 42.6% for intention, 6.2% to 16% for behavioral simulation, and 2.4% to 6.3% for behavior.
We operationalized multiple theories measuring across five behaviors. Continuing challenges that emerge from our work are: better specification of behaviors, better operationalization of theories; how best to appropriately extend the range of theories; further assessment of the value of theories in different settings and groups; exploring the implications of these methods for the management of chronic diseases; and moving to experimental designs to allow an understanding of behavior change.
Prescribing errors are a major source of morbidity and mortality and represent a significant patient safety concern. Evidence suggests that trainee doctors are responsible for most prescribing errors. Understanding the factors that influence prescribing behavior may lead to effective interventions to reduce errors. Existing investigations of prescribing errors have been based on Human Error Theory but not on other relevant behavioral theories. The aim of this study was to apply a broad theory-based approach using the Theoretical Domains Framework (TDF) to investigate prescribing in the hospital context among a sample of trainee doctors.
Semistructured interviews, based on 12 theoretical domains, were conducted with 22 trainee doctors to explore views, opinions, and experiences of prescribing and prescribing errors. Content analysis was conducted, followed by applying relevance criteria and a novel stage of critical appraisal, to identify which theoretical domains could be targeted in interventions to improve prescribing.
Seven theoretical domains met the criteria of relevance: “social professional role and identity,” “environmental context and resources,” “social influences,” “knowledge,” “skills,” “memory, attention, and decision making,” and “behavioral regulation.” From critical appraisal of the interview data, “beliefs about consequences” and “beliefs about capabilities” were also identified as potentially important domains. Interrelationships between domains were evident. Additionally, the data supported theoretical elaboration of the domain behavioral regulation.
In this investigation of hospital-based prescribing, participants’ attributions about causes of errors were used to identify domains that could be targeted in interventions to improve prescribing. In a departure from previous TDF practice, critical appraisal was used to identify additional domains that should also be targeted, despite participants’ perceptions that they were not relevant to prescribing errors. These were beliefs about consequences and beliefs about capabilities. Specifically, in the light of the documented high error rate, beliefs that prescribing errors were not likely to have consequences for patients and that trainee doctors are capable of prescribing without error should also be targeted in an intervention. This study is the first to suggest critical appraisal for domain identification and to use interview data to propose theoretical elaborations and interrelationships between domains.
Prescribing; Patient safety; Theoretical domains framework
Healthcare professional response rates to postal questionnaires are declining and this may threaten the validity and generalisability of their findings. Methods to improve response rates do incur costs (resources) and increase the cost of research projects. The aim of these randomised controlled trials (RCTs) was to assess whether 1) incentives, 2) type of reminder and/or 3) reduced response burden improve response rates; and to assess the cost implications of such additional effective interventions.
Two RCTs were conducted. In RCT A general dental practitioners (dentists) in Scotland were randomised to receive either an incentive; an abridged questionnaire or a full length questionnaire. In RCT B non-responders to a postal questionnaire sent to general medical practitioners (GPs) in the UK were firstly randomised to receive a second full length questionnaire as a reminder or a postcard reminder. Continued non-responders from RCT B were then randomised within their first randomisation to receive a third full length or an abridged questionnaire reminder. The cost-effectiveness of interventions that effectively increased response rates was assessed as a secondary outcome.
There was no evidence that an incentive (52% versus 43%, Risk Difference (RD) -8.8 (95%CI −22.5, 4.8); or abridged questionnaire (46% versus 43%, RD −2.9 (95%CI −16.5, 10.7); statistically significantly improved dentist response rates compared to a full length questionnaire in RCT A. In RCT B there was no evidence that a full questionnaire reminder statistically significantly improved response rates compared to a postcard reminder (10.4% versus 7.3%, RD 3 (95%CI −0.1, 6.8). At a second reminder stage, GPs sent the abridged questionnaire responded more often (14.8% versus 7.2%, RD −7.7 (95%CI −12.8, -2.6). GPs who received a postcard reminder followed by an abridged questionnaire were most likely to respond (19.8% versus 6.3%, RD 8.1%, and 9.1% for full/postcard/full, three full or full/full/abridged questionnaire respectively). An abridged questionnaire containing fewer questions following a postcard reminder was the only cost-effective strategy for increasing the response rate (£15.99 per response).
When expecting or facing a low response rate to postal questionnaires, researchers should carefully identify the most efficient way to boost their response rate. In these studies, an abridged questionnaire containing fewer questions following a postcard reminder was the only cost-effective strategy. An increase in response rates may be explained by a combination of the number and type of contacts. Increasing the sampling frame may be more cost-effective than interventions to prompt non-responders. However, this may not strengthen the validity and generalisability of the survey findings and affect the representativeness of the sample.
Although most people with Type 2 diabetes receive their diabetes care in primary care, only a limited amount is known about the quality of diabetes care in this setting. We investigated the provision and receipt of diabetes care delivered in UK primary care.
Postal surveys with all healthcare professionals and a random sample of 100 patients with Type 2 diabetes from 99 UK primary care practices.
326/361 (90.3%) doctors, 163/186 (87.6%) nurses and 3591 patients (41.8%) returned a questionnaire. Clinicians reported giving advice about lifestyle behaviours (e.g. 88% would routinely advise about calorie restriction; 99.6% about increasing exercise) more often than patients reported having received it (43% and 42%) and correlations between clinician and patient report were low. Patients’ reported levels of confidence about managing their diabetes were moderately high; a median (range) of 21% (3% to 39%) of patients reporting being not confident about various areas of diabetes self-management.
Primary care practices have organisational structures in place and are, as judged by routine quality indicators, delivering high quality care. There remain evidence-practice gaps in the care provided and in the self confidence that patients have for key aspects of self management and further research is needed to address these issues. Future research should use robust designs and appropriately designed studies to investigate how best to improve this situation.
The International Classification of Functioning, Disability and Health (ICF) defines participation as a person’s performance in life situations, including the size of social networks, and satisfaction with social contacts. Stroke survivors are known to experience a reduction in the number of their social networks and contacts, which cannot be explained solely in terms of activity limitations caused by physical impairment. Problems of emotional processing, including impaired mood, emotion regulation and emotion perception, are known to occur following stroke and can detrimentally influence many aspects of social interaction and participation. The aim of this study is to investigate whether emotion processing impairments predict stroke survivors’ restricted social participation, independent of problems with activity limitation.
We aim to recruit 125 patients admitted to NHS Grampian with a confirmed diagnosis of stroke. All participants will be assessed on measures of emotion processing, social participation and activity limitation at approximately one month post stroke and again at approximately one year post stroke in order to assess change over time.
It is important to develop a greater understanding of the emotional factors which may underlie key social deficits in stroke recovery in an ageing population where stroke is one of the leading causes of severe, complex disability. This research may enable us to identify those who are risk of participation restriction and target them in the acute stroke phase of stroke so that adverse outcome is avoided and rehabilitation potential is fulfilled.
How people present symptoms to health services may influence the care they subsequently receive. Leventhal's Commonsense Model of Self-Regulation (CS-SRM) posits that individuals develop cognitive illness representations elaborated around five main components (identity, timeline, cause, consequences, and cure/control), coherence, and emotional representations.
To examine whether initial presentations to health services consist of the components of illness representation proposed by the CS-SRM.
Design and setting
A CS-SRM-based content analysis of calls to the Scottish national telephone advice service, NHS 24.
A random sample of callers to NHS 24 was identified. A quota sample of 60 consented to participate. Their consultations were transcribed verbatim. Responses to an initial open question regarding the reason for calling were identified and divided into ‘meaning units’. A coding schedule was developed using Leventhal's definitions of illness representations. Meaning units were coded independently by two researchers.
Fifty-nine eligible initial presentations contained between 1 and 13 coding units, (mean = 4). A total of 230 coding units were available for coding. Overall, 202 (88%) coding units were coded to at least one component of illness representation. All 59 (100%) participants made reference to identity, 26 (44%) to timeline, nine (15%) to cause, eight (14%) to consequences, 22 (37%) to cure/control, and 11 (19%) to the degree of coherence. Emotional representations were identified in six (10%) participants' presentations.
Leventhal's CS-SRM accounts for a large proportion of initial presentations to health services. Most people offer identity plus at least one additional component of illness representation. It may be necessary for clinicians to prompt remaining components to obtain a comprehensive understanding of patients' representations of illness.
consultation; symptoms; telephone triage