|Home | About | Journals | Submit | Contact Us | Français|
Improving dietary behaviours such as increasing fruit and vegetable consumption and reducing saturated fat intake are important in the promotion of better health. Computer tailoring has shown promise as a strategy to promote such behaviours. A narrative systematic review was conducted to describe the available evidence on ‘second’-generation computer-tailored primary prevention interventions for dietary behaviour change and to determine their effectiveness and key characteristics of success. Systematic literature searches were conducted through five databases: Medline, Embase, PsycINFO, CINAHL and All EBM Reviews and by examining the reference lists of relevant articles to identify studies published in English from January 1996 to 2008. Randomized controlled trials or quasi-experimental designs with pre-test and post-test behavioural outcome data were included. A total of 13 articles were reviewed, describing the evaluation of 12 interventions, seven of which found significant positive effects of the computer-tailored interventions for dietary behaviour outcomes, one also for weight reduction outcomes. Although the evidence of short-term efficacy for computer-tailored dietary behaviour change interventions is fairly strong, the uncertainty lies in whether the reported effects are generalizable and sustained long term. Further research is required to address these limitations of the evidence.
Chronic diseases, such as heart disease, stroke, cancer, chronic respiratory diseases and diabetes, are by far the leading cause of mortality in the world, representing 60% of all deaths . Promoting increased fruit and vegetable consumption and reduced saturated fat intake is important in the prevention of chronic disease and promotion of better health [2, 3]. There is growing evidence that behaviour change programmes using computer tailoring can be effective in changing such lifestyle risk factors .
Computer-tailored interventions have been classified into three generations, according to their mode of delivery. First-generation interventions are delivered through printed materials such as letters, reports and pamphlets. Second-generation interventions are delivered through interactive technology or desktop applications such as websites, email and CD-ROM programs [5, 6]. Third-generation interventions include mobile and remote devices such as mobile phones and handheld computers which may enhance the potential for timely feedback .
Computer tailoring is promising as a strategy for health education . Firstly, like personal counselling participants are assessed and the results then used to generate individualized feedback and advice , making the health information received personalized and delivered at a relatively low cost . Participant's behaviours can be compared with current recommendations, the behaviours of peers and previous assessments . Feedback can then be provided that is relevant to performance levels, awareness, motivation, self-efficacy, expectations and goals . Secondly, it has potential for wide distribution due to its application to electronic non-print media such as the Internet which provides an opportunity for remote access to the intervention .
The limitations of computer-tailored interventions include that participants must answer a large number of questions and that feedback is based on participant's self-reported behaviour. This may result in inaccurate estimates of behaviour, subsequently resulting in mismatched feedback and advice [8, 9]. Such limitations may be minimized through the use of a combination of validated self-reports with more objective measures of behaviour change; however, there is a lack of existing objective measures for dietary behaviour change .
Previous well-conducted systematic reviews on computer-tailored interventions , web-based interventions [10, 11] and interventions using interactive technology  targeting physical activity and dietary behaviours indicated that further research was required to form any conclusions on their effectiveness, but the evidence was promising for those targeting dietary behaviour change. To investigate the potential of developing computer-tailored dietary behaviour change interventions targeting Australian adults, the abovementioned reviews were found to be relevant, however, had a different purpose, focus and inclusion criteria and considerable time had lapsed in this rapidly developing field [4, 5, 10, 11]. The aim of this study was to conduct a narrative systematic review which would describe the range and quality of available evidence on second- and third-generation computer-tailored primary prevention interventions for dietary behaviour change and to determine their effectiveness and key characteristics of success. The two most recent reviews focused on Internet-based interventions [10, 11]: one review included both first- and second-generation computerized interventions up to 2004 and excluded those in which there was any interpersonal contact with a counsellor  and one review that included studies up to 2005 was not exclusive to primary prevention interventions .
These reviews noted the significant heterogeneity of such studies. When there is significant heterogeneity of studies, it is considered more appropriate to undertake a narrative systematic review than a meta-analysis and to describe the variation in findings rather than attempt to combine findings into one overall estimate of effect .
Literature searches were conducted to retrieve articles from January 1996 to January 2008 that were written in English using five databases in February 2008: Medline, Embase, PsycINFO, CINAHL and All EBM Reviews. The search consisted of a combination of each of the following terms to represent computer-tailored or expert systems: expert system; web based; computer tailor*; computer based or Internet based; with each of the target domains: nutrition; diet; overweight; obesity and weight loss. Additional articles of relevance were sought by reviewing the reference lists of included articles and previous systematic reviews of relevance identified through the literature search [4, 5, 10, 11, 13–15].
Articles identified through the literature search were restricted to those written in English and published in a scientific journal between January 1996 and January 2008 (inclusive). Only randomized controlled trials (RCTs) or quasi-experimental designs with pre-test and post-test behavioural outcome data were included.
For inclusion in this review, articles had to describe the evaluation of a ‘second-’ or ‘third’-generation computerized intervention in which tailored nutrition advice was generated through a computerized system. Delivery was inclusive of but not exclusive to the electronic technology. Interventions were considered tailored if the advice or feedback provided was specific to individuals and based on an individual assessment and their characteristics. Further, the intervention had to target adults for dietary behaviour as a primary prevention strategy. Kroeze et al. definition of primary prevention was utilized ‘… the initiation of lifestyle or behavioural changes to prevent the onset of chronic diseases in apparently healthy participants’. [4: 206] Dietary behaviour changes had to be described as the primary outcome measure.
Interventions were excluded that had significant face-to-face contact involving counselling in one of the main treatment arms of the study. Interventions with limited interpersonal contact such as provision of computer-tailored feedback through telephone or email; initial one-off face-to-face sessions for the purpose of instructing participants in the use of the technology or data collection (i.e. not for the purposes of behavioural counselling) were included. Interventions that had additional treatment arms such as face-to-face sessions were also included. However, the effects reported in this review are only that of the treatment arm with none or limited interpersonal contact as described above.
Articles identified through the literature search were excluded if they met the following criteria:
Where studies addressed multiple behaviours, only dietary behaviour and change in body mass or weight outcomes and the instruments used to measure these outcomes were considered. Although not the main purpose of this review, when dietary behaviour effects were absent, dietary behaviour mediator outcomes were considered.
The Australian National Public Health Partnership (NPHP) guidelines for evaluating evidence on public health interventions  and previously published reviews [4, 5, 10] were used as a guide to reviewing and summarizing the studies included. Each article was reviewed by two of the authors with the following information extracted and tabulated: intervention context and description, study design and evaluation, outcome measures, findings, strengths and limitations. These two authors independently performed a quality coding assessment of all studies, which consisted of 17 criteria symbolizing the quality of the intervention and the study’s internal and external validity (Table I). The internal validity criteria assessed whether the study was well conducted and the findings valid, whereas the external validity assessed whether the findings were generalizable. The purpose of the validity scores was not to categorize individual studies for comparison, but to provide an illustration of the overall state of the science in this area. These characteristics were adapted from those used in previous reviews [5, 11], the Australian NPHP guidelines for evaluating evidence on public health interventions  and external validity criteria outlined by Glasgow and Emmons . Each criteria had the same value or weighting, the sum of which was used as a validity score, calculated as a percentage of the maximum obtainable score. Ranking disagreements were discussed by all authors until consensus was reached. All authors reviewed both the summarized review of studies and the quality assessment then convened to reach consensus on the strength of evidence.
The initial cross-database literature search yielded 1349 publications. After removing duplicates and reviewing the title and abstract of these publications against the inclusion criteria, the number of eligible published articles was 25. After reviewing the full articles, 16 were excluded for meeting one of the exclusion criteria, leaving nine articles. The search of reference lists of relevant papers, including previous reviews, yielded another three relevant articles. An additional article was included, identified by a colleague and undergoing peer review for journal publication.
There was a total of 12 interventions, evaluated in 13 separate studies which aimed to improve dietary behaviours [18–30] (Table II). Two articles described the post-test  and long-term follow-up  of one intervention programme. Another article described a similar intervention programme that had been trialled within a different setting .
Dietary behaviours targeted included reducing fat consumption, increasing fruit and vegetable consumption or increasing fiber intake. Six articles described multi-component computer-tailored health interventions that targeted both physical activity and dietary behaviours, representing five interventions [18, 19, 21–23, 25]. Three studies also measured weight reduction outcomes [18, 19, 22].
Overall, seven computer-tailored intervention studies reported significant short to medium-term positive between group effects on dietary behaviour outcomes (Table III) [20, 22, 23, 25, 27–29]. The mode of delivery included desktop computer programs [23, 25, 28], the Internet/Intranet [20, 22], telephone  and multi-media .
Of the 10 interventions aimed to reduce fat consumption, eight found positive effects, five of which reported a significant between-group effect on fat intake in favour of the computer-tailored intervention over a control group [20, 25, 27–29]. Three of these reported within-group positive effects on fat intake but no significant between-group effects [18, 19, 30]. The two studies that did not find positive effects on dietary fat intake behaviours found positive between-group effects for mediators such as knowledge, awareness, self-efficacy, stage of change and intention to change [24, 26]. Of the seven studies aiming to increase fruit and vegetable intake, four found positive effects in favour of the computer-tailored intervention over a control group [22, 23, 28, 29]. One found positive between-group effects on vegetable intake mediators, i.e. awareness and intention to change, but not on actual measures of behaviour . Of the four studies aiming to increase fibre intake, three found positive effects in favour of the computer-tailored intervention over a control group [22, 28, 29].
It is worth noting the positive effects on fat intake found for the intervention programme used by Vandelanotte et al.  were maintained at 2-year follow-up; however, there was no control group and a potential dropout bias at the long-term follow-up . The authors of this study noted the limitations of these findings in terms of real-life effectiveness, generalizability and application to practice due to the controlled setting and motivated sample [21, 25]. However, positive effects on fat intake were also reported in an adapted version of the same intervention programme in a real-life setting .
The internal validity scores ranged from 50% to 88%, with an average of 66% for all studies and 70% for those studies reporting significant positive between-group effects on dietary behaviour outcomes (Table III). Of the five studies which had an above average internal validity score (>66%), four reported positive between-group effects on dietary behaviour outcomes, one of which also found positive between-group weight reduction outcomes. Most criteria reflecting the internal validity of studies were met by a majority of studies, with the exception of three internal validity criteria: retention, reporting a rationale for sample size and conducting analyses with consideration for missing data that maintained the fidelity of the randomisation. For example, one study with the lowest internal validity score did not meet any of these three criteria in addition to appropriate randomization . The study with the highest internal validity score met all criteria apart from having equivalent groups at baseline based on ethnicity .
The external validity scores ranged from 33% to 78%, with an average of 52% for all studies and 54% for those studies reporting significant positive between-group effects on dietary behaviour outcomes (Table III). Of the five studies which had an above average external validity score (>52%), four reported positive between-group effects: three for dietary behaviour outcomes and one for weight reduction outcomes. Only a minority of studies met the following external validity criteria: describing the maintenance of long-term post-intervention effects; using representative samples; reporting on intervention costs and reporting on participation or recruitment rates or the similarity and differences between participants to either those who declined participation or the intended target audience. For example, one study with the lowest external validity score did not meet any of these four criteria in addition to insufficient description of the intervention. Two criteria were only partially met: accounting for all participants who entered the trial at its conclusion and describing recruitment methods and/or inclusion and exclusion criteria sufficiently . The study with the highest external validity score met all criteria apart from providing cost information and two criteria were only partially met: reporting exclusion criteria and long-term follow-up effects .
All interventions were classified as second-generation computerized interventions. The majority were delivered using the Internet and/or email [18–20, 22, 24], followed by desktop computer programs [21, 23–25, 28], multi-media (combination of audio, video and graphics) [26, 27, 30] and telephone .
Baseline sample size ranged from 73 to 1071. Eight studies either described dropouts compared with study completers and/or described reasons for dropout [18, 20–24, 28, 30] and only two studies reported a rationale for sample size [22, 23].
The generalizability of findings was a limitation of all studies due to one or more of the following: a small or unrepresentative sample; an unrepresentative target population or the controlled nature of the setting within which the study was conducted. Only four studies reported on the characteristics of participants compared with the target population [20, 22, 28, 30].
The majority of study samples usually consisted of healthy adults recruited through community settings [18, 21, 22, 25, 26, 28, 30], the workplace [19, 20, 24, 27] and primary health care settings [23, 29]. The majority of interventions recruited self-select volunteer individuals [18, 19, 22–30]. Some studies used additional eligibility or exclusion criteria related to medical conditions [22, 25, 29], age [25, 29], gender [26, 30], health behaviour status , medication , body mass index , income  and household characteristics .
The majority of samples were predominately female, well educated and Caucasian. Eleven studies reported a predominately female baseline or follow-up sample [18–22, 25–30], with a median proportion of 72% for all 13 studies. Eight of the 12 studies reporting on education level of their baseline or follow-up sample had a predominately well-educated sample, as determined by level of educational attainment or years of education [18–21, 23, 25, 27, 28], with a median proportion of 67% for all 12 studies. Six of the seven studies reporting on the ethnic racial background of their baseline or follow-up sample had a predominately Caucasian/White sample [18, 19, 26–29], with a median proportion of 81% for all seven studies.
Of the seven computer-tailored studies reporting significant positive between-group effects on dietary behaviour outcomes [20, 22, 23, 25, 27–29] three were single exposure [20, 23, 25] and four involved varied frequencies of multiple exposures, ranging from 12 weeks to 6 months duration [22, 27–29]. Three of these used controlled programme delivery which meant that the information was new at each exposure [22, 28, 29].
Two interventions compared computer-tailored intervention groups which differed in intensity in terms of the number of behaviours targeted, neither of which could report significant differences between such groups [18, 21]. A web-based study comparing computer-tailored intervention groups with the same physical activity and dietary behaviour intervention in addition to personal support  reported that the intervention group receiving the additional social supports had better outcomes. However, both groups had significantly better outcomes than the waitlist control group.
Of the seven computer-tailored intervention studies reporting significant positive between-group effects on dietary behaviour outcomes [20, 22, 23, 25, 27–29], a wide range of theories were used, most commonly the transtheoretical model [20, 25, 27, 29] and social cognitive theory [22, 27–29]. These were also the most commonly used theories overall. Other theories of successful interventions included the theory of planned behaviour [20, 25], the theory of reasoned action , health communication theory  and decision-making theory .
Ten studies isolated the effect of the tailoring by comparing the computer-tailored intervention group to either a no treatment or waiting list control, or a comparison treatment group receiving generic information. Six of these found evidence in favour of the computer-tailored intervention for dietary behaviour outcomes [20, 22, 23, 25, 27, 28], one of which also reported positive between-group effects on weight reduction outcomes .
Of the six studies that isolated the effect of the tailoring and found evidence of a positive effect, all compared participant's behaviour to current recommendations [20, 22, 23, 25, 27, 28]. Half also tailored feedback according to the participant's stage of change [20, 25, 27]. The majority of these studies tailored feedback in more than one way [20, 22, 23, 25, 27]. These tailoring methods were also common for studies overall.
Other ways of tailoring included providing feedback that compared participant's behaviour to the behaviour of peers [23, 24], to previously set goals [18, 22] and tailoring feedback to the participant's self-efficacy, perceived benefits and barriers to behaviour, intentions and attitudes [20, 25].
Only one dietary behaviour study did not indicate the use of valid instruments to measure dietary behavioural outcomes. The most commonly used were food frequency questionnaires [20–22, 24–26, 28–30]. Other instruments included a 24-h dietary recall questionnaire  and a dietary habits questionnaire . Food shopping receipts were also used in two studies [22, 28].
Three studies included weight reduction outcomes, only one of which used objective measures of height, weight and waist circumference taken in a clinic , the remaining two using self-reported measures of weight and/or height [19, 22].
Studies reported retention rates for different timeframes making comparisons difficult. Retention rates were compared by considering post-test retention rates when reported [18, 19, 22, 25, 29], and when not available the earliest post-intervention follow-up retention rate was used as the best approximation, the majority of which were short term (<3 months) [23, 24, 26–28, 30], one medium term (3≤ month ≤6)  and one long term (>6 months) .
Estimated retention rates ranged from 63% to 90%. Five studies had a retention rate >80% [19, 22, 23, 27, 29]. It must be noted that all studies with relatively higher retention rates were actual post-test measurements [19, 22, 29] or estimates based on short-term post-intervention follow-up retention rates [23, 27]. Those studies reporting retention rates <80% were often approximations based on retention rates reported for post-intervention follow-up: short term [24, 26, 30], medium term  and long term,  which may account for the relatively lower rates. Only two of the studies with rates <80% were actual post-test measurements [18, 25].
There were some commonalities between the five studies with relatively high retention rates: all used highly motivated and/or self-select samples; a majority were intended as multiple exposure interventions ranging from 2 to 6 months [19, 22, 27, 29] and a majority offered incentives to participants [19, 22, 23, 27]. Due to the small number of heterogenous studies reviewed, a consistent relationship between retention rates and the intervention mode of delivery, duration or intensity could not be found.
Ten of the studies isolated the effect of the computer-tailored intervention in terms of both the tailoring and the technology effect by comparing to either a no treatment or waiting list control, group or a non-tailored non-technology control group. Six of these found evidence in favour of the computer-tailored intervention on dietary behaviour outcomes [20, 22, 23, 25, 27, 28], one of which also found evidence in favour of the computer-tailored intervention for weight reduction outcomes .
Although many articles referred to the cost effectiveness of computer-tailored interventions [18–20, 25, 27, 29], only one reported on any basic economic measures for their intervention such as costs. This included an indication of the cost of a website-delivered intervention, a face-to-face nutrition counselling intervention and an Internet-based intervention with nutrition counselling . They reported that although the original set-up costs for a website are costly (minimum $20000 AUD), ongoing costs are minimal and additional cost savings may be had by participants due to no travel time or costs.
This narrative systematic review has described the range and quality of evidence on second-generation computer-tailored primary prevention interventions targeting dietary behaviour change in adults. It also describes common characteristics of interventions that produced significant between-group effects and interventions with good retention rates. To our knowledge, previous reviews have not attempted to gauge the external validity of such intervention studies although they have included varying measures of external validity in their quality criteria. Doing so is important in determining their generalizability and relevance to health promotion practice .
The majority of studies that isolated the effect of both the technology and tailoring in their study design reported significant positive outcomes, indicating computer-tailored interventions targeting these behaviours as a promising primary prevention strategy. The efficacy of computer-tailored interventions is dependent on many factors such as the intervention quality, duration, exposure, intensity, use of theory, method of tailoring, source credibility and mode of delivery. The quality, intensity and duration of intervention studies reporting significant positive between-group effects on dietary behaviour outcomes differed widely. However, it appears that tailoring and the use of theory are important factors for success.
Success of the intervention is not dependent on the technology used in its delivery or its intensity. However, this could be due to the small number of heterogeneous studies reviewed and the very small number of studies comparing intervention groups of differing intensity. There seems little evidence that success is more likely in interventions of greater intensity than of lower intensity, and this is the case whether additional support is delivered through the technology or interpersonal communication. Kroeze et al.  reported similar findings. There is insufficient evidence to determine the optimal intensity for computer-tailored interventions generally and the best way of delivering interventions targeting more than one behaviour. Therefore, more research is needed in this area [21, 33].
It has been recommended that studies use a combination of validated self-reports with more objective measures of behaviour change; however, for dietary behaviour change, there is a lack of existing objective measures . Although valid measurement instruments were used, there was a lack of objective outcome measures. Future studies may benefit from collecting objective outcome measures to determine whether the behaviour changes reported are real.
The real-life effectiveness of such interventions is dependent on the setting, the characteristics and representativeness of the targeted and recruited population sample and the methods of recruitment. These factors influence the external validity and generalizability of findings to practice . The external validity of reviewed studies was generally poor, resulting in uncertainty about such interventions’ generalizability This finding is not surprising given the majority of studies were RCTs as such designs aim to maximize internal validity and can sacrifice external validity, with results only generalizable to those participants who are willing to accept randomization . A stronger focus on effectiveness and dissemination may assist in the development of programmes in population-based effectiveness settings. Future RCTs should attempt to increase their external validity by including representative participants and answering real-world questions . This review found such characteristics of design lacking, with the common use of small, homogenous or unrepresentative samples and for some a lack of comparison conditions relevant to real-world decisions. Such characteristics significantly limit the dissemination of such interventions into practice .
Although determining cost effectiveness was not the purpose of this review, it is recommended that future studies at the very least report on basic economic measures such as costs. This information is of great relevance to decision makers and can assist in intervention uptake, dissemination and inform more advanced cost-effectiveness studies [17, 32]. Cost-effectiveness analyses of computer-tailored interventions would also be worthwhile. The potential cost savings gained by participants due to no travel time or costs may be particularly important for those living in rural or isolated areas.
There was a fundamental lack of long-term post-intervention follow-up, with only one study demonstrating that intervention effects were maintained at 2 years post-baseline . However, the generalizability of this study's findings and application to practice may be limited. More studies with long-term follow-up of 12 months post-intervention are needed .
Previously noted poor retention rates of computer-tailored interventions, in particular web-based interventions [4–6, 10], prompted consideration of characteristics of interventions that might maintain engagement and retention. Such characteristics include the intervention's interactivity, duration and intensity, the length of follow-up, setting and sample population characteristics. However, with the small number of studies comparing retention rates became problematic due to their varied follow-up length and therefore we could not form any definite conclusions. Based on the findings of this review and other published reviews [5, 10], it seems the following intervention characteristics may be important in enhancing participant retention: ensuring multiple exposures to the intervention material, preferably using controlled programme delivery; the use of incentives; prompts through another medium; interactive and dynamic web components and individualized tailoring. Each of these characteristics may be insufficient on its own to result in good retention and therefore all will need to be considered in intervention design, sample size calculations and probable retention rates in the future.
The limitations of this review must also be acknowledged. Firstly, this review did not actively seek unpublished studies although one such study was included. Therefore, when considering the findings of this review, the possibility of publication bias should be noted, resulting in a bias of studies with positive findings. However, given the fairly high proportion of published studies reviewed that did not have significant findings, it is believed that the likelihood of publication bias is minimal.
Secondly, this review did not include articles in which dietary behaviour was not a primary outcome. This meant articles were excluded in which psychological indicators, behaviour mediators or process measures were the only outcome measures reported. Process measures were not described, limiting this paper's discussion on retention, engagement and acceptability of computer-tailored interventions and their components in different population subgroups and settings. Although this was not the purpose of the review, reviewing computer-tailored intervention research describing process outcomes would be worthwhile as it may indicate different levels of acceptance and the relative effectiveness in different population subgroups. This may be particularly important given the majority of reviewed studies had predominantly female, Caucasian and well-educated samples.
Thirdly, this review has not attempted to estimate a pooled effect size or to calculate and compare effect sizes of different studies due to the heterogeneity of studies in terms of their intervention design, delivery method, exposure and intensity, participants, study design and methods and outcome measures. Such factors make comparisons difficult  and inadequate , and hence a narrative systematic review was conducted. The two previous reviews on computer-tailored or interactive technology health behaviour interventions most relevant to this review reported small to medium effect sizes [4, 5]. Despite the small effect sizes found, such interventions can have substantial impact at a population health level, with their potential for wide distribution at relatively low cost compared with face-to-face interventions [4, 5, 27]. However, it will be critical to determine whether such findings are generalizable, can be replicated and to ensure adequate reach and engagement within varied population groups for such interventions.
Lastly, the findings on common characteristics of successful interventions and those with good retention are limited due to the small number of heterogeneous studies included and reliance on varying levels of detail provided in each article. Only a small proportion of the retrieved articles were included in this review. The main reasons for this include: many studies were duplicated in the databases that were searched, broad search terms were used and the exclusion criteria were specific and detailed. For example, the search terms did not distinguish between first- and second-generation interventions, and first-generation interventions which make up a substantial proportion of the literature were not considered in this review.
Future research should endeavour to replicate studies in different populations to indicate effectiveness and generalizability. The work of Vandelanotte and colleagues where the same theory-based intervention was trialed and adapted in different population groups and settings and followed up long term [20, 21, 25, 33, 36] is important in building the evidence base. Their reports on the acceptability and feasibility of these interventions in individuals of different age, sex, education level and computer literacy [8, 9] are also valuable.
The evidence of effectiveness for computer-tailored dietary behaviour change interventions is fairly strong and they have the potential to reach large groups of people albeit self-selected groups. The uncertainty lies in whether the reported behaviour changes can be sustained long term and whether they are generalizable. Also, the relative success of different components of efficacious interventions is unclear in addition to the optimal intervention intensity. Interventions should be tailored to the individual and based on theory. To enhance retention, the use of incentives, individualized tailoring, interactive and dynamic components, multiple exposures to the intervention material, preferably using controlled programme delivery, and prompts through another medium should be considered.
Further research will be needed on computer-tailored dietary behaviour primary prevention interventions including: the replication of successful efficacy trials in different settings and population groups; effectiveness studies in representative heterogenous populations; a review of the research on engagement and acceptability of such interventions; long-term post-intervention follow-up studies and cost-effectiveness studies. More research is also needed to determine the optimal intensity for population-level interventions.
Funding to pay the Open Access publication charges for this article was provided by the NSW Department of Health.
The authors would like to thank both the library staff of the New South Wales Department of Health and Ms Elizabeth Develin, Director, Centre for Health Advancement, New South Wales Department of Health.