Effectiveness Review
Analytic Framework
[PDF – 3.1 MB] – see Figure 1 on page 76
When starting an effectiveness review, the systematic review team develops an analytic framework. The analytic framework illustrates how the intervention approach is thought to affect public health. It guides the search for evidence and may be used to summarize the evidence collected. The analytic framework often includes intermediate outcomes, potential effect modifiers, potential harms, and potential additional benefits.
The number of studies and publications do not always correspond (e.g., a publication may include several studies or one study may be explained in several publications).
Effectiveness Review
Goodman RM, Wheeler FC, Lee PR. Evaluation of the Heart To Heart Project: lessons from a community-based chronic disease prevention project. Am J Health Promot 1995;9:443–55.
Jason LA, Greiner BJ, Naylor K, Johnson SP, Van Egeren L. A large-scale, short-term, media-based weight loss program. Am J Health Promot 1991;5:432–7.
Luepker RV, Murray DM, Jacobs DJ, et al. Community education for cardiovascular disease prevention: risk factor changes in the Minnesota Heart Health Program. Am J Public Health 1994;84:1383–93.
Malmgren S, Andersson G. Who were reached by and participated in a one year newspaper health information campaign? Scand J Soc Med 1986;14:133–40.
Meyer AJ. Skills training in a cardiovascular health education campaign. J Consult Clin Psychol 1980;48:129–42.
Osler M, Jespersen NB. The effect of a community-based cardiovascular disease prevention project in a Danish municipality. Dan Med Bull 1993;40:485–9.
Owen N, Lee C, Naccarella L, Haag K. Exercise by mail: a mediated behavior-change program for aerobic exercise. J Sport Psychol 1987;9:346–57.
Tudor-Smith C, Nutbeam D, Moore L, Catford J. Effects of the Heartbeat Wales programme over five years on behavioural risks for cardiovascular disease: quasi-experimental comparison of results from Wales and a matched reference area. BMJ 1998;316(7134):818–22.
Wimbush E, MacGregor A, Fraser E. Impacts of a national mass media campaign on walking in Scotland. Health Promot Internation 1998;13:45–53.
Young DR, Haskell WL, Taylor CB, Fortmann SP. Effect of community health education on physical activity knowledge, attitudes, and behavior. The Stanford Five-City Project. Am J Epidemiol 1996;144:264–74.
Effectiveness Review
The search for evidence started with seven computerized databases (MEDLINE, Sportdiscus, Psychlnfo, Transportation Research Information Services [TRIS], Enviroline, Sociological Abstracts, and Social SciSearch) and included reviews of reference lists and consultations with experts in the field. Studies were eligible for inclusion if they:
- Were published in English during 1980-2000
- Were conducted in an Established Market Economy*
- Assessed a behavioral intervention primarily focused on physical activity
- Were primary investigations of interventions selected for evaluation rather than, for example, guidelines or reviews
- Evaluated outcomes selected for review; and
- Compared outcomes among groups of persons exposed to the intervention with outcomes among groups of persons not exposed or less exposed to the intervention (whether the study design included a concurrent or before-and-after comparison)
* Established Market Economies as defined by the World Bank are Andorra, Australia, Austria, Belgium, Bermuda, Canada, Channel Islands, Denmark, Faeroe Islands, Finland, France, Germany, Gibraltar, Greece, Greenland, Holy See, Iceland, Ireland, Isle of Man, Italy, Japan, Liechtenstein, Luxembourg, Monaco, the Netherlands, New Zealand, Norway, Portugal, San Marino, Spain, St. Pierre and Miquelon, Sweden, Switzerland, the United Kingdom, and the United States.
Economic Review
The databases MEDLINE, Transportation Research Information Services (TRIS), Combined Health Information Database (CHID), ECONLIT, PsychInfo, Sociological Abstracts, Sociofile, Social SciSearch, and Enviroline were searched for the period 1980–2000. In addition, the references listed in all retrieved articles were reviewed and experts were consulted. Most of the included studies were either government reports or were published in journals. To be included in the review a study had to:
- Be a primary study rather than, for example, a guideline or review
- Take place in an Established Market Economy
- Be written in English
- Meet the team’s definitions of the recommended and strongly recommended interventions
- Use economic analytical methods such as cost analysis, cost-effectiveness analysis, cost-utility, or cost-benefit analysis; and
- Itemize program costs and costs of illness or injury averted