Our approach to strategy evaluation assesses the contribution of each intervention to overall Strategy goals. This approach, which has been referred to as intervention path contribution analysis, examines an intervention’s progress along evidence-based paths expected to lead to desired Strategy outcomes.
The starting point for this analysis is path logic models, which lay out:
- Smoke-Free Ontario Strategy infrastructure and interventions
- Paths through which the interventions work to achieve short, intermediate, and long-term outcomes. The paths typically include changing knowledge/awareness, social climate, social exposure, and access and availability
Evaluative information about the activities and results of the Smoke-Free Ontario Strategy (SFOS) are reported in an Annual Strategy Evaluation Report that:
- Describes Strategy infrastructure and interventions (policies, programs and social marketing)
- Analyzes population-level changes
- Explores the reach and effects of interventions
The Annual Strategy Evaluation Report is informed by population surveillance of key tobacco control indicators—such as tobacco use, quitting behaviour, exposure to secondhand smoke—obtained from provincial and national surveys including:
- Centre for Addiction and Mental Health Monitor
- Ontario Student Drug Use and Health Survey
- Ontario Tobacco Survey
- Youth Smoking Survey
- Canadian Tobacco Use Monitoring Survey
- Canadian Community Health Survey
Project evaluations, performance data and annual reports from SFO funded organizations are used to document program reach and effectiveness. The 2012 report (available this Fall), include several new sections including:
- Indicators on pro-tobacco influences
- The latest public opinion on a variety of topics
- New data that characterize youth, young adult and adults by prevalence of tobacco use, other chronic disease risk factors, and social determinants of health.
Each year, OTRU conducts evaluation research on a select number of topics—including youth engagement, enforcement activity, and cessation initiatives, to inform Ontario’s Smoke-Free Ontario Strategy. Current projects assessing the contributions of individual Smoke-Free Ontario Strategy interventions to the overall Strategy goals include evaluations of initiatives in the goal areas of cessation, prevention and protection.
Tobacco Informatics Monitoring System (TIMS)
TIMS is an innovative web-based application designed to provide easy access to reliable, up-to-date data on key tobacco control indicators including those related to tobacco use, cessation, prevention, protection, public opinion, and tobacco industry denormalization.
More evaluation projects related to the Ontario Strategy are under way:
Modelling Intervention and Strategy Effects
Focus Area: Modelling
Development of a model to simulate the effects of tobacco control interventions on initiation, consumption, quitting and possibly on morbidity and mortality in Ontario.
Survey of Public Health Unit Tobacco Control Activity
Focus Area: Public Health Units
A cross-sectional survey of current tobacco control activities by Public Health Units using the Comprehensive Local Tobacco Control Index (CLTCI).
We also apply our evaluation expertise to projects in other jurisdictions.
Learning How Comprehensive Tobacco Control Strategies Work in Practice
Focus Areas: MPOWER, World Health Organization
An evaluation of the progress in MPOWER implementation and in achieving declines in tobacco use, and a study of different configurations of MPOWER implementation (scope, intensity, duration) are associated with successful outcomes.
Performance Measurement and Evaluation Services for the Saskatchewan Tobacco Strategy
Focus Area: Saskatchewan
A multi‐faceted evaluation of the contribution of particular tobacco control activities and focus areas towards achieving desired initial, intermediate and long‐term outcomes of the Strategy on reducing tobacco use in Saskatchewan.