Strategy Evaluation

Strategy Evaluation

Our approach to strategy evaluation assesses the contribution of each intervention to overall Strategy goals. This approach, which has been referred to as intervention path contribution analysis, examines an intervention’s progress along evidence-based paths expected to lead to desired Strategy outcomes.

The starting point for this analysis is path logic models, which lay out:

  • Smoke-Free Ontario Strategy infrastructure and interventions
  • Paths through which the interventions work to achieve short, intermediate, and long-term outcomes. The paths typically include changing knowledge/awareness, social climate, social exposure, and access and availability

Evaluative information about the activities and results of the Smoke-Free Ontario Strategy (SFOS) are reported in an Annual Strategy Evaluation Report that:

  • Describes Strategy infrastructure and interventions (policies, programs and social marketing)
  • Analyzes population-level changes
  • Explores the reach and effects of interventions

The Annual Strategy Evaluation Report is informed by population surveillance of key tobacco control indicators—such as tobacco use, quitting behaviour, exposure to secondhand smoke—obtained from provincial and national surveys including:

  • Centre for Addiction and Mental Health Monitor
  • Ontario Student Drug Use and Health Survey
  • Ontario Tobacco Survey
  • Youth Smoking Survey
  • Canadian Tobacco Use Monitoring Survey
  • Canadian Community Health Survey

Project evaluations, performance data and annual reports from SFO funded organizations are used to document program reach and effectiveness. The 2012 report (available this Fall), include several new sections including:

  • Indicators on pro-tobacco influences
  • The latest public opinion on a variety of topics
  • New data that characterize youth, young adult and adults by prevalence of tobacco use, other chronic disease risk factors, and social determinants of health.

Click here for all Strategy Evaluation Reports

Evaluation Projects

Each year, OTRU conducts evaluation research on a select number of topics—including youth engagement, enforcement activity, and cessation initiatives, to inform Ontario’s Smoke-Free Ontario Strategy. Current projects assessing the contributions of individual Smoke-Free Ontario Strategy interventions to the overall Strategy goals include evaluations of initiatives in the goal areas of cessation, prevention and protection.

Tobacco Informatics Monitoring System (TIMS)

TIMS is an innovative web-based application designed to provide easy access to reliable, up-to-date data on key tobacco control indicators including those related to tobacco use, cessation, prevention, protection, public opinion, and tobacco industry denormalization.

To learn more about TIMS, please visit the TIMS homepage or go straight to the TIMS data portal to run queries and obtain data.

More evaluation projects related to the Ontario Strategy are under way:

Modelling Intervention and Strategy Effects

Focus Area: Modelling

Development of a model to simulate the effects of tobacco control interventions on initiation, consumption, quitting and possibly on morbidity and mortality in Ontario.

Survey of Public Health Unit Tobacco Control Activity

Focus Area: Public Health Units

A cross-sectional survey of current tobacco control activities by Public Health Units using the Comprehensive Local Tobacco Control Index (CLTCI).

We also apply our evaluation expertise to projects in other jurisdictions.

Learning How Comprehensive Tobacco Control Strategies Work in Practice

Focus Areas: MPOWER, World Health Organization

An evaluation of the progress in MPOWER implementation and in achieving declines in tobacco use, and a study of different configurations of MPOWER implementation (scope, intensity, duration) are associated with successful outcomes.

Performance Measurement and Evaluation Services for the Saskatchewan Tobacco Strategy

Focus Area: Saskatchewan

A multi‐faceted evaluation of the contribution of particular tobacco control activities and focus areas towards achieving desired initial, intermediate and long‐term outcomes of the Strategy on reducing tobacco use in Saskatchewan.