The Provincial Centre of Excellence for Child and Youth Mental Health at CHEO. (2013). Program Evaluation Toolkit. Ottawa, ON. Retrieved from: http://www.excellenceforchildandyouth.ca/sites/default/files/docs/program-evaluation-toolkit.pdf
Relevance for Public Health
This toolkit will be helpful for planning and conducting an evaluation of a public health program or policy.
This toolkit outlines a three-phase process for planning, doing, and using a program evaluation. With itemized lists and steps, along with templates and worksheets, this workbook is a useful tool for evaluating public health initiative.
Program evaluation is the systematic gathering, analysis and reporting of data about a program to assist in decision making. Process evaluation seeks to describe the program and determine if the program is being implemented as intended. Outcome evaluation assesses the impact of the program for the intended population, the organization and others.
The Guiding Principles for Evaluation in Ontario Health Units outline when, how and why evaluations should be conducted and who should be involved. These principles stress: integration of program planning and evaluation; the necessity for a clear description of the program; the importance of tying the purpose of the evaluation to specific decision-making needs; the need to ask specific evaluation questions; ethical conduct; use of systematic methods; clear and accurate reporting; timely and widespread dissemination; a multidisciplinary team approach; stakeholder involvement; and use of evaluation findings.
Accessing the Method/Tool
Implementing the Method/Tool
Time for Participation/Completion
More than 8 hours
The toolkit will likely require more than 8 hours to complete. Planning and conducting an evaluation requires a significant commitment of personnel, time and resources, which is dependent on the scope of the initiative being evaluated. Program evaluations typically take 6 months to complete.
Additional Resources and/or Skills Needed for Implementation
Implementing this tool requires expertise in program evaluation, research methods and statistical analysis.
Steps for Using Method/Tool
The toolkit outlines a three-phase process for conducting a program evaluation.
Phase 1: Planning Evaluation - Deciding on program to be evaluated and describing this program
Phase 2: Doing Evaluation - Data collection and analysis
Phase 3: Using Evaluation - Putting knowledge into practice
Who is involved
Research and evaluation specialists and project specialists would be required to plan and conduct the evaluation, access data sources and analyze data on an ongoing basis.
Conditions for Use
Evaluation and Measurement Characteristics
Information not available
Ontario Centre of Excellence for Child and Youth Mental Health
Method of Development
This toolkit is one of three resources produced by the Ontario Centre of Excellence for Child and Youth Mental Health (CHEO) within the Centre's Knowledge Exchange division. The Centre has developed this series of toolkits to facilitate access to the best available evidence for practice.
The Ontario Centre of Excellence for Child and Youth Mental Health (CHEO)
695 Industrial Avenue
Ottawa, ON K1G 0Z1
Phone: (613) 737-2297
These summaries are written by the NCCMT to condense and to provide an overview of the resources listed in the Registry of Methods and Tools and to give suggestions for their use in a public health context. For more information on individual methods and tools included in the review, please consult the authors/developers of the original resources.