Program evaluation toolkit

A Summary of

The Provincial Centre of Excellence for Child and Youth Mental Health at CHEO. (2013). Program Evaluation Toolkit. Ottawa, ON. Retrieved from: http://www.excellenceforchildandyouth.ca/sites/default/files/docs/program-evaluation-toolkit.pdf

Relevance for Public Health

This toolkit will be helpful for planning and conducting an evaluation of a public health program or policy.

Description

This toolkit outlines a three-phase process for planning, doing, and using a program evaluation. With itemized lists and steps, along with templates and worksheets, this workbook is a useful tool for evaluating public health initiative.

Program evaluation is the systematic gathering, analysis and reporting of data about a program to assist in decision making. Process evaluation seeks to describe the program and determine if the program is being implemented as intended. Outcome evaluation assesses the impact of the program for the intended population, the organization and others.

The Guiding Principles for Evaluation in Ontario Health Units outline when, how and why evaluations should be conducted and who should be involved. These principles stress: integration of program planning and evaluation; the necessity for a clear description of the program; the importance of tying the purpose of the evaluation to specific decision-making needs; the need to ask specific evaluation questions; ethical conduct; use of systematic methods; clear and accurate reporting; timely and widespread dissemination; a multidisciplinary team approach; stakeholder involvement; and use of evaluation findings.

Accessing the Method/Tool


Language(s)

Not specified

Format(s)

Not specified

Cost

Not Specified

Implementing the Method/Tool


Time for Participation/Completion

More than 8 hours

The toolkit will likely require more than 8 hours to complete. Planning and conducting an evaluation requires a significant commitment of personnel, time and resources, which is dependent on the scope of the initiative being evaluated. Program evaluations typically take 6 months to complete.

Additional Resources and/or Skills Needed for Implementation

Implementing this tool requires expertise in program evaluation, research methods and statistical analysis.

Steps for Using Method/Tool

The toolkit outlines a three-phase process for conducting a program evaluation.

Phase 1: Planning Evaluation - Deciding on program to be evaluated and describing this program

Phase 2: Doing Evaluation - Data collection and analysis

Phase 3: Using Evaluation - Putting knowledge into practice

Who is involved

Research and evaluation specialists and project specialists would be required to plan and conduct the evaluation, access data sources and analyze data on an ongoing basis.

Conditions for Use

Not specified

Evaluation and Measurement Characteristics


Evaluation

Information not available

Validity

Not applicable

Reliability

Not applicable

Methodological Rating

Unknown/No evidence

Method/Tool Development


Developer(s)

Ontario Centre of Excellence for Child and Youth Mental Health
Website: http://www.excellenceforchildandyouth.ca

Method of Development

This toolkit is one of three resources produced by the Ontario Centre of Excellence for Child and Youth Mental Health (CHEO) within the Centre's Knowledge Exchange division. The Centre has developed this series of toolkits to facilitate access to the best available evidence for practice.

Release Date

2007

Contact Person/Source

Evangeline Danesco
The Ontario Centre of Excellence for Child and Youth Mental Health (CHEO)
695 Industrial Avenue
Ottawa, ON K1G 0Z1
Phone: (613) 737-2297
E-mail: edanesco@cheo.on.ca

These summaries are written by the NCCMT to condense and to provide an overview of the resources listed in the Registry of Methods and Tools and to give suggestions for their use in a public health context. For more information on individual methods and tools included in the review, please consult the authors/developers of the original resources.

Resources

Title of Primary Resource Program Evaluation Toolkit
File Attachment None
Web-link
Reference

The Provincial Centre of Excellence for Child and Youth Mental Health at CHEO. (2013). Program Evaluation Toolkit. Ottawa, ON. Retrieved from: http://www.excellenceforchildandyouth.ca/sites/default/files/docs/program-evaluation-toolkit.pdf

Type of Material Resource
Format On-line Access
Cost to Access None.
Language English, French
Conditions for Use Copyright © 2007 Creative Commons Attribution-NonCommerical-NoDerivs 2.5 License
Title of Supplementary Resource Enhancing managers' evaluation capacity: A case study from Ontario public health.
File Attachment None
Web-link
Reference Porteous, N. L., Sheldrick, B. J., & Stewart, P. J. (1999). Enhancing managers' evaluation capacity: A case study from Ontario public health. The Canadian Journal of Program Evaluation, 14 (Special Issue), 137-154.
Type of Material Journal article
Format Periodical
Cost to Access Journal article purchase
Language English
Conditions for Use Copyright © 1999 Canadian Evaluation Society
Title of Supplementary Resource Introducing program teams to logic models: Facilitating the learning process.
File Attachment None
Web-link
Reference Porteous, N. L., Sheldrick, B. J., & Stewart, P. J. (2002). Introducing program teams to logic models: Facilitating the learning process. The Canadian Journal of Program Evaluation, 17(3), 113-141.
Type of Material Journal article
Format Periodical
Cost to Access Journal article purchase
Language English
Conditions for Use Copyright © 2002 Canadian Evaluation Society
Title of Supplementary Resource The logic model: A blueprint for describing programs.
File Attachment None
Web-link
Reference Porteous, N. L., Sheldrick, B. J., & Stewart, P. J. (1997). The logic model: A blueprint for describing programs. Ottawa, ON: Ottawa-Carleton Health Department.

Type of Material Resource
Format On-line Access
Cost to Access None.
Language English, French
Conditions for Use Not specified
Title of Supplementary Resource Program Evaluation Tool Kit
File Attachment None
Web-link
Reference

Porteous, N. L., Sheldrick, B. J., Stewart, P. J. (1997). Program Evaluation Tool Kit: A blueprint for public health management. Ottawa, ON: Ottawa-Carleton Health Department, Public Health Research, Education and Development Program and the Ontario Ministry of Health, Public Health Branch.

Type of Material Resource
Format On-line Access
Cost to Access None.
Language English, French
Conditions for Use Not specified

Have you used this resource? Share your story!