Program evaluation toolkit

A Summary of

The Provincial Centre of Excellence for Child and Youth Mental Health at CHEO. (2013). Program Evaluation Toolkit. Ottawa, ON. Retrieved from: http://www.excellenceforchildandyouth.ca/sites/default/files/docs/program-evaluation-toolkit.pdf

Description

This toolkit outlines a three-phase process for planning, doing, and using a program evaluation. With itemized lists and steps, along with templates and worksheets, this workbook is a useful tool for evaluating public health initiative.

Program evaluation is the systematic gathering, analysis and reporting of data about a program to assist in decision making. Process evaluation seeks to describe the program and determine if the program is being implemented as intended. Outcome evaluation assesses the impact of the program for the intended population, the organization and others.

The Guiding Principles for Evaluation in Ontario Health Units outline when, how and why evaluations should be conducted and who should be involved. These principles stress: integration of program planning and evaluation; the necessity for a clear description of the program; the importance of tying the purpose of the evaluation to specific decision-making needs; the need to ask specific evaluation questions; ethical conduct; use of systematic methods; clear and accurate reporting; timely and widespread dissemination; a multidisciplinary team approach; stakeholder involvement; and use of evaluation findings.

Access the Tool

Format of the Tool


Language(s)

Not specified

Format(s)

Not specified

Cost

Not Specified

Using the Tool


Time for Participation/Completion

More than 8 hours

The toolkit will likely require more than 8 hours to complete. Planning and conducting an evaluation requires a significant commitment of personnel, time and resources, which is dependent on the scope of the initiative being evaluated. Program evaluations typically take 6 months to complete.

Additional Resources and/or Skills Needed for Implementation

Implementing this tool requires expertise in program evaluation, research methods and statistical analysis.

Steps for Using Method/Tool

The toolkit outlines a three-phase process for conducting a program evaluation.

Phase 1: Planning Evaluation - Deciding on program to be evaluated and describing this program

Phase 2: Doing Evaluation - Data collection and analysis

Phase 3: Using Evaluation - Putting knowledge into practice

Who is involved

Research and evaluation specialists and project specialists would be required to plan and conduct the evaluation, access data sources and analyze data on an ongoing basis.

Conditions for Use

Not specified

Evaluation of the Tool


Evaluation

Information not available

Validity

Not applicable

Reliability

Not applicable

Methodological Rating

Unknown/No evidence

Development of the Tool


Developer(s)

Ontario Centre of Excellence for Child and Youth Mental Health
Website: http://www.excellenceforchildandyouth.ca

Method of Development

This toolkit is one of three resources produced by the Ontario Centre of Excellence for Child and Youth Mental Health (CHEO) within the Centre's Knowledge Exchange division. The Centre has developed this series of toolkits to facilitate access to the best available evidence for practice.

Release Date

2007

Contact Person/Source

Evangeline Danesco
The Ontario Centre of Excellence for Child and Youth Mental Health (CHEO)
695 Industrial Avenue
Ottawa, ON K1G 0Z1
Phone: (613) 737-2297
E-mail: edanesco@cheo.on.ca

These summaries are written by the NCCMT to condense and to provide an overview of the resources listed in the Registry of Methods and Tools and to give suggestions for their use in a public health context. For more information on individual methods and tools included in the review, please consult the authors/developers of the original resources.

Have you used this resource? Share your story!