CES Ontario is proud to partner with expert evaluators in presenting a wide variety of evaluation topics. For current Intermediate and Advanced Workshops and Courses, please check our Upcoming Workshops page, or navigate the dropdown menu under Professional Development.
Please contact us if you have any questions about past Workshops and Courses.
Evaluation By Design
Facilitator: Dr. Cameron Norman
March 22, 2021
What if we viewed evaluation as a service as well as a means of assessing value and supporting decision-making? A design-driven approach to evaluation is one that brings insights from service design into the practice of evaluation by integrating creativity, craft, and empathy with data-gathering, feedback, and sensemaking into the evaluator’s role. This approach, which brings together design thinking and evaluative thinking, explores ways to embed evaluation into a program’s development structure, particularly for those that are operating in domains of high complexity and need for innovation. Design-driven evaluation is an approach, drawing on utilization-focused, developmental, and participatory evaluation methods and techniques and brings them together with the creative problem orientation, interactivity, and end-user focus from the world of professional design.
This workshop will introduce evaluators to the fundamentals of a design-driven approach to evaluation. It will orient evaluators to the role that design can play in shaping both the evaluation and the program itself and is suited for those interested in expanding their practice, working more closely with innovative or complex programs and for those interested in developmental evaluation. The workshop will introduce design theory and methods, involve interactive activities aimed at illustrating design thinking in practice in ways that can be used both in-person and at distance, and how evaluators can play a pivotal role in supporting product, program, and service innovation in new ways.
Developmental Evaluation in Action: Facilitating Social Innovation in Real-Time
Facilitators: Dr. Keiko Kuji-Shikatani, Dr. Wendy Rowe, and Megan Borner
January 29-30, 2020
Hart House, University of Toronto, Toronto
November 28 and December 4-5, 2018
Bond Place Hotel, Toronto
November 13 and 15-16, 2017
Bond Place Hotel, Toronto
This blended course provides participants with introductory knowledge in the fundamentals of Developmental Evaluation (DE) and its implementation, including the role and use of the Theory of Change/Action.
The course is focused on how developmental evaluators track, document, and help interpret the nature and implications of innovations and adaptations as they unfold, and help extract lessons and insights from both processes and outcomes to inform the ongoing adaptive innovative process. (Patton, McKegg, & Wehipeihana, 2015)
Situational analysis and case studies will be used to authenticate the information being presented in order to equip evaluators with the practical application of DE within the complex, dynamic environments they may experience in their work.
Throughout the course participants will be invited to apply their learning to the programs/ evaluation activities in which they are involved.
The course will consist of a webinar and in-person session. An optional one-hour group consultation is offered to those participants wishing to present and discuss questions or issues concerning implementation of DE they may have.
Performance Measurement: From Theory to Practice
Facilitator: Dr. Paul Favaro
September 16-17, 2019
(Rescheduled from June 20-21, 2019)
Oakham House, Ryerson University
The overall purpose of this two day intermediate to advanced level workshop is to focus on how performance measurement frameworks are built, their technical properties, and on how they add value to organizational decision-making. The challenges and limitations of developing performance measurement systems will also be emphasized. The workshop will present current approaches and research based practices in the performance measurement field. It is designed to bring your measures to life and to make performance measurement about transformation and not just about accountability.
The workshop format utilizes formal presentations, interactive exercises, discussions, small group activities, and case studies. Emphasis is placed on the relevance, utility, technical, and practical application of performance measurement. Participants will have an opportunity to apply the theory learned.
The workshop is designed for individuals working in program evaluation, performance measurement, program managers, funders, board of directors. It is designed for both government and not-for-profit/human service delivery sectors.
By the end of the workshop, you should have:
- A consistent approach to measuring organizational performance
- Use of common performance measurement language in your organization
- A specific set of criteria for determining effective performance indicators
- A set of indicators to track efficiency (outputs) & effectiveness (outcomes)
- A set of data collection methods for your performance indicator system
- A framework for developing performance measurement reports/dashboards
- An initial set of appropriate performance targets/expectations
- A positive culture for the use & development of performance measurement
CES Competencies Presented In Workshop:
This workshop aims to strengthen capacities in line with the following Competencies for Canadian Evaluation Practice:
1.1 Knows evaluation theories, models & tools and is informed about new thinking and best practices;
1.7 Uses self-awareness and reflective thinking to continuously improve practice
2.6 Uses appropriate evaluation methods;
2.7 Identifies data requirements and data collection tools;
2.7 Produces balanced evaluation reporting to support decision-making and learning
3.4 Promotes usefulness of evaluation process and results
4.2 Defines work parameters, plans, and agreements;
5.4 Uses a variety of processes that result in negotiated agreements and understandings.
Strategic Project Management for Evaluators
Facilitator: Alison Paprica
October 7, 2020
October 12, 2018
Bond Place Hotel, Toronto
April 6, 2017
Bond Place Hotel, Toronto
The sheer number of tools and processes in the Project Management Body of Knowledge (PMBOK® Guide) can make it challenging for evaluators to know which tools to apply, and when. This workshop provides theory and hands-on experience applying four PMBOK® derived light-touch project management tools that have been tailored for evaluation projects. All tools can be applied using the standard Microsoft Office suite of applications.
Participants will work with two case studies used to illustrate project management in practice, with time for participants to share their own learnings and experiences. The workshop concludes with a facilitated session using a modified version of the PMBOK® risk management processes to help participants identify, and begin to develop mitigation strategies for, the risks most likely to affect evaluation projects. The course will enhance participant knowledge and application of project management tools and processes that have been tailored for evaluators, with a focus on:
- Understanding the project management mindset of “define then deliver”
- Hands-on experience applying light-touch project management tools and processes; specifically:
- Work breakdown structure
- Deliverable-based Gantt chart schedule
- Deliverable-based budget
- Deliverable-based project tracking and reporting
- Sharing experience and knowledge on the topic of common risks for evaluation projects
This course presupposes a basic understanding of evaluation theory and practice, and is best suited for those with a firm grounding in its evaluation concepts.
Beyond Boxes – Black, Mystery and Magic – Understand and Use the Theory of Change for Your Programs
Facilitators: Jennifer Yessis and Kelly Skinner
March 9-10, 2017
Centre for Social Innovation – Regent Park, Toronto
Theory of Change describes the theory (or set of assumptions) that explain the steps that lead to the long-term goal of interest and the connections between program activities and outcomes.
This advanced two-day workshop will describe concepts related to theory of change, and apply the concepts discussed to enable participants to develop program theory including theory of change and action.
The concept of contribution analysis will be described in day two, and applied to the theory of change example. Participants will be engaged throughout the two-day workshop in interactive activities for an active learning experience.
At the end of the workshop, participants will be able to:
- Describe and explain what a program theory is, and how this relates to theory of change and theory of action
- Describe how theories of change go beyond logic models
- Describe how theories of change can contribute to a contribution analysis
- Apply the theoretical concepts shared to develop a program theory for a relevant program including a theory of change and theory of action