CES Ontario is proud to partner with expert evaluators in presenting a wide variety of evaluation topics. For current Intermediate and Advanced Workshops and Courses, please check our Upcoming Workshops page, or navigate the dropdown menu under Professional Development.
Please contact us if you have any questions about past Workshops and Courses.
Past Events:
Rapid Impact Evaluation
Facilitator: Andy Rowe
October 18-29, 2021
Online
Rapid Impact Evaluation offers the ability to evaluate the impacts of a program using developmental and formative evaluation as well as summative. RIE triangulates perspectives of three separate groups of experts. Three methodologies that are central to RIE will provide learners with an understanding to apply RIE. RIE is a cost-efficient and quick approach to assessing impacts and does not intrude on design or implementation of the program. Evaluation learners will benefit when they add RIE to their toolbox of evaluation methods.
Participants will have virtual hands-on interactive learning opportunities across multiple sessions that are comprised of three 3-hour learning modules and optional two 2-hour learning labs and one final session for questions and discussions about applications. The labs will offer the opportunity to applying the method using real-world cases using RIE methods learned in the modules. Professionals who participate in RIE will:
- Develop an understanding of principles of RIE and the methods specific to RIE and CE designation credentials.
Evaluation learners and those interested in evaluation methods can benefit from this learning opportunity on a leading example of the trend towards more nimble evaluation methods. No prerequisite of skills/knowledge are needed to fully engage in this learning opportunity except your passion for evaluation.
Designing Interactive Dashboards
Facilitators: Shelley Engelman and Tom Withee
October 4-6, 2021
Online
Creating dynamic dashboards in Microsoft Excel and Google Sheets is a fantastic and cost-effective way to view important data with minimal construction time. This workshop takes you through all you need to know to design interactive dashboards from start to finish. This skill-building workshop will demonstrate how to generate an interactive dashboard in 5 easy-to-learn steps: Pivot, Analyze, Rename, Chart, and Slice. Using sample survey data, you will learn how to a) use a Pivot table to analyze data, b) create a chart using PivotCharts, c) incorporate Slicers and d) create a professional looking dashboard that allows stakeholders to slice-and-dice the data in seconds. Additionally, we will share best practices in dashboard design to make your dashboards really pop! Finally, we will demonstrate how to incorporate inferential statistics (e.g., paired samples t-test) into your dashboards that will update as you slice-and-dice your data. After attending the workshop, you will be equipped with clear steps that you can immediately implement to create stunning dashboards that are dynamic and easy to reproduce.
This skill-building workshop is aligned to the following CES competencies:
- 1.1- This workshop explores new thinking and practices related to interactive dashboards;
- 2.8- This workshop will give participants accessible tools and process to help them interpret and present their data;
- 2.10- By allowing evaluators and stakeholders the ability to interact with data, interactive dashboards promote complete and balanced evaluation reporting to support decision-making; and,
- 3.4- Interactive dashboards are an efficient way for evaluators and stakeholders to understand results in real-time.
Evaluation learners and those interested in evaluation digital tools can benefit from this learning experience. Learners will need access to their own Microsoft Excel and Google Sheet to fully engage with the content of this workshop as well as a passion for learning new ways of mobilizing data for knowledge sharing.
Feminist Principles in MEAL
Facilitator: Dr. Anna Du Vent
September 29, 2021
Online
This workshop will guide participants through Oxfam Canada’s Seven Foundations to Feminist Monitoring, Evaluation, Accountability and Learning (MEAL). Oxfam’s feminist approach challenges practitioners to think differently about evidence, push the boundaries on data collection, and question who gives meaning and power to knowledge. Through these challenges, participants will engage in an iterative process of applying and reflecting the principles of the approach.
This workshop will introduce the seven foundations, grounded in three recent Oxfam project examples including the following projects:
• The mid-term evaluation of a six-country project, which integrated a participatory, peer-to-peer approach, co-designed by project partners.
• Women’s Voice and Leadership – Pakistan, including local women’s rights organizations, Oxfam in Pakistan (OiP), and Oxfam Canada.
Participants will have the opportunity to ‘deep dive’ into the three project examples with country-based staff and partners leading discussions in breakout rooms.
Methodologies that can be incorporated into feminist MEAL approaches will be shared and participants will have the opportunity to experience at least one of these methodologies.
Principles-Focused Evalution
Facilitator: Paul Bakker
April 7, 2021
Online
Principles help organizations adhere to values and beliefs, and helps them be effective; especially when dealing with complex issues.
This workshop will enable participants to understand how and when using a principles-focused evaluation design will have the most impact.
After the workshop participants will:
- be able to identify when a principles-focused evaluation methodology could be used.
- have a framework to help them to assess and/or develop quality effectiveness principles.
- develop a principles-focused evaluation plan specific to their interests.
The workshop will include the review of Michael Quinn-Patton’s GUIDE framework for assessing quality effectiveness principles as well as small group and practical application of what is learned by designing a plan to answer principles-focused evaluation questions.
The workshop will be most useful to those familiar with evaluation basics, whose work is guided by principles, or who address complex issues.
Evaluation By Design
Facilitator: Dr. Cameron Norman
March 22, 2021
Online
What if we viewed evaluation as a service as well as a means of assessing value and supporting decision-making? A design-driven approach to evaluation is one that brings insights from service design into the practice of evaluation by integrating creativity, craft, and empathy with data-gathering, feedback, and sensemaking into the evaluator’s role. This approach, which brings together design thinking and evaluative thinking, explores ways to embed evaluation into a program’s development structure, particularly for those that are operating in domains of high complexity and need for innovation. Design-driven evaluation is an approach, drawing on utilization-focused, developmental, and participatory evaluation methods and techniques and brings them together with the creative problem orientation, interactivity, and end-user focus from the world of professional design.
This workshop will introduce evaluators to the fundamentals of a design-driven approach to evaluation. It will orient evaluators to the role that design can play in shaping both the evaluation and the program itself and is suited for those interested in expanding their practice, working more closely with innovative or complex programs and for those interested in developmental evaluation. The workshop will introduce design theory and methods, involve interactive activities aimed at illustrating design thinking in practice in ways that can be used both in-person and at distance, and how evaluators can play a pivotal role in supporting product, program, and service innovation in new ways.
Developmental Evaluation in Action: Facilitating Social Innovation in Real-Time
Facilitators: Dr. Keiko Kuji-Shikatani, Dr. Wendy Rowe, and Megan Borner
January 29-30, 2020
Hart House, University of Toronto, Toronto
November 28 and December 4-5, 2018
Bond Place Hotel, Toronto
November 13 and 15-16, 2017
Bond Place Hotel, Toronto
This blended course provides participants with introductory knowledge in the fundamentals of Developmental Evaluation (DE) and its implementation, including the role and use of the Theory of Change/Action.
The course is focused on how developmental evaluators track, document, and help interpret the nature and implications of innovations and adaptations as they unfold, and help extract lessons and insights from both processes and outcomes to inform the ongoing adaptive innovative process. (Patton, McKegg, & Wehipeihana, 2015)
Situational analysis and case studies will be used to authenticate the information being presented in order to equip evaluators with the practical application of DE within the complex, dynamic environments they may experience in their work.
Throughout the course participants will be invited to apply their learning to the programs/ evaluation activities in which they are involved.
The course will consist of a webinar and in-person session. An optional one-hour group consultation is offered to those participants wishing to present and discuss questions or issues concerning implementation of DE they may have.
Performance Measurement: From Theory to Practice
Facilitator: Dr. Paul Favaro
September 16-17, 2019
(Rescheduled from June 20-21, 2019)
Oakham House, Ryerson University
The overall purpose of this two day intermediate to advanced level workshop is to focus on how performance measurement frameworks are built, their technical properties, and on how they add value to organizational decision-making. The challenges and limitations of developing performance measurement systems will also be emphasized. The workshop will present current approaches and research based practices in the performance measurement field. It is designed to bring your measures to life and to make performance measurement about transformation and not just about accountability.
The workshop format utilizes formal presentations, interactive exercises, discussions, small group activities, and case studies. Emphasis is placed on the relevance, utility, technical, and practical application of performance measurement. Participants will have an opportunity to apply the theory learned.
The workshop is designed for individuals working in program evaluation, performance measurement, program managers, funders, board of directors. It is designed for both government and not-for-profit/human service delivery sectors.
Learning Objectives:
By the end of the workshop, you should have:
- A consistent approach to measuring organizational performance
- Use of common performance measurement language in your organization
- A specific set of criteria for determining effective performance indicators
- A set of indicators to track efficiency (outputs) & effectiveness (outcomes)
- A set of data collection methods for your performance indicator system
- A framework for developing performance measurement reports/dashboards
- An initial set of appropriate performance targets/expectations
- A positive culture for the use & development of performance measurement
CES Competencies Presented In Workshop:
This workshop aims to strengthen capacities in line with the following Competencies for Canadian Evaluation Practice:
Reflective Practice
1.1 Knows evaluation theories, models & tools and is informed about new thinking and best practices;
1.7 Uses self-awareness and reflective thinking to continuously improve practice
Technical Practice
2.6 Uses appropriate evaluation methods;
2.7 Identifies data requirements and data collection tools;
2.7 Produces balanced evaluation reporting to support decision-making and learning
Situational Practice
3.4 Promotes usefulness of evaluation process and results
Management Practices
4.2 Defines work parameters, plans, and agreements;
Interpersonal Practice
5.4 Uses a variety of processes that result in negotiated agreements and understandings.
Strategic Project Management for Evaluators
Facilitator: Alison Paprica
October 7, 2020
Online
October 12, 2018
Bond Place Hotel, Toronto
April 6, 2017
Bond Place Hotel, Toronto
The sheer number of tools and processes in the Project Management Body of Knowledge (PMBOK® Guide) can make it challenging for evaluators to know which tools to apply, and when. This workshop provides theory and hands-on experience applying four PMBOK® derived light-touch project management tools that have been tailored for evaluation projects. All tools can be applied using the standard Microsoft Office suite of applications.
Participants will work with two case studies used to illustrate project management in practice, with time for participants to share their own learnings and experiences. The workshop concludes with a facilitated session using a modified version of the PMBOK® risk management processes to help participants identify, and begin to develop mitigation strategies for, the risks most likely to affect evaluation projects. The course will enhance participant knowledge and application of project management tools and processes that have been tailored for evaluators, with a focus on:
- Understanding the project management mindset of “define then deliver”
- Hands-on experience applying light-touch project management tools and processes; specifically:
- Work breakdown structure
- Deliverable-based Gantt chart schedule
- Deliverable-based budget
- Deliverable-based project tracking and reporting
- Sharing experience and knowledge on the topic of common risks for evaluation projects
This course presupposes a basic understanding of evaluation theory and practice, and is best suited for those with a firm grounding in its evaluation concepts.
Beyond Boxes – Black, Mystery and Magic – Understand and Use the Theory of Change for Your Programs
Facilitators: Jennifer Yessis and Kelly Skinner
March 9-10, 2017
Centre for Social Innovation – Regent Park, Toronto
Theory of Change describes the theory (or set of assumptions) that explain the steps that lead to the long-term goal of interest and the connections between program activities and outcomes.
This advanced two-day workshop will describe concepts related to theory of change, and apply the concepts discussed to enable participants to develop program theory including theory of change and action.
The concept of contribution analysis will be described in day two, and applied to the theory of change example. Participants will be engaged throughout the two-day workshop in interactive activities for an active learning experience.
At the end of the workshop, participants will be able to:
- Describe and explain what a program theory is, and how this relates to theory of change and theory of action
- Describe how theories of change go beyond logic models
- Describe how theories of change can contribute to a contribution analysis
- Apply the theoretical concepts shared to develop a program theory for a relevant program including a theory of change and theory of action