Canadian Evaluation Society - Ontario Chapter

Evaluation for the Next Generation
2019-11-19 18:00 - 20:00 (America/Toronto)
From the event description:
Hey fellow evaluation aficionados,
Patricia and Marshal from Dig Insights have come forward to host us for our next Evaluation Cafe and to share some of the innovative methods they are using.
Here’s their description about what they’ll share:
Dig Insights (https://www.diginsights.com/) is excited to host this months Evaluation Café! Come to their downtown office (372 Bay Street) to learn about how they are integrating new and innovative technology to bring evaluation into the next generation.
Started as a market research company in 2010, Dig Insights Evaluation Team leverages the best practices of market research to help their clients extract in-depth insights about their program and provide them the opportunity to track learning far outside of the traditional survey. This includes the integration of their in-house apps including Upsiide (https://upsiide.com/) and Dig PhotoVoice, and other mobile friendly data collection tools including mobile diaries, online discussion boards and video key informant interviews. Not only has Dig expanded the reach of data collection techniques, they actively work with their clients to apply the most applicable analytical and data visualization tools including network maps, sanky diagrams, interactive scorecards and geographical mapping. This allows Dig the ability to extract key findings as well as present the information in easily digestible tools that increases programs effectiveness in decision making and allows them to better demonstrate the reach of their program to key stakeholders and the general public.
Come to this session to learn more about how you can further the effectiveness of your evaluation approach and provide greater insights to your internal and external stakeholders.
Drinks and light snacks will be provided.
The presentation will be delivered by Patricia King, CE, Vice President of Evaluation ([masked]) and Marshal Rodrigues, Senior Research Manager ([masked])
Tickets: https://www.meetup.com/Evaluation-Cafe-Toronto/events/266319080/.

October 2019 Essential Skills Series
2019-10-21 08:30 - 2019-10-24 16:30
Description

This 4-day course was developed by the Canadian Evaluation Society to provide participants with a basic understanding of the main models and practices associated with the profession of evaluation. Prior knowledge of evaluation and of social science research methods is not required. There are no examinations associated with the course, nor is there any homework. Participation in all 15 course modules entitles you to a Certificate of Completion from the Canadian Evaluation Society.
Participants will gain basic levels of knowledge, skill and appreciation with respect to the essential elements of evaluation, equipping them to enter and participate in the evaluation field and develop as evaluation professionals.
Course Competencies
Participants will be able to describe in basic terms:
• the uses and benefits of evaluation (1)
• common settings in which evaluation takes place (1)
• where evaluations and performance monitoring fit in the program cycle (1)
• underlying theories related to evaluation, and their implications (1)
• the historical and technical context in which evaluation takes place (1)
• the range of terminology used in evaluation (1)
• causes of, and responses to, resistance (4)
• potential misuses of evaluation (4)
• cultural considerations in conducting evaluations (4)
• ethical considerations with respect to evaluation (6)
• evaluation standards (6)
• evaluation as a profession (9)
• the role of CES, including the CE system (9)
• special applications of evaluation (15)
• the relevance of, and processes associated with:
o identifying evaluation objectives (2)
o identifying and engaging evaluation clients and stakeholders, and establishing roles (2)
o develop a program profile (3)
o creating evaluation questions (5) and indicators (7)
o common data collection methods (8, 10)
o creating an appropriate and valid evaluation design, including the selection of data collection methods (11)
o collecting data, including performance monitoring (12)
o data management (12)
o assessing data quality (12)
o data analysis, including cost effectiveness analysis (12)
o determining evaluation scale and budget (13)
o project management (13)
o synthesis of evidence leading to the development of conclusions and recommendations (14)
o evaluation reporting and dissemination (14)
Participants will also gain elementary experience in:
• creating logic models (3)
• developing indicators (7)
• question construction (5)
• creating an evaluation matrix (11)
• writing findings statements (12)
• creating a reporting plan (14)

About the Tickets

Please note that CES New Practitioner and CES Student tickets are available only to CES members with those membership categories. If you are unsure about your membership category, or would like more information about how to become a CES New Practitioner or CES Student member, please contact CES Ontario.

About the Facilitator
John Allen has worked in the area of Program Evaluation, Performance Measurement and Strategic Planning for more than 35 years, serving on governments at the national, provincial / state and municipal levels in Canada and the United States as well as the not-for-profit sector. Before becoming a consultant John was an Ontario public servant with the Treasury Board Secretariat and the Ministry of Municipal Affairs and Housing. While with Treasury Board, John implemented Ontario’s first formal performance measurement and evaluation process, Managing By Results. That system remains the conceptual framework of Ontario’s results based management initiatives to this day.
John works on client projects on his own and in partnership with Power Analysis Inc. of London, Ontario. As well as undertaking project assignments in all his areas of speciality, John also provides training on those subjects. He is a vendor of record with the provinces of Ontario, Nova Scotia, Manitoba, British Columbia, the Federal government and Nunavut Territory. He is an instructor for the Canadian Evaluation Society, the Association of Municipal Managers, Clerks and Treasurers of Ontario and the Ontario Municipal Social Services Association.
John is an instructor in public sector management topics with the University of Alberta’s School of Business, the Sprott School of Business at Carleton University and the Schulich School of Business at York University.

Tickets: https://www.eventbrite.ca/e/october-2019-essential-skills-series-tickets-66100180419.

Eval Cafe: Agile Reporting of Survey Data
2019-10-09 18:00 - 20:00
From the event description:
Gustavo Miranda, Data Analysis, Program Evaluation and Quality Improvement, at the Etobicoke Children’s Centre will share the following with us:
Online survey services/software like RedCap, SurveyMonkey, and LimeSurvey are a cheap, quick, user friendly way to collect information from an organization’s staff, stakeholders and community partners. This is especially true for organizations with resources too limited to design their own databases and host their own servers.
Unlike the data collected in locally hosted relational databases, however, responses from online surveys can’t always be accessed in a format that lends itself to quick, agile, versatile reporting.
Two little known features available in Excel and the free Power BI Desktop software can mitigate these limitations.
This demo-heavy presentation/discussion will demonstrate how:
1) Power Query’s point-and-click interface as well as its data transformation language, M, can be used to combine several flat files of survey feedback and break them out into a relational table structure in an automated, replicable way ,
and, if we have time
2) how Power Pivot and it’s measurement language DAX can be used to connect those related tables and create quick, interactive reports that can be used to guide decision making and ensure quick responses to client feedback.
Examples of service improvement will be discussed.
This location has a security guard, so we need to supply everyone’s names ahead of time, so please RSVP by 12 PM on Tuesday, October 8, 2019. CES Ontario is a sponsor of Eval Cafe Toronto.
Tickets: https://www.meetup.com/Evaluation-Cafe-Toronto/events/265386723/.

Credentialed Evaluation: A Panel Discussion
2019-09-16 17:30 - 19:30
The Canadian Evaluation Society – Ontario Chapter is pleased to host a Membership Networking Event. You are invited to join Evaluators for complimentary appetizers and an opportunity to engage in good conversation with seasoned and emerging evaluators. This is an open event; you do not need to be a CES Member to attend!
This event has a special focus on the Credentialed Evaluator (CE) designation. It will include a panel discussion on the experience of applying for the CE designation, and the benefits of having the CE designation. The panel member will consist of the several Evaluators from various fields including the following:
Dr. Keiko Kuji-Shikatani, C.E., is an internal Evaluator with the Ministry of Education, infusing evaluative thinking in collaborative teams to build sector capacity for the use of evidence to inform decisions. She shares her Development Evaluation expertise widely leading interministerial collaborations, evaluation capacity building for governments both in Canada and internationally, through universities, civil societies and EvalPartners.
Yasser Ismail, MFA, C.E., is the Corporate Evaluation Consultant at the College of Nurses of Ontario. Over the last seven years, Yasser has worked as a full-time evaluation consultant within Ontario’s health system both as an external and internal evaluator. Yasser’s current focus is on using evaluative tools to facilitate evidence-informed program design and evaluation. Demonstrating evaluation value, evaluation capacity building and reflective practice are also areas of interest for Yasser.
Marika Warner, MSc., C.E., is the Director of Research and Evaluation at MLSE LaunchPad, a Sport For Development facility for youth facing barriers in downtown Toronto. Marika’s large portfolio includes program evaluation, longitudinal research and academic partnerships focusing on positive youth development and corporate social responsibility in professional sport. Marika holds a BScPT from the University of Alberta and an MSc from the University of Toronto. Prior to her current role, Marika worked as a clinician and clinical researcher at Toronto Rehab, Bloorview Research Institute, and Regent Park Community Health Centre. Marika is also a retired professional dancer and mother of one.
Dr. Cameron Norman, C.E., is a professional designer, psychologist, educator, and evaluator who works with human service organizations to organize and support innovation for wellbeing. Cameron has worked in evaluation as a practitioner, scholar, educator, and advocate for more than 20 years and was among the first cohort of professionals to receive the Credentialed Evaluator designation in Canada. He is the President of Cense Ltd. and serves on the faculty at OCAD University in the Design and Health program and the Dalla Lana School of Public Health at the University of Toronto.
Tickets: https://www.eventbrite.ca/e/credentialed-evaluation-a-panel-discussion-tickets-66764280761.

Performance Measurement: From Theory to Practice
2019-09-16 08:30 - 2019-09-17 16:00
Description:
The overall purpose of this two day intermediate to advanced level workshop is to focus on how performance measurement frameworks are built, their technical properties, and on how they add value to organizational decision-making. The challenges and limitations of developing performance measurement systems will also be emphasized. The workshop will present current approaches and research based practices in the performance measurement field. It is designed to bring your measures to life and to make performance measurement about transformation and not just about accountability.
The workshop format utilizes formal presentations, interactive exercises, discussions, small group activities, and case studies. Emphasis is placed on the relevance, utility, technical, and practical application of performance measurement. Participants will have an opportunity to apply the theory learned.
The workshop is designed for individuals working in program evaluation, performance measurement, program managers, funders, board of directors. It is designed for both government and not-for-profit/human service delivery sectors.

Please note that this workshop was originally slated for June 2019 and has been rescheduled.
Specific Learning Objectives:
By the end of the workshop, you should have:

A consistent approach to measuring organizational performance
Use of common performance measurement language in your organization
A specific set of criteria for determining effective performance indicators
A set of indicators to track efficiency (outputs) & effectiveness (outcomes)
A set of data collection methods for your performance indicator system
A framework for developing performance measurement reports/dashboards
An initial set of appropriate performance targets/expectations
A positive culture for the use & development of performance measurement

CES Competencies Presented In Workshop:
The following CES competencies are covered in the workshop:
Reflective Practice
1.1 Knows evaluation theories, models & tools and is informed about new thinking and best practices;
1.7 Uses self-awareness and reflective thinking to continuously improve practice
Technical Practice
2.7 Identifies data requirements and data collection tools;
2.6 Uses appropriate evaluation methods;
2.7 Produces balanced evaluation reporting to support decision-making and learning
Situational Practice
3.4 Promotes usefulness of evaluation process and results
Management Practices
4.2 Defines work parameters, plans, and agreements;
Interpersonal Practice
5.4 Uses a variety of processes that result in negotiated agreements and understandings.
About the Facilitator:
Paul Favaro Ph.D., CE is the Chief of Research, Program Evaluation, and Accountability for the Peel District School Board in Mississauga, Ontario. He teaches management sciences at York University in Toronto.
Dr. Favaro has authored or co-authored articles, chapters, and technical reports, and has conducted professional training workshops in the areas of program evaluation, performance measurement, and research methodology. He is on the editorial board of The Canadian Journal of Program Evaluation. Throughout his career, he has worked as a research consultant to a wide variety of government ministries, educational organizations, charitable foundations, and community-based programs. He has held several executive positions on the board of the Canadian Evaluation Society (CES). In 2010, he was awarded a fellowship in the CES. He is a Credentialed Evaluator by the Canadian Evaluation Society.
Tickets: https://www.eventbrite.ca/e/performance-measurement-from-theory-to-practice-tickets-61618603903.

CES Ontario Member Engagement Session: North
2019-08-01 18:00 - 19:00 | Online
At our recent AGM, membership approved our Mission, Vision, Values, and Strategic Directions. Members in attendance also provided their input into how we can achieve our goals.
We know many evaluators live too far away to be able to attend our AGM in person. For those members, we are hosting a series of online sessions to get their input. We are looking for passionate members in Western, Eastern, and Northern Ontario to attend a one-hour online session and help us plan how to better serve their regions. If you have ideas for how CES-ON can achieve our goals in your area, please sign up to the session for the region you consider yourself to be in.
Eastern – July 18th at 6pm to 7pm
Western – July 25th at 6pm to 7pm
Northern – August 1st at 6pm to 7pm
To help us facilitate the session, we are limiting registration to 15 members.
Gaining feedback from most of our members, allows us to serve you better. We look forward to hearing your input and encourage you join us!
Tickets: https://www.eventbrite.ca/e/ces-ontario-member-engagement-session-north-tickets-64706426664.

Eval Cafe: Evaluation Capacity Building
2019-07-31 18:30 - 20:30
From the event description:
As noted at our last Eval Cafe event, some members noted interest in evaluation capacity building. A few members stepped up and we’ll have a couple present at this event; covering both building capacity with internal and external stakeholders.
We’ll be on the Bedford Academy’s patio for this event. Try to show up at 6:30 pm. We’ll begin the discussions as soon as enough people show up, but by 7pm at the latest. We’ll provide some apps courtesy of CES-ON’s sponsorship, but attendees will cover their own drinks or food beyond the apps.
Building Internal Evaluation Capacity:
Margaret (Meg) Gassanov (Ph.D., CE) will draw on her experiences of building internal evaluation capacity within the City of Toronto. She will explore five areas requiring attention to be successful in these efforts. The presentation will include examples of activities that can be done to build internal evaluation capacity, from the perspective of an internal evaluator.
Building Audacity – Evaluation Capacity Building with External Partners:
This brief presentation will explore the challenges of building capacity across external organizations: that is, among sponsors, clients, and stakeholders that evaluation teams have no formal, long-term commitment to. It will focus on concrete activities aimed at helping align organizations’ strategic priorities while considering ways to spur along sustainable cultures of evaluative thinking and learning. Kris Erickson (PhD, BFA) will draw on his experiences in community development, education, and workforce development to lead this interactive chat.
As always, the CES-ON sponsorship will provide some snacks, but you will be responsible for any food or drink beyond that.
Tickets: https://www.meetup.com/Evaluation-Cafe-Toronto/events/262998033/.

CES Ontario Member Engagement Session: West
2019-07-25 18:00 - 19:00 | Online
At our recent AGM, membership approved our Mission, Vision, Values, and Strategic Directions. Members in attendance also provided their input into how we can achieve our goals.
We know many evaluators live too far away to be able to attend our AGM in person. For those members, we are hosting a series of online sessions to get their input. We are looking for passionate members in Western, Eastern, and Northern Ontario to attend a one-hour online session and help us plan how to better serve their regions. If you have ideas for how CES-ON can achieve our goals in your area, please sign up to the session for the region you consider yourself to be in.
Eastern – July 18th at 6pm to 7pm
Western – July 25th at 6pm to 7pm
Northern – August 1st at 6pm to 7pm
To help us facilitate the session, we are limiting registration to 15 members.
Gaining feedback from most of our members, allows us to serve you better. We look forward to hearing your input and encourage you join us!
Tickets: https://www.eventbrite.ca/e/ces-ontario-member-engagement-session-west-tickets-64706201992.

CES Ontario Member Engagement Session: East
2019-07-18 18:00 - 19:00 | Online
At our recent AGM, membership approved our Mission, Vision, Values, and Strategic Directions. Members in attendance also provided their input into how we can achieve our goals.
We know many evaluators live too far away to be able to attend our AGM in person. For those members, we are hosting a series of online sessions to get their input. We are looking for passionate members in Western, Eastern, and Northern Ontario to attend a one-hour online session and help us plan how to better serve their regions. If you have ideas for how CES-ON can achieve our goals in your area, please sign up to the session for the region you consider yourself to be in.
Eastern – July 18th at 6pm to 7pm
Western – July 25th at 6pm to 7pm
Northern – August 1st at 6pm to 7pm
To help us facilitate the session, we are limiting registration to 15 members.
Gaining feedback from most of our members, allows us to serve you better. We look forward to hearing your input and encourage you join us!
Tickets: https://www.eventbrite.ca/e/ces-ontario-member-engagement-session-east-tickets-64706049536.

CES Summer Social: Evaluator Meet + Greet
2019-07-15 17:30 - 19:30
About our Event:
We would like to host you at the CES Summer Social coming up at Page One. The purpose of this event is to provide an informal setting for new practitioners and students to network with experienced Evaluators, learn from their narratives, and ask questions. The event will be structured as four casual small groups – please feel free to move among them throughout the evening! Food and non-alcoholic drinks will be provided.
Please take a moment to review the bios of our Experienced Evaluators, and come prepared with questions. You can ask general questions about evaluation, about their careers, about tricky evaluation scenarios you might be facing right now, and more.
See you on Monday July 15th!
This meet and greet is presented in conjunction with the July 2019 Essential Skills Series.
About our Experts:
Patricia King is currently the Vice President of Evaluation and Qualitative Research at Dig Insights and an Adjunct Professor at Dalhousie University. She previously worked as the Director of Evaluation at MQO Research. Other past experience includes working in the public sector as a Manager with the Provincial Government of Newfoundland and Labrador conducting research to inform policy development, as well as in the private sector conducting provincial and national evaluations. She just completed tenure as president of the CES–Newfoundland and Labrador (CES-NL). She has over 8 years of experience on volunteer boards, and almost 10 years of experience on both the client and suppliers side of research and evaluation. Patricia holds a Masters of Applied Social Psychology from Memorial University and a Credentialed Evaluator (CE) designation from the Canadian Evaluation Society (CES).
Eden Amare is an Evaluator that is passionate about social services. She currently works as a Policy Development Officer with the Shelter, Support & Housing Administration division of the City of Toronto, where her projects focus on quality assurance and evaluation. She previously worked as the Program Evaluator at Toronto Public Health where she evaluated communicable disease control programs. Eden also possesses evaluation experience at the Canadian Foundation for Healthcare Improvement, including organizational evaluation capacity-building. She holds a Master of Health Evaluation from the University of Waterloo and was a finalist in the 2018 Canadian Evaluation Society Student Case Competition.
Nick Petten is a researcher, consultant, and evaluator that is primarily concerned with how to meaningfully and ethically involve diverse populations in research, evaluation and program design. As a representative of his professional associations in several governance functions (Canadian Evaluation Society and American Evaluation Association) and currently working in municipal government in Strategic Planning, Management and Evaluation, Nick is continually facilitating knowledge exchange and demonstrating the social impact of programming and services for people using ethical and rigorous scientific methods.
Paul Bakker is a Credential Evaluator and coach, with over a decade of experience. For the last seven years, he has run his independent evaluation consulting practice, Social Impact Squared. His evaluation projects are typically for small nonprofits or provincial government agencies in the areas of education, health, employment, youth development, and crime prevention. His wide range of experience includes using developmental evaluation approaches to carrying out quasi-experimental designs and statistical analyses. Paul also organizes Evaluation Cafe Toronto events for those interested in evaluation to learn and connect with each other.

Tickets: https://www.eventbrite.ca/e/ces-summer-social-evaluator-meet-greet-tickets-64185596848.

July 2019 Essential Skills Series
2019-07-15 08:30 - 2019-07-18 16:30
This 4-day course was developed by the Canadian Evaluation Society to provide participants with a basic understanding of the main models and practices associated with the profession of evaluation. Prior knowledge of evaluation and of social science research methods is not required. There are no examinations associated with the course, nor is there any homework. Participation in all 15 course modules entitles you to a Certificate of Completion from the Canadian Evaluation Society.
Participants will gain basic levels of knowledge, skill and appreciation with respect to the essential elements of evaluation, equipping them to enter and participate in the evaluation field and develop as evaluation professionals.
Breakfast, lunch, and coffee breaks and included in the registration fee.
Course Competencies
Participants will be able to describe in basic terms:
• the uses and benefits of evaluation (1)
• common settings in which evaluation takes place (1)
• where evaluations and performance monitoring fit in the program cycle (1)
• underlying theories related to evaluation, and their implications (1)
• the historical and technical context in which evaluation takes place (1)
• the range of terminology used in evaluation (1)
• causes of, and responses to, resistance (4)
• potential misuses of evaluation (4)
• cultural considerations in conducting evaluations (4)
• ethical considerations with respect to evaluation (6)
• evaluation standards (6)
• evaluation as a profession (9)
• the role of CES, including the CE system (9)
• special applications of evaluation (15)
• the relevance of, and processes associated with:
o identifying evaluation objectives (2)
o identifying and engaging evaluation clients and stakeholders, and establishing roles (2)
o develop a program profile (3)
o creating evaluation questions (5) and indicators (7)
o common data collection methods (8, 10)
o creating an appropriate and valid evaluation design, including the selection of data collection methods (11)
o collecting data, including performance monitoring (12)
o data management (12)
o assessing data quality (12)
o data analysis, including cost effectiveness analysis (12)
o determining evaluation scale and budget (13)
o project management (13)
o synthesis of evidence leading to the development of conclusions and recommendations (14)
o evaluation reporting and dissemination (14)
Participants will also gain elementary experience in:
• creating logic models (3)
• developing indicators (7)
• question construction (5)
• creating an evaluation matrix (11)
• writing findings statements (12)
• creating a reporting plan (14)
About the Facilitator
Dr. Keiko Kuji-Shikatani, C.E., is an internal evaluator with the Ministry of Education, infusing evaluative thinking in collaborative teams to build sector capacity for the use of evidence to inform decisions. She shares her DE expertise widely leading interministerial collaborations, evaluation capacity building for governments both in Canada and internationally, through universities, civil societies and EvalPartners.

Tickets: https://www.eventbrite.ca/e/july-2019-essential-skills-series-tickets-61112615478.

2019 CES AGM + Learning Event
2019-06-19 13:00 - 16:30
Please join us for the 23rd annual CES Ontario AGM and Learning Event! This event is open to all members of the Canadian Evaluation Society Ontario chapter, as well as interested members of the public.

Event Agenda:
1:00 PM – 1:30 PM: Registration & Networking
1:30 PM – 3:45 PM: Annual General Meeting + Integrated Strategic/Operational Plan update and consultation
3:45 PM – 4:00 AM: Break & Networking Event
4:00 PM – 5:00 PM: Learning Event: Feminist Data Analysis

Annual General Meeting + Integrated Strategic/Operational Plan update and consultation
As you are all aware, CES Ontario has undertaken an integrated strategic and operational planning process (ISOP) to guide us over the next 5 years. In this session, members will review our updated Vision, Mission, Value Statements, and Strategic Directions. We will also be engaging members in helping us identify key activities to move our operational planning forward and bring our ISOP Goals to life.
Learning Event: Feminist Data Analysis

Very few people become evaluators because they want to promote racist or sexist ideas. However, it’s very easy to accidentally fall into these traps, particularly in the data-centric aspects of evaluation. A working understanding of how to incorporate ethics and equity into quantitative evaluation is essential. Heather’s talk will tell stories and show real world examples that will guide you through the process of learning to identify inequity and hidden bias at seven key stages of the evaluation data lifecycle.
About the Speaker:
Heather Krause is a data scientist working on projects for equity and ethics in data. As a statistician (PStat) she attacks the largest questions facing societies today, working with non-profit and social sector organizations, local and national governments, and data journalists. Her relentless pursuit of clarity and realism in these projects pushed her beyond pure analysis to mastering the entire data ecosystem including ground-breaking work in evaluation, data sourcing, design, visualization, communication, and journalism, each incorporating bleeding edge theory and technologies. Her unique contributions have been sought across a range of clients from individual researchers to large international organizations including FiveThirtyEight, Orb Media, the Bill and Melinda Gates Foundation, CARE, MasterCard, the UNHCR, and several national governments.
Tickets: https://www.eventbrite.ca/e/2019-ces-ontario-agm-learning-event-tickets-62239544152.

Eval Cafe: Equity in Evaluation
2019-05-28 18:30 - 20:30
Our two facilitators will present on their approaches to ensuring their evaluation work is equitable, and then will help us reflect on what we can do to incorporate equity considerations into our evaluation practice. Heidi Schaeffer will present on her work evaluating health equity initiatives and on applying Outcome Harvesting principles to enhance equity and inclusion. Heather Krause will also present on how Feminist data analysis principles present opportunities to increase equity, inclusion, and fairness.
CES Ontario is a sponsor of Eval Cafe Toronto.
Tickets: https://www.meetup.com/Evaluation-Cafe-Toronto/events/260769828/.

April 2019 Essential Skills Series
2019-04-15 08:30 - 2019-04-18 16:00
Description

This 4-day course was developed by the Canadian Evaluation Society to provide participants with a basic understanding of the main models and practices associated with the profession of evaluation. Prior knowledge of evaluation and of social science research methods is not required. There are no examinations associated with the course, nor is there any homework. Participation in all 15 course modules entitles you to a Certificate of Completion from the Canadian Evaluation Society.
Participants will gain basic levels of knowledge, skill and appreciation with respect to the essential elements of evaluation, equipping them to enter and participate in the evaluation field and develop as evaluation professionals.
Course Competencies
Participants will be able to describe in basic terms:
• the uses and benefits of evaluation (1)
• common settings in which evaluation takes place (1)
• where evaluations and performance monitoring fit in the program cycle (1)
• underlying theories related to evaluation, and their implications (1)
• the historical and technical context in which evaluation takes place (1)
• the range of terminology used in evaluation (1)
• causes of, and responses to, resistance (4)
• potential misuses of evaluation (4)
• cultural considerations in conducting evaluations (4)
• ethical considerations with respect to evaluation (6)
• evaluation standards (6)
• evaluation as a profession (9)
• the role of CES, including the CE system (9)
• special applications of evaluation (15)
• the relevance of, and processes associated with:
o identifying evaluation objectives (2)
o identifying and engaging evaluation clients and stakeholders, and establishing roles (2)
o develop a program profile (3)
o creating evaluation questions (5) and indicators (7)
o common data collection methods (8, 10)
o creating an appropriate and valid evaluation design, including the selection of data collection methods (11)
o collecting data, including performance monitoring (12)
o data management (12)
o assessing data quality (12)
o data analysis, including cost effectiveness analysis (12)
o determining evaluation scale and budget (13)
o project management (13)
o synthesis of evidence leading to the development of conclusions and recommendations (14)
o evaluation reporting and dissemination (14)
Participants will also gain elementary experience in:
• creating logic models (3)
• developing indicators (7)
• question construction (5)
• creating an evaluation matrix (11)
• writing findings statements (12)
• creating a reporting plan (14)
About the Facilitator
Dr. Paul Favaro is a well-known research, planning, and program evaluation consultant based in Toronto. He has been involved professionally in program evaluation since 1980 and has worked as an evaluation consultant to a wide variety of public and community programs, especially in the fields of health, mental health and education. Dr. Favaro received his Ph.D. in applied psychology from the University of Toronto and has lectured extensively in psychology, education and program evaluation at York University, the University of Guelph and the University of Waterloo. He is also the author/co-author of numerous articles, chapters and technical reports in the areas of program evaluation, applied measurement, and performance measurement.
Dr. Favaro has conducted numerous training workshops for the Canadian Evaluation Society in assessment and program evaluation, has served as chair of the Program Evaluation Section of the Canadian Psychological Association, chair of the Canadian Evaluation Society – Ontario Chapter, and as an executive member of the Canadian Evaluation Society National Council.

Tickets: https://www.eventbrite.ca/e/april-2019-essential-skills-series-tickets-55829085297.

The Art & Science of Producing Effective Infographics
2019-03-29 13:00 - 17:00
Data visualization as a hot topic in the evaluation world, especially in knowledge transfer activities. The interactive and multi-modal workshop will focus on a specific type of data visualization, namely infographics – artistic or graphic presentation of data to communicate insights. We will briefly orient infographics in the realm of data visualization, illustrating the different types of infographics. Then our focus will shift to the science of why we use infographics in communicating to our various audiences (clients and funders). We then venture into design theory, calling on the works of data visualization experts Bernard Marr, Stephanie Evergreen, Garr Reynolds and Edward Tufte. The bulk of the time will be aimed at specific design elements of graphics, colour, and font, which provide the visual cues to our most important element: the data. We will then put these elements together with examples, and then look at resources and tools for infographic production. The session will conclude with a short question period.
Learning objectives:
By the end of the Workshop, the participant will be able to:

Compare the different types of infographics and situate them in the greater web of data visualization
Understand the basic tenets of design theory and how the brain process and information
Identify and appraise the design elements of effective infographics
Locate and use various resources and tools for effective infographic production

In addition, this workshop aims to strengthen capacities in line with the following Competencies for Canadian Evaluation Practice:

2.8 Identify data sources
2.13 Assesses trustworthiness of data
2.16 Reports evaluation findings and results
3.5 Serves the information needs of intended users
4.6 Reports on progress and results
5.1 Uses written communication skills and technologies

About the Facilitator
Dr. A. Sidiq (Sid) Ali, CE is the Managing Director of Research & Evaluation Consulting Inc. He is one of Canada’s leaders in credentialing program development and evaluation, utilizing his psychometric and program evaluation expertise to lead high-stakes licensure and certification projects within professional governing bodies and regulators, such as the Law Society of Upper Canada, the Chartered Professional Accountants of Canada, the Canadian Association of Insolvency and Restructuring Professionals and the Royal Bank of Canada. Sid has been the recipient of the University of Toronto’s department of Curriculum, Teaching and Learning’s Doctoral Scholarship and the National (U.S.) Science Foundation’s Evaluators’ Institute scholarship. He has earned the Credentialed Evaluator designation, authoring many evaluation and technical reports, publishing articles in magazines, Canadian and international scholarly journals, including twice in the Canadian Journal of Program Evaluation, and presenting his work at national and international conferences in the domains of education, evaluation and credentialing. He holds bachelor’s degrees in Humanities and Education, as well as a Master’s degree and Doctorate (Ph.D.) in Educational Measurement and Evaluation from the Ontario Institute for Studies in Education at the University of Toronto.

Tickets: https://www.eventbrite.ca/e/the-art-and-science-of-producing-effective-infographics-tickets-56539216318.

Eval Cafe: Tips of the Trade – RESCHEDULED
2019-02-27 17:30 - 19:30
Details

For the first time ever, we are actually going to have an Evaluation Cafe Toronto event at a cafe. For those of you that like beer or wine, don’t worry, after the group discussions you can choose to duck downstairs for a drink.
For this cafe, let’s each come with a least one evaluation practice tip that we can share with the group. Have you ever done a lighting round presentation? You could share that. Found something that saved time, budget, or worked better? Share that. New to evaluation, but want to learn more? Check out https://aea365.org/blog/ and pick a past useful tip from there that you’d like to share.
For this event, we will use our sponsorship from the Ontario Chapter of the Canadian Evaluation Society to buy attendees a coffee/tea/drink instead of snacks.
Space is limited, so please only RSVP if you are sure you will attend.
See you there!

NOTE: This event has been rescheduled to February 27 due to weather.
Tickets: https://www.meetup.com/Evaluation-Cafe-Toronto/events/258200211/?rv=ea1_v2&_xtd=gatlbWFpbF9jbGlja9oAJDI4MmY4ODkyLTQzYmItNGM2ZS04ZmE3LTJjM2M4MmQwOTNlZg.

January 2019 Essential Skills Series
2019-01-28 08:30 - 2019-01-31 16:30
This 4-day course was developed by the Canadian Evaluation Society to provide participants with a basic understanding of the main models and practices associated with the profession of evaluation. Prior knowledge of evaluation and of social science research methods is not required. There are no examinations associated with the course, nor is there any homework. Participation in all 15 course modules entitles you to a Certificate of Completion from the Canadian Evaluation Society.
Participants will gain basic levels of knowledge, skill and appreciation with respect to the essential elements of evaluation, equipping them to enter and participate in the evaluation field and develop as evaluation professionals.
Course Competencies
Participants will be able to describe in basic terms:

the uses and benefits of evaluation (1)
common settings in which evaluation takes place (1)
where evaluations and performance monitoring fit in the program cycle (1)
underlying theories related to evaluation, and their implications (1)
the historical and technical context in which evaluation takes place (1)
the range of terminology used in evaluation (1)
causes of, and responses to, resistance (4)
potential misuses of evaluation (4)
cultural considerations in conducting evaluations (4)
ethical considerations with respect to evaluation (6)
evaluation standards (6)
evaluation as a profession (9)
the role of CES, including the CE system (9)
special applications of evaluation (15)
the relevance of, and processes associated with:
identifying evaluation objectives (2)
identifying and engaging evaluation clients and stakeholders, and establishing roles (2)
develop a program profile (3)
creating evaluation questions (5) and indicators (7)
common data collection methods (8, 10)
creating an appropriate and valid evaluation design, including the selection of data collection methods (11)
collecting data, including performance monitoring (12)
data management (12)
assessing data quality (12)
data analysis, including cost effectiveness analysis (12)
determining evaluation scale and budget (13)
project management (13)
synthesis of evidence leading to the development of conclusions and recommendations (14)
evaluation reporting and dissemination (14)Participants will also gain elementary experience in:• creating logic models (3)
developing indicators (7)
question construction (5)
creating an evaluation matrix (11)
writing findings statements (12)
creating a reporting plan (14)

About the Tickets

Please note that the CES New Practitioner and the CES Student tickets are available onty to CES members with those membership categories. If you are unsure about your membership category, or would like more information about how to become a CES New Practitioner or CES Student member, please contact CES Ontario.

About the Facilitator
Tina Sahay has worked in the area of Program Evaluation and Performance Measurement for more than 24 years, supporting governments at the national, provincial and municipal levels in Canada as well as the not-for-profit sector. Tina operates a consulting firm in Toronto and works on client projects in all areas of of her specialty of community and public health. She works extensively with vulnerable populations including newcomers, youth and those at-risk for mental health and substance use disorders. Tina also provides training to professionals on various aspects of program evaluation. She is an instructor for the Canadian Evaluation Society and has designed and conducted training programs for Toronto Public Health, Canadian Breast Cancer Foundation, MOHLTC, Hastings Prince Edward Public Health and York University.
Tina holds a Masters degree in Health Science from the University of Toronto and is a certified Quality Improvement Specialist. Tina is also a credentialed evaluator with the Canadian Evaluation Society.
Tickets: https://www.eventbrite.ca/e/january-2019-essential-skills-series-tickets-53862590458.

Developmental Evaluation in Action: Facilitating Social Innovation in Real-time
2018-12-04 08:30 - 2018-12-05 16:00
Developmental Evaluation in Action: Facilitating Social Innovation in Real-time consists of three parts:
Online webinar: Wednesday November 28, 1:30 PM – 3:30 PM
In-person: Tuesday December 4 & Wedenesday December, 9 AM (registration 8:30 AM) – 3:30 PM. Refreshments will be provided.
On-line group consultation (optional): TBA
Course outline:
This blended course provides participants with introductory knowledge in the fundamentals of Developmental Evaluation (DE) and its implementation, including the role and use of the Theory of Change/Action.
The course is focused on how developmental evaluators track, document, and help interpret the nature and implications of innovations and adaptations as they unfold, and help extract lessons and insights from both processes and outcomes to inform the ongoing adaptive innovative process. (Patton, McKegg, & Wehipeihana, 2015)
Situational analysis and case studies will be used to authenticate the information being presented in order to equip evaluators with the practical application of DE within the complex, dynamic environments they may experience in their work.
Throughout the course participants will be invited to apply their learning to the programs/ evaluation activities in which they are involved.
The course will consist of a webinar and in-person session. An optional follow-up one-hour group consultation is offered to those participants wishing to present and discuss questions or issues concerning implementation of DE they may have.
Please note that this course requires the use of Michael Quinn Patton’s book Developmental Evaluation Exemplars: Principles in Practice (2015). This book can be purchased directly from Guilford Press here.
Instructor Bios:
Megan Börner has worked in the public education sector for over 25 years. She is currently with the Ontario Ministry of Education, where she has created a model for embedding internal research and evaluation staff in policy/program teams to promote the understanding of evaluative thinking through everyday decisions and processes.
Dr. Keiko Kuji-Shikatani, C.E., is an internal evaluator with the Ministry of Education, infusing evaluative thinking in collaborative teams to build sector capacity for the use of evidence to inform decisions. She shares her DE expertise widely leading interministerial collaborations, evaluation capacity building for governments both in Canada and internationally, through universities, civil societies and EvalPartners.
Dr. Wendy Rowe is a professor at Royal Roads University, Victoria, Canada, teaching in the School of Leadership. She has 20 years professional experience in the evaluation field across Canada and United States, using models of collaboration and developmental evaluation to enhance organizational capacities, increase program efficiency and effectiveness, and create learning organizations.
Tickets: https://www.eventbrite.ca/publish?crumb=422fc12ae78773&eid=51341056482.

Eval Cafe: Launch of the Service Information System (SIS) for evaluators
2018-11-29 18:00 - 20:00
LogicalOutcomes has launched SIS, the open source evaluation platform that Gillian presented to the evaluation café a few months ago. We have signed up our first clients, and want to work with the evaluation community to develop shared tools for the human service sector in Canada. We are hoping that the platform will be used by evaluators for data collection and analysis in their own projects.
SIS includes tools for building an evaluation plan and logic model, data collection instruments, tools for analysis and data visualization, an indicator registry and a clinical notetaking application. Some of them are free for anyone to use. The platform provides secure data storage hosted on Canadian or European servers. It will be officially GDPR compliant in a couple of months (GDPR is the new European Union privacy regulation).
At the evaluation café, Gillian Kerr will demonstrate SIS and discuss how it can be customized for evaluators.
Snacks will be provided courtesy of the Canadian Evaluation Society – Ontario Chapter.
Tickets: https://www.meetup.com/Evaluation-Cafe-Toronto/events/255809757/?rv=ea1_v2&_xtd=gatlbWFpbF9jbGlja9oAJDZiNjQwMzgwLTlmNTEtNDQyZC04NjZhLTc2ZWQ2NzkzZTExMA.

November 2018 Essential Skills Series
2018-11-26 08:30 - 2018-11-29 16:30
This 4-day course was developed by the Canadian Evaluation Society to provide participants with a basic understanding of the main models and practices associated with the profession of evaluation. Prior knowledge of evaluation and of social science research methods is not required. There are no examinations associated with the course, nor is there any homework. Participation in all 15 course modules entitles you to a Certificate of Completion from the Canadian Evaluation Society.
Participants will gain basic levels of knowledge, skill and appreciation with respect to the essential elements of evaluation, equipping them to enter and participate in the evaluation field and develop as evaluation professionals.
Course Competencies
Participants will be able to describe in basic terms:
• the uses and benefits of evaluation (1)
• common settings in which evaluation takes place (1)
• where evaluations and performance monitoring fit in the program cycle (1)
• underlying theories related to evaluation, and their implications (1)
• the historical and technical context in which evaluation takes place (1)
• the range of terminology used in evaluation (1)
• causes of, and responses to, resistance (4)
• potential misuses of evaluation (4)
• cultural considerations in conducting evaluations (4)
• ethical considerations with respect to evaluation (6)
• evaluation standards (6)
• evaluation as a profession (9)
• the role of CES, including the CE system (9)
• special applications of evaluation (15)
• the relevance of, and processes associated with:
o identifying evaluation objectives (2)
o identifying and engaging evaluation clients and stakeholders, and establishing roles (2)
o develop a program profile (3)
o creating evaluation questions (5) and indicators (7)
o common data collection methods (8, 10)
o creating an appropriate and valid evaluation design, including the selection of data collection methods (11)
o collecting data, including performance monitoring (12)
o data management (12)
o assessing data quality (12)
o data analysis, including cost effectiveness analysis (12)
o determining evaluation scale and budget (13)
o project management (13)
o synthesis of evidence leading to the development of conclusions and recommendations (14)
o evaluation reporting and dissemination (14)
Participants will also gain elementary experience in:
• creating logic models (3)
• developing indicators (7)
• question construction (5)
• creating an evaluation matrix (11)
• writing findings statements (12)
• creating a reporting plan (14)
About the Facilitator
Dr. Paul Favaro is a well-known research, planning, and program evaluation consultant based in Toronto. He has been involved professionally in program evaluation since 1980 and has worked as an evaluation consultant to a wide variety of public and community programs, especially in the fields of health, mental health and education. Dr. Favaro received his Ph.D. in applied psychology from the University of Toronto and has lectured extensively in psychology, education and program evaluation at York University, the University of Guelph and the University of Waterloo. He is also the author/co-author of numerous articles, chapters and technical reports in the areas of program evaluation, applied measurement, and performance measurement.
Dr. Favaro has conducted numerous training workshops for the Canadian Evaluation Society in assessment and program evaluation, has served as chair of the Program Evaluation Section of the Canadian Psychological Association, chair of the Canadian Evaluation Society – Ontario Chapter, and as an executive member of the Canadian Evaluation Society National Council.

Tickets: https://www.eventbrite.ca/e/november-2018-essential-skills-series-tickets-50068443061.

City of Hamilton & CES Ontario: Research and Evaluation Network Event
2018-11-05 16:30 - 19:00
Join the City of Hamilton – Children’s Services and Neighbourhood Development Division and the Canadian Evaluation Society – Ontario Chapter (CES-ON) at a co-hosted inaugural Research and Evaluation Network event. This event is free to attend, and light snacks and refreshments will be provided.
The City is looking to broaden the scope of the previously existing Best Start Early Year’s Research and Evaluation Committee to include more members, a wider range of functions, including a focus on human services and system-level inquiry and learning.
One of CES-ON’s goals is to support local evaluation communities of practice and connect its members to them.
The event will start with a presentation from Michelle Vine and Rachel Laxer (from Public Health Ontario) on the Evaluation of the Healthy Kids Community Challenge, which is a community-based intervention developed by the Ontario Ministry of Health and Long-Term Care (MOHLTC). Forty-five Ontario communities worked with local public and private partners to develop and implement community-based initiatives (i.e., programs, policies, environmental supports) to promote healthy behaviours among children and youth. Michelle and Rachel will discuss:

How a multi-stakeholder approach is integral for population-based initiatives to be most effective.
Results of some of the partnerships formed.
Successes and challenges associated with forming public-private partnerships.
Ways in which PHO formed partnerships across sectors in order to carry out the different evaluation activities.

After the presentation there will be small group discussions on how to best nurture engagement in the Research and Evaluation Network moving forward.
Lastly, there will be time for open networking, so that attendees can get to know new members working on evaluation in the Hamilton region.
What are my transportation/parking options for getting to and from the event?
There are paid parking lots under Jackson Square mall, which is attached to the Library.
When to arrive:
Please arrive starting at 4:30pm to register and find a seat, as the event will start at 5pm sharp.
About the presenters:
Dr. Michelle Vine is an Evaluation Specialist in Health Promotion, Chronic Disease and Injury Prevention at Public Health Ontario and Adjunct Assistant Professor in the School of Public Health and Health Systems at the University of Waterloo. She is a social geographer, with a focus on the environment and health, population health intervention research, health policy implementation and evaluation, and qualitative research methods.
Dr. Rachel Laxer is an Evaluation Specialist in Health Promotion, Chronic Disease and Injury Prevention at Public Health Ontario. Her PhD research focused on obesity-related behaviours in youth, and the implementation of programs and policies in schools to improve youth health behaviours. Prior to PHO, Rachel worked as an evaluation consultant for Ophea, evaluating the impact of their Healthy Schools Certification and informing programmatic changes.
Tickets: https://www.eventbrite.ca/e/city-of-hamilton-ces-ontario-research-and-evaluation-network-event-tickets-51252328093.

Strategic Project Management for Evaluators
2018-10-12 09:00 - 15:00
There are 47 tools and processes used in Project Management. Which ones are best suited to your evaluation practice? Join us this April for a workshop that will expand on four key project management tools you can use to advance and hone your evaluation practice.
The sheer number of tools and processes in the Project Management Body of Knowledge (PMBOK® Guide) can make it challenging for evaluators to know which tools to apply, and when. This workshop provides theory and hands-on experience applying four PMBOK® derived light-touch project management tools that have been tailored for evaluation projects. All tools can be applied using the standard Microsoft Office suite of applications.
Participants will work with two case studies used to illustrate project management in practice, with time for participants to share their own learnings and experiences. The workshop concludes with a facilitated session using a modified version of the PMBOK® risk management processes to help participants identify, and begin to develop mitigation strategies for, the risks most likely to affect evaluation projects. The course will enhance participant knowledge and application of project management tools and processes that have been tailored for evaluators, with a focus on:
// Understanding the project management mindset of “define then deliver”
// Hands-on experience applying light-touch project management tools and processes; specifically:

Work breakdown structure
Deliverable-based Gantt chart schedule
Deliverable-based budget
Deliverable-based project tracking and reporting

// Sharing experience and knowledge on the topic of common risks for evaluation projects
This course presupposes a basic understanding of evaluation theory and practice, and is best suited for those with a firm grounding in its evaluation concepts
The Credentialed Evaluators competencies aligned through this workshop include:
Management Practice: skills and tools to manage a project/evaluation such as work plans, coordinating accountabilities and resources (including budget)
Technical Practice: inclusion of core technical elements of evaluation in PM tools such as program theory and evaluation design, as frameworks to technical practice
Interpersonal Practice: attendance to process and tools that promote stakeholder involvement, inclusion and discussion
This course is organized by CES Ontario Chapter and applicable towards your application to, and maintenance of, the Credentialed Evaluation (CE) designation.
This workshop is also eligible for 5.5 contact / training hours towards the Project Management Professional (PMP) certification. Attendees are encouraged to bring their laptops for interactive exercises.
About the Facilitator
Alison Paprica PhD, PMP is the Principal and founder of RPM – a boutique consulting firm that provides strategic, light-touch project management services and training. Through RPM, Alison has provided workshops to build project management capacity in diverse audiences including evaluators, graduate students, and principal investigators leading large research grants. As adjunct faculty at the Institute of Health Policy Management & Evaluation at the University of Toronto, Alison developed and delivers a graduate student course on Strategic Project Management for Research.
Tickets: https://www.eventbrite.ca/e/strategic-project-management-for-evaluators-2018-tickets-44807496428.

Eval Cafe: Youth Engagement in Evaluation: The Students Commission of Canada’s Approach
2018-10-10 18:00 - 20:00
The Students Commission of Canada is a national charitable organization that purposely works with others to ensure that young people’s voices are heard and valued. The SCC believes in a world where all young people transition into a positive adulthood.
The SCC leads a network called the Centre of Excellence for Youth Engagement, which focuses on bringing together youth, academics and organizations to generate and gather research on meaningful youth engagement. For the past 7 years, the SCC and CEYE have been supporting 300 youth serving organizations to effectively tell their story through rigorous evaluation. They use a shared database to provide customized evaluation supports for individual organizations. They also aggregate the data from individual organizations to identify trends that are occurring across the youth-serving sector. The SCC will present their approach and showcase some of the aggregated data at our next meeting.
Light snacks will be provided courtesy of CES-Ontario (http://www.evaluationontario.ca/). Members will need to pay for their drinks or additional food.
Tickets: https://www.meetup.com/Evaluation-Cafe-Toronto/events/254972688/?rv=co1&_xtd=gatlbWFpbF9jbGlja9oAJGJlMzJlNTYxLWY0MDYtNDVkOC1iNGJhLTQ2YjQzMmVlMTUxOQ&_cookie-check=FD61pEAilxgDEa8E.

The Art and Science of Producing Effective Infographics
2018-09-28 12:30 - 17:00
Description

Data visualization as a hot topic in the evaluation world, especially in knowledge transfer activities. The interactive and multi-modal workshop will focus on a specific type of data visualization, namely infographics – artistic or graphic presentation of data to communicate insights. We will briefly orient infographics in the realm of data visualization, illustrating the different types of infographics. Then our focus will shift to the science of why we use infographics in communicating to our various audiences (clients and funders). We then venture into design theory, calling on the works of data visualization experts Bernard Marr, Stephanie Evergreen, Garr Reynolds and Edward Tufte. The bulk of the time will be aimed at specific design elements of graphics, colour, and font, which provide the visual cues to our most important element: the data. We will then put these elements together with examples, and then look at resources and tools for infographic production. The session will conclude with a short question period.
Learning objectives:
By the end of the Workshop, the participant will be able to:

Compare the different types of infographics and situate them in the greater web of data visualization
Understand the basic tenets of design theory and how the brain process and information
Identify and appraise the design elements of effective infographics
Locate and use various resources and tools for effective infographic production

In addition, this workshop aims to strengthen capacities in line with the following Competencies for Canadian Evaluation Practice:

2.8 Identify data sources
2.13 Assesses trustworthiness of data
2.16 Reports evaluation findings and results
3.5 Serves the information needs of intended users
4.6 Reports on progress and results
5.1 Uses written communication skills and technologies

About the Facilitator
Dr. A. Sidiq (Sid) Ali, CE is the Managing Director of Research & Evaluation Consulting Inc. He is one of Canada’s leaders in credentialing program development and evaluation, utilizing his psychometric and program evaluation expertise to lead high-stakes licensure and certification projects within professional governing bodies and regulators, such as the Law Society of Upper Canada, the Chartered Professional Accountants of Canada, the Canadian Association of Insolvency and Restructuring Professionals and the Royal Bank of Canada. Sid has been the recipient of the University of Toronto’s department of Curriculum, Teaching and Learning’s Doctoral Scholarship and the National (U.S.) Science Foundation’s Evaluators’ Institute scholarship. He has earned the Credentialed Evaluator designation, authoring many evaluation and technical reports, publishing articles in magazines, Canadian and international scholarly journals, including twice in the Canadian Journal of Program Evaluation, and presenting his work at national and international conferences in the domains of education, evaluation and credentialing. He holds bachelor’s degrees in Humanities and Education, as well as a Master’s degree and Doctorate (Ph.D.) in Educational Measurement and Evaluation from the Ontario Institute for Studies in Education at the University of Toronto

Tickets: https://www.eventbrite.ca/e/the-art-and-science-of-producing-effective-infographics-tickets-48078149038.

Essential Skills Series September 2018
2018-09-10 08:30 - 2018-09-13 16:30
September 2018 Essential Skills SeriesLocation: Oakham House, Ryerson University. 63 Gould Street, Toronto ON M5B 1E9
Date: September 10-13, 2018, 8:30 AM – 4:30 PM
Cost: CES Member: $1150 / CES Student Member: $575 / CES New Practitioner Member (Ontario only): $862.50 / Non-member: $1437.50 / Non-member student: $718.75
Meals: Breakfast, lunch, and coffee breaks will be provided
Registration deadline: September 4, 2018, 12:00 PM
Registration URL: https://www.eventbrite.ca/e/essential-skills-series-september-2018-tickets-47870377588
This 4-day course was developed by the Canadian Evaluation Society to provide participants with a basic understanding of the main models and practices associated with the profession of evaluation. Prior knowledge of evaluation and of social science research methods is not required. There are no examinations associated with the course, nor is there any homework. Participation in all 15 course modules entitles you to a Certificate of Completion from the Canadian Evaluation Society.
Participants will gain basic levels of knowledge, skill and appreciation with respect to the essential elements of evaluation, equipping them to enter and participate in the evaluation field and develop as evaluation professionals.
Course Competencies
Participants will be able to describe in basic terms:
• the uses and benefits of evaluation (1)
• common settings in which evaluation takes place (1)
• where evaluations and performance monitoring fit in the program cycle (1)
• underlying theories related to evaluation, and their implications (1)
• the historical and technical context in which evaluation takes place (1)
• the range of terminology used in evaluation (1)
• causes of, and responses to, resistance (4)
• potential misuses of evaluation (4)
• cultural considerations in conducting evaluations (4)
• ethical considerations with respect to evaluation (6)
• evaluation standards (6)
• evaluation as a profession (9)
• the role of CES, including the CE system (9)
• special applications of evaluation (15)
• the relevance of, and processes associated with:
o identifying evaluation objectives (2)
o identifying and engaging evaluation clients and stakeholders, and establishing roles (2)
o develop a program profile (3)
o creating evaluation questions (5) and indicators (7)
o common data collection methods (8, 10)
o creating an appropriate and valid evaluation design, including the selection of data collection methods (11)
o collecting data, including performance monitoring (12)
o data management (12)
o assessing data quality (12)
o data analysis, including cost effectiveness analysis (12)
o determining evaluation scale and budget (13)
o project management (13)
o synthesis of evidence leading to the development of conclusions and recommendations (14)
o evaluation reporting and dissemination (14)
Participants will also gain elementary experience in:
• creating logic models (3)
• developing indicators (7)
• question construction (5)
• creating an evaluation matrix (11)
• writing findings statements (12)
• creating a reporting plan (14)
About the Facilitator
John Allen has worked in the area of Program Evaluation, Performance Measurement and Strategic Planning for more than 35 years, serving on governments at the national, provincial / state and municipal levels in Canada and the United States as well as the not-for-profit sector. Before becoming a consultant John was an Ontario public servant with the Treasury Board Secretariat and the Ministry of Municipal Affairs and Housing. While with Treasury Board, John implemented Ontario’s first formal performance measurement and evaluation process, Managing By Results. That system remains the conceptual framework of Ontario’s results based management initiatives to this day.
John works on client projects on his own and in partnership with Power Analysis Inc. of London, Ontario. As well as undertaking project assignments in all his areas of speciality, John also provides training on those subjects. He is a vendor of record with the provinces of Ontario, Nova Scotia, Manitoba, British Columbia, the Federal government and Nunavut Territory. He is an instructor for the Canadian Evaluation Society, the Association of Municipal Managers, Clerks and Treasurers of Ontario and the Ontario Municipal Social Services Association.
John is an instructor in public sector management topics with the University of Alberta’s School of Business, the Sprott School of Business at Carleton University and the Schulich School of Business at York University.
Tickets: https://www.eventbrite.ca/e/essential-skills-series-september-2018-tickets-47870377588.

Eval Cafe: OTF’s Evaluation and Measurement Hub Discussion
2018-07-24 17:00 - 19:00
The Ontario Trillium Foundation (OTF) had launched an online shared learning environment, the Knowledge Centre, to help connect Ontario’s nonprofit sector. This site includes a discussion forum, and a resource library that will grow with the sector’s engagement.
The discussion forums are centered around OTF’s six Action Areas, and two other topics currently, evaluation and measurement, and open data. OTF’s hope is that this site will be a space that can help make connections across the nonprofit sector and where people can share stories, challenges opportunities, and important resources.
As mentioned above, one of the discussion forums focuses on evaluation and measurement (Measurement Hub). Come join Stacey McDonald, the Measurement Hub’s moderator on Tuesday, July 24th to help us discuss how this space can be useful to people doing evaluative work in the nonprofit sector. OTF wants to hear from you about what types of discussions or resources would be most helpful and how such as space could help you in your work.
To help individuals with kids and/or other evening engagements attend our events, we are testing out a 5pm start time. The discussion will get started around 5:30pm, followed by time for open networking.
Light snacks will be provided courtesy of CES-ON.
Tickets: https://www.meetup.com/Evaluation-Cafe-Toronto/events/252675605/.

July 2018 Essential Skills Series
2018-07-09 08:30 - 2018-07-12 16:30
This 4-day course was developed by the Canadian Evaluation Society to provide participants with a basic understanding of the main models and practices associated with the profession of evaluation. Prior knowledge of evaluation and of social science research methods is not required. There are no examinations associated with the course, nor is there any homework. Participation in all 15 course modules entitles you to a Certificate of Completion from the Canadian Evaluation Society.
Participants will gain basic levels of knowledge, skill and appreciation with respect to the essential elements of evaluation, equipping them to enter and participate in the evaluation field and develop as evaluation professionals.
Breakfast, lunch, and coffee breaks and included in the registration fee.
Course Competencies
Participants will be able to describe in basic terms:
• the uses and benefits of evaluation (1)
• common settings in which evaluation takes place (1)
• where evaluations and performance monitoring fit in the program cycle (1)
• underlying theories related to evaluation, and their implications (1)
• the historical and technical context in which evaluation takes place (1)
• the range of terminology used in evaluation (1)
• causes of, and responses to, resistance (4)
• potential misuses of evaluation (4)
• cultural considerations in conducting evaluations (4)
• ethical considerations with respect to evaluation (6)
• evaluation standards (6)
• evaluation as a profession (9)
• the role of CES, including the CE system (9)
• special applications of evaluation (15)
• the relevance of, and processes associated with:
o identifying evaluation objectives (2)
o identifying and engaging evaluation clients and stakeholders, and establishing roles (2)
o develop a program profile (3)
o creating evaluation questions (5) and indicators (7)
o common data collection methods (8, 10)
o creating an appropriate and valid evaluation design, including the selection of data collection methods (11)
o collecting data, including performance monitoring (12)
o data management (12)
o assessing data quality (12)
o data analysis, including cost effectiveness analysis (12)
o determining evaluation scale and budget (13)
o project management (13)
o synthesis of evidence leading to the development of conclusions and recommendations (14)
o evaluation reporting and dissemination (14)
Participants will also gain elementary experience in:
• creating logic models (3)
• developing indicators (7)
• question construction (5)
• creating an evaluation matrix (11)
• writing findings statements (12)
• creating a reporting plan (14)
About the Facilitator
Dr. Keiko Kuji-Shikatani, C.E., is an internal evaluator with the Ministry of Education, infusing evaluative thinking in collaborative teams to build sector capacity for the use of evidence to inform decisions. She shares her DE expertise widely leading interministerial collaborations, evaluation capacity building for governments both in Canada and internationally, through universities, civil societies and EvalPartners.
Tickets: https://www.eventbrite.ca/e/july-2018-essential-skills-series-tickets-46511284504.

2018 CES Ontario AGM + Member Consultation
2018-06-19 08:30 - 12:00
Please join us for the 22nd annual CES Ontario AGM + Member Consultation! This event is open to all members of the Canadian Evaluation Society – Ontario chapter, as well as interested members of the public.
Event Agenda:
8:30 – 9:00 AM: Registration, Breakfast & Networking
9:00 – 10:00 AM: AGM
10:00 – 10:30 AM: Break & Networking Event
10:30 – 11:55 AM: CES Ontario Integrated Strategic-Operational Plan Member Consultation
11:55 – 12:00 PM: Closing Statements
Member Consultation:
Sonja Nerad from SN Management will be facilitating a session at the upcoming Annual General Meeting. The purpose of this 90-minute session is to provide members of CES-ON with an opportunity to engage in the current strategic and operational planning and inform the Board of Directors decision making process as it looks to establish its three-year priorities. In advance of the session we will share a “Backgrounder” that will set out the key issues that are facing our organization and provide the evolving context for our strategic planning. SN Management will ask members to critically reflect on the key issues and help to shape the emerging strategic plan by assessing a series of opportunities and options for strengthening the Chapter’s relevance and sustainability over the coming three to five years.
About the Consultants:
Sonja Nerad, founder and owner of SN Management is excited to be supporting the CES-ON to develop an integrated strategic and operational plan. SN Management is a fully incorporated management consulting firm established in 2011 specializing in planning, operations improvement and innovation. We use a strengths based approach grounded in principles of respect and trust to help organizations achieve tangible and practical results while building capacity for continuous learning, innovation and sustainability.
The SN Management Team includes Sonja Nerad, associate Fredrick Kreutlein and Leigh Himel, CEO, Gravity Partners, a brand strategy, marketing and communications planning firm. Together, we offer CES-on our expertise in:

Strategic and business planning
Integrated brand assessment, planning and marketing
Stakeholder engagement, consultation and change management
Organization/system review, design, development and capacity building
Full cycle program planning, evaluation, performance measurement and reporting
Partnership development, front/back office and corporate integration
Leadership coaching, mentoring and interim management.

Tickets: https://www.eventbrite.ca/e/2018-ces-ontario-agm-member-consultation-tickets-46382059990.
