The Impact Evaluation series consists of 13 methodological briefs and four whiteboard animation videos which cover the basics of impact evaluation, including how to plan and manage an impact evaluation, select the appropriate strategy for inferring causal attribution, and choose appropriate data collection and analysis methods.
The four whiteboard animation videos included in this activity, summarize the content of the briefs in an engaging and user-friendly manner. To gain a deeper understanding of impact evaluation, we recommend that you read the briefs, and explore the “pros” and “cons” of each approach, the relevant ethical issues and practical limitations, and UNICEF examples of good practices and common challenges in more detail. All materials were written by international evaluation experts from RMIT University, BetterEvaluation and the International Initiative for Impact Evaluation (3ie).
The four videos on this page explore each topic using case studies inspired by UNICEF impact evaluation:
- In the Building Blocks of Impact Evaluation video, Anne, a Monitoring & Evaluation Specialist from UNICEF Kenya walks us through the steps she needs to think about when planning an impact evaluation.
- The Strategies for Causal Attribution video is narrated by a Social Policy Specialist from UNICEF Nicaragua called Carlos. He is in charge of evaluating a child rights policy implemented in selected provinces and needs to decide on the most appropriate design for his context.
- The Randomized Controlled Trials (RCTs) video uses an actual UNICEF impact evaluation of an ECD trial in Pakistan to explain key concepts like random sampling, random assignment, stratified sampling and factorial design.
- In the final video, Data Collection and Analysis, Vadim from UNICEF Moldova walks us through the key issues he needs to consider when selecting the appropriate data collection and analysis methods for an evaluation of Child Friendly Schools.
Learning objectives
After watching these videos, you will :
- Understand the basic components of impact evaluation, including the theory of change, key evaluation questions, and different design, and data collection and analysis options.
- Be able to name who needs to be involved in an impact evaluation.
- Understand how a theory of change is used in an impact evaluation.
- Understand the difference between experimental, quasi-experimental and non-experimental designs.
- Understand the concepts of random sampling, random assignment, stratified sampling and factorial design.
Audience
The principal audience of the Impact Evaluation series is UNICEF staff involved in commissioning or applying data from impact evaluations. The secondary audience is UNICEF staff interested in learning more about impact evaluations. The videos are narrated and drawn in a way that allows staff who do not have a research background to learn some of the basic concepts of impact evaluation. Although the videos were designed specifically for UNICEF, others interested in impact evaluation will also benefit from these materials.
Length
It should take you about 30 minutes to view all four videos.
Methodology
The videos on this page use the whiteboard animation method to explain the basic concepts of impact evaluation. The videos are supporting materials only and we recommend that you read the methodological briefs they accompany to learn more.
Structure
This videos cover the following topics:
- Building Blocks of Impact Evaluation
- Strategies for Causal Attribution
- Randomized Controlled Trials (RCTs)
- Data Collection & Analysis Methods
Contact details
Shivit Bakrania, Knowledge Management Specialist, Research – Innocenti: sbakrania@unicef.org