IZA/DFID Short Course on Program Evaluation

Organizers: David Lam (University of Michigan and IZA), Maryam Naghsh Nejad (IZA)
Location:Dhaka, Bangladesh
Date:December 19, 2015 - December 20, 2015

Event Manager:

Dominik Spitza (IZA)

Please download the pdf program: here


+++ all sessions include 20-30 minutes practical applications (with technical assistance) +++

Saturday, December 19:

08:00 - 09:00   Registration and Distribution of Learning Materials
Teaching Materials
Stata Licenses, Installation
09:00 - 09:15   Welcome and Introduction (All)
09:15 - 10:30   Kate Vyborny (Duke University)
  "Impact Evaluation"
        Theory of Change and Outcome Variable Selection
Potential Outcome Framework
RCT and Other Identification Strategies
10:30 - 11:00   Coffee Break
11:00 - 12:30   Christopher Parsons (University of Western Australia and IZA)
  "Difference in Differences"
        Motivation and Intuition
Historical Example
Graphical Illustration and Formalization
DiD with Regressions
Practical Advice and Sensitivity Analysis
12:30 - 13:30   Lunch
13:30 - 15:00   Marco Caliendo (University of Potsdam and IZA)
  "Matching I"
        What Is (Propensity Score) Matching?
Estimating the Propensity Score
Overlap and Common Support
15:00 - 15:30   Coffee Break
15:30 - 17:00   Marco Caliendo (University of Potsdam and IZA)
"Matching II"
        Choosing a Matching Algorithm
Assessing the Matching Quality
Effect Estimation
17:00 - 17:30   Day 1 Wrap Up (All)
19:00       Dinner

Sunday, December 20:

08:30 - 10:00   Kate Vyborny (Duke University)
"Randomized Evaluations I"
        How to Randomize
(Selecting a Sample; Stratification; Level of Randomization;
Avoiding Spillovers and Clustering; Balance Testing)
Take-Up; Full vs. Partial Randomization
10:00 - 10:30   Coffee Break
10:30 - 12:00   Kate Vyborny (Duke University)
"Randomized Evaluations II"
        Data Collection: from Baseline to Follow-Up
(Sample Size; Timing and Frequency; Attrition)
Heterogeneous Effects
Multiple Arms and Testing Mechanisms
External Validity
12:00 - 13:00   Lunch
13:00 - 14:30   Christopher Parsons (University of Western Australia)
"Regression and Discontinuity Design"
        Motivation and Intuition
Examples: RDD in Practice
Sharp RDD: Formalization and Estimation
Robustness Checks
Fuzzy RDD: Intuition and Practice
14:30 - 15:00   Coffee Break
15:00 - 16:00   Practical Implications and Concluding Remarks (All)
18:00       Dinner


S. M. Abdullah (University of Dhaka)
Shiva Raj Adhikari (Tribhuvan University, Kathmandu)
Rifat Afroze (Bangladesh Rural Advancement Committee (BRAC))
Sibbir Ahmad (Bangladesh Rural Advancement Committee (BRAC))
Maliha Ahmed (Bangladesh Rural Advancement Committee (BRAC))
Moin Uddin Ahmed (University of Dhaka)
Tutan Ahmed (Indian Institute of Management)
Hashan Ali (United Nations Development Programme (UNDP))
Jinnat Ara (Bangladesh Rural Advancement Committee (BRAC))
Abul Kalam Azad (University of Dhaka)
Salma Begum (North South University, Bangladesh)
Marco Caliendo (University of Potsdam and IZA)
Pradeep Choudhury (Jawaharlal Nehru University)
Benoit Conti (United Nations Development Programme (UNDP))
Debasish Kumar Das (Khulna University, Bangladesh)
Alfariany Milati Fatimah (Jameel Poverty Action Lab (JPAL))
Latiful Haque (Bangladesh Rural Advancement Committee (BRAC))
Mohammad Helal (Institute of Developing Economies (IDE-JETRO))
Masyhur Hilmy (Jameel Poverty Action Lab (JPAL))
Shahnaj Hira (United Nations Development Programme (UNDP))
Belayet Hossain (United Nations Development Programme (UNDP))
Azharul Islam (Stamford University, Bangladesh)
Shahidul Islam (University of Dhaka)
Randeep Kaur (University of Texas at Austin)
Nuheen Khan (North South University, Bangladesh)
Tahsina Naz Khan (Bangladesh Rural Advancement Committee (BRAC))
David Lam (University of Michigan and IZA)
Abdul Salam Lodhi (Balochistan University, Pakistan)
Minhaj Mahmud (BRAC University)
Farzana Munshi (BRAC University)
Rubaiya Murshed (University of Dhaka)
Maryam Naghsh Nejad (IZA)
Christopher Parsons (University of Western Australia and IZA)
Thomas Polley (Duke University)
Abdur Rahim (SANEM Dhaka Secretariat)
Atiqur Rahman (Bangladesh Institute of Development Studies (BIDS))
Masud Rahman (SANEM Dhaka Secretariat)
Mohammad Rahman (Bangladesh Institute of Development Studies (BIDS))
Mustafa Rahman (North South University, Bangladesh)
Nabeera Rahman (United Nations Development Programme (UNDP))
Rehnuma Rahman (Bangladesh Rural Advancement Committee (BRAC))
Balram Rao (Indian Institute of Technology Roorkee)
Fabrizio Santoro (Innovations for Poverty Action (IPA))
Rachel Sayers (Duke University)
Musharrat Shabnam Shuchi (University of Dhaka)
Wajid Hasan Shah (Bangladesh Institute of Development Studies (BIDS))
Abu Shonchoy (Institute of Developing Economies (IDE-JETRO))
Claudia Stier (University of Potsdam)
Shubham Tomar (Ministry of Skill Development and Entrepreneurship, India)
Ramiz Uddin (United Nations Development Programme (UNDP))
Sujon Uddin (SANEM Dhaka Secretariat)
Nayamat Ullah (Institute of Developing Economies (IDE-JETRO))
Kate Vyborny (Duke University)
Martin Weißenberger (University of Potsdam)
H.M Asad-Uz- Zaman (a2i Programme)

Suggested Reading

Impact Evaluation:
Difference in Differences:
  • Card, D. & Krueger, A.B. (1994): Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania, The American Economic Review 84, 772-793.

  • Caliendo, M. & Kopeinig, S. (2008): Some Practical Guidance for the Implementation of Propensity Score Matching, Journal of Economic Surveys 22, 31-72.
  • Dehejia, R.H. & Wahba, S. (1999): Causal Effects in Nonexperimental Studies: Reevaluation of Training Programs, Journal of the American Statistical Association 94, 1053-1062.

Randomized Evaluations: Regression Discontinuity Design:
  • Angrist, J.D. & Lavy, V. (1999): Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement, The Quarterly Journal of Economics 114, 533-575.