A Roadmap: Impact Evaluation to Development Impact (i2i) M Abul Azad IE Coordinator, DIME ieconnect Impact Evaluation Workshop Rio de Janeiro, Brazil June 22-25, 2015
What have we done Oops
What have we really done? QUESTIONS SOLUTIONS? METHODS
What will we do next? PRESENT DESIGN IMPLEMENT DISSEMINATE
Who will be involved? PROJECT IMPLEMENTATION TEAM WORLD BANK OPERATIONS TEAM IMPACT EVALUATION RESEARCH TEAM
Design Inputs: o Project design (determines overall structure of the project and sets overarching development objectives) o Impact evaluation research questions and hypotheses o Evidence, experience, expertise Output: o IE concept note o IE concept note review meeting
Design TASKS Project Implementation Team World Bank Operational Team Impact Evaluation Research Team IE design mission Joint responsibility Intervention design Concept note drafting Concept note review Intervention design and approval Policy, operational, technical inputs; review; no objection Review and respond to comments; attend meeting Operational and technical inputs Drafting Primary responsible for responding to comments; redrafting if needed
Implementation IE data collection and analysis Inputs Research protocol Data collection tools and procedures Analytical plan Funding Outputs Datasets Intermediate and final analyses Feedback to the project team Implementation of IE interventions Inputs Operational manual Monitoring tools Implementing partners Funding Outputs Activities implemented Field reports Monitoring data
IE data collection and analysis TASKS Ethical clearance Design of data collection tools and procedures Hiring of data collection firm Funding of data collection Supervision of data collection Analysis and drafting of reports/briefs Project Implementation Team Support with national guidelines World Bank Operational Team Context and sector expertise Hiring of firm Primary responsibility Supervision of contract Supervision of process No objection Supervision of process Operational and policy inputs Impact Evaluation Research Team Drafting and submission Development of tools TOR drafting; technical review Supervision & direct inputs into fieldwork Analytical work
Implementation of IE interventions TASKS Drafting of operational manual Implementation of interventions Funding of implementation Project Implementation Team Primary responsibility Primary responsibility Primary responsibility World Bank Operational Team Supervision and technical and operational inputs Planning support and supervision Supervision Impact Evaluation Research Team Technical and operational inputs Planning and implementation support Ongoing monitoring Primary responsibility Supervision Planning and implementation support
Dissemination Inputs/Activities: o IE and M&E data o Analyses o Dissemination strategy Outputs: o Ongoing feedback o Policy and operational briefs o In and out-of country dissemination events (seminars, workshops, conferences) o Working papers and journal articles o Social media
Dissemination TASKS Ongoing operational and policy feedback Preparation of reports and briefs Dissemination incountry Dissemination out of country Project Implementation Team Willingness to adjust World Bank Operational Team Support adjustment processes Policy, operational, technical input Securing key audiences; preparing and presenting Preparing and presenting Impact Evaluation Research Team Provide feedback Primary responsibility Preparing and presenting Securing key audiences; preparing and presenting Academic papers Operational and policy inputs Primary responsibility Social media Shared responsibility
PRESENT (today) A A roadmap example Baseline data collection and analysis Roll-out of activities Follow-up data collection(s) Design mission Concept note review and approval IMPLEMENT End-of-evaluation dissemination activities DESIGN DISSEMINATE
Big question What are the costs? o Research design & concept note development o Data collection o Analysis o Intervention o Dissemination
Bigger question Who will pay for all these?
INVESTMENT CATEGORY INTERVENTIONS DATA COLLECTION RESEARCH TEAM SOURCE OF FUNDING PROJECT BUDGET PROJECT M&E BUDGET EXTERNAL SOURCES (E.G. i2i)
i2i $25,000 $50,000 x 3 $20,000
i2i Expression of interest Technical review by external reviewers Policy review by World Bank regional departments $25k seed funding for concept note development $50k IE implementation funding per year for three years $20k dissemination funding
Thank You! WEB http://dime.worldbank.org facebook.com/ieknow #impacteval blogs.worldbank.org/impactevaluations microdata.worldbank.org/index.php/catalog/ impact_evaluation