A Roadmap: Impact Evaluation to Development Impact (i2i)

Size: px

Start display at page:

Download "A Roadmap: Impact Evaluation to Development Impact (i2i)"

Mildred Porter
5 years ago
Views:

1 A Roadmap: Impact Evaluation to Development Impact (i2i) M Abul Azad IE Coordinator, DIME ieconnect Impact Evaluation Workshop Rio de Janeiro, Brazil June 22-25, 2015

2 What have we done Oops

3 What have we really done? QUESTIONS SOLUTIONS? METHODS

4 What will we do next? PRESENT DESIGN IMPLEMENT DISSEMINATE

5 Who will be involved? PROJECT IMPLEMENTATION TEAM WORLD BANK OPERATIONS TEAM IMPACT EVALUATION RESEARCH TEAM

6 Design Inputs: o Project design (determines overall structure of the project and sets overarching development objectives) o Impact evaluation research questions and hypotheses o Evidence, experience, expertise Output: o IE concept note o IE concept note review meeting

7 Design TASKS Project Implementation Team World Bank Operational Team Impact Evaluation Research Team IE design mission Joint responsibility Intervention design Concept note drafting Concept note review Intervention design and approval Policy, operational, technical inputs; review; no objection Review and respond to comments; attend meeting Operational and technical inputs Drafting Primary responsible for responding to comments; redrafting if needed

8 Implementation IE data collection and analysis Inputs Research protocol Data collection tools and procedures Analytical plan Funding Outputs Datasets Intermediate and final analyses Feedback to the project team Implementation of IE interventions Inputs Operational manual Monitoring tools Implementing partners Funding Outputs Activities implemented Field reports Monitoring data

9 IE data collection and analysis TASKS Ethical clearance Design of data collection tools and procedures Hiring of data collection firm Funding of data collection Supervision of data collection Analysis and drafting of reports/briefs Project Implementation Team Support with national guidelines World Bank Operational Team Context and sector expertise Hiring of firm Primary responsibility Supervision of contract Supervision of process No objection Supervision of process Operational and policy inputs Impact Evaluation Research Team Drafting and submission Development of tools TOR drafting; technical review Supervision & direct inputs into fieldwork Analytical work

10 Implementation of IE interventions TASKS Drafting of operational manual Implementation of interventions Funding of implementation Project Implementation Team Primary responsibility Primary responsibility Primary responsibility World Bank Operational Team Supervision and technical and operational inputs Planning support and supervision Supervision Impact Evaluation Research Team Technical and operational inputs Planning and implementation support Ongoing monitoring Primary responsibility Supervision Planning and implementation support

11 Dissemination Inputs/Activities: o IE and M&E data o Analyses o Dissemination strategy Outputs: o Ongoing feedback o Policy and operational briefs o In and out-of country dissemination events (seminars, workshops, conferences) o Working papers and journal articles o Social media

12 Dissemination TASKS Ongoing operational and policy feedback Preparation of reports and briefs Dissemination incountry Dissemination out of country Project Implementation Team Willingness to adjust World Bank Operational Team Support adjustment processes Policy, operational, technical input Securing key audiences; preparing and presenting Preparing and presenting Impact Evaluation Research Team Provide feedback Primary responsibility Preparing and presenting Securing key audiences; preparing and presenting Academic papers Operational and policy inputs Primary responsibility Social media Shared responsibility

13 PRESENT (today) A A roadmap example Baseline data collection and analysis Roll-out of activities Follow-up data collection(s) Design mission Concept note review and approval IMPLEMENT End-of-evaluation dissemination activities DESIGN DISSEMINATE

14 Big question What are the costs? o Research design & concept note development o Data collection o Analysis o Intervention o Dissemination

15 Bigger question Who will pay for all these?

16 INVESTMENT CATEGORY INTERVENTIONS DATA COLLECTION RESEARCH TEAM SOURCE OF FUNDING PROJECT BUDGET PROJECT M&E BUDGET EXTERNAL SOURCES (E.G. i2i)

17 i2i $25,000 $50,000 x 3 $20,000

18 i2i Expression of interest Technical review by external reviewers Policy review by World Bank regional departments $25k seed funding for concept note development $50k IE implementation funding per year for three years $20k dissemination funding

19 Thank You! WEB facebook.com/ieknow #impacteval blogs.worldbank.org/impactevaluations microdata.worldbank.org/index.php/catalog/ impact_evaluation

Fund for Gender Equality Monitoring and Evaluation Framework Executive Summary

Fund for Gender Equality Monitoring and Framework Executive Summary Primary Goal of the Monitoring and Framework The overall aim of this Monitoring and (M&E) Framework is to ensure that the Fund for Gender