WHAT ARE JOINT SECTOR REVIEWS AND WHY DO THEY MATTER? I L L U S T R AT E D B Y S T O R I E S F RO M A RO U N D T H E W O R L D P R E S E N T A T I O N G I V E N A T T H E A G U A S A N W O R K S H O P, S P I E Z, S W I T Z E R L A N D O N 2 6 J U N E 2 0 1 8 Dr Kerstin Danert kerstin.danert@skat.ch http://skat.ch/portfolio-item/learning-note-on-evidence-on-the-effectiveness-of-jointsector-reviews-in-fragile-states/
WHY ARE JOINT SECTOR REVIE WS NEEDED FOR WASH?... because of the donors and many foreign actors fragmentation is unmanageable for the donors to help find our what others are doing; those isolated come together and can compare to shed light on innovative and promising approaches by NGOs before, NGOs blamed as a platform to discuss and understand each other and discuss properly VALUE OF THE JSR PROCESS TO STAKEHOLDERS IN NEPAL, Danert and Karki (2015)
THE JOINT SECTOR REVIEW P ROCESS A VISUAL CHECKLIST Wider context of activities and processes NGO coordination or network Donor or development partner working group coordination mechanism programme constitution Water act or law Joint assistance strategy Local reporting Water policy reporting Wide Approach (SWAp) General budget support planning framework investment plan Medium term expenditure framework strategy Planning & budgeting cycle Wider context of laws and policies Wider context of activities and processes NGO coordination or network Donor or development partner working group coordination mechanism programme constitution Water policy planning framework Water act or law strategy reporting General budget support Joint Medium assistance Local term strategy expenditure framework reporting Wide Approach (SWAp) Planning & budgeting cycle investment plan Wider context of laws and policies WASH cluster budget support Local development initiatives WASH cluster budget support Local development initiatives Private sector associations Water user associations Data collation, GIS & analysis expertise Presentation and debating skills Report writing & editing skills Venue suitable for 200-400 people Stakeholder coordination & reporting Transport & comms costs Event facilitation skills Performance Report Setting priority actions Evidence open to academic scrutiny Staff time costs Publicity (language, content, medium) Regular cycle (annual/ biennial) Training & JSR Activities capacity development & Processes Mid-term review event Secretariat Logistics, with control of Skills & budget and organisation Resources Leadership of the JSR process List of attendees Agreed scope, objectives ToR Field visits or verification of reports News media invited to JSR Gathering JSR Gathering (0.5-3 days) Binding Commitments/ Undertakings Civil Society / Pre-Gathering NGO written papers response Post- Gathering report & public summary in newspapers Donor/ Agreed targets Development and indicators Partner Written Response Financial and activity reports from public bodies Documents published online JSR Documentation Monitoring Framework Human Right to water & sanitation Legal & Policy framew ork Finance Water resources monitoring & Climate change monitoring & disaster risk reduction Water for nature Ecosystems services Gender, disabled Institutional accessibility, marginalised Themes groups Coordination, harmonisation & alignment Urban water Wastewater, supply & sewerage & s WASH-related Water, Sanitation Hygiene & health impacts Agriculture/ Water for Production Water for industry & energy Staffing & human resources Rural water supply & Drainage and flood control Urban sanitation & Rural sanitation & Water Drought Resources management IWRM Water quality and pollution monitoring & Solid waste management & Hygiene (WASH) WASH in health centres WASH in schools agreement Evaluation Reports Census Water supply inventory Wider context of implementation stakeholders & reporting surveys Groundwater & Surface water databases Global / remote sensing databases Project and programme reports Academic research Citizens CSOs, NGOs, ingos Self-supply agencies Local agencies Political leaders Private sector Donor agencies Research & training organisations Agency projects programme Training Reforms System management Utility management Regulation Water user associations Private sector associations Data collation, GIS & analysis expertise Presentation and debating skills Report writing & editing skills Venue suitable for 200-400 people Stakeholder coordination & reporting Transport & comms costs Event facilitation skills Performance Report Nepal Setting priority actions Evidence open to academic scrutiny Staff time costs Publicity (language, content, medium) Regular cycle (annual/ biennial) Mid-term review event Leadership of the JSR process List of attendees Agreed scope, objectives ToR Field visits or verification of reports JSR Activities Training & capacity development & Processes Secretariat Logistics, with control of Skills & budget and organisation Resources News media invited to JSR Gathering JSR Gathering (0.5-3 days) Binding Commitments/ Undertakings Civil Society / Pre-Gathering NGO written papers response Post- Gathering report & public summary in newspapers Donor/ Agreed targets Development and indicators Partner Written Response Financial and activity reports from public bodies Documents published online JSR documentation monitoring framework Human Right to water & sanitation Legal & Policy framew ork Finance Water resources monitoring & Climate change monitoring & disaster risk reduction Water for nature Ecosystems services Gender, disabled Institutional accessibility, marginalised Themes groups Coordination, harmonisation & alignment Urban water supply & s WASH-related Hygiene health impacts Hygiene (WASH) Rural water WASH in health supply & centres Agriculture/ Water for Production Water for industry & energy Staffing & human resources Drainage and flood control Transboundary Resources Transboundary Resources Urban sanitation & Rural sanitation & Water Drought Resources management IWRM Water quality and pollution monitoring & Solid waste management & Wastewater, sewerage & Water, Sanitation & WASH in schools agreement Evaluation Reports Census Water supply inventory Citizens Wider context of implementation stakeholders & reporting surveys Groundwater & Surface water databases Global / remote sensing databases Project and programme reports Academic research CSOs, NGOs, ingos Self-supply agencies Local agencies Political leaders Private sector Donor agencies Research & training organisations Agency projects programme Training Reforms System management Utility management Regulation
WHAT IS A JOINT SECTOR REVIEW (JSR)? Pre-Gathering preparation such as: meetings, data collation, field visits, preparation of input papers and/or sector report JSR Gathering Post-Gathering report, commitments and follow-up meetings national context, reforms and WASH service delivery CYCLE 1 CYCLE 2 CYCLE 3 Key: communication status & action time There is no standard definition of a Joint Review (JSR). For our purposes, a JSR is a periodic process that brings different stakeholders in a particular sector together to engage in dialogue, review status, progress and performance and take decisions on priority actions (often called undertakings, or commitments).
IS A JSR PROCESS RELEVANT FOR WASH? Stakeholder interaction Dealing with multiple donors, & NGOs and fragmentation Pre-Gathering preparation such as: meetings, data collation, field visits, preparation of input papers and/or sector report JSR Gathering Post-Gathering report, commitments and follow-up meetings national context, reforms and WASH service delivery CYCLE 1 CYCLE 2 CYCLE 3 Key: communication status & action time But - JSR objectives need to be relevant for stakeholders
WHERE AND WHEN HAVE JSR S (FOR WASH) TAKEN PL ACE (2001 2015)? Country MATURE Rwanda Uganda INTERMEDIATE Burkina Faso Burundi Ethiopia Kenya Malawi Niger Senegal Tanzania Zambia Fragile State Protracted Crisis No. years with JSRs 11 JSR in the Year (20' ) 15 7 5 6 9 8 8 8 9 6 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 1 1 KEY Country included in one or more of the OECD fragile states reports between 2007 and 2015 (OECD, 2015 pp32) UN peace-keeping operation in the country between 2012 and 2015 Country included in the FAO (2010 or 2015) updated list for countries in protracted crisis One or more JSR gatherings took place in that year No JSR in 2015 BASIC (Continuing) Laos PDR Liberia Nepal Sierra Leone BASIC (Discontinued) Ghana South Sudan Yemen Zimbabwe NO EXPERIENCE Afghanistan East Timor Indonesia Jordan Somalia West Bank & Gaza 1 3 2 2 4 4 2 1 0 0 0 0 0 0 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 2 NOTES 1. 1 The 2011 and 2015 meetings in Burkina Faso were both entitled national Forum and prepared for the participation of country in the World Water Forums in Marseille, France (2012) and Daegu-Gyeongbuk, South Korea (2015). 2. 2 Indonesia International Water Week (2015) had many features of a JSR Gathering. Technical review meetings (a second review type meeting, or half-yearly meeting) have taken place in Burkina Faso (2013), Ethiopia (some years), South Sudan (2010), Uganda and Rwanda. 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15
WHERE AND WHEN HAVE JSR S (FOR WASH) TAKEN PL ACE (2001 2015)? See Poster!
MY JOINT SECTOR REVIE W (JSR) JOURNEY OF DISCOVERY In Uganda, 2004 - Worked with colleagues on the official Uganda NGO response to the 1 st Water and Sanitation Performance Report (SPR) we were critical and demanding (and had NO idea of how difficult the process to consolidate the data had actually been) In Uganda, 2005 to 2010 Technical Support in preparing the Uganda Water and Sanitation, then Water and Environment SPRs, including preparing for presentation and discussion at the Joint Review Gathering (of about 200 participants) extremely demanding, but rewarding experience to encourage authors & challenge conclusions reached. From Switzerland, 2010 Drawing together contributions on country-led monitoring from six countries for IRC WASH Symposium on monitoring not everywhere operates like Uganda! It led to a chapter in a book (From infrastructure to Services. From Switzerland, 2012 Worked with my Ugandan colleague, Disan Ssozi to document Uganda s Monitoring Experiences which I believe informed & inspired others. In Northern Bahr el Ghazal, South Sudan, 2013 brought simple but important reflections on data into the State WASH Cluster Meeting started to think more about the role of JSRs in the transition from a Humanitarian to Developmental context. In Liberia, 2014 Supporting 10 Ministries, plus NGOs to collate data for the First Water and Sanitation SPR and JSR phew it came together, with considerable joint learning! From Switzerland and in Nepal, 2015/16 First study of Effectiveness of Joint Reviews for Water and Sanitation (WASH) of 25 countries, with an emphasis on Fragile States and tracking down numerous hidden information sources...
JSR STORIES First and second-hand
D A T A C O L L E C T I O N & R E P O R T I N G A N D T H E M U L T I - S T A K E H O L D E R P L A T F O R M NORTHERN BAHR E L GHA ZAL STATE, SOUTH SUDAN 2013 & 2014 View from the road to Aweil South at the end of the rains View from the road to Aweil South as the dry season commences
Multi-stakeholder platform Monthly stakeholder gathering: WASH CLUSTER MEETING Hosted by the Ministry of Water, Cooperatives and Rural Development (since June 2014) Reporting, sharing of information, discussion, agreeing actions Data and Reporting Water Information Management System (WIMS): Federal to State Government Seasonal Borehole in Mariduakum, Mariam West Semi-informal reporting: handpump mechanics Payam County State Some NGOs report to county
SIMPLE ANALYSIS AND VISUALISATION TO FOSTER DISCUSSION Boreholes coverage in the five counties of NBEG and Aweil Town Location of New Boreholes Drilled and Installed from July 2013 to Nov 2014 County Ave no. of people per functional borehole Aweil North 417 Aweil East 667 Aweil West 51 20% Aweil North 72 28% Aweil Centre 9 4% Aweil West 702 Aweil South 575 Aweil Centre 1019 Aweil Town 765 Total 595 Aweil East 116 46% Aweil South 5 2%
LIBERIA, 2014 M O T I V A T I N G, B U I L D I N G A T E A M, R A I S I N G S K I L L S & C O N S O L I D A T I N G D A T A... F O R D I S C U S S I O N A N D D E C I S I O N M A K I N G Development Partner:...getting people working in the Ministries to write...nice idea but it won t work here... so what is your plan B? Kerstin, Skat: err... there is no plan B. We have to make this work... [nervous smile] - I think that it helps if we believe that the proposed approach can work.
Performance Report Authors WASH Data Flows... Peer review of the Draft Performance Report (Libassa Ecolodge)
Monrovia Piped Service Areas (Adapted from sketch from JICA project report and discussions with LWSC staff) Donor Aid for WASH: Budget for Fiscal Year 2012/13 and 2013/14 and Projections for 2014/15 (Source: Aid Management Unit, Ministry of Finance; data available on request) Report extract for the newspaper
Tips for a Performance Report (from Liberia) for later reading... Determine scope, audience, purpose and an outline structure for the Performance Report early on Key elements work closely with different agencies AND Agree on roles and responsibilities the report must synthesize A LOT without being too long, or losing focus; Compiling, consolidating, prioritizing the information; the importance of an internal retreat; emphasis on building analytical, writing and Facilitation skills to prepare the report and run the review; Balance raising skills with the scope of the report to ensure quality. Build up key relationships and teams for the SPR process and to run the JSR gathering; Process of drafting, reviewing and quality assuring the SPR and preparing for the JSR The process of preparing the report depended on the motivation, leadership, skills and team work of the Liberia Core Team.
R E P O R T I N G, L E A R N I N G H O W T O P R E S E N T D A T A A N D C O M M I T M N E N T S F O R A C T I O N ( U N D E R T A K I N G S ) UGANDA 2004 TO 2011
Data sources & flow in Performance Measurement Framework (SPMF) in Uganda Joint Review Mini Performance Reports by Sub-s Water & Environment Working Group Performance Report (SPR) Data (annually) Various Survey Reports Data (annually) Small SPR Secretariat (in Ministry of Water and Environment) Annual Report ata annually) UWASNET Ministry of Water and Environment MIS Quarterly & Annual Reports District Local Government (District Water Office) Technical Audits Tracking Studies Ministry of Health MIS District Local Government (District Health Inspectorate) Uganda Bureau of Statistics Specific Surveys Ministry of Education & Sports School Inspections MIS NGOs/CBOs NGOs/CBOs NGOs/CBOs Community Visits Community Visits Communities Health Inspections Schools A B C MIS Key Data Collection Reporting Management Information System Government Institution Non-Government Institution Coordination Body
Kabarole Rukungiri Gulu Kanungu Lira Kabale Abimu Kamwenge Nakaseke Dokolo Kitgum Katakwi Kapchorwa Nebbi Mpigi Bukwo Sironko Amuru Bundibugyo Arua Bushenyi Ntungamo Kaberamaido Masaka Nakasongola Kyenjojo Busia Hoima Mbarara Soroti Wakiso Bududa Kasese Mbale Bukedea Luwero Maracha - Terego Mityana Budaka Kibale Koboko Apac Mukono Oyam Ibanda Amolatar Jinja Kayunga Kumi Masindi Tororo Iganga Namutumba Pader Pallisa Kamuli Kalangala Kiboga Butaleja Amuria Kaliro Manafa Lyantonde Moyo Sembabule Kisoro Mayuge Moroto Rakai Adjuman Mubende Kotido Nakapiripirit Isingiro Yumbe Bugiri Kiruhura Bulisa Kaabongo % Access to an Improved Water Supply Graph used in 2012 to illustrate the disparity in access to safe water between districts in the 2010 Performance Report, with red bars illustrating districts below the national average of 65% at that time 100 90 80 Average 65% 70 60 50 40 30 20 10 0 65
M A K I N G B E T T E R U S E O F AVA I L A B L E DA T A A N D R E F E R E N C I N G SEVERAL COUNTRIES Ethiopia, Tanzania and Nepal no succinct overview in their national reports, despite the availability of data! Yemen and Zimbabwe plenty of data, but lack of references regarding the sources. The above takes place despite the presence of leading international agencies in the country and involved in the process.
B U I L D I N G A M U LT I - S T A K E H O L D E R C O M M U N I T Y F O R WA S H NEPAL, 2014 Six week preparation process for the conference: meetings, thematic group formation, brainstorming, checklists, learning visits and sharing meetings. identify core issues, review policy, capture learning and compliance, and recommend actions. Working papers and presentations. 70 people participated in the planning meeting, 55 in the learning visits, and 80 in the learning visit sharing; there were 200 stakeholders at the JSR conference.
JSR EFFECTIVENESS At their best, JSR processes provide a reliable overview of finance, implementation, institutions, and gaps; bring sector stakeholders together; and contribute towards driving reforms and improving sector governance. At their worst, there is hurried preparation for a poorly facilitated gathering that identifies a plethora of problems and priorities for action that fail to be implemented or followed-up on. Most JSR processes fall somewhere in between the above extremes. (Danert et al, 2016) Where the JSR process fell down was the follow-up (Anon, 2015)
THE JOINT SECTOR REVIEW P ROCESS A VISUAL CHECKLIST Wider context of activities and processes NGO coordination or network Donor or development partner working group coordination mechanism programme constitution Water act or law Joint assistance strategy Local reporting Water policy reporting Wide Approach (SWAp) General budget support planning framework investment plan Medium term expenditure framework strategy Planning & budgeting cycle Wider context of laws and policies Wider context of activities and processes NGO coordination or network Donor or development partner working group coordination mechanism programme constitution Water policy planning framework Water act or law strategy reporting General budget support Joint Medium assistance Local term strategy expenditure framework reporting Wide Approach (SWAp) Planning & budgeting cycle investment plan Wider context of laws and policies WASH cluster budget support Local development initiatives WASH cluster budget support Local development initiatives Private sector associations Water user associations Data collation, GIS & analysis expertise Presentation and debating skills Report writing & editing skills Venue suitable for 200-400 people Stakeholder coordination & reporting Transport & comms costs Event facilitation skills Performance Report Setting priority actions Evidence open to academic scrutiny Staff time costs Publicity (language, content, medium) Regular cycle (annual/ biennial) Training & JSR Activities capacity development & Processes Mid-term review event Secretariat Logistics, with control of Skills & budget and organisation Resources Leadership of the JSR process List of attendees Agreed scope, objectives ToR Field visits or verification of reports News media invited to JSR Gathering JSR Gathering (0.5-3 days) Binding Commitments/ Undertakings Civil Society / Pre-Gathering NGO written papers response Post- Gathering report & public summary in newspapers Donor/ Agreed targets Development and indicators Partner Written Response Financial and activity reports from public bodies Documents published online JSR Documentation Monitoring Framework Human Right to water & sanitation Legal & Policy framew ork Finance Water resources monitoring & Climate change monitoring & disaster risk reduction Water for nature Ecosystems services Gender, disabled Institutional accessibility, marginalised Themes groups Coordination, harmonisation & alignment Urban water Wastewater, supply & sewerage & s WASH-related Water, Sanitation Hygiene & health impacts Agriculture/ Water for Production Water for industry & energy Staffing & human resources Rural water supply & Drainage and flood control Urban sanitation & Rural sanitation & Water Drought Resources management IWRM Water quality and pollution monitoring & Solid waste management & Hygiene (WASH) WASH in health centres WASH in schools agreement Evaluation Reports Census Water supply inventory Wider context of implementation stakeholders & reporting surveys Groundwater & Surface water databases Global / remote sensing databases Project and programme reports Academic research Citizens CSOs, NGOs, ingos Self-supply agencies Local agencies Political leaders Private sector Donor agencies Research & training organisations Agency projects programme Training Reforms System management Utility management Regulation Water user associations Private sector associations Data collation, GIS & analysis expertise Presentation and debating skills Report writing & editing skills Venue suitable for 200-400 people Stakeholder coordination & reporting Transport & comms costs Event facilitation skills Performance Report Nepal Setting priority actions Evidence open to academic scrutiny Staff time costs Publicity (language, content, medium) Regular cycle (annual/ biennial) Mid-term review event Leadership of the JSR process List of attendees Agreed scope, objectives ToR Field visits or verification of reports JSR Activities Training & capacity development & Processes Secretariat Logistics, with control of Skills & budget and organisation Resources News media invited to JSR Gathering JSR Gathering (0.5-3 days) Binding Commitments/ Undertakings Civil Society / Pre-Gathering NGO written papers response Post- Gathering report & public summary in newspapers Donor/ Agreed targets Development and indicators Partner Written Response Financial and activity reports from public bodies Documents published online JSR documentation monitoring framework Human Right to water & sanitation Legal & Policy framew ork Finance Water resources monitoring & Climate change monitoring & disaster risk reduction Water for nature Ecosystems services Gender, disabled Institutional accessibility, marginalised Themes groups Coordination, harmonisation & alignment Urban water supply & s WASH-related Hygiene health impacts Hygiene (WASH) Rural water WASH in health supply & centres Agriculture/ Water for Production Water for industry & energy Staffing & human resources Drainage and flood control Transboundary Resources Transboundary Resources Urban sanitation & Rural sanitation & Water Drought Resources management IWRM Water quality and pollution monitoring & Solid waste management & Wastewater, sewerage & Water, Sanitation & WASH in schools agreement Evaluation Reports Census Water supply inventory Citizens Wider context of implementation stakeholders & reporting surveys Groundwater & Surface water databases Global / remote sensing databases Project and programme reports Academic research CSOs, NGOs, ingos Self-supply agencies Local agencies Political leaders Private sector Donor agencies Research & training organisations Agency projects programme Training Reforms System management Utility management Regulation
Q & A Question: Does data matter for a good Joint Review Process? My answer: Definitely, but remember that it one part of the story! Data cannot DRIVE a Joint Review. The process is DRIVEN by the sector stakeholders
CLOSING WORDS Joint Reviews are social and technical. Emphasize learning Strengthen reporting Adapt over time Encourage open discussion Publish the documentation Link to implementation and services on the ground!
REFERENCES Danert, K. 2015b. Messy, Varied and Growing: Country-led Monitoring of Rural Water Supplies. In From Infrastructure to Services: Trends in Monitoring Sustainable Water, Sanitation and Hygiene Services, edited by T. Schouten and S. Smits (2015). Practical Action Publishing. DANERT, K, FUREY, S, MECHTA, M and GUPTA, S (2016) Effective Joint Reviews for Water, Sanitation and Hygiene (WASH). A Study and Guidance - 2016, World Bank, World Bank, http://www.rural-water-supply.net/en/resources/details/757 DANERT, K., S. FUREY, J. SCHMITZER, AND C. HALL. 2014. WASH Liberia Performance Report 2014 & Joint Review: Process Report. Skat: Switzerland http://www.rural-watersupply.net/en/resources/details/582]. DANERT, K., AND K. KARKI. 2016. Effective Joint Reviews for Water, Sanitation and Hygiene (WASH) A Case Study from Nepal 2015. Washington, USA: Water and Sanitation Programme of the World Bank [http://www.rural-water-supply.net/en/resources/details/757].
REFERENCES DANERT, K., S. FUREY, M. MECHTA, AND S. GUPTA. 2016. Effective Joint Reviews for Water, Sanitation and Hygiene: Learning Note. Washington, USA: Water and Sanitation Programme of the World Bank [http://skat.ch/wp-content/uploads/2018/05/jsr-learning- Note.pdf]. GOVERNMENT OF LIBERIA. 2014. Water, Sanitation & Hygiene (WASH) Performance Report 2013. Government of the Republic of Liberia [www.wash-liberia.org].. 2015. Water, Sanitation & Hygiene (WASH) Performance Report 2014. Government of the Republic of Liberia [www.wash-liberia.org]. SSOZI, D., AND K. DANERT. 2012. Monitoring of Rural Water Supplies. How the Government of Uganda did it and lessons for other countries. RWSN, St Gallen, Switzerland. Available from [http://www.rural-water-supply.net/en/resources/details/383].
THE END