Public Disclosure Authorized EAST ASIA AND PACIFIC Indonesia Education Global Practice IBRD/IDA Specific Investment Loan FY 2013 Seq No: 7 ARCHIVED on 07-Dec-2016 ISR25509 Implementing Agencies: Ministry of Research Technology and Higher Education, Ministry of Research Technology and Higher Education Public Disclosure Authorized Key Dates Key Project Dates Bank Approval Date:29-Mar-2013 Planned Mid Term Review Date:13-Jun-2016 Original Closing Date:31-Dec-2020 Project Development Objectives Effectiveness Date:12-Jun-2013 Actual Mid-Term Review Date:09-Feb-2016 Revised Closing Date:31-Dec-2020 Public Disclosure Authorized Project Development Objective (from Project Appraisal Document) To create an enabling policy environment for research and development in science and technology, to improve the publicresearchanddevelopment institutes performance, and to improve science, technology and innovation human resource capacity. Has the Project Development Objective been changed since Board Approval of the Project Objective? No PHRPDODEL Components Public Disclosure Authorized Name Improving Innovation Policy Framework and Performance of Public Research Centers.:(Cost $4000000.00 M) Strengthening Public Research Funding.:(Cost $4000000.00 M) Developing Science and Technology Human Resources Capacity.:(Cost $80000000.00 M) Project Management.:(Cost $7000000.00 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Unsatisfactory Moderately Unsatisfactory Overall Implementation Progress (IP) Moderately Unsatisfactory Moderately Satisfactory Overall Risk Rating Substantial Substantial 12/7/2016 Page 1 of 11
Implementation Status and Key Decisions Overall project implementation has improved over the past six months, including the departure of 60 scholars from the LPNKs for Master s and Ph.D. studies abroad, and another 455 researchers who have participated in a range of international training programs to build capacity on science, technology and innovation in Indonesia. Project Management Office (PMO) has taken several actions to enhance project implementation, including developing project action plans for the remaining life of the project, assigning staff and consultants to support project implementation, and revising the Project Operation Manual (POM) to accelerate overall activity implementation. Monitoring and Evaluation (M&E) has made progress as evidenced by proactive actions on the part of the PMO team in undertaking the pre- Mid Term Review (MTR) work and in providing timely project evaluation results, as well as practical recommendations on how to move the project forward. In addition, the project is being restructured in line with the government s request. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Substantial Substantial Macroeconomic -- Moderate Moderate Sector Strategies and Policies -- Substantial Moderate Technical Design of Project or Program -- Substantial Substantial Institutional Capacity for Implementation and Sustainability -- Substantial Substantial Fiduciary -- Substantial Substantial Environment and Social -- Moderate Moderate Stakeholders -- Moderate Moderate Other -- -- -- Overall -- Substantial Substantial Results Project Development Objective Indicators PHINDPDOTBL 1. Percentage of LPNK reform milestones reached (Percentage, Custom) Date 13-May-2011 31-Dec-2015 31-Oct-2016 31-Dec-2020 Target in 2016 is not defined. The target for 2017 is 60%, increased 40% from the target in 2015 (20%). Current actual: Supporting activities are being conducted, even though they are limited in number. Since a LPNK is a very large 12/7/2016 Page 2 of 11
institution consisting of many research agencies, the reforms will be focused on the LPNKs research agencies (Technology Transfer Offices). PHINDPDOTBL 2. Share of total LPNK R&D revenue generated from external partners (industry, local community, foreign grant) (Percentage, Custom) Value 5.00 4.00 4.00 12.00 Date 13-May-2011 31-Dec-2015 31-Oct-2016 31-Dec-2020 The baseline is less than 5 percent. Target in 2015 is no change from the baseline. Current actual: The data collected shows that the actual revenues generated by the LPNKs with external partners is lower than the baseline, even though in-kind collaboration of LPNKs with external parties has been increasing. The fluctuation of the generated income is influenced by the extent and willingness of the private sector to collaborate with LPNKs, a factor that is beyond the control of the project. Therefore, this indicator is proposed to be revised to measure efforts within the control of the project. PHINDPDOTBL 3. : Increased % of Masters or PhD degree holders in LPNK and RISTEK (Percentage, Custom) Value 15.00 24.00 24.00 20.00 Date 13-May-2011 31-Dec-2015 31-Oct-2016 31-Dec-2020 Target in 2016 is not identified, target in 2017 is 19%. Current actual: There is a need to revise this indicator as it currently also captures non-project graduates. Therefore, revision of this indicator is needed to ensure that the increased percentage is the result of the project s intervention. Overall Intermediate Results Indicators 12/7/2016 Page 3 of 11
1. National innovation study completed and disseminated (Component 1) (Text, Custom) Value Commence -- In progress Disseminated Date 01-Oct-2013 31-Dec-2015 30-Sep-2016 31-Dec-2019 Target in 2015, the studies are being conducted. The study should be completed in 2017. Current actual: This indicator will be modified as the restructured design will cancel a number of studies and focus more on the development of a national innovation strategy rather than the completion of a national innovation study. This is also in line with the government s new priority and their completed programs. 2. National Information System for STI is established with staff appointed and fund allocated; (Component 1) (Text, Custom) Value Design -- In progress Data updated Date 01-Oct-2013 31-Dec-2015 30-Sep-2016 31-Dec-2020 Target of 2015: Database is established. The end target: Data base is updated. Current actual: E-survey software has been developed. Design and data collection will be conducted in 2017. Data management and maintenance will be undertaken by Pusdatin. 7. Percentage of institutional development targets met (Component 1) (Percentage, Custom) Target of 2016 is not identified, target in 2017 is 60%, increased 40% that the target in 2015 (20%). Current actual: This indicator will be revised to reflect the narrowed focus on 4 LPNKs and their Technology Transfer Offices (TTO). This is in line with the government s priority and will allow for better tracking of project interventions. 12/7/2016 Page 4 of 11
1. RISTEK (Percentage, Custom Supplement) 3. BPPT (Percentage, Custom Supplement) 2. LIPI (Percentage, Custom Supplement) 4. BATAN (Percentage, Custom Supplement) 12/7/2016 Page 5 of 11
5. BAPETEN (Percentage, Custom Supplement) 6. BIG (Percentage, Custom Supplement) 7. BSN (Percentage, Custom Supplement) 8. LAPAN (Percentage, Custom Supplement) 12/7/2016 Page 6 of 11
3. Minimum annual number of annual independent evaluations performed on RISTEK-funded projects (Component 2) (Number, Custom) Value 0.00 0.00 0.00 12.00 Target of 2016 is not defined. The target for2017 is the completion of six evaluations. Current actual: No evaluation was conducted in FY 2016 as the appointment of the independent evaluation team had to be postponed. The target values need to be revised since the evaluation is now postponed to FY 2017 1. Increased number of LPNK staff completing domestic Master s program (Component 3) (Number, Custom) Value 0.00 250.00 250.00 280.00 Target of 2015 is 200. Current actual: Based on data collected by the PMO in April 2015, there has been an increase in domestic Master s degree holders (the number of domestic Master s degree holders in LPNKs at the end of 2015 was 250, the same as in June 2015). It should be noted, however, that the RISET project does not finance the domestic scholarship programs. This indicator therefore will be deleted. 2. Increased number of LPNK staff studied overseas (Component 3) (Number, Custom) Value 0.00 135.00 202.00 210.00 Target for 2016 is 210. From April to September 2016, 60 scholars (28 for Master s and 32 for Ph.D. programs) had traveled abroad for their studies supported by the RISET project. From the start of project implementation to the present, the project has sent a total of 202 scholars for their studies abroad. 12/7/2016 Page 7 of 11
1. Project implementation and monitoring reports (include financial reports) completed (Component 4) (Yes/No, Custom) Value N N N Y Target of 2016 is: Yes Current actual: The project implementation and monitoring report for fiscal year (FY) 2016 is not yet due. 2. Computerized project monitoring database established, updated, and key information placed on RISTEK project site (Component 4) (Yes/No, Custom) Value N N N Y Target of 2016 is: Yes The current actual: The web-based system is currently being developed. It will contain a database of project data, agenda of research programs, progress to date, status of complaint handling, etc. In FY 2017, the project will activate the website and start to establish the project database. 3. Increased number of persons which participate in training of Innovation System and Professional Course (Component 1) (Number, Custom) Value 0.00 604.00 1059.00 850.00 Target (cumulative) of 2016 is not available; Target for 2017 is 850 participants. The current actual: From April to October 2016, 455 new researchers have participated in various international courses and training programs. From the start of project implementation to date, the project has sent a total of 1059 researchers and staff to attend a variety of Non-Degree Programs. 12/7/2016 Page 8 of 11
4. Completed LPNK survey and institutional assessment (Component 1) (Yes/No, Custom) Value N Y Y Y Date 13-May-2011 31-Dec-2015 30-Sep-2016 31-Dec-2015 Target of 2015 is Yes. Current actual: The assessment was completed in 2014. 5. Independent Institutional Development Review Panels established with terms of reference prepared (Component 1) (Yes/No, Custom) Value N N N N Date 13-May-2011 31-Dec-2015 30-Sep-2016 31-Dec-2013 Target in 2013: Yes. Current actual: Appointment of the Panel Review was postponed because the IDPs have not been developed by the LPNKs as yet. 6. LPNK and RISTEK completed Institutional Development Plan, including a longer term HR and incentives scheme for productivity, reviewed by Independent Review Panels (Component 1) (Number, Custom) Value 0.00 0.00 0.00 8.00 Target of 2015 and 2017 is 8 Institutional Development Plans. Current actual: In 2016, the project is designing the development of the IDPs of four identified Technology Transfer Office (TTO) under four LPNKs (BATAN, BPPT, LAPAN, LIPI). 12/7/2016 Page 9 of 11
1. Feasibility study and design of a national research foundation completed (Component 2) (Yes/No, Custom) Value N N N Y Date 13-May-2011 31-Dec-2015 30-Sep-2016 31-Dec-2015 Target at the end of 2015 is Yes. Current actual: Based on new government priorities, this indicator will be deleted as in March 2016, government established the new national research foundation called the Indonesia Science Fund (ISF). 2. Minimal annual share of RISTEK s institutional research funding to projects with industry co-implementation (Component 2) (Percentage, Custom) Value 0.00 4.00 4.00 100.00 Target in 2015 is 100%. The current actual: This indicator will be revised to measure the development of the funding system that is based on specific unit cost, outputs to be achieved, multiyear budgeting. Overall Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed Disbursed P121842 IBRD-82450 Effective USD 95.00 95.00 0.00 24.55 70.45 26% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P121842 IBRD-82450 Effective 29-Mar-2013 12-Apr-2013 12-Jun-2013 31-Dec-2020 31-Dec-2020 12/7/2016 Page 10 of 11
Cumulative Disbursements Restructuring History There has been no restructuring to date. Related Project(s) There are no related projects. 12/7/2016 Page 11 of 11