Joint Research Centre

Transcription

1 Joint Research Centre the European Commission's in-house science service Serving society Stimulating innovation Supporting legislation Competence Centre on composite indicators & scoreboards Sven Langedijk Head of Unit Michaela Saisana Project Leader, COIN Brussels, 03/02/2016

2 We are drowning in information, while starving for wisdom. The world henceforth will be run by synthesizers, people able to put together the right information at the right time, think critically about it, and make important choices wisely.

3 Composite indicators take societies' pulse on phenomena not directly observable by aggregating sets of indicators (data) Health Income Education Human Development Increased needs? - Data revolution/complexity - Human brain limits

4 1987 First Composite Indicator proposed by the EC Proposal for a Council Regulation establishing a Community system of aids to agricultural income [COM(87) 166 final] 1973 First reference within an EU document 14th rep. on the activities of the Monetary Committee [OJ No C94]

5 130 composite indicators developed or used by the EC 50% of the EC indices are developed with JRC contribution ECFIN ENTR DG FISMA Banks contribution to EU Single Resolution Fund JRC 10 DG ECHO Index for Risk Management (INFORM) REGIO EMPL RTD DG JUST DG REGIO Consumer Conditions & Markets Europe 2020 Index EAC 5 DG GROW Small Business Act Principles SANCO ESTAT ECHO DG RTD DG JRC Innovation Output Indicator Cultural and Creative Cities Monitor (ongoing) CNECT 3 DG BUDG Budget Focused on Results (new) MARKT AGRI 3 3 ECB Systemic Risk Heat Maps [JRC study, ongoing]

6 2002 First JRC report: State of the art on CIs (EUR 20408) First DG request: Internal Market Index (EUR 20547) 2004 Second Seminar: Joint OECD/JRC Paris, Feb First External request: Env. Sustainability Index (EUR 21807) First Paper: UASA for CIs (JRSSA, 168: ) Launch website: Server, 10 steps (>1000 links, 1st hit) First JRC Seminar: Ispra, 12 May Fifth Seminar: Joint ESTAT/JRC Lux., May OECD/JRC Handbook on CIs: (endorsed by the OECD high level statistical committee) 2013

7 European Commission External Global Innovation Index (WIPO, INSEAD) 2. Global Talent Competitiveness Index (INSEAD) 3. Rule of Law Index (World Justice Project) 4. Environmental Performance Index (Yale & Columbia) 5. Environment and Gender Index (IUCN) 6. Drug Consequences Index (ONDCP) 7. Sustainable Society Index (SSF, NL) 8. Corruption Perceptions Index (Trans. Int.) 9. Global Focus Model (UN OCHA) JRC COIN Composite Indicators Research Group Regional Human Development Index (DG REGIO) 2. Regional Human Poverty Index (DG REGIO) 3. Europe 2020 Index (DG REGIO) 4. Consumer Conditions Index (DG SANCO) 5. Market Performance Index (DG SANCO) 6. Small Business Act Principles (DG ENTR) 7. Youth Civic Competencies Index (DG EAC) 8. Environmental Pressures Index (DG ENV) Over 100 audit requests since 2005

8 JRC Quality Control Framework A valuable process for indices and scoreboards Methods Tools Trainings Handbook Academic papers 14 years of experience 15 policy DGs supported on multiple files 100 JRC audits Do s and Don ts in the design of benchmarking No information is lost in aggregation Aggregation up to a level that provides meaningful information Weighting and aggregation grounded in a theory of how the various parts work together.

9 Work plan for COIN, 2016

10 New Tools & Methods in 2016 COIN Explorer platform to visualize and combine dimensions from over 100 indices & scoreboards with EC relevance COIN Tool Excel -based tool to assess some of the statistical and robusteness properties of composite indicators JRC- OECD Guidelines on constructing and interpreting composite indicators (follow up to the JRC-OECD Handbook) New Training Syllabus modules for users and developers of composite indicators & scoreboards International Conference on new methods for constructing, visualizing and interpreting indices and scoreboards Online Forum on indices and scoreboards, actively moderated by COIN

11 Source: The Commission should better exploit the potential of big data and seize the opportunities for better policy-making offered by the data revolution [HLRG, 2015]

12 Collaborative working JRC Knowledge Centres Competence Centres Policy DGs Implementation and action Disclaimer: To be credible and effective catalyst of policy action, indices and scoreboards need to be developed sensibly and used responsibly.

13