Success indicators for the future uptake of ESCO v1

Transcription

1 Success indicators for the future uptake of ESCO v1

2 Creation Date: 26/07/2016 Last update:29 /11/2016 Purpose of this document With this document the Commission presents to the Maintenance Committee (MAI) a first collection of potential business Key Performance Indicators (KPIs) 1 for ESCO. The goal of these KPIs is to measure the uptake of ESCO after its first release. We share this document with the MAI for consultation before continuing with internal discussions and adoption of a list of KPIs. Introduction By developing KPIs the Commission services aim at: monitoring the uptake of ESCO by Member States, EURES and private entities (incl. companies and associations); demonstrating the business objectives of ESCO and evaluating their accomplishment and analysing the results of the KPIs and drawing conclusions for the improvement of the ESCO classification. KPIs will be applied on an annual basis and will be based on SMART criteria: Specific: KPIs encapsulate goals in specific terms; Measurable: KPIs indicate tangible measures of progress; Attainable: KPIs are feasible; Realistic: KPIs results are realistically achieved taking into account available resources; Time-bound: KPIs specify when the results can be achieved. What do we want to measure? Successful use of ESCO according to the new EURES Regulation In order to comply with Regulation 2016/589/EU (EURES Regulation), the Member States will: either map their national, regional and sectoral classifications to and from a European classification, in principle ESCO, or adopt the European classification as their national classification. After the release of ESCO v1 the Commission intends to propose the ESCO classification as the European classification through an Implementing Act according to art. 19 (2) of the EURES Regulation. 1 See Annex I and II July

3 The successful use of ESCO in EURES is one of the key success criteria for the uptake of ESCO. Uptake of ESCO by public and private actors ESCO seeks to promote semantic interoperability in the labour market and the education/training sector. This includes a wide range of private actors, such as private employment services, HR software vendors, job boards, social media networks, search engines or private awarding bodies. For ESCO, the uptake by the private market is therefore a crucial success criterion. Since July 2015 some private entities test ESCO demo datasets in their applications. Following the release of ESCO v1, public and private entities can use the ESCO vocabulary in their systems free of charge, which allows them to make their systems interoperable and to extend the reach of their service offers to all Member States. Evolution of the qualifications pillar Currently, the Commission is finalising the technical and methodological framework for the qualifications pillar in cooperation with Member States and stakeholders as a first step. The second step will be to populate the qualifications pillar with information on qualifications; the final step to interlink it with the other two pillars of ESCO. The qualifications in ESCO and their link to the skills and competence pillar will reflect the learning outcomes approach in Education and Training, expressing what someone knows, understands and is able to do on completion of a learning process. The Commission will populate the qualifications pillar with information provided by Member States in their national qualification databases. The aim is to provide a comprehensive listing of those qualifications that are relevant for the European labour market. Our goal is to connect the majority of Member States by Evolution of an eco-system of classifications ESCO has the ambition to be at the heart of an "ecosystem of vocabularies" for the labour market. For this to happen, other semantic assets (such as national classifications, ISCO, NACE, ISCED-FOET, the digital competences framework and the e-cf) will be mapped to ESCO or use the same concepts. This way concepts of ESCO can be transcoded and easily combined with information from other vocabularies, taxonomies and classifications when exchanging information on the labour market or in the education and training sector. Performance KPIs The ESCO business KPIs should be accompanied in a second step by a set of performance KPI that measure the level of satisfaction of ESCO users, as well as the July

4 fitness for purpose in the various business cases. For the use of ESCO for job matching in EURES, we will discuss with the EURES team on the definition of performance KPIs and how to measure them. Next steps The Commission after receiving the feedback from the Maintenance Committee will finalise the list of the business KPIs and will define for each KPI how to measure them and implement them. The Commission will have a meeting with the EURES team to investigate how to measure the relevancy of the search results to the job seeker. For example if he/she searches for a specific occupation how relevant the result of his/her research would be for him/her. July

5 ANNEX I Examples of business KPIs that could be used to measure the success of ESCO Use of ESCO in EURES (after adoption of the Implementing Act) % of Member States that mapped to the occupations pillar of ESCO % of Member States that mapped to the skills/competences pillar of ESCO % of job vacancies sent to EURES that are annotated with ESCO occupations 2 % of job vacancies sent to EURES that are annotated with ESCO skills/competences % of the job results that a job seeker considers relevant after a job search or job matching on the EURES job portal. Uptake of ESCO by the public and private market Number of downloads of the ESCO API Number of private service providers that use ESCO to deliver online services 3 Number of public service providers that use ESCO to deliver online services Number of websites that use ESCO to semantically annotate pages, such as job offers or qualification information. Evolution of the ESCO qualifications pillar No. of national qualification databases connected to ESCO No. of qualifications in the ESCO qualifications pillar 4 % of qualifications with learning outcome descriptions that are annotated with ESCO knowledge, skills and competences Evolution of an eco-system of classifications No. of semantic assets (i.e. classifications, taxonomies, controlled vocabularies, ontologies and the like) in the labour market and education domain that are mapped to ESCO or use the same concepts as ESCO 2 These figures could be measured per ESCO version (how many are annotated with ESCO v1, ESCO v1.1, etc.) in order to measure the time to market of new ESCO versions. 3 This could be automatically measured in case we require users of ESCO v1 to include a statement (e.g. "This project is using the ESCO classification as source to develop its services") on their website. We intend to internally discuss the desirability and feasibility of such a requirement. 4 We can measure the number of qualifications coming from the Member States' national qualification databases (indirect inclusion) separately from information sent by other data providers (direct inclusion).