- development of Customer satisfaction studies in Europe and beyond NCSI Anniversary Presentation Seoul, Korea January 29 th, 2008 Jan Eklöf, EPSI Rating and SSE
NCSI 10 Year Anniversary Presentation Congratulations to the first decade of national customer satisfaction assessment. Have a successful future! EPSI Rating, Pan-European counterpart 11/10/2009 www.epsi-rating.com 2
Plan European Performance Satisfaction Index Why?
Why listen to the customers? The customer base, the only reason for existence of the company/venture The external customers generate all long-term revenues for the operation It is profitable to adopt to their expectations Customer perception is much more than just supplying good goods and services Any provider can work on customer expectations and perceived satisfaction to enhance sustainable profitability. Revive the dormant potentials. Prioritization crucial for financial strength Why? 11/10/2009 www.epsi-rating.com 4
The customer is King But certainly not always right How to react to their wishes Should we always try to fulfil or even exceed their expectations How is the image and expectations handled by a supplier 11/10/2009 www.epsi-rating.com 5
Deming said One has to focus on the customers Current customers satisfaction Future (potential) customers needs and demands Because there are no more any truly supply driven economies or markets, but demand sets the rule of the game 11/10/2009 www.epsi-rating.com 6
Who are the customers? Internal Current employees Potential affiliates External Current clients Potential clients Those you want to do business with 11/10/2009 www.epsi-rating.com 7
The EFQM Excellence Model - the basis for EPSI - The EPSI analysis Framework Why? 11/10/2009 www.epsi-rating.com 8
(external) Customer Loyalty Satisfied customers might not be enough Loyal customer are key LOYAL CUSTOMERS Cost less to maintain Buy more products Buy more efficiently Act as ambassadors 11/10/2009 www.epsi-rating.com 9
What is EPSI? Why? Economic Indicator Financial Indicator EPSI, European Performance Satisfaction Index, is an economic indicator based on modeling of customer assessment of the quality of goods and services purchased in European countries. It reflects causes and consequences of customer satisfaction and their mutual relationships. EPSI is an important indicator of economic performance, both for individual firms and on the industry and society levels. It is related to leading indicators that are able to predict consumer spending and stock -market growth. Integrated Indicator EPSI started as a voice of the customers and later proved to be most useful also as a reflection tool of Employees Satisfaction and Loyalty/trust. Further development allowed applying EPSI approach for other stakeholders Satisfaction and its drivers, for example, citizens in general and CSR (corporate Social Responsibility) assessment. 11/10/2009 www.epsi-rating.com 10
Customer Satisfaction Index by Country 85 Customer Satis sfaction Index (EPSI) 80 75 70 65 60 1999 2000 2001 2002 2003 2004 2005 2006 2007 Denmark Finland Greece Portugal Sweden Ireland Iceland Russia Estonia Latvia Lithuania Norway Czech Republic Pan European Average Ukraine 11/10/2009 www.epsi-rating.com 12
Customer Satisfaction Index by Sector 1999-2007 75 Customer Satisf faction Index (EPSI) 70 65 60 1999 2000 2001 2002 2003 2004 2005 2006 2007 Banking Mobile Supermarket Insurance Pan European Average Datacom 11/10/2009 www.epsi-rating.com 13
Main countries and sectors coverage Why? - Nations covered at present Denmark Finland Iceland Norway Sweden (initiator) Estonia Latvia Lithuania Russia Czech Republic Greece France (emerging) Germany (emerging) Ukraine United Kingdom (emerging) Portugal (affiliated) 11/10/2009 www.epsi-rating.com 14
Main countries and sectors coverage - Industries/sectors covered at present Why? Banking (consumer and corporate segment) General Insurance (consumer and corporate segment) Life/pension insurance Retail Trade Mobile Telecoms and Broadband (consumer and corporate segment) Utilities (electricity etc.) Health services Education Police and public safety Public transport Public administration Logistics (corporate segment) Postal Services Business Services (IT, auditing, legal) 11/10/2009 www.epsi-rating.com 15
History Why? The EPSI-initiative (started 1999 with 11 countries; 8 countries year 2001, about 15 in 2004 and almost 20 in 2008 ) under the Umbrella of EPSI Rating EPSI aim at cooperating with similar initiatives in USA (ACSI), Far East countries (like NCSI) and Middle East/Africa (SAS etc.) 11/10/2009 www.epsi-rating.com 16
Comparability with other initiatives EPSI is in its core approach very similar to ACSI (the USA-counterpart) Model sructure and estimation techniques are harmonized Comparisons of results may be possible on both aggregate index and latent (driver) level For impacts-comparisons specific calibration (on industry level) should be done. 11/10/2009 www.epsi-rating.com 17
Value of A model where the market value of a firm is related to the level of customer satisfaction previous year has been established. ------------ - Studies have been done for a number of industries (incl. banking and insurance) on the relationship between satisfaction and financial performance/market value showing positive correlation (with a time-lag) - Similar studies have been documented based on USAdata (Fornell et al) 11/10/2009 www.epsi-rating.com 18
Pan-European CSI studies for Why? Ranking and promotion (beauty contest) Finding areas calling for improvements (SWOT-aspect) Identifying where more analysis is needed General benchmarking Analyzing effects of modifications Evaluating effects of strategic improvements Guiding customers All this is part of the EPSI agenda 11/10/2009 www.epsi-rating.com 19
EPSI RATING Master Model Structure Image Customer Expectations Perceived Quality ------------ product quality Perceived Value Customer Satisfaction Index (CSI) (SCSI) Loyalty (retention) Perceived Quality ------------ service quality Complaints (not part of the master model) 11/10/2009 www.epsi-rating.com 20
Design aspects (the Pan European approach) Survey design properties Questionnaire design Sample selection Field operation 11/10/2009 www.epsi-rating.com 21
Questionnaire Design A set of master questionnaires is developed and tested; A common scale is used (1-10); The wording is calibrated on the Pan-European level (with adoption to national peculiarities ); Each latent variable is covered by at least 3 manifest questions. 11/10/2009 www.epsi-rating.com 22
Level of Detail About 35 questions are included in the master questionnaire; Possible to add a limited number of specific questions by a company (similar to the entire market); Flexible results presentation possible, based on the full range of collected items, with extensive analysis on the driver side. 11/10/2009 www.epsi-rating.com 23
Blocks of Questions Three standard questions are used for measuring the EPSI construct itself. These are: Overall satisfaction with the product/provider; Satisfaction compared to expectations; and The product/provider compared to an ideal (not always relevant, may be substituted; see below). 11/10/2009 www.epsi-rating.com 24
Blocks of Questions (cont.) For loyalty, we use: Intention to buy again (or remain as a customer to the said company/product); Intention of cross-buying (buy another product from the same brand/company); Intention to switch to another brand/company/supplier; and Intention to recommend the brand/company to other consumers (word of mouth). 11/10/2009 www.epsi-rating.com 25
Latents on Driver side Image Expectations Perceived Quality Product domain Service domain Perceived value 11/10/2009 www.epsi-rating.com 26
Blocks of Questions (cont.) On the driver side we use about 20 questions relating to the image, expectations, product and service quality as well as to the perceived value. The definition of aspects differ slightly from sector to sector, depending of the characteristics of the industry: The exact wording of questions is standardized to allow comparative studies. 11/10/2009 www.epsi-rating.com 27
Sample Selection Representative sample of current customers is key; Experience of the provider product is crucial; The reference period is industry-specific (banking 12 months, retail trade 3 months, car purchase 36, etc.); Consumers vs. corporate customers (B2C vs. B2B); Extensive non-response monitoring is conducted. About 250 observations for each study domain is required for comprehensive model analysis 11/10/2009 www.epsi-rating.com 28
Field Operation Data collection is done by telephone as default; Only qualified field interviewers from recognized survey organizations - and specially trained - are used; A full-fledge CATI-system should be in operation by each considered data collection agency; A process quality control system developed; Validation in relation to population characteristics. Also other alternatives tested and introduced step-by-step (like. Web-based surveys) 11/10/2009 www.epsi-rating.com 29
The analysis tool The model is estimated by means of structural equation techniques (basically Partial Least Squares approaches); Results are obtained for: customer perceived index levels impact strength/importance of all aspects (manifests) Relative weights for manifest questions Model quality (accuracy, explanation power, robustness) 11/10/2009 www.epsi-rating.com 30
Model Quality assessment Why? Quality requirements for: - Precision The 95 percent confidence interval for the CSI shall have a width of not more than 4 units (referring to an index scale of 0 100). - Explanatory power The econometric model must be able to explain approximately 65% of what drives customer satisfaction. 11/10/2009 www.epsi-rating.com 31
Comparability In any comparison two aspects are at stake. The two main dimensions of comparability of course are: Over time Between similar phenomena (individuals, companies, industries, etc.) These two dimensions are often combined into a composite cross-section time-series approach. It would be fair to say that such analyses constitute the standard case in all economics and business studies. 11/10/2009 www.epsi-rating.com 32
Benchmark Country specific differences are expected in the measurement process. EPSI Rating has developed a modelbases approach to measure this kind of effects. -This gives calibration factors by country and industry - Further, in-country differences occur due to the fact that consumers react differently to measurements (by i.a. age, gender and socio-demography etc.) 11/10/2009 www.epsi-rating.com 33
Benchmark studies Using data from major industries and several countries we have obtained measures of: 1. Country effects 2. Industry effecs 3. Segment effects 4. (B2B vs. B2C and customer profile) 5. Customer based differences 11/10/2009 www.epsi-rating.com 34
Corporate Usage of EPSI (benchmark) Results The EPSI approach and empirical resultas are used internally for more than merely promotion in numerous major companies and organisations. More than 50 multi-national companies currently have EPSI as one performance dimension. Companies like: Nordea, Danske Bank, Handelsbanken, SEB, Swedbank, SBAB, SPP, Stadshypotek, Den Norske bank, Gjensidige Nor, If, Codan -Trygg Hansa, Folksam, TeliaSonea, Ax-food, ICA, Erste Bank, Athens Metro. EXAMPLES
De-regulation in Telecoms An Example relating to Business - to - business Fixed Telecommunications The old monopoly and the competitors In Sweden 11/10/2009 www.epsi-rating.com 36
Trends in Telecoms 1989-1999 S C S I fo r th e C o m p a n y - T im e D e v e lo p m e n t 6 2 6 0 5 8 Index 5 6 The C o m pa ny 5 4 5 2 5 0 1 9 8 9 1 9 9 0 1 9 9 1 1 9 9 2 1 9 9 3 1 9 9 4 1 9 9 5 1 9 9 6 1 9 9 7 9 8 /9 9 y e a r 11/10/2009 www.epsi-rating.com 37
Trends in Telecoms 1989-1999 W a tc h T h e C om p e tito r 7 0 6 5 Index The C o mpa ny The C o mpe tito 6 0 5 5 1 9 8 9 1 9 9 0 1 9 9 1 1 9 9 2 1 9 9 3 1 9 9 4 1 9 9 5 1 9 9 6 1 9 9 7 9 8 /9 9 Y ear 11/10/2009 www.epsi-rating.com 38
Corporate Telecoms 1999 C u s to m e r V a lu a tio n 8 5 8 0 7 5 In d e x 7 0 6 5 6 0 5 5 T h e c o m p a n y T h e C o m p e tito 5 0 Image Expectations Product Quality Service Quality In d ic a t o r Perceived Value SCSI Loyalty 11/10/2009 www.epsi-rating.com 39
Corporate Telecoms 1999 P e rc e iv e d v a lu e 35 30 25 20 Procent V alu TE LI V alu A N N A 15 10 5 0 5 15 25 35 45 55 65 75 85 95 In d e x 11/10/2009 www.epsi-rating.com 40
Telia and its competitor(s) Telia och konkurrensen 70 Telia 65 Konkurrenten competitor N?d dhet 60 55 50 1989 1990 1991 1992 1993 1994 1995 1996 1997 98/99 2000 2001 흏 11/10/2009 www.epsi-rating.com 41
Competition in the fixed phone sector: Sweden Fast telekom F? etagsmarknad i SKI 70 65 Kundn? dhe et 60 Telia andra 55 1996 1997 1998/99 2000 2001 2002 2003 흏 11/10/2009 www.epsi-rating.com 42
The third wave of market adoption Why? Fixed lines B2B market in Sweden EPSI 1996-2007 70 Customer satisf faction 65 60 Telia Tele2 Phonera Ventelo Annan 55 1996 1997 1998/98 2000 2001 2002 2003 2004 2005 2006 2007 Year 11/10/2009 www.epsi-rating.com 43
Insurance company usage - Finland B2B segment Priority setting The improvement candidates - Today and compared with the situation Last year 11/10/2009 www.epsi-rating.com 44
Svenskt EPSI Kvalitetsindex Finland 2007 2006 General Bank Privatmarknad Insurance B2B Company X Föreningssparbanken If Drivande Driving Factors Faktorer Image 75.4 74,1 Resultat Results 0,42 0.59 0.24 0,20 Kund Expectations Förväntningar 81.8 82,4 0.49 0,37 0.39 0,52 Perceived Upplevd Product Produktkvalitet Quality 78.2 78,8 0.18 0.56 0,50 0,24 0,59 0.45 0,30 0.43 Perceived Prisvärde Value 73.1 76,1 Customer 0.41 0,16 Kundnöjdhet Satisfaction 0,74 0.67 73,4 74.0 0,41 0.16 0,18 0.09 Complaints Klagomål Lojalitet Loyalty 73,9 78.3 0,20 0.15 Perveived Upplevd Servicekvalitet Quality 77.0 80,2 11/10/2009 www.epsi-rating.com 45
Company X Why?
Total Effect from Divers to Customer Satisfaction EPSI Finland 2007 Driver is increased by one unit Total Effec ct 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0.0 Image Expectations Product Quality Service Quality Value Fennia If Pohjola A-Vakuutus Tapiola Other 11/10/2009 www.epsi-rating.com 47
Total Impact from Drivers to Customer Satisfaction Driver is increased by one unit 0.8 0.7 0.6 2006 Fennia If Pohjola Tapiola Other Total Impa act 0.5 0.4 0.3 0.2 0.1 Image Expectations ProdQ ServQ Value
Priority Map If Company X EPSI Finland 2007 89 Score 79 69 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 Importanc e Image E xpect P rodq S ervq Value 11/10/2009 www.epsi-rating.com 49
Prioritization Image is still the most important aspect for improvemnet (has the highest effect on satisfaction). However it has decreased slightly from 2006. Product Quality is this year almost as important as image (their relative impact has increased) Expectations come as third in importance. That will be achieved by increased image. 11/10/2009 www.epsi-rating.com 50
Improving IMAGE By..
Score and Weight Image EPSI Finland 2007 9.0 0.25 8.5 Score Weight 0.23 Score 8.0 7.5 0.21 0.19 Weight 7.0 0.17 6.5 the image of being a reliable and transparent insurance company? the image of providing excellent overall customer service? the image of offeringthe image of being athe overall image of good value for money to the customers in terms of fees and claim settling? professional, stateof the-art insurance company? your insurance company? 0.15 *No big differences in relative weight, so concentrate on the ones that are cheapest to improve! 11/10/2009 www.epsi-rating.com 52
Effect Calculation - Image A: Improve the image of providing excellent customer service with one unit on 1-10 scale 2007 yields (result 2006 in parenthesis). An increase in overall Image by 2.60 units (2.92 units last year). An increase in customer satisfaction by 1.63 units (1.93 units) ----------------------------------- B: Improve the image of providing value for money with one unit on 1-10 scale 2007 yields... An increase in overall Image by 2.10 units. An increase in customer satisfaction by 1.30 units 11/10/2009 www.epsi-rating.com 53
Improving Product Quality By..
Score and Weight Product Quality EPSI Finland 2007 9.0 Score Weight 0.30 8.5 0.28 8.0 0.26 Score 7.5 7.0 0.24 0.22 Weight 6.5 the quality of the insurance functions offered (fees, coverage, etc.)? the quality of the the technical quality of the overall insurance reliability and accuracythe products (functions) quality of the functions (standing orders processed in accordance with offered (data transfer, Internet connection, that matter for you offered by your insurance company? instructions, accuracy of statements, etc.)? overall security system, etc.)? Relative importance of technical quality has increased from 2006 0.20 11/10/2009 www.epsi-rating.com 55
Effect Calculation - ProductQ A: Improving the quality of the reliability and accuracy with one unit on 1-10 scale 2007 yields (result 2006 in parenthesis). An increase in overall Product Quality by 2.94 units (3.14 units last year). An increase in customer satisfaction by 1.81 units (1.78 units) ----------------------------------- B: Improving the quality of product functions with one unit on 1-10 scale 2007 yields... An increase in overall Product Quality by 2.70 units. An increase in customer satisfaction by 1.66 units 11/10/2009 www.epsi-rating.com 56
Thus provided these above aspects can be improved in the eyes of the customers Why? With 1 unit each (from 7.9; 7.6; 7.9 and 8.1 respectively) it is possible others have succeeded with improvements of 1 unit or more during 1 2 years time The customer satisfaction may (theoretically) improve with (up to) 6.4 units. Highly significant indeed! 11/10/2009 www.epsi-rating.com 57
But, maybe the strategies should be more select Focussing of special categories of customers..
Because, Customers are different Spread in customer satisfaction and other latents Complaints Claims and their handling
Spread Customer Satisfaction General Insurance B2B EPSI Finland 2007 60% 50% Proport tion (%) 40% 30% 20% 10% 0% 0-60 60-75 75-100 Index level If Pohjola A-Vakuutus Tapiola Other 11/10/2009 www.epsi-rating.com 60
The integrated approach EPSI Customers and Employees integrated
The EFQM Excellence Model - The EPSI analysis Framework 11/10/2009 www.epsi-rating.com 63
EPSI Employees There is a strong relationship?? Satisfied employees Satisfied customers 11/10/2009 www.epsi-rating.com 64
Top Management Image EPSI Employees ---- Structural Model Framework My boss Cooperation Satisfaction (R 2 = ) Loyalty (R 2 = ) The daily work 80,4 Motivation Salary and other working regulations Personal development
Approach for integrated analysis From the integrated model we calculate:... Index for each latent Priority areas and possible conflicts (between consumer and employee perspective) Improvement possibilities 11/10/2009 www.epsi-rating.com 66
Challenges for the future Opportunities and Threats In the European EPSI environment
Opportunities Why? It is becoming increasingly important for the corporate image to have good customer satisfaction; More and more multi-national companies are using non-financial performance indicators for assessment (like in BSC-systems); EPSI is becoming increasingly using in such applications (both strategic and more operational); Priority setting and evaluation of improvement schemes is more and more critical for costefficiency in the industry; and Society-activities (public sector) call for more and more of prioritization based on user-responsiveness. 11/10/2009 www.epsi-rating.com 68
Threats Short-term financial monitoring dominates, and longer-term investing in customers get too little priority; Data collection is becoming increasingly difficult and costly generating nonrepresentative samples; and Reaction patterns by customers are changing calling for adaptive modelling 11/10/2009 www.epsi-rating.com 69
EPSI Challenges Develop and Run national as well as corporate customer satisfaction studies in Europe Have EPSI accepted as a standard performance indicator in corporate society Cooperate with similar initiatives on other continents Offer benchmark opportunities using interaction between performance areas 11/10/2009 www.epsi-rating.com 70
For more information European Performance Satisfaction Index Webb-plats: www.kvalitetsindex.se www.epsi-rating.com 1 11/10/2009 www.epsi-rating.com 71