An Analysis of the Robustness of Bankruptcy Prediction Models Industrial Concerns in the Czech Republic in the Years

Similar documents
Possibilities for the Application of the Altman Model within the Czech Republic

Could the coefficients re-estimation solve the industry or time specific issues?

COMPREHENSIVE ANALYSIS OF BANKRUPTCY PREDICTION ON STOCK EXCHANGE OF THAILAND SET 100

Application and Comparison of Altman and Ohlson Models to Predict Bankruptcy of Companies

THE COMPARISON OF DIFFERENT BANKRUPTCY MODELS IN THE CONDITIONS OF SELECTED COMPANIES

Tendencies and Characteristics of Financial Distress: An Introductory Comparative Study among Three Industries in Albania

THE STABILITY OF BANKRUPTCY PREDICTORS IN THE CONSTRUCTION AND MANUFACTURING INDUSTRIES AT VARIOUS TIMES BEFORE BANKRUPTCY

CONTROVERSIES REGARDING THE UTILIZATION OF ALTMAN MODEL IN ROMANIA

REHABCO and recovery signal : a retrospective analysis

Assessing the Probability of Failure by Using Altman s Model and Exploring its Relationship with Company Size: An Evidence from Indian Steel Sector

Predicting Financial Distress: Multi Scenarios Modeling Using Neural Network

A STUDY OF APPLICATION OF ALTMAN Z SCORE MODEL FOR OMAN CEMENT COMPANY (SAOG), SOHAR SULTANATE OF OMAN

Audit Opinion Prediction Before and After the Dodd-Frank Act

A Statistical Analysis to Predict Financial Distress

MODELLING OF INCOME AND WAGE DISTRIBUTION USING THE METHOD OF L-MOMENTS OF PARAMETER ESTIMATION

The problem of outliers in the research on the financial standing of construction enterprises in Poland

Methods for Overcoming the Financial Crisis of Enterprises

COMPARISON OF THE MODELS OF FINANCIAL DISTRESS PREDICTION

A Study on MeASuring the FinAnciAl health of Bhel (ranipet) using Z Score Model

A Proposed Model for Industrial Sickness

THE USE OF THE ALTMAN MODEL IN EVALUATION OF ECONOMIC PERFORMANCE OF A CORPORATION IN THE CRISIS PERIOD IN THE BUILDING SECTOR IN THE CZECH REPUBLIC

Predicting Corporate Bankruptcy using Financial Ratios: An Empirical Analysis: Indian evidence from

Part I: Distress Prediction Models and Some Applications

FORECASTING THE FINANCIAL DISTRESS OF MINING COMPANIES: TOOL FOR TESTING THE KEY PERFORMANCE INDICATORS

A PREDICTION MODEL FOR THE ROMANIAN FIRMS IN THE CURRENT FINANCIAL CRISIS

A Comparison of Jordanian Bankruptcy Models: Multilayer Perceptron Neural Network and Discriminant Analysis

Financial Distress Models: How Pertinent Are Sampling Bias Criticisms?

A STUDY ON FINANCIAL HEALTH OF DAIRY INDUSTRY IN ANDHRA PRADESH BASED ON Z SCORE ANALYSIS

Parallel Accommodating Conduct: Evaluating the Performance of the CPPI Index

On The Prediction Of Financial Distress For UK firms: Does the Choice of Accounting and Market Information Matter?

Assessing the probability of financial distress of UK firms

Creation Bankruptcy Prediction Model with Using Ohlson and Shirata Models

Journal of Central Banking Theory and Practice, 2016, 3, pp Received: 16 March 2016; accepted: 16 June 2016

LINK BETWEEN CORPORATE STRATEGY AND BANKRUPTCY RISK: A STUDY OF SELECT LARGE INDIAN FIRMS

The Two-Sample Independent Sample t Test

PARAMETRIC AND NON-PARAMETRIC BOOTSTRAP: A SIMULATION STUDY FOR A LINEAR REGRESSION WITH RESIDUALS FROM A MIXTURE OF LAPLACE DISTRIBUTIONS

ANALYSIS OF ROMANIAN SMALL AND MEDIUM ENTERPRISES BANKRUPTCY RISK

Power of t-test for Simple Linear Regression Model with Non-normal Error Distribution: A Quantile Function Distribution Approach

Apply Logit analysis in Bankruptcy Prediction

Bankruptcy Prediction in the WorldCom Age

THE ECONOMICS OF BANK ROBBERIES IN NEW ENGLAND 1. Kimberly A. Leonard, Diane L. Marley & Charlotte A. Senno

ASSESSING THE DETERMINANTS OF FINANCIAL DISTRESS IN FRENCH, ITALIAN AND SPANISH FIRMS 1

The European Commission s science and knowledge service. Joint Research Centre

Web Extension 25A Multiple Discriminant Analysis

FIRM-LEVEL BUSINESS CYCLE CORRELATION IN THE EU: SOME EVIDENCE FROM THE CZECH REPUBLIC AND SLOVAKIA Ladislava Issever Grochová 1, Petr Rozmahel 2

Bayesian Methods for Improving Credit Scoring Models

SMEs and Family Business Conference

Measuring and managing market risk June 2003

ANALYSIS OF THE DISTRIBUTION OF INCOME IN RECENT YEARS IN THE CZECH REPUBLIC BY REGION

Z-score Model on Financial Crisis Early-Warning of Listed Real Estate Companies in China: a Financial Engineering Perspective Wang Yi *

Modelling catastrophic risk in international equity markets: An extreme value approach. JOHN COTTER University College Dublin

TALLINN UNIVERSITY OF TECHNOLOGY School of Business and Governance Department of Business Administration

Predicting probability of default of Indian companies: A market based approach

Monetary policy under uncertainty

Online Open Access publishing platform for Management Research. Copyright 2010 All rights reserved Integrated Publishing association

ABILITY OF VALUE AT RISK TO ESTIMATE THE RISK: HISTORICAL SIMULATION APPROACH

Goldstar's Financial Condition Analysis for the Period from to

On Performance of Confidence Interval Estimate of Mean for Skewed Populations: Evidence from Examples and Simulations

Bankruptcy prediction in the construction industry: financial ratio analysis.

A Survey of the Relationship between Earnings Management and the Cost of Capital in Companies Listed on the Tehran Stock Exchange

Section 7 Credit risk analysis

University of Economics, Prague. Analysis of Financial Condition of the Czech Professional Football Clubs. David Procházka

SELECTION BIAS REDUCTION IN CREDIT SCORING MODELS

DATA SUMMARIZATION AND VISUALIZATION

FINANCIAL INSTABILITY PREDICTION IN MANUFACTURING AND SERVICE INDUSTRY

Modeling Private Firm Default: PFirm

IMPACT OF FINANCIAL STRENGTH ON LEVERAGE: A STUDY WITH SPECIAL REFERENCE TO SELECT COMPANIES IN INDIA

THE APPLICABILITY OF THE EDMISTER MODEL FOR THE ASSESSMENT OF CREDIT RISK IN CROATIAN SMEs

Z SCORES: AN EFFECTIVE WAY OF ANALYSING BANKS RISKS

Logarithmic-Normal Model of Income Distribution in the Czech Republic

~j (\J FINANCIAL RATIO ANALYSIS GEORGIA INSTITUTE OF TECHNOLOGY SCHOOL OF CIVIL ENGINEERING ATLANTA, GEORGIA 30332

BANKRUPTCY PREDICTION USING ALTMAN Z-SCORE MODEL: A CASE OF PUBLIC LISTED MANUFACTURING COMPANIES IN MALAYSIA

Graduate Business School

The Financial Crisis Early-Warning Research of Real Estate Listed Corporation Basted Logistic Model RongJin.Li 1,TingGao 2

Journal of Applied Business Research First Quarter 2006 Volume 22, Number 1

Richardson Extrapolation Techniques for the Pricing of American-style Options

Assessing Bankruptcy Probability with Alternative Structural Models and an Enhanced Empirical Model

Financial Time Series and Their Characteristics

Evaluating the Financial Health of Jordan International Investment Company Limited Using Altman s Z Score Model

THE DETERMINANTS OF FINANCIAL HEALTH IN THAILAND: A FACTOR ANALYSIS APPROACH

Financial performance measurement with the use of financial ratios: case of Mongolian companies

EX-POST VERIFICATION OF PREDICTION MODELS OF WAGE DISTRIBUTIONS

A COMPARATIVE ANALYSIS OF REAL AND PREDICTED INFLATION CONVERGENCE IN CEE COUNTRIES DURING THE ECONOMIC CRISIS

Forecasting Bankruptcy via Cross-Sectional Earnings Forecasts

AN EMPIRICAL RESEARCH ON EARLY BANKRUPTCY FORECASTING MODELS: DOES LOGIT ANALYSIS ENHANCE BUSINESS FAILURE PREDICTABILITY?

- International Scientific Journal about Simulation Volume: Issue: 2 Pages: ISSN

David Tenenbaum GEOG 090 UNC-CH Spring 2005

Companies value in the context of economic crisis

Developing a Bankruptcy Prediction Model for Sustainable Operation of General Contractor in Korea

The Presentation of Financial Crisis Forecast Pattern (Evidence from Tehran Stock Exchange)

Predicting Bankruptcy with Univariate Discriminant Analysis. Case of Albania

Mortality of Beneficiaries of Charitable Gift Annuities 1 Donald F. Behan and Bryan K. Clontz

Analysis of 2x2 Cross-Over Designs using T-Tests for Non-Inferiority

Fatemeh Arasteh. Department of Accounting, Science and Research Branch, Islamic Azad University, Guilan, Iran. (Corresponding Author)

INFORMATION EFFICIENCY HYPOTHESIS THE FINANCIAL VOLATILITY IN THE CZECH REPUBLIC CASE

A STUDY ON PREDICTION OF DEFAULT PROBABILITY OF AUTOMOBILE DEALERSHIP COMPANIES USING ALTMAN Z SCORE MODEL

Discriminatory Power of the Altman Z-Score Model

Enterprise Rating System: the rhomboid structure of the Greek corporate universe

DO BANKRUPTCY MODELS REALLY HAVE PREDICTIVE ABILITY? EVIDENCE USING CHINA PUBLICLY LISTED COMPANIES.

Terms & Characteristics

Transcription:

988 Vision 2020: Sustainable Growth, Economic Development, and Global Competitiveness An Analysis of the Robustness of Bankruptcy Prediction Models Industrial Concerns in the Czech Republic in the Years 1999 2013 Michal Karas, Brno University of Technology Faculty of Business and Management, Brno, Czech Republic, karas@fbm.vutbr.cz Mária Režňáková, Brno University of Technology Faculty of Business and Management, Brno, Czech Republic,reznakova@fbm.vutbr.cz Abstract The development of a bankruptcy prediction model, i.e. a model capable of identifying in advance companies threatened by bankruptcy with a high degree of accuracy, is a difficult process in view of the absence of data on companies that have gone into bankruptcy. This leads to the use of models that have already been developed, for which their authors have declared a high degree of prediction accuracy. The subject of the research presented in this paper is the testing of the accuracy of such models in a period or environment other than that for which they were designed. The ability of these models to differentiate between companies threatened by bankruptcy and prospering companies and their identification error, i.e. indicating companies that go into bankruptcy as prospering companies and vice versa, were tested. Testing was performed on data on companies in the manufacturing industry operating in the Czech Republic in the years 1999 2013 with the use of three models. The first of the models used is the Altman model, which originated in a different environment and in a different period of time to the tested companies. The second model tested was the Neumaier model, which originated in a similar environment, though at a different time. The last of the models tested is a model developed by the authors of this paper, which originated on the basis of data from the same field, though in a different period. The use of these models over a long time period also enabled testing of the predication capability of the individual models in advance, i.e. one to nine years before bankruptcy. The results of this research clearly demonstrate that the accuracy of such models falls markedly when used in a different environment and different time period. The best results were obtained by the use of a model created with data on the same field, though in a different period of time. Keywords: Bankruptcy model, financial ratios, the prediction accuracy of bankruptcy models. Introduction The publications by William Beaver (1966) and Edward Altman (1968) are pioneering works in this field. Many other authors (Deakin, 1972; Altman, 1977; Ohlson, 1980; Zmijewski, 1984; Shumway, 2001, and others) have followed on from their conclusions in subsequent years. The model produced by Altman, in particular, is still considered appropriate for predicting the threat of bankruptcy to this day by a number of authors. The use of bankruptcy models in economic environments or in time periods different from those for which they were designed raises the question as to whether such models can simply be transferred from their original economic environment to a different environment (e.g. at a different stage of economic development, with a differing performance of the economy, etc.) or for how long such models retain their prediction capability. Authors such as Platt and Platt (1990), Grice and Dugan (2001), Niemann et al (2008) and Wu, Gaunt and Gray (2010), have pointed out this problem and indicated that the predication accuracy of bankruptcy models (their ability to differentiate correctly between a company threatened by bankruptcy and a prospering company) falls markedly when they are applied to a different branch, period or economic environment than that from which the data on which they were developed was taken. The aim of this paper is to test the robustness of a model in time and in a different environment over a longer time interval. The robustness of a bankruptcy model is understood here as the possibility of

Vision 2020: Sustainable Growth, Economic Development, and Global Competitiveness 989 applying the given model in a moment in time or environment different to that in which it was created without any significant loss of accuracy. The accuracy of a total of three bankruptcy models was tested for this purpose. The first of these models is the Bankruptcy Index model that resulted from our previous piece of research (Karas and Režňáková, 2013). This model was derived in the Czech environment. The second is the IN05 model (see Neumaierová and Neumaier, 2005) which was also derived for the Czech environment, though on the basis of data from a different period to the preceding model. A comparison of these two models allows us to demonstrate robustness in time. The third model is the Altman model, specifically the version designed for unquoted companies (see Altman, 2000). A comparison of the first two models with this model allows us to analyse robustness in time and environment. The subject of this research is also the ability to identify a company threatened with bankruptcy (hereafter a bankrupt company) a number of years before it goes into bankruptcy. All the three given models were created by the discriminant analysis method, with the model parameters being financial indicators on the companies a year before bankruptcy. It is, however, desirable to identify the risk of impending company bankruptcy as early as possible, i.e. several years before bankruptcy, for which reason the accuracy of the models will also be tested a number of time intervals before bankruptcy. Sample and Methods The sample under investigation is comprised of 2,659 companies in the manufacturing industry (NACE rev. 2 main section C: Manufacturing), of which 2,092 financially healthy (active) companies and 567 companies threatened with bankruptcy (bankrupt). The bankrupt companies investigated went into bankruptcy in the years 2008 to 2013, although data on these companies was monitored over 9 time intervals. In the case of the bankrupt companies, the first interval studied is the year before bankruptcy, which is referred to as period t+1. The period studied is then the period between the years 1999 and 2013. The data was obtained from the Amadeus database provided to the company Bureau Van Dijk. Bankruptcy Index (BI) This model was developed for companies in the manufacturing industry in the Czech Republic on the basis of data on the years 2008 2010. It works by combining linear discriminant analysis and Box- Cox transformation of variables (see Box and Cox, 1964). The model was originally designed for an application in the currency CZK (see Karas and Režňáková, 2013), though its coefficients were later modified for indicators defined in EUR (see Karas and Režňáková, 2014). The currency of the indicators is important for the model because the model contains one absolute variable. The model in its original form (for CZK values), which is tested in this piece of research, is as follows (see Karas and Režňáková, 2013): 0.4949 1.4560 X 0.9306 9.9934 X 1.1965 10. 0. 0765 BI 11.8356 X 1 2 9205 where X 1 is the total assets turnover ratio (ratio of sales to total assets), X 2 is the ratio of quick assets (current assets minus inventories) to sales, X 3 is the value of total assets [CZK]. 3 (1) A company is evaluated by the model as bankrupt if the index < 23.826, otherwise it is evaluated as active. The model achieved an average total accuracy of 93.91 % on the original sample (data from the Czech Republic from the years 2007 to 2010).

990 Vision 2020: Sustainable Growth, Economic Development, and Global Competitiveness The IN05 Model The IN05 model represents a combination of a bankruptcy and solvency model, or a model capable of assessing whether a company creates value for its owners. Data on a total of 1,526 industrial companies for the year 2004 was used in its creation. The model can be written in the following form (see Neumaier and Neumaierová, 2005): IN05 = 0.13*TA/TL+0.04*EBIT/I+3.97*EBIT/TA+0.21*OR/TA+0.09*CA/CL (2) where TL/TA represents the ratio total liabilities to total assets, EBIT/I the ratio of earnings before interest and taxes to interest, EBIT/TA the ratio of earnings before interest and taxes to total assets, OR/TA the ratio of operating revenue to total assets, CA/CL the ratio of current assets to current liabilities. Because the indicator EBIT/I often attains extreme values during practical application in view of the low value of the denominator, the authors recommend limiting its value to a maximum of 9 (Neumaier, Neumaierová, 2005). IN05 model values are interpreted as follows. At IN05 values < 0.9 the company does not create value for its owners or destroys value, at IN05 values > 1.6 the company creates new value for its owners, and at values falling within a range of 1.6 > IN05 > 0.9 no definitive conclusive can be determined (the grey zone ). At the time at which the model was created, its authors summarised its predication ability as follows (Neumaier and Neumaierová, 2005): If the index value for a given company falls beneath the lower limit, there is a 97 % probability that the company is headed for bankruptcy and a probability of 76 % that it will not create value. A company in the grey zone has a practically 50 % probability of bankruptcy and a 70 % probability of creating value. A company above the upper limit will have a 92 % probability of not going bankrupt and a 95 % probability of creating value. The Altman Model version for unquoted companies The original version of this model, known as ZETA, comes from 1977. Altman later revised the model in the year 2000 in order for it to be useable for companies whose shares are not listed on the capital market (see Altman, 2000). This modification consisted of the substitution of the ratio of the market value of equity to total liabilities with the ratio of the accounting value of equity to total liabilities and the adjustment of coefficients and the boundaries of the grey zone. According to Altman the significance of this modified predictor is slightly lower, though it still represents the model s third most important predictor as in the original version. The revised model takes the following form (see Altman, 2000): Z-score = 0.717*WC/TA+0.847*RE/TA+3.107*EBIT/TA+0.42*E/D+0.998*S/TA (3) where WC/TA is the ratio of net working capital to total assets, RE/TA is the ratio of retained earnings to total assets, EBIT/TA is the ratio of earnings before interest and taxes to total assets, E/D is the ratio of the accounting value of equity to total liabilities, S/TA is the ratio of sales to total assets. Z-score values are interpreted as follows. Companies with a Z-score value < 1.23 are evaluated as being threatened with bankruptcy. Z-score values > 2.9 indicate the company is financially healthy, while the interval of values 1.23 > Z-score > 2.9 means no unambiguous conclusion may be drawn, i.e. the grey zone of inconclusive results.

Vision 2020: Sustainable Growth, Economic Development, and Global Competitiveness 991 Altman (2000) states the accuracy of this model as 90.9 % correctly classified bankrupt companies and 97 % correctly classified active companies over a period of one year before bankruptcy. The accuracy of the model falls as the period before bankruptcy increases. The author of the model states that over a period of five years before bankruptcy, its accuracy is 69.8 % correctly classified bankrupt companies and 82.1 % correctly classified active companies. All three tested models are based on the method of linear discriminant analysis, which is essentially a parametric method. The conclusions of parametric methods are influenced by the presence of extreme values in the sample and by deviation from normality. The presence of extreme values in the sample can be identified by the Grubbs test (see Grubbs, 1969), which tests the null hypothesis that there are no outliers in the data sample. The Grubbs test statistic is the largest absolute deviation from the sample mean in units of the sample standard deviation and can be written as follows (Grubbs, 1969): G max Yi Y 1,2 N s i,..., (4) Where Y and s denote the sample mean and the standard deviation, respectively. Fulfilment of the condition of normality can be assessed either by testing, e.g. the Shapiro-Wilk test (see Shapiro and Wilk, 1965), or by the values of skewness and kurtosis. The selective coefficient of skewness (third moment) takes the shape: T 3 1 x t x ˆ 1 (5) T ˆ t 1 The selective coefficient of kurtosis (fourth moment) takes the shape: T 4 1 x ˆ2 t x 3 (6) T t 1 ˆ The variables used have the following meaning: T is the range of the selection, x is the arithmetic mean, ˆ is the selective standard deviation. Results The descriptive statistics of the values of variables used in the individual models quantified for the sample under examination are given in the following table. Variables for active companies are given as (A), variables for bankrupt companies as (B).

992 Vision 2020: Sustainable Growth, Economic Development, and Global Competitiveness Table 1, Descriptive statistics of variables of tested models Variable Mean G.Test Std. p-value Median Min. Max. Stat. dev. Skew. Kurt. CA/CL (A) 2.677 39.58 0.00000 1.5624 0.0000 361.1760 9.058 32.49 1239.7 CA/CL (B) 2.5425 17.48 0.00000 0.7805 0.0000 421.2308 23.955 17.15 299.98 E/D (A) 2.1924 25.86 0.00000 0.8972-7.8995 126.0169 4.789 12.30 257.47 E/D (B) 0.27 15.41 0.00000 0.0307-1.0000 43.4 2.799 13.06 189.84 EBIT/I (A) -13.312 24.46 0.00000 7.7674-6231.31 9.0000 254.25-17.96 353.32 EBIT/I (B) -76.279 13.95 0.00000-0.5759-8476.00 9.0000 602.28-12.91 178.31 EBIT/TA (A) 0.0809 24.76 0.00000 0.0703-4.4800 1.0431 0.184-11.00 260.32 EBIT/TA (B) -0.2429 13.27 0.00000-0.0117-14.000 1.97 1.037-8.58 101.91 OR/TA (A) 1.882 16.50 0.00000 1.6008-7.7508 24.91 1.395 5.70 75.28 OR/TA (B) 2.1393 7.70 0.00000 1.7069 0.0000 18.8409 2.168 2.92 14.90 QA/S (A) 1.0167 44.84 0.00000 0.2414-0.8262 1436.65 32.015 44.86 2012.67 QA/S (B) 17.308 16.59 0.00000 0.2477 0.0000 3899 233.920 16.15 267.12 RE/TA (A) 0.3364 10.57 0.00000 0.3424-3.6052 1.2152 0.373-2.18 15.30 RE/TA (B) -5.0266 15.40 0.00000-0.0337-767.00 0.8294 49.489-13.44 192.60 S/TA (A) 1.7839 16.83 0.00000 1.5184-0.7480 24.3744 1.342 6.35 83.95 S/TA (B) 1.9817 8.13 0.00000 1.5838 0.0000 18.7697 2.064 3.01 16.33 TA (A) 570761 20.81 0.00000 164761-420717 42366711 2008599 13.43 230.14 TA (B) 37422 14.92 0.00000 11465 0.0000 1921528 126281 11.51 160.74 TL/TA (A) 0.5367 11.42 0.00000 0.5256-0.1449 4.3626 0.335 3.08 28.48 TL/TA (B) 5.5079 15.33 0.00000 0.9679 0.0000 718 46.465 13.47 192.03 WC/TA (A) 0.1947 13.80 0.00000 0.2094-4.3229 1.0000 0.327-2.74 28.47 WC/TA (B) -3.525 17.43 0.00000-0.1392-717.0 1 40.933-16.89 293.92 Source: Own processing of data from the Amadeus database. According to the results of the Grubbs test, all the variables contain at least one extreme value. The influence of these extreme values is also clear from a comparison of the average and median values of indicators. Another characteristic shared by all the indicators is a marked deviation from a normal distribution, particularly in terms of the high degree of kurtosis of the values. This high degree of kurtosis was expressed particularly markedly in the model indicator CA/CL (A), i.e. the ratio of current assets to current liabilities in the sample of active companies, and the indicator QA/S (A), i.e. the ratio of quick assets to sales, again in the sample of active companies. Quick assets represent the difference between current assets and inventories. The IN05 model works with the indicator CA/CL, the BI model with the indicator QA/S. The following table shows the percentage of valid observations on companies for the individual models divided into active and bankrupt companies. A valid observation on a company is understood as an observation for which all the variables of the given model could be quantified. Data on active companies is considerably more readily available than data on bankrupt companies, even after a long time interval (see table 2). Table 2, Number of valid observations on companies t+1 t+2 t+3 t+4 t+5 t+6 t+7 t+8 t+9 BI (A) 96.22 94.31 92.30 88.53 83.75 78.30 70.98 59.03 32.98 BI (B) 50.62 46.21 41.27 34.92 29.28 19.05 11.29 5.82 1.76 IN05 (A) 96.08 94.22 92.11 88.34 83.51 77.92 70.60 58.51 32.60 IN05 (B) 48.32 43.74 39.15 32.80 27.34 18.17 10.76 5.82 1.76 Altman (A) 96.41 94.55 92.97 89.29 84.99 79.16 72.18 59.99 33.60 Altman (B) 55.38 48.68 42.86 35.98 29.98 19.40 11.29 5.82 1.76 Source: Own processing of data from the Amadeus database. There was a pronounced fall in the number of companies that could be included in the test among bankrupt companies. The proportion of tested companies fell to 1.76 %, i.e. the average number of observations is 9, in the period nine years before bankruptcy (the period t+9).

Vision 2020: Sustainable Growth, Economic Development, and Global Competitiveness 993 Testing the accuracy of the models From the viewpoint of assessing the accuracy of the models, a company may either be evaluated by a model correctly, the company may fall in the grey zone, or a type one or type two error may occur. A type one error represents a situation in which an active company is evaluated by the model as bankrupt. A type two error represents the opposite situation. In the case of a type one error, the creditor stands to lose potential yield of interest, while in the case of a type two error he stands to lose his entire credit commitment (unpaid debt capital plus agreed interest). For this reason a type two error is between two and twenty times more serious (i.e. costly) than a type one error (see Zhou and Elhag, 2007). Type one or type two error is quantified as the number of erroneously evaluated companies to the total number of active or bankrupt companies. The accuracy of the models (correctly identified active or bankrupt company) was quantified as the ratio of the number of correctly evaluated active or bankrupt companies to the total number of valid observations on active or bankrupt companies. The total accuracy of the models, represented by the balanced average of correct observations on active and bankrupt companies, weighted by the number of valid observations, was also evaluated. Table 3, Results of testing on the Bankruptcy Index model t+1 t+2 t+3 t+4 t+5 t+6 t+7 t+8 t+9 Min. Max. Mean Active 82.36 78.46 78.56 83.05 80.19 76.43 76.09 74.17 71.01 71.01 83.05 77.82 Bankrupt 85.02 81.68 77.78 76.77 73.49 81.48 75.00 72.73 50.00 50.00 85.02 74.88 Total 82.70 78.84 78.48 82.44 79.61 76.75 76.05 74.13 70.71 70.71 82.70 77.74 Grey zone 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 type I error 14.98 18.32 22.22 23.23 26.51 18.52 25.00 27.27 50.00 14.98 50.00 25.12 type II error 17.64 21.54 21.44 16.95 19.81 23.57 23.91 25.83 28.99 16.95 28.99 22.18 Source: Own processing of data from the Amadeus database. The original version of the BI model does not use a grey zone, so the number of unevaluated companies is therefore zero. The model can accurately identify 83.05 % of active companies (77.82 % on average) in the sample tested. The number of correctly evaluated companies fell with the increasing length of time from bankruptcy, i.e. the number of years before bankruptcy. On average 22.18 % of bankrupt companies were erroneously evaluated as active companies and 12.12 % of active companies evaluated as companies threatened with bankruptcy. This value increased for individual periods with the increasing number of years before bankruptcy. On the other hand, the model manages to correctly identify bankrupt companies in a maximum of 85.02 % of cases (74.88 % on average), with a maximum of 50 % of bankrupt companies being erroneously evaluated as active companies (25.12 % on average). The overall accuracy of the model ranged in time from 70.71 to 82.7 %. The second model to be tested was the IN05 model. Table 4, Results of testing on the IN05 model t+1 t+2 t+3 t+4 t+5 t+6 t+7 t+8 t+9 Min. Max. Mean Active 22.84 21.16 22.00 25.79 28.92 31.60 30.95 30.83 28.05 21.16 31.60 26.90 Bankrupt 66.82 60.61 58.58 45.52 41.28 35.82 34.15 54.55 57.14 34.15 66.82 50.50 Total 27.79 25.39 25.40 27.45 29.78 31.81 31.06 31.36 28.44 25.39 31.81 28.72 Grey zone (T) 40.87 39.56 37.09 38.23 41.78 39.34 40.49 39.90 39.55 37.09 41.78 39.64 Grey zone (A) 43.30 41.42 38.00 38.47 42.37 39.36 40.63 40.49 39.69 38.00 43.30 40.42 Grey zone (B) 21.96 24.24 28.40 35.86 33.94 38.81 36.59 13.64 28.57 13.64 38.81 29.11 type I error 11.21 15.15 13.02 18.62 24.77 25.37 29.27 31.82 14.29 11.21 31.82 20.39 type II error 33.87 37.42 40.00 35.74 28.71 29.04 28.42 28.67 32.25 28.42 40.00 32.68 Source: Own processing of data from the Amadeus database. Note: A active, B bankrupt, T total.

994 Vision 2020: Sustainable Growth, Economic Development, and Global Competitiveness The IN05 model can correctly identify an active company in the tested sample in a maximum of 31.6 % of cases (26.9 % on average), with an average of 40.42 % of active companies remaining unevaluated (a maximum of 43.30 %) and as many as 40 % of active companies being erroneously evaluated as bankrupt companies (32.68 % on average). Within the sample of bankrupt companies, the model can correctly identify a company in a maximum of 66.82 % of cases (50.50 % on average), while an average of 29.11 % of bankrupt companies remain unevaluated (the maximum number of unevaluated companies is 38.81 %) and as many as 40 % of bankrupt companies are erroneously evaluated as active companies (32.68 %) on average. The values for the prediction accuracy given for bankrupt companies indicate that the accuracy of the model begins to rise following an initial fall (the values in periods t+8, t+9). This apparent increase in model accuracy was caused by the low number of observations. Index values lying in the grey zone are most often shown by active companies on average 95.21 % of the companies in the grey zone in the IN05 model are active companies. On average, only 4.79 % of companies in the grey zone are bankrupt companies. The total accuracy of the model in time ranges from 25.39 to 31.81 %. The total accuracy of the model is considerably reduced by its low accuracy in the sample of active companies, heightened by the number of observations on these companies. The third model tested is the Altman model from the year 2000 (see Altman, 2000). Table 5, Results of testing on the Altman model t+1 t+2 t+3 t+4 t+5 t+6 t+7 t+8 t+9 Min. Max. Mean Active 53.25 50.35 50.13 51.23 52.98 53.99 51.99 50.76 46.23 46.23 53.99 51.21 Bankrupt 49.36 37.32 26.34 25.00 18.24 17.27 17.19 24.24 40.00 17.19 49.36 28.33 Total 52.72 48.76 47.49 48.65 49.95 51.70 50.57 50.08 46.14 46.14 52.72 49.56 Grey zone 36.68 37.31 37.16 36.15 35.16 34.99 35.32 35.33 39.41 34.99 39.41 36.39 Grey zone (A) 37.43 37.36 36.40 36.35 35.21 34.72 35.50 35.46 39.54 34.72 39.54 36.44 Grey zone (B) 31.85 36.96 43.21 34.31 34.71 39.09 31.25 30.30 30.00 30.00 43.21 34.63 type I error 18.79 25.72 30.45 40.69 47.06 43.64 51.56 45.45 30.00 18.79 51.56 37.04 type II error 9.32 12.29 13.47 12.42 11.81 11.29 12.52 13.78 14.22 9.32 14.22 12.35 Source: Own processing of data from the Amadeus database. Altman s model can, in the tested sample, correctly identify an active company in 53.9 % of cases (51.21 % on average). As many as 39.54 % of active companies remain unevaluated (40.42 % on average) and as many as 14.22 % are erroneously evaluated as bankrupt companies (12.35 % on average). In the sample of bankrupt companies, the model can correctly identify a company in as many as 49.36 % of cases (28.33 % on average), with as many as a third of bankrupt companies remaining unevaluated (the largest proportion of unevaluated companies is 43.21 %) and as many as 51.56 % being erroneously evaluated as active companies (12.35 % on average). This value is surprising in relation to the accuracy of identification of bankrupt companies, which is only 28.33 %. On the other hand, the number of financially healthy companies that were evaluated as bankrupt increased significantly. This value grows unambiguously with an increasing period of time from bankruptcy, i.e. an increasing number of years before bankruptcy. Index values lying in the grey zone are again most frequently shown by active companies (on average 92.39 % of companies in the grey zone in Altman s model are active companies, with only an average of 7.61 % of companies in the grey zone being bankrupt companies). The total accuracy of the model in time ranges from 46.14 to 52.72 %. The total accuracy of the model is, in contrast to the IN05 model, supported by accuracy in the sample of active companies combined with the number of observations on active companies.

Vision 2020: Sustainable Growth, Economic Development, and Global Competitiveness 995 Discussion All the models under investigation were tested on data from a period different to that in which they were derived. Altman s model was, what s more, tested in a different environment. The testing performed demonstrated that all the models function with a lower degree of accuracy than in the period and environment in which they were created. On the sample of active companies investigated, the highest level of precision was shown by the BI model, followed by Altman s model and the IN model. On the sample of bankrupt companies, the highest level of precision was shown by the BI model, followed by the IN model and Altman s model. In contrast to the original accuracy values stated by the authors of the model, the Czech BI model operates with a precision 12.28 % lower on active data and 4.6 % lower on bankrupt data. Only the ability of the other Czech model (IN05) to predict bankruptcy was tested. Its accuracy for active companies (companies not threatened by bankruptcy) was shown to be 75.18 % lower than its original accuracy and its accuracy with data on bankrupt companies 31.11 % lower. The application of both Czech models, in the same environment though a different period, led to a significant increase in type one errors, i.e. a reduced ability to identify active companies. The increase in type one errors was smaller. A probable explanation for this is the shift in the boundaries of the grey zone in time. This theory is also supported by the fact that approximately ten times fewer bankrupt companies were found in the grey zone in the IN05 model than stated by the authors (originally 50 %, currently 4.79 %). The majority of the companies in the grey zone (i.e. 95.21 %) were not clearly threatened with bankruptcy, but were active companies. Since the indicator EBIT/I used in the IN05 model often attains extreme values during practical application in view of the low value of the denominator, the authors of the model recommend limiting its value to a maximum of 9 (Neumaier and Neumaierová, 2005). This recommendation was tested during the testing of the model. The purpose of restricting the given indicator is to eliminate distortion of the values of the index as a whole caused by the frequent extreme values of the indicator EBIT/I attained. During the testing of the model, a variant without restriction of the values of this indicator was investigated. The result was an increase in accuracy in the sample of active companies, for example in the year t+1 from a value of 22.84 % to a value of 40.21 % correctly identified companies. This remains, however, a significantly lower value for the model s identification ability than the value declared by its authors. A significant loss in accuracy was also seen for the Altman model, which in this piece of research is an example of a model created in a different environment and a different time period, though more detailed analysis reveals differences. The predication accuracy of the model fell by approximately the same percentage in the identification of active companies as for companies threatened by bankruptcy. To be precise, its ability to identify active companies is 45.11 % lower and its ability to identity bankrupt companies 45.7 % lower. The accuracy of the Altman model does not exceed the level of random selection (i.e. 50 %) either in the group of active companies or in the group of bankrupt companies. In both the IN05 model and the Altman model, the vast majority of companies grouped in the grey zone were active companies. We might note that the common feature of these models is the fact that they were created in a time period different to the test period. The comparison of the accuracy of these models offers the theory that the reduction to their robustness due to the affects of time is reflected, first and foremost, in an increase in type two errors, i.e. a reduction to their ability to correctly identify bankrupt companies. Application in a different environment also results in an increase in type one errors, i.e. a reduction to their ability to identify active companies. The causes of this increase in the error rate can be seen primarily in the shift of the boundaries of the model s grey zone (see Lukáš, 2013). The question, however, remains as to why this shift occurs. According to Altman (2000) it is likely that the profile of failure changes, which leads to the necessity of updating the models.

996 Vision 2020: Sustainable Growth, Economic Development, and Global Competitiveness Another factor in lower model accuracy in relation to the tested data may be the characteristics of the tested data. All three tested models were created with the use of a linear discriminant analysis method, which is part of the group of parametric models. Parametric models are usually based on the assumption of a normal distribution of data. As is clear from Table 1, certain model variables show a high degree of kurtosis and extreme values, for which reason it can be justifiably assumed that the prediction accuracy of the models was also influenced by the given properties of these variables. Conclusion The testing of bankruptcy models created in different time periods and environments showed that their accuracy falls markedly when they are applied to a different period or environment. This finding is in accordance with the conclusions reached by other authors. The testing of two models created in the same environment, though in a different period, along with the testing of a model from another environment and branch, makes it possible to expand these conclusions with the finding that the reduction to model robustness as an influence of time is expressed differently to the reduction in robustness as an influence of a different environment. In the case of the use of a model merely in a different period of time, its ability to identify a financially healthy company is diminished, i.e. type one error increases. The influence of a different environment reduces the accuracy of a model in both respects, i.e. in its ability to identify both bankrupt and active (financially healthy) companies. The prediction accuracy of these models was also shown to fall over time. The BI model, which was developed on the basis of data from the same field, though in a different period of time, attains an overall prediction accuracy of 70 % nine years before bankruptcy. The accuracy of prediction of bankrupt companies was significantly diminished, though this may have been caused by the low number of observations. For the sake of completeness, we would also state that the prediction accuracy of Altman s model in the same period was 46 %, and that of the IN05 model only 28 %. References Altman, E. I., (1968) Financial Ratios, Discriminant Analysis and the Prediction of Corporate Bankruptcy, The Journal of Finance, 23, 589 609. Altman, E. I., Haldeman, R. G. and Narayanan, P. (1977) ZETA Analysis. A new model to identify bankruptcy risk of corporations, Journal of Banking and Finance, 1, 22-54. Altman, E. I., (2000) Predicting financial distress of companies: Revisiting the Z-score and Zeta models [online]. [Retrieved April 23, 2013] http://pages.stern.nyu.edu/~ealtman/predfncldistr.pdf Beaver, W. H., (1966). Financial Ratios as predictors of Failure, Journal of Accounting Research 4, 71 111. Box, G. E. P. and Cox, D. R. (1964) An Analysis of Transformations, Journal of the Royal Statistical Society, 26(2), 211-252. Deakin, E. B. (1972) A Discriminant Analysis of Predictors of Business Failure, Journal of Accounting Research, 10, 167 179. Grice, J. S. and Dugan, M. T. (2001) The limitations of bankruptcy prediction models: Some cautions for the researchers, Review of Quantitative Finance and Accounting, 17, 151-166. Grubbs, F. E. (1969). Procedures for Detecting Outlying Observations in Samples, Technometrics,11(1), 1-21. Karas, M., Režňáková, M. (2013) Bankruptcy prediction model of industrial enterprises in the Czech republic, International journal of mathematical models and methods in applied sciences 7, 519 531. Karas, M., Režňáková, M. (2014) Možnosti využití bankrotního modelu k měření úvěrového rizika podniku, [Possibilities for the application of a bankruptcy prediction model for measuring credit risk of a company]. Proceedings of the Hradecké ekonomické dny 2014, 435-442.

Vision 2020: Sustainable Growth, Economic Development, and Global Competitiveness 997 Lukáš, L. (2013). Some connections between bankruptcy models and their new possibilities, Proceedings of the Faktory prosperity podniků v lokálním a globálním prostředí optikou roku 2013, 321-330. Neumaier, I., Neumaierová, I. (2005) Index IN 05, Proceedings of the Evropské finanční systémy.143-148. Niemann, M., Schmidt, J. H. and Neukirchen, M. (2008) Improving performance of corporate rating prediction models by reducing financial ratio heterogeneity, Journal of Banking & Finance, 32, 434 446. Ohlson, J. A. (1980) Financial Ratios and the Probabilistic Prediction of Bankruptcy, Journal of Accounting Research, 18, 109 131. Platt, D. H. and Platt, M. B. (1990) Development of a Class of Stable Predictive Variables: The Case of Bankruptcy Prediction, Journal of Business Finance & Accounting, 17(1), 31-51. Shapiro, S. S. and Wilk, M. B. (1965) An Analysis of Variance Test for Normality (Complete Samples), Biometrika, 52(3/4), 591-611. Shumway, T. (2001) Forecasting Bankruptcy More Accurately: A Simple Hazard Model, Journal of Business, 74, 101 24. Wu, Y., Gaunt, C. and Gray, S. (2010) A comparison of alternative bankruptcy prediction models, Journal of Contemporary Accounting & Economics, 6, 34-45. Zhou, Y., Elhag, T. M. S. (2007) Apply Logit analysis in Bankruptcy Prediction Proceedings of the 7th WSEAS International Conference on Simulation, Modelling and Optimization, pp. 301-308. Zmijewski, M. E. (1984) Methodological issues related to the estimation of financial distress prediction models, Journal of Accounting Research, 22, 59-82.