DANMARKS NATIONALBANK Far out in the tails Danish Economic Society, Koldingfjord Conference, January 2014. by Kim Abildgren Views and conclusions expressed in the presentation are those of the author and do not necessarily represent those of Danmarks Nationalbank.
Macro stress testing 2
3 The Rangvid report "... the financial crisis has exposed the limitations of the stress tests used by the authorities..." "... the models should also be further improved in the future via new knowledge and a focus on including low-probability but highconsequence scenarios..."
Real GDP growth in 2009 in Danmarks Nationalbank's hard stress scenarios 4
5 Limitations of traditional economic models used for macro stress tests Designed to capture average rather than extreme outcome. The dynamic interactions between the financial sector and the real economy are rich and complicated - especially the feedback effects from a distressed banking sector to the real economy. Theoretically well-founded and consistent storytelling as well as communication might tend to generate too "mild" stress scenarios. Correlation between macro-financial risk factors might be subject to tail dependence - estimated statistical relationships might therefore break down during crises. An assumption of linear relationships may be reasonable when shocks are small - nonlinearities might emerge during crisis (collateral constraints, fire saes, illiquid markets).
6 A supplementary approach - tails from the past Economic history Economic history is rich on extreme events: Currency crises. Banking crises. Debt crises. Severe stock-market collapses. Stress tests Might have an eye for the long-term historical perspective as a source of inspiration when designing lowprobability scenarios. Base scenarios on shocks from the tail of the historical distribution of specific macro-financial risk factors.
7 Frequency distribution of year-on-year growth in real GDP
8 Frequency distribution of year-on-year growth in real exports of goods
Frequency distribution of year-on-year change in domestic non-bank credit in per cent of nominal GDP 9
10 Frequency distribution of year-on-year growth in nominal farm prices
Frequency distribution of year-on-year nominal growth in the total share price index 11
The use of marginal historical distributions of macro-financial risk factors in stress tests 12 Evaluate the likelihood of shocks studied in simple static sensitivity analyses (e.g. a 20 per cent drop in stock prices). Identify relevant historical scenarios of interest for scenario-based stress tests (for instance the 1920s). Reverse stress testing", e.g. calculate the increase in longterm interest rates that the financial system can handle without a need for further capitalisation and use the marginal historical distributions to get an idea of the likelihood of such an increase. Inspiration for designing "worst case" scenarios, for instance the simultaneous occurrence of the largest drop in farm prices and the largest increase in long-term interest rates that we have experienced historically.
What are the cons of using marginal historical distributions in stress tests 13 Simultaneous historical distributions would be of greater interest than marginal historical distributions of each macrofinancial risk factor in isolation (However, the curse of dimensionality: 5 x 5 x 5 x 5 x 5 = 3,125). Purely "statistical" approach without specifying and explaining those transmission channels and structural relationships that would generate worst case outcomes or determining the exact likelihood of the scenarios. The key stories of stress scenarios are usually easier to tell within the framework of structural macroeconomic models. Historical outcomes reflect public support measures.
The importance of simultaneous distributions - banking crises can be very different! 14
What are the pros of using marginal historical distributions in stress tests 15 "... the main advantages of historical scenarios is the fact that they are plausible, if only because they have occurred before, and are not as sensitive to model risk as hypothetical scenarios (Varotto, 2012) One can use conditional scenarios. If e.g. the focus is on the financial system's resilience to a large drop in stock prices, one could find those years where stock prices declined by 10 per cent per or more from one year to another. One could then randomly pick one of those years and use the actual historical values of all macro-financial risk factors for this year and the following years as the stress scenario. One can use mixed scenarios based on linear combinations of historical outcomes in different periods. This could for instance be a linear combination of the outcomes from the years characterised by large drops in house prices, real GDP and real exports with the outcome from the years characterised by a large increase in long-term interest rates
16 Final remarks Quantitative macro stress testing methodologies will no doubt remain under rapid development in many years to come. However, there will properly always be a considerable element of choices and judgements involved in the design of proper stress scenarios. Stress tests based on structural macro-economic models are important for storytelling in the communication of macroprudential policy initiatives. Worst case" scenarios might be useful as some of the tools available within a larger suite of stress-test approaches. Applying different approaches for stress testing provide a more robust picture of the risks faced by the financial system.