Financial System Stress Tests, Presented by Hononhan

502 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
502
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
18
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Financial System Stress Tests, Presented by Hononhan

  1. 1. Financial System Stress Tests Seminar on Financial Stability and Development
  2. 2. Overview <ul><li>Stress tests in FSAPs </li></ul><ul><li>Stress tests in central banks & banking supervisory agencies </li></ul><ul><li>Selected methodological issues </li></ul><ul><li>Recent developments in stress test methodology </li></ul>
  3. 3. Stress Tests in FSAPs Part I
  4. 4. Defining Stress Tests <ul><li>Stress tests = a set of statistical techniques to help assess the vulnerability of financial institutions & financial systems to exceptional but plausible events </li></ul><ul><li>Defining exceptional but plausible </li></ul><ul><ul><li>Against a specific historical scenario </li></ul></ul><ul><ul><li>Hypothetical scenario based on the analysis of past volatility and correlations </li></ul></ul><ul><ul><li>Other methods </li></ul></ul>
  5. 5. Types of Stress Tests <ul><li>By aggregation </li></ul><ul><li>I ndividual exposures </li></ul><ul><li>Individual institutions </li></ul><ul><li>System-wide </li></ul><ul><ul><li>on bank by bank * data (“bottom up”) </li></ul></ul><ul><ul><li>on aggregate data (“top down”) </li></ul></ul><ul><li>By methodology </li></ul><ul><li>Sensitivity analysis </li></ul><ul><li>Scenario analysis </li></ul><ul><li>Contagion analysis </li></ul>* Most system-wide stress tests so far have been on banks. Thus, focus on banks and the banking sector here. Nonetheless, the issue of Stress tests for nonbank financial institutions will also be discussed.
  6. 6. Recent Experience with Stress Tests <ul><li>Financial crisis of late 1990s </li></ul><ul><ul><li>More focus on financial sector risks </li></ul></ul><ul><ul><li>Balance sheet approach </li></ul></ul><ul><li>Increasing interest in stress tests as a result </li></ul><ul><ul><li>Financial institutions (BIS surveys in 2000 & 2004) </li></ul></ul><ul><ul><li>Supervisory agencies & central banks </li></ul></ul><ul><ul><li>International institutions: IMF, World Bank </li></ul></ul>
  7. 7. Stress Tests in the FSAP <ul><li>Stress tests a crucial tool in the quantitative assessments in FSAPs </li></ul><ul><li>Stress tests tailored to country-specific circumstances (complexity of the financial system, data availability) </li></ul>
  8. 8. Stress Tests as a Multi-Stage Process <ul><li>I dentify macroeconomic & market risks </li></ul><ul><li>I dentif y major exposures </li></ul><ul><li>D efine coverage </li></ul><ul><li>Identify data required </li></ul><ul><li>C alibrate shocks (or scenarios) </li></ul><ul><li>S elect & implement methodolog y </li></ul><ul><li>I nterpret results </li></ul>
  9. 9. Stress Tests vs. Other Analytical Tools <ul><li>Advantages of stress tests </li></ul><ul><ul><li>Forward-looking assessment of risks </li></ul></ul><ul><ul><li>More precise than analyzing aggregated indicators (NPLs, open positions) </li></ul></ul><ul><li>Disadvantages of stress tests </li></ul><ul><ul><li>Robustness with respect to assumptions? </li></ul></ul><ul><ul><li>Banks viewed as static portfolios rather than as dynamic units </li></ul></ul><ul><ul><li>Role of non-quantitative factors? </li></ul></ul>
  10. 10. Other Analytical Methods Complement Stress Tests <ul><li>Macroprudential analysis </li></ul><ul><ul><li>Financial Soundness Indicators (FSIs) </li></ul></ul><ul><ul><li>Links between FSIs and other factors, especially the macroeconomic framework </li></ul></ul><ul><li>Analysis of qualitative information </li></ul><ul><ul><li>Legal, regulatory, accounting, tax conditions </li></ul></ul><ul><ul><li>Corporate governance </li></ul></ul>
  11. 11. Evolving Role of Stress Tests in FSAP <ul><li>Most missions: single-factor sensitivity analysis based on historical extremes </li></ul><ul><li>More recent FSAP missions </li></ul><ul><ul><li>More focus on scenario analysis </li></ul></ul><ul><ul><li>Active involvement of the authorities </li></ul></ul><ul><ul><li>Industrial countries: bank internal stress test models, authorities’ macroeconomic models, inclusion of interbank contagion risk </li></ul></ul><ul><ul><li>Inclusion of nonbank financial institutions in some cases </li></ul></ul>
  12. 12. Stress Tests in Central Banks & Banking Supervisory Agencies Part II
  13. 13. Role of Stress Tests <ul><li>Help focus supervisory processes on a risk basis </li></ul><ul><li>Support macroprudential analysis at the central banks (including in financial stability reports) </li></ul><ul><li>Assess effects of prospective policy changes </li></ul>
  14. 14. Stress Tests Conducted by Central Banks & Banking Supervisors <ul><li>Bank-by-bank stress tests conducted by supervisors </li></ul><ul><li>Financial system stability reports include or refer to aggregate stress tests </li></ul><ul><li>Range of approaches – examples: </li></ul><ul><ul><li>Hungary (focus on sensitivity calculations) </li></ul></ul><ul><ul><li>Norway (focus on sources of credit risk) </li></ul></ul>
  15. 15. Implementation Issues <ul><ul><li>Coverage – institutions </li></ul></ul><ul><ul><li>Coverage – exposures </li></ul></ul><ul><ul><li>Methodology </li></ul></ul><ul><ul><li>Organization </li></ul></ul>
  16. 16. Coverage - Institutions <ul><li>From systemic stability perspective, important to cover a significant part of the system, but not all institutions </li></ul><ul><li>But for supervisory purposes, it might be useful to increase the coverage </li></ul><ul><li>Coverage of foreign banks (branches, subsidiaries, exposures to foreign banks) </li></ul><ul><li>Consolidation (consistency across time, inclusion of non-bank financial institutions) </li></ul>
  17. 17. Coverage - Exposures <ul><li>Basic exposures to be included </li></ul><ul><ul><li>Credit risk (incl. indirect FX & interest rate risks) </li></ul></ul><ul><ul><li>Direct interest rate risk </li></ul></ul><ul><ul><li>Direct FX risk </li></ul></ul><ul><li>Other exposures to be considered </li></ul><ul><ul><li>Interbank contagion risk </li></ul></ul><ul><ul><li>Equity and/or real estate price risk </li></ul></ul><ul><ul><li>Later: liquidity, concentration risks </li></ul></ul><ul><li>Include on- & off-balance sheet exposures </li></ul>
  18. 18. Methodology <ul><li>Both sensitivity and scenario analysis </li></ul><ul><li>Scenario analysis: a combination of historical and hypothetical scenarios </li></ul><ul><li>For the hypothetical scenarios, justification using macroeconomic models (see later) </li></ul><ul><li>A mix of top down & bottom up </li></ul><ul><ul><li>Factors: computation difficulty, confidentiality </li></ul></ul><ul><ul><li>Most calculations typically bank-by-bank, but model estimates on aggregate basis </li></ul></ul>
  19. 19. Methodology <ul><li>Expressing the impact: in terms of capital adequacy ( pre- shock vs. post-shock); in terms of liquidity for liquidity stress test </li></ul><ul><li>Impact measured over what period? </li></ul><ul><ul><li>Typically one year (ideally, NPV of future impact) </li></ul></ul><ul><li>Treatment of profits </li></ul><ul><ul><li>A prudent assumption based on the past </li></ul></ul><ul><ul><li>An autonomous shock to non-interest income or net interest income (on top of other shocks) </li></ul></ul>
  20. 20. Organization <ul><li>How frequently? </li></ul><ul><ul><li>Standard set of tests on quarterly basis, market risk/sensitivity analysis more frequently, elaborate analysis (e.g. contagion) less frequently </li></ul></ul><ul><li>Run by whom? </li></ul><ul><li>Which software? </li></ul><ul><ul><li>Many start with Excel and E-Views, then integrate with supervisory information systems </li></ul></ul><ul><li>Presentation, dissemination of the results </li></ul><ul><ul><li>By bank (supervision; links with EWS) </li></ul></ul><ul><ul><li>By peer groups (macroprudential surveillance) </li></ul></ul>
  21. 21. Selected Methodological Issues Part III
  22. 22. Selected Methodological Issues <ul><ul><li>Selecting macroeconomic scenarios </li></ul></ul><ul><ul><li>Foreign exchange (FX) risk </li></ul></ul><ul><ul><li>Interest rate risk </li></ul></ul><ul><ul><li>Credit risk </li></ul></ul><ul><ul><li>Interbank contagion risk </li></ul></ul><ul><ul><li>Liquidity risk </li></ul></ul><ul><ul><li>Equity price & real estate price risk </li></ul></ul>
  23. 23. Macro Scenarios for Stress Tests <ul><li>Historical scenarios </li></ul><ul><ul><li>e.g. the 1997 turbulence and subsequent slowdown in East Asia </li></ul></ul><ul><li>Hypothetical scenarios </li></ul><ul><ul><li>Recognizing the limitations of macro models, especially for large shocks, would it be possible to use the central bank’s existing macro model? </li></ul></ul><ul><ul><li>Stochastic simulations based on the model? </li></ul></ul><ul><ul><ul><li>Scenario design: relative sizes of shocks to the risk factors </li></ul></ul></ul><ul><ul><ul><li>Assessing likelihood of the scenarios </li></ul></ul></ul>
  24. 24. Worst Case vs. Threshold Approach
  25. 25. Controversy on Probability <ul><li>Stress test scenarios should not be attached any probability measure, ST is different from the standard risk-modeling toolkit (e.g., Kupiec, 2001) </li></ul><ul><li>Stress test scenarios need to be attached an explicit probability measure; otherwise they are useless (e.g., Berkowitz, 1999) </li></ul>
  26. 26. Controversy on Probability <ul><li>Practical solutions </li></ul><ul><ul><li>Base stress test on extreme historical scenario </li></ul></ul><ul><ul><li>Relate stress test to extreme historical scenario </li></ul></ul><ul><ul><li>Use threshold approach with extreme thresholds (useful when exposures negligible: proof by contradiction ) </li></ul></ul><ul><ul><li>Combine historical scenario with hypothetical assumptions ( robustness analysis ) </li></ul></ul>
  27. 27. Foreign Exchange Risk <ul><li>The standard sensitivity analysis </li></ul><ul><li>Note: C=capital, A RW =risk-weighted assets, F=net open position, e=exchange rate </li></ul><ul><li>The impact on capital adequacy roughly equals the shock times the open position… </li></ul>
  28. 28. Foreign Exchange Risk <ul><li>... but stress test must reflect non-linearity arising from FX options </li></ul><ul><li>Off-balance sheet (OBS) positions, which include options, are not negligible in many countries. </li></ul><ul><li>Example </li></ul>-49.8 25.9 2002 -26.8 14.7 Jan-03 13.1 25.2 18.9 40.0 ... with OBS items 77.5 55.6 58.8 34.2 ... w/o OBS items 2001 2000 1999 1998 Net FX position/capital (%) 
  29. 29. Indirect FX Risk <ul><li>Nonperforming loans vs. exchange rate </li></ul><ul><li>Usually much more significant than the direct FX risk </li></ul><ul><li>The analysis requires </li></ul><ul><ul><li>Regression of leverage vs. NPLs </li></ul></ul><ul><ul><li>Inclusion of stock and flow exposures in FX </li></ul></ul>
  30. 30. Interest Rate Risk <ul><li>Duration is the key indicator, because </li></ul><ul><li>This allows to express changes in capital adequacy ratio as </li></ul><ul><li>where </li></ul>
  31. 31. Interest Rate Risk—Issues <ul><li>Adequacy of the available data, including </li></ul><ul><ul><li>Do banks report residual maturity properly? </li></ul></ul><ul><ul><li>Does the indicator capture the whole balance sheet? </li></ul></ul><ul><ul><li>Are off-balance sheet contracts included? </li></ul></ul><ul><li>Simplified method: residual maturity plus weigths proposed by Basel Committee </li></ul><ul><li>Nonlinearity (duration changes with large changes in interest rates) </li></ul><ul><li>NPV may differ from the regulatory capital </li></ul><ul><li>Correlation between risk-weighted assets and assets </li></ul><ul><li>Indirect interest rate risk (see under credit risk) </li></ul>
  32. 32. Credit Risk Modeling <ul><li>The most significant source of risk </li></ul><ul><li>Also, the most in need of strengthening </li></ul><ul><ul><li>Mechanical approaches </li></ul></ul><ul><ul><li>Approaches based on corporate sector data (leverage, interest coverage) & possibly household sector data </li></ul></ul><ul><ul><li>Approaches based on loan performance data (including the VAR model already estimated) </li></ul></ul>
  33. 33. 1. Mechanical Approaches <ul><li>Assume an inflow of new NPLs </li></ul><ul><ul><li>Function of existing NPLs, performing loans, or a weighted sum of the two </li></ul></ul><ul><li>Assume ↑ provisions on existing NPLs </li></ul><ul><ul><li>Increase in provisioning rates </li></ul></ul><ul><ul><li>Credit migration within NPLs (“transition matrix”) </li></ul></ul><ul><li>Credit expansion model: inflow of new loans, followed by credit migration to and within NPLs </li></ul><ul><li>Do the above by sectors (e.g. corporate & household) </li></ul>
  34. 34. 2. Data on Borrowers <ul><li>Leverage vs. NPLs (a possible model) * </li></ul><ul><li>Top-down calculations </li></ul><ul><li>* Notes: Based on an actual model used by IMF staff for cross-country panel data estimates. Npls – ratio of non-performing loans to total loans, lev – leverage ratio, rcc – real cost of capital, reer – real effective exchange rate, y-hat – real GDP growth rate, p-hat – inflation rate, m-hat – growth rate of M1, d-hat – growth rate of domestic credit, roe – corporate sector return on equity </li></ul>
  35. 35. 2. Data on Borrowers <ul><li>Logit model predicting individual bankruptcy probabilities as a function of age, size, industry characteristics & corporate soundness indicators (earnings, liquidity, financial strength) </li></ul><ul><li>Include interest and exchange rates on the right hand side (to capture the indirect risk) </li></ul><ul><li>Link to individual banks through their exposures to the various groups of companies </li></ul><ul><li>Predict bank potential losses (also taking into account collateral) </li></ul>
  36. 36. 2. Data on Borrowers <ul><li>A simpler approach: exposure variables </li></ul><ul><ul><li>Net open FX position & ratio of FX income to FX costs (for indirect FX risk) </li></ul></ul><ul><ul><li>Interest coverage (for indirect interest risk) </li></ul></ul><ul><li>If exposure variable exceeds an estimated (assumed) threshold, default rate rises </li></ul><ul><li>Similarly to previous approach, translate to bank losses (after collateral) </li></ul>
  37. 37. 3. Loan Performance Data <ul><li>Advantages </li></ul><ul><ul><li>Also available for household sector (with rapid lending growth in many countries) </li></ul></ul><ul><ul><li>Should be more readily available than leverage </li></ul></ul><ul><li>Disadvantage </li></ul><ul><ul><li>Lagging indicators of asset quality </li></ul></ul>
  38. 38. Introducing Contagion Risk <ul><li>Need to compile data for the following matrix </li></ul>-- -- ∙ ∙ ∙ Exposure of bank n to bank 2 Exposure of bank n to bank 1 Bank n ∙ ∙ ∙ -- -- ∙ ∙ ∙ ∙ ∙ ∙ ∙ ∙ ∙ Exposure of bank 2 to bank n ∙ ∙ ∙ -- -- Exposure of bank 2 to bank 1 Bank 2 Exposure of bank 1 to bank n ∙ ∙ ∙ Exposure of bank 1 to bank 2 -- -- Bank 1 Bank n ∙ ∙ ∙ Bank 2 Bank 1
  39. 39. Introducing Contagion Risk <ul><li>Exposure = all uncollateralized lending (including both on- & off-balance sheet exposures) </li></ul><ul><li>Currently, only data on total exposure of a bank to interbank market are available </li></ul><ul><li>Two types of the contagion stress test </li></ul><ul><ul><li>“ Pure” contagion test: A “fraud” in a bank; impact on other banks through interbank exposures </li></ul></ul><ul><ul><li>“ Macro” contagion test: Macro shocks are grossed-up to trigger failure of weakest bank; followed by interbank contagion </li></ul></ul>
  40. 40. Introducing Contagion Risk <ul><li>Implementation (example for 4 banks) </li></ul>Si’ = (C i -E 1i )/(A i -E i1 ), where i =2, 3, and 4. S 2 ’’=(C 2 -E 12 -P 3 *E 32 -P 4 *E 42 )/(A 2 -E 21 -P 3 *E 23 -P 4 *E 24 ) S 3 ’’=(C 3 -E 13 -P 2 *E 23 -P 4 *E 43 )/(A 3 -E 31 -P 2 *E 32 -P 4 *E 34 ) S 4 ’’=(C 4 -E 14 -P 2 *E 24 -P 3 *E 34 )/(A 4 -E 41 -P 2 *E 42 -P 3 *E 43 ) ... estimate as a part of the EWS model
  41. 41. <ul><li>Aggregate stress test vs. interbank contagion stress test </li></ul>Introducing Contagion Risk
  42. 42. Equity & Real Estate Price Risk <ul><li>Equity price risk—similar to FX risk </li></ul><ul><ul><li>Net open positions in equities </li></ul></ul><ul><ul><li>Need to include off-balance sheet exposures </li></ul></ul><ul><li>Banks’ exposure to real estate price risk </li></ul><ul><ul><li>Direct exposure (investment in real estate) </li></ul></ul><ul><ul><li>Credit exposure (developers etc.) </li></ul></ul><ul><ul><li>Degree of real estate collateralization </li></ul></ul><ul><ul><ul><li>loan to value ratio </li></ul></ul></ul><ul><ul><ul><li>default probability (from credit risk stress test) </li></ul></ul></ul>
  43. 43. Concentration Risks (Credit) <ul><li>Simple example: sensitivity analysis for large exposures </li></ul><ul><li>More sophisticated example </li></ul><ul><ul><li>Run regressions for default probability on corporate data (company-by-company), with dummy variables for the sectors/regions </li></ul></ul><ul><ul><li>Ways to define default probability (actual default—run a logit regression; or set a threshold for interest coverage ratio) </li></ul></ul><ul><ul><li>For a set of a bank’s exposures to sectors/regions, calculate implied default probability </li></ul></ul>
  44. 44. Liquidity Risk <ul><li>Focus on bank liquidity stress tests </li></ul><ul><li>Results reported off-site, validate during on-site visits </li></ul><ul><li>Off-site cross-check (sensitivity analysis) </li></ul><ul><ul><li>Overall risk: assume a % of deposits withdrawn (percentages determined based on past bank runs, vary for different maturities) </li></ul></ul><ul><ul><li>Concentration risk in deposits (same as above, but for a percentage of the largest deposits) </li></ul></ul>
  45. 45. Recent Developments in Stress Test Methodology Part IV
  46. 46. Bank Internal Stress Test Models <ul><li>Two surveys of stress test practices in commercial banks (2000 & 2004) </li></ul><ul><li>More attention to bank internal stress tests in on-site visits </li></ul><ul><li>Consider issuing guidelines on stress tests in commercial banks? </li></ul><ul><li>Cross-check results of bank & supervisor stress tests </li></ul>
  47. 47. Stress Tests vs. Early Warning Systems <ul><li>Consider designing an EWS system in the form of a statistical model of detection of bank failure/stress </li></ul><ul><li>Could be back tested against the ratings </li></ul><ul><li>BIS working paper on EWS for banking supervision </li></ul>
  48. 48. Cross-Market Contagion <ul><li>Coverage of non-bank financial institutions in the framework for consolidated supervision </li></ul><ul><li>Contagion between banks and non-bank financial institutions—e.g. insurance companies </li></ul><ul><li>Credit derivatives </li></ul>
  49. 49. Further Reading <ul><li>Blaschke et al., 2001, “ST of Financial Systems: An Overview of Issues, Methodologies, and FSAP Experiences,” IMF WP 01/88 </li></ul><ul><ul><li>www.imf.org/external/pubs/cat/longres.cfm?sk=15166.0 </li></ul></ul><ul><li>IMF & WB, 2003, “Analytical Tools of the FSAP” </li></ul><ul><ul><li>www.imf.org/external/np/fsap/2003/022403a.pdf </li></ul></ul><ul><li>Č ih á k, 2004, “ST : A Review of Ke y Concepts , ” Czech National Bank technical note 2/ 20 04 </li></ul><ul><ul><li>http://www.cnb.cz/en/pdf/IRPN_2_2004.pdf </li></ul></ul>

×