Credit Risk Stress Testing
Stress Testing Features of Risk Evaluator 1.6
1. Introduction
Risk Evaluator is a financial tool intended for evaluating market and credit risk of single positions or of large multi-currency portfolios. RiskMetrics™ and CreditMetrics™ methodologies of J.P.Morgan Bank and structured Monte Carlo simulation are implemented for about 40 financial instruments including interest rate, foreign exchange and stock instruments, futures and options.
Credit Risk of a transaction expresses the uncertainty of future cash flow payments involved by the credit standing of the counterpart to that transaction. The risk to a particular party depends on two factors: changes in market rates, that is market risk and whether or not the counterpart will default prior to the maturity, that is credit risk. The main task in evaluation credit risk is the computation of the credit risk exposure profile showing the notional amount that can be lost when a counterpart default its obligations. The credit risk of a counterpart or of a multi-party portfolio is measured by a single value, called credit Value at Risk (VaR). VaR represents the expected loses (adverse move) of the portfolio value due to credit events at given confidence level and for given credit risk h orizon.
The resulting Value at Risk is set normally to give a 95% confidence level, that is the actual loss should exceed the Value at Risk figure only in 5% of cases. The risk horizon is set in the most cases to one year, but larger or shorter risk horizons are meaningful too.
Risk evaluation software is important for financial institutions due to the BIS/Basle regulations. Risk Evaluator covers the most BIS/Basle requirements for Value at Risk (VaR) calculation.
Stress testing provides useful information on the model’s range of results, and also allows investigation of the sensitivity of risk estimates to model inputs and critical assumptions. Higher evaluation model transparency can be obtained through changes of input data and exploration of credit risk results.
The BIS report describes reported stress testing activities as including:
deterioration in credit ratings,
changes in default probabilities,
deterioration in market spreads,
changes of recovery rates, and
changes in correlation structures.
This study was inspired by [2], a publication in RiskMetrics Jourmal, May 2000. It describes briefly the stress testing features of Risk Evaluator 1.6 outlining stress testing results for major model input factors having influence on credit risk VaR. The s tudy provides examples of the kind of stress testing and sensitivity analysis possible using the Risk Evaluator examining the risk profile of an Eurobond benchmark.
2. Benchmark Portfolio of Eurobonds – Risk Profile
The portfolio used in this analysis study is a set of 215 liquid Eurobonds in 8 currencies (BEF, DEM, ESP, EUR, FRF, IEP, ITL and NLG). The portfolio is weighted by bond liquidity. The bonds are assigned to a set of obligors rated from A1 to Ba3 within Moody18 rating system (see Figure 1) group ed in two
groups: A1, A2 and A3 – middle to good quality obligors with 60 % and Ba1, Ba2 and Ba3 – passable obligors with 40 %. The average rating of the portfolio is A3.
Figure 1
Running a simulation summary report in Risk Evaluator using EUR as base currency, a one-year risk horizon, and 100 000 simulation runs provides the risk profile in Table 1.
Table 1
Sample Results from a Simulation Summary on the Portfolio
Estimated Parameter Result RORAC
Expected Portfolio Return 5.09%
5 Percentile Loss from Mean 1.52% 3.348 1 Percentile Loss from Mean 3.92% 1.300 0.3 Percentile Loss from Mean 6.36% 0.800 0.1 Percentile Loss from Mean 8.85% 0.575
We have a 99% confidence that we will not lose more than 3.92% of the expected value of the portfolio at the risk horizon. The RORAC is calculated as the Return/Risk quotient.
Risk Evaluator produces correlated credit VaR results grouping obligors into sub -portfolios according to industry sectors and company structures. A sample 5 % risk report from a simulation shows risk estimation results by industry sectors (see Table 2.). The portfolio VaR is 1.52 % of portfolio expected value (distribution mean). The VaR results by industry sectors are presented in column 3 of Table 2.
The simple uncorrelated sum of VaR of industry sectors produce a higher VaR result of 2.7180 %, so the risk diversification effect is 1.1980 %. The risk diversification effect can be explained through following correlation chain:
Obligors are assigned to branch indexes on percent basis, branch indexes are bound to branch index correlation matrix that is obtained from historic index series.
Obligor correlation is derived from branch index assignments and from branch index correlation matrix.
Industry sector correlation is derived from obligor assignments to industry sectors and from
Table 2
Sample 5 % Risk from a Simulation Report by Industry Sectors
Industry Sector VaR VaR (%) Expected Value Financial 453,440.70 2.3587% 19,223,899.62 Transportation 369,697.75 2.9928% 12,352,735.66 Utilities 564,995.31 3.1261% 18,073,419.61
Banks 499,538.88 3.1175% 16,023,866.51
Industrial 167,868.18 1.6869% 9,951,212.96 Simple Sum 2,055,540.82 2.7180% 75,625,134.36 Portfolio Result 1,149,580.53 1.5201% 75,625,134.36 Diversification Effect 905 960.29 1.1980%
3. Sensitivity Analysis
For a portfolio of bonds, Table 3 summarizes the major model input factors that have an impact on the risk estimates in terms of their effect on the estimate of price volatility and asset return correlation.
Risk Evaluator allows construction of stress test scenarios containing specific changes in major model input factors. Following stress testing scenario features are available the whole portfolio:
Change transition matrixes based on systematic component and credit year quality.
Spreading ratings related spread curves by parallel shifts and long or short end twists.
Spreading market risk volatility by parallel shifts and long or short end twists important for evaluation of market driven instruments.
Chock or set constant correlation within branch index correlation matrix.
A set of stress test scenarios can be related to individual industry sectors:
Up or Down grading all counterparts within industry sector.
Increase or decrease volumes of counterpart positions within industry sector.
Change Exogenous Factor (market dependence) for counterparts, that is change the relation between obligor specific risk and branch index dependence risk within industry sectors.
All parameters defining scenarios are stored in scenario tables for later use. The user can change or reload existing scenarios. Credit risk results and corresponding scenario parameters are stored using a relation to allow for scenario and credit risk result reporting.
Table 3
Model factors used for stress testing in Risk Evaluator
Model Factor Impact on Model Stress Testing in Risk Evaluator Transition and Default Probabilities Volatility of Losses Scenario: Stress Transition Matrixes Spread curves Exposure Volatility Scenario: Spreading spread curves Recovery Rate and Standard Deviation Volatility of Losses Database: Change seniority classes Branch Index Correlation Obligor Correlation Scenario: Set constant correlation Obligor Rating (Industry Sector) Volatility of Losses Scenario: Up/Down grading obligors Obligor Specific Risk (Industry Sector) Obligor Correlation Scenario: Change exogenous factor Obligor Volume (Industry Sector) Obligor’s Exposure Scenario: Change obligor’s volume
The major model factor can be changed in Risk Evaluator either using the stress test scenarios or manipulating the data in the database.
Figure 2
Risk Evaluator Stress Testing Dialog
3.1 Recovery Rate Sensitivity
To assess the sensitivity of risk estimates to changes in reco very rate, a set of stress tests were run.
The recovery rate was set progressively from 0 to 100% in steps of 10%. The results of each simulation summary were exported to Excel and then summarized to produce the results shown on Figure 3.
Figure 3
Percentile Risk vs. Mean Recovery Rate
0 2 4 6 8 10 12 14 16
0 10 20 30 40 50 60 70 80 90
0.1 Percentile Loss from Mean
0.3 Percentile Loss from Mean
1 Percentile Loss from Mean 5 Percentile Loss from Mean
From this chart we can see the following:
All percentile risk measures decrease as recovery rate increases.
Sensitivity to recovery rate increases as we consider smaller risk percentiles.
3.2 Portfolio Correlation Sensitivity
In order to investigate the sensitivity to the level of correlation in the portfolio, Risk Evaluator was set to use the Constant Correlation setting on the Advanced Credit Risk Simulation Options Panel.
This forces the asset return correlations between every branch index to the same va lue. The level of constant correlation varied from 0 to 1 in steps of 0.1, with simulation summary outputs exported to Excel. The results are shown in Figure 4. We can see the following trends in this data:
As the level of asset correlation is increased, all risk percentiles generally increase
.
Sensitivity to asset correlation increases as we consider larger asset correlation.
Figure 4
4. Specific Correlation Scenarios
In addition to testing the sensitivity to overall levels of correlation in the portfolio, Risk Evaluator also tests the effect of a change in the specific correlation among a set of industries. This feature is available within the Industries Stress Scenario Panel (Figure 5). Rating up / down grading can be defined separate for every industry sector changing the rating for all obligors assigned to the sector. The volume factor allows to increase or to decrease the exposure for all obligors within the sector. This is used to simulate and to check industry sector balance and diversification strategies. The market dependence parameter is intended to simulate increasing or decreasing the obligor’s specific risk part related to branch index dependence part described by obligor’s percentile assignments to branch indexes. A zero value means
Percentile Risk vs. Constant Correlation
0 2 4 6 8 10 12
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0.1 Percentile Loss from Mean
0.3 Percentile Loss from Mean
1 Percentile Loss from Mean 5 Percentile Loss from Mean
no index dependence (only specific risk) while a value = 1 forces total index dependence (no specific risk).
Figure 5
Risk Evaluator Industries Stress Scenario Panel
For the analysis the correlation for each industry was increased progressively from 0 to 1 in steps of 0.1. The results summarized in figures 6 through 10, show that the most observable effect is in the 0.3 and 0.1 percentiles.
Figure 6
Figure 7
Financial Percentile Risk vs. Constant Correlation
0 2 4 6 8 10 12
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0.1 Percentile Loss from Mean
0.3 Percentile Loss from Mean
1 Percentile Loss from Mean 5 Percentile Loss from Mean
Transportation Percentile Risk vs. Constant Correlation
0 1 2 3 4 5 6 7 8 9
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0.1 Percentile Loss from Mean
0.3 Percentile Loss from Mean
1 Percentile Loss from Mean 5 Percentile Loss from Mean
Figure 8
Utilities Percentile Risk vs. Constant Correlation
0 5 10 15 20 25
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0.1 Percentile Loss from Mean
0.3 Percentile Loss from Mean
1 Percentile Loss from Mean 5 Percentile Loss from Mean
Figure 9
Figure 10
5. Transition Probabilities – Predictive Stress Testing
For the analysis the systematic component was increased progressively from 0 to 10% in steps of 1% as the value of the credit year quality varied from 0 to 3 in steps of 0.3. Refer to [1] for details on Conditional Transition Matrix. The simulation summary output for systematic component = 5 % and credit year quality variation was exported to Excel. The results are shown in Figure 11.
Banks Percentile Risk vs. Constant Correlation
0 2 4 6 8 10 12 14 16 18
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0.1 Percentile Loss from Mean
0.3 Percentile Loss from Mean
1 Percentile Loss from Mean 5 Percentile Loss from Mean
Industrial Percentile Risk vs. Constant Correlation
0 2 4 6 8 10 12
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0.1 Percentile Loss from Mean
0.3 Percentile Loss from Mean
1 Percentile Loss from Mean 5 Percentile Loss from Mean
Figure 11
. We can see the following trends in this data:
As the credit year quality going high, all risk percentiles generally decrease
.
Sensitivity to year quality decreases as we consider higher quality.
6. M ulti-factor Stress Testing
Risk Evaluator allows the user to stress test multiple factors. Figure 12 shows the combined effect of varying recovery rates and constant correlation across the Eurobond portfolio. A set of simulation runs is completed, where the constant correlation varied from 0.1 to 0.9 in steps of 0.2, and the recovery rates varied from 10% to 90% in steps of 20%. The results are presented in a 3-D risk profile for the first percentile loss from mean.
Predictive Risk vs. Credit Year Quality
0 1 2 3 4 5 6 7 8 9 10
0 0.3 0.6 0.9 1.2 1.5 1.8 2.1 2.4 2.7 3
0.1 Percentile Loss from Mean
0.3 Percentile Loss from Mean
1 Percentile Loss from Mean 5 Percentile Loss from Mean
Figure 12
7. Risk Evaluator Performance
Risk Evaluator is characterized by extremely high evaluation speed based on representation of instruments and portfolios by pricing expression trees. Specific instrument objects create pricing expressions trees for every instrument types and for portfolios and other aggregates using mapping to market risk grid points. The pricing expressions are simplified at run time reducing the volume of needed subsequent calculations while exposure creation and Monte Carlo runs. Fast risk evaluation engines perform recursive calculations on pricing trees using specific volatility and covariance algebra.
Sample performance results for the analyzed test portfolio and for a large portfolio of 2 150 positions in 9 currencies are shown in Table 4. The total valuation time for the 215 position portfolio is 43 seconds including all needed times for loading the positions and the risk data sets from data base and the simulation time. The pure simulation time is 22 seconds for 10 000 runs including pricing tree construction. The simulation time for 100 000 runs is about 1 minute. The large portfolio needs about 3 minutes for all where the pure simulation for 10 000 runs consumes only 108 seconds.
The performance test was created on a Pentium III / 666 MHz with 128 MB memory using a fast Oracle server.
10 30 50 70 90
0.1 0.5
0.9 0
1 2 3 4 5 6 7
Recovery Rate
Constant
Correlation
1 Percentile Loss for Mean
Table 4
Sample Results from a Performance Report
Value Date Confidence(%) Currency
Date 15.11.2000 15.11.2000 95 EUR
Test Portfolio Positions Load Counterparts Load Currencies Load
215 5 sec 81 6 sec 9 10 sec
Calculate Var(%) VaR PF Value Total
Market Risk 7 0,31 313,620.71 101,343,790.62 22 sec Monte Carlo 40 0.27 273,581.73 101,344,082.38 55 sec Credit Risk 22 1.60 1,211,851.70 75,620,143.23 43 sec Large Portfolio Positions Load Counterparts Load Currencies Load
2150 44 290 7 sec 2 2 sec
Calculate Var(%) VaR PF Value Total
Market Risk 11 0.31 3,355,032.83 1,082,739,918.44 57 sec Monte Carlo 30 0.28 2,996,012.66 1,082,743,026.92 76 sec Credit Risk 108 0.68 4,463,390.65 652,375,412.58 161 sec
8. Summary
The Risk Evaluator features to transparently change the major model factors composed in stored scenarios allows for impressive sensitivity and stress testing analysis. Stress test parameter settings and results are written back into database. Simple reporting is possible through clipboard copy and paste to other applications such as Excel or Word. Advanced reporting is performed by Crystal Reporter using stored reporting information in database.
The presented features highlight the need to allocate capital based on reasonable model factor stress.
Based on an understanding of the model parameter influence on risk results the user can create corresponding confidence intervals around the estimates for risk and economic capital.
References
[1] Kim, J. (1999) Conditional Transition Matrix Builder:
Technical Document
[2] Rob Fraser(2000) Stress Testing Credit Risk Using CreditManager 2.5:
RiskMetrics Jourmal May 2000