SlideShare a Scribd company logo
1 of 23
Download to read offline
Uncertain
Covariance Models
RISK FORECASTS THAT KNOW HOW ACCURATE THEY ARE AND WHERE
NOV 9, 2015 QWAFAFEW SAN FRANCISCO
ANISH R. SHAH, CFA ANISHRS@INVESTMENTGRADEMODELING.COM
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
The Math of Uncertain Covariance
Straightforward … and not for a presentation
Shah, A. (2015). Uncertain Covariance Models
http://ssrn.com/abstract=2616109
Questions or comments, please email
AnishRS@InvestmentGradeModeling.com
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
Background: Why Care About
Covariance?
Notions of co-movement are needed to make decisions throughout the investment process
1. Estimating capital at risk and portfolio volatility
2. Hedging
3. Constructing and rebalancing portfolios through optimization
4. Algorithmic trading
5. Evaluating performance
6. Making sense of asset allocation
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
Background: Why Care About
Uncertainty?
1. Nothing is exactly known. Everything is a forecast
2. However, one can estimate the accuracy of individual numbers
Suppose two stocks have the same expected covariance against other securities
The first has been well-predicted in the past, the other not
Which is a safer hedge?
3. It’s imprudent to make decisions without considering accuracy
A fool, omitting accuracy from his objective, curses optimizers for taking numbers at face value
4. Relying on wrong numbers can cost you your shirt
under leverage
when you can be fired and have assets assigned to another manager
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
A Factor Covariance Model in Pictures
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
GOOG
Market
Risk Factors
Exposures
Stock-Specific
Effect
AAPL
GE
Growth-Value
Spread
Together these constitute a
model of how securities move –
jointly (winds and sails) and
independently (motors)
The Math of a Factor Covariance Model
1. Say a stock’s return is partly a function of pervasive factors, e.g. the return of the market and oil
𝑟𝐺𝑂𝑂𝐺 = ℎ 𝐺𝑂𝑂𝐺 𝑓 𝑚𝑘𝑡, 𝑓𝑜𝑖𝑙 + stuff assumed to be independent of the factors and other securities
2. Imagine linearly approximating this function
𝑟𝐺𝑂𝑂𝐺 ≈
𝜕ℎ 𝐺𝑂𝑂𝐺
𝜕𝑓 𝑚𝑘𝑡
𝑓 𝑚𝑘𝑡 +
𝜕ℎ 𝐺𝑂𝑂𝐺
𝜕𝑓 𝑜𝑖𝑙
𝑓𝑜𝑖𝑙 + constant + stuff
3. Model a stock’s variance as the variance of the approximation
𝑣𝑎𝑟 𝑟𝐺𝑂𝑂𝐺 ≈
𝜕ℎ 𝐺𝑂𝑂𝐺
𝜕𝑓 𝑚𝑘𝑡
𝜕ℎ 𝐺𝑂𝑂𝐺
𝜕𝑓 𝑜𝑖𝑙
exposures
sails
𝑣𝑎𝑟 𝑓 𝑚𝑘𝑡 𝑐𝑜𝑣 𝑓 𝑚𝑘𝑡, 𝑓𝑜𝑖𝑙
𝑐𝑜𝑣 𝑓 𝑚𝑘𝑡, 𝑓𝑜𝑖𝑙 𝑣𝑎𝑟 𝑓𝑜𝑖𝑙
factor covariance
how wind blows
𝜕ℎ 𝐺𝑂𝑂𝐺
𝜕𝑓 𝑚𝑘𝑡
𝜕ℎ 𝐺𝑂𝑂𝐺
𝜕𝑓 𝑜𝑖𝑙
exposures
sails
+ 𝑣𝑎𝑟 stuff
stock specific variance
size of motor
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
The Math of a Factor Covariance Model
4. Covariance between stocks is modeled as the covariance of their approximations
𝑐𝑜𝑣 𝑟𝐺𝑂𝑂𝐺, 𝑟𝐺𝐸 ≈
𝜕ℎ 𝐺𝑂𝑂𝐺
𝜕𝑓 𝑚𝑘𝑡
𝜕ℎ 𝐺𝑂𝑂𝐺
𝜕𝑓 𝑜𝑖𝑙
exposures
sails (𝐺𝑂𝑂𝐺)
𝑣𝑎𝑟 𝑓 𝑚𝑘𝑡 𝑐𝑜𝑣 𝑓 𝑚𝑘𝑡, 𝑓𝑜𝑖𝑙
𝑐𝑜𝑣 𝑓 𝑚𝑘𝑡, 𝑓𝑜𝑖𝑙 𝑣𝑎𝑟 𝑓𝑜𝑖𝑙
factor covariance
how wind blows
𝜕ℎ 𝐺𝐸
𝜕𝑓 𝑚𝑘𝑡
𝜕ℎ 𝐺𝐸
𝜕𝑓 𝑜𝑖𝑙
exposures
sails (𝐺𝐸)
Note: no motors here – they are assumed independent across stocks
5. Parts aren’t known but inferred, typically by regression, or by more sophisticated tools
6. Best is to forecast values over one’s horizon
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
GOOG
Uncertain Risk Factors
projected onto orthogonal directions
Uncertain
Exposures
Uncertain
Stock-Specific
Effect
Welcome to reality!
Nothing is known with certainty.
But some forecasts are believed
more accurate than others
A portfolio’s risk has – according
to beliefs – an expected value
and a variance
Good decisions come from
considering uncertainty explicitly.
Ignoring doesn’t make it go away
An Uncertain Factor Covariance Model
Uncertain Exposures
Beliefs about future exposure to the factors are communicated as Gaussian
◦ 𝒆 𝐺𝑂𝑂𝐺 ~ 𝑁 𝒆 𝐺𝑂𝑂𝐺, 𝛀 𝐺𝑂𝑂𝐺
◦ Exposures can be correlated across securities
◦ Estimates of mean and covariance come from the method to forecast exposures and historical accuracy
So, a portfolio’s exposures are also Gaussian
◦ This fact is used in the math to work out variance (from uncertainty) of portfolio return variance
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
Sidebar: E[β2] > (E[β])2
Ignoring Uncertainty Underestimates Risk
A CAPM flavored bare bones example to illustrate the idea:
◦ Stock’s return = market return × β
◦ Variance of stock’s return = market var × β2
Say β isn’t known exactly
◦ E[variance of stock’s return] = market var × E[β2]
= market var × (E2[β] + var[β] )
> market var × E2[β]
Ignoring uncertainty underestimates risk
◦ Note: this has nothing to do with aversion to uncertainty
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
“uncertainty correction”
Uncertain Factor Variances
Beliefs about the future factor variances are communicated as their mean and covariance
◦ Forecasts are the mean and covariance – according to uncertainty – of return variances
◦ Not Gaussian since variances ≥ 0
How the heck do you generate these?
Shah, A. (2014). Short-Term Risk and Adapting Covariance Models to Current Market Conditions
◦ http://ssrn.com/abstract=2501071
1. Forecast whatever you can, e.g. from VIX and cross-sectional returns, the volatility of S&P 500 daily
returns over the next 3 months will be 25% ± 5% annualized
2. The states of quantities measured by the risk model imply a configuration of factor variances
Since this inferred distribution of factor variances arises from predictions, it is a forecast
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
Adapting Infers Distribution
Of Factor Variances
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
SP
500
IBM
WM
OIL
1. Noisy variance forecasts via all manner
of Information sources
Implied vol, intraday price movement, news
and other big data, …
2. Imply a distribution on how the world is
3. An aside: this extends to the behavior of other securities
All risk forecasts are improved
JNJ
SB UX
FDX
Uncertain Stock-Specific Effects
Stock-specific effects (motors) are best regarded as both exposures (sails) and factors (wind)
1. A motor is like wind that affects just 1 stock
2. Its size is estimated with error like a sail
3. The average size of motors across securities varies over time
e.g. stock-specific effects can shrink as market volatility rises
Since it might depend on the variance of other factors, average size gets treated like one
Thus, uncertainty from stock-specific effects is captured using both types of uncertainty in the
preceding slides.
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
All Set with Machinery:
Uncertain Portfolio Variance
Math then yields for a portfolio
◦ expected variance
◦ standard deviation of variance
according to beliefs (estimates) about uncertainty in the pieces
◦ exposures
◦ factor variances
◦ stock-specific effects
Expectation and standard deviation are with respect to beliefs
◦ Not reality, but one’s best assessment of it
◦ “Given my beliefs, the portfolio’s tracking variance is E ± sd”
◦ What a person (or computer) needs to make good decisions from the information at hand
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
Applications
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
Portfolio Optimization: Uncertain Utility
Conventional
maxw U(w) = r(w) – λ × v(w) where r(w) = mean return, v(w) = variance of return
Uncertain
maxw O(w) = E[U(w)] – γ × stdev[U(w)]
var[U(w)] = var[r(w)] + λ2 var[v(w)] – 2 λ stdev[r(w)] stdev[v(w)] × ρw
ρw = cor[r(w), v(w)] for portfolio w, the correlation of uncertainty in mean and in variance
r(w) ~ N[wTμ, wTΣw] assume mean returns have Gaussian error
All pieces are known except ρw which, absent beliefs, can be set to 0
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
Portfolio Optimization:
Maximize Risk Adjusted Return
Risk-adjusted return ≡ portfolio alpha - ½ portfolio tracking variance
Say alpha is known exactly
Randomly pick 10 securities – ½ are eq wt benchmark, ½ are optimized into fully invested portfolio
Optimize under the following covariance models
Base conventional Bayesian 15 factor PCA model
Adapted base model adapted to forecasts of future market conditions
Uncertain[γ] adapted model with uncertainty information
maximize alpha - ½ [variance + γ stdev(variance)]
note: Uncertain[0] has uncertainty correction, but no penalty on uncertainty
Measure the shortfall in realized risk-adjusted return vs. the ideal (w/future covariance known)
Repeat the experiment 1000 times
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
Portfolio Optimization:
Maximize Risk Adjusted Return (cont)
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
-140
-120
-100
-80
-60
-40
-20
0
Base Adapted Uncertain[0] Uncertain[0.1] Uncertain[1] Uncertain[10]
RISKADJUSTEDRETURN
Shortfall in realized risk-adjusted return vs decision with future covariance known
10% 25% 50% 75% 90%
Considering uncertainty tames downside
without costing upside
2013-Jun-27 with a horizon of 20 trading days
percentile:
of the 1000 experiments
Predicted vs Realized Efficient Frontier
Perfectly known alphas
Random 5 stock portfolio, 5 stock benchmark
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
0
0.5
1
1.5
2
2.5
0 2 4 6 8 10 12
Alpha
Tracking Error
Base predicted
Adapted predicted
Uncertain[0] predicted
Uncertain[1] predicted
Uncertain[10] predicted
Uncertain[10] realized
Uncertain[1] realized
Uncertain[0] realized
Adapted realized
Base realized
Underestimated Risk
Realized Efficient Frontier, Imperfect Alphas
cor(Forecast, Realized Alpha) = .07
Random 5 stock portfolio, 5 stock benchmark
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
-0.4
-0.2
0
0.2
0.4
0.6
0.8
1
0 1 2 3 4 5 6
Alpha
Tracking Error
Uncertain[10]
Uncertain[1]
Uncertain[0]
Adapted
Base
Realized Efficient Frontier, Imperfect Alphas
cor(Forecast, Realized Alpha) = .07
Random 15 stock portfolio, 15 stock benchmark
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0 1 2 3 4 5 6 7 8
Alpha
Tracking Error
Uncertain[10]
Uncertain[1]
Uncertain[0]
Adapted
Base
Pairs Trading
Improved via knowledge of uncertainty
◦ Feel bullish (or bearish) about one or several similar securities
◦ Have candidates you feel the opposite about
◦ Choose – from the two sets – the long-short pair with lowest uncertainty
penalized risk
◦ If you have explicit alpha forecasts, instead maximize uncertain utility
◦ Better risk control = safer leverage and more room to pursue alpha
A toy example, hedging with 3 securities
◦ AAPL is the reference security
◦ Every 11 trading days from 2012 through 2013, find the best 3 hedges
(ignoring stock-specific effects) from a universe of tech stocks and equal
weight-them
◦ Calculate the subsequent 10 day volatility of daily returns of long AAPL,
short the equal weighted
Model Avg 1 Day TE
Base 1.34
Uncertain[0] 1.13
Uncertain[0.5] 1.14
Uncertain[1] 1.13
Uncertain[100] 1.15
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
Investment Grade Modeling LLC
Uncertain Covariance Models
Run nightly in the cloud. Bloomberg BBGID or ticker
Built uniquely for each use
◦ Risk factors arise from one’s universe (e.g. only healthcare + tech, all US equities + commodity indices)
◦ .. and horizon (e.g. 1 day, 6 months) and return frequency (daily or weekly)
◦ Exposures (sails) are forecasts of the average over the horizon
◦ Factors volatilities (winds) and specific risks (motors) are adapted to forecasts of future volatility over
the horizon made from broad set of information
◦ Though I believe risk crowding is baloney: zero chance of crowding from others using an identical model
“Augmented” PCA
◦ PCA + (as necessary) factors to cover important not-stock-return-pervasive effects, e.g. VIX and certain
commodities
Java library does uncertainty calculations
INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
ANISH R. SHAH, CFA
ANISHRS@
INVESTMENTGRADEMODELING.COM

More Related Content

What's hot

Apoorva Javadekar -Ratings Quality Under ’Investor-Pay Model
 Apoorva Javadekar -Ratings Quality Under ’Investor-Pay Model Apoorva Javadekar -Ratings Quality Under ’Investor-Pay Model
Apoorva Javadekar -Ratings Quality Under ’Investor-Pay ModelApoorva Javadekar
 
Federico Thibaud - Capital Structure Arbitrage
Federico Thibaud - Capital Structure ArbitrageFederico Thibaud - Capital Structure Arbitrage
Federico Thibaud - Capital Structure ArbitrageFederico Thibaud
 
Measuring the behavioral component of financial fluctuaction. An analysis bas...
Measuring the behavioral component of financial fluctuaction. An analysis bas...Measuring the behavioral component of financial fluctuaction. An analysis bas...
Measuring the behavioral component of financial fluctuaction. An analysis bas...SYRTO Project
 
A Short Glimpse Intrododuction to Multi-Period Fuzzy Bond Imunization for Con...
A Short Glimpse Intrododuction to Multi-Period Fuzzy Bond Imunization for Con...A Short Glimpse Intrododuction to Multi-Period Fuzzy Bond Imunization for Con...
A Short Glimpse Intrododuction to Multi-Period Fuzzy Bond Imunization for Con...NABIH IBRAHIM BAWAZIR
 
C323-RiskManagementPrinciplesandApplications-AssignmentOne
C323-RiskManagementPrinciplesandApplications-AssignmentOneC323-RiskManagementPrinciplesandApplications-AssignmentOne
C323-RiskManagementPrinciplesandApplications-AssignmentOneMark Heath - BA Hons, MSc, MCIPS
 
Impact of Valuation Adjustments (CVA, DVA, FVA, KVA) on Bank's Processes - An...
Impact of Valuation Adjustments (CVA, DVA, FVA, KVA) on Bank's Processes - An...Impact of Valuation Adjustments (CVA, DVA, FVA, KVA) on Bank's Processes - An...
Impact of Valuation Adjustments (CVA, DVA, FVA, KVA) on Bank's Processes - An...Andrea Gigli
 
Credit Risk Evaluation Model
Credit Risk Evaluation ModelCredit Risk Evaluation Model
Credit Risk Evaluation ModelMihai Enescu
 
Creating an Explainable Machine Learning Algorithm
Creating an Explainable Machine Learning AlgorithmCreating an Explainable Machine Learning Algorithm
Creating an Explainable Machine Learning AlgorithmBill Fite
 
Explainable Machine Learning
Explainable Machine LearningExplainable Machine Learning
Explainable Machine LearningBill Fite
 
Analysis of risk variables in business
Analysis of risk variables in businessAnalysis of risk variables in business
Analysis of risk variables in businessAlexander Decker
 
64920420 solution-ch10-charles-p-jones
64920420 solution-ch10-charles-p-jones64920420 solution-ch10-charles-p-jones
64920420 solution-ch10-charles-p-jonesAtiqa Tanveer
 
Optimization By Simulated Annealing
Optimization By Simulated AnnealingOptimization By Simulated Annealing
Optimization By Simulated Annealingmisterval
 
Slides money banking risk reward capm
Slides money banking risk reward capmSlides money banking risk reward capm
Slides money banking risk reward capmJulio Huato
 
Empirical Analysis of Bank Capital and New Regulatory Requirements for Risks ...
Empirical Analysis of Bank Capital and New Regulatory Requirements for Risks ...Empirical Analysis of Bank Capital and New Regulatory Requirements for Risks ...
Empirical Analysis of Bank Capital and New Regulatory Requirements for Risks ...Michael Jacobs, Jr.
 
Monte Carlo Analysis
Monte Carlo AnalysisMonte Carlo Analysis
Monte Carlo Analysispmass
 

What's hot (19)

Apoorva Javadekar -Ratings Quality Under ’Investor-Pay Model
 Apoorva Javadekar -Ratings Quality Under ’Investor-Pay Model Apoorva Javadekar -Ratings Quality Under ’Investor-Pay Model
Apoorva Javadekar -Ratings Quality Under ’Investor-Pay Model
 
Federico Thibaud - Capital Structure Arbitrage
Federico Thibaud - Capital Structure ArbitrageFederico Thibaud - Capital Structure Arbitrage
Federico Thibaud - Capital Structure Arbitrage
 
IMCA Wealth Monitor
IMCA Wealth MonitorIMCA Wealth Monitor
IMCA Wealth Monitor
 
Measuring the behavioral component of financial fluctuaction. An analysis bas...
Measuring the behavioral component of financial fluctuaction. An analysis bas...Measuring the behavioral component of financial fluctuaction. An analysis bas...
Measuring the behavioral component of financial fluctuaction. An analysis bas...
 
A Short Glimpse Intrododuction to Multi-Period Fuzzy Bond Imunization for Con...
A Short Glimpse Intrododuction to Multi-Period Fuzzy Bond Imunization for Con...A Short Glimpse Intrododuction to Multi-Period Fuzzy Bond Imunization for Con...
A Short Glimpse Intrododuction to Multi-Period Fuzzy Bond Imunization for Con...
 
C323-RiskManagementPrinciplesandApplications-AssignmentOne
C323-RiskManagementPrinciplesandApplications-AssignmentOneC323-RiskManagementPrinciplesandApplications-AssignmentOne
C323-RiskManagementPrinciplesandApplications-AssignmentOne
 
Impact of Valuation Adjustments (CVA, DVA, FVA, KVA) on Bank's Processes - An...
Impact of Valuation Adjustments (CVA, DVA, FVA, KVA) on Bank's Processes - An...Impact of Valuation Adjustments (CVA, DVA, FVA, KVA) on Bank's Processes - An...
Impact of Valuation Adjustments (CVA, DVA, FVA, KVA) on Bank's Processes - An...
 
Credit Risk Analytics
Credit Risk AnalyticsCredit Risk Analytics
Credit Risk Analytics
 
Risk & Return
Risk & ReturnRisk & Return
Risk & Return
 
Credit Risk Evaluation Model
Credit Risk Evaluation ModelCredit Risk Evaluation Model
Credit Risk Evaluation Model
 
Creating an Explainable Machine Learning Algorithm
Creating an Explainable Machine Learning AlgorithmCreating an Explainable Machine Learning Algorithm
Creating an Explainable Machine Learning Algorithm
 
Explainable Machine Learning
Explainable Machine LearningExplainable Machine Learning
Explainable Machine Learning
 
Analysis of risk variables in business
Analysis of risk variables in businessAnalysis of risk variables in business
Analysis of risk variables in business
 
64920420 solution-ch10-charles-p-jones
64920420 solution-ch10-charles-p-jones64920420 solution-ch10-charles-p-jones
64920420 solution-ch10-charles-p-jones
 
Optimization By Simulated Annealing
Optimization By Simulated AnnealingOptimization By Simulated Annealing
Optimization By Simulated Annealing
 
Slides money banking risk reward capm
Slides money banking risk reward capmSlides money banking risk reward capm
Slides money banking risk reward capm
 
Empirical Analysis of Bank Capital and New Regulatory Requirements for Risks ...
Empirical Analysis of Bank Capital and New Regulatory Requirements for Risks ...Empirical Analysis of Bank Capital and New Regulatory Requirements for Risks ...
Empirical Analysis of Bank Capital and New Regulatory Requirements for Risks ...
 
Monte Carlo Analysis
Monte Carlo AnalysisMonte Carlo Analysis
Monte Carlo Analysis
 
EEC
EECEEC
EEC
 

Similar to Uncertain Covariance

Converting_Scores_Into_Alphas
Converting_Scores_Into_AlphasConverting_Scores_Into_Alphas
Converting_Scores_Into_AlphasIlan Gleiser
 
Stochastic Loss Reserving-General Insurance
Stochastic Loss Reserving-General InsuranceStochastic Loss Reserving-General Insurance
Stochastic Loss Reserving-General InsuranceSyed Danish Ali
 
Risk_Management_Final_Report
Risk_Management_Final_ReportRisk_Management_Final_Report
Risk_Management_Final_ReportRohan Sanas
 
2008 implementation of va r in financial institutions
2008   implementation of va r in financial institutions2008   implementation of va r in financial institutions
2008 implementation of va r in financial institutionscrmbasel
 
Report_TermPaper_IE5003
Report_TermPaper_IE5003Report_TermPaper_IE5003
Report_TermPaper_IE5003Arun Sankar
 
Optimum Investment Selection process-Nov 9-2013
Optimum Investment Selection process-Nov 9-2013Optimum Investment Selection process-Nov 9-2013
Optimum Investment Selection process-Nov 9-2013Gary Crosbie
 
CAPM: Introduction & Teaching Issues - Richard Diamond
CAPM: Introduction & Teaching Issues - Richard DiamondCAPM: Introduction & Teaching Issues - Richard Diamond
CAPM: Introduction & Teaching Issues - Richard DiamondRichard Diamond
 
AgendaComprehending risk when modeling investment (project) de.docx
AgendaComprehending risk when modeling investment (project) de.docxAgendaComprehending risk when modeling investment (project) de.docx
AgendaComprehending risk when modeling investment (project) de.docxgalerussel59292
 
Practical Aspects of Stochastic Modeling.pptx
Practical Aspects of Stochastic Modeling.pptxPractical Aspects of Stochastic Modeling.pptx
Practical Aspects of Stochastic Modeling.pptxRon Harasym
 
Coursework- Soton (Single Index Model and CAPM)
Coursework- Soton (Single Index Model and CAPM)Coursework- Soton (Single Index Model and CAPM)
Coursework- Soton (Single Index Model and CAPM)Ece Akbulut
 
Improving Returns from the Markowitz Model using GA- AnEmpirical Validation o...
Improving Returns from the Markowitz Model using GA- AnEmpirical Validation o...Improving Returns from the Markowitz Model using GA- AnEmpirical Validation o...
Improving Returns from the Markowitz Model using GA- AnEmpirical Validation o...idescitation
 

Similar to Uncertain Covariance (20)

Converting_Scores_Into_Alphas
Converting_Scores_Into_AlphasConverting_Scores_Into_Alphas
Converting_Scores_Into_Alphas
 
Value At Risk Sep 22
Value At Risk Sep 22Value At Risk Sep 22
Value At Risk Sep 22
 
Risks and returns
Risks and returnsRisks and returns
Risks and returns
 
Risk Ana
Risk AnaRisk Ana
Risk Ana
 
Stochastic Loss Reserving-General Insurance
Stochastic Loss Reserving-General InsuranceStochastic Loss Reserving-General Insurance
Stochastic Loss Reserving-General Insurance
 
Risk_Management_Final_Report
Risk_Management_Final_ReportRisk_Management_Final_Report
Risk_Management_Final_Report
 
2008 implementation of va r in financial institutions
2008   implementation of va r in financial institutions2008   implementation of va r in financial institutions
2008 implementation of va r in financial institutions
 
Report_TermPaper_IE5003
Report_TermPaper_IE5003Report_TermPaper_IE5003
Report_TermPaper_IE5003
 
Optimum Investment Selection process-Nov 9-2013
Optimum Investment Selection process-Nov 9-2013Optimum Investment Selection process-Nov 9-2013
Optimum Investment Selection process-Nov 9-2013
 
Value at risk
Value at riskValue at risk
Value at risk
 
CAPM: Introduction & Teaching Issues - Richard Diamond
CAPM: Introduction & Teaching Issues - Richard DiamondCAPM: Introduction & Teaching Issues - Richard Diamond
CAPM: Introduction & Teaching Issues - Richard Diamond
 
AgendaComprehending risk when modeling investment (project) de.docx
AgendaComprehending risk when modeling investment (project) de.docxAgendaComprehending risk when modeling investment (project) de.docx
AgendaComprehending risk when modeling investment (project) de.docx
 
Risk Measurement in practice
Risk Measurement in practiceRisk Measurement in practice
Risk Measurement in practice
 
Reasons behind XVAs
Reasons behind XVAsReasons behind XVAs
Reasons behind XVAs
 
Practical Aspects of Stochastic Modeling.pptx
Practical Aspects of Stochastic Modeling.pptxPractical Aspects of Stochastic Modeling.pptx
Practical Aspects of Stochastic Modeling.pptx
 
Coursework- Soton (Single Index Model and CAPM)
Coursework- Soton (Single Index Model and CAPM)Coursework- Soton (Single Index Model and CAPM)
Coursework- Soton (Single Index Model and CAPM)
 
Improving Returns from the Markowitz Model using GA- AnEmpirical Validation o...
Improving Returns from the Markowitz Model using GA- AnEmpirical Validation o...Improving Returns from the Markowitz Model using GA- AnEmpirical Validation o...
Improving Returns from the Markowitz Model using GA- AnEmpirical Validation o...
 
Chap007
Chap007Chap007
Chap007
 
SSRN-id2554642
SSRN-id2554642SSRN-id2554642
SSRN-id2554642
 
Schema econ
Schema econSchema econ
Schema econ
 

Uncertain Covariance

  • 1. Uncertain Covariance Models RISK FORECASTS THAT KNOW HOW ACCURATE THEY ARE AND WHERE NOV 9, 2015 QWAFAFEW SAN FRANCISCO ANISH R. SHAH, CFA ANISHRS@INVESTMENTGRADEMODELING.COM INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 2. The Math of Uncertain Covariance Straightforward … and not for a presentation Shah, A. (2015). Uncertain Covariance Models http://ssrn.com/abstract=2616109 Questions or comments, please email AnishRS@InvestmentGradeModeling.com INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 3. Background: Why Care About Covariance? Notions of co-movement are needed to make decisions throughout the investment process 1. Estimating capital at risk and portfolio volatility 2. Hedging 3. Constructing and rebalancing portfolios through optimization 4. Algorithmic trading 5. Evaluating performance 6. Making sense of asset allocation INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 4. Background: Why Care About Uncertainty? 1. Nothing is exactly known. Everything is a forecast 2. However, one can estimate the accuracy of individual numbers Suppose two stocks have the same expected covariance against other securities The first has been well-predicted in the past, the other not Which is a safer hedge? 3. It’s imprudent to make decisions without considering accuracy A fool, omitting accuracy from his objective, curses optimizers for taking numbers at face value 4. Relying on wrong numbers can cost you your shirt under leverage when you can be fired and have assets assigned to another manager INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 5. A Factor Covariance Model in Pictures INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM GOOG Market Risk Factors Exposures Stock-Specific Effect AAPL GE Growth-Value Spread Together these constitute a model of how securities move – jointly (winds and sails) and independently (motors)
  • 6. The Math of a Factor Covariance Model 1. Say a stock’s return is partly a function of pervasive factors, e.g. the return of the market and oil 𝑟𝐺𝑂𝑂𝐺 = ℎ 𝐺𝑂𝑂𝐺 𝑓 𝑚𝑘𝑡, 𝑓𝑜𝑖𝑙 + stuff assumed to be independent of the factors and other securities 2. Imagine linearly approximating this function 𝑟𝐺𝑂𝑂𝐺 ≈ 𝜕ℎ 𝐺𝑂𝑂𝐺 𝜕𝑓 𝑚𝑘𝑡 𝑓 𝑚𝑘𝑡 + 𝜕ℎ 𝐺𝑂𝑂𝐺 𝜕𝑓 𝑜𝑖𝑙 𝑓𝑜𝑖𝑙 + constant + stuff 3. Model a stock’s variance as the variance of the approximation 𝑣𝑎𝑟 𝑟𝐺𝑂𝑂𝐺 ≈ 𝜕ℎ 𝐺𝑂𝑂𝐺 𝜕𝑓 𝑚𝑘𝑡 𝜕ℎ 𝐺𝑂𝑂𝐺 𝜕𝑓 𝑜𝑖𝑙 exposures sails 𝑣𝑎𝑟 𝑓 𝑚𝑘𝑡 𝑐𝑜𝑣 𝑓 𝑚𝑘𝑡, 𝑓𝑜𝑖𝑙 𝑐𝑜𝑣 𝑓 𝑚𝑘𝑡, 𝑓𝑜𝑖𝑙 𝑣𝑎𝑟 𝑓𝑜𝑖𝑙 factor covariance how wind blows 𝜕ℎ 𝐺𝑂𝑂𝐺 𝜕𝑓 𝑚𝑘𝑡 𝜕ℎ 𝐺𝑂𝑂𝐺 𝜕𝑓 𝑜𝑖𝑙 exposures sails + 𝑣𝑎𝑟 stuff stock specific variance size of motor INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 7. The Math of a Factor Covariance Model 4. Covariance between stocks is modeled as the covariance of their approximations 𝑐𝑜𝑣 𝑟𝐺𝑂𝑂𝐺, 𝑟𝐺𝐸 ≈ 𝜕ℎ 𝐺𝑂𝑂𝐺 𝜕𝑓 𝑚𝑘𝑡 𝜕ℎ 𝐺𝑂𝑂𝐺 𝜕𝑓 𝑜𝑖𝑙 exposures sails (𝐺𝑂𝑂𝐺) 𝑣𝑎𝑟 𝑓 𝑚𝑘𝑡 𝑐𝑜𝑣 𝑓 𝑚𝑘𝑡, 𝑓𝑜𝑖𝑙 𝑐𝑜𝑣 𝑓 𝑚𝑘𝑡, 𝑓𝑜𝑖𝑙 𝑣𝑎𝑟 𝑓𝑜𝑖𝑙 factor covariance how wind blows 𝜕ℎ 𝐺𝐸 𝜕𝑓 𝑚𝑘𝑡 𝜕ℎ 𝐺𝐸 𝜕𝑓 𝑜𝑖𝑙 exposures sails (𝐺𝐸) Note: no motors here – they are assumed independent across stocks 5. Parts aren’t known but inferred, typically by regression, or by more sophisticated tools 6. Best is to forecast values over one’s horizon INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 8. INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM GOOG Uncertain Risk Factors projected onto orthogonal directions Uncertain Exposures Uncertain Stock-Specific Effect Welcome to reality! Nothing is known with certainty. But some forecasts are believed more accurate than others A portfolio’s risk has – according to beliefs – an expected value and a variance Good decisions come from considering uncertainty explicitly. Ignoring doesn’t make it go away An Uncertain Factor Covariance Model
  • 9. Uncertain Exposures Beliefs about future exposure to the factors are communicated as Gaussian ◦ 𝒆 𝐺𝑂𝑂𝐺 ~ 𝑁 𝒆 𝐺𝑂𝑂𝐺, 𝛀 𝐺𝑂𝑂𝐺 ◦ Exposures can be correlated across securities ◦ Estimates of mean and covariance come from the method to forecast exposures and historical accuracy So, a portfolio’s exposures are also Gaussian ◦ This fact is used in the math to work out variance (from uncertainty) of portfolio return variance INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 10. Sidebar: E[β2] > (E[β])2 Ignoring Uncertainty Underestimates Risk A CAPM flavored bare bones example to illustrate the idea: ◦ Stock’s return = market return × β ◦ Variance of stock’s return = market var × β2 Say β isn’t known exactly ◦ E[variance of stock’s return] = market var × E[β2] = market var × (E2[β] + var[β] ) > market var × E2[β] Ignoring uncertainty underestimates risk ◦ Note: this has nothing to do with aversion to uncertainty INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM “uncertainty correction”
  • 11. Uncertain Factor Variances Beliefs about the future factor variances are communicated as their mean and covariance ◦ Forecasts are the mean and covariance – according to uncertainty – of return variances ◦ Not Gaussian since variances ≥ 0 How the heck do you generate these? Shah, A. (2014). Short-Term Risk and Adapting Covariance Models to Current Market Conditions ◦ http://ssrn.com/abstract=2501071 1. Forecast whatever you can, e.g. from VIX and cross-sectional returns, the volatility of S&P 500 daily returns over the next 3 months will be 25% ± 5% annualized 2. The states of quantities measured by the risk model imply a configuration of factor variances Since this inferred distribution of factor variances arises from predictions, it is a forecast INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 12. Adapting Infers Distribution Of Factor Variances INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM SP 500 IBM WM OIL 1. Noisy variance forecasts via all manner of Information sources Implied vol, intraday price movement, news and other big data, … 2. Imply a distribution on how the world is 3. An aside: this extends to the behavior of other securities All risk forecasts are improved JNJ SB UX FDX
  • 13. Uncertain Stock-Specific Effects Stock-specific effects (motors) are best regarded as both exposures (sails) and factors (wind) 1. A motor is like wind that affects just 1 stock 2. Its size is estimated with error like a sail 3. The average size of motors across securities varies over time e.g. stock-specific effects can shrink as market volatility rises Since it might depend on the variance of other factors, average size gets treated like one Thus, uncertainty from stock-specific effects is captured using both types of uncertainty in the preceding slides. INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 14. All Set with Machinery: Uncertain Portfolio Variance Math then yields for a portfolio ◦ expected variance ◦ standard deviation of variance according to beliefs (estimates) about uncertainty in the pieces ◦ exposures ◦ factor variances ◦ stock-specific effects Expectation and standard deviation are with respect to beliefs ◦ Not reality, but one’s best assessment of it ◦ “Given my beliefs, the portfolio’s tracking variance is E ± sd” ◦ What a person (or computer) needs to make good decisions from the information at hand INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 15. Applications INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 16. Portfolio Optimization: Uncertain Utility Conventional maxw U(w) = r(w) – λ × v(w) where r(w) = mean return, v(w) = variance of return Uncertain maxw O(w) = E[U(w)] – γ × stdev[U(w)] var[U(w)] = var[r(w)] + λ2 var[v(w)] – 2 λ stdev[r(w)] stdev[v(w)] × ρw ρw = cor[r(w), v(w)] for portfolio w, the correlation of uncertainty in mean and in variance r(w) ~ N[wTμ, wTΣw] assume mean returns have Gaussian error All pieces are known except ρw which, absent beliefs, can be set to 0 INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 17. Portfolio Optimization: Maximize Risk Adjusted Return Risk-adjusted return ≡ portfolio alpha - ½ portfolio tracking variance Say alpha is known exactly Randomly pick 10 securities – ½ are eq wt benchmark, ½ are optimized into fully invested portfolio Optimize under the following covariance models Base conventional Bayesian 15 factor PCA model Adapted base model adapted to forecasts of future market conditions Uncertain[γ] adapted model with uncertainty information maximize alpha - ½ [variance + γ stdev(variance)] note: Uncertain[0] has uncertainty correction, but no penalty on uncertainty Measure the shortfall in realized risk-adjusted return vs. the ideal (w/future covariance known) Repeat the experiment 1000 times INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 18. Portfolio Optimization: Maximize Risk Adjusted Return (cont) INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM -140 -120 -100 -80 -60 -40 -20 0 Base Adapted Uncertain[0] Uncertain[0.1] Uncertain[1] Uncertain[10] RISKADJUSTEDRETURN Shortfall in realized risk-adjusted return vs decision with future covariance known 10% 25% 50% 75% 90% Considering uncertainty tames downside without costing upside 2013-Jun-27 with a horizon of 20 trading days percentile: of the 1000 experiments
  • 19. Predicted vs Realized Efficient Frontier Perfectly known alphas Random 5 stock portfolio, 5 stock benchmark INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM 0 0.5 1 1.5 2 2.5 0 2 4 6 8 10 12 Alpha Tracking Error Base predicted Adapted predicted Uncertain[0] predicted Uncertain[1] predicted Uncertain[10] predicted Uncertain[10] realized Uncertain[1] realized Uncertain[0] realized Adapted realized Base realized Underestimated Risk
  • 20. Realized Efficient Frontier, Imperfect Alphas cor(Forecast, Realized Alpha) = .07 Random 5 stock portfolio, 5 stock benchmark INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM -0.4 -0.2 0 0.2 0.4 0.6 0.8 1 0 1 2 3 4 5 6 Alpha Tracking Error Uncertain[10] Uncertain[1] Uncertain[0] Adapted Base
  • 21. Realized Efficient Frontier, Imperfect Alphas cor(Forecast, Realized Alpha) = .07 Random 15 stock portfolio, 15 stock benchmark INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0 1 2 3 4 5 6 7 8 Alpha Tracking Error Uncertain[10] Uncertain[1] Uncertain[0] Adapted Base
  • 22. Pairs Trading Improved via knowledge of uncertainty ◦ Feel bullish (or bearish) about one or several similar securities ◦ Have candidates you feel the opposite about ◦ Choose – from the two sets – the long-short pair with lowest uncertainty penalized risk ◦ If you have explicit alpha forecasts, instead maximize uncertain utility ◦ Better risk control = safer leverage and more room to pursue alpha A toy example, hedging with 3 securities ◦ AAPL is the reference security ◦ Every 11 trading days from 2012 through 2013, find the best 3 hedges (ignoring stock-specific effects) from a universe of tech stocks and equal weight-them ◦ Calculate the subsequent 10 day volatility of daily returns of long AAPL, short the equal weighted Model Avg 1 Day TE Base 1.34 Uncertain[0] 1.13 Uncertain[0.5] 1.14 Uncertain[1] 1.13 Uncertain[100] 1.15 INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM
  • 23. Investment Grade Modeling LLC Uncertain Covariance Models Run nightly in the cloud. Bloomberg BBGID or ticker Built uniquely for each use ◦ Risk factors arise from one’s universe (e.g. only healthcare + tech, all US equities + commodity indices) ◦ .. and horizon (e.g. 1 day, 6 months) and return frequency (daily or weekly) ◦ Exposures (sails) are forecasts of the average over the horizon ◦ Factors volatilities (winds) and specific risks (motors) are adapted to forecasts of future volatility over the horizon made from broad set of information ◦ Though I believe risk crowding is baloney: zero chance of crowding from others using an identical model “Augmented” PCA ◦ PCA + (as necessary) factors to cover important not-stock-return-pervasive effects, e.g. VIX and certain commodities Java library does uncertainty calculations INVESTMENT GRADE MODELING, LLC INVESTMENTGRADEMODELING.COM ANISH R. SHAH, CFA ANISHRS@ INVESTMENTGRADEMODELING.COM