Risk-Averse Decision Making and Control
|
|
- Joella Baker
- 5 years ago
- Views:
Transcription
1 Marek Petrik University of New Hampshire Mohammad Ghavamzadeh Adobe Research February 4, 2017
2 Introduction to Risk Averse Modeling Outline Introduction to Risk Averse Modeling (Average) Value at Risk Coherent Measures of Risk Risk Measures in Reinforcement Learning Time consistency of in reinforcement learning Summary
3 Introduction to Risk Averse Modeling Schedule 9:00 9:20 Introduction to risk-averse modeling 9:20 9:40 Value at Risk and Average Value at Risk 9:40 9:50 Break 9:50 10:30 Coherent Measures of Risk: Properties and methods 10:30 11:00 Coffee break 11:00 12:30 Risk-averse reinforcement learning 12:30 12:40 Break 12:40 12:55 Time consistent measures of risk
4 Introduction to Risk Averse Modeling Risk Aversion Risk (Wikipedia): Risk is the potential of gaining or losing something of value.... Uncertainty is a potential, unpredictable, and uncontrollable outcome; risk is a consequence of action taken in spite of uncertainty. Risk aversion (Wikipedia):... risk aversion is the behavior of humans, when exposed to uncertainty, to attempt to reduce that uncertainty.... Tutorial: Modern methods for risk-averse decision making
5 Introduction to Risk Averse Modeling Desire for Risk Aversion Empirical evidence: 1. People buy insurance 2. Diversifying financial portfolios 3. Experimental results Other reasons: Reduce contingency planning
6 Introduction to Risk Averse Modeling Where Risk Aversion Matters Financial portfolios Heath-care decisions Agriculture Public infrastructure Self-driving cars?
7 Introduction to Risk Averse Modeling When Risks Are Ignored... Housing bubble leads to a financial collapse Seawalls overflow in a tsunami
8 Introduction to Risk Averse Modeling Need to Quantify Risk Mitigating risk is expensive, how much is it worth?
9 Introduction to Risk Averse Modeling Need to Quantify Risk Mitigating risk is expensive, how much is it worth? Expected utility theory: E[u(X)] = E[utility(X)]
10 Introduction to Risk Averse Modeling Need to Quantify Risk Mitigating risk is expensive, how much is it worth? Expected utility theory: E[u(X)] = E[utility(X)] Exponential utility function (Bernoulli functions): u(x) = 1 e a x a Utility Function Reward ($)
11 Introduction to Risk Averse Modeling Example: Buying Car Insurance Car value: $ Insurance options Option Deductible Cost X 1 $ $0 X 2 $2 000 $112 X 3 $100 $322
12 Introduction to Risk Averse Modeling Example: Buying Car Insurance Car value: $ Insurance options Option Deductible Cost X 1 $ $0 X 2 $2 000 $112 X 3 $100 $322 Expected utility: Event P X 1 X 2 X 3 No accident 92% $0 $112 $322 Minor accident 7.5% $2 500 $2 112 $422 Major accident 0.5% $ $2 112 $422
13 Introduction to Risk Averse Modeling Example: Buying Car Insurance Car value: $ Insurance options Option Deductible Cost X 1 $ $0 X 2 $2 000 $112 X 3 $100 $322 Expected utility: Event P X 1 X 2 X 3 No accident 92% $0 $112 $322 Minor accident 7.5% $2 500 $2 112 $422 Major accident 0.5% $ $2 112 $422
14 Introduction to Risk Averse Modeling Example: Buying Car Insurance Car value: $ Insurance options Option Deductible Cost X 1 $ $0 X 2 $2 000 $112 X 3 $100 $322 Expected utility: Event P X 1 X 2 X 3 No accident 92% $0 $112 $322 Minor accident 7.5% $2 500 $2 112 $422 Major accident 0.5% $ $2 112 $422
15 Introduction to Risk Averse Modeling Example: Buying Car Insurance Car value: $ Insurance options Option Deductible Cost X 1 $ $0 X 2 $2 000 $112 X 3 $100 $322 Expected utility: Event P X 1 X 2 X 3 No accident 92% $0 $112 $322 Minor accident 7.5% $2 500 $2 112 $422 Major accident 0.5% $ $2 112 $422 E $ $ $ Risk-neutral choice: no insurance
16 Introduction to Risk Averse Modeling Risk Averse Utility Functions Exponential utility function u(x) = 1 exp( 10 6 (x )) 10 6 X 1 no insurance X 2 high deductible insurance Event P X 1 u(x 1 ) X 2 u(x 2 ) No accident 92% $ $ Minor accident 7.5% $ $ Major accident 0.5% $ $ E $ $
17 Introduction to Risk Averse Modeling Risk Averse Utility Functions Exponential utility function u(x) = 1 exp( 10 6 (x )) 10 6 X 1 no insurance X 2 high deductible insurance Event P X 1 u(x 1 ) X 2 u(x 2 ) No accident 92% $ $ Minor accident 7.5% $ $ Major accident 0.5% $ $ E $ $ Prefer insurance, but difficult to interpret and elicit
18 Introduction to Risk Averse Modeling Drawbacks of Expected Utility Theory (Schoemaker 1980) 1. Does not explain human behavior 2. Difficult to elicit utilities 3. Complicates optimization (Friedman et al. 2014)
19 Introduction to Risk Averse Modeling Major Alternatives for Measuring Risk 1. Markowitz portfolios: Penalize dispersion risk [ ] min Var c i X i c 0 [ i ] s.t. E c i X i = µ, c i = 1 i Limited modeling capability and also penalizes upside i
20 Introduction to Risk Averse Modeling Major Alternatives for Measuring Risk 1. Markowitz portfolios: Penalize dispersion risk [ ] min Var c i X i c 0 [ i ] s.t. E c i X i = µ, c i = 1 i Limited modeling capability and also penalizes upside i 2. Risk measures: (Artzner et al. 1999) Value at risk (V@R) Conditional value at risk (CV@R) Coherent measures of risk
21 Introduction to Risk Averse Modeling Coherent Measures of Risk Topic of this tutorial Alternative to expected utility theory
22 Introduction to Risk Averse Modeling Coherent Measures of Risk Topic of this tutorial Alternative to expected utility theory + Flexible modeling framework
23 Introduction to Risk Averse Modeling Coherent Measures of Risk Topic of this tutorial Alternative to expected utility theory + Flexible modeling framework + Convenient to use with optimization and decision making
24 Introduction to Risk Averse Modeling Coherent Measures of Risk Topic of this tutorial Alternative to expected utility theory + Flexible modeling framework + Convenient to use with optimization and decision making + Easier to elicit than utilities
25 Introduction to Risk Averse Modeling Coherent Measures of Risk Topic of this tutorial Alternative to expected utility theory + Flexible modeling framework + Convenient to use with optimization and decision making + Easier to elicit than utilities Difficulties in sequential decision making
26 (Average) Value at Risk Outline Introduction to Risk Averse Modeling (Average) Value at Risk Coherent Measures of Risk Risk Measures in Reinforcement Learning Time consistency of in reinforcement learning Summary
27 (Average) Value at Risk Schedule 9:00 9:20 Introduction to risk-averse modeling 9:20 9:40 Value at Risk and Average Value at Risk 9:40 9:50 Break 9:50 10:30 Coherent Measures of Risk: Properties and methods 10:30 11:00 Coffee break 11:00 12:30 Risk-averse reinforcement learning 12:30 12:40 Break 12:40 12:55 Time consistent measures of risk
28 (Average) Value at Risk Risk Measure Risk measure: function ρ that maps random variable to a real number
29 (Average) Value at Risk Risk Measure Risk measure: function ρ that maps random variable to a real number Expectation is a risk measure ρ(x) = E[X] = ω Ω X(ω)P (ω) Risk neutral
30 (Average) Value at Risk Risk Measure Risk measure: function ρ that maps random variable to a real number Expectation is a risk measure ρ(x) = E[X] = ω Ω X(ω)P (ω) Risk neutral Worst-case is a risk measure ρ(x) = min[x] = min ω Ω X(ω) Very risk averse
31 (Average) Value at Risk Value at Risk ρ(x) = V@R α (X) = sup { t : P[X t] < α } Rewards smaller than V@R α (X) with probability at most α Example α values: α = 0.5 Median
32 (Average) Value at Risk Value at Risk ρ(x) = V@R α (X) = sup { t : P[X t] < α } Rewards smaller than V@R α (X) with probability at most α Example α values: α = 0.5 Median α = 0.3 More conservative
33 (Average) Value at Risk Value at Risk ρ(x) = V@R α (X) = sup { t : P[X t] < α } Rewards smaller than V@R α (X) with probability at most α Example α values: α = 0.5 Median α = 0.3 More conservative α = 0.05 Conservative
34 (Average) Value at Risk Value at Risk ρ(x) = V@R α (X) = sup { t : P[X t] < α } Rewards smaller than V@R α (X) with probability at most α Example α values: α = 0.5 Median α = 0.3 More conservative α = 0.05 Conservative α = 0 Worst case
35 (Average) Value at Risk Example 1: Cumulative Distribution Function 0.05 (X) = CDF Reward ($)
36 (Average) Value at Risk Example 2: Cumulative Distribution Function 0.3 (X) = CDF Reward ($)
37 (Average) Value at Risk Car Insurance And 25% 1.0 Event P X 1 No accident 92% $0 Minor accident 7.5% $2 500 Major accident 0.5% $ CDF Reward ($) V@R α (X) = sup { t : P[X t] < α } α = 0.25 t P[X t] α $ $ $
38 (Average) Value at Risk Car Insurance And 8% 1.0 Event P X 1 No accident 92% $0 Minor accident 7.5% $2 500 Major accident 0.5% $ CDF Reward ($) V@R α (X) = sup { t : P[X t] < α } α = t P[X t] α $ $
39 (Average) Value at Risk Car Insurance And X 1 : no insurance (high risk) X 2 : high deductible insurance (medium risk) X 3 : low deductible insurance (low risk) Event P X 1 X 2 X 3 No accident 92% $0 $112 $322 Minor accident 7.5% $2 500 $2 112 $422 Major accident 0.5% $ $2 112 $422 E $238 $272 $330
40 (Average) Value at Risk Car Insurance And X 1 : no insurance (high risk) X 2 : high deductible insurance (medium risk) X 3 : low deductible insurance (low risk) Event P X 1 X 2 X 3 No accident 92% $0 $112 $322 Minor accident 7.5% $2 500 $2 112 $422 Major accident 0.5% $ $2 112 $422 E $238 $272 $330 V@R 0.25 $0 $112 $322
41 (Average) Value at Risk Car Insurance And X 1 : no insurance (high risk) X 2 : high deductible insurance (medium risk) X 3 : low deductible insurance (low risk) Event P X 1 X 2 X 3 No accident 92% $0 $112 $322 Minor accident 7.5% $2 500 $2 112 $422 Major accident 0.5% $ $2 112 $422 E $238 $272 $330 V@R 0.25 $0 $112 $322 V@R 0.05 $2 500 $2 112 $422
42 (Average) Value at Risk Properties of + Preserves affine transformations: α (τ X + c) = τ V@R α (X) + c + Simple and intuitive to model and understand + Compelling meaning in finance Ignores heavy tails Not convex
43 (Average) Value at Risk Properties of + Preserves affine transformations: α (τ X + c) = τ V@R α (X) + c + Simple and intuitive to model and understand + Compelling meaning in finance Ignores heavy tails Not convex Coherent measures of risk: Preserve V@R positives and improve negatives (Artzner et al. 1999)
44 (Average) Value at Risk Average Value at Risk AKA Conditional Value at Risk and Expected Shortfall Popular coherent risk measure ρ Simple definition for atomless distributions: [ ] CV@R α (X) = E X X V@R α (X) Recall: V@R α (X) = sup { t : P[X t] < α } Convex extension of V@R (Rockafellar and Uryasev 2000)
45 (Average) Value at Risk vs Cumulative Distribution Function 0.3 (X) = 0.5 CV@R 0.3 (X) = CDF CDF Reward ($) Reward ($)
46 (Average) Value at Risk vs Heavy Tails A more expensive car? Event P X 1 No accident 92% $0 Minor acc. 7.5% $2 500 Major acc. 0.5% $ Event P X 1 No accident 92% $0 Minor acc. 7.5% $2 500 Major acc. 0.5% $
47 (Average) Value at Risk vs Heavy Tails A more expensive car? Event P X 1 No accident 92% $0 Minor acc. 7.5% $2 500 Major acc. 0.5% $ V@R 0.05 $2 500 Event P X 1 No accident 92% $0 Minor acc. 7.5% $2 500 Major acc. 0.5% $ V@R 0.05 $2 500
48 (Average) Value at Risk vs Heavy Tails A more expensive car? Event P X 1 No accident 92% $0 Minor acc. 7.5% $2 500 Major acc. 0.5% $ V@R 0.05 $2 500 CV@R 0.05 $3 250 Event P X 1 No accident 92% $0 Minor acc. 7.5% $2 500 Major acc. 0.5% $ V@R 0.05 $2 500 CV@R 0.05 $
49 (Average) Value at Risk Heavy Tails and Financial Crisis
50 (Average) Value at Risk vs Continuity Risk ($) V@R AV@R Risk level α
51 (Average) Value at Risk Schedule 9:00 9:20 Introduction to risk-averse modeling 9:20 9:40 Value at Risk and Average Value at Risk 9:40 9:50 Break 9:50 10:30 Coherent Measures of Risk: Properties and methods 10:30 11:00 Coffee break 11:00 12:30 Risk-averse reinforcement learning 12:30 12:40 Break 12:40 12:55 Time consistent measures of risk
52 Coherent Measures of Risk Outline Introduction to Risk Averse Modeling (Average) Value at Risk Coherent Measures of Risk Risk Measures in Reinforcement Learning Time consistency of in reinforcement learning Summary
53 Coherent Measures of Risk Schedule 9:00 9:20 Introduction to risk-averse modeling 9:20 9:40 Value at Risk and Average Value at Risk 9:40 9:50 Break 9:50 10:30 Coherent Measures of Risk 10:30 11:00 Coffee break 11:00 12:30 Risk-averse reinforcement learning 12:30 12:40 Break 12:40 12:55 Time consistent measures of risk
54 Coherent Measures of Risk Coherent Measures of Risk Generalize to allow more general models Framework introduced in (Artzner et al. 1999) Coherence: Requirements for risk measure ρ to satisfy Our treatment based on (Shapiro, Dentcheva, and Ruszczynski 2009) and (Follmer and Schied 2011)
55 Coherent Measures of Risk Coherence Requirements of Risk Measures 1. Convexity: (really concavity for maximization!) ρ(t X + (1 t) Y ) t ρ(x) + (1 t) ρ(y ) 2. Monotonicity: If X Y, then ρ(x) ρ(y ) 3. Translation equivariance: For a constant a: ρ(x + a) = ρ(x) + a 4. Positive homogeneity: For t > 0, then: ρ(t X) = t ρ(x)
56 Coherent Measures of Risk Convexity Why: Diversification should decrease risk (and it helps with optimization) ρ(t X + (1 t) Y ) t ρ(x) + (1 t) ρ(y )
57 Coherent Measures of Risk Convexity Why: Diversification should decrease risk (and it helps with optimization) ρ(t X + (1 t) Y ) t ρ(x) + (1 t) ρ(y ) 1 Event P X 1 X 2 2 X X 2 No accident 92% $0 $112 $56 Minor accident 7.5% $2 500 $2 112 $2 306 Major accident 0.5% $ $2 112 $6 056 CV@R $238 $272 $240
58 Coherent Measures of Risk Convexity Why: Diversification should decrease risk (and it helps with optimization) ρ(t X + (1 t) Y ) t ρ(x) + (1 t) ρ(y ) 1 Event P X 1 X 2 2 X X 2 No accident 92% $0 $112 $56 Minor accident 7.5% $2 500 $2 112 $2 306 Major accident 0.5% $ $2 112 $6 056 CV@R $238 $272 $ = 255
59 Coherent Measures of Risk Monotonicity Why: Do not prefer an outcome that is always worse If X Y, then ρ(x) ρ(y )
60 Coherent Measures of Risk Monotonicity Why: Do not prefer an outcome that is always worse If X Y, then ρ(x) ρ(y ) X 2 : Insurance with deductible of $ Event P X 1 X 2 No accident 92% $0 $112 Minor accident 7.5% $2 500 $2 500 Major accident 0.5% $ $ ρ $238 $320
61 Coherent Measures of Risk Monotonicity Why: Do not prefer an outcome that is always worse If X Y, then ρ(x) ρ(y ) X 2 : Insurance with deductible of $ Event P X 1 X 2 No accident 92% $0 $112 Minor accident 7.5% $2 500 $2 500 Major accident 0.5% $ $ ρ $238 $320 $320 $238
62 Coherent Measures of Risk Translation equivariance Why: Risk is measured in the same units as the reward ρ(x + a) = ρ(x) + a
63 Coherent Measures of Risk Translation equivariance Why: Risk is measured in the same units as the reward ρ(x + a) = ρ(x) + a More expensive insurance by $100 Event P X 2 X 2 No accident 92% $112 $212 Minor accident 7.5% $2 112 $2 212 Major accident 0.5% $2 112 $2 212 ρ $272 $372
64 Coherent Measures of Risk Translation equivariance Why: Risk is measured in the same units as the reward ρ(x + a) = ρ(x) + a More expensive insurance by $100 Event P X 2 X 2 No accident 92% $112 $212 Minor accident 7.5% $2 112 $2 212 Major accident 0.5% $2 112 $2 212 ρ $272 $372 $372 = $272 $100
65 Coherent Measures of Risk Positive homogeneity Why: Risk is measured in the same units as the reward ρ(t X) = t ρ(x)
66 Coherent Measures of Risk Positive homogeneity Why: Risk is measured in the same units as the reward ρ(t X) = t ρ(x) What if the prices are in e: $1 = e0.94 Event P X 2 X 2 No accident 92% $112 e105 Minor accident 7.5% $2 112 e1 985 Major accident 0.5% $2 112 e1 985 ρ $272 e256
67 Coherent Measures of Risk Positive homogeneity Why: Risk is measured in the same units as the reward ρ(t X) = t ρ(x) What if the prices are in e: $1 = e0.94 Event P X 2 X 2 No accident 92% $112 e105 Minor accident 7.5% $2 112 e1 985 Major accident 0.5% $2 112 e1 985 ρ $272 e256 $272 = e256
68 Coherent Measures of Risk Convex Risk Measures Weaker definition than coherent risk measures 1. Convexity: 2. Monotonicity: ρ(t X + (1 t) Y ) t ρ(x) + (1 t) ρ(y ) If X Y, then ρ(x) ρ(y ) 3. Translation equivariance: For a constant a: 4. Positive homogeneity ρ(x + a) = ρ(x) + a
69 Coherent Measures of Risk Additional Property: Law Invariance Value of risk measure is independent of the names of the events Consider a coin flip Event P X Y Heads 1/2 1 0 Tails 1/2 0 1 Require that ρ(x) = ρ(y ); violated by some coherent risk measures Distortion risk measures: coherence & law invariance & comonotonicity
70 Coherent Measures of Risk Simple Coherent Measures of Risk Expectation: ρ(x) = E[X] = ω Ω X(ω)P (ω) 1. Convexity: E[X] is linear 2. Monotonicity: E[X] E[Y ] if X Y 3. Translation equivariance: E[X + a] = E[X] + a 4. Positive homogeneity: E[t X] = t E[X] for t > 0
71 Coherent Measures of Risk Simple Coherent Measures of Risk Expectation: ρ(x) = E[X] = ω Ω X(ω)P (ω) 1. Convexity: E[X] is linear 2. Monotonicity: E[X] E[Y ] if X Y 3. Translation equivariance: E[X + a] = E[X] + a 4. Positive homogeneity: E[t X] = t E[X] for t > 0 Worst case: ρ(x) = min[x] = min ω Ω X(ω) 1. Convexity: min[x] is convex 2. Monotonicity: min[x] min[y ] if X Y 3. Translation equivariance: min[x + a] = min[x] + a 4. Positive homogeneity: min[t X] = t E[X] for t > 0
72 Coherent Measures of Risk for Discrete Distributions Simple definition is not coherent [ ] CV@R α (X) = E X X V@R α (X) Violates convexity when distribution has atoms (discrete distributions)
73 Coherent Measures of Risk for Discrete Distributions Simple definition is not coherent [ ] CV@R α (X) = E X X V@R α (X) Violates convexity when distribution has atoms (discrete distributions) Coherent definition of CV@R: { CV@R α (X) = sup t + 1 } t α E[X t] t = V@R α (X) when the distribution is atom-less
74 Coherent Measures of Risk for Discrete Distributions Simple definition is not coherent [ ] CV@R α (X) = E X X V@R α (X) Violates convexity when distribution has atoms (discrete distributions) Coherent definition of CV@R: { CV@R α (X) = sup t + 1 } t α E[X t] t = V@R α (X) when the distribution is atom-less Definitions the same for continuous distributions
75 Coherent Measures of Risk Computing Discrete distributions: Solve a linear program max t,y t + 1 α p y s.t. y X t, y 0 Continuous distributions: Closed form for many (Nadarajah, Zhang, and Chan 2014; Andreev, Kanto, and Malo 2005)
76 Coherent Measures of Risk Car Insurance and X 1 no insurance X 2 high deductible insurance X 3 low deductible insurance Event P X 1 X 2 X 3 No accident 92% $0 $112 $322 Minor accident 7.5% $2 500 $2 112 $422 Major accident 0.5% $ $2 112 $422 E $238 $272 $330
77 Coherent Measures of Risk Car Insurance and X 1 no insurance X 2 high deductible insurance X 3 low deductible insurance Event P X 1 X 2 X 3 No accident 92% $0 $112 $322 Minor accident 7.5% $2 500 $2 112 $422 Major accident 0.5% $ $2 112 $422 E $238 $272 $330 V@R 0.25 $0 $112 $322 CV@R 0.25 $950 $752 $354
78 Coherent Measures of Risk Car Insurance and X 1 no insurance X 2 high deductible insurance X 3 low deductible insurance Event P X 1 X 2 X 3 No accident 92% $0 $112 $322 Minor accident 7.5% $2 500 $2 112 $422 Major accident 0.5% $ $2 112 $422 E $238 $272 $330 V@R 0.25 $0 $112 $322 CV@R 0.25 $950 $752 $354 V@R 0.05 $2 500 $2 112 $422 CV@R 0.05 $3 250 $2 112 $422
79 Coherent Measures of Risk Robust Representation of Coherent Risk Measures Important representation for analysis and optimization For any coherent risk measure ρ: ρ(x) = min E [ ] ξ X = inf ξ A ξ A ξ X
80 Coherent Measures of Risk Robust Representation of Coherent Risk Measures Important representation for analysis and optimization For any coherent risk measure ρ: ρ(x) = min E [ ] ξ X = inf ξ A ξ A ξ X A is a set of measures such that is: 1. convex 2. bounded 3. closed
81 Coherent Measures of Risk Robust Representation of Coherent Risk Measures Important representation for analysis and optimization For any coherent risk measure ρ: ρ(x) = min E [ ] ξ X = inf ξ A ξ A ξ X A is a set of measures such that is: 1. convex 2. bounded 3. closed Proof: Double convex conjugate Convex conjugate: Fenchel Moreau theorem: ρ (y) = sup x y ρ(x) x ρ (x) = ρ(x)
82 Coherent Measures of Risk Robust Set for { α (X) = sup t + 1 } t α E[X t] Robust representation: ρ(x) = inf E [ ] ξ X ξ A Robust set for probability distribution P : { A = ξ 0 ξ 1 } α P, 1 ξ = 1
83 Coherent Measures of Risk Robust Set for Robust representation: ρ(x) = min E [ ] ξ X ξ A { A = ξ 0 ξ 1 } α P, 1 ξ = 1 Random variable: X = [10, 5, 2] Probability distribution: p = [ 1 /3, 1 /3, 1 /3] CV@R 1/2 (X) = min ξ 0 10 ξ ξ ξ 3 ξ i 1 α p i = 1 1/2 1/3 = 2 3 ξ 1 + ξ 2 + ξ 3 = 1
84 Coherent Measures of Risk Other Coherent Risk Measures 1. Combination of expectation and 2. Entropic risk measure 3. Coherent entropic risk measure (convex, incoherent) 4. Risk measures from utility functions 5....
85 Coherent Measures of Risk Convex Combination of Expectation and ignores the mean return Risk-averse solutions bad in expectation Practical trade-off: Combine mean and risk ρ(x) = c E[X] + (1 c) CV@R α (X)
86 Coherent Measures of Risk Entropic Risk Measure Convex risk measure ρ(x) = 1 /τ ln E [ e τ X] τ > 0
87 Coherent Measures of Risk Entropic Risk Measure ρ(x) = 1 /τ ln E [ e τ X] τ > 0 Convex risk measure Incoherent (violates translation invariance) No robust representation
88 Coherent Measures of Risk Entropic Risk Measure Convex risk measure ρ(x) = 1 /τ ln E [ e τ X] τ > 0 Incoherent (violates translation invariance) No robust representation Coherent entropic risk measure: (Föllmer and Knispel 2011) { } ρ(x) = max E ξ [X] KL(ξ P ) c, 1 ξ = 1 ξ 0
89 Coherent Measures of Risk Risk Measure From Utility Function Concave utility function u( ) Construct a coherent risk measure from g?
90 Coherent Measures of Risk Risk Measure From Utility Function Concave utility function u( ) Construct a coherent risk measure from g? Direct construction: ρ(x) = E[u(X)] Not coherent or convex
91 Coherent Measures of Risk Risk Measure From Utility Function Concave utility function u( ) Construct a coherent risk measure from g? Direct construction: Not coherent or convex ρ(x) = E[u(X)] Optimized Certainty Equivalent (Ben-Tal and Teboulle 2007) ρ(x) = sup (t + E[g(X t)]) t
92 Coherent Measures of Risk Optimized Certainty Equivalent ρ(x) = sup (t + E[g(X t)]) t How much consume now given uncertain future
93 Coherent Measures of Risk Optimized Certainty Equivalent ρ(x) = sup (t + E[g(X t)]) t How much consume now given uncertain future Convex risk measure for any concave u Coherent risk measure for pos. homogeneous u
94 Coherent Measures of Risk Optimized Certainty Equivalent ρ(x) = sup (t + E[g(X t)]) t How much consume now given uncertain future Convex risk measure for any concave u Coherent risk measure for pos. homogeneous u Exponential u: OCE = entropic risk measure Piecewise linear u: OCE = CV@R
95 Coherent Measures of Risk Recommended References Lectures on Stochastic Programming: Modeling and Theory (Shapiro, Dentcheva, and Ruszczynski 2014) Stochastic Finance: An Introduction in Discrete Time (Follmer and Schied 2011)
96 Coherent Measures of Risk Remainder of Tutorial: Multistage Optimization How to apply risk measures when optimizing over multiple time steps Results in machine learning and reinforcement learning Time or dynamic consistency in multiple time steps
97 Coherent Measures of Risk Schedule 9:00 9:20 Introduction to risk-averse modeling 9:20 9:40 Value at Risk and Average Value at Risk 9:40 9:50 Break 9:50 10:30 Coherent Measures of Risk: Properties and methods 10:30 11:00 Coffee break 11:00 12:30 Risk-averse reinforcement learning 12:30 12:40 Break 12:40 12:55 Time consistent measures of risk
98 Risk Measures in Reinforcement Learning Outline Introduction to Risk Averse Modeling (Average) Value at Risk Coherent Measures of Risk Risk Measures in Reinforcement Learning Time consistency of in reinforcement learning Summary
99 Risk Measures in Reinforcement Learning Schedule 9:00 9:20 Introduction to risk-averse modeling 9:20 9:40 Value at Risk and Average Value at Risk 9:40 9:50 Break 9:50 10:30 Coherent Measures of Risk: Properties and methods 10:30 11:00 Coffee break 11:00 12:30 Risk-averse reinforcement learning 12:30 12:40 Break 12:40 12:55 Time consistent measures of risk
100 Risk Measures in Reinforcement Learning Please see the other slide deck
101 Risk Measures in Reinforcement Learning Schedule 9:00 9:20 Introduction to risk-averse modeling 9:20 9:40 Value at Risk and Average Value at Risk 9:40 9:50 Break 9:50 10:30 Coherent Measures of Risk: Properties and methods 10:30 11:00 Coffee break 11:00 12:30 Risk-averse reinforcement learning 12:30 12:40 Break 12:40 12:55 Time consistent measures of risk
102 Time consistency of in reinforcement learning Outline Introduction to Risk Averse Modeling (Average) Value at Risk Coherent Measures of Risk Risk Measures in Reinforcement Learning Time consistency of in reinforcement learning Summary
103 Time consistency of in reinforcement learning Schedule 9:00 9:20 Introduction to risk-averse modeling 9:20 9:40 Value at Risk and Average Value at Risk 9:40 9:50 Break 9:50 10:30 Coherent Measures of Risk: Properties and methods 10:30 11:00 Coffee break 11:00 12:30 Risk-averse reinforcement learning 12:30 12:40 Break 12:40 12:55 Time consistent measures of risk
104 Time consistency of in reinforcement learning Example: Driving Test Discount Option 1: Plain Insurance Cost: $9.00 No deductible Certain expected outcome: E[X 1 ] = 9.00 ρ(x 1 ) = E[X 1 ] = 9.00
105 Time consistency of in reinforcement learning Example: Driving Test Discount Option 1: Plain Insurance Cost: $9.00 No deductible Certain expected outcome: E[X 1 ] = 9.00 ρ(x 1 ) = E[X 1 ] = 9.00 Option 2: Custom Insurance Take a safety exam Pass with probability 1 /2 OK [P = 2/3]: +$5.00 Not [P = 2/3]: $20.00 Fail with probability 1 /2 OK [P = 2/3]: $5.00 Not [P = 2/3]: $10.00
106 Time consistency of in reinforcement learning Example: Driving Test Discount Option 1: Plain Insurance Cost: $9.00 No deductible Certain expected outcome: E[X 1 ] = 9.00 ρ(x 1 ) = E[X 1 ] = 9.00 Option 2: Custom Insurance Take a safety exam Pass with probability 1 /2 OK [P = 2/3]: +$5.00 Not [P = 2/3]: $20.00 Fail with probability 1 /2 OK [P = 2/3]: $5.00 Not [P = 2/3]: $10.00 Risk measure: ρ = CV@R 2/3
107 Time consistency of in reinforcement learning Risk Measure of Option 2 OK 5 1/3 Fail P = 1 /2 1/3 1/3 OK 5 Risk measure: ρ(x 2 ) = CV@R 2/3 (X 2 ) Take test Pass P = 1 /2 1/3 1/3 1/3 NOK 10 OK 5 OK 5 P X 2 1/6 5 1/6 5 1/6 10 1/6 5 1/6 5 1/6 20 NOK 20
108 Time consistency of in reinforcement learning Risk Measure of Option 2 1/3 OK 5 Risk measure: ρ(x 2 ) = CV@R 2/3 (X 2 ) Fail P = 1 /2 Take test Pass P = 1 /2 1/3 1/3 1/3 OK 5 NOK 10 OK 5 P X 2 1/6 5 1/6 5 1/6 10 1/6 5 1/6 5 1/6 20 1/3 1/3 OK 5 NOK ρ(x 2 ) = = 4 = 10.0 < 9.0 = ρ(x 1 )
109 Time consistency of in reinforcement learning Risk Measure of Option 2 1/3 OK 5 Risk measure: ρ(x 2 ) = CV@R 2/3 (X 2 ) Fail P = 1 /2 Take test Pass P = 1 /2 1/3 1/3 1/3 1/3 1/3 OK 5 NOK 10 OK 5 OK 5 P X 2 1/6 5 1/6 5 1/6 10 1/6 5 1/6 5 1/6 20 NOK 20 ρ(x 2 ) < ρ(x 1 ) Prefer option 1
110 Time consistency of in reinforcement learning Optimal Solution of Subproblems Recall we prefer option 1: ρ(x 1 ) = 9 NOK 20 1/3 Pass test 1/3 OK 5 1/3 OK 5 P 1/3 1/3 1/3 X
111 Time consistency of in reinforcement learning Optimal Solution of Subproblems Recall we prefer option 1: ρ(x 1 ) = 9 NOK 20 1/3 Pass test 1/3 OK 5 1/3 OK 5 P 1/3 1/3 1/3 X ρ(x 2 Pass) = = If pass, prefer option 2
112 Time consistency of in reinforcement learning Optimal Solution of Subproblems Recall we prefer option 1: ρ(x 1 ) = 9 NOK 10 1/3 Fail test 1/3 OK 5 1/3 OK 5 P 1/3 1/3 1/3 X
113 Time consistency of in reinforcement learning Optimal Solution of Subproblems Recall we prefer option 1: ρ(x 1 ) = 9 NOK 10 1/3 Fail test 1/3 OK 5 1/3 OK 5 P 1/3 1/3 1/3 X
114 Time consistency of in reinforcement learning Optimal Solution of Subproblems Recall we prefer option 1: ρ(x 1 ) = 9 NOK 10 1/3 Fail test 1/3 OK 5 1/3 OK 5 P 1/3 1/3 1/3 X ρ(x 2 Fail) = If fail, prefer option 2 = 7.5
115 Time consistency of in reinforcement learning Optimal Solution of Subproblems Recall we prefer option 1: ρ(x 1 ) = 9 1/3 Pass test 1/3 1/3 1/3 Fail test 1/3 1/3 NOK 20 OK 5 OK 5 NOK 10 OK 5 OK 5 P 1/3 1/3 1/3 X P 1/3 1/3 1/3 X ρ(x 2 Pass) = = If pass, prefer option 2 ρ(x 2 Fail) = = If fail, prefer option 2 Time inconsistent behavior (Roorda, Schumacher, and Engwerda 2005; Iancu, Petrik, and Subramanian 2015)
116 Time consistency of in reinforcement learning Time Consistent Risk Measures Filtration (scenario tree) of rewards with T levels: X 1, X 2, X 3,..., X T Dynamic risk measure at time t: ρ t (X t + + X T )
117 Time consistency of in reinforcement learning Time Consistent Risk Measures Filtration (scenario tree) of rewards with T levels: X 1, X 2, X 3,..., X T Dynamic risk measure at time t: ρ t (X t + + X T ) Time consistent: if for all X, Y (also dynamic consistent) ρ t+1 (X t + ) ρ t+1 (Y t + ) ρ t (X t + ) ρ t (Y t + )
118 Time consistency of in reinforcement learning Time Consistent Risk Measures Filtration (scenario tree) of rewards with T levels: X 1, X 2, X 3,..., X T Dynamic risk measure at time t: ρ t (X t + + X T ) Time consistent: if for all X, Y (also dynamic consistent) ρ t+1 (X t + ) ρ t+1 (Y t + ) ρ t (X t + ) ρ t (Y t + ) Similar to subproblem optimality in programming optimality
119 Time consistency of in reinforcement learning Time Consistency via Iterated Risk Mappings Time consistent risk measures must be composed of iterated risk mappings (Roorda, Schumacher, and Engwerda 2005): µ 1, µ 2,..., µ t Dynamic risk measure: ρ t (X t + + X T ) = µ t (X t + µ t+1 (X t+1 + µ t+2 (x t+3 + ))) Each µ t : a coherent risk measure applied on subtree of filtration
120 Time consistency of in reinforcement learning Time Consistency via Iterated Risk Mappings Time consistent risk measures must be composed of iterated risk mappings (Roorda, Schumacher, and Engwerda 2005): µ 1, µ 2,..., µ t Dynamic risk measure: ρ t (X t + + X T ) = µ t (X t + µ t+1 (X t+1 + µ t+2 (x t+3 + ))) Each µ t : a coherent risk measure applied on subtree of filtration Markov risk measures for MDPs (Ruszczynski 2010)
121 Time consistency of in reinforcement learning Computing Time Consistent Risk Measure NOK 20 1/3 Pass test 1/3 OK 5 1/3 OK 5 ρ(x 2 Pass) = = 7.5
122 Time consistency of in reinforcement learning Computing Time Consistent Risk Measure NOK 10 1/3 Fail test 1/3 OK 5 1/3 OK 5 ρ(x 2 Fail) = = 7.5
123 Time consistency of in reinforcement learning Computing Time Consistent Risk Measure Pass 7.5 1/2 Take test 1/2 Fail 7.5 ρ(x 2 ) = ρ( 7.5) = 7.5 > 9
124 Time consistency of in reinforcement learning Computing Time Consistent Risk Measure 1/3 Pass test 1/3 1/3 1/3 Fail test 1/3 1/3 NOK 20 OK 5 OK 5 NOK 10 OK 5 OK 5 ρ(x 2 Pass) = = 7.5 ρ(x 2 Fail) = = 7.5 Pass 7.5 1/2 Take test 1/2 Fail 7.5 ρ(x 2 ) = ρ( 7.5) = 7.5 > 9 Consistently prefer option 1 throughout the execution
125 Time consistency of in reinforcement learning Approximating Inconsistent Risk Measures Time consistent risk measures are difficult to specify Approximate an inconsistent risk measure by a consistent one? Best lower bound: e.g. what is the best α 1, α 2 such that CV@R α1 (CV@R α2 (X)) CV@R α (X) for all X Best upper bound: e.g. what is the best α 1, α 2 such that CV@R α1 (CV@R α2 (X)) CV@R α (X) for all X (Iancu, Petrik, and Subramanian 2015)
126 Time consistency of in reinforcement learning Best Time Consistent Bounds Compare robust sets of consistent and inconsistent measures Main insight: need to compare down-monotone closures of robust sets
127 Time consistency of in reinforcement learning Time Consistent Bounds: Main Results Lower consistent bound: Uniformly tightest bound can be constructed in polynomial time Method: rectangularization Upper consistent bound: NP hard to even evaluate how tight the approximation is Approximation can be tighter than the lower bound
128 Time consistency of in reinforcement learning Planning with Time Consistent Risk Measures Stochastic dual dynamic programming (Shapiro 2012) Applied in reinforcement learning (Petrik and Subramanian 2012) Only entropic dynamically consistent risk measures are law invariant (Kupper and Schachermayer 2006)
129 Summary Outline Introduction to Risk Averse Modeling (Average) Value at Risk Coherent Measures of Risk Risk Measures in Reinforcement Learning Time consistency of in reinforcement learning Summary
130 Summary Risk Measures: Many Other Topics 1. Elicitation of risk measures 2. Estimation of risk measure from samples 3. Relationship to acceptance sets 4. Relationship to robust optimization
131 Summary Take Home Messages Coherent risk measures are a convenient and established risk aversion framework
132 Summary Take Home Messages Coherent risk measures are a convenient and established risk aversion framework Computations with coherent risk measure are more efficient than with utility functions
133 Summary Take Home Messages Coherent risk measures are a convenient and established risk aversion framework Computations with coherent risk measure are more efficient than with utility functions Risk measures (V@R, CV@R) are more intuitive than utility functions
134 Summary Take Home Messages Coherent risk measures are a convenient and established risk aversion framework Computations with coherent risk measure are more efficient than with utility functions Risk measures (V@R, CV@R) are more intuitive than utility functions Time consistency is important in dynamic settings, but can be difficult to achieve (open research problems)
135 Summary Take Home Messages Coherent risk measures are a convenient and established risk aversion framework Computations with coherent risk measure are more efficient than with utility functions Risk measures (V@R, CV@R) are more intuitive than utility functions Time consistency is important in dynamic settings, but can be difficult to achieve (open research problems) Risk measures are making inroads in reinforcement learning and artificial intelligence
136 Summary Thank you!!
137 Summary Bibliography I Andreev, Andriy, Antti Kanto, and Pekka Malo (2005). Closed-Form Calculation of Cvar. In: Sweedish School of Economics. Artzner, Philippe et al. (1999). Coherent Measures of Risk. In: Mathematical Finance 9, pp issn: doi: / Ben-Tal, Aharon and Marc Teboulle (2007). An Old-New Concept of Convex Risk Measures: The Optimized Certainty Equivalent. In: Mathematical Finance 17, pp url:
138 Summary Bibliography II Föllmer, Hans and Thomas Knispel (2011). Entropic Risk Measures: Coherence Vs. Convexity, Model Ambiguity and Robust Large Deviations. In: Stochastics and Dynamics 11.02n03, pp issn: doi: /S url: S Follmer, Hans and Alexander Schied (2011). Stochastic Finance: An Introduction in Discrete Time. 3rd. Walter de Gruyter. Friedman, Daniel et al. (2014). Risky Curves: On the Empirical Failure of Expected Utility.
139 Summary Bibliography III Iancu, Dan A, Marek Petrik, and Dharmashankar Subramanian (2015). Tight Approximations of Dynamic Risk Measures. In: Mathematics of Operations Research 40.3, pp issn: X. doi: /moor arxiv: url: abs/ /moor Kupper, Michael and Walter Schachermayer (2006). Representation results for law invariant time consistent functions. In: Mathematics and Financial Economics 16.2, pp url:
140 Summary Bibliography IV Nadarajah, Saralees, Bo Zhang, and Stephen Chan (2014). Estimation methods for expected shortfall. In: Quantitative Finance 14.2, pp issn: doi: / url: Petrik, Marek and Dharmashankar Subramanian (2012). An approximate solution method for large risk-averse Markov decision processes. In: Uncertainty in Artificial Intelligence (UAI). url: Rockafellar, R. Tyrrell and S. Uryasev (2000). Optimization of conditional value-at-risk. In: Journal of Risk 2, pp
141 Summary Bibliography V Roorda, Berend, Hans Schumacher, and Jacob Engwerda (2005). Coherent acceptability measures in multiperiod models. In: Mathematical Finance, pp url: Ruszczynski, Andrzej (2010). Risk-averse dynamic programming for Markov decision processes. In: Mathematical Programming B 125.2, pp issn: doi: /s url: Schoemaker, P.J.H. (1980). Experiments on Decisions under Risk: The Expected Utility Hypothesis.
142 Summary Bibliography VI Shapiro, A., D. Dentcheva, and A. Ruszczynski (2014). Lectures on stochastic programming: modeling and theory. P isbn: X. doi: Shapiro, Alexander (2012). Minimax and risk averse multistage stochastic programming. In: European Journal of Operational Research 219.3, pp issn: doi: /j.ejor url: Shapiro, Alexander, Darinka Dentcheva, and Andrzej Ruszczynski (2009). Lectures on Stochastic Programming. SIAM. isbn:
Risk Measures and Optimal Risk Transfers
Risk Measures and Optimal Risk Transfers Université de Lyon 1, ISFA April 23 2014 Tlemcen - CIMPA Research School Motivations Study of optimal risk transfer structures, Natural question in Reinsurance.
More informationDynamic Risk Management in Electricity Portfolio Optimization via Polyhedral Risk Functionals
Dynamic Risk Management in Electricity Portfolio Optimization via Polyhedral Risk Functionals A. Eichhorn and W. Römisch Humboldt-University Berlin, Department of Mathematics, Germany http://www.math.hu-berlin.de/~romisch
More informationRisk aversion in multi-stage stochastic programming: a modeling and algorithmic perspective
Risk aversion in multi-stage stochastic programming: a modeling and algorithmic perspective Tito Homem-de-Mello School of Business Universidad Adolfo Ibañez, Santiago, Chile Joint work with Bernardo Pagnoncelli
More informationPrudence, risk measures and the Optimized Certainty Equivalent: a note
Working Paper Series Department of Economics University of Verona Prudence, risk measures and the Optimized Certainty Equivalent: a note Louis Raymond Eeckhoudt, Elisa Pagani, Emanuela Rosazza Gianin WP
More informationThe mathematical definitions are given on screen.
Text Lecture 3.3 Coherent measures of risk and back- testing Dear all, welcome back. In this class we will discuss one of the main drawbacks of Value- at- Risk, that is to say the fact that the VaR, as
More informationRisk, Coherency and Cooperative Game
Risk, Coherency and Cooperative Game Haijun Li lih@math.wsu.edu Department of Mathematics Washington State University Tokyo, June 2015 Haijun Li Risk, Coherency and Cooperative Game Tokyo, June 2015 1
More informationRisk measures: Yet another search of a holy grail
Risk measures: Yet another search of a holy grail Dirk Tasche Financial Services Authority 1 dirk.tasche@gmx.net Mathematics of Financial Risk Management Isaac Newton Institute for Mathematical Sciences
More informationBuilding Consistent Risk Measures into Stochastic Optimization Models
Building Consistent Risk Measures into Stochastic Optimization Models John R. Birge The University of Chicago Graduate School of Business www.chicagogsb.edu/fac/john.birge JRBirge Fuqua School, Duke University
More informationMultistage risk-averse asset allocation with transaction costs
Multistage risk-averse asset allocation with transaction costs 1 Introduction Václav Kozmík 1 Abstract. This paper deals with asset allocation problems formulated as multistage stochastic programming models.
More informationOn Risk Measures, Market Making, and Exponential Families
On Risk Measures, Market Making, and Exponential Families JACOB D. ABERNETHY University of Michigan and RAFAEL M. FRONGILLO Harvard University and SINDHU KUTTY University of Michigan In this note we elaborate
More informationPortfolio selection with multiple risk measures
Portfolio selection with multiple risk measures Garud Iyengar Columbia University Industrial Engineering and Operations Research Joint work with Carlos Abad Outline Portfolio selection and risk measures
More informationCS 4100 // artificial intelligence
CS 4100 // artificial intelligence instructor: byron wallace (Playing with) uncertainties and expectations Attribution: many of these slides are modified versions of those distributed with the UC Berkeley
More informationWorst-case-expectation approach to optimization under uncertainty
Worst-case-expectation approach to optimization under uncertainty Wajdi Tekaya Joint research with Alexander Shapiro, Murilo Pereira Soares and Joari Paulo da Costa : Cambridge Systems Associates; : Georgia
More informationOptimizing S-shaped utility and risk management
Optimizing S-shaped utility and risk management Ineffectiveness of VaR and ES constraints John Armstrong (KCL), Damiano Brigo (Imperial) Quant Summit March 2018 Are ES constraints effective against rogue
More informationLECTURE 4: BID AND ASK HEDGING
LECTURE 4: BID AND ASK HEDGING 1. Introduction One of the consequences of incompleteness is that the price of derivatives is no longer unique. Various strategies for dealing with this exist, but a useful
More informationOptimizing S-shaped utility and risk management: ineffectiveness of VaR and ES constraints
Optimizing S-shaped utility and risk management: ineffectiveness of VaR and ES constraints John Armstrong Dept. of Mathematics King s College London Joint work with Damiano Brigo Dept. of Mathematics,
More informationA Computational Study of Modern Approaches to Risk-Averse Stochastic Optimization Using Financial Portfolio Allocation Model.
A Computational Study of Modern Approaches to Risk-Averse Stochastic Optimization Using Financial Portfolio Allocation Model by Suklim Choi A thesis submitted to the Graduate Faculty of Auburn University
More informationCHOICE THEORY, UTILITY FUNCTIONS AND RISK AVERSION
CHOICE THEORY, UTILITY FUNCTIONS AND RISK AVERSION Szabolcs Sebestyén szabolcs.sebestyen@iscte.pt Master in Finance INVESTMENTS Sebestyén (ISCTE-IUL) Choice Theory Investments 1 / 65 Outline 1 An Introduction
More informationOptimal Portfolio Liquidation with Dynamic Coherent Risk
Optimal Portfolio Liquidation with Dynamic Coherent Risk Andrey Selivanov 1 Mikhail Urusov 2 1 Moscow State University and Gazprom Export 2 Ulm University Analysis, Stochastics, and Applications. A Conference
More informationEE365: Risk Averse Control
EE365: Risk Averse Control Risk averse optimization Exponential risk aversion Risk averse control 1 Outline Risk averse optimization Exponential risk aversion Risk averse control Risk averse optimization
More informationValue at Risk. january used when assessing capital and solvency requirements and pricing risk transfer opportunities.
january 2014 AIRCURRENTS: Modeling Fundamentals: Evaluating Edited by Sara Gambrill Editor s Note: Senior Vice President David Lalonde and Risk Consultant Alissa Legenza describe various risk measures
More informationCS 343: Artificial Intelligence
CS 343: Artificial Intelligence Uncertainty and Utilities Instructors: Dan Klein and Pieter Abbeel University of California, Berkeley [These slides are based on those of Dan Klein and Pieter Abbeel for
More informationA Simple, Adjustably Robust, Dynamic Portfolio Policy under Expected Return Ambiguity
A Simple, Adjustably Robust, Dynamic Portfolio Policy under Expected Return Ambiguity Mustafa Ç. Pınar Department of Industrial Engineering Bilkent University 06800 Bilkent, Ankara, Turkey March 16, 2012
More informationIEOR E4602: Quantitative Risk Management
IEOR E4602: Quantitative Risk Management Risk Measures Martin Haugh Department of Industrial Engineering and Operations Research Columbia University Email: martin.b.haugh@gmail.com Reference: Chapter 8
More informationRisk aversion and choice under uncertainty
Risk aversion and choice under uncertainty Pierre Chaigneau pierre.chaigneau@hec.ca June 14, 2011 Finance: the economics of risk and uncertainty In financial markets, claims associated with random future
More informationWhy Bankers Should Learn Convex Analysis
Jim Zhu Western Michigan University Kalamazoo, Michigan, USA March 3, 2011 A tale of two financial economists Edward O. Thorp and Myron Scholes Influential works: Beat the Dealer(1962) and Beat the Market(1967)
More informationMESURES DE RISQUE DYNAMIQUES DYNAMIC RISK MEASURES
from BMO martingales MESURES DE RISQUE DYNAMIQUES DYNAMIC RISK MEASURES CNRS - CMAP Ecole Polytechnique March 1, 2007 1/ 45 OUTLINE from BMO martingales 1 INTRODUCTION 2 DYNAMIC RISK MEASURES Time Consistency
More informationCS 5522: Artificial Intelligence II
CS 5522: Artificial Intelligence II Uncertainty and Utilities Instructor: Alan Ritter Ohio State University [These slides were adapted from CS188 Intro to AI at UC Berkeley. All materials available at
More informationOutline. Simple, Compound, and Reduced Lotteries Independence Axiom Expected Utility Theory Money Lotteries Risk Aversion
Uncertainty Outline Simple, Compound, and Reduced Lotteries Independence Axiom Expected Utility Theory Money Lotteries Risk Aversion 2 Simple Lotteries 3 Simple Lotteries Advanced Microeconomic Theory
More informationSession 9: The expected utility framework p. 1
Session 9: The expected utility framework Susan Thomas http://www.igidr.ac.in/ susant susant@mayin.org IGIDR Bombay Session 9: The expected utility framework p. 1 Questions How do humans make decisions
More informationValue at Risk, Expected Shortfall, and Marginal Risk Contribution, in: Szego, G. (ed.): Risk Measures for the 21st Century, p , Wiley 2004.
Rau-Bredow, Hans: Value at Risk, Expected Shortfall, and Marginal Risk Contribution, in: Szego, G. (ed.): Risk Measures for the 21st Century, p. 61-68, Wiley 2004. Copyright geschützt 5 Value-at-Risk,
More informationCasino gambling problem under probability weighting
Casino gambling problem under probability weighting Sang Hu National University of Singapore Mathematical Finance Colloquium University of Southern California Jan 25, 2016 Based on joint work with Xue
More informationReferences. H. Föllmer, A. Schied, Stochastic Finance (3rd Ed.) de Gruyter 2011 (chapters 4 and 11)
General references on risk measures P. Embrechts, R. Frey, A. McNeil, Quantitative Risk Management, (2nd Ed.) Princeton University Press, 2015 H. Föllmer, A. Schied, Stochastic Finance (3rd Ed.) de Gruyter
More informationMathematics in Finance
Mathematics in Finance Steven E. Shreve Department of Mathematical Sciences Carnegie Mellon University Pittsburgh, PA 15213 USA shreve@andrew.cmu.edu A Talk in the Series Probability in Science and Industry
More informationECON FINANCIAL ECONOMICS
ECON 337901 FINANCIAL ECONOMICS Peter Ireland Boston College Spring 2018 These lecture notes by Peter Ireland are licensed under a Creative Commons Attribution-NonCommerical-ShareAlike 4.0 International
More informationPortfolio Optimization with Alternative Risk Measures
Portfolio Optimization with Alternative Risk Measures Prof. Daniel P. Palomar The Hong Kong University of Science and Technology (HKUST) MAFS6010R- Portfolio Optimization with R MSc in Financial Mathematics
More informationExpectimax and other Games
Expectimax and other Games 2018/01/30 Chapter 5 in R&N 3rd Ø Announcement: q Slides for this lecture are here: http://www.public.asu.edu/~yzhan442/teaching/cse471/lectures/games.pdf q Project 2 released,
More informationKIER DISCUSSION PAPER SERIES
KIER DISCUSSION PAPER SERIES KYOTO INSTITUTE OF ECONOMIC RESEARCH Discussion Paper No.981 Optimal Initial Capital Induced by the Optimized Certainty Equivalent Takuji Arai, Takao Asano, and Katsumasa Nishide
More informationLog-Robust Portfolio Management
Log-Robust Portfolio Management Dr. Aurélie Thiele Lehigh University Joint work with Elcin Cetinkaya and Ban Kawas Research partially supported by the National Science Foundation Grant CMMI-0757983 Dr.
More informationSOLVENCY AND CAPITAL ALLOCATION
SOLVENCY AND CAPITAL ALLOCATION HARRY PANJER University of Waterloo JIA JING Tianjin University of Economics and Finance Abstract This paper discusses a new criterion for allocation of required capital.
More informationPortfolio Optimization using Conditional Sharpe Ratio
International Letters of Chemistry, Physics and Astronomy Online: 2015-07-01 ISSN: 2299-3843, Vol. 53, pp 130-136 doi:10.18052/www.scipress.com/ilcpa.53.130 2015 SciPress Ltd., Switzerland Portfolio Optimization
More informationStochastic Optimal Control With Dynamic, Time-Consistent Risk Constraints
Stochastic Optimal Control With Dynamic, Time-Consistent Risk Constraints Yin-Lam Chow, Marco Pavone risk metric is applied to the future stream of costs; typical examples include variance-constrained
More informationRisk Measurement in Credit Portfolio Models
9 th DGVFM Scientific Day 30 April 2010 1 Risk Measurement in Credit Portfolio Models 9 th DGVFM Scientific Day 30 April 2010 9 th DGVFM Scientific Day 30 April 2010 2 Quantitative Risk Management Profit
More informationarxiv: v1 [math.oc] 25 Mar 2015
A Time Consistent Formulation of Risk Constrained Stochastic Optimal Control Yin-Lam Chow, Marco Pavone arxiv:153.7461v1 [math.oc 25 Mar 215 Abstract Time-consistency is an essential requirement in risk
More informationUncertain Outcomes. CS 188: Artificial Intelligence Uncertainty and Utilities. Expectimax Search. Worst-Case vs. Average Case
CS 188: Artificial Intelligence Uncertainty and Utilities Uncertain Outcomes Instructor: Marco Alvarez University of Rhode Island (These slides were created/modified by Dan Klein, Pieter Abbeel, Anca Dragan
More informationRobustness of Conditional Value-at-Risk (CVaR) for Measuring Market Risk
STOCKHOLM SCHOOL OF ECONOMICS MASTER S THESIS IN FINANCE Robustness of Conditional Value-at-Risk (CVaR) for Measuring Market Risk Mattias Letmark a & Markus Ringström b a 869@student.hhs.se; b 846@student.hhs.se
More informationA class of coherent risk measures based on one-sided moments
A class of coherent risk measures based on one-sided moments T. Fischer Darmstadt University of Technology November 11, 2003 Abstract This brief paper explains how to obtain upper boundaries of shortfall
More informationMaster s in Financial Engineering Foundations of Buy-Side Finance: Quantitative Risk and Portfolio Management. > Teaching > Courses
Master s in Financial Engineering Foundations of Buy-Side Finance: Quantitative Risk and Portfolio Management www.symmys.com > Teaching > Courses Spring 2008, Monday 7:10 pm 9:30 pm, Room 303 Attilio Meucci
More informationPricing and hedging in incomplete markets
Pricing and hedging in incomplete markets Chapter 10 From Chapter 9: Pricing Rules: Market complete+nonarbitrage= Asset prices The idea is based on perfect hedge: H = V 0 + T 0 φ t ds t + T 0 φ 0 t ds
More informationOptimal construction of a fund of funds
Optimal construction of a fund of funds Petri Hilli, Matti Koivu and Teemu Pennanen January 28, 29 Introduction We study the problem of diversifying a given initial capital over a finite number of investment
More informationAll Investors are Risk-averse Expected Utility Maximizers. Carole Bernard (UW), Jit Seng Chen (GGY) and Steven Vanduffel (Vrije Universiteit Brussel)
All Investors are Risk-averse Expected Utility Maximizers Carole Bernard (UW), Jit Seng Chen (GGY) and Steven Vanduffel (Vrije Universiteit Brussel) First Name: Waterloo, April 2013. Last Name: UW ID #:
More informationu (x) < 0. and if you believe in diminishing return of the wealth, then you would require
Chapter 8 Markowitz Portfolio Theory 8.7 Investor Utility Functions People are always asked the question: would more money make you happier? The answer is usually yes. The next question is how much more
More informationAll Investors are Risk-averse Expected Utility Maximizers
All Investors are Risk-averse Expected Utility Maximizers Carole Bernard (UW), Jit Seng Chen (GGY) and Steven Vanduffel (Vrije Universiteit Brussel) AFFI, Lyon, May 2013. Carole Bernard All Investors are
More informationModels and Decision with Financial Applications UNIT 1: Elements of Decision under Uncertainty
Models and Decision with Financial Applications UNIT 1: Elements of Decision under Uncertainty We always need to make a decision (or select from among actions, options or moves) even when there exists
More informationOptimal Portfolio Selection Under the Estimation Risk in Mean Return
Optimal Portfolio Selection Under the Estimation Risk in Mean Return by Lei Zhu A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Master of Mathematics
More informationDistortion operator of uncertainty claim pricing using weibull distortion operator
ISSN: 2455-216X Impact Factor: RJIF 5.12 www.allnationaljournal.com Volume 4; Issue 3; September 2018; Page No. 25-30 Distortion operator of uncertainty claim pricing using weibull distortion operator
More informationCharacterization of the Optimum
ECO 317 Economics of Uncertainty Fall Term 2009 Notes for lectures 5. Portfolio Allocation with One Riskless, One Risky Asset Characterization of the Optimum Consider a risk-averse, expected-utility-maximizing
More informationConditional Value-at-Risk: Theory and Applications
The School of Mathematics Conditional Value-at-Risk: Theory and Applications by Jakob Kisiala s1301096 Dissertation Presented for the Degree of MSc in Operational Research August 2015 Supervised by Dr
More informationComparative Analyses of Expected Shortfall and Value-at-Risk (2): Expected Utility Maximization and Tail Risk
MONETARY AND ECONOMIC STUDIES/APRIL 2002 Comparative Analyses of Expected Shortfall and Value-at-Risk (2): Expected Utility Maximization and Tail Risk Yasuhiro Yamai and Toshinao Yoshiba We compare expected
More informationA new approach for valuing a portfolio of illiquid assets
PRIN Conference Stochastic Methods in Finance Torino - July, 2008 A new approach for valuing a portfolio of illiquid assets Giacomo Scandolo - Università di Firenze Carlo Acerbi - AbaxBank Milano Liquidity
More informationLiquidity-Sensitive Automated Market Makers via Homogeneous Risk Measures
Liquidity-Sensitive Automated Market Makers via Homogeneous Risk Measures Abraham Othman and Tuomas Sandholm Computer Science Department, Carnegie Mellon University {aothman,sandholm}@cs.cmu.edu Abstract.
More informationPortfolio Choice via Quantiles
Portfolio Choice via Quantiles Xuedong He Oxford Princeton University/March 28, 2009 Based on the joint work with Prof Xunyu Zhou Xuedong He (Oxford) Portfolio Choice via Quantiles March 28, 2009 1 / 16
More informationScenario Generation and Sampling Methods
Scenario Generation and Sampling Methods Güzin Bayraksan Tito Homem-de-Mello SVAN 2016 IMPA May 9th, 2016 Bayraksan (OSU) & Homem-de-Mello (UAI) Scenario Generation and Sampling SVAN IMPA May 9 1 / 30
More informationAllocation of Risk Capital via Intra-Firm Trading
Allocation of Risk Capital via Intra-Firm Trading Sean Hilden Department of Mathematical Sciences Carnegie Mellon University December 5, 2005 References 1. Artzner, Delbaen, Eber, Heath: Coherent Measures
More informationCapital Allocation Principles
Capital Allocation Principles Maochao Xu Department of Mathematics Illinois State University mxu2@ilstu.edu Capital Dhaene, et al., 2011, Journal of Risk and Insurance The level of the capital held by
More informationRisk Measures for Derivative Securities: From a Yin-Yang Approach to Aerospace Space
Risk Measures for Derivative Securities: From a Yin-Yang Approach to Aerospace Space Tak Kuen Siu Department of Applied Finance and Actuarial Studies, Faculty of Business and Economics, Macquarie University,
More informationComparison of Estimation For Conditional Value at Risk
-1- University of Piraeus Department of Banking and Financial Management Postgraduate Program in Banking and Financial Management Comparison of Estimation For Conditional Value at Risk Georgantza Georgia
More informationInvestigation of the and minimum storage energy target levels approach. Final Report
Investigation of the AV@R and minimum storage energy target levels approach Final Report First activity of the technical cooperation between Georgia Institute of Technology and ONS - Operador Nacional
More informationMaking Decisions. CS 3793 Artificial Intelligence Making Decisions 1
Making Decisions CS 3793 Artificial Intelligence Making Decisions 1 Planning under uncertainty should address: The world is nondeterministic. Actions are not certain to succeed. Many events are outside
More informationWhat do Coin Tosses and Decision Making under Uncertainty, have in common?
What do Coin Tosses and Decision Making under Uncertainty, have in common? J. Rene van Dorp (GW) Presentation EMSE 1001 October 27, 2017 Presented by: J. Rene van Dorp 10/26/2017 1 About René van Dorp
More informationWorst-Case vs. Average Case. CSE 473: Artificial Intelligence Expectimax, Uncertainty, Utilities. Expectimax Search. Worst-Case vs.
CSE 473: Artificial Intelligence Expectimax, Uncertainty, Utilities Worst-Case vs. Average Case max min 10 10 9 100 Dieter Fox [These slides were created by Dan Klein and Pieter Abbeel for CS188 Intro
More informationMeasures of Contribution for Portfolio Risk
X Workshop on Quantitative Finance Milan, January 29-30, 2009 Agenda Coherent Measures of Risk Spectral Measures of Risk Capital Allocation Euler Principle Application Risk Measurement Risk Attribution
More informationFinancial Economics: Making Choices in Risky Situations
Financial Economics: Making Choices in Risky Situations Shuoxun Hellen Zhang WISE & SOE XIAMEN UNIVERSITY March, 2015 1 / 57 Questions to Answer How financial risk is defined and measured How an investor
More informationQuantitative Risk Management
Quantitative Risk Management Asset Allocation and Risk Management Martin B. Haugh Department of Industrial Engineering and Operations Research Columbia University Outline Review of Mean-Variance Analysis
More informationMartingale Pricing Theory in Discrete-Time and Discrete-Space Models
IEOR E4707: Foundations of Financial Engineering c 206 by Martin Haugh Martingale Pricing Theory in Discrete-Time and Discrete-Space Models These notes develop the theory of martingale pricing in a discrete-time,
More informationAsset-Liability Management
Asset-Liability Management John Birge University of Chicago Booth School of Business JRBirge INFORMS San Francisco, Nov. 2014 1 Overview Portfolio optimization involves: Modeling Optimization Estimation
More informationPORTFOLIO THEORY. Master in Finance INVESTMENTS. Szabolcs Sebestyén
PORTFOLIO THEORY Szabolcs Sebestyén szabolcs.sebestyen@iscte.pt Master in Finance INVESTMENTS Sebestyén (ISCTE-IUL) Portfolio Theory Investments 1 / 60 Outline 1 Modern Portfolio Theory Introduction Mean-Variance
More informationRegime-dependent robust risk measures with application in portfolio selection
Regime-dependent robust risk measures Regime-dependent robust risk measures with application in portfolio selection, P.R.China TEL:86-29-82663741, E-mail: zchen@mail.xjtu.edu.cn (Joint work with Jia Liu)
More informationMICROECONOMIC THEROY CONSUMER THEORY
LECTURE 5 MICROECONOMIC THEROY CONSUMER THEORY Choice under Uncertainty (MWG chapter 6, sections A-C, and Cowell chapter 8) Lecturer: Andreas Papandreou 1 Introduction p Contents n Expected utility theory
More informationSpot and forward dynamic utilities. and their associated pricing systems. Thaleia Zariphopoulou. UT, Austin
Spot and forward dynamic utilities and their associated pricing systems Thaleia Zariphopoulou UT, Austin 1 Joint work with Marek Musiela (BNP Paribas, London) References A valuation algorithm for indifference
More informationDASC: A DECOMPOSITION ALGORITHM FOR MULTISTAGE STOCHASTIC PROGRAMS WITH STRONGLY CONVEX COST FUNCTIONS
DASC: A DECOMPOSITION ALGORITHM FOR MULTISTAGE STOCHASTIC PROGRAMS WITH STRONGLY CONVEX COST FUNCTIONS Vincent Guigues School of Applied Mathematics, FGV Praia de Botafogo, Rio de Janeiro, Brazil vguigues@fgv.br
More informationWhere Has All the Value Gone? Portfolio risk optimization using CVaR
Where Has All the Value Gone? Portfolio risk optimization using CVaR Jonathan Sterbanz April 27, 2005 1 Introduction Corporate securities are widely used as a means to boost the value of asset portfolios;
More informationOptimal Stopping. Nick Hay (presentation follows Thomas Ferguson s Optimal Stopping and Applications) November 6, 2008
(presentation follows Thomas Ferguson s and Applications) November 6, 2008 1 / 35 Contents: Introduction Problems Markov Models Monotone Stopping Problems Summary 2 / 35 The Secretary problem You have
More informationFRONTIERS OF STOCHASTICALLY NONDOMINATED PORTFOLIOS
FRONTIERS OF STOCHASTICALLY NONDOMINATED PORTFOLIOS Andrzej Ruszczyński and Robert J. Vanderbei Abstract. We consider the problem of constructing a portfolio of finitely many assets whose returns are described
More informationPORTFOLIO selection problems are usually tackled with
, October 21-23, 2015, San Francisco, USA Portfolio Optimization with Reward-Risk Ratio Measure based on the Conditional Value-at-Risk Wlodzimierz Ogryczak, Michał Przyłuski, Tomasz Śliwiński Abstract
More informationWeek 2 Quantitative Analysis of Financial Markets Hypothesis Testing and Confidence Intervals
Week 2 Quantitative Analysis of Financial Markets Hypothesis Testing and Confidence Intervals Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg :
More informationFinancial Risk Management
Financial Risk Management Professor: Thierry Roncalli Evry University Assistant: Enareta Kurtbegu Evry University Tutorial exercices #4 1 Correlation and copulas 1. The bivariate Gaussian copula is given
More informationReport for technical cooperation between Georgia Institute of Technology and ONS - Operador Nacional do Sistema Elétrico Risk Averse Approach
Report for technical cooperation between Georgia Institute of Technology and ONS - Operador Nacional do Sistema Elétrico Risk Averse Approach Alexander Shapiro and Wajdi Tekaya School of Industrial and
More informationLecture 1 of 4-part series. Spring School on Risk Management, Insurance and Finance European University at St. Petersburg, Russia.
Principles and Lecture 1 of 4-part series Spring School on Risk, Insurance and Finance European University at St. Petersburg, Russia 2-4 April 2012 s University of Connecticut, USA page 1 s Outline 1 2
More informationMATH3075/3975 FINANCIAL MATHEMATICS TUTORIAL PROBLEMS
MATH307/37 FINANCIAL MATHEMATICS TUTORIAL PROBLEMS School of Mathematics and Statistics Semester, 04 Tutorial problems should be used to test your mathematical skills and understanding of the lecture material.
More informationLecture 10: Performance measures
Lecture 10: Performance measures Prof. Dr. Svetlozar Rachev Institute for Statistics and Mathematical Economics University of Karlsruhe Portfolio and Asset Liability Management Summer Semester 2008 Prof.
More informationLecture 12: Introduction to reasoning under uncertainty. Actions and Consequences
Lecture 12: Introduction to reasoning under uncertainty Preferences Utility functions Maximizing expected utility Value of information Bandit problems and the exploration-exploitation trade-off COMP-424,
More informationApproximation of Continuous-State Scenario Processes in Multi-Stage Stochastic Optimization and its Applications
Approximation of Continuous-State Scenario Processes in Multi-Stage Stochastic Optimization and its Applications Anna Timonina University of Vienna, Abraham Wald PhD Program in Statistics and Operations
More informationOptimization 101. Dan dibartolomeo Webinar (from Boston) October 22, 2013
Optimization 101 Dan dibartolomeo Webinar (from Boston) October 22, 2013 Outline of Today s Presentation The Mean-Variance Objective Function Optimization Methods, Strengths and Weaknesses Estimation Error
More informationOptimal Investment for Worst-Case Crash Scenarios
Optimal Investment for Worst-Case Crash Scenarios A Martingale Approach Frank Thomas Seifried Department of Mathematics, University of Kaiserslautern June 23, 2010 (Bachelier 2010) Worst-Case Portfolio
More informationMonte-Carlo Planning: Introduction and Bandit Basics. Alan Fern
Monte-Carlo Planning: Introduction and Bandit Basics Alan Fern 1 Large Worlds We have considered basic model-based planning algorithms Model-based planning: assumes MDP model is available Methods we learned
More informationLecture 6: Risk and uncertainty
Lecture 6: Risk and uncertainty Prof. Dr. Svetlozar Rachev Institute for Statistics and Mathematical Economics University of Karlsruhe Portfolio and Asset Liability Management Summer Semester 2008 Prof.
More informationTWO-STAGE PORTFOLIO OPTIMIZATION WITH HIGHER-ORDER CONDITIONAL MEASURES OF RISK
TWO-STAGE PORTFOLIO OPTIMIZATION WITH HIGHER-ORDER CONDITIONAL MEASURES OF RISK By Sıtkı Gülten A dissertation submitted to the Graduate School - Newark Rutgers, The State University of New Jersey in partial
More informationUniversity of California Berkeley
Working Paper # 2015-04 The Temporal Dimension of Drawdown Ola Mahmoud, University of St. Gallen July 13, 2015 University of California Berkeley THE TEMPORA DIMENSION OF DRAWDOWN OA MAHMOUD 1 Abstract.
More informationVaR vs CVaR in Risk Management and Optimization
VaR vs CVaR in Risk Management and Optimization Stan Uryasev Joint presentation with Sergey Sarykalin, Gaia Serraino and Konstantin Kalinchenko Risk Management and Financial Engineering Lab, University
More information