Oil prices and depletion path

Similar documents
Hotelling Under Pressure. Soren Anderson (Michigan State) Ryan Kellogg (Michigan) Stephen Salant (Maryland)

Markov Decision Processes

Optimal Dam Management

Fall Energy Resources

COMP417 Introduction to Robotics and Intelligent Systems. Reinforcement Learning - 2

Martingale Pricing Theory in Discrete-Time and Discrete-Space Models

CSEP 573: Artificial Intelligence

Portfolio Analysis with Random Portfolios

202: Dynamic Macroeconomics

Review of whole course

Consumption and Portfolio Choice under Uncertainty

Decision making in the presence of uncertainty

CSE 473: Artificial Intelligence

Stochastic Programming in Gas Storage and Gas Portfolio Management. ÖGOR-Workshop, September 23rd, 2010 Dr. Georg Ostermaier

CEC login. Student Details Name SOLUTIONS

Oil Monopoly and the Climate

Macroeconomics and finance

Stock Price Behavior. Stock Price Behavior

Theoretical Tools of Public Finance. 131 Undergraduate Public Economics Emmanuel Saez UC Berkeley

(FRED ESPEN BENTH, JAN KALLSEN, AND THILO MEYER-BRANDIS) UFITIMANA Jacqueline. Lappeenranta University Of Technology.

The Irrevocable Multi-Armed Bandit Problem

Simulation of delta hedging of an option with volume uncertainty. Marc LE DU, Clémence ALASSEUR EDF R&D - OSIRIS

Extraction capacity and the optimal order of extraction. By: Stephen P. Holland

CS 188: Artificial Intelligence

CS 343: Artificial Intelligence

General equilibrium simulations of floods

Online Appendix: Extensions

Indian Association of Alternative Investment Funds (IAAIF) Swapnil Pawar Scient Capital

Economics 2010c: Lecture 4 Precautionary Savings and Liquidity Constraints

Lecture 5 Theory of Finance 1

MSc Behavioural Finance detailed module information

Option Valuation (Lattice)

Reinforcement Learning. Slides based on those used in Berkeley's AI class taught by Dan Klein

Commodity and Energy Markets

Performance of Statistical Arbitrage in Future Markets

Introduction to Decision Making. CS 486/686: Introduction to Artificial Intelligence

How Costly is External Financing? Evidence from a Structural Estimation. Christopher Hennessy and Toni Whited March 2006

Extending MCTS

Reinforcement Learning

Dynamic Replication of Non-Maturing Assets and Liabilities

THE OPTIMAL ASSET ALLOCATION PROBLEMFOR AN INVESTOR THROUGH UTILITY MAXIMIZATION

Market Risk Analysis Volume II. Practical Financial Econometrics

Multistage grid investments incorporating uncertainty in Offshore wind deployment

Online Network Revenue Management using Thompson Sampling

Lecture 2: Making Good Sequences of Decisions Given a Model of World. CS234: RL Emma Brunskill Winter 2018

CS 6300 Artificial Intelligence Spring 2018

Online Appendix: Asymmetric Effects of Exogenous Tax Changes

Chapter 15: Jump Processes and Incomplete Markets. 1 Jumps as One Explanation of Incomplete Markets

Monte-Carlo Planning: Introduction and Bandit Basics. Alan Fern

A Study on Optimal Limit Order Strategy using Multi-Period Stochastic Programming considering Nonexecution Risk

Reinsurance Optimization GIE- AXA 06/07/2010

Handout 8: Introduction to Stochastic Dynamic Programming. 2 Examples of Stochastic Dynamic Programming Problems

Lattice Model of System Evolution. Outline

Optimal Investment for Generalized Utility Functions

Portfolio Management and Optimal Execution via Convex Optimization

Hotelling s model in practice

Logistics. CS 473: Artificial Intelligence. Markov Decision Processes. PS 2 due today Midterm in one week

Fixed-Income Securities Lecture 5: Tools from Option Pricing

PART II IT Methods in Finance

June Economic Capital for Life Insurers - Robert Chen

A Note on the Oil Price Trend and GARCH Shocks

Chapter 7 A Multi-Market Approach to Multi-User Allocation

A Note on the Oil Price Trend and GARCH Shocks

Non-Deterministic Search

Dynamic Macroeconomics

16 MAKING SIMPLE DECISIONS

The Binomial Model. Chapter 3

Risk Neutral Pricing. to government bonds (provided that the government is reliable).

Computational Finance. Computational Finance p. 1

1. Suppose that instead of a lump sum tax the government introduced a proportional income tax such that:

Lecture 5. 1 Online Learning. 1.1 Learning Setup (Perspective of Universe) CSCI699: Topics in Learning & Game Theory

Modeling Emission Trading Schemes

Lecture outline W.B.Powell 1

2.1 Mathematical Basis: Risk-Neutral Pricing

Stochastic Optimization Methods in Scheduling. Rolf H. Möhring Technische Universität Berlin Combinatorial Optimization and Graph Algorithms

Introduction to Real Options

1 Consumption and saving under uncertainty

16 MAKING SIMPLE DECISIONS

Practical example of an Economic Scenario Generator

AK and reduced-form AK models. Consumption taxation. Distributive politics

An agent-based model for bank formation, bank runs and interbank networks

Computational Finance Least Squares Monte Carlo

Resource Planning with Uncertainty for NorthWestern Energy

Multistage risk-averse asset allocation with transaction costs

Stock Prices and the Stock Market

Economics 101A Spring A Revised Version of the Slutsky Equation Using the Expenditure Function or, the expenditure function is our friend!

Stock Market Forecast: Chaos Theory Revealing How the Market Works March 25, 2018 I Know First Research

Empirical and Average Case Analysis

Monte-Carlo Planning: Introduction and Bandit Basics. Alan Fern

Fast Convergence of Regress-later Series Estimators

A Taxonomy of Decision Models

Market Design for Emission Trading Schemes

Theory of Consumer Behavior First, we need to define the agents' goals and limitations (if any) in their ability to achieve those goals.

CS 4100 // artificial intelligence

14.05 Lecture Notes. Endogenous Growth

Disaster Risk Financing and Contingent Credit

Alternative VaR Models

Interest-rate pegs and central bank asset purchases: Perfect foresight and the reversal puzzle

Prepayments in depth - part 2: Deeper into the forest

Lecture 17: More on Markov Decision Processes. Reinforcement learning

Transcription:

Pierre-Noël GIRAUD (CERNA, Paris) Aline SUTTER Timothée DENIS (EDF R&D) timothee.denis@edf.fr Oil prices and depletion path Hubbert oil peak and Hotelling rent through a combined Simulation and Optimisation approach

Presentation overview EDF is interested in oil as a key driving force within the energy commodities market a pedagogic tool to get a grasp on oil prices and depletion 1. Origination and Principle 2. Optimisation model 3. Simulation model 2

Origination and Principle Ricardo, Hubbert and Hotelling

Introduction a joint CERNA (Commodities Economics Lab, Ecole des Mines de Paris) and EDF R&D research project revisit the long term oil market fundamental driving forces still work in progress few results, much methodology starting from the classical approaches of the field Ricardo differential rents Hotelling rent Hubbert oil peak a double modelling approach (which one is best?) 1. an optimisation model to determine the exploration strategy 2. a simulation model based on rational agents behaviour 4

Hotelling model an exhaustible resource with a given stock and extraction cost a given demand presence of an abundant backstop technology with a given extraction cost (e.g. hydrogen via fuel cells) perfect competition between deposits owners no limit on production capacity presence of a market with a rate of return r no arbitrage opportunity production of resource is optimal any time unchanged discounted rent over time 5

Hotelling model (2) ( r( T T )) price = pe + ( ps pe)exp 0 price of a substitutable exhaustible resource through time 6

Hubbert peak oil production is bound to reach a peak how? when? oil production is geologically constrained: production level cannot increase too fast there exists a production cap above which global recovery rate is not optimal production path of an oil well through time 7

Hubbert peak (2) empirical result total production of a multi-deposit region also shows a peak (when half of total reserves are depleted) production path of several oil wells through time 8

Hubbert peak (3) 48-US oil production peak had been forecasted by Hubbert 15 years before (with a 1 year error!) 9

Hubbert peak (3) other oil producing countries production peak? 10

Optimisation model Objectives Principle Method

Model objectives enrich original Hotelling model get a grasp on the long-term dynamic of oil price setting, by accounting for the need to explore to be able to produce oil the (random) discovery of new reserves through exploration reserves exhaustion oil production technical constraints 2 different production costs be able to find out the optimal exploration strategy 12

Model principles if reserves were known to actors, we would expect Ricardo oil production starting in the ascending cost order Hotelling presence of a scarcity rent oil production subject to technical constraint but reserves first have to be discovered, therefore need for modelling how they get into the agent production portfolio this can be viewed as an information production about reserves unknown reserves exploration reserves in portfolio production demand associated Cost Ex. producing or saving? associated Cost Prod. 13

Model principles (2) meeting known Supply and Demand under minimum cost through time optimisation fundamental model production demand deterministic or stochastic associated Cost Prod. numerically tractable via Linear Programming or Bellman Values here Supply characteristics are unveiled by paying for exploration strategy arbitrage : unknown reserves exploration reserves in portfolio time step t carpe diem strategy exploring strategy Exploration cost ($/b) Expectation: low Risk : low Expectation: medium Risk : medium Production cost ($/b) Expectation: medium Risk : high Expectation: low Risk : medium associated Cost Ex. dual effect 14

Model principles (3) dual effect or one-armed bandit problem methodological core of the problem paying in the hope of decreasing total cost? carpe diem strategy explore all strategy Exploration cost ($/b) Expectation: low Risk : low Expectation: high! (cf. discount rate) Risk : low Production cost ($/b) Expectation: medium Risk : high Expectation: low Risk : none classical optimisation techniques very hard to use linear programming exponential explosion of number of nodes to explore Bellman stochastic dynamic programming limited number of states possible only which does not allow to consider a rich set of hypothesis 15

Model method 2 states Bellman stochastic dynamic programming minimizing total cost under supply/demand constraint constant and inelastic demand 2 types of oil available (cheap and expensive), spread into 150 unknown reserves (unique reserve size) randomness on future production cost of discoverable reserves infinitely and immediately available backstop technology knowledge of the agent statistical knowledge of the reserves to be discovered able to calculate ex ante the exhaustion date discovery cost per reserve increases linearly with portfolio reserves 16

Model method (2) V t 2 states Bellman stochastic dynamic programming Bellman states: 2 types of oil reserves in portfolio = D t t rt D ω { 0,..., q } ({ }) ( ) D D N N r t P q ω q ω + + ({ N N R, R min e I C C p (1 p) V R, R }) 1, t 2, t ω t+ 1 1, t+ 1 2, t+ 1 where: r D t is the control variable : the amount of oil to be discovered for each t Bellman Values are then used to simulate any scenario 17

Model method (3) demand is satisfied by putting new reserves into production, in the ascending cost order under a technical constraint: production exponential decrease production rate is proportional to current level of reserve with half-life time τ less realistic but only way to allow for a tractable solvency (see next slide) production flow of an oil reserve 18

Model method (4) production exponential decrease hypothesis has several modelling consequences 1. production rate is proportional to current level of reserve with half-life time τ reserves in production are fungible through time 2. since demand is non decreasing, one can calculate ex ante the exhaustion date 3. producing reserves need not be considered into Bellman Values since they can be deduced from the state of portfolio 4. 2 states Bellman stochastic dynamic programming production flow of an oil reserve 19

Model results examples 9.E+10 7.E+11 8.E+10 7.E+10 6.E+10 5.E+10 4.E+10 3.E+10 2.E+10 1.E+10 investment is made when amount of cheap oil in portfolio is below a certain level investment levels are very hectic except for the middle period, where exhaustion begins 6.E+11 5.E+11 4.E+11 3.E+11 2.E+11 1.E+11 0.E+00 1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 0.E+00 cheap oil in portfolio (b) exploration investment ($) 20

Model results examples (2) 9.E+10 8.E+10 7.E+10 6.E+10 5.E+10 4.E+10 3.E+10 2.E+10 1.E+10 a big discovery is often followed by a zero investment level close to heuristics in 2 nd part 8.E+11 7.E+11 6.E+11 5.E+11 4.E+11 3.E+11 2.E+11 1.E+11 0.E+00 1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 0.E+00 cheap oil in portfolio (b) cheap oil discoveries (b) cheap oil new production (b) exploration investment ($) new production cost ($) 21

Model results examples (3) 7.E+10 7.E+11 6.E+10 5.E+10 investment is made when amount of expensive oil discovered is beyond a certain level 6.E+11 5.E+11 4.E+10 4.E+11 3.E+10 3.E+11 2.E+10 2.E+11 1.E+10 1.E+11 0.E+00 1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 0.E+00 expensive oil discoveries (b) exploration investment ($) 22

Model results examples (4) 7.E+10 6.E+10 5.E+10 4.E+10 3.E+10 2.E+10 1.E+10 0.E+00 1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 8.E+11 7.E+11 6.E+11 5.E+11 4.E+11 3.E+11 2.E+11 1.E+11 0.E+00 expensive oil discoveries (b) expensive oil new production (b) expensive oil in portfolio (b) exploration investment ($) new production cost ($) 23

Model extension attempt enrich hypothesis set to account for a more realistic randomness to better fit the reality of oil market stay close from optimal strategy while approximating sliding random tree use a small depth random tree to account for exploration randomness use Linear Programming to find the optimal time-local exploration strategy make it slide along the time axis 24

Model extension attempt (2) sliding random tree size of tree can be huge K E r t E ( n + 1, r ) = K( n, s) where K t ( n, s) s= 0 is the number of allocation of s reserves of n different categories numeric example : n=9 (3 oil production cost and 3 reserve sizes) ; r E =3 and p=3 size of tree: 4,519,515 variables and number of constraints is the same order of magnitude numerical limit for Linear Programming does not allow for an interesting set of hypothesis 25

Possible model extensions sliding deterministic tree using expectation of discoverable reserves sliding random non branching tree defining several deterministic scenarios through random tree untested yet 26

Simulation model Objectives Principle Method

Model objectives get a grasp on the long-term dynamic of oil price setting, by accounting for reserves exhaustion different production cost ranges technical constraints (exploration and production) combining classical approaches test the existence of a Hubbert peak on oil production 28

Model principles enrich original Hotelling model to assess for the (random) discovery of new reserves through exploration the technical constraints on oil production the cost difference between the production of various types of oil (Ricardo), e.g. Arabian light West Texas intermediate North Sea brent account for the exploration strategy of the agent through heuristics 29

Model hypothesis constant and inelastic demand 5 cost-differentiated types of oil available, spread into 330 unknown reserves of 3 different sizes randomness on both size and future production cost of discoverable reserves infinitely and immediately available backstop technology knowledge of the agent a priori statistical knowledge of the reserves to be discovered updated knowledge along successive discoveries constant discovery cost per reserve 30

Model description 5 cost-differentiated types of oil available, spread into 330 unknown reserves of 3 different sizes 2 types of randomness initial modelled distribution of oil reserves on earth follows a uniform law (expected number of reserves from each of the 15 categories is 22) this draw is made once and for all (sense of considering scenarios here?) order in which these reserves are discovered what defines scenarios number of scenarios is tremendous: 330! ( 22! ) 377 10 15 31

Model description (2) 5 cost-differentiated types of oil available, spread into 330 unknown reserves of 3 different sizes overestimation of cheap and small reserves ; underestimation of big and expensive reserves 35 30 25 20 15 10 5 0 5 $/b 5 $/b 5 $/b 10 $/b 10 $/b 10 $/b 15 $/b 15 $/b 15 $/b 20 $/b 20 $/b 20 $/b 25 $/b 25 $/b 25 $/b size of reserve (bb) real number of reserves a priori number of reserves 32

Model description (3) demand is satisfied by putting new reserves into production, in the ascending cost order under a technical constraint: a reserve yields a constant rate of production during τ years profile of a producing reserve 33

Model exploration heuristics idea: short-sighted vision explore when it seems worth it, but to meet demand only for the following time step (no dynamic feature) 1. for each time period the agent owns a reserves portfolio inherited from his exploration/production decisions in the past it then computes for each period an exploration level such that E[Cost exploration ] + E[marginal Cost production (new port.)] is less or equal than E[marginal Cost production (old port.)] 2. it proceeds with exploration, which randomly returns size and future production cost of the discovered reserve 34

Simulation overview production (b) simulation over 100 time steps total reserves: 2,000 billions barrels 3.E+10 3.E+10 2.E+10 2.E+10 1.E+10 demand: 30 billions barrels 0.E+00 1. peaks are occurring one after the other, starting from cheapest oil types reserves in portfolio (b) 5.E+09 2. there is always an overlapping of the different producing reserves 1 11 21 31 41 51 61 71 81 91 time 1 2 3 4 5 S no more discoverable reserves production (b) 1.6E+12 1.4E+12 1.2E+12 1E+12 8E+11 6E+11 4E+11 2E+11 0 1 11 21 31 41 51 61 71 81 91 time 3.E+10 3.E+10 2.E+10 2.E+10 1.E+10 5.E+09 0.E+00 1 11 21 31 41 51 61 71 81 91 time 1 2 3 4 5 no more discoverable reserves 1 2 3 4 5 S no more discoverable reserves 35

Agent knowledge the agent first has to explore to be able to produce oil it starts with an a priori statistical knowledge of the reserves to be discovered, which might be far from the actual reality it will then use the outcome of its further discoveries to update this knowledge 36

Agent knowledge (2) updated knowledge of reserves allows agent to better infer outcome of exploration for each of the 15 cost-size oil categories updated probability knowledge 1 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 time 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 37

Inferring depletion date updated knowledge of the reserves allows agent to better infer outcome of exploration total volume estimation error updated probability knowledge b 2.5E+12 2.0E+12 1.5E+12 1.0E+12 5.0E+11 7.0E+11 6.0E+11 5.0E+11 4.0E+11 3.0E+11 2.0E+11 1.0E+11 0.0E+00 0.0E+00 1 2 3 4 5 6 7 8 9 101112 13 1415 16 17 1819 20 21 2223 2425262728 time -1.0E+11 estimation error total actual volume total estimated volume 38

Inferring depletion date (2) updated knowledge of the reserves allows agent to better infer outcome of exploration example for 2 oil categories 3.E+11 3.E+11 2.E+11 2.E+11 1.E+11 5.E+10 0.E+00 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 actual volume 1 actual volume 15 estimated volume 1 estimated volume 15 39

Inferring depletion date (3) estimated volumes V total remaining of remaining reserves allow agent to infer a depletion date T estimated volumes of remaining reserves at t model run estimated volumes of remaining reserves at t+1 85 80 75 70 65 60 55 inferred depletion date inferred depletion date at t+1 50 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 time 40

Inferring Hotelling rent inferred depletion date T allow agent to update the Hotelling rent rent H at each time step discount rate r also is affected by the depletion date being non deterministic 41

Inferring Hotelling rent (2) inferred depletion date T at each time step discount rate r at each time step renth = ( ps pe)exp( r( T T 0) ) marginal extraction cost marginal Cost production 85 80 75 70 65 60 55 50 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 time inferred depletion date no more discoverable reserves 45 40 35 30 25 20 15 10 5 0 1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 55 58 61 64 67 70 73 76 79 time marginal extraction cost ($/b) no more discoverable reserves end of portfolio reserves 42

Inferring Hotelling rent (3) inferred depletion date T at each time step discount rate r at each time step renth = ( ps pe)exp( r( T T 0) ) marginal extraction cost marginal Cost production 14 $/b 12 10 8 6 4 2 0 1 6 11 16 21 26 31 36 41 46 51 56 61 66 71 76 81 time theoritical Hotelling rent constant discount rate Hotelling rent updated discount rate Hotelling rent no more discoverable reserves end of portfolio reserves 43

Price output theoretical definition price for each time step is the expectation of the marginal production cost of one barrel more precisely, price is defined as the expectation of the marginal production cost of 1/τ barrel during τ years due to the variety of possible scenarios, such price might depend (among others) on realization 44

Price output (2) rational definition for a given agent, price corresponds to the sum of all costs necessary to meet demand extraction cost of marginal reserve exploration cost supposed to be covered by production differential rents Hotelling rent 45 40 35 30 $/b 25 20 15 10 5 0 1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 55 58 61 64 67 70 73 76 79 time marginal extraction cost updated discount rate Hotelling rent 45

Pierre-Noël GIRAUD (CERNA, Paris) Aline SUTTER Timothée DENIS (EDF R&D) timothee.denis@edf.fr Oil prices and depletion path Hubbert oil peak and Hotelling rent through a combined Simulation and Optimisation approach