Economics 2010c: Lecture 4 Precautionary Savings and Liquidity Constraints

Size: px
Start display at page:

Download "Economics 2010c: Lecture 4 Precautionary Savings and Liquidity Constraints"

Transcription

1 Economics 2010c: Lecture 4 Precautionary Savings and Liquidity Constraints David Laibson 9/11/2014

2 Outline: 1. Precautionary savings motives 2. Liquidity constraints 3. Application: Numerical solution of a problem with liquidity constraints 4. Comparison to eat-the-pie problem 5. Discrete numerical analysis (optional)

3 1 Precautionary motives How does uncertainty affect the Euler Equation? ln +1 = 1 ( +1 )+ 2 ln +1 where ln +1 = [ ln +1 ln +1 ] 2 Increase in economic uncertainty, raises ln +1 raising ln +1 Why? Marginal utility is convex when is in the CRRA class. An increase in uncertainty, raises the expected value of marginal utility. This increases the motive to save. Sometimes this is referred to as the precautionary savings effect.

4 2 period Example: 0 = 0 =1 1 has distribution function ( ) with non-negative support. ( 1 )=1 Definition: Precautionary saving is the reduction in consumption due to the fact that future labor income is uncertain instead of being fixed at its mean value.

5 Greater income uncertainty increases motive to save (even if expected value of future income is unchanged). Prediction tested using variation in income uncertainty across occupations. Dynan (1993) finds that income uncertainty does not predict consumption growth. Carroll (1994) finds a robust relationship.

6 2 Liquidity constraints. Since the 1990 s consumption models have emphasized the role of liquidity constraints (Zeldes, Carroll, Deaton). Two key assumptions of these buffer stock models. 1. Consumers face a borrowing limit e.g. This matters whether or not it actually binds in equilibrium (e.g., atom at zero income). 2. Consumers are impatient

7 Predictions: Consumers accumulate a small stock of assets to buffer transitory income shocks Consumption weakly tracks income at high frequencies (even predictable income) Consumption strongly tracks income at low frequencies (even predictable income) We will revisit these predictions in coming lectures.

8 3 Application: Numerical solution Labor income iid, symmetric beta-density on [0,1] = cash-on-hand ( ) = with = =2 Discount factor, =0 9 Gross rate of return, = Infinite horizon

9 Solution method is numerical. Let ( )( ) sup { ( )+ ( ( )+ +1 )} [0 ] +1 = ( )+ +1 Solution given by: lim ( )( ) Iteration of Bellman operator is done on a computer (using a discretized state and action space).

10 4 Eat the pie problem Compare to a model in which the consumer can securitize her income stream. In this model, labor income can be transformed into a bond. If consumers have exogenous idiosyncratic labor income risk, then there is no risk premium and consumers can sell their labor income for 0 = 0 X =0 The dynamic budget constraint is +1 = ( )

11 Bellman equation for eat-the-pie problem: ( )= sup { ( )+ ( ( ))} [0 ]

12 Guess the form of the solution. ( )= 1 1 if [0 ] 6= 1 + ln if =1 Confirm that solution works (problem set). Derive optimal policy rule (problem set). = 1 1 =1 ( 1 ) 1

13 Let s compare two similarly situated consumers: abuffer stock consumer with cash-on-hand (and a non-tradeable claim to all future labor income) an eat-the-pie consumer with cash-on-hand (and a tradeable claim to all future labor income); so the eat-the-pie consumer has current tradeable wealth = + X =1 Note that eat-the-pie consumption function lies above optimal consumption function

14 Optimal policy function is concave and bounded above by the lower envelope of the 45 degree line and eat-the-pie consumption function

15 0.04 Density of Income Process Density Income (partitioned into 100 cells)

16 -3 Converging value functions v(x) cash-on-hand

17 Consumption Functions Consumption Function for Eat-the-Pie Problem 1 Consumption Consumption Function for Liquidity Constraint Problem degree line (liquidity constraint) Cash-on-hand

18 Finally, think about linearized Euler Equation ln +1 = 1 ( +1 )+ 1 2 ln +1 Is the conditional variance of consumption growth constant? If cash-on-hand is low this period, what can we say about the variability ofconsumptiongrowthnextperiod? If cash-on-hand is high this period, what can we say about the variability ofconsumptiongrowthnextperiod?

19 When is close to 0, " +1 # as 0 When is large, is well approximated by an affine function, = + implying that and " # ' [ ( + )] + +1 " # ( + +1 ) ( + ) ' + " { [ ( + )] + ' +1 } + " # [1 ] 1 =0 as 1 #

20 5 Discrete numerical analysis basic idea is to partition continuous spaces into discrete spaces e.g., instead of having wealth in the interval [0, $5 million], we could set up a discrete space 0, $1000, $2000, $3000,..., $5,000,000 we could then let the agent optimize at every point in the discrete space (using some arbitrary continuation value function defined on the discrete space, and then iterating until convergence)

21 5.1 Example of discretization of buffer stock model (optional) Continuous State-Space Bellman Equation: ( ) = sup [0 ] { ( )+ ( ( )+ +1 )} We ll now discretize this problem.

22 Consider a discrete grid of points = { } It s natural to set 0 =0and equal to a value that is sufficiently large that you never expect an optimizing agent to reach However, should not be so large that you lose too much computational speed. Finding a sensible is an art and may take a few trial runs. Consider another discrete grid of points = { }

23 Now, given is chosen such that 0 (1) ( )+ for all (2) To make this last restriction possible, the discretized grids, and must be chosen judiciously. Define Γ( ) as the set of feasible consumption values that satisfy constraints (1) and (2). So the Bellman Equation for the discretized problem becomes: ( ) = sup { ( )+ ( ( )+ +1 )} Γ( )

24 An example of discretized grids and Choose to be divisible by Let {0 2 3 } Let the elements of by multiples of (e.g., = {13 47 }) Here I assume that the largest element in is smaller than Fix a cell Let represent the REMainder generated by dividing by Then, Γ( ) { } If Γ( ) then will be a multiple of so for all ( )+

25 Remark: For some (large) values of you will need to truncate the lowest valued cells of the Γ( ) correspondence. Specifically, it must be the case that for every value of for all This implies that ( min {Γ( )})+ min {Γ( )} =max{ ( )+ )}

26 5.2 Practical advice for Dynamic Programming (optional) When using analytical methods... work with -horizon problems (if possible) exploit other tricks to make your problem stationary (e.g., constant hazard rate for retirement) work with tractable densities (always try the uniform density in discrete time; try brownian motion and/or poisson jump processes in continuous time) minimize the number of state variables

27 When using numerical methods... approximate continuous random variables with discretized Markov processes coarsely discretize exogenous random variables densely discretize endogenous random variables use Monte Carlo methods to calculate multi-dimensional integrals use analytics to partially simplify problem (e.g., retirement as infinite horizon eat the pie problem)

28 translate Matlab code into optimized code (C ++ ) consider using polynomial approximations of value functions (Judd) consider using spline (piecewise polynomial) approximations of value functions (Judd) minimize the number of state variables (cf Carroll 1997)

29 5.3 Curse of dimensionality: travelling salesman (optional) must map route including visits to cities job is to minimize total distance travelled state variable: a -dimensional vector representing the cities if the salesman has already visited a city, we put a one in that cell set of states is all -dimensional vectors with 0 s and 1 s as elements = Y =1 {0 1}

30 Bellman Equation: Functional Equation: ( city) =max city 0 ( )( city) =max city 0 n (city city 0 ) + ( 0 city 0 ) o n (city city 0 ) + ( 0,city 0 ) o How many different states are there? X ³ =0 This is a large number when is large.

31 For example: ³ =! ( )!! Let =100 =50 so ³ = 100! 50!50! =1029 And that s just one value of To put this in perspective, a modern supercomputer can do a trillion calculations per second. So a supercomputer could go through one round of Bellman operator iteration in years.

32 Lesson: Even for seemingly simple problems the state space can get quite large. Work hard to limit the size of your state space.

33 You will typically have state spaces that are in < Suppose you had =4 Suppose you were modelling assets and you partitioned your state space into blocks of $1000. Imagine that you bound each of your four assets between $0 and $1,000,000. Your state space has elements. So each round of Bellman iteration requires the computer to do computations.

X ln( +1 ) +1 [0 ] Γ( )

X ln( +1 ) +1 [0 ] Γ( ) Problem Set #1 Due: 11 September 2014 Instructor: David Laibson Economics 2010c Problem 1 (Growth Model): Recall the growth model that we discussed in class. We expressed the sequence problem as ( 0 )=

More information

Notes for Econ202A: Consumption

Notes for Econ202A: Consumption Notes for Econ22A: Consumption Pierre-Olivier Gourinchas UC Berkeley Fall 215 c Pierre-Olivier Gourinchas, 215, ALL RIGHTS RESERVED. Disclaimer: These notes are riddled with inconsistencies, typos and

More information

1 Precautionary Savings: Prudence and Borrowing Constraints

1 Precautionary Savings: Prudence and Borrowing Constraints 1 Precautionary Savings: Prudence and Borrowing Constraints In this section we study conditions under which savings react to changes in income uncertainty. Recall that in the PIH, when you abstract from

More information

A simple wealth model

A simple wealth model Quantitative Macroeconomics Raül Santaeulàlia-Llopis, MOVE-UAB and Barcelona GSE Homework 5, due Thu Nov 1 I A simple wealth model Consider the sequential problem of a household that maximizes over streams

More information

Non-Deterministic Search

Non-Deterministic Search Non-Deterministic Search MDP s 1 Non-Deterministic Search How do you plan (search) when your actions might fail? In general case, how do you plan, when the actions have multiple possible outcomes? 2 Example:

More information

EC316a: Advanced Scientific Computation, Fall Discrete time, continuous state dynamic models: solution methods

EC316a: Advanced Scientific Computation, Fall Discrete time, continuous state dynamic models: solution methods EC316a: Advanced Scientific Computation, Fall 2003 Notes Section 4 Discrete time, continuous state dynamic models: solution methods We consider now solution methods for discrete time models in which decisions

More information

Macroeconomics 2. Lecture 12 - Idiosyncratic Risk and Incomplete Markets Equilibrium April. Sciences Po

Macroeconomics 2. Lecture 12 - Idiosyncratic Risk and Incomplete Markets Equilibrium April. Sciences Po Macroeconomics 2 Lecture 12 - Idiosyncratic Risk and Incomplete Markets Equilibrium Zsófia L. Bárány Sciences Po 2014 April Last week two benchmarks: autarky and complete markets non-state contingent bonds:

More information

Dynamic Portfolio Choice II

Dynamic Portfolio Choice II Dynamic Portfolio Choice II Dynamic Programming Leonid Kogan MIT, Sloan 15.450, Fall 2010 c Leonid Kogan ( MIT, Sloan ) Dynamic Portfolio Choice II 15.450, Fall 2010 1 / 35 Outline 1 Introduction to Dynamic

More information

Economics 2010c: -theory

Economics 2010c: -theory Economics 2010c: -theory David Laibson 10/9/2014 Outline: 1. Why should we study investment? 2. Static model 3. Dynamic model: -theory of investment 4. Phase diagrams 5. Analytic example of Model (optional)

More information

Notes on Macroeconomic Theory II

Notes on Macroeconomic Theory II Notes on Macroeconomic Theory II Chao Wei Department of Economics George Washington University Washington, DC 20052 January 2007 1 1 Deterministic Dynamic Programming Below I describe a typical dynamic

More information

Lecture 17: More on Markov Decision Processes. Reinforcement learning

Lecture 17: More on Markov Decision Processes. Reinforcement learning Lecture 17: More on Markov Decision Processes. Reinforcement learning Learning a model: maximum likelihood Learning a value function directly Monte Carlo Temporal-difference (TD) learning COMP-424, Lecture

More information

STATE UNIVERSITY OF NEW YORK AT ALBANY Department of Economics. Ph. D. Comprehensive Examination: Macroeconomics Fall, 2010

STATE UNIVERSITY OF NEW YORK AT ALBANY Department of Economics. Ph. D. Comprehensive Examination: Macroeconomics Fall, 2010 STATE UNIVERSITY OF NEW YORK AT ALBANY Department of Economics Ph. D. Comprehensive Examination: Macroeconomics Fall, 2010 Section 1. (Suggested Time: 45 Minutes) For 3 of the following 6 statements, state

More information

MACROECONOMICS. Prelim Exam

MACROECONOMICS. Prelim Exam MACROECONOMICS Prelim Exam Austin, June 1, 2012 Instructions This is a closed book exam. If you get stuck in one section move to the next one. Do not waste time on sections that you find hard to solve.

More information

Markov Decision Processes: Making Decision in the Presence of Uncertainty. (some of) R&N R&N

Markov Decision Processes: Making Decision in the Presence of Uncertainty. (some of) R&N R&N Markov Decision Processes: Making Decision in the Presence of Uncertainty (some of) R&N 16.1-16.6 R&N 17.1-17.4 Different Aspects of Machine Learning Supervised learning Classification - concept learning

More information

Lecture Notes 1

Lecture Notes 1 4.45 Lecture Notes Guido Lorenzoni Fall 2009 A portfolio problem To set the stage, consider a simple nite horizon problem. A risk averse agent can invest in two assets: riskless asset (bond) pays gross

More information

Markov Decision Process

Markov Decision Process Markov Decision Process Human-aware Robotics 2018/02/13 Chapter 17.3 in R&N 3rd Ø Announcement: q Slides for this lecture are here: http://www.public.asu.edu/~yzhan442/teaching/cse471/lectures/mdp-ii.pdf

More information

Homework #4. Due back: Beginning of class, Friday 5pm, December 11, 2009.

Homework #4. Due back: Beginning of class, Friday 5pm, December 11, 2009. Fatih Guvenen University of Minnesota Homework #4 Due back: Beginning of class, Friday 5pm, December 11, 2009. Questions indicated by a star are required for everybody who attends the class. You can use

More information

1 Answers to the Sept 08 macro prelim - Long Questions

1 Answers to the Sept 08 macro prelim - Long Questions Answers to the Sept 08 macro prelim - Long Questions. Suppose that a representative consumer receives an endowment of a non-storable consumption good. The endowment evolves exogenously according to ln

More information

1 Ricardian Neutrality of Fiscal Policy

1 Ricardian Neutrality of Fiscal Policy 1 Ricardian Neutrality of Fiscal Policy For a long time, when economists thought about the effect of government debt on aggregate output, they focused on the so called crowding-out effect. To simplify

More information

CS 188: Artificial Intelligence

CS 188: Artificial Intelligence CS 188: Artificial Intelligence Markov Decision Processes Dan Klein, Pieter Abbeel University of California, Berkeley Non-Deterministic Search 1 Example: Grid World A maze-like problem The agent lives

More information

Chapter 3. Dynamic discrete games and auctions: an introduction

Chapter 3. Dynamic discrete games and auctions: an introduction Chapter 3. Dynamic discrete games and auctions: an introduction Joan Llull Structural Micro. IDEA PhD Program I. Dynamic Discrete Games with Imperfect Information A. Motivating example: firm entry and

More information

Limit Theorems for the Empirical Distribution Function of Scaled Increments of Itô Semimartingales at high frequencies

Limit Theorems for the Empirical Distribution Function of Scaled Increments of Itô Semimartingales at high frequencies Limit Theorems for the Empirical Distribution Function of Scaled Increments of Itô Semimartingales at high frequencies George Tauchen Duke University Viktor Todorov Northwestern University 2013 Motivation

More information

Consumption and Portfolio Choice under Uncertainty

Consumption and Portfolio Choice under Uncertainty Chapter 8 Consumption and Portfolio Choice under Uncertainty In this chapter we examine dynamic models of consumer choice under uncertainty. We continue, as in the Ramsey model, to take the decision of

More information

MDPs: Bellman Equations, Value Iteration

MDPs: Bellman Equations, Value Iteration MDPs: Bellman Equations, Value Iteration Sutton & Barto Ch 4 (Cf. AIMA Ch 17, Section 2-3) Adapted from slides kindly shared by Stuart Russell Sutton & Barto Ch 4 (Cf. AIMA Ch 17, Section 2-3) 1 Appreciations

More information

4 Reinforcement Learning Basic Algorithms

4 Reinforcement Learning Basic Algorithms Learning in Complex Systems Spring 2011 Lecture Notes Nahum Shimkin 4 Reinforcement Learning Basic Algorithms 4.1 Introduction RL methods essentially deal with the solution of (optimal) control problems

More information

1 Consumption and saving under uncertainty

1 Consumption and saving under uncertainty 1 Consumption and saving under uncertainty 1.1 Modelling uncertainty As in the deterministic case, we keep assuming that agents live for two periods. The novelty here is that their earnings in the second

More information

CS 343: Artificial Intelligence

CS 343: Artificial Intelligence CS 343: Artificial Intelligence Markov Decision Processes II Prof. Scott Niekum The University of Texas at Austin [These slides based on those of Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC

More information

Consumption. ECON 30020: Intermediate Macroeconomics. Prof. Eric Sims. Spring University of Notre Dame

Consumption. ECON 30020: Intermediate Macroeconomics. Prof. Eric Sims. Spring University of Notre Dame Consumption ECON 30020: Intermediate Macroeconomics Prof. Eric Sims University of Notre Dame Spring 2018 1 / 27 Readings GLS Ch. 8 2 / 27 Microeconomics of Macro We now move from the long run (decades

More information

1 The Solow Growth Model

1 The Solow Growth Model 1 The Solow Growth Model The Solow growth model is constructed around 3 building blocks: 1. The aggregate production function: = ( ()) which it is assumed to satisfy a series of technical conditions: (a)

More information

CS 188: Artificial Intelligence Fall 2011

CS 188: Artificial Intelligence Fall 2011 CS 188: Artificial Intelligence Fall 2011 Lecture 9: MDPs 9/22/2011 Dan Klein UC Berkeley Many slides over the course adapted from either Stuart Russell or Andrew Moore 2 Grid World The agent lives in

More information

Outline for today. Stat155 Game Theory Lecture 19: Price of anarchy. Cooperative games. Price of anarchy. Price of anarchy

Outline for today. Stat155 Game Theory Lecture 19: Price of anarchy. Cooperative games. Price of anarchy. Price of anarchy Outline for today Stat155 Game Theory Lecture 19:.. Peter Bartlett Recall: Linear and affine latencies Classes of latencies Pigou networks Transferable versus nontransferable utility November 1, 2016 1

More information

Problem set Fall 2012.

Problem set Fall 2012. Problem set 1. 14.461 Fall 2012. Ivan Werning September 13, 2012 References: 1. Ljungqvist L., and Thomas J. Sargent (2000), Recursive Macroeconomic Theory, sections 17.2 for Problem 1,2. 2. Werning Ivan

More information

Decision Theory: Value Iteration

Decision Theory: Value Iteration Decision Theory: Value Iteration CPSC 322 Decision Theory 4 Textbook 9.5 Decision Theory: Value Iteration CPSC 322 Decision Theory 4, Slide 1 Lecture Overview 1 Recap 2 Policies 3 Value Iteration Decision

More information

SOLVING ROBUST SUPPLY CHAIN PROBLEMS

SOLVING ROBUST SUPPLY CHAIN PROBLEMS SOLVING ROBUST SUPPLY CHAIN PROBLEMS Daniel Bienstock Nuri Sercan Özbay Columbia University, New York November 13, 2005 Project with Lucent Technologies Optimize the inventory buffer levels in a complicated

More information

3.4 Copula approach for modeling default dependency. Two aspects of modeling the default times of several obligors

3.4 Copula approach for modeling default dependency. Two aspects of modeling the default times of several obligors 3.4 Copula approach for modeling default dependency Two aspects of modeling the default times of several obligors 1. Default dynamics of a single obligor. 2. Model the dependence structure of defaults

More information

Lecture 12. Asset pricing model. Randall Romero Aguilar, PhD I Semestre 2017 Last updated: June 15, 2017

Lecture 12. Asset pricing model. Randall Romero Aguilar, PhD I Semestre 2017 Last updated: June 15, 2017 Lecture 12 Asset pricing model Randall Romero Aguilar, PhD I Semestre 2017 Last updated: June 15, 2017 Universidad de Costa Rica EC3201 - Teoría Macroeconómica 2 Table of contents 1. Introduction 2. The

More information

Making Complex Decisions

Making Complex Decisions Ch. 17 p.1/29 Making Complex Decisions Chapter 17 Ch. 17 p.2/29 Outline Sequential decision problems Value iteration algorithm Policy iteration algorithm Ch. 17 p.3/29 A simple environment 3 +1 p=0.8 2

More information

Online Appendix Optimal Time-Consistent Government Debt Maturity D. Debortoli, R. Nunes, P. Yared. A. Proofs

Online Appendix Optimal Time-Consistent Government Debt Maturity D. Debortoli, R. Nunes, P. Yared. A. Proofs Online Appendi Optimal Time-Consistent Government Debt Maturity D. Debortoli, R. Nunes, P. Yared A. Proofs Proof of Proposition 1 The necessity of these conditions is proved in the tet. To prove sufficiency,

More information

Final exam solutions

Final exam solutions EE365 Stochastic Control / MS&E251 Stochastic Decision Models Profs. S. Lall, S. Boyd June 5 6 or June 6 7, 2013 Final exam solutions This is a 24 hour take-home final. Please turn it in to one of the

More information

Idiosyncratic risk, insurance, and aggregate consumption dynamics: a likelihood perspective

Idiosyncratic risk, insurance, and aggregate consumption dynamics: a likelihood perspective Idiosyncratic risk, insurance, and aggregate consumption dynamics: a likelihood perspective Alisdair McKay Boston University June 2013 Microeconomic evidence on insurance - Consumption responds to idiosyncratic

More information

Credit Crises, Precautionary Savings and the Liquidity Trap October (R&R Quarterly 31, 2016Journal 1 / of19

Credit Crises, Precautionary Savings and the Liquidity Trap October (R&R Quarterly 31, 2016Journal 1 / of19 Credit Crises, Precautionary Savings and the Liquidity Trap (R&R Quarterly Journal of nomics) October 31, 2016 Credit Crises, Precautionary Savings and the Liquidity Trap October (R&R Quarterly 31, 2016Journal

More information

Economics 101. Lecture 3 - Consumer Demand

Economics 101. Lecture 3 - Consumer Demand Economics 101 Lecture 3 - Consumer Demand 1 Intro First, a note on wealth and endowment. Varian generally uses wealth (m) instead of endowment. Ultimately, these two are equivalent. Given prices p, if

More information

Problem Set 3. Thomas Philippon. April 19, Human Wealth, Financial Wealth and Consumption

Problem Set 3. Thomas Philippon. April 19, Human Wealth, Financial Wealth and Consumption Problem Set 3 Thomas Philippon April 19, 2002 1 Human Wealth, Financial Wealth and Consumption The goal of the question is to derive the formulas on p13 of Topic 2. This is a partial equilibrium analysis

More information

INTERTEMPORAL ASSET ALLOCATION: THEORY

INTERTEMPORAL ASSET ALLOCATION: THEORY INTERTEMPORAL ASSET ALLOCATION: THEORY Multi-Period Model The agent acts as a price-taker in asset markets and then chooses today s consumption and asset shares to maximise lifetime utility. This multi-period

More information

Online appendix for Price Pressures. Terrence Hendershott and Albert J. Menkveld

Online appendix for Price Pressures. Terrence Hendershott and Albert J. Menkveld Online appendix for Price Pressures Terrence Hendershott and Albert J. Menkveld This document has the following supplemental material: 1. Section 1 presents the infinite horizon version of the Ho and Stoll

More information

2.1 Mathematical Basis: Risk-Neutral Pricing

2.1 Mathematical Basis: Risk-Neutral Pricing Chapter Monte-Carlo Simulation.1 Mathematical Basis: Risk-Neutral Pricing Suppose that F T is the payoff at T for a European-type derivative f. Then the price at times t before T is given by f t = e r(t

More information

ECON 459 Game Theory. Lecture Notes Auctions. Luca Anderlini Spring 2017

ECON 459 Game Theory. Lecture Notes Auctions. Luca Anderlini Spring 2017 ECON 459 Game Theory Lecture Notes Auctions Luca Anderlini Spring 2017 These notes have been used and commented on before. If you can still spot any errors or have any suggestions for improvement, please

More information

Lecture 1: Lucas Model and Asset Pricing

Lecture 1: Lucas Model and Asset Pricing Lecture 1: Lucas Model and Asset Pricing Economics 714, Spring 2018 1 Asset Pricing 1.1 Lucas (1978) Asset Pricing Model We assume that there are a large number of identical agents, modeled as a representative

More information

Problem set 1 Answers: 0 ( )= [ 0 ( +1 )] = [ ( +1 )]

Problem set 1 Answers: 0 ( )= [ 0 ( +1 )] = [ ( +1 )] Problem set 1 Answers: 1. (a) The first order conditions are with 1+ 1so 0 ( ) [ 0 ( +1 )] [( +1 )] ( +1 ) Consumption follows a random walk. This is approximately true in many nonlinear models. Now we

More information

Multi-armed bandit problems

Multi-armed bandit problems Multi-armed bandit problems Stochastic Decision Theory (2WB12) Arnoud den Boer 13 March 2013 Set-up 13 and 14 March: Lectures. 20 and 21 March: Paper presentations (Four groups, 45 min per group). Before

More information

Lecture 2 Dynamic Equilibrium Models: Three and More (Finite) Periods

Lecture 2 Dynamic Equilibrium Models: Three and More (Finite) Periods Lecture 2 Dynamic Equilibrium Models: Three and More (Finite) Periods. Introduction In ECON 50, we discussed the structure of two-period dynamic general equilibrium models, some solution methods, and their

More information

Recharging Bandits. Joint work with Nicole Immorlica.

Recharging Bandits. Joint work with Nicole Immorlica. Recharging Bandits Bobby Kleinberg Cornell University Joint work with Nicole Immorlica. NYU Machine Learning Seminar New York, NY 24 Oct 2017 Prologue Can you construct a dinner schedule that: never goes

More information

Unobserved Heterogeneity Revisited

Unobserved Heterogeneity Revisited Unobserved Heterogeneity Revisited Robert A. Miller Dynamic Discrete Choice March 2018 Miller (Dynamic Discrete Choice) cemmap 7 March 2018 1 / 24 Distributional Assumptions about the Unobserved Variables

More information

Graduate Macro Theory II: Two Period Consumption-Saving Models

Graduate Macro Theory II: Two Period Consumption-Saving Models Graduate Macro Theory II: Two Period Consumption-Saving Models Eric Sims University of Notre Dame Spring 207 Introduction This note works through some simple two-period consumption-saving problems. In

More information

1 Modelling borrowing constraints in Bewley models

1 Modelling borrowing constraints in Bewley models 1 Modelling borrowing constraints in Bewley models Consider the problem of a household who faces idiosyncratic productivity shocks, supplies labor inelastically and can save/borrow only through a risk-free

More information

The Method of Moderation

The Method of Moderation SED Version The Method of Moderation June 24, 2012 Christopher D. Carroll 1 JHU Kiichi Tokuoka 2 ECB Weifeng Wu 3 Fannie Mae Abstract In a risky world, a pessimist assumes the worst will happen. Someone

More information

Notes II: Consumption-Saving Decisions, Ricardian Equivalence, and Fiscal Policy. Julio Garín Intermediate Macroeconomics Fall 2018

Notes II: Consumption-Saving Decisions, Ricardian Equivalence, and Fiscal Policy. Julio Garín Intermediate Macroeconomics Fall 2018 Notes II: Consumption-Saving Decisions, Ricardian Equivalence, and Fiscal Policy Julio Garín Intermediate Macroeconomics Fall 2018 Introduction Intermediate Macroeconomics Consumption/Saving, Ricardian

More information

Behavioral Finance and Asset Pricing

Behavioral Finance and Asset Pricing Behavioral Finance and Asset Pricing Behavioral Finance and Asset Pricing /49 Introduction We present models of asset pricing where investors preferences are subject to psychological biases or where investors

More information

Online Appendix: Extensions

Online Appendix: Extensions B Online Appendix: Extensions In this online appendix we demonstrate that many important variations of the exact cost-basis LUL framework remain tractable. In particular, dual problem instances corresponding

More information

Asset-Liability Management

Asset-Liability Management Asset-Liability Management John Birge University of Chicago Booth School of Business JRBirge INFORMS San Francisco, Nov. 2014 1 Overview Portfolio optimization involves: Modeling Optimization Estimation

More information

Equity correlations implied by index options: estimation and model uncertainty analysis

Equity correlations implied by index options: estimation and model uncertainty analysis 1/18 : estimation and model analysis, EDHEC Business School (joint work with Rama COT) Modeling and managing financial risks Paris, 10 13 January 2011 2/18 Outline 1 2 of multi-asset models Solution to

More information

1 Ricardian Neutrality of Fiscal Policy

1 Ricardian Neutrality of Fiscal Policy 1 Ricardian Neutrality of Fiscal Policy We start our analysis of fiscal policy by stating a neutrality result for fiscal policy which is due to David Ricardo (1817), and whose formal illustration is due

More information

6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE

6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE 6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE Suboptimal control Cost approximation methods: Classification Certainty equivalent control: An example Limited lookahead policies Performance bounds

More information

Consumption. ECON 30020: Intermediate Macroeconomics. Prof. Eric Sims. Fall University of Notre Dame

Consumption. ECON 30020: Intermediate Macroeconomics. Prof. Eric Sims. Fall University of Notre Dame Consumption ECON 30020: Intermediate Macroeconomics Prof. Eric Sims University of Notre Dame Fall 2016 1 / 36 Microeconomics of Macro We now move from the long run (decades and longer) to the medium run

More information

Reinforcement Learning

Reinforcement Learning Reinforcement Learning MDP March May, 2013 MDP MDP: S, A, P, R, γ, µ State can be partially observable: Partially Observable MDPs () Actions can be temporally extended: Semi MDPs (SMDPs) and Hierarchical

More information

Continuous-time Stochastic Control and Optimization with Financial Applications

Continuous-time Stochastic Control and Optimization with Financial Applications Huyen Pham Continuous-time Stochastic Control and Optimization with Financial Applications 4y Springer Some elements of stochastic analysis 1 1.1 Stochastic processes 1 1.1.1 Filtration and processes 1

More information

Inflation. David Andolfatto

Inflation. David Andolfatto Inflation David Andolfatto Introduction We continue to assume an economy with a single asset Assume that the government can manage the supply of over time; i.e., = 1,where 0 is the gross rate of money

More information

17 MAKING COMPLEX DECISIONS

17 MAKING COMPLEX DECISIONS 267 17 MAKING COMPLEX DECISIONS The agent s utility now depends on a sequence of decisions In the following 4 3grid environment the agent makes a decision to move (U, R, D, L) at each time step When the

More information

Module 10:Application of stochastic processes in areas like finance Lecture 36:Black-Scholes Model. Stochastic Differential Equation.

Module 10:Application of stochastic processes in areas like finance Lecture 36:Black-Scholes Model. Stochastic Differential Equation. Stochastic Differential Equation Consider. Moreover partition the interval into and define, where. Now by Rieman Integral we know that, where. Moreover. Using the fundamentals mentioned above we can easily

More information

16 MAKING SIMPLE DECISIONS

16 MAKING SIMPLE DECISIONS 253 16 MAKING SIMPLE DECISIONS Let us associate each state S with a numeric utility U(S), which expresses the desirability of the state A nondeterministic action a will have possible outcome states Result(a)

More information

Optimally Thresholded Realized Power Variations for Lévy Jump Diffusion Models

Optimally Thresholded Realized Power Variations for Lévy Jump Diffusion Models Optimally Thresholded Realized Power Variations for Lévy Jump Diffusion Models José E. Figueroa-López 1 1 Department of Statistics Purdue University University of Missouri-Kansas City Department of Mathematics

More information

Homework 2: Dynamic Moral Hazard

Homework 2: Dynamic Moral Hazard Homework 2: Dynamic Moral Hazard Question 0 (Normal learning model) Suppose that z t = θ + ɛ t, where θ N(m 0, 1/h 0 ) and ɛ t N(0, 1/h ɛ ) are IID. Show that θ z 1 N ( hɛ z 1 h 0 + h ɛ + h 0m 0 h 0 +

More information

Regret Minimization and Correlated Equilibria

Regret Minimization and Correlated Equilibria Algorithmic Game heory Summer 2017, Week 4 EH Zürich Overview Regret Minimization and Correlated Equilibria Paolo Penna We have seen different type of equilibria and also considered the corresponding price

More information

THE OPTIMAL ASSET ALLOCATION PROBLEMFOR AN INVESTOR THROUGH UTILITY MAXIMIZATION

THE OPTIMAL ASSET ALLOCATION PROBLEMFOR AN INVESTOR THROUGH UTILITY MAXIMIZATION THE OPTIMAL ASSET ALLOCATION PROBLEMFOR AN INVESTOR THROUGH UTILITY MAXIMIZATION SILAS A. IHEDIOHA 1, BRIGHT O. OSU 2 1 Department of Mathematics, Plateau State University, Bokkos, P. M. B. 2012, Jos,

More information

16 MAKING SIMPLE DECISIONS

16 MAKING SIMPLE DECISIONS 247 16 MAKING SIMPLE DECISIONS Let us associate each state S with a numeric utility U(S), which expresses the desirability of the state A nondeterministic action A will have possible outcome states Result

More information

CAN CAPITAL INCOME TAX IMPROVE WELFARE IN AN INCOMPLETE MARKET ECONOMY WITH A LABOR-LEISURE DECISION?

CAN CAPITAL INCOME TAX IMPROVE WELFARE IN AN INCOMPLETE MARKET ECONOMY WITH A LABOR-LEISURE DECISION? CAN CAPITAL INCOME TAX IMPROVE WELFARE IN AN INCOMPLETE MARKET ECONOMY WITH A LABOR-LEISURE DECISION? Danijela Medak Fell, MSc * Expert article ** Universitat Autonoma de Barcelona UDC 336.2 JEL E62 Abstract

More information

Lecture 2. (1) Permanent Income Hypothesis. (2) Precautionary Savings. Erick Sager. September 21, 2015

Lecture 2. (1) Permanent Income Hypothesis. (2) Precautionary Savings. Erick Sager. September 21, 2015 Lecture 2 (1) Permanent Income Hypothesis (2) Precautionary Savings Erick Sager September 21, 2015 Econ 605: Adv. Topics in Macroeconomics Johns Hopkins University, Fall 2015 Erick Sager Lecture 2 (9/21/15)

More information

Intertemporal choice: Consumption and Savings

Intertemporal choice: Consumption and Savings Econ 20200 - Elements of Economics Analysis 3 (Honors Macroeconomics) Lecturer: Chanont (Big) Banternghansa TA: Jonathan J. Adams Spring 2013 Introduction Intertemporal choice: Consumption and Savings

More information

The Optimization Process: An example of portfolio optimization

The Optimization Process: An example of portfolio optimization ISyE 6669: Deterministic Optimization The Optimization Process: An example of portfolio optimization Shabbir Ahmed Fall 2002 1 Introduction Optimization can be roughly defined as a quantitative approach

More information

1 Dynamic programming

1 Dynamic programming 1 Dynamic programming A country has just discovered a natural resource which yields an income per period R measured in terms of traded goods. The cost of exploitation is negligible. The government wants

More information

Lecture 11: Bandits with Knapsacks

Lecture 11: Bandits with Knapsacks CMSC 858G: Bandits, Experts and Games 11/14/16 Lecture 11: Bandits with Knapsacks Instructor: Alex Slivkins Scribed by: Mahsa Derakhshan 1 Motivating Example: Dynamic Pricing The basic version of the dynamic

More information

Practice Problems 1: Moral Hazard

Practice Problems 1: Moral Hazard Practice Problems 1: Moral Hazard December 5, 2012 Question 1 (Comparative Performance Evaluation) Consider the same normal linear model as in Question 1 of Homework 1. This time the principal employs

More information

Optimal Unemployment Insurance in a Search Model with Variable Human Capital

Optimal Unemployment Insurance in a Search Model with Variable Human Capital Optimal Unemployment Insurance in a Search Model with Variable Human Capital Andreas Pollak February 2005 Abstract The framework of a general equilibrium heterogeneous agent model is used to study the

More information

Financial Frictions Under Asymmetric Information and Costly State Verification

Financial Frictions Under Asymmetric Information and Costly State Verification Financial Frictions Under Asymmetric Information and Costly State Verification General Idea Standard dsge model assumes borrowers and lenders are the same people..no conflict of interest. Financial friction

More information

Strategy -1- Strategy

Strategy -1- Strategy Strategy -- Strategy A Duopoly, Cournot equilibrium 2 B Mixed strategies: Rock, Scissors, Paper, Nash equilibrium 5 C Games with private information 8 D Additional exercises 24 25 pages Strategy -2- A

More information

STATE UNIVERSITY OF NEW YORK AT ALBANY Department of Economics. Ph. D. Comprehensive Examination: Macroeconomics Spring, 2016

STATE UNIVERSITY OF NEW YORK AT ALBANY Department of Economics. Ph. D. Comprehensive Examination: Macroeconomics Spring, 2016 STATE UNIVERSITY OF NEW YORK AT ALBANY Department of Economics Ph. D. Comprehensive Examination: Macroeconomics Spring, 2016 Section 1. Suggested Time: 45 Minutes) For 3 of the following 6 statements,

More information

On Existence of Equilibria. Bayesian Allocation-Mechanisms

On Existence of Equilibria. Bayesian Allocation-Mechanisms On Existence of Equilibria in Bayesian Allocation Mechanisms Northwestern University April 23, 2014 Bayesian Allocation Mechanisms In allocation mechanisms, agents choose messages. The messages determine

More information

Convex-Cardinality Problems

Convex-Cardinality Problems l 1 -norm Methods for Convex-Cardinality Problems problems involving cardinality the l 1 -norm heuristic convex relaxation and convex envelope interpretations examples recent results Prof. S. Boyd, EE364b,

More information

MFE Macroeconomics Week 8 Exercises

MFE Macroeconomics Week 8 Exercises MFE Macroeconomics Week 8 Exercises 1 Liquidity shocks over a unit interval A representative consumer in a Diamond-Dybvig model has wealth 1 at date 0. They will need liquidity to consume at a random time

More information

Macroeconomics and finance

Macroeconomics and finance Macroeconomics and finance 1 1. Temporary equilibrium and the price level [Lectures 11 and 12] 2. Overlapping generations and learning [Lectures 13 and 14] 2.1 The overlapping generations model 2.2 Expectations

More information

Macroeconomics I Chapter 3. Consumption

Macroeconomics I Chapter 3. Consumption Toulouse School of Economics Notes written by Ernesto Pasten (epasten@cict.fr) Slightly re-edited by Frank Portier (fportier@cict.fr) M-TSE. Macro I. 200-20. Chapter 3: Consumption Macroeconomics I Chapter

More information

Game Theory Fall 2003

Game Theory Fall 2003 Game Theory Fall 2003 Problem Set 5 [1] Consider an infinitely repeated game with a finite number of actions for each player and a common discount factor δ. Prove that if δ is close enough to zero then

More information

Discussion of Optimal Monetary Policy and Fiscal Policy Interaction in a Non-Ricardian Economy

Discussion of Optimal Monetary Policy and Fiscal Policy Interaction in a Non-Ricardian Economy Discussion of Optimal Monetary Policy and Fiscal Policy Interaction in a Non-Ricardian Economy Johannes Wieland University of California, San Diego and NBER 1. Introduction Markets are incomplete. In recent

More information

Chapter 15: Jump Processes and Incomplete Markets. 1 Jumps as One Explanation of Incomplete Markets

Chapter 15: Jump Processes and Incomplete Markets. 1 Jumps as One Explanation of Incomplete Markets Chapter 5: Jump Processes and Incomplete Markets Jumps as One Explanation of Incomplete Markets It is easy to argue that Brownian motion paths cannot model actual stock price movements properly in reality,

More information

STATE UNIVERSITY OF NEW YORK AT ALBANY Department of Economics. Ph. D. Preliminary Examination: Macroeconomics Fall, 2009

STATE UNIVERSITY OF NEW YORK AT ALBANY Department of Economics. Ph. D. Preliminary Examination: Macroeconomics Fall, 2009 STATE UNIVERSITY OF NEW YORK AT ALBANY Department of Economics Ph. D. Preliminary Examination: Macroeconomics Fall, 2009 Instructions: Read the questions carefully and make sure to show your work. You

More information

1 A tax on capital income in a neoclassical growth model

1 A tax on capital income in a neoclassical growth model 1 A tax on capital income in a neoclassical growth model We look at a standard neoclassical growth model. The representative consumer maximizes U = β t u(c t ) (1) t=0 where c t is consumption in period

More information

TDT4171 Artificial Intelligence Methods

TDT4171 Artificial Intelligence Methods TDT47 Artificial Intelligence Methods Lecture 7 Making Complex Decisions Norwegian University of Science and Technology Helge Langseth IT-VEST 0 helgel@idi.ntnu.no TDT47 Artificial Intelligence Methods

More information

The Pennsylvania State University. The Graduate School. Department of Industrial Engineering AMERICAN-ASIAN OPTION PRICING BASED ON MONTE CARLO

The Pennsylvania State University. The Graduate School. Department of Industrial Engineering AMERICAN-ASIAN OPTION PRICING BASED ON MONTE CARLO The Pennsylvania State University The Graduate School Department of Industrial Engineering AMERICAN-ASIAN OPTION PRICING BASED ON MONTE CARLO SIMULATION METHOD A Thesis in Industrial Engineering and Operations

More information

King s College London

King s College London King s College London University Of London This paper is part of an examination of the College counting towards the award of a degree. Examinations are governed by the College Regulations under the authority

More information

Self-organized criticality on the stock market

Self-organized criticality on the stock market Prague, January 5th, 2014. Some classical ecomomic theory In classical economic theory, the price of a commodity is determined by demand and supply. Let D(p) (resp. S(p)) be the total demand (resp. supply)

More information