Chapter 8. Repeated Games. Strategies and payoffs for games played twice

Similar documents
Game Theory. Wolfgang Frimmel. Repeated Games

Duopoly models Multistage games with observed actions Subgame perfect equilibrium Extensive form of a game Two-stage prisoner s dilemma

M.Phil. Game theory: Problem set II. These problems are designed for discussions in the classes of Week 8 of Michaelmas term. 1

G5212: Game Theory. Mark Dean. Spring 2017

Economics 209A Theory and Application of Non-Cooperative Games (Fall 2013) Repeated games OR 8 and 9, and FT 5

Economics 171: Final Exam

In reality; some cases of prisoner s dilemma end in cooperation. Game Theory Dr. F. Fatemi Page 219

Introduction to Industrial Organization Professor: Caixia Shen Fall 2014 Lecture Note 5 Games and Strategy (Ch. 4)

FDPE Microeconomics 3 Spring 2017 Pauli Murto TA: Tsz-Ning Wong (These solution hints are based on Julia Salmi s solution hints for Spring 2015.

Introduction to Game Theory Lecture Note 5: Repeated Games

ECE 586BH: Problem Set 5: Problems and Solutions Multistage games, including repeated games, with observed moves

1 Solutions to Homework 4

The Nash equilibrium of the stage game is (D, R), giving payoffs (0, 0). Consider the trigger strategies:

CHAPTER 14: REPEATED PRISONER S DILEMMA

Prisoner s dilemma with T = 1

CUR 412: Game Theory and its Applications Final Exam Ronaldo Carpio Jan. 13, 2015

Lecture 5 Leadership and Reputation

REPEATED GAMES. MICROECONOMICS Principles and Analysis Frank Cowell. Frank Cowell: Repeated Games. Almost essential Game Theory: Dynamic.

Early PD experiments

Repeated Games. September 3, Definitions: Discounting, Individual Rationality. Finitely Repeated Games. Infinitely Repeated Games

Repeated Games. EC202 Lectures IX & X. Francesco Nava. January London School of Economics. Nava (LSE) EC202 Lectures IX & X Jan / 16

Player 2 L R M H a,a 7,1 5,0 T 0,5 5,3 6,6

Infinitely Repeated Games

Stochastic Games and Bayesian Games

February 23, An Application in Industrial Organization

Lecture 6 Dynamic games with imperfect information

Repeated Games. Econ 400. University of Notre Dame. Econ 400 (ND) Repeated Games 1 / 48

Credibility and Subgame Perfect Equilibrium

MKTG 555: Marketing Models

Exercises Solutions: Oligopoly

Stochastic Games and Bayesian Games

Economics 431 Infinitely repeated games

Warm Up Finitely Repeated Games Infinitely Repeated Games Bayesian Games. Repeated Games

Noncooperative Market Games in Normal Form

Repeated games. Felix Munoz-Garcia. Strategy and Game Theory - Washington State University

ECON/MGEC 333 Game Theory And Strategy Problem Set 9 Solutions. Levent Koçkesen January 6, 2011

SI Game Theory, Fall 2008

Outline for Dynamic Games of Complete Information

Problem 3 Solutions. l 3 r, 1

Introductory Microeconomics

is the best response of firm 1 to the quantity chosen by firm 2. Firm 2 s problem: Max Π 2 = q 2 (a b(q 1 + q 2 )) cq 2

An introduction on game theory for wireless networking [1]

Repeated Games with Perfect Monitoring

Microeconomics of Banking: Lecture 5

Econ 323 Microeconomic Theory. Practice Exam 2 with Solutions

In the Name of God. Sharif University of Technology. Graduate School of Management and Economics

Introduction to Game Theory

13.1 Infinitely Repeated Cournot Oligopoly

Econ 323 Microeconomic Theory. Chapter 10, Question 1

Answer Key: Problem Set 4

1 Solutions to Homework 3

Not 0,4 2,1. i. Show there is a perfect Bayesian equilibrium where player A chooses to play, player A chooses L, and player B chooses L.

Game Theory. Important Instructions

Answers to Problem Set 4

Simon Fraser University Spring 2014

Dynamic Games. Econ 400. University of Notre Dame. Econ 400 (ND) Dynamic Games 1 / 18

SI 563 Homework 3 Oct 5, Determine the set of rationalizable strategies for each of the following games. a) X Y X Y Z

IPR Protection in the High-Tech Industries: A Model of Piracy. Thierry Rayna University of Bristol

Sequential-move games with Nature s moves.

GAME THEORY: DYNAMIC. MICROECONOMICS Principles and Analysis Frank Cowell. Frank Cowell: Dynamic Game Theory

Lecture 9: Basic Oligopoly Models

Noncooperative Oligopoly

Econ 101A Final exam May 14, 2013.

Game Theory: Additional Exercises

Mixed-Strategy Subgame-Perfect Equilibria in Repeated Games

Microeconomics III. Oligopoly prefacetogametheory (Mar 11, 2012) School of Economics The Interdisciplinary Center (IDC), Herzliya

Iterated Dominance and Nash Equilibrium

The Ohio State University Department of Economics Second Midterm Examination Answers

Math 152: Applicable Mathematics and Computing

Repeated Games. Debraj Ray, October 2006

CUR 412: Game Theory and its Applications, Lecture 9

MA300.2 Game Theory 2005, LSE

PRISONER S DILEMMA. Example from P-R p. 455; also 476-7, Price-setting (Bertrand) duopoly Demand functions

CMSC 474, Introduction to Game Theory 16. Behavioral vs. Mixed Strategies

m 11 m 12 Non-Zero Sum Games Matrix Form of Zero-Sum Games R&N Section 17.6

Simon Fraser University Fall Econ 302 D200 Final Exam Solution Instructor: Songzi Du Wednesday December 16, 2015, 8:30 11:30 AM

Name. Answers Discussion Final Exam, Econ 171, March, 2012

Notes for Section: Week 4

Economics 502 April 3, 2008

1 R. 2 l r 1 1 l2 r 2

A folk theorem for one-shot Bertrand games

Module 3: "Dynamic games of complete information" Lecture 23: "Bertrand Paradox in an Infinitely repeated game" The Lecture Contains:

Basic Game-Theoretic Concepts. Game in strategic form has following elements. Player set N. (Pure) strategy set for player i, S i.

ECON402: Practice Final Exam Solutions

EC 202. Lecture notes 14 Oligopoly I. George Symeonidis

6 Dynamic Games with Incomplete Information

CS 331: Artificial Intelligence Game Theory I. Prisoner s Dilemma

Econ 101A Final exam Mo 18 May, 2009.

The Ohio State University Department of Economics Econ 601 Prof. James Peck Extra Practice Problems Answers (for final)

Game Theory and Economics Prof. Dr. Debarshi Das Department of Humanities and Social Sciences Indian Institute of Technology, Guwahati.

Strategy -1- Strategy

ECO303: Intermediate Microeconomic Theory Benjamin Balak, Spring 2008

I. Introduction and definitions

UC Berkeley Haas School of Business Economic Analysis for Business Decisions (EWMBA 201A) Fall 2012

Answers to Microeconomics Prelim of August 24, In practice, firms often price their products by marking up a fixed percentage over (average)

Follow the Leader I has three pure strategy Nash equilibria of which only one is reasonable.

Introduction to Multi-Agent Programming

HE+ Economics Nash Equilibrium

Strategy: OPEC. OPEC (Members and their shares) Cartels, Reputation and Trust. Intermediate Microeconomics

Static Games and Cournot. Competition

Transcription:

Chapter 8 epeated Games 1 Strategies and payoffs for games played twice Finitely repeated games Discounted utility and normalized utility Complete plans of play for 2 2 games played twice Trigger strategies 2

L L L L A 2 2 game played twice L L L L First play of one-shot game L L Second play 3 Strategies for playing a 2 2 game twice Strategy ound 1 After After After After No. (L, L) (L, ) (, L) (, ) 1 L L L L L 2 L L L L 3 L L L L 4 L L L 17 L L L L 18 L L L 31 L 4

Zero-sum, 2-player games played more than once epetition adds nothing new to a zerosum game Zero-sum is no basis for a relationship 5 Variable sum games with a single equilibrium, played twice Selten s theorem on unique subgame perfect equilibria epetition by itself does not solve a credibility problem Finite repetition of Cournot market game 6

Prisoner s Dilemma, played twice 7 Prisoner s Dilemma, backward induction (second play): Pay-off matrix Player 1 Player 2 Do not Do not 3, 3 0, 4 8

Prisoner s Dilemma, backward induction (second play): Player 1 s strategy Player 1 Player 2 Do not Do not 3, 3 0, 4 9 Prisoner s Dilemma, backward induction (second play): Player 2 s strategy Player 1 Player 2 Do not Do not 3, 3 0, 4 10

Prisoner s Dilemma, second play, by backward induction Player 2 Player 1 Do not Do not 3, 3 0, 4 11 Prisoner s Dilemma, first play: Get (2,2) in second play regardless of first 12

Prisoner s Dilemma, played twice: Can t support better than (2,2) in first 13 Selten s Theorem If a game with a unique equilibrium is played finitely many times, its solution is that equilibrium played each and every time 14

OPEC Won t Curb Oil Until Others Do OPEC s quota system, 1973-1993 The attempt to improve upon a one-shot Cournot equilibrium Finiteness of a resource and finiteness of a game 15 OPEC quotas P ($/barrel) OPEC target price P + P* OPEC target Total Quotas Deviations Market Outcome Demand Q (barrels/day) 16

Variable sum games with multiple equilibria, played finitely many times Multiple one-shot equilibria mean multiple subgame perfect equilibria Equilibria involving rotation Equilibria involving trigger strategies The Folk Theorem for finitely repeated 2- player games 17 Market Niches, the one-shot game Firm 2 Firm 1 A B A 3, 3 1, 4 B 4, 1 0, 0 18

Market Niches, the one-shot game: Player 1 s strategy in pure strategy Firm 2 Firm 1 A B A 3, 3 1, 4 B 4, 1 0, 0 19 Market Niches, the one-shot game: Player 2 s strategy in pure strategy Firm 2 Firm 1 A B A 3, 3 1, 4 B 4, 1 0, 0 20

Market Niches, the one-shot game: Two pure strategy equilibria Firm 2 Firm 1 A B A 3, 3 1, 4 B 4, 1 0, 0 21 Market Niches, played two or three times, average utility possibilities u 2 (1, 4) (1.5, 3) (2.5, 2.5) (3, 3) (2.67, 2.67) () (3, 1.5) (4, 1) u 1 22

Folk Theorem for Finitely epeated Two-person Games Suppose that a finitely repeated game has a one-shot equilibrium payoff vector that payoff dominates w. Then all individually rational and feasible payoffs are supported in the limit as average payoffs of subgame perfect equilibria. 23 Folk Theorem: Market Niches played finitely many times u 2 (1, 4) (3, 3) (0, 0) I = w = (1, 1) (4, 1) u 1 24

Infinitely repeated games: strategies and payoffs The as if interpretation of infinite repetition Complete plans for infinite play Discounting infinite series of payoffs Normalizing discounted discounted payoffs 25 Evaluating payoffs for an infinitely repeated game Total payoff for player 1, u 1 = t u 1 (t) t goes from 0 to ; is the discount factor where < 1 When u 1 (t) = 1 for all t, u 1 = 1 + + 2 + 3 + For 0 < < 1, the series sums to u 1 = 1/(1 - ) = 1 + + 2 + 3 + When u 1 (t) = k for all t, u 1 = k/(1 - ) We can multiply the infinite sum of utilities by (1 - ) to keep this payoff on the same-scale as those of the oneshot game t 26

Folk Theorem for Infinitely epeated Games Suppose that an infinitely repeated game has a payoff vector that exceeds w i for each player i. Then all individually rational and feasible payoffs that payoff dominate w are supported as payoffs of subgame perfect equilibria, as long as discount factors are sufficiently close to 1. In particular, efficient payoff vectors are supported as payoffs of subgame perfect equilibria when discount factors are sufficiently close to 1. 27 obert Axelrod s Tournament Experiment to compare strategies Tit-for-tat strategy World War I use of poisonous gas 28

Infinitely repeated market games A one-shot Cournot equilibrium, repeated infinitely often, is a subgame perfect equilibrium path Better paying equilibria than one-shot Cournot Monopoly-like equilibria when firms attach enough importance to the future A Folk Theorem for infinitely repeated games Infinitely repeated Bertrand market games 29 Two-firm market game, played in infinite number of periods Each period the market demand both firm 1 and 2 face is: P = 130 - Q and constant marginal cost, c = $10 The Cournot Equilibrium is x 1 * = x 2 * = 40 and each firm s profit = $1600 Suppose both firms play Cournot strategy infinitely often: every play: ship 40 units after every possible history The infinite sum of payoffs, normalized, to each firm is (1 - ) 1600/ (1 - ) = $1600 30

Two-firm market game, played in infinite number of periods Now, suppose firm 1 decides to charge $51 for each unit and as a result they sell only 39 units each period In each period t, u 1 (t) = (51-10) 39 = $1599 If firm 1 were to do this forever, it would get, u 1 = $1599 This u 1 is $1 lower than at the Cournot equilibrium educing output does not increase profit Similarly, raising output does not increase profit either 31 Folk theorem: Infinitely repeated Cournot market game u 2 (0, 3600) A 2 =(1600, 2000) (1800, 1800) C = w = (1600, 1600) A 1 =(2000, 1600) I = (0, 0) (3600, 0) u 1 32

Payoff possibilities, infinitely repeated Bertrand market game u 2 (0, 3600) (1800, 1800) u 1 + u 2 = 1600 I = w = (0, 0) = B (3600, 0) u 1 33 Price leadership in the ready-to-eat cereals industry The serious problem of equilibrium selection Using price leadership as an equilibrium selection device Kellogg s as a price leader High rates of return in ready-to-eat cereals 34

Price Leadership Under price leadership, one firm, the price leader, takes charge of the industry pricing policy. Every time a change in prices is called for by a change in economic fundamentals, the price leader makes the change. The members of the industry depends on the price leader to make the correct price changes, so that industry profits are as high as they can be. 35