The Limits of Reciprocal Altruism

Similar documents
Introduction to Game Theory Lecture Note 5: Repeated Games

Repeated Games. September 3, Definitions: Discounting, Individual Rationality. Finitely Repeated Games. Infinitely Repeated Games

Repeated Games. EC202 Lectures IX & X. Francesco Nava. January London School of Economics. Nava (LSE) EC202 Lectures IX & X Jan / 16

CHAPTER 14: REPEATED PRISONER S DILEMMA

G5212: Game Theory. Mark Dean. Spring 2017

Repeated Games with Perfect Monitoring

Duopoly models Multistage games with observed actions Subgame perfect equilibrium Extensive form of a game Two-stage prisoner s dilemma

SI Game Theory, Fall 2008

Economics 209A Theory and Application of Non-Cooperative Games (Fall 2013) Repeated games OR 8 and 9, and FT 5

FDPE Microeconomics 3 Spring 2017 Pauli Murto TA: Tsz-Ning Wong (These solution hints are based on Julia Salmi s solution hints for Spring 2015.

Game Theory. Wolfgang Frimmel. Repeated Games

Prisoner s dilemma with T = 1

Warm Up Finitely Repeated Games Infinitely Repeated Games Bayesian Games. Repeated Games

ECE 586BH: Problem Set 5: Problems and Solutions Multistage games, including repeated games, with observed moves

Stochastic Games and Bayesian Games

Credible Threats, Reputation and Private Monitoring.

The folk theorem revisited

Information Aggregation in Dynamic Markets with Strategic Traders. Michael Ostrovsky

Microeconomic Theory II Preliminary Examination Solutions

Competing Mechanisms with Limited Commitment

Advanced Microeconomics

Repeated Games. Econ 400. University of Notre Dame. Econ 400 (ND) Repeated Games 1 / 48

IPR Protection in the High-Tech Industries: A Model of Piracy. Thierry Rayna University of Bristol

Stochastic Games and Bayesian Games

Outline for Dynamic Games of Complete Information

Chapter 8. Repeated Games. Strategies and payoffs for games played twice

CS 331: Artificial Intelligence Game Theory I. Prisoner s Dilemma

Game Theory. Lecture Notes By Y. Narahari. Department of Computer Science and Automation Indian Institute of Science Bangalore, India October 2012

General Examination in Microeconomic Theory SPRING 2014

February 23, An Application in Industrial Organization

Topics in Contract Theory Lecture 3

Introduction to Industrial Organization Professor: Caixia Shen Fall 2014 Lecture Note 5 Games and Strategy (Ch. 4)

Infinitely Repeated Games

Microeconomics II. CIDE, MsC Economics. List of Problems

Game theory and applications: Lecture 1

Epistemic Game Theory

FDPE Microeconomics 3 Spring 2017 Pauli Murto TA: Tsz-Ning Wong (These solution hints are based on Julia Salmi s solution hints for Spring 2015.

Beliefs and Sequential Rationality

Topics in Contract Theory Lecture 5. Property Rights Theory. The key question we are staring from is: What are ownership/property rights?

Game Theory for Wireless Engineers Chapter 3, 4

6.254 : Game Theory with Engineering Applications Lecture 3: Strategic Form Games - Solution Concepts

Answers to June 11, 2012 Microeconomics Prelim

Problem 3 Solutions. l 3 r, 1

Auctions That Implement Efficient Investments

Rationalizable Strategies

6 Dynamic Games with Incomplete Information

Uncertainty in Equilibrium

Supplement to the lecture on the Diamond-Dybvig model

Game Theory Fall 2003

Outline Introduction Game Representations Reductions Solution Concepts. Game Theory. Enrico Franchi. May 19, 2010

INTERIM CORRELATED RATIONALIZABILITY IN INFINITE GAMES

Early PD experiments

Discounted Stochastic Games with Voluntary Transfers

d. Find a competitive equilibrium for this economy. Is the allocation Pareto efficient? Are there any other competitive equilibrium allocations?

Practice Problems 1: Moral Hazard

Renegotiation in Repeated Games with Side-Payments 1

Mixed-Strategy Subgame-Perfect Equilibria in Repeated Games

A Baseline Model: Diamond and Dybvig (1983)

Finite Memory and Imperfect Monitoring

1 Solutions to Homework 4

Player 2 L R M H a,a 7,1 5,0 T 0,5 5,3 6,6

Cooperation and Rent Extraction in Repeated Interaction

Strategies and Nash Equilibrium. A Whirlwind Tour of Game Theory

Lecture 3 Representation of Games

Evolution & Learning in Games

Finite Memory and Imperfect Monitoring

The Nash equilibrium of the stage game is (D, R), giving payoffs (0, 0). Consider the trigger strategies:

Not 0,4 2,1. i. Show there is a perfect Bayesian equilibrium where player A chooses to play, player A chooses L, and player B chooses L.

Online Appendix for Debt Contracts with Partial Commitment by Natalia Kovrijnykh

Game Theory. Important Instructions

Maintaining a Reputation Against a Patient Opponent 1

Microeconomic Theory May 2013 Applied Economics. Ph.D. PRELIMINARY EXAMINATION MICROECONOMIC THEORY. Applied Economics Graduate Program.

Dynamic Decisions with Short-term Memories

Corporate Control. Itay Goldstein. Wharton School, University of Pennsylvania

Extensive-Form Games with Imperfect Information

Introduction to game theory LECTURE 2

An Ascending Double Auction

REPEATED GAMES. MICROECONOMICS Principles and Analysis Frank Cowell. Frank Cowell: Repeated Games. Almost essential Game Theory: Dynamic.

When does strategic information disclosure lead to perfect consumer information?

Answer Key: Problem Set 4

Behavioral Competitive Equilibrium and Extreme Prices. Faruk Gul Wolfgang Pesendorfer Tomasz Strzalecki

Capital markets liberalization and global imbalances

Problem Set 3. Thomas Philippon. April 19, Human Wealth, Financial Wealth and Consumption

On Existence of Equilibria. Bayesian Allocation-Mechanisms

On the Optimality of Financial Repression

Introductory Microeconomics

Reference-Dependent Preferences with Expectations as the Reference Point

Ph.D. Preliminary Examination MICROECONOMIC THEORY Applied Economics Graduate Program June 2017

CUR 412: Game Theory and its Applications, Lecture 12

A Model with Costly Enforcement

Answers to Microeconomics Prelim of August 24, In practice, firms often price their products by marking up a fixed percentage over (average)

Motivation: Two Basic Facts

Public Goods Provision with Rent-Extracting Administrators

REPUTATION WITH LONG RUN PLAYERS

High Frequency Repeated Games with Costly Monitoring

1 Dynamic programming

Sequential-move games with Nature s moves.

Directed Search and the Futility of Cheap Talk

Eliciting Informative Feedback: The Peer-Prediction Method

A brief introduction to evolutionary game theory

Transcription:

The Limits of Reciprocal Altruism Larry Blume & Klaus Ritzberger Cornell University & IHS & The Santa Fe Institute

Introduction Why bats? Gerald Wilkinson, Reciprocal food sharing in the vampire bat. Nature 308, 1984: 181 184., Food sharing in vampire bats. Scientific American 262, 1990: 76-82. Sustaining cooperation? David Kreps, Paul Milgrom, John Roberts and Robert Wilson, Rational cooperation in the finitely repeated prisoners dilemma. JET 27, 1982. Robert Axelrod, The Evolution of Cooperation, 1984. Elinor Ostrom, Governing the Commons: The Evolution of Institutions for Collective Action, 1990.

Social Norms What Are Social Norms? Norms are socially shared prescriptions for behavior. They emerge from behavioral regularity. What Sustains Social Norms? Social Expectation Lessig 1995, Acemoglu and Jackson 2013 Regulation of Payoffs Institutions Reciprocal altruism.

Limits to Reciprocal Altruism The survival of reciprocal altruism in repeated games is a consequence of the folk theorem, that if the future is sufficiently immediate, the potential for manipulating future outcomes can discipline current choices. BUT Experimenting is costly. The short-term costs of learning to cooperate can destroy the long-term stability of cooperation. The benefits to cooperation cannot always be reciprocated. Folk theorems require that the only way the present affects the future is through what individuals believe about the future. Is reciprocal altruism sustainable when the present physically constrains the future? Suppose there are state variables other than beliefs.

Model States Two individuals each eat 1 per day Each individual draws a random endowment once a day. The endowment is 2 with pr p, and 0 otherwise. Individuals maintain an inventory. A individual may share 1 with the other individual. A individual dies when she fails to eat. The inventory space is I, which describes each individual s current inventory. b i = 1 is death, an absorbing state.

Model Payoffs Let Ω denote the sample space on which the processes are built: ω t = (ω 1t, ω 2t ) where each ω it describes the outcome of i s date-t endowment draw, success or failure. From each strategy profile (σ 1, σ 2 ) and the initial inventory b = (b 10, b 20 ) compute τ i b (ω) = inf{t : b it = 1}, the time at which i dies. Individual i s payoff function is u i (σ 1, σ 2 ) = τ i b (ω) t=0 δ t.

Dynamics I Irreversible Accumulation An action for individual i is a choice to share S or withhold W 1 unit from individual j. A = {S, W}. A state q Q of the game is a quadruple q = (b 1, b 2, ω 1, ω 2 ) where (b 1, b 2 ) I are the individual s inventory levels, and ω i is describes the outcome of individual i s endowment draw. State q t describes the date-t physical situation after endowments are realized. Taking s = S = 1 and f = W = 0, the dynamics are b 1t b 1t, ω 1t b 2t b 2t, ω 2t b 1t + ω 1t a 1t + a 2t 1 b 2t + ω 2t a 2t + a 1t 1 b t q t b t+1

Strategies A norm is a map n : I A. N denotes the set of norms. A partial history is a structure (q 0, a 10, a 20,..., q t, a 1t, a 2t ). Let H denote the set of partial histories. h t H is the sequence of states and actions through date t. A strategy for individual i is a map σ : H N where σ(h t 1 ) is the norm employed at date t.

Some Norms Autarchy. Each individual contributes to and withdraws from her own inventory. No sharing takes place. Simple Sharing. A successful individual shares with an unsuccessful individual. Wealth-Based Sharing. A successful individual shares with the other individual iff she is wealthier. Full Sharing. Split 50-50.

Questions The possibilities for cooperation: Is sharing over some or all of the state space optimal? Yes, on all of I. For large δ, are there equilibria which support sharing on some or all of the state space? Depends on p, and only for some part of I. For large δ, are there equilibria which achieve the welfare optima? No.

Folk Theorems These questions are normally answered by folk theorems. Requirements for the folk theorem: The set of feasible long-run average payoffs is state-independent. The long-run average min-max payoffs are state-independent. The dimension of the set of long-run average feasible payoffs is 2. In our game. For p < 1/2 the only feasible long-run average payoff is 0. For p > 1/2, the maximal long-run average payoff is state-dependent. Prajit Dutta, A folk theorem for stochastic games JET 66, 1995.

Value Functions Strategies determine a stochastic process on I. τ i b is the first time the process hits 1. The value of being at b I is τ i b (ω) V i (b) = E δ t lim V i (b) = δ 1 t=0 = 1 δ E { δ τi b (ω)} 1 δ 1 + { E τ i b (ω)} { if pr τ i (ω) b < } = 1, otherwise The average discounted value at b I is ADV i (b) = 1 δ E { δ τi b (ω)}, lim ADV i (b) = { pr τ i b (ω) = }. δ 1

Results Optimal Norms The welfare-optimal norm is full sharing. The welfare-optimal norm for sharing out of new endowment is wealth-based sharing.

Results Achieving Optima We look for SPE with a grim trigger. A successful individual may defect from sharing and revert to autarchy but with one more unit. The social optima are never equilibria. In both games there is no δ < 1 such that a sharing norm is supported at (0, 0). In the flow game, there is no δ < 1 such that sharing is supported when either individual has stock 0. Autarky is always an equilibrium. Autarky is the only equilibrium for p < 1/2.

Results Sharing Norms For any p > 1/2 there is a δ sufficiently large, simple sharing at every interior state is an equilibrium. For any p > 1/2 and for all sufficiently large δ there is an M such that wealth-based sharing at all states such that max{b 1, b 2 } min{b 1, b 2 } + 2M and autarky otherwise is an equilibrium. For any p > 1/2 there is no δ < 1 such that wealth-based sharing is an equilibrium at all interior states. For any p > 1/2 and for all sufficiently large δ ex ante full sharing is optimal everywhere except at (0, 0).