Introduction to Game Theory

Size: px
Start display at page:

Download "Introduction to Game Theory"

Transcription

1 Introduction to Game Theory 3a. More on Normal-Form Games Dana Nau University of Maryland Nau: Game Theory 1

2 More Solution Concepts Last time, we talked about several solution concepts Pareto optimality Nash equilibrium Maximin and Minimax Dominance Rationalizability We ll continue with several more Trembling-hand perfect equilibrium ε-nash equilibrium Rationalizability Evolutionarily stable strategies Nau: Game Theory 2

3 Trembling-Hand Perfect Equilibrium A solution concept that s stricter than Nash equilibrium Trembling hand : Requires that the equilibrium be robust against slight errors or trembles by the agents I.e., small perturbations of their strategies Recall: A fully mixed strategy assigns every action a non-0 probability Let S = (s 1,, s n ) be a mixed strategy profile for a game G S is a (trembling hand) perfect equilibrium if there is a sequence of fully mixed-strategy profiles S 0, S 1,, that has the following properties: lim k Sk = S for each S k = (s 1k,, s ik,, s nk ), every strategy s i k is a best response to the strategies S i k The details are complicated, and I won t discuss them Nau: Game Theory 3

4 ε-nash Equilibrium Another solution concept Reflects the idea that agents might not change strategies if the gain would be very small Let ε > 0. A strategy profile S = (s 1,..., s n ) is an ε-nash equilibrium if, for every agent i and for all strategies s iʹ s i, u i (s i, S i ) u i (s iʹ, S i ) ε ε-nash equilibria always exist Every Nash equilibrium is surrounded by a region of ε-nash equilibria for any ε > 0 This concept can be computationally useful Algorithms to identify ε-nash equilibria need consider only a finite set of mixed-strategy profiles (not the whole continuous space) Because of finite precision, computers generally find only ε-nash equilibria, where ε is roughly the machine precision Nau: Game Theory 4

5 Problems with ε-nash Equilibrium For every Nash equilibrium, there are ε-nash equilibria that approximate it, but the converse isn t true There are ε-nash equilibria that aren t close to any Nash equilibrium Example: the game at right has just one Nash equilibrium: (D, R) We can use strategy elimination to get it: D dominates U for agent 1 On removing U, R dominates L for agent 2 (D, R) is also an ε-nash equilibrium But there s another ε-nash equilibrium: (U, L) In this equilibrium, neither agent s payoff is within ε of the agent s payoff in a Nash equilibrium Problem: In the ε-nash equilibrium (U, L), agent 1 can t gain more than ε by deviating But if agent 1 deviates, agent 2 can gain more than ε by best-responding to agent 1 s deviation Nau: Game Theory 5

6 Problems with ε-nash Equilibrium Some ε-nash equilibria are very unlikely to arise Agent 1 might not care about a gain of ε/2, but might reason as follows: Agent 2 may expect agent 1 to to play D since it dominates U So agent 2 is likely to play R If agent 2 plays R, agent 1 does much better by playing D rather than U In general, ε-approximation is much messier in games than in optimization problems Nau: Game Theory 6

7 Rationalizability A strategy is rationalizable if a perfectly rational agent could justifiably play it against perfectly rational opponents The formal definition is complicated Informally, a strategy for agent i is rationalizable if it s a best response to some beliefs that agent i could have about the strategies that the other agents will take But agent i s beliefs must take into account i s knowledge of the rationality of the others. This incorporates the other agents knowledge of i s rationality, their knowledge of i s knowledge of their rationality, and so on ad infinitum A rationalizable strategy profile is a strategy profile that consists only of rationalizable strategies Nau: Game Theory 7

8 Example Matching Pennies Agent 1 s pure strategy Heads is rationalizable Let s look at the chain of beliefs Heads Tails Heads Tails 1, 1 1, 1 1, 1 1, 1 For agent 1, Heads is a best response to agent 2 s pure strategy Heads, and believing that 2 would also play Heads is consistent with 2 s rationality, for the following reasons 2 could believe that 1 would play Tails, to which 2 s best response is Heads; and it would be rational for 2 to believe that 1 would play Tails, for the following reasons: 2 could believe that 1 believed that 2 would play Tails, to which Tails is a best response; Nau: Game Theory 8

9 Strategies that aren t rationalizable Prisoner s Dilemma Strategy C isn t rationalizable for agent 1 It isn t a best response to any of agent 2 s strategies The 3x3 game we used earlier M is not a rationalizable strategy for agent 1 It is a best response to one of agent 2 s strategies, namely R But there s no belief that agent 2 could have about agent 1 s strategy for which R would be a best response 3, 3 0, 5 5, 0 1, 1 Nau: Game Theory 9

10 Comments The formal definition of rationalizability is complicated because of the infinite regress But we can say some intuitive things about rationalizable strategies Nash equilibrium strategies are always rationalizable So the set of rationalizable strategies (and strategy profiles) is always nonempty In two-player games, rationalizable strategies are simply those that survive the iterated elimination of strictly dominated strategies In n-agent games, this isn t so Rather, rationalizable strategies are those that survive iterative removal of strategies that are never a best response to any strategy profile by the other agents Example: the p-beauty contest Nau: Game Theory 10

11 The p-beauty Contest At the start of my first class, I asked you to do the following: Choose a number in the range from 0 to 100 Write it on a piece of paper, along with your name In a few minutes, I ll ask you to pass your papers to the front of the room After class, I ll compute the average of all of the numbers The winner(s) will be whoever chose a number that s closest to 2/3 of the average I ll announce the results in a subsequent class This game is famous among economists and game theorists It s called the p-beauty contest I used p = 2/3 Nau: Game Theory 11

12 Recall that in n-player games, The p-beauty Contest Rationalizable strategies are those that survive iterative removal of strategies that are never a best response to any strategy profile by the other agents In the p-beauty contest, consider the strategy profile in which everyone else chooses 100 Every number in the interval [0,100) is a best response Thus every number in the interval [0,100) is rationalizable Nau: Game Theory 12

13 Nash Equilibrium for the p-beauty Contest Iteratively eliminate dominated strategies All numbers 100 => 2/3(average) < 67 => any strategy that includes numbers 67 isn t a best response to any strategy profile, so eliminate it The remaining strategies only include numbers < 67 => for every rationalizable strategy profile, 2/3(average) < 45 => any strategy that includes numbers 45 isn t a best response to any strategy profile, so eliminate it Rationalizable strategies only include numbers < 45 => for every rationalizable strategy profile, 2/3(average) < The only strategy profile that survives elimination of dominated strategies: Everybody chooses 0 Therefore this is the unique Nash equilibrium Nau: Game Theory 13

14 p-beauty Contest Results (2/3)(average) = 21 winner = Giovanni Nau: Game Theory 14

15 Another Example of p-beauty Contest Results Average = /3 of the average = Winner: anonymous xx Nau: Game Theory 15

16 We aren t rational Most of you didn t play Nash equilibrium strategies We aren t game-theoretically rational agents Huge literature on behavioral economics going back to about 1979 Many cases where humans (or aggregations of humans) tend to make different decisions than the game-theoretically optimal ones Daniel Kahneman received the 2002 Nobel Prize in Economics for his work on that topic Nau: Game Theory 16

17 Choosing Irrational Strategies Why choose a non-equilibrium strategy? Limitations in reasoning ability Didn t calculate the Nash equilibrium correctly Don t know how to calculate it Don t even know the concept Hidden payoffs Other things may be more important than winning Want to be helpful Want to see what happens Want to create mischief Agent modeling (next slide) Nau: Game Theory 17

18 Agent Modeling A Nash equilibrium strategy is best for you if the other agents also use their Nash equilibrium strategies In many cases, the other agents won t use Nash equilibrium strategies If you can forecast their actions accurately, you may be able to do much better than the Nash equilibrium strategy I ll say more about this in Session 9 Incomplete-information games Nau: Game Theory 18

19 Evolutionarily Stable Strategies An evolutionarily stable strategy (ESS) is a mixed strategy that s resistant to invasion by new strategies This concept comes from evolutionary biology Consider how various species relative fitness causes their proportions of the population to grow or shrink For us, an organism s fitness = its expected payoff from interacting with a random member of the population An organism s strategy = anything that might affect its fitness size, aggressiveness, sensory abilities, intelligence, Suppose a small population of invaders playing a different strategy is added to a population The original strategy is an ESS if it gets a higher payoff against the mixture of the new and old strategies than the invaders do Nau: Game Theory 19

20 Evolutionary Stability Let G be a symmetric 2-player game Recall that the matrix shows u(r,r') = payoff for r against r' A strategy r' invades a strategy r at level x if fraction x of the population uses r' and fraction (1 x) of the population uses r fitness(r) = expected payoff for r against a random member of the population = (1 x)a + xb Similarly, fitness(r') = (1 x)c + xd r is evolutionarily stable against r' if there is an ε > 0 such that for every x < ε, fitness(r) > fitness(r') i.e., (1 x)a + xb > (1 x)c + xd As x 0, (1 x)a + xb a and (1 x)c + xd c For sufficiently small x, the inequality holds if either a > c, or a = c and b > d Thus r is evolutionarily stable against r' iff one of the following holds: a > c a = c and b > d r r' r a c r' b d Nau: Game Theory 20

21 More generally Evolutionary Stability We ll use a mixed strategy s to represent a population that is composed of several different species We ll talk about s s evolutionary stability against all other mixed strategies s is evolutionarily stable iff for every mixed strategy s' s, one of the following holds: u(s,s) > u(s',s) u(s,s) = u(s',s) and u(s,s') > u(s',s') s is weakly evolutionarily stable iff for every mixed strategy sʹ s, one of the following holds: u(s,s) > u(s',s) u(s,s) = u(s',s) and u(s,s') > u(s',s') Includes cases where the original strategy and invading strategy have the same fitness, so the population with the invading strategy neither grows nor shrinks r r' r a c r' b d Nau: Game Theory 21

22 Example The Hawk-Dove game 2 animals contend for a piece of food The animals are chosen at random from the entire population Each animal may be either a hawk (H) or a dove (D) The prize is worth 6 to each Fighting costs each 5 When a hawk meets a dove, the hawk gets the prize without a fight: payoffs 6, 0 When 2 doves meet, they split the prize without a fight: payoff 3, 3 When 2 hawks meet, they fight ( 5 for each), each with a 50% chance of getting the prize ((0.5)(6) = 3): payoffs 2, 2 It s easy to show that this game has a unique Nash equilibrium (s, s), where s = (3/5, 2/5) i.e., 60% hawks, 40% doves Nau: Game Theory 22

23 Example To confirm that s is also an ESS, show that, for all sʹ s, u 1 (s, sʹ ) = u 1 (sʹ, s) and u 1 (s, sʹ ) > u 1 (sʹ, sʹ ) u 1 (s,sʹ ) = u 1 (sʹ,s) is true of any mixed strategy equilibrium with full support To show u 1 (s,sʹ ) > u 1 (sʹ,sʹ ), find the sʹ that minimizes f (sʹ ) = u 1 (s,sʹ ) u 1 (sʹ,sʹ ) s = play H with probability 3/5, D with probability 2/5 sʹ = play H with probability p, D with probability 1 p u 1 (s,s') = (3/5)[ 2p + 6(1 p)] + (2/5)[0p + 3(1 p)] u 1 (s',s') = p[ 2p + 6(1 p)] + (1 p)[0p + 3(1 p)] so f (sʹ ) = u 1 (s,sʹ ) u 1 (sʹ,sʹ ) is quadratic in p Set d f(s')/d p = 0, solve for p => p = 3/5 So the unique minimum occurs when sʹ = s Nau: Game Theory 23

24 Evolutionary Stability and Nash Equilibria Theorem. Let G be a symmetric 2-player game, and s be a mixed strategy. If s is an evolutionarily stable strategy, then (s, s) is a Nash equilibrium of G. Proof. By definition, an ESS s must satisfy u(s,s) u(sʹ,s), i.e., s is a best response to itself, so it must be a Nash equilibrium. Theorem. Let G be a symmetric 2-player game, and s be a mixed strategy. If (s,s) is a strict Nash equilibrium of G, then s is an evolutionarily stable strategy. Proof. If (s,s) is a strict Nash equilibrium, then u(s,s) > u(sʹ,s). This satisfies the first of the two alternative criteria of an ESS Nau: Game Theory 24

25 Summary We ve discussed several more solution concepts trembling-hand perfect equilibria epsilon-nash equilibria rationalizability the p-beauty Contest evolutionarily stable strategies Hawk-Dove game Nau: Game Theory 25

Introduction to Multi-Agent Programming

Introduction to Multi-Agent Programming Introduction to Multi-Agent Programming 10. Game Theory Strategic Reasoning and Acting Alexander Kleiner and Bernhard Nebel Strategic Game A strategic game G consists of a finite set N (the set of players)

More information

6.254 : Game Theory with Engineering Applications Lecture 3: Strategic Form Games - Solution Concepts

6.254 : Game Theory with Engineering Applications Lecture 3: Strategic Form Games - Solution Concepts 6.254 : Game Theory with Engineering Applications Lecture 3: Strategic Form Games - Solution Concepts Asu Ozdaglar MIT February 9, 2010 1 Introduction Outline Review Examples of Pure Strategy Nash Equilibria

More information

G5212: Game Theory. Mark Dean. Spring 2017

G5212: Game Theory. Mark Dean. Spring 2017 G5212: Game Theory Mark Dean Spring 2017 More on Nash Equilibrium So now we know That (almost) all games have a Nash Equilibrium in mixed strategies How to find these equilibria by calculating best responses

More information

Iterated Dominance and Nash Equilibrium

Iterated Dominance and Nash Equilibrium Chapter 11 Iterated Dominance and Nash Equilibrium In the previous chapter we examined simultaneous move games in which each player had a dominant strategy; the Prisoner s Dilemma game was one example.

More information

January 26,

January 26, January 26, 2015 Exercise 9 7.c.1, 7.d.1, 7.d.2, 8.b.1, 8.b.2, 8.b.3, 8.b.4,8.b.5, 8.d.1, 8.d.2 Example 10 There are two divisions of a firm (1 and 2) that would benefit from a research project conducted

More information

CMSC 474, Introduction to Game Theory 16. Behavioral vs. Mixed Strategies

CMSC 474, Introduction to Game Theory 16. Behavioral vs. Mixed Strategies CMSC 474, Introduction to Game Theory 16. Behavioral vs. Mixed Strategies Mohammad T. Hajiaghayi University of Maryland Behavioral Strategies In imperfect-information extensive-form games, we can define

More information

Rationalizable Strategies

Rationalizable Strategies Rationalizable Strategies Carlos Hurtado Department of Economics University of Illinois at Urbana-Champaign hrtdmrt2@illinois.edu Jun 1st, 2015 C. Hurtado (UIUC - Economics) Game Theory On the Agenda 1

More information

CS711 Game Theory and Mechanism Design

CS711 Game Theory and Mechanism Design CS711 Game Theory and Mechanism Design Problem Set 1 August 13, 2018 Que 1. [Easy] William and Henry are participants in a televised game show, seated in separate booths with no possibility of communicating

More information

Game Theory. VK Room: M1.30 Last updated: October 22, 2012.

Game Theory. VK Room: M1.30  Last updated: October 22, 2012. Game Theory VK Room: M1.30 knightva@cf.ac.uk www.vincent-knight.com Last updated: October 22, 2012. 1 / 33 Overview Normal Form Games Pure Nash Equilibrium Mixed Nash Equilibrium 2 / 33 Normal Form Games

More information

10.1 Elimination of strictly dominated strategies

10.1 Elimination of strictly dominated strategies Chapter 10 Elimination by Mixed Strategies The notions of dominance apply in particular to mixed extensions of finite strategic games. But we can also consider dominance of a pure strategy by a mixed strategy.

More information

CMPSCI 240: Reasoning about Uncertainty

CMPSCI 240: Reasoning about Uncertainty CMPSCI 240: Reasoning about Uncertainty Lecture 23: More Game Theory Andrew McGregor University of Massachusetts Last Compiled: April 20, 2017 Outline 1 Game Theory 2 Non Zero-Sum Games and Nash Equilibrium

More information

CS 331: Artificial Intelligence Game Theory I. Prisoner s Dilemma

CS 331: Artificial Intelligence Game Theory I. Prisoner s Dilemma CS 331: Artificial Intelligence Game Theory I 1 Prisoner s Dilemma You and your partner have both been caught red handed near the scene of a burglary. Both of you have been brought to the police station,

More information

CS 7180: Behavioral Modeling and Decision- making in AI

CS 7180: Behavioral Modeling and Decision- making in AI CS 7180: Behavioral Modeling and Decision- making in AI Algorithmic Game Theory Prof. Amy Sliva November 30, 2012 Prisoner s dilemma Two criminals are arrested, and each offered the same deal: If you defect

More information

Now we return to simultaneous-move games. We resolve the issue of non-existence of Nash equilibrium. in pure strategies through intentional mixing.

Now we return to simultaneous-move games. We resolve the issue of non-existence of Nash equilibrium. in pure strategies through intentional mixing. Econ 221 Fall, 2018 Li, Hao UBC CHAPTER 7. SIMULTANEOUS-MOVE GAMES: MIXED STRATEGIES Now we return to simultaneous-move games. We resolve the issue of non-existence of Nash equilibrium in pure strategies

More information

Introductory Microeconomics

Introductory Microeconomics Prof. Wolfram Elsner Faculty of Business Studies and Economics iino Institute of Institutional and Innovation Economics Introductory Microeconomics More Formal Concepts of Game Theory and Evolutionary

More information

IV. Cooperation & Competition

IV. Cooperation & Competition IV. Cooperation & Competition Game Theory and the Iterated Prisoner s Dilemma 10/15/03 1 The Rudiments of Game Theory 10/15/03 2 Leibniz on Game Theory Games combining chance and skill give the best representation

More information

Week 8: Basic concepts in game theory

Week 8: Basic concepts in game theory Week 8: Basic concepts in game theory Part 1: Examples of games We introduce here the basic objects involved in game theory. To specify a game ones gives The players. The set of all possible strategies

More information

Stochastic Games and Bayesian Games

Stochastic Games and Bayesian Games Stochastic Games and Bayesian Games CPSC 532L Lecture 10 Stochastic Games and Bayesian Games CPSC 532L Lecture 10, Slide 1 Lecture Overview 1 Recap 2 Stochastic Games 3 Bayesian Games Stochastic Games

More information

Best-Reply Sets. Jonathan Weinstein Washington University in St. Louis. This version: May 2015

Best-Reply Sets. Jonathan Weinstein Washington University in St. Louis. This version: May 2015 Best-Reply Sets Jonathan Weinstein Washington University in St. Louis This version: May 2015 Introduction The best-reply correspondence of a game the mapping from beliefs over one s opponents actions to

More information

Game Theory. Analyzing Games: From Optimality to Equilibrium. Manar Mohaisen Department of EEC Engineering

Game Theory. Analyzing Games: From Optimality to Equilibrium. Manar Mohaisen Department of EEC Engineering Game Theory Analyzing Games: From Optimality to Equilibrium Manar Mohaisen Department of EEC Engineering Korea University of Technology and Education (KUT) Content Optimality Best Response Domination Nash

More information

UC Berkeley Haas School of Business Game Theory (EMBA 296 & EWMBA 211) Summer 2016

UC Berkeley Haas School of Business Game Theory (EMBA 296 & EWMBA 211) Summer 2016 UC Berkeley Haas School of Business Game Theory (EMBA 296 & EWMBA 211) Summer 2016 More on strategic games and extensive games with perfect information Block 2 Jun 11, 2017 Auctions results Histogram of

More information

Stochastic Games and Bayesian Games

Stochastic Games and Bayesian Games Stochastic Games and Bayesian Games CPSC 532l Lecture 10 Stochastic Games and Bayesian Games CPSC 532l Lecture 10, Slide 1 Lecture Overview 1 Recap 2 Stochastic Games 3 Bayesian Games 4 Analyzing Bayesian

More information

Economics 171: Final Exam

Economics 171: Final Exam Question 1: Basic Concepts (20 points) Economics 171: Final Exam 1. Is it true that every strategy is either strictly dominated or is a dominant strategy? Explain. (5) No, some strategies are neither dominated

More information

Advanced Microeconomics

Advanced Microeconomics Advanced Microeconomics ECON5200 - Fall 2014 Introduction What you have done: - consumers maximize their utility subject to budget constraints and firms maximize their profits given technology and market

More information

Player 2 L R M H a,a 7,1 5,0 T 0,5 5,3 6,6

Player 2 L R M H a,a 7,1 5,0 T 0,5 5,3 6,6 Question 1 : Backward Induction L R M H a,a 7,1 5,0 T 0,5 5,3 6,6 a R a) Give a definition of the notion of a Nash-Equilibrium! Give all Nash-Equilibria of the game (as a function of a)! (6 points) b)

More information

Regret Minimization and Security Strategies

Regret Minimization and Security Strategies Chapter 5 Regret Minimization and Security Strategies Until now we implicitly adopted a view that a Nash equilibrium is a desirable outcome of a strategic game. In this chapter we consider two alternative

More information

Microeconomics II. CIDE, MsC Economics. List of Problems

Microeconomics II. CIDE, MsC Economics. List of Problems Microeconomics II CIDE, MsC Economics List of Problems 1. There are three people, Amy (A), Bart (B) and Chris (C): A and B have hats. These three people are arranged in a room so that B can see everything

More information

Notes on Auctions. Theorem 1 In a second price sealed bid auction bidding your valuation is always a weakly dominant strategy.

Notes on Auctions. Theorem 1 In a second price sealed bid auction bidding your valuation is always a weakly dominant strategy. Notes on Auctions Second Price Sealed Bid Auctions These are the easiest auctions to analyze. Theorem In a second price sealed bid auction bidding your valuation is always a weakly dominant strategy. Proof

More information

A brief introduction to evolutionary game theory

A brief introduction to evolutionary game theory A brief introduction to evolutionary game theory Thomas Brihaye UMONS 27 October 2015 Outline 1 An example, three points of view 2 A brief review of strategic games Nash equilibrium et al Symmetric two-player

More information

In the Name of God. Sharif University of Technology. Graduate School of Management and Economics

In the Name of God. Sharif University of Technology. Graduate School of Management and Economics In the Name of God Sharif University of Technology Graduate School of Management and Economics Microeconomics (for MBA students) 44111 (1393-94 1 st term) - Group 2 Dr. S. Farshad Fatemi Game Theory Game:

More information

ECE 586GT: Problem Set 1: Problems and Solutions Analysis of static games

ECE 586GT: Problem Set 1: Problems and Solutions Analysis of static games University of Illinois Fall 2018 ECE 586GT: Problem Set 1: Problems and Solutions Analysis of static games Due: Tuesday, Sept. 11, at beginning of class Reading: Course notes, Sections 1.1-1.4 1. [A random

More information

Name. Answers Discussion Final Exam, Econ 171, March, 2012

Name. Answers Discussion Final Exam, Econ 171, March, 2012 Name Answers Discussion Final Exam, Econ 171, March, 2012 1) Consider the following strategic form game in which Player 1 chooses the row and Player 2 chooses the column. Both players know that this is

More information

An introduction on game theory for wireless networking [1]

An introduction on game theory for wireless networking [1] An introduction on game theory for wireless networking [1] Ning Zhang 14 May, 2012 [1] Game Theory in Wireless Networks: A Tutorial 1 Roadmap 1 Introduction 2 Static games 3 Extensive-form games 4 Summary

More information

SI 563 Homework 3 Oct 5, Determine the set of rationalizable strategies for each of the following games. a) X Y X Y Z

SI 563 Homework 3 Oct 5, Determine the set of rationalizable strategies for each of the following games. a) X Y X Y Z SI 563 Homework 3 Oct 5, 06 Chapter 7 Exercise : ( points) Determine the set of rationalizable strategies for each of the following games. a) U (0,4) (4,0) M (3,3) (3,3) D (4,0) (0,4) X Y U (0,4) (4,0)

More information

Introduction to Industrial Organization Professor: Caixia Shen Fall 2014 Lecture Note 5 Games and Strategy (Ch. 4)

Introduction to Industrial Organization Professor: Caixia Shen Fall 2014 Lecture Note 5 Games and Strategy (Ch. 4) Introduction to Industrial Organization Professor: Caixia Shen Fall 2014 Lecture Note 5 Games and Strategy (Ch. 4) Outline: Modeling by means of games Normal form games Dominant strategies; dominated strategies,

More information

Week 8: Basic concepts in game theory

Week 8: Basic concepts in game theory Week 8: Basic concepts in game theory Part 1: Examples of games We introduce here the basic objects involved in game theory. To specify a game ones gives The players. The set of all possible strategies

More information

Can we have no Nash Equilibria? Can you have more than one Nash Equilibrium? CS 430: Artificial Intelligence Game Theory II (Nash Equilibria)

Can we have no Nash Equilibria? Can you have more than one Nash Equilibrium? CS 430: Artificial Intelligence Game Theory II (Nash Equilibria) CS 0: Artificial Intelligence Game Theory II (Nash Equilibria) ACME, a video game hardware manufacturer, has to decide whether its next game machine will use DVDs or CDs Best, a video game software producer,

More information

Repeated, Stochastic and Bayesian Games

Repeated, Stochastic and Bayesian Games Decision Making in Robots and Autonomous Agents Repeated, Stochastic and Bayesian Games Subramanian Ramamoorthy School of Informatics 26 February, 2013 Repeated Game 26/02/2013 2 Repeated Game - Strategies

More information

Outline for today. Stat155 Game Theory Lecture 13: General-Sum Games. General-sum games. General-sum games. Dominated pure strategies

Outline for today. Stat155 Game Theory Lecture 13: General-Sum Games. General-sum games. General-sum games. Dominated pure strategies Outline for today Stat155 Game Theory Lecture 13: General-Sum Games Peter Bartlett October 11, 2016 Two-player general-sum games Definitions: payoff matrices, dominant strategies, safety strategies, Nash

More information

G5212: Game Theory. Mark Dean. Spring 2017

G5212: Game Theory. Mark Dean. Spring 2017 G5212: Game Theory Mark Dean Spring 2017 Bargaining We will now apply the concept of SPNE to bargaining A bit of background Bargaining is hugely interesting but complicated to model It turns out that the

More information

MA300.2 Game Theory 2005, LSE

MA300.2 Game Theory 2005, LSE MA300.2 Game Theory 2005, LSE Answers to Problem Set 2 [1] (a) This is standard (we have even done it in class). The one-shot Cournot outputs can be computed to be A/3, while the payoff to each firm can

More information

PAULI MURTO, ANDREY ZHUKOV

PAULI MURTO, ANDREY ZHUKOV GAME THEORY SOLUTION SET 1 WINTER 018 PAULI MURTO, ANDREY ZHUKOV Introduction For suggested solution to problem 4, last year s suggested solutions by Tsz-Ning Wong were used who I think used suggested

More information

Common Knowledge AND Global Games

Common Knowledge AND Global Games Common Knowledge AND Global Games 1 This talk combines common knowledge with global games another advanced branch of game theory See Stephen Morris s work 2 Today we ll go back to a puzzle that arose during

More information

Game Theory: Global Games. Christoph Schottmüller

Game Theory: Global Games. Christoph Schottmüller Game Theory: Global Games Christoph Schottmüller 1 / 20 Outline 1 Global Games: Stag Hunt 2 An investment example 3 Revision questions and exercises 2 / 20 Stag Hunt Example H2 S2 H1 3,3 3,0 S1 0,3 4,4

More information

Basic Game-Theoretic Concepts. Game in strategic form has following elements. Player set N. (Pure) strategy set for player i, S i.

Basic Game-Theoretic Concepts. Game in strategic form has following elements. Player set N. (Pure) strategy set for player i, S i. Basic Game-Theoretic Concepts Game in strategic form has following elements Player set N (Pure) strategy set for player i, S i. Payoff function f i for player i f i : S R, where S is product of S i s.

More information

Lecture 1: Normal Form Games: Refinements and Correlated Equilibrium

Lecture 1: Normal Form Games: Refinements and Correlated Equilibrium Lecture 1: Normal Form Games: Refinements and Correlated Equilibrium Albert Banal-Estanol April 2006 Lecture 1 2 Albert Banal-Estanol Trembling hand perfect equilibrium: Motivation, definition and examples

More information

6.207/14.15: Networks Lecture 9: Introduction to Game Theory 1

6.207/14.15: Networks Lecture 9: Introduction to Game Theory 1 6.207/14.15: Networks Lecture 9: Introduction to Game Theory 1 Daron Acemoglu and Asu Ozdaglar MIT October 13, 2009 1 Introduction Outline Decisions, Utility Maximization Games and Strategies Best Responses

More information

CUR 412: Game Theory and its Applications Final Exam Ronaldo Carpio Jan. 13, 2015

CUR 412: Game Theory and its Applications Final Exam Ronaldo Carpio Jan. 13, 2015 CUR 41: Game Theory and its Applications Final Exam Ronaldo Carpio Jan. 13, 015 Instructions: Please write your name in English. This exam is closed-book. Total time: 10 minutes. There are 4 questions,

More information

Repeated Games. Econ 400. University of Notre Dame. Econ 400 (ND) Repeated Games 1 / 48

Repeated Games. Econ 400. University of Notre Dame. Econ 400 (ND) Repeated Games 1 / 48 Repeated Games Econ 400 University of Notre Dame Econ 400 (ND) Repeated Games 1 / 48 Relationships and Long-Lived Institutions Business (and personal) relationships: Being caught cheating leads to punishment

More information

Strategies and Nash Equilibrium. A Whirlwind Tour of Game Theory

Strategies and Nash Equilibrium. A Whirlwind Tour of Game Theory Strategies and Nash Equilibrium A Whirlwind Tour of Game Theory (Mostly from Fudenberg & Tirole) Players choose actions, receive rewards based on their own actions and those of the other players. Example,

More information

February 23, An Application in Industrial Organization

February 23, An Application in Industrial Organization An Application in Industrial Organization February 23, 2015 One form of collusive behavior among firms is to restrict output in order to keep the price of the product high. This is a goal of the OPEC oil

More information

Lecture 3 Representation of Games

Lecture 3 Representation of Games ecture 3 epresentation of Games 4. Game Theory Muhamet Yildiz oad Map. Cardinal representation Expected utility theory. Quiz 3. epresentation of games in strategic and extensive forms 4. Dominance; dominant-strategy

More information

Game Theory Problem Set 4 Solutions

Game Theory Problem Set 4 Solutions Game Theory Problem Set 4 Solutions 1. Assuming that in the case of a tie, the object goes to person 1, the best response correspondences for a two person first price auction are: { }, < v1 undefined,

More information

6.207/14.15: Networks Lecture 10: Introduction to Game Theory 2

6.207/14.15: Networks Lecture 10: Introduction to Game Theory 2 6.207/14.15: Networks Lecture 10: Introduction to Game Theory 2 Daron Acemoglu and Asu Ozdaglar MIT October 14, 2009 1 Introduction Outline Review Examples of Pure Strategy Nash Equilibria Mixed Strategies

More information

preferences of the individual players over these possible outcomes, typically measured by a utility or payoff function.

preferences of the individual players over these possible outcomes, typically measured by a utility or payoff function. Leigh Tesfatsion 26 January 2009 Game Theory: Basic Concepts and Terminology A GAME consists of: a collection of decision-makers, called players; the possible information states of each player at each

More information

6.207/14.15: Networks Lecture 9: Introduction to Game Theory 1

6.207/14.15: Networks Lecture 9: Introduction to Game Theory 1 6.207/14.15: Networks Lecture 9: Introduction to Game Theory 1 Daron Acemoglu and Asu Ozdaglar MIT October 13, 2009 1 Introduction Outline Decisions, Utility Maximization Games and Strategies Best Responses

More information

Microeconomics of Banking: Lecture 5

Microeconomics of Banking: Lecture 5 Microeconomics of Banking: Lecture 5 Prof. Ronaldo CARPIO Oct. 23, 2015 Administrative Stuff Homework 2 is due next week. Due to the change in material covered, I have decided to change the grading system

More information

Introduction to Game Theory

Introduction to Game Theory Introduction to Game Theory A. J. Ganesh Feb. 2013 1 What is a game? A game is a model of strategic interaction between agents or players. The agents might be animals competing with other animals for food

More information

Microeconomics Comprehensive Exam

Microeconomics Comprehensive Exam Microeconomics Comprehensive Exam June 2009 Instructions: (1) Please answer each of the four questions on separate pieces of paper. (2) When finished, please arrange your answers alphabetically (in the

More information

Sequential-move games with Nature s moves.

Sequential-move games with Nature s moves. Econ 221 Fall, 2018 Li, Hao UBC CHAPTER 3. GAMES WITH SEQUENTIAL MOVES Game trees. Sequential-move games with finite number of decision notes. Sequential-move games with Nature s moves. 1 Strategies in

More information

In the Name of God. Sharif University of Technology. Microeconomics 2. Graduate School of Management and Economics. Dr. S.

In the Name of God. Sharif University of Technology. Microeconomics 2. Graduate School of Management and Economics. Dr. S. In the Name of God Sharif University of Technology Graduate School of Management and Economics Microeconomics 2 44706 (1394-95 2 nd term) - Group 2 Dr. S. Farshad Fatemi Chapter 8: Simultaneous-Move Games

More information

S 2,2-1, x c C x r, 1 0,0

S 2,2-1, x c C x r, 1 0,0 Problem Set 5 1. There are two players facing each other in the following random prisoners dilemma: S C S, -1, x c C x r, 1 0,0 With probability p, x c = y, and with probability 1 p, x c = 0. With probability

More information

Econ 711 Homework 1 Solutions

Econ 711 Homework 1 Solutions Econ 711 Homework 1 s January 4, 014 1. 1 Symmetric, not complete, not transitive. Not a game tree. Asymmetric, not complete, transitive. Game tree. 1 Asymmetric, not complete, transitive. Not a game tree.

More information

MA200.2 Game Theory II, LSE

MA200.2 Game Theory II, LSE MA200.2 Game Theory II, LSE Problem Set 1 These questions will go over basic game-theoretic concepts and some applications. homework is due during class on week 4. This [1] In this problem (see Fudenberg-Tirole

More information

Economics 109 Practice Problems 1, Vincent Crawford, Spring 2002

Economics 109 Practice Problems 1, Vincent Crawford, Spring 2002 Economics 109 Practice Problems 1, Vincent Crawford, Spring 2002 P1. Consider the following game. There are two piles of matches and two players. The game starts with Player 1 and thereafter the players

More information

Game theory and applications: Lecture 1

Game theory and applications: Lecture 1 Game theory and applications: Lecture 1 Adam Szeidl September 20, 2018 Outline for today 1 Some applications of game theory 2 Games in strategic form 3 Dominance 4 Nash equilibrium 1 / 8 1. Some applications

More information

Game Theory: Minimax, Maximin, and Iterated Removal Naima Hammoud

Game Theory: Minimax, Maximin, and Iterated Removal Naima Hammoud Game Theory: Minimax, Maximin, and Iterated Removal Naima Hammoud March 14, 17 Last Lecture: expected value principle Colin A B Rose A - - B - Suppose that Rose knows Colin will play ½ A + ½ B Rose s Expectations

More information

Chapter 2 Strategic Dominance

Chapter 2 Strategic Dominance Chapter 2 Strategic Dominance 2.1 Prisoner s Dilemma Let us start with perhaps the most famous example in Game Theory, the Prisoner s Dilemma. 1 This is a two-player normal-form (simultaneous move) game.

More information

1 Solutions to Homework 4

1 Solutions to Homework 4 1 Solutions to Homework 4 1.1 Q1 Let A be the event that the contestant chooses the door holding the car, and B be the event that the host opens a door holding a goat. A is the event that the contestant

More information

m 11 m 12 Non-Zero Sum Games Matrix Form of Zero-Sum Games R&N Section 17.6

m 11 m 12 Non-Zero Sum Games Matrix Form of Zero-Sum Games R&N Section 17.6 Non-Zero Sum Games R&N Section 17.6 Matrix Form of Zero-Sum Games m 11 m 12 m 21 m 22 m ij = Player A s payoff if Player A follows pure strategy i and Player B follows pure strategy j 1 Results so far

More information

FDPE Microeconomics 3 Spring 2017 Pauli Murto TA: Tsz-Ning Wong (These solution hints are based on Julia Salmi s solution hints for Spring 2015.

FDPE Microeconomics 3 Spring 2017 Pauli Murto TA: Tsz-Ning Wong (These solution hints are based on Julia Salmi s solution hints for Spring 2015. FDPE Microeconomics 3 Spring 2017 Pauli Murto TA: Tsz-Ning Wong (These solution hints are based on Julia Salmi s solution hints for Spring 2015.) Hints for Problem Set 2 1. Consider a zero-sum game, where

More information

Symmetric Game. In animal behaviour a typical realization involves two parents balancing their individual investment in the common

Symmetric Game. In animal behaviour a typical realization involves two parents balancing their individual investment in the common Symmetric Game Consider the following -person game. Each player has a strategy which is a number x (0 x 1), thought of as the player s contribution to the common good. The net payoff to a player playing

More information

Introduction. Microeconomics II. Dominant Strategies. Definition (Dominant Strategies)

Introduction. Microeconomics II. Dominant Strategies. Definition (Dominant Strategies) Introduction Microeconomics II Dominance and Rationalizability Levent Koçkesen Koç University Nash equilibrium concept assumes that each player knows the other players equilibrium behavior This is problematic

More information

March 30, Why do economists (and increasingly, engineers and computer scientists) study auctions?

March 30, Why do economists (and increasingly, engineers and computer scientists) study auctions? March 3, 215 Steven A. Matthews, A Technical Primer on Auction Theory I: Independent Private Values, Northwestern University CMSEMS Discussion Paper No. 196, May, 1995. This paper is posted on the course

More information

CUR 412: Game Theory and its Applications, Lecture 4

CUR 412: Game Theory and its Applications, Lecture 4 CUR 412: Game Theory and its Applications, Lecture 4 Prof. Ronaldo CARPIO March 27, 2015 Homework #1 Homework #1 will be due at the end of class today. Please check the website later today for the solutions

More information

CMSC 858F Introduction to Game Theory*

CMSC 858F Introduction to Game Theory* CMSC 858F Introduction to Game Theory* Mohammad T. Hajiaghayi University of Maryland *Some of these slides are originally prepared by Professor Dana Nau. What is Game Theory? Game Theory is about interactions

More information

Infinitely Repeated Games

Infinitely Repeated Games February 10 Infinitely Repeated Games Recall the following theorem Theorem 72 If a game has a unique Nash equilibrium, then its finite repetition has a unique SPNE. Our intuition, however, is that long-term

More information

The Nash equilibrium of the stage game is (D, R), giving payoffs (0, 0). Consider the trigger strategies:

The Nash equilibrium of the stage game is (D, R), giving payoffs (0, 0). Consider the trigger strategies: Problem Set 4 1. (a). Consider the infinitely repeated game with discount rate δ, where the strategic fm below is the stage game: B L R U 1, 1 2, 5 A D 2, 0 0, 0 Sketch a graph of the players payoffs.

More information

Game Theory: introduction and applications to computer networks

Game Theory: introduction and applications to computer networks Game Theory: introduction and applications to computer networks Introduction Giovanni Neglia INRIA EPI Maestro 21 January 2013 Part of the slides are based on a previous course with D. Figueiredo (UFRJ)

More information

Mixed Strategies. In the previous chapters we restricted players to using pure strategies and we

Mixed Strategies. In the previous chapters we restricted players to using pure strategies and we 6 Mixed Strategies In the previous chapters we restricted players to using pure strategies and we postponed discussing the option that a player may choose to randomize between several of his pure strategies.

More information

Introduction to Game Theory

Introduction to Game Theory Introduction to Game Theory What is a Game? A game is a formal representation of a situation in which a number of individuals interact in a setting of strategic interdependence. By that, we mean that each

More information

6.1 What is a Game? 166 CHAPTER 6. GAMES

6.1 What is a Game? 166 CHAPTER 6. GAMES Chapter 6 Games In the opening chapter of the book, we emphasized that the connectedness of a complex social, natural, or technological system really means two things: first, an underlying structure of

More information

Outline Introduction Game Representations Reductions Solution Concepts. Game Theory. Enrico Franchi. May 19, 2010

Outline Introduction Game Representations Reductions Solution Concepts. Game Theory. Enrico Franchi. May 19, 2010 May 19, 2010 1 Introduction Scope of Agent preferences Utility Functions 2 Game Representations Example: Game-1 Extended Form Strategic Form Equivalences 3 Reductions Best Response Domination 4 Solution

More information

Duopoly models Multistage games with observed actions Subgame perfect equilibrium Extensive form of a game Two-stage prisoner s dilemma

Duopoly models Multistage games with observed actions Subgame perfect equilibrium Extensive form of a game Two-stage prisoner s dilemma Recap Last class (September 20, 2016) Duopoly models Multistage games with observed actions Subgame perfect equilibrium Extensive form of a game Two-stage prisoner s dilemma Today (October 13, 2016) Finitely

More information

Follow the Leader I has three pure strategy Nash equilibria of which only one is reasonable.

Follow the Leader I has three pure strategy Nash equilibria of which only one is reasonable. February 3, 2014 Eric Rasmusen, Erasmuse@indiana.edu. Http://www.rasmusen.org Follow the Leader I has three pure strategy Nash equilibria of which only one is reasonable. Equilibrium Strategies Outcome

More information

Extensive-Form Games with Imperfect Information

Extensive-Form Games with Imperfect Information May 6, 2015 Example 2, 2 A 3, 3 C Player 1 Player 1 Up B Player 2 D 0, 0 1 0, 0 Down C Player 1 D 3, 3 Extensive-Form Games With Imperfect Information Finite No simultaneous moves: each node belongs to

More information

Using the Maximin Principle

Using the Maximin Principle Using the Maximin Principle Under the maximin principle, it is easy to see that Rose should choose a, making her worst-case payoff 0. Colin s similar rationality as a player induces him to play (under

More information

Chapter 10: Mixed strategies Nash equilibria, reaction curves and the equality of payoffs theorem

Chapter 10: Mixed strategies Nash equilibria, reaction curves and the equality of payoffs theorem Chapter 10: Mixed strategies Nash equilibria reaction curves and the equality of payoffs theorem Nash equilibrium: The concept of Nash equilibrium can be extended in a natural manner to the mixed strategies

More information

ECON 459 Game Theory. Lecture Notes Auctions. Luca Anderlini Spring 2017

ECON 459 Game Theory. Lecture Notes Auctions. Luca Anderlini Spring 2017 ECON 459 Game Theory Lecture Notes Auctions Luca Anderlini Spring 2017 These notes have been used and commented on before. If you can still spot any errors or have any suggestions for improvement, please

More information

Notes for Section: Week 7

Notes for Section: Week 7 Economics 160 Professor Steven Tadelis Stanford University Spring Quarter, 004 Notes for Section: Week 7 Notes prepared by Paul Riskind (pnr@stanford.edu). spot errors or have questions about these notes.

More information

CUR 412: Game Theory and its Applications, Lecture 4

CUR 412: Game Theory and its Applications, Lecture 4 CUR 412: Game Theory and its Applications, Lecture 4 Prof. Ronaldo CARPIO March 22, 2015 Homework #1 Homework #1 will be due at the end of class today. Please check the website later today for the solutions

More information

1 R. 2 l r 1 1 l2 r 2

1 R. 2 l r 1 1 l2 r 2 4. Game Theory Midterm I Instructions. This is an open book exam; you can use any written material. You have one hour and 0 minutes. Each question is 35 points. Good luck!. Consider the following game

More information

Preliminary Notions in Game Theory

Preliminary Notions in Game Theory Chapter 7 Preliminary Notions in Game Theory I assume that you recall the basic solution concepts, namely Nash Equilibrium, Bayesian Nash Equilibrium, Subgame-Perfect Equilibrium, and Perfect Bayesian

More information

Economics 51: Game Theory

Economics 51: Game Theory Economics 51: Game Theory Liran Einav April 21, 2003 So far we considered only decision problems where the decision maker took the environment in which the decision is being taken as exogenously given:

More information

Prisoner s Dilemma. CS 331: Artificial Intelligence Game Theory I. Prisoner s Dilemma. Prisoner s Dilemma. Prisoner s Dilemma.

Prisoner s Dilemma. CS 331: Artificial Intelligence Game Theory I. Prisoner s Dilemma. Prisoner s Dilemma. Prisoner s Dilemma. CS 331: rtificial Intelligence Game Theory I You and your partner have both been caught red handed near the scene of a burglary. oth of you have been brought to the police station, where you are interrogated

More information

CSI 445/660 Part 9 (Introduction to Game Theory)

CSI 445/660 Part 9 (Introduction to Game Theory) CSI 445/660 Part 9 (Introduction to Game Theory) Ref: Chapters 6 and 8 of [EK] text. 9 1 / 76 Game Theory Pioneers John von Neumann (1903 1957) Ph.D. (Mathematics), Budapest, 1925 Contributed to many fields

More information

Elements of Economic Analysis II Lecture XI: Oligopoly: Cournot and Bertrand Competition

Elements of Economic Analysis II Lecture XI: Oligopoly: Cournot and Bertrand Competition Elements of Economic Analysis II Lecture XI: Oligopoly: Cournot and Bertrand Competition Kai Hao Yang /2/207 In this lecture, we will apply the concepts in game theory to study oligopoly. In short, unlike

More information

Problem 3 Solutions. l 3 r, 1

Problem 3 Solutions. l 3 r, 1 . Economic Applications of Game Theory Fall 00 TA: Youngjin Hwang Problem 3 Solutions. (a) There are three subgames: [A] the subgame starting from Player s decision node after Player s choice of P; [B]

More information

MATH 4321 Game Theory Solution to Homework Two

MATH 4321 Game Theory Solution to Homework Two MATH 321 Game Theory Solution to Homework Two Course Instructor: Prof. Y.K. Kwok 1. (a) Suppose that an iterated dominance equilibrium s is not a Nash equilibrium, then there exists s i of some player

More information

Notes for Section: Week 4

Notes for Section: Week 4 Economics 160 Professor Steven Tadelis Stanford University Spring Quarter, 2004 Notes for Section: Week 4 Notes prepared by Paul Riskind (pnr@stanford.edu). spot errors or have questions about these notes.

More information