Game Theory. Zero sum games

Transcription

1 Game Theory Lecture 13 Zero sum games In zero sum games, payoffs in each cell sum up to zero Movement diagram 1

2 Zero sum games Minimax = maximin = value of the game The game may have mulfple saddle points Zero sum games Or it may have no saddle points To find the value of such game, consider mixed strategies 2

3 Zero sum games If there is more strategies, you don t know which one will be part of opfmal mixed strategy. Let Column mixed strategy be (x,1 x) Then Raw will try to maximize Zero sum games Column will try to choose x to minimize the upper envelope 3

4 Zero sum games Tranform into Linear Programming In the fivies, Davenport studied a village of 200 people on the south shore of Jamaica, whose inhabitants made their living by fishing. Fishing on Jamaica 4

5 Twenty six fishing crews in sailing, dugout canoes fish this area [fishing grounds extend outward from shore about 22 miles] by se9ng fish pots, which are drawn and reset, weather and sea permi9ng, on three regular fishing days each week The fishing grounds are divided into inside and outside banks. The inside banks lie from 5 15 miles offshore, while the outside banks all lie beyond Because of special underwater contours and the locaeon of one prominent headland, very strong currents set across the outside banks at frequent intervals These currents are not related in any apparent way to weather and sea condieons of the local region. The inside banks are almost fully protected from the currents. [Davenport 1960] Jamaica on a map 5

6 Strategies There were 26 wooden canoes. The captains of the canoes might adopt 3 fishing strategies: IN put all pots on the inside banks OUT put all pots on the outside banks IN OUT) put some pots on the inside banks, some pots on the outside Advantages and disadvantages It takes Fme to reach outside banks, so those who use OUT or IN OUT can set fewer pots When the current is running, it is harmful to outside pots: marks are dragged away, pots may be smashed while moving, changes in temeperature may kill fish inside the pots, etc. The outside banks produce higher quality fish, both in variafes and in size. If many outside fish are available, they may drive the inside fish off the market. The OUT and IN OUT strategies require befer canoes. Their captains dominate the sport of canoe racing, which is presfgious and offers large rewards. 6

7 CollecFng data Davenport collected the data concerning the fishermen average monthly profit depending on the fishing strategies they used to adopt. Fishermen\Current FLOW NO FLOW IN 17,3 11,5 OUT 4,4 20,6 IN OUT 5,2 17,0 Zero sum game??? The problem of vicious current ; p current s strategy Fishermen problem; q fishermen strategy 7

8 Graphical solufon of the current s problem SoluFon: p=0.31 IN OUT IN OUT Mixed strategy of the current Maximin and minimax Fishers' mixed strategy objective function q1 q2 q3 Maximize 13,31 0,67 0,00 0,33 Expected payoff of the current when FLOW 13,31 >= 13,31 NO FLOW 13,31 >= 13,31 probabilities 1,00 = 1,00 objective Mixed strategy of the current function p 1-p minimize 13,31 0,31 0,69 Expected payoff from strategy: IN 13,31 <= 13,31 OUT 12,79 <= 13,31 IN_OUT 13,31 <= 13,31 probabilities 1,00 = 1,00 8

9 Forecast and observafon Game theory predicts No fishermen risks fishing outside Strategy 67% IN, 33% IN OUT [Payoff: 13.31] OpFmal current s strategy 31% FLOW, 69% NO FLOW ObservaMon shows No fishermen risks fishing outside Strategy 69% IN, 31% IN OUT [Payoff: 13.38] Current s strategy : 25% FLOW, 75% NO FLOW The similarity is striking Davenport s finding went unchallenged for several years UnFl Current is not vicious Kozelka 1969 and Read, Read 1970 pointed out a serious flaw: The current is not a reasoning enfty and cannot adjust to fishermen changing their strategies. Hence fishermen should use Expected Value principle: Expected payoff of the fishermen: IN: 0.25 x x 11.5 = OUT: 0.25 x ( 4.4) x 20.6 = IN OUT: 0.25 x x 17.0 = Hence, all of the fishermen should fish OUTside. Maybe, they are not well adapted aver all 9

10 Current may be vicious aver all The current does not reason, but it is very risky to fish outside. Even if the current runs 25% of the Fme ON AVERAGE, it might run considerably more or less in the short run of a year. Suppose one year it ran 35% of the Fme. Expected payoffs: IN: 0.35 x x 11.5 = OUT: 0.35 x ( 4.4) x 11.5 = IN OUT: 0.35 x x 17.0 = By treafng the current as their opponent, fishermen GUARANTEE themselves payoff of at least Fishermen pay 1.05 pounds as insurance premium Actual (25%) Vicious (31%) 35% OpFmal Actual OUT Consider the following game Mr Raw Mrs Column A B A (2,6) (10,5) B (4,8) (0,0) 10

11 Security level Mr Raw s game is a zero sum game with Mr Raw s payoffs unchaged Mr Raw Mrs Column A B A (2,6) (10,5) B (4,8) (0,0) Mr Raw X A B A (2,-2) (10,-10) B (4,-4) (0,0) Mr Raw s security level is the value of Mr Raw s game: No saddle point, so mixed strategy x=5/6, expected payoff=10/3=value of Mr Raw s game. Security level Mrs Column s game is a zero sum game with Mrs Column s payoffs unchaged Mr Raw Mrs Column A B A (2,6) (10,5) B (4,8) (0,0) Mrs Column A B A (-6,6) (-5,5) B (-8,8) (0,0) Mrs Column s security level is the value of Mrs Column s game: There is a saddle point 6 So 6=value of Mrs Column s game. X 11

12 Nash arbitrafon Scheme Up to this point, no cooperafon btw. players Now different approach: what is a reasonable outcome to the game? Take again our previous game Mrs Column A B A (2,6) (10,5) Mr Raw B (4,8) (0,0) Egalitarian proposal: choose the outcome with the largest total payoff. Then split it equally. (15/2 for each) Two major flaws of this approach: Payoffs are uflifes. They cannot be meaningfully added or transferred across individuals. Neglects the asymmetries of strategic posifon in the game. (Mrs. Column posifon in the game above is strong) Nash arbitrafon scheme Challenge: to find a method of arbitrafng games which: Does not involve illegifmate manipulafon of uflifes Does take into account strategic ineqalifes Has a claim to fairness First good idea: von Neumann, Morgenstern (1944): any reasonable solufon to a non zero sum game should be: Pareto opmmal At or above the security level for both players The set of such outcomes (pure or mixed) is called the negomamon set of the game. 12

13 Payoff polygon and Pareto efficient points Mrs Column s payoff (4,8) (2,6) Pareto efficient fronmer (10,5) (0,0) Mr Raw s payoff Status Quo and negofafon set Mrs Column s payoff (4,8) NegoMaMon set 6 (2,6) SQ (10,5) (0,0) 10/3 Mr Raw s payoff 13

14 Nash 1950 arbitrafon scheme What point in the negofafon set do we choose? Nash arbitrafon scheme: Axioms: 1. RaMonality: The solufon lies in the negofafon set 2. Linear invariance: If we linearly transform all the uflifes, the solufons will also be linearly transformed 3. Symmetry: If the polygon happens to be symmetric about the line of slope +1 through SQ, then the solufon should be on this line as well 4. Independence of Irrelevant AlternaMves: Suppose N is the solufon point for a polygon P with status quo point SQ. Suppose Q is another polygon which contains both SQ and N, and is totally contained in P. Then N should also be the solufon point for Q with status quo point SQ. Independence of Irrelevant AlternaFves graphically N SQ Suppose N is the solufon point for a polygon P with status quo point SQ. Suppose Q is another polygon which contains both SQ and N, and is totally contained in P. Then N should also be the solufon point for Q with status quo point SQ. 14

15 Nash 1950 Theorem Theorem: There is one and only one arbitramon scheme which safsfies Axioms 1 4. It is this: if SQ=(x 0,y 0 ), then the arbitrated solufon point N is the point (x,y) in the polygon with x x 0, and y y 0, which maximizes the product (x x 0 )(y y 0 ). Nash solufon our example In our example Nash solufon is (5 2 / 3, 7 1 / 6 ) Mrs Column s payoff (4,8) 6 (2,6) SQ (5 2 / 3, 7 1 / 6 ) (10,5) (0,0) 10/3 Mr Raw s payoff 15

16 ApplicaFon The management of a factory is negofafng a new contract with the union represenfng its workers The union demands new benefits: One dollar per hour across the board raise (R) Increased pension benefits (P) Managements demands concessions: Eliminate the 10:00 a.m. coffee break (C) Automate one of the assembly checkpoints (reducfon necessary) (A) You have been called as an arbitrator. 16