Top Banner
Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011
80

Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Dec 15, 2015

Download

Documents

Devin Mepham
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Structure in Games

Soumya Paul & R. Ramanujam

The Institute of Mathematical Sciences

Chennai

ACTS 2011

Page 2: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 3: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 4: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 5: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 6: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 7: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 8: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 9: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 10: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 11: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 12: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 13: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 14: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

The Model

Page 15: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 16: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 17: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Related Work

Page 18: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

• Michael J. Kearns, Michael L. Littman, and Satinder P. Singh. An efficient, exact algorithm for solving tree-structured graphical games. In NIPS, pages 817–823, 2001

• Michael J. Kearns, Michael L. Littman, and Satinder P. Singh. Graphical models for game theory. In UAI, pages 253–260, 2001

• H. Peyton Young. The evolution of conventions. In Econometrica, volume 61, pages 57–84. Blackwell Publishing, 1993

• H. Peyton Young. The diffusion of innovations in social networks. Economics Working Paper Archive 437, The Johns Hopkins University, Department of Economics, May 2000

• Heiner Ackermann, Heiko Röglin, and Berthold Vöcking. On the impact of combinatorial structure on congestion games. In In Proc. of the 47th Ann. IEEE Symp. on Foundations of Computer Science (FOCS), pages 613–622, 2006

• Heiner Ackermann, Simon Fischer, Petra Berenbrink, and Martin Hoefer. Concurrent imitation dynamics in congestion games, 2008

Page 19: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Weighted Coordination Games

Page 20: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

1 1

1

0

0

Page 21: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

1 1

1

0

0

2/5

2/53/5

3/53/5

Page 22: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

1 1

1

0

0

2/5

2/53/5

3/53/5

x1

y2

y1

x2

Page 23: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Static Neighbourhoods

Page 24: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Description of type t

• If payoff in round k > 0.5 then– play same action a in round k+1

• else if all players with the maximum payoff in round k played a different action 1-a– play 1-a in round k+1

• Else play a in round k+1• EndIf

Page 25: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Theorem:

Let G be a neighbourhood graph and let m be the number of neighbourhoods (cliques) and let M be the maximum size of a clique. If all the players are of the same type t then the game stabilises in at most mM steps.

Proof Idea:

• Associate a potential with every configuration of the graph

• Show that whenever the configuration changes from round k to k+1 the potential strictly increases

• The maximum possible potential of the graph is bounded

Page 26: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Theorem:

Let G be a neighbourhood graph and let m be the number of neighbourhoods (cliques) and let M be the maximum size of a clique. If all the players are of the same type t then the game stabilises in at most mM steps.

Proof Idea:

• Associate a potential with every configuration of the graph

• Show that whenever the configuration changes from round k to k+1 the potential strictly increases

• The maximum possible potential of the graph is bounded

A weight or value unique for every configuration;

independent of the history

Page 27: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Theorem:

Let G be a neighbourhood graph and let m be the number of neighbourhoods (cliques) and let M be the maximum size of a clique. If all the players are of the same type t then the game stabilises in at most mM steps.

Proof Idea:

• Associate a potential with every configuration of the graph

• Show that whenever the configuration changes from round k to k+1 the potential strictly increases

• The maximum possible potential of the graph is bounded

1 1

1

0

0

1 0

0

1

0

Page 28: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Theorem:

Let G be a neighbourhood graph and let m be the number of neighbourhoods (cliques) and let M be the maximum size of a clique. If all the players are of the same type t then the game stabilises in at most mM steps.

Proof Idea:

• Associate a potential with every configuration of the graph

• Show that whenever the configuration changes from round k to k+1 the potential strictly increases

• The maximum possible potential of the graph is bounded

Page 29: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Dynamic Neighbourhoods

Page 30: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 31: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 32: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 33: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Description of type t

• If payoff > 0.5 then– Stay in the same neighbourhood X

• ElseIf there is a player j in a different visible neighbourhood X’ who received the maximum (visible) payoff in round k and this payoff is greater than my payoff then– Join X’ in round k+1

• Else– Stay in X

• EndIf

Page 34: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Theorem:

Let a game have n players where the dynamic neighbourhood structure is given by a graph G. If all the players are of the same type t, then the game stabilises in at most nn(n+1)/2 steps.

Proof Idea: Same as before• Associate a potential with every configuration of

the graph• Show that whenever the configuration changes

from round k to k+1 the potential strictly increases• The maximum possible potential of the graph is

bounded

Page 35: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

General Neighbourhood Games

Page 36: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Theorem:

A general game with n players and with either a static or a dynamic neighbourhood structure eventually stabilises if and only if we can associate a potential Φk with every round k such that if the game moves to a different configuration from round k to round k + 1 then Φk+1 > Φk and the maximum possible potential of the game is bounded.

Page 37: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Proof

Page 38: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Unfolding of the game -configuration tree

Page 39: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Unfolding of the game -configuration tree

Finite

Page 40: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

M = max Φ

Ck

Page 41: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

M = max Φ

Page 42: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

M = max Φ

M+1

Page 43: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

M = max Φ

M+1

Page 44: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Ck+1

Page 45: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.
Page 46: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.
Page 47: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.
Page 48: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.
Page 49: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.
Page 50: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.
Page 51: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.
Page 52: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.
Page 53: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.
Page 54: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.
Page 55: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Cycle!

Page 56: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Generalising Stability

Page 57: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 58: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 59: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 60: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 61: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 62: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 63: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 64: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 65: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 66: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

X

Page 67: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

X

Page 68: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

X

X

Page 69: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

X

X

Page 70: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

X

X

X

Page 71: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Theorem:A general game with n players and with either a static or a dynamic neighbourhood structure eventually stabilises if and only if we can associate a potential Φk with every round k such that the following holds:

1. If the game has not yet stabilised in round k then there exists a round k0 > k such that Φk0 > k

2. There exists k0 ≥ 0 such that for all k, k’ > k0, Φk = Φk’. That is, the potential of the game becomes constant eventually

3. The maximum potential of the game is bounded

Page 72: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Proof

Page 73: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Configurationtree (with simple

cycles)

Page 74: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

FiniteConfiguration

tree (with simplecycles)

Page 75: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 76: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.
Page 77: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Page 78: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

No cyclic configuration implies

simple cycle implies

unfolding was not correct

Page 79: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

No cyclic configuration implies

simple cycle implies

unfolding was not correct

Cyclic configurationimplies

complex cycle presentcontradicts

definition of stability

Page 80: Neighbourhood Structure in Games Soumya Paul & R. Ramanujam The Institute of Mathematical Sciences Chennai ACTS 2011.

Neighbourhood Sturcture in Games

Questions?