Top Banner
Fan Chung Graham University of California, San Diego
76
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Fan Chung Graham University of California, San Diego.

Fan Chung Graham

University of California, San Diego

Page 2: Fan Chung Graham University of California, San Diego.

A graph G = (V,E)

vertex

edge

Page 3: Fan Chung Graham University of California, San Diego.

Graph models

Vertices

cities people authors telephones web pages genes

Edges

flights pairs of friends coauthorship phone calls linkings regulatory aspects

_____________________________

Page 4: Fan Chung Graham University of California, San Diego.

Graph Theory has 250 years of history.

Leonhard Euler 1707-

1783

The bridges of KönigsburgIs it possible to walk over

every bridge once and only once?

Page 5: Fan Chung Graham University of California, San Diego.

Real world large graphs

Graph Theory has 250 years of history.

Theory applications

Page 6: Fan Chung Graham University of California, San Diego.

Geometric graphs

Algebraic graphs

real graphs

Page 7: Fan Chung Graham University of California, San Diego.

Massive dataMassive graphs

• WWW-graphs

• Call graphs

• Acquaintance graphs

• Graphs from any data a.base

Page 8: Fan Chung Graham University of California, San Diego.

The Opte project

Page 9: Fan Chung Graham University of California, San Diego.

An Internet routing (BGP) graph

Page 10: Fan Chung Graham University of California, San Diego.

A subgraph of the Hollywood graph.

Page 11: Fan Chung Graham University of California, San Diego.

An induced subgraph of the collaboration graph with authors of

Erdös number ≤ 2.

Page 12: Fan Chung Graham University of California, San Diego.

Numerous questions arise in dealing with large realistic

networks

• What are the basic structures of such xxgraphs?

• What principles dictate their behavior?

• How are these graphs formed?

• How are subgraphs related to the large xxhost graph?

• What are the main graph invariants xxcapturing the properties of such graphs?

Page 13: Fan Chung Graham University of California, San Diego.

New problems and directions

• Percolation on special graphs

• Correlation among vertices

• Classical random graph theory

• Graph coloring/routing

Random graphs with any given degrees

Percolation on general graphs

Pagerank of a graph

Network games

Page 14: Fan Chung Graham University of California, San Diego.

Several examples

• Diameter of random trees of a given graph

• Correlation between vertices xxxxxxxxxxxxThe pagerank of a graph

• Random graphs with specified degrees

• Graph coloring and network games

Diameter of random power law graphs

• Percolation and giant components in a graph

Page 15: Fan Chung Graham University of California, San Diego.

Random graphs with specified degrees

Random power law graphs

Classical random graphs Same expected degree for all

vertices

Page 16: Fan Chung Graham University of California, San Diego.

Some prevailing characteristics of large

realistic networks

•Small world phenomenon

Small diameter/average distanceClustering

• Power law degree distribution

•Sparse

Page 17: Fan Chung Graham University of California, San Diego.

Degree sequence: (4,4,4,3,3,2)Degree distribution: (0,0,1,2,3)

0

1

2

3

4

5

degree_0 degree_1 degree_2 degree_3 degree_4

vertex

edge

44

4 2

33

Page 18: Fan Chung Graham University of California, San Diego.

A crucial observation

Massive graphs satisfy the power lawpower law.

• Broder, Kleinberg, Kumar, Raghavan, Rajagopalan aaand Tomkins, 1999.

• Barabási, Albert and Jeung, 1999.

• M Faloutsos, P. Faloutsos and C. Faloutsos, 1999.

• Abello, Buchsbaum, Reeds and Westbrook, 1999.

• Aiello, Chung and Lu, 1999.

Discovered by several groups independently.

Page 19: Fan Chung Graham University of California, San Diego.

The history of the power law

• Zipf’s law, 1949. (The nth most frequent word occurs at rate 1/n)

• Yule’s law, 1942.

• Lotka’s law, 1926. (Distribution of authors in chemical abstracts)

• Pareto, 1897 (Wealth distribution follows a power law.)

1907-1916

(City populations follow a power law.)

Natural language

Bibliometrics

Social sciences

Nature

Page 20: Fan Chung Graham University of California, San Diego.

Power law graphs

The degree sequences satisfy a power law:

Power decay degree distribution.

The number of vertices of degree j is proportional to j-ß where ß is some constant ≥ 1.

Page 21: Fan Chung Graham University of California, San Diego.

Comparisons

From simulation

From real data

Page 22: Fan Chung Graham University of California, San Diego.

The distribution of the connected components

in the Collaboration graph

Page 23: Fan Chung Graham University of California, San Diego.

The distribution of the connected components

in the Collaboration graph

The giant component

Page 24: Fan Chung Graham University of California, San Diego.

Examples of power law

•Inter

• Internet graphs.

• Call graphs.

• Collaboration graphs.

• Acquaintance graphs.

• Language usage

• Transportation networks

Page 25: Fan Chung Graham University of California, San Diego.

Faloutsos et al ‘99

Degree distribution of an Internet graph

A power law graph with β = 2.2

Page 26: Fan Chung Graham University of California, San Diego.

Degree distribution of Call GraphsA power law graph with β = 2.1

Page 27: Fan Chung Graham University of California, San Diego.

The collaboration graph is a power law graph, basedon data from Math Reviews with 337451 authors

A power law graph with β = 2.25

Page 28: Fan Chung Graham University of California, San Diego.

The Collaboration graph (Math Reviews)

•337,000 authors

•496,000 edges

•Average 5.65 collaborations per person

•Average 2.94 collaborators per person

•Maximum degree 1416

•The giant component of size 208,000

•84,000 isolated vertices

(Guess who?)

Page 29: Fan Chung Graham University of California, San Diego.

What is the `shape’ of a network ?

experimental

modeling

Page 30: Fan Chung Graham University of California, San Diego.

Massive Graphs

Random graphs

Similarities: Adding one (random) edge at a time.

Differences:

Random graphs almost regular.Massive graphs uneven degrees, correlatio

ns.

Page 31: Fan Chung Graham University of California, San Diego.

Random Graph Theory

Graph Graph Ramsey Theory

How does a random graph How does a random graph behave?behave?

What are the What are the unavoidable patterns?unavoidable patterns?

Page 32: Fan Chung Graham University of California, San Diego.

Paul ErdÖs and A. Rényi,

On the evolution of random graphs

Magyar Tud. Akad. Mat. Kut. Int. Kozl. 5 (1960) 17-61.

Page 33: Fan Chung Graham University of California, San Diego.

A random graph G(n,p)

• G has n vertices.

• For any two vertices u and v in G, a{u,v} is an edge with probability p.

Page 34: Fan Chung Graham University of California, San Diego.

What does a random graph look like?

Page 35: Fan Chung Graham University of California, San Diego.

Prob(G is connected)?

Page 36: Fan Chung Graham University of California, San Diego.

Prob(G is connected) =

no. of connected graphs

total no. of graphs

=

48

=12

p =

12

Page 37: Fan Chung Graham University of California, San Diego.

A random graph has property P

Prob(G has property P)

as n → ∞.

→ 1

Page 38: Fan Chung Graham University of California, San Diego.

wi : expected degree at vi

Random graphs with expected degrees wi

Prob( i ~ j) = wiwj p

Erdos-Rényi model G(n,p) :

The special case with same wi for all i.

Choose p = 1/wi , assuming max wi2<

wi .

Page 39: Fan Chung Graham University of California, San Diego.

Six degrees of separationMilgram 1967

Two web pages (in a certain portion of the Web) are 19 clicks away from each other.

Barabasi 1999

/39

Small world phenomenon

Broder 2000

Page 40: Fan Chung Graham University of California, San Diego.

Distanced(u,v) = length of a shortest path joining u and v.Diameterdiam(G) = max { d(u,v)}.

u,v

Average distance = ∑ d(u,v)/n2.

u,v

where u and v are joined by a path.

Page 41: Fan Chung Graham University of California, San Diego.

Exponents for Large Networks

P(k)~k -

Networks WWW Actors Citation Index

Power Grid

Phone calls

~2.1 (in)

~2.5 (out)

~2.3 ~3 ~4 ~2.1

Page 42: Fan Chung Graham University of California, San Diego.

Random power law graphs

provided d > 1 and max deg `large’

> 3 average distance

diameter c log n

log n / log

2 < < 3 average distance log log n

diameter c log n

Properties of Chung+Lu

PNAS’02

= 3 average distance log n / log log n

diameter c log n

%d

Page 43: Fan Chung Graham University of California, San Diego.

The structure of random power law graphs

core

legs of length

`Octopus’

log n

2 < < 3

Core has width log log n

Page 44: Fan Chung Graham University of California, San Diego.

Yahoo IM graph

Page 45: Fan Chung Graham University of California, San Diego.

Several examples

• Diameter of random trees of a given graph

• Random graphs with any given degrees Diameter of random power law

graphs

• Percolation and giant components in a graph• Correlation between vertices xxxThe pagerank of a graphs • Graph coloring and network games

Page 46: Fan Chung Graham University of California, San Diego.

Motivation

2008

Page 47: Fan Chung Graham University of California, San Diego.

Motivation

Random spanning trees have large diameters.

Page 48: Fan Chung Graham University of California, San Diego.

Diameter of spanning trees

Theorem (Rényi and Szekeres 1967): The diameter of a random spanning tree in a complete graph Kn is of order .

Theorem (Aldous 1990) : The diameter diam(T) of a random spanning tree in a regular graph with spectral bound is

n

c(1− ) nlogn

≤E(diam(T)) ≤c nlogn

1−.

Page 49: Fan Chung Graham University of California, San Diego.

Adjacency matrixMany ways

to define

the spectrum of a graph

How are the eigenvalues How are the eigenvalues related to related to

properties of graphs?properties of graphs?

The spectrum of a graph

Page 50: Fan Chung Graham University of California, San Diego.

•Combinatorial Laplacian

L D A= −diagonal degree matrix

adjacency matrix

•Adjacency matrix

•Normalized Laplacian

Random walks

Rate of convergence

The spectrum of a graph

Page 51: Fan Chung Graham University of California, San Diego.

For a path

=−12{( f (xj+1) − f (xj ))

−( f (xj ) − f (xj−1))}

1( ) ( ( ) ( ))

y xx

f x f x f yd

Δ = −∑:

Discrete Laplace operator ∆ on f: V R

Δf (x)

2

2( )f x

x

∂−

∂ 1( ) ( ){ }j jf x f xx x+∂ ∂

− −∂ ∂

The spectrum of a graph

Page 52: Fan Chung Graham University of California, San Diego.

The spectrum of a graph

not symmetric in general

•Normalized Laplaciansymmetricnormalized

1( ) ( ( ) ( ))

y xx

f x f x f yd

Δ = −∑:

( , )L x y =1 if x y=

{ 1

x

if x yd

− ≠

L( , )x y =1 if x y=

{ 1

x y

if x yd d

− ≠

Discrete Laplace operator ∆ on f: V R

Page 53: Fan Chung Graham University of California, San Diego.

Properties of Laplacian eigenvalues of a graph

Spectral bound : 0 =λ0 ≤λ1 ≤⋅⋅⋅≤λn−1 ≤2

=max

i≠0|λi −1|

“=“ holds iff G is disconnceted or bipartite.

≤1

Page 54: Fan Chung Graham University of California, San Diego.

Question

What is the diameter of a random spanning tree of a given graph G ?

Page 55: Fan Chung Graham University of California, San Diego.

Some notation

For a given graph G,

• n: the number of vertices,

• dx: the degree of vertex x,

• vol(G)=∑x dx : the volume of G,

• d =vol(G)/n : the average degree,

• The second-order average degree

%d =dx

2x∑dxx∑

• : the minimum degree,

Page 56: Fan Chung Graham University of California, San Diego.

Diameter of random spanning trees

Chung, Horn and Lu 2008

If d >>

log2 nlog2

,

then with probability 1-, a random tree T in G has diameter diam(T) satisfying

(1−)

nd%d

≤diam(T) ≤c

nd log(1 / )

logn.

If %d ≤Cd, then

Ω( n) ≤E(diam(T)) ≤O( nlogn).

Page 57: Fan Chung Graham University of California, San Diego.

Several examples

• Diameter of random trees of a given graph

• Random graphs with any given degrees Diameter of random power law

graphs

• Percolation and giant components in a graph• Correlation between vertices xxxxxxxxxxxThe pagerank of a graph• Graph coloring and network games

Page 58: Fan Chung Graham University of California, San Diego.

A disease contact graph

Jim Walker 2008

Page 59: Fan Chung Graham University of California, San Diego.

For a given graph G,retain each edge with probability p.

Contact graph

infection rate

Percolation on G = a random subgraph of G.

Gp :

Example: G=Kn, G(n,p), Erdös-Rényi model

Question: For what p, does Gp have a giant xxxxxxxxxcomponent?Under what conditions will the disease spread to a large population?

Page 60: Fan Chung Graham University of California, San Diego.

Hammersley 1957, Fisher 1964 ……

Percolation on graphs

Erdös-Rényi 1959

History: Percolation on• lattices

• d-regular expander graphs

Ajtai, Komlos, Szemerédi 1982

• hypercubes

• Cayley graphsMalon, Pak 2002

Bollobás et. al. 2008

Frieze et. al. 2004

• dense graphs• complete graphs

Alon et. al. 2004

Page 61: Fan Chung Graham University of California, San Diego.

Percolation on general sparse graphs

Percolation on special graphs or dense graphs

Page 62: Fan Chung Graham University of California, San Diego.

Percolation on general sparse graphs

Theorem (Chung,Horn,Lu 2008)

For a graph G, the critical probability for percolation graph Gp is

p =1%d

provided that the maximum degree of ∆

satisfies

Δ =o

%d

⎝⎜⎞

⎠⎟

under some mild conditions.

Page 63: Fan Chung Graham University of California, San Diego.

Percolation on general sparse graphs

Theorem (Chung+Horn +Lu)

For a graph G, the percolation graph Gp contains a giant component with volume

p =

1%d,

provided that the maximum degree of ∆

satisfies

Δ =o

%d

⎝⎜⎞

⎠⎟under some mild conditions.

max(2d log n, Ω( vol G)

Questions: Tighten the bounds? Double jumps?

Page 64: Fan Chung Graham University of California, San Diego.

Several examples

• Diameter of random trees of a given graph

• Random graphs with any given degrees Diameter of random power law

graphs

• Percolation and giant components in a graph• Correlation between vertices xxxxxxxxxxxxxThe pagerank of a graphs • Graph coloring and network games

Page 65: Fan Chung Graham University of California, San Diego.
Page 66: Fan Chung Graham University of California, San Diego.

What is PageRank?

PageRank is a well-defined operator

on any given graph, introduced by

Sergey Brin and Larry Page of Google

in a paper of 1998.

Answer #1:

Answer #2:PageRank denotes

quantitative correlation

between pairs of vertices.See slices of last year’s talk at http://math.ucsd.edu/~fan

Page 67: Fan Chung Graham University of California, San Diego.

What does a sweep of PageRank look like?

Page 68: Fan Chung Graham University of California, San Diego.

Several examples

• Diameter of random trees of a given graph

• Random graphs with any given degrees Diameter of random power law

graphs

• Percolation and giant components in a graph

• Graph coloring and network games

• Correlation between vertices xxxxxxxxxxxxxThe pagerank of a graphs

Page 69: Fan Chung Graham University of California, San Diego.

Michael Kearns’ experiments on coloring games 2006

Page 70: Fan Chung Graham University of California, San Diego.

Michael Kearns’ experiments on coloring games 2006

Page 71: Fan Chung Graham University of California, San Diego.

Coloring graphs in a greedy and selfish way

Classical graph coloring

Chromatic graph theory

Coloring games on graphs

Page 72: Fan Chung Graham University of California, San Diego.

Applications of graph coloring games

• dynamics of social networks

• conflict resolution

• Internet economics

• • •

• on-line optimization + scheduling

Page 73: Fan Chung Graham University of California, San Diego.

A graph coloring game

At each round, each player (vertex) chooses a color randomly from a set of colors unused by his/her neighbors. Best response myopic

strategyArcante, Jahari, Mannor 2008

Nash equilibrium: Each vertex has a different color from its neighbors.

Question: How many rounds does it take to converge to Nash equilibrium?

Page 74: Fan Chung Graham University of California, San Diego.

A graph coloring game

Theorem (Chaudhuri,Chung,Jamall 2008)

∆ : the maximum degree of G

If ∆+2 colors are available, the

coloring game converges in O(log n) rounds.If ∆+1 colors are available, the coloring game may not converge for some initial settings.

Page 75: Fan Chung Graham University of California, San Diego.

Improving existing methods

• Probabilistic methods, random

graphs.

• Random walks and the

convergence rate

• Lower bound techniques

• General Martingale methods

• Geometric methods

• Spectral methods

Page 76: Fan Chung Graham University of California, San Diego.

New directions in graph theory

• Diameter of random trees of a given graph

• Random graphs with any given degrees Diameter of random power law

graphs

• Percolation and giant components in a graph• Correlation between vertices xxxThe pagerank of a graphs • Graph coloring and network games • Many new directions and tools ….