Principles in Communication Networks. Instructor: Prof. Yuval Shavitt, Office hours: room 303 s/w eng. bldg., Tue 16:00-17:00 Prerequisites ( דרישות קדם ): Introduction to computer communications (TAU, Technion, BGU) Expectations from students: probability Queueing theory basics - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
• Prerequisites (דרישות קדם):– Introduction to computer communications (TAU,
Technion, BGU)
• Expectations from students:– probability – Queueing theory basics – Graph theory
Course Syllabus (tentative)• Internet structure• Internet measurements• Measurement optimization• Measurement analysis• Introduction to switching, router types• Use of Gen. Func.: HOL analysis, TCP analysis.• Matching algorithms and their analysis• CLOS networks: non-blocking theorem, routing
algorithms and their analysis• Scheduling algorithms
Grade composition
• Final exam – 60%
• Project – 30%
• Home assignments (2-3) - 10%
Routing in the Internet
Routing in the Internet
Routing in the Internet is done in three levels:– In LANs in the MAC layer:
• Spanning tree protocol for Ethernet Transparent bridge.• Source routing for token rings
• Inside autonomous systems (ASes):– RIP, OSPF, IS-IS, (E)IGRP
• Between ASes:– BGP
Autonomous Systems• Autonomous Routing Domains: A collection of
physical networks glued together using IP, that have a unified administrative routing policy.
• An AS is an autonomous routing domain that has been assigned a number.
RFC 1930: Guidelines for creation, selection, and registration of an Autonomous System
… the administration of an AS appears to other ASes to have a single coherent interior routing plan and presents a consistent picture of what networks are reachable through it.
Internet Hierarchical Routing
Host h2
a
b
b
aaC
A
Bd c
A.a
A.c
C.bB.a
cb
Hosth1
Intra-AS routingwithin AS A
Inter-AS routingbetween A and B
Intra-AS routingwithin AS B
Policy: • Inter-AS: admin wants control over how its traffic
routed, who routes through its net. • Intra-AS: single admin, so no policy decisions
Performance: • Intra-AS: can focus on performance• Inter-AS: policy may dominate over performance
Why different Intra- and Inter-AS routing ?
RIP
• A distance-vector protocol – (distributed Bellman Ford)
• Developed in the 80s based on a Xerox protocol
• RIP-2 is now often used due to its simplicity
• Distance metric: minimum hop
OSPF / IS-IS
• Link state protocol – each node see the entire network map and calculate shortest paths using Dijksrta algorithm.
• Allows two level of hierarchy
• Authentication
• Complex
• IS-IS gain popularity among large ISPs
The structure of the Internet
How are routers connected?
• Why should we care?– While communication protocols will work
correctly on ANY topology– ….they may not be efficient for some
topologies– Knowledge of the topology can aid in
optimizing protocols
The Internet as a graph
• Remember: the Internet is a collection of networks called autonomous systems (ASs)
• The Internet graph:– The AS graph
• Nodes: ASs, links: AS peering
– The router level graph• Nodes: routers, links: fibers, cables, MW channels, etc.
– There are mid-level aggregation schemes• PoP topologies, city topologies
• How does it looks like?
Random graphs in Mathematics The Erdös-Rényi model
• Generation:– create n nodes.– each possible link is added with probability p.
• Number of links: np
• If we want to keep the number of links linear, what happen to p as n?
Poisson distribution
The Waxman model
• Integrating distance with the E-R model
• Generation– Spread n nodes on a large enough grid.– Pick a link uar and add it with prob. that
exponentially decrease with its length– Stop if enough links
• Heavily used in the 90s
0 10 20 30 40 50 60 70 80 90 1000
10
20
30
40
50
60
70
80
90
100
1999
The Faloutsos brothers• Measured the Internet
AS and router graphs.• Mine, she looks
different!
Notre Dame• Looked at complex
system graphs: social relationship, actors, neurons, WWW
• Suggested a dynamic generation model
The Faloutsos Graph1995 Internet router topology
3888 nodes, 5012 edges, <k>=2.57
SCIENCE CITATION INDEX
( = 3)
Nodes: papers Links: citations
(S. Redner, 1998)
P(k) ~k-
2212
25
1736 PRL papers (1988)
Witten-SanderPRL 1981
Sex-web
Nodes: people (Females; Males)Links: sexual relationships
Liljeros et al. Nature 2001
4781 Swedes; 18-74; 59% response rate.
Web power-laws
SCALE-FREE NETWORKS
(1) The number of nodes (N) is NOT fixed. Networks continuously expand
by the addition of new nodes
Examples: WWW : addition of new documents Citation : publication of new papers
(2) The attachment is NOT uniform.A node is linked with higher probability to a
node that already has a large number of links.
Examples : WWW : new documents link to well known sites (CNN, YAHOO, NewYork Times, etc) Citation : well cited papers are more likely to be cited again
Scale-free model(1) GROWTH : At every timestep we add a new node with m edges (connected to the nodes already present in the system).
(2) PREFERENTIAL ATTACHMENT : The probability Π that a new node will be connected to node i depends on the connectivity ki of that node
A.-L.Barabási, R. Albert, Science 286, 509 (1999)
jj
ii k
kk
)(
P(k) ~k-3
The Faloutsos Graph
100
101
102
103
104
100
101
102
103
104
node degree for AS20000102.m
Back to the Internet
• Understanding its structure and dynamics – help applications (WWW, file sharing)– help improving routing– predict Internet growth
• So lets look at the data….
…Data?
• The Internet is an engineered system, so someone must know how it is built, no?
• NO! It is an uncoordinated interconnection of Autonomous Systems (ASes=networks).
• No central database about Internet structure.
• Several projects attempt to reveal the structure: Skitter, RouteViews, …
The Internet Structure
routers
The Internet Structure
The AS graph
Revealing the Internet Structure
Revealing the Internet Structure
Revealing the Internet Structure
Revealing the Internet Structure
30 new links
7 new links
NO new links
Diminishing return!Diminishing return!
Deploying more boxes does not
pay-off
Revealing the Internet Structure
To obtain the ‘horizontal’ links we need strong presence in the edge
What is DIMES?
• Distributed Internet measurement and monitoring– Based on software agents downloaded by volunteers
• Diminishing return?– Software agents
– The cost of the first agent is very high– each additional agent costs almost zero
• Capabilities – Obtaining Internet maps at all granularity level
• 96% of the agents have less than 4 different vps
• High degree ASs tend to have more agents
• High number of measurements for all vps degrees
Diminishing Returns?Diminishing Returns?
• Barford et. al. – the utility of adding many vps quickly diminishes – In terms of ASes and AS-links
• Shavitt and Shir – utility indeed diminishes but the tail is long and significant–Tail is biased towards horizontal links
• We wish to quantify how different aspects of AS-level topology are affected by adding more vps
Creating topologies per VPCreating topologies per VP
sort by
Topology SizeTopology Size
• The return (especially for AS links) does not diminishes fast!
VP with small local topology can contribute many new links!
Direction of Detected LinksDirection of Detected Links
• For each link: Plot max adjacent AS degree and max adjacent ASes degree difference
Low degree difference – indicates tangential links and links between small-size ASes
High degree difference – indicates radial links towards the core
Convergence of PropertiesConvergence of Properties
• Taking several common AS-level graph properties, and analyze their convergence as local topologies are added–Keeping the sort order by number of links
• Slow convergence indicates the need to have broad and diverse set of vps
Density and Average DegreeDensity and Average Degree
Slow convergence of density and average degree – easy to detect ASes but difficult to find all links
Power-law and Max DegreePower-law and Max Degree
Fair convergence of power-law exponent
Fast convergence of maximal degree – core links are easily detects
Betweenness and ClusteringBetweenness and Clustering
Radial links decrease cc
Fast convergence of max bc – Level3 (AS3356), a tier-1 AS is immediately detected as having max bc
Tangential links increase cc
Revisiting Sampling BiasRevisiting Sampling Bias
• Lakhina et al. – AS degrees inferred from traceroute sampling are biased–ASes in vicinity to vps have higher degrees–Power-law might be an artifact of this!
• Dall’asta et al. – no…it is quite possible to have unbiased degrees with traceroutes
• Cohen et al. – when exponent is larger than 2, resulting bias is negligible
Evaluating Sampling BiasEvaluating Sampling Bias
• For each AS find:–All the vps that have it in their local topology–The Valley-Free distance in hops
Up-hill to the core (c2p), side-ways in the core (p2p) and down-hill from the core (p2c)
Dataset VPs and DistancesDataset VPs and Distances
Low degree ASes are seen from less vps than high-degree ASes…this makes sense!
In our dataset, most ASes have a vp that is only 1-2 hops away!
Average Distance per DegreeAverage Distance per Degree
Low degree ASes are seen from farther vps…sampling bias?
No real bias! •More VPs are located in high-degree ASes•There are high-degree ASes that are seen from “far” vps•Broad distribution – all ASes are pretty close-by to a vp!
Predicting Growth
OurGoal
• To measure the Internet evolution in time– AS level - too coarse– IP level - too fine
What the PoP is ?• PoP – Point of Presence of the ISP
OurGoal
• To measure the Internet evolution in time– AS level - too coarse– IP level - too fine– PoP level – strike the right balance
• Network size is reasonable
• Nodes are roughly the same size
• Has a good geographical grip (with some exceptions)
• Other uses of PoP maps– Network distance estimation
The Algorithm Input & Output
Pivot Idea: What is a graph representation of the POP?
• Comments in 2004 (expert meeting in UCSD)– It will never fly– You’ll be lucky to get 500 downloads in three
years– You’ll never be able to clean the noise– How will you deal with problemi (i=1,2,3,4,….)?
• Status in Feb 2010– Over 21,700 downloads (over 100 nations)– 1000-1200 active agents every day– Measuring from over 200 ASes every week– Data is used world wide by EE, CS, Phys, Econ– DIMES is highly cited