Mapping a country’s Internet Topology using RIPE Atlas · 2019-09-11 · • RIPE Atlas is a global active measurement platform • Based on multiple lightweight probes Over 9100+

Mapping a country’s Internet Topology using RIPE Atlas Sebastian Castro -- NZRS NZNOG 2017, Tauranga

•  Improve understanding of the Internet connectivity at a country level Started with New Zealand, applicable to any country

•  Checking with evidence about common (mis)conceptions Better informed decisions

•  Finding oddities, strange behavior Traffic destined to the country leaving the country Use and benefit of IXs

Motivation

NZNOG'17 IP Topology Map 2

•  Create reproducible research By making code available Methodology available Data available

•  Generate a visual representation of BGP adjacencies derived from IP paths Added with analytics Allow anybody to explore and draw their own conclusions

Goals


•  RIPE Atlas is a global active measurement platform https://atlas.ripe.net

•  Based on multiple lightweight probes Over 9100+ probes around the world 82 probes in NZ Aiming for full NZ coverage

At least one probe per ASN

•  Probes hosted by volunteers •  Measurement data is publicly available

RIPE Atlas


RIPE Atlas in NZ


ASN AS Name Number of probes

4771 Spark New Zealand 5

9500 Vodafone NZ 5

9790 CallPlus 5

4768 TelstraClear 3

55850 TrustPower 5

23655 Snap Internet 4

4648 Global Gateway 0

38793 Two Degrees 0

58600 Flip Services 0

55853 Megatel 0

55872 BayCity Communications 0

133579 MyRepublic 2

•  Network for Learning (AS133420) •  University of Auckland (AS9431) •  University of Otago (AS38305) •  2talk (AS55561) •  University of Canterbury (AS9432) •  Victoria University of Wellington

(AS23905) •  Unifone (AS45637) •  Wireless Nation (AS24111)

Seeking to host probes at


•  Use RIPE Atlas probes as starting point Generate and collect as many IP paths as possible

•  Select a reasonable number/quality of destinations 1.  RIPE Atlas probes public address 2.  Curated list of popular sites (Alexa minus

undesirable sites) 3.  Active IPv4 addresses in the country address space

BGP views + https://censys.io datasets

•  Select reasonable traffic to use UDP traceroute unreliable ICMP Paris available TCP traceroute testing pending

Methodology


•  Deal with incompleteness You can’t map to ASN

Star nodes Host that don’t respond to ICMP probing Private addresses Non-routable addresses Some internal routing within ISP AWS

IXP addresses Most of them visible using PeeringDB

Methodology


Hop Name AS Guessed AS

Probe 17594 133579 133579

Private 17594-1 Priv 133579

* X0 133579

131.203.224.57 9503 9503

122.56.118.165 4648 4648

* X0 4648

125.236.192.9 4771 4771

* X0 4771

125.236.218.204 4771 4771

•  Patching up the path •  Star nodes (addresses

not answering) and private addresses can’t be mapped to ASN

•  Assume inter-AS edges will answer ICMP with public addresses

•  Assume start/private nodes happen inside AS.

Methodology


•  IpTopologyMap https://github.com/NZRS/IpTopologyMap Fetch BGP data using BGPStream (CAIDA) Determine country’s IPv4 address space from RIR and BGP data Select sources and destinations Schedule traceroutes Collect results Combine Visualize

Code


•  NZ IP Topology Map •  http://ip.topology.net.nz/

NZ_20160922/ •  http://ip.topology.net.nz/

NZ_20170124/

•  Legend •  Red: IX •  Blue: In-country AS •  Yellow: Secondary

country •  Green: any other

country •  Orange: Tier1

Results


Metadata •  78 probes •  32225 traces

•  68.67% complete •  31.33% incomplete

•  Trace length •  10 hops +/- 4

Observations •  Most influential providers are

Australian •  New IXPs are gaining traction

•  AKL-IX and MegaIX •  APE and WIX are well

established

•  Big providers peer with each other •  SPARK and CLIX/Vodafone

A view of NZ (Sep-2016)


Metadata •  82 probes •  56444 traces

•  70.37% complete •  29.63% incomplete

•  Trace length •  10 hops +/- 4

Observations •  APE and AKL-IX neck

to neck •  APE, 71 detected peers.

AKL-IX, 66 detected peers

•  BGP: APE 83 peers, AKL-IX, 55 peers.

A view of NZ (Jan-2017)


ASN Sep 2016 Jan 2017

APE 71 71

WIX 37 46

AKL-IX 56 66

Mega-IX AKL 32 50

Vocus/AS4826 70 56

FX/AS9503 61 103

Spark/AS4648 55 63

Comparison


•  NOTE: there is randomness in the destination sampling •  TODO: compare ground truth (BGP adjacencies) with discovered

peers •  Open Questions

•  peering transfer from Vocus to FX? •  APE growth affected by the AKL-IX and Mega-IX AKL presence?

•  Is the topology turning more resilient, increased path resilience?

•  Spain Topology •  http://

ip.topology.net.nz/ES-20160914/

•  Metadata •  115 probes •  65052 traces

•  Complete: 72.27% •  Incomplete: 27.73%

•  Trace length •  12 +/- 4

Results


•  Clicking in a node highlights the neighbors Display Organization, number of detected peers and country

•  Clicking an edge shows the addresses involved in that edge

•  Search for specific ASN •  Discover the path between two endpoints •  Data used is available as JSON file

Network representation in GraphML format

Your time to play


•  CAIDA https://www.caida.org/research/topology/

•  IXP Country Jedy https://github.com/emileaben/ixp-country-jedi Emile Aben, RIPE NCC

Related work


•  We all love IXP Country Jedi •  Now you can generate IXP Country Jedi

from this Example: http://ip.topology.net.nz/NZ_20160922/IXP_Country_Jedi/

IXP Country Jedi integration


•  Potential Bias on sources Clue core Not enough diversity

•  Not all destinations covered A bit of a scale problem A bit of a “what’s visible” problem

•  ICMP Traceroute not fully reliable Possibly better with TCP traceroute

Caveats


•  Automate analytics process Link RTT estimation

•  Run process regularly Path detection changes New actors entering the market

•  Make data snapshots available Simple format Raw traceroutes

Future Work


Contact: www.nzrs.net.nz

[email protected]

Thanks!

21

Mapping a country’s Internet Topology using RIPE Atlas · 2019-09-11 · • RIPE Atlas is a global active measurement platform • Based on multiple lightweight probes Over 9100+

Documents