5/12/011 eircom net IP Network Karl Jeacle [email protected].

5/12/01 1

eircom net IP Network

Karl [email protected]

5/12/01 2

Overview

• PoP locations

• Peering & transit

• Access network

• Architecture & routing

• Monitoring & tools

• Traffic patterns

5/12/01 3

PoP locations

5/12/01 4

PoP locations

• Ireland– Dublin, Cork, Galway, Limerick– 26 x dial pops

• International– 2 x London, Amsterdam, Frankfurt– 2 x New York

5/12/01 5

5/12/01 6

5/12/01 7

5/12/01 8

5/12/01 9

Peering

• INEX– Dublin - Irish ISPs & HEANET

• LINX– London - UK & Europe

• AMSIX– Amsterdam - Europe

• DECIX– Frankfurt - Europe

5/12/01 10

Transit

• Locations– London, Amsterdam, New York

• Providers– Have been / are customers of:

• MCI, Unisource, UUnet,• GTS/Ebone, KPN/Qwest,• Cable & Wireless, Teleglobe

– 95th percentile usage billing

5/12/01 11

Access Network

5/12/01 12

Dialup

• Access servers fed by ISDN PRAs• Hence all pops ISDN-capable• (Modems must be added for PSTN)

• Subscription product• 1891 number = reduced call rates• PSTN default, option of 64 / 128K ISDN

• Free product• “Geo” numbers = local call rates• PSTN and 64K ISDN

5/12/01 13

Dial PoP Network

5/12/01 14

Fixed Circuits

• Leased line• Typically 64/128/256/512/1024/2048• More recently, 34Mb/s

• Frame relay• 64K to 2Mb/s lines into national cloud• Single PVC from cloud to ISP

• ATM• Customer buys 34M or 155M ATM port• 2Mb/s to 155Mb/s PVC to ISP

5/12/01 15

Hosting

• Data centres– Crown Alley & Citywest

• Power, pipe & ping– Exchange power: batteries & generators– Dual 100mb/s VRRP connection– Basic monitoring– Additional bespoke services available

5/12/01 16

ADSL

• Initial rollout in greater Dublin area• Product options

– Speed: 512/128 or 1Mb/256– USB or ethernet– Single/multiple user– Download allowances

• PPPoE– “Preserves the dialup experience!”

5/12/01 17

Fixed Wireless

• eircom hold FWA licence

• Currently used for remote POTS

• 15km line of sight

• Potential for data services

• Data trials in 2002

5/12/01 18

Architecture & Routing

5/12/01 19

Pop Architecture

Core Network

core1 core2

sw itch1 sw itch2

edge1 edge2 edgeN

5/12/01 20

Vendor Equipment

• Cisco– Routers, switches, access servers

• Lucent– Access servers

• Foundry– Switches/routers

• Redback– Broadband access servers

5/12/01 21

Routing

• Static– Subnets assigned to customer links

• RIPv2– Legacy equipment

• OSPF– All loopbacks & connected interfaces

• BGP– Internal prefixes & global routes

5/12/01 22

OSPF

• Open Shortest Path First– IGP (Interior Gateway Protocol)– runs on all devices inside network– carries local connectivity information– provides

• shortest path route through network• default route for non-BGP speakers• relatively fast convergence time (~1 sec)

5/12/01 23

BGP

• Border Gateway Protocol• Used both internally and externally

• eBGP when used as EGP• announce eircom & customer routes• receive global routing table

• iBGP when used as IGP• carries global routes around network• injected with eircom customer routes

5/12/01 24

Multicast

• PIM-SM– Native multicast routing protocol

• MSDP & MBGP– Discover active multicast sources– Exchange routes to multicast sources

• IGMP– Dialup and ADSL access

5/12/01 25

Monitoring & Tools

5/12/01 26

Monitoring

• Custom-built monitoring system– Ping devices and link interfaces– Email notification by default– Pager notification on critical failure

• Any network device• Key links (e.g. international circuits)• 24 x 7 customers

– Weekly reports generated from logs

5/12/01 27

Monitoring (2)

• Graph utilisation with MRTG– link bandwidth– memory– CPU– device specific data

• active ports• active sessions• IP address pools

5/12/01 28

Tools

– Collect data• SNMP - perl library allows SNMP get/walk queries

• expect - automated login allows “show” command output

• syslog - swatch catches key events

– Process• perl, sh, sed, awk, tcl/expect

– Display• HTML: MRTG, RRDtool, perl/gd

5/12/01 29

Traffic Patterns

5/12/01 30

Dial Ports

5/12/01 31

Bandwidth

5/12/01 32

Questions?