International Connectivity and Atlantic Wave Overview SURA IT and HPC Committee Joint Meeting March 22, 2005 Don Riley.

International Connectivity and

Atlantic Wave Overview

SURA IT and HPC Committee Joint Meeting

March 22, 2005

Don Riley

2

New SURA IT Strategy – Highest Priorities

• Foundation-Building– Connectivity

• Regional (USA Waves, Crossroads)• National (National Lambda Rail, Internet2)• International Opportunities

– High Performance Computing– “Grids”

• Data storage• Middleware

• Program Development– SCOOP– Bio-Informatics/ Medical Research

3

Program PlanRegional and National Connectivity

• Goals– Secure new resources/tools to facilitate infrastructure improvements

• New partnerships• Secure federal and other sources of funding

– Build the Regional Infrastructure: SURA Crossroads• Evolving new role for MAX as key resource• AT&T Collaboration: Fiber First; Waves next (?)• Support and leverage SURA region NLR nodes• Facilitate other regional partnership and efforts

– Establish National and International Connectivity and Visibility• Leverage AT&T Collaboration Agreement

– USAWaves and National Buyers Consortium– Help complete/enhance NLR backbone to advantage of SURA region

– Impact digital divide issues• Drive down cost while improving physical connectivity

4

Program PlanInternational Connectivity

• Program Elements– Identify and engage with strategic international networking forums and projects

• National and Regional Networking groups– Internet2, NLR, CENIC, etc.– CANARIE, GEANT/DANTE, SURFNet, UKERNA, CERN, NORDUNet, etc.– APAN, TRANSPAC, AMPATH, ALICE/CLARA, etc.

• International Networking Initiatives– TransLight, EuroLink, SurfLight, UKLight, NorthernLight. Etc.– GLIF - Global Lambda Integrated Facility– HOPI (UCAID)

– Support and partner with international research collaborations• HENP, GOOS/IOS, BioGrid, eVLBI, etc.

– Partnership with IEEAF• New international fiber and lambda donations• Link and leverage with SURA/USAWaves and NLR

5

6

7

NSF International Research Network Connections (IRNC)(Kick-off March 11, 2005)

8

Map of International GLIF Initiative:Global Lambda Integrated Facility

www.glif.is Visualization courtesy of Bob Patterson, NCSA.

9

Thailand Regional Initiative: Next Generation Internet Announced by H.E.Dr. Surapong Suebwonglee, Minister of ICT, Thailand

January 26, 2005

10

International Connectivity for Collaboration

• Lots of point-to-point OC-x’s• Now increasing waves: 2.5G ’s, 10G ’s• NSF IRNC solicitation is generating more• GLIF

• Multiple POPs, connection points, “owners”• Numerous exchange agreements, AUPs, barriers to

transparent communications

• Increasing focus on neutral, open exchanges, distributed peering infrastructure

11

Another view of NSF IRNC

GLORIAD: Global Ring to China and RussiaGLORIAD: Global Ring to China and Russia

To EuropeTo EuropeTo Japan,To Japan,HongKong,HongKong,SingaporeSingapore P-WaveP-Wave

To Hawaii,To Hawaii,AustraliaAustralia

To AustraliaTo Australia

To Latin AmericaTo Latin America

12

U.S. International Peering Fabric

13

Removing Geographic Barriers

• Concept: an extensible, geographically dispersed peering fabric -- with open, neutral exchange/peering points

• Result: you connect at any one location on the fabric and have the option to peer with any other participant, regardless of where they are connected

Atlantic Wave: A New Paradigm for

International Peering (and more)on the East Coast

15

SURA and FIU/AMPATH: Now WHREN (Western Hemisphere Research and Education Network)

• SURA and FIU committed to interconnect AMPATH and NYC/MANLAN– Initially with 1Ge that SURA has under its

agreement with NLR– Then with 10G

• Important to include connectivity to MAX and its federal connections in DC area; leverage SURA investment in MAX

• Leverage SURA investment in SoX, role of SoX/SLR as southeast exchange point

16

Important East Coast International Peerings

• FIU/AMPATH, Miami - Latin America• NYC/MANLAN - multiple• MAX - Feds + GEANT

17

MANLAN, MAX & AMPATH

18

The Strategic Picture…

19

SURA Atlantic Wave Proposal

• ITSG (IT Steering Group) recommended and SURA Executive Committee approved:

– That SURA acquire a 10Gbps wavelength on the NLR backbone from Jacksonville to NYC and a switch to be placed in NYC, in support of the Atlantic Wave initiative (background and details follow).

– The estimated one-time expenditure of $481,472 be funded from the I.T. Fund.

20

Atlantic Wave Matching Commitments

• Significant matching funds are being committed by the various partners in Atlantic Wave (based on initial estimate):

• a. AMPATH (FIU): recurring costs of 10G wave from JAX to NYC - $ 35,823 per yr

• b. FLR and FIU/AMPATH: 10G wave from JAX to Miami – cost not yet known

• c. AMPATH: switch in Miami - estimated $150K• d. FLR: switch in Jacksonville - estimated $150K• e. ATL/SoX switch: SoX/SLR - estimated $150K• f. MAX: switch in DC/MAX - estimated $150K

21

AtlanticWave

• AtlanticWave is an International Peering Fabric along the East Coast– US, Canada, Europe, South America Plus….– Distributed IP peering points:

• NYC, WDC, ATL, MIA, SPB

• Described as an integral component of the WHREN-LILA proposal to extend LILA on the Atlantic side to MANLAN in NYC

• Establishes 10Gb wave from Miami to MAX/NGIX-E in DC and MANLAN/NYC over FLR and NLR with interconnects in Jacksonville and Atlanta

• Interconnects the Atlantic with international peering exchanges in TransLight/Chicago and the Pacific through CA*net4 and Pacific Wave (P-Wave)

• SURA, FIU-AMPATH-CHEPREO, the IEEAF, MAX, SoX/SLR, MANLAN, and in partnership with the Academic Network of Sao Paulo (ANSP) are combining efforts to establish AtlanticWave

• Complements the PacificWave distributed peering facility on the west coast

22

The Strategic Picture…

23

AtlanticWave Topology

• A-Wave will provide multi-layer/multi-protocol services between participating networks

– Layer 3 peering services over ethernet

– GLIF “light path” services– Others TBD

• A-Wave will provide a Layer 3 distributed exchange capability

– Ethernet based– Best effort packet exchange– Linear topology –

unprotected (NLR based)– 1 GE, 10GE LAN, 10GE

WAN client access– Jumbo frame support

24

A-Wave Layered Services

STS-(x)cLight Path 1

Inter-switchVLAN 1

Ethernet

…

GLIF Light Path ServicesDynamically Allocated

STS-(?)cLight Path 2

STS-(?)cLight Path 3

STS-(?)cLight Path n

…

Inter-switchVLAN 2

IP IP

IP (POS)

IP

Ethernet

IP

A-Wave backbone: OC192c Sonet wave over NLR

IP Peering ServicesStatically Provisioned

User defined sonet payload framing

VLAN(s)

VCAT/LCAS

VCAT = Virtual ConcatenationLCAS = Link Capacity Adjustment Scheme

Prepared by Jerry Sobieski

25

AtlanticWave Design

Prepared by Jerry Sobieski

26

Deployment Plans & Timeline

• Phase 1: Deploy backbone OC192c Sept 05– Between MIA-ATL, ATL-WDC, WDC-NYC

– 10Gbs WAN PHY ethernet over NLR wave initially.

– Migration of existing exchange switches/networks• Regional backhaul

• Reconfiguration of existing exchange services and networks

• Phase 2: Sonet switch deployment Dec 05– Map IP/Ethernet Peering Fabric across “appropriate” sized VCG (GFP-F &

VCAT)

– Engineer and deploy GLIF Common Services in conjunction with other GLIF domains

• Phase 3: Deploy dynamic light path services Mar 06

• Phase 4: Expansion Aug 06 ->– Integrate links between A-Wave, P-Wave, Northern Tier, etc