LambdaGRID the NREN (r)Evolution Kees Neggers Managing Director SURFnet Reykjavik, 26 August 2003.

LambdaGRID

the NREN (r)Evolution

Kees Neggers

Managing Director SURFnet

Reykjavik, 26 August 2003

2

SURFnet

• Provides the Dutch National Research Network• Not for profit company, 50 employees• 160 connected organizations, 500.000 users• Turnover (2002): 30M€• Infrastructure services:

– innovation paid for by government– cost effective exploitation for higher

education and research

3

SURFnet AUP

• Full service for Research and Higher Education Institutes

• All others, including industry, test and development activities for advanced applications

4

Over the last 5 years SURFnet’s innovation

engine is powered by:

•Budget 1999-2003: 70MEuro

Research Networking is the innovation engine between research and market introduction of new services

•Partnership with industry

5

GigaPort results

– SURFnet5 10 Gbit/s lambda based network up and running since mid 2001

– Fiber to the dormitories: 20,000 students via 10/100 Mbit/s switched Ethernet

– GigaMAN: Development of market for managed dark fiber in The Netherlands

– Access pilots/ mobility/ middleware– NetherLight: International testbed for lambda

networking– Playground for new applications

6

SURFnet5

• Partners BT and Cisco

• 15 PoPs connected by thirty 10 Gbit/s lambdas

• Dual stack IPv4 and IPv6 since 2001

• 500,000 users

• 60% customers connected at Gbit/s level

7

What did we learn

• Lambdas are an excellent basis for IP networking• Dark fiber and gigabit Ethernet is an excellent way to

connect customers• Researchers are interested in direct access to

lambda’s for high bandwidth, low jitter, low latency point tot point connections

• Incumbent operators were reluctant to sell dark fiber• Added value of network operators in NG NRENs is

limited• International cooperation in developing lambda

networking is essential

8

NREN challenge

• Accommodate needs of scientific users for higher speed, higher quality networking

• While protecting the performance of the network for current users

• And keeping the successful end-to-end model of the internet

9

Paradigm shift

SURFnet4 project GigaPort

DWDM

Lambdas

POS

1995

GigaPort NG

20041999

SURFnet4 networkSURFnet5 network

ATM

2008

• Next generation NREN is no simple extrapolation of current networks

SURFnet6 network

10

NetherLight

An optical Internet exchange point in Amsterdam built and operated by SURFnet to experiment with light path provisioning concepts for high-bandwidth, high quality internet traffic in a multi domain environment

11

NetherLight network 2001

• 2.5Gbit/s lambda between StarLight, Chicago, USA and NetherLight, Amsterdam, NL

• Lambda terminated on Cisco ONS15454 muxes,

– WAN side: SONET framed: OC48c– LAN side: GbE interfaces to computer

clusters

StarLight NetherLight

2.5G lambdaGbE

GbE

GbE

GbE

12

NetherLight Network 2002

• The iGrid2002 event brought many lambdas to Amsterdam

2.5 Gbit/s

2.5 Gbit/s SURFnet

2.5 Gbit/s SURFnet

10 Gbit/sLevel3

10 Gbit/s Tyco

2.5 Gbit/sCERN

DWDM SURFnet

ChicagoStarLightChicagoStarLight

New YorkNew York

CERNCERN

DwingelooASTRON/

JIVE

DwingelooASTRON/

JIVE

AmsterdamNetherLightAmsterdamNetherLight

CAnet

13

ATLAS Canada Lightpath trialTRIUMF Vancouver CERN Geneva

CANARIE2xGbE

circuits StarLight SURFnet 2xGbE

circuits

NetherLight

“A full Terabyte of real data was transferred at rates equivalent to a full CD in under 8 seconds and a DVD in under 1 minute” Wade Hong et al

14

NetherLight Network August 2003 Emerging international lambda grid

10 Gbit/sNSF

10 Gbit/s SURFnet

10 Gbit/sSURFnet

10 Gbit/s Tyco/IEEAF

DWDM SURFnet

GenevaCERN

GenevaCERN

DwingelooASTRON/JIVEDwingeloo

ASTRON/JIVE

PragueCzechLightPrague

CzechLight

2.5 Gbit/s CESNET

10 Gbit/sNSF

New York City

ChicagoStarLightChicagoStarLight

AmsterdamNetherLight

AmsterdamNetherLight

LondonUKLightLondonUKLight

StockholmNorthernLightStockholm

NorthernLight

2.5 Gbit/s DataTAG

Canet

15

10GBase-LR (SM fiber, = 1310nm) 1000BaseT (copper)1000BaseSX (MM fiber, = 850nm)1000BaseLX (SM fiber, = 1310nm)

DWDM line terminal(Cisco ONS15252)

Ethernet switch(Cisco 6509)

optical cross connect(Calient PXC)

L1 multiplexer(Cisco ONS15454)

Lambdas to Chicago, Geneva, Prague etc

DWDM to JIVE

Computer clusters

UvA/NIKHEF

NetherLight setup at SARA

16

What did we learn

• Point to point lambdas is a powerful service• Current Optical-Electrical-Optical equipment is

capable of allocating sub-lambdas to individual applications

• Management is still cumbersome• Hybrid network architecture seems to be the

only valuable NREN option for the future:– Packet switched internet for regular many-to-many usage– Light path switched internet for new high speed

few-to-few usage• LambdaGRID is needed

17

LambdaGrid

• A grid is a set of networked, middleware-enabled computing resources.

• A LambdaGrid is a grid in which the lambda networks themselves are resources that can be scheduled, like all other computing resources.

18

TransLight

• Emerging Global-Scale LambdaGrid for e-Science• Hub and spoke model, initially around StarLight

and NetherLight • Will not replace current best efforts networks• Major initial funding

– GigaPort Project (SURFnet) – US National Science Foundation (Euro-Link award

to University of Illinois at Chicago)– Canada's CANARIE

• “bring us your lambdas”

19

TransLight fabric

Red Lines: TransLight

Lambda Links, Funded

Blue Lines: TransLight

Lambda Links, Donated

Courtesy of Tom DeFanti UIC

20

SURFnet plans to continue innovation via

Next Generation Network

21

Scope GigaPort NG Network

22

Scope GigaPort Next GenerationF

un

cti

on

Civilinfrastructure

Generic application

services

Industryapplications

Networkinfrastructure

Grid Services

GigaPort NG Network

Virtual Laboratory

for e-Science

GigaPort NG Applications

e-Science e-Business

23

Design principles GigaPort NG Network

• Realization of a next generation network with seamless end-to-end communication:

– Integration of lambdas in the IP network– Multi-domain networking– Ethernet services as part of the WANs– Intelligence of networks and the associated

responsibilities at the edges

• Paving the way to a ubiquitous and scalable Services Grid

24

SURFnet6 overview

• Congestion free transparent end-to-end IP transport

– unicast and multicast; IPv4 and IPv6; all at wire speed

– 1 Gbit/s, 10 Gbit/s and beyond• Lambda services to eventually all connected

organizations • Layer 1: DWDM equipment• Layer 2: Ethernet equipment• Layer 3: Small routed core at 2 to 5 locations

25

SURFnet6 will be based on Dark Fiber

• Over 3000 km fiber pairs already available, average price paid for 15 year IRUs is 7 Euro/m per pair.

• More than 25 co-location facilities in use.

• Managed dark fiber infrastructure will be extended with new routes

26

SURFnet6 Call for Proposal for industrial partner(s)

• In June 2003 a Contract Notice has been published in the Official Journal of the EC to invite industrial partners to contribute to the final design of SURFnet6 and take responsibility for supplying, implementing, maintaining and supporting transmission, switching and routing equipment for SURFnet6

27

Timelines SURFnet6

28

Conclusion

• NREN users need new services that current networks will not be able to support

• Telecommunication infrastructures will become part of the grid and will be intergrated in scientific instruments

• NRENs do need to react carefully and timely to these developments.

• Lambda networking is not a revolution

[email protected]

www.surfnet.nl

www.gigaport.nl