Technology for Using High Performance Networks or How to Make Your Network Go Faster…. Robin Tasker ([email protected]) UK Light Town Meeting 9 September.

Technology for Using High Performance Networks

or

How to Make Your Network Go Faster….

Robin Tasker ([email protected])

UK Light Town Meeting9 September 2004

Presenter Name

Facility Name

One Terabyte of data transferred in less than an hour

On February 27-28 2003, the transatlantic DataTAG network was extended, i.e. CERN - Chicago - Sunnyvale (>10000 km).

For the first time, a terabyte of data was transferred across the Atlantic in less than one hour using a single TCP (Reno) stream.

The transfer was accomplished from Sunnyvale to Geneva at a rate of 2.38 Gbits/s

Throughput? What’s the problem?

Presenter Name

Facility Name

Just the Internet2 Land Speed Record…

OK

We can get transatlantic rates of 6.5 Gbits/s, but how was that done?

What’s the magic?

So you thought 2.38 Gbits/s was good?

Presenter Name

Facility Name

InternetInternet

Regional Regional

RegionalRegional

Campus

Campus

Campus

Campus

Client

Server

Just a Well Engineered End-to-End Connection

End-to-End “no loss” environment from CERN to Sunnyvale!

At least a 2.5 Gbits/s capacity pipe on the end-to-end path

Processor speed and system bus characteristics

TCP Configuration – window size and frame size (MTU)

Network Interface Card and associated driver and their configuration

A single TCP connection on the end-to-end path

Memory-to-Memory transfer; no disk system involved

No real user application

That’s to say the devil is in the detail…

Sorry. No magic here…..

Presenter Name

Facility Name

Campus

Campus

Campus

Campus

Client

Server

UK LightUK Light

Just a Well Engineered End-to-End Connection

End-to-End “no loss” environment

At least a 2.5 Gbits/s capacity pipe on the end-to-end path

Processor speed and system bus characteristics

TCP Configuration – window size and frame size (MTU)

Network Interface Card and associated driver and their configuration

A single TCP connection on the end-to-end path

Memory-to-Memory transfer; no disk system involved

No real user application

Even with UK Light, the devil is in the detail …and it’s harder!

And how about the same across UK Light?

Presenter Name

Facility Name

The Easy Bits…. :-)

End-to-End “no loss” environment

At least a 2.5 Gbits/s capacity pipe on the end-to-end path

Processor speed and system bus characteristics

TCP Configuration – window size and frame size (MTU)

Network Interface Card and associated driver and their configuration

Presenter Name

Facility Name

Read the Details Here

http://grid.ucl.ac.uk/nfnn.html

Presenter Name

Facility Name

Now for the hard bits…

Presenter Name

Facility Name

A Single TCP Connection

Presenter Name

Facility Name

Fortunately there’s good news!

Standard TCPRecovery >10 minutes

Scalable TCPVery rapid recovery

High Speed TCPRapid recovery

Comparison of TCP stack performance under loss rate of 1 in 10**6, RTT=108ms

Presenter Name

Facility Name

Memory to memory; no disk system

High Speed TCP transfer using Iperf,i.e. no disk system and no application

Web100 records of High Speed TCPduring a http-Get data transfer, i.e.disk system but no application

Presenter Name

Facility Name

Understanding disk systems

Presenter Name

Facility Name

No real user application

High Speed TCP transfer using Iperf,i.e. no disk system and no application

Web100 records of High Speed TCPduring a http-Get data transfer, i.e.disk system but no application

Web100 records of High Speed TCPduring a GridFTP data transfer, i.e.disk system and real userapplication

Presenter Name

Facility Name

Understand your Application

It’s YOUR application, so remember

Three Golden Rules

Benchmark!

Benchmark!!

Benchmark!!!

Presenter Name

Facility Name

Book Early!!!

- Pro

visi

onal

ly -

Tues

day

1st –

Wed

nes

day

2nd M

arch

2005

NeS

C

http://grid.ucl.ac.uk/nfnn.html