Updates of Networking in AP CCIRN at Cairns July 3, 2004 Shigeki Goto/Yong-Jin Park/Xing Li/George Mclaughlin/Simon Lin.

Updates of Networking in AP

CCIRN at CairnsJuly 3, 2004

Shigeki Goto/Yong-Jin Park/Xing Li/George Mclaughlin/Simon Lin

APAN Updates

• APAN Bylaws were approved by APAN Primary members on May 19, 2004.

• Professor Shigeki Goto was appointed as APAN Chair in June 2004.

Korea Japan

China

Philippines

Singapore

Malaysia

Thailand

1.2Gbps

1Gbps

155Mbps155 + 45Mbps

90Mbps

310Mbps

8Mbps

2Mbps

1.5Mbps(Satellite)

1.5Mbps(Satellite)

1.5Mbps (Satellite)

1.5Mbps (Satellite)

1.5Mbps(Satellite)Taiwan 155Mbps

Hongkong

5Gbps

APIITEIN

TransPAC

Indonesia

1.5Mbps( Satellite)

KR

TW

JP

TH

MY

ID

SG

HK

PH

APIIAPII

EUGEANT

34Mbps

CN

Australia

AU

USA

STARTAPSTARLIGHT

Sri LankaSL

1.5Mbps( Satellite)

APAN Link Status as of May 2004

2x155 Mbps

5Gbps

Countries Network Bandwidth(Mbps) Availability AUP/Remark

AU-JP AARNet 155 (plan) R&E

AU-US AARNet 310 Now R&E, 20Gbps in 2004Q2

CN-HK CERNET 622 Now R&E, (1~2.5Gbps in 2004)

CN-HK CSTNET 155 Now R&E, 2.5Gbps in 2004

CN-JP CERNET 155 Now R&E

CN-JP CERNET 45 Now Native IPv6

CN-UK CERNET 45 Now R&E

CN-US CERNET 155 Now R&E

CN-US CSTNET 155 Now Research

HK-US HARNET 45 Now R&E

HK-TW HARNET/TANET 100 Now R&E

JP-HK APII 45 Now R&E, (2.5Gbps in 2004Q2)

JP-ID AI3(ITB) 2/1.5 Now R&E

JP-KR APII 2Gbps Now Research (APII)

JP-LK AI3(ICT) 1.5/0.5 (plan) R&E

JP-MY AI3(USM) 1.5/0.5 Now R&E

JP-PH AI3(ASTI) 1.5/0.5 Now R&E

JP-PH MAFFIN 6 Now Research

JP-SG AI3(SICU) 1.5/0.5 Now R&E

JP-SG 　 1Gbps (plan) R&E

JP-TH AI3(AIT) 1.5/0.5 Now R&E

JP-TH SINET (ThaiSarn) 2 Now R&E

JP-US TransPac 5 Gbps Now R&E, (20Gbps in 2004)

JP-VN AI3(IOIT) 1.5/0.5 Now R&E

APAN Link Status (1) as of May 2004

Countries Network Bandwidth(Mbps) Availability AUP/Remark

KR-CN APII 155x2 2004Q3 R&E

KR-FR KOREN/RENATER 34 Now Research (TEIN)

KR-SG APII(KOREN) 8 Now R&E

KR-US KOREN/KREONet2 1.2G Now R&E

LK-JP LEARN 2.5 Now R&E

MY-TH TEMAN/ThaiSarn 8~45 (plan) R&E

SG-US SingaREN 90 Now R&E

TH-US Uninet 155 Now R&E

TW-HK ASNET/TANET 155 Now R&E

TW-JP ASNET/TANET 622 Now R&E

TW-US ASNET/TANET 5G Now R&E

TW-UK ASNET/TANET 155 Now R&E, through US

US-JP IEEAF 10.6Gbps 2003 Q4 R&E

Non APAN Links 　

Countries Network Bandwidth(Mbps) Availability AUP

IN-CH LHC 155 2004 Research (HEP)

IN-US/UK ERNET 16 Now R&E

JP-(US)-EU SINET 155 Now R&E / No Transit

JP-US SINET 5 Gbps Now R&E / No Transit

APAN Link Status (2) as of May 2004

Japan

List of Events & Plan after APAN Busan meeting (2003.8)

•- TransPAC link•- Tokyo-China link•- Bandwidth challenge at SC2003•- Tokyo-Honolulu link-- Japan-Philippines link upgrade-- Hawaii Workshop jointly with Internet2, etc.

TransPAC link

Current TransPAC (2.5 Gbps x 2)

Shima South

Maruyama

KDDI Otemachi Manchester

MorroBay

KDDI LA

Abilene LA

StarLight(Chicago)

(1) KDDI Otemachi---Maruyama---Manchester---KDDI LA---Abilene LA

(2) KDDI Otemachi---Shima South---MorroBay-----KDDI LA----StarLight

Japan-US Cable

Link Owner of JP side has been changed from JST into NICT in Nov. 1 , 2003

TransPAC Network Topology

OC-48 link will be upgraded into OC-192 shortly.

To be connected to LaLaLAN

TransPAC links of OC192 (planned)

• Tokyo-Chicago– SONET OC192 – STS-12c x 16 (possible to change into STS192c, STS48c x 4 etc)– TokyoXP - Carrier-LA : Preemptive , Carrier-LA - NWU : Low Priority– Tokyo : APAN TokyoXP , Chicago : StarLight

• Tokyo-LA– SONET STS192c– TokyoXP - Carrier-LA : Protected , Carrier-LA - Abilene : protected– Tokyo : APAN TokyoXP , LA : Abilene

Tyco Shinagawa Tyco LA

Tokyo XP

TransLIGHT

Carrier-LA

Abilene

CHIN

Lambda

RouterCarrier ADM (NEC Product)

SONET OC-192STS12c x 16 (initial)

SONET OC192STS12c x 16 (initial)Low Priority

10GigE

Pro8812+OC192 POS

Cisco ONS15454+ML x 4+OC192IR x 1+XC-10G x 1

Cisco ONS

SONET STS192c

SONET STS192cProtected

Cisco ONS15454+ML x 4+OC192IR x 1+XC-10G x 1

SL Switch

LOSA

Carrier ADM

China – JP Link

Link upgrades & Plan• Beijing-Tokyo link was upgraded from

10Mbps into 45Mbps in November, 2003.• But the link is almost fully used, and the

further upgrade is expected.• Hong Kong – Tokyo link is the cost-

effective solution, and NICT is studying to install the link of 2.4Gbps.

• APAN-JP will peer with both CERNET and CSTNET in Hong Kong. TANET2 and HARNET will join the peerings later on.

China – Japan Gigabit Links (planned)

SiSi

SiSi

APAN GbE

TransPAC

2.5Gbps x 2

10Gλx 2 in 2004

SL

CERNETCSTNET

2.5Gbps SONET (2.5Gbps x 2 in future)GbE/SONET Converter GbE/SONET

Converter

WIDE DIX-6

SiSi

apan

SiSi

SiSi

WIDE DIX-4 SINET

JGN

SiSi

Genkai GbE

KR

Dragon Tap & CNGI XP

Conv.

JAPANChina

2.5Gbps SONET

LA

IPv6 GEIPv4 GE

SiSi

SiSi

SiSiSiSi

E over MPLS

SiSi

SiSi

6TNet

BUPT

Bandwidth challenge at SC2003

SC2003 Bandwidth Challenge

• Three awards by APAN-JP members:• 1. Application Award: "Multi-

Continental Telescience,"

• 2. Distance x Bandwidth Product & Network Technology Award: "Transmission Rate Controlled TCP on Data Reservoir”

• 3. Distributed Infrastructure Award: "Trans-Pacific Grid Datafarm,"

Tokyo-Hawaii link

U-Hawaii has OC3 circuit over Japan-US cable

U-Hawaii & Japan have worked together for establishing the links:

- 45Mbps link donated during iGrid 2000

- 45Mbps TransPAC link in 2001.1-12

< This link was cut off when TransPAC link was upgraded into 622Mbps.>

- 155Mbps U-Hawaii link from 2004.1

19

Why is Hawaii so important?

• Ethnic gene pool and diversity and disease population

• Lifestyle and cultural similarities to Japan• Demographics of Hawaii can not be

duplicated anywhere else in the United States.• The healthcare industry in Hawaii is unified

with the University of Hawaii in the area of teaching and research

• 25-year track record of collaboration between Japan and Hawaii cancer researchers

MRTG grpah of Tokyo-Honolulu link

APAN Remote Medical Conference was held yesterday in Cairns via

Hawaii.

Japan-Philippines link upgrade

New Japan-Philippines link (2MbpsX3)

The link was upgraded from 768kbps into 6Mbps, but is almost fully used!

Hawaii Workshop

• - APAN organized Workshop jointly with Internet2, etc. in Hawaii in 2001.1 and 2004.1.

- - Both workshop were very productive for both USA and Asian countries. Join Techs Workshop recorded the biggest number of participants.

Korea

International Link Update

• KR-US: 1.2Gbps• KR-JP: 1Gbps• KR-SG: 8Mbps• KR-EU (TEIN): 34Mbps• KR-CN: 155Mbps(CERNET) +

155Mbps(CSTNET) (2004Q3)

Seoul

Daejun

Daegu

Busan

Gwangju

Suwon

GSR

GSR

155 M

JGN(JP)

1 G

ATM Switch

155Mbps

2.5Gbps

Router

Remark

DWDM

40 Gbps

Gigabit SwitchGSR

GSR

6 M

10 M

Backbone : 40G ~ 2.5G

Access Network : 1G ~ 155Mbps

KOREN Topology

GSR

STARTAP(USA)

GEANT(EU)

SingAREN(SG)

GSR

1G*5

GSR

GSR GSR

GES GES

GES

GSR

GES

DWDMDWDM

Seoul GigaPOP

40 G

Daejun GigaPOPGwangju GigaPOP Daegu GigaPOP

Busan GigaPOP

GSR

GSR

GSR2.5Gbps

GSR

KOREN Update (Year 2003)

10Gbps Triangle After 2006

Proposed C-J-K Infra.

KRKR

JPJP

CNCN

1Gbps

45M/155M (initial)

2.5Gbps (future)

20Mbps(2.5G future)

CRL, JGN

KOREN

2.5Gbps(future)

DRAGONTAP

Research Labs.

UniversitiesGovernment

Orgs.Industrial

Labs.Supercomput

er UsersEtc. Total

45 50 14 57 95 40 298

KREONET/KREONet2 II

Domestic Lambda Networking I

10G

Seoul

2.5G10G

5G

SeoulSuwon

Incheon

Chungnam

Jeonju

Kwangju

Daejeon

Changwon

Busan

Daegu

Pohang

Core Router

Legend

ONS15454

Access Router

GigE Switch

10G

2.5G

WDM 120GWDM 120G

2.5G

10G

2.5G

2.5G2.5G

2.5G

5G

5G

Domestic Lambda Networking

KREONet2KREONet2Layer 2 / Layer 1 networkLayer 2 / Layer 1 network

Lightpath Provisioning System based on User

Applications

Layer 3 Traffic Engineering

GridApplications

e-ScienceApplications

SupercomputingApplications

KREONet2Routers

Point-to-point lightpath

OperationsManagement

International Lambda Networking Participation in Global-scale Lambda Networking

• KR-North America : KR-CA-US• Global lambda networking : EU, Asia (JP, CN, TW), etc.

Chicago

STM-4 * 2

Seattle(PW)

APII-testbed/KREONet2

KREONET/SuperSIReNCA*Net4 Global Lambda

NetworkingSTAR LIGHT

6KREONET and Testbed I

SuwonSeoul

Incheon

Daejeon

CheonanCheonan

GwangJu

JeonJuJeonJu

ChangwonChangwonBusan

PohangPohang

Daegu

2.5G2.5G

2.5G2.5G

1010GG

2.5G2.5G 5G5G

2.5G2.5G5G5G

2.5G2.5G

2.5G2.5G5G5G

Cisco GSR

Cisco OSR/Catalyst

Cisco Router

IPv4/IPv6

IPv4

IPv6 Applications- Supercomputer/ Cluster- Information/ DB- News, FTP, Etc.

IPv6 Applications- Supercomputer/ Cluster- Information/ DB- News, FTP, Etc.

• KREONET IPv4/IPv6 Dualstack Network

• KREONET IPv6 sTLA : 2001:320::/32

• IPv4/IPv6 Dual Network

- Seven 6GigaPoPs

• IPv6 Transition : 6to4, ISATAP

• ITN : 6TAP, Internet2, CA*net4

• IPv6 Services

- DNS, Web, Whois

- IPv6 Traffic Measurement

- IPv6 monitoring (Looking Glass)

during 2002-2004, 7 institutes, 10Gbps regional testbed

10 Gbps

10 Gbps

10 Gbps

1 Gbps

10 Gbps

10 Gbps

1Gbps

10 Gbps

10 Gbps

54 Mbps(wireless)

54 Mbps(wireless)

1~10 Gbps link(wire)

54Mbps link(wireless)

1Gbps(예정 )

SuperSIReN

~1.5 Gbps link(FSO)

Gbps(FSO)

Hyunhae / Genkai

10 Gbps

10 Gbps

45 Mbps45 Mbps

1Gbps

10Gbps

10 Gbps

54 Mbps(wireless)

54 Mbps(wireless)

1~10 Gbps link(wire)

54Mbps link(wireless)

10Gbps

SuperSIReN

~1.5 Gbps link(FSO)

~1.5~1.5 Gbps(FSO)

1 Gbps(예정 )

10Gbps

10Gbps

10Gbps

10Gbps

10Gbps10Gbps

APIIAPII

SuperSIReN II

Daejeon GSR 12416

Catalyst 6506

Catalyst 6509

OSR 7613

5G 5G

10G

ONS 15454

ONS 15454

ONS 15454

ONS 15454

ONS 15454

ONS 15454

ONS 15454

ONS 15454

ONS 15454

ONS 15454

ONS 15454

ONS 15454

ONS 15454

ONS 15454

DWDM(320G)

+ MSPP(10G)

ONS 15600

10G

10GbE/GbE

10GbE/GbE

SuperSIReN III (2005-2006)

China

CERNET Topology

CERNET Statistics

• 8 national Pops are connected via 2.5Gbps DWDM links

• 30 provincial Pops are connected via multiple 155Mbps

SDH links

• 38 GigaPops distributed in 36 cities, covering all the

provinces in Mainland China.

• 300 campus networks connect to their nearest Pops via

100Mbps-1Gbps links.

• 1,500 education and research institutions connected

• 15 million users

• 320 million students/school kids in mainland China

CSTNet Geographic Map

CSTNet Status

* International Bandwidth ： 155M+155M

* Domestic Interconnection with other

networks ： 2.5G+GE+155M*2+more

* International traffic ： 400-500GByte/Day

* Access network ： >1000

* Computer connected ： 250,000

* User ： nearly 1M

CNGI Project

北京

西安

武汉

合肥

上海

广州

成都

沈阳

天津

重庆

厦门

南京

10G

2.5G

兰州

（长春） （哈尔滨）

（大连）

（郑州）

（杭州）

（济南）

（长沙）

CERNET2 Backbone

CERNET NSFCNET CSTNET

GEANT

APAN

Abilene

CNGI-IX

STARLIGHT

CNGI-IX

Applications

• High Performance– Grid

• Realtime– Video and Virtual Laboratory

• Mobile– Distributed Monitoring and Applications

• Multicast– Large scale video conferences

Australia

Key Strategic Alliances• with Powerlink (North Queensland) and TransGrid (NSW) –

power utility companies that provided fibre to regional areas – resulted in gigabit capacity where not previously economically feasible

• with Australian Government and the Australian Research and Education Network Initiative (AREN) – provided funding to catalyse key regional initiatives

• with Southern Cross on SXTransPORT• with Leightons (construction company – 2 fibre pairs

across Australia as basis for AARNet3 and regional gigabit connectivity (eg to remote telescopes)

• with AUSAID (Australian Aid Agency) to provide a connection from the Fiji Campus of the University of the South Pacific to AARNet and global R&E networks

Gigabit capacity within Australia – challenges and

solutions•Poor response to request to carriers to make dark

fibre available– Solution: use AARNet’s carrier licence to carry out civil works

to lay our own fibre– Generally only needed to do once in any area after this

some players willing to sell/lease dark fibre•Poor response from traditional carriers for high

capacity connectivity to regional areas– Solution: form strategic alliances with power utilities for

mutual benefit– Now have affordable gigabit capacity in North Queensland

and inland NSW•Tasmania, an island state south of Melbourne,

monopoly carrier, no affordable high capacity option– Solution: form strategic alliance with State govt, gas pipeline

group to deploy alternative undersea cable capacity

Grasp the rare opportunities - NextGen

• Both of the two new fibre build initiatives in Australia went into receivership in 2003

• One of these (NextGen) had a footprint of fibre that was of great interest to AARNet’s clients (the universities, research bodies, especially the astronomers)

• AARNet made a bid in its own right initially, but ended up partnering with the construction company that built the network (Leightons)

• Concluded agreement on Christmas eve after a 5 months process• Provides 2 fibre pairs Australia wide (Brisbane to Perth)• 1st pair lit as 10 Gbps for inter-capital trunks• 2nd pair equipped by APL as regional fibre loops• Access to space in all capital city central offices and controlled

environment vaults (huts) along the routes

AARNet’s Australian Network

Overview - International Links

•Add drop offs to existing STM-1/OC3 (155Mbps)

– Mixed traffic - R&E and Commodity– University of South Pacific, Fiji– Possibly Auckland, New Zealand– Connects to 155Mbps path to Tokyo from Hawai‘i

•Dual STM-4 (622Mbps)–Commodity Internet transit - NTT/Verio and MCI– PAIX Palo Alto– Los Angeles

•“SX TransPORT” - Dual STM-64 (10Gbps) – Research and Education (R&E) traffic only - AUP– Hawai‘i - Manoa and Seattle (Abilene, CA*net 4, NLR)– Los Angeles (Abilene, TransPac, CENIC, CUDI)– Look to add Mauna Kea to Los Angeles path later

Dual 155Mbps circuits – regional and Pacific Island connectivity

•4-drop ring (4 unprotected circuits, MPLS, fast failover)

– Sydney-Suva (new)– Suva-Oahu (Hawaii) – and then to U Hawaii, Manoa– Oahu-Hillsboro – and then to Pacific Wave, Seattle– Hillsboro-Sydney

•AUSAID to provide funding for the University of the South Pacific to contract AARNet to provide connections to AARNet and the global R&E Networks (monopoly carrier issues)

•Interconnect at Hawaii with new Hawaii –Tokyo link•USPNet to other Pacific Islands to be upgraded

later•Possible connection of NZ later

AARNET’s Pacific Rim Network

Dual 622Mbps circuits – commodity traffic

Access Commodity Internet in Palo Alto–Connected to the PAIX peering fabric–Obtain transit from MCI and NTT/Verio–Peer with other organisations at PAIX

Add second commodity POP in Los Angeles

–Need to determine– data centre location– backhaul from Morro Bay (San Luis Obispo)– transit providers, at least one in common with Palo

Alto site

AARNET’s Pacific Rim Network

Dual 10Gbps circuits – SXTransPORT

Trans Pacific Optical Research Testbed •Major new partnership announced between AARNet and

Southern Cross Cable Network (SX) on 11 December 2003•Support from Australian Government•Dual 10Gbps circuits between Australia and US West Coast•Activation Q3/2004, Initial term 5 years, option for 5-year

term•AUP applies similar to Abilene•Advisory Board to be set up with reps expected from SX,

AARNet, global research interests•Will provide affordable high throughput access allowing

Australia to effectively participate in global e-science initiatives

•Will strengthen case for locating unique research facilities in Australia, eg Square Kilometre Array

AARNET’s Pacific Rim Network

A cooperative Pacific Rim model

AARNET’s International Connections

Taiwan

TW R&E Network International Connect

Japan

US-East

Hong Kong

HARNetNL-Amsterdam

AMSIX

622M

622M2.4G

6.2G (now) * 2.5 to Seattle * 3.7 to PAIX

2.4Gbps

US-West

SingaporeSingAREN

155M

622M + 1G

•High Energy Physics: Atlas, CMS, CDF (Academia Sinica, NTU, NCU)

•Bioinformatics: BioPortal, HealthGrid (Academia Sinica)

•Digital Archive Grid (Academia Sinica)

•Biodiversity Informatics (Academia Sinica)

•Parallel Computing Environment (Academia Sinica)

•eLearning (Academia Sinica)

•Access Grid (Academia Sinica & NCHC)

•Tele-Science (NCHC)

•Eco-Grid (prototyping by NCHC)

–National Land Use Monitoring & Analysis

–Structure Monitoring of Buildings for Earthquake Risk

–Flood Forecasting & Monitoring

–SARS Grid

–3D Imaging of Neural Structure of Fruit Fries•Moving to World-Wide Grid (WWG) and eScience

Grid Activities in Taiwan

•Take Advantage of Grid Technology to –Facilitate resource sharing and collaboration in Taiwan and with other academic institutes–Build up more robust IT Infrastructure–Federating distributed resources of computing, storage and data

•Learn from LCG/HEP to expand to other academic discipline, such as bioinformatics, and toward eScience

•Provide Secure, Reliable and Ubiquitous Services

Goals of Grid Development in AS

Contributions of Taiwan in LCGCollaborate ATLAS & CMS Teams in Taiwan

Acting as Tier-1 and Tier-2 Site for Data Challenge

LCG

LCG Core Site

2nd Grid Operation Center (GOC)

2nd Global Grid User Support (GGUS) Center

Participate LCG Technology Development

• Data Management

• Grid Technology

• Certification & Testing

• Application Software

• ARDA

• LCG1 Status– LCG-0 Deployed at March 19, 2003, just after RAL and CNAF

– ASGCCA Approved: June 12th, 2003

– Keep 2~6 Staffs Stationed at CERN from July 2003• Join GTA, DB, Application, and C&T teams for LCG Development

– LCG-1 Testbed Ready: July 30, 2003• Sep. 2: LCG1-1_0_0 Ready

• Oct.28: LCG1-1_1_0 Ready

• Nov. 7: LCG1-1_1_1.I Ready

• Dec.: LCG1-1_1_3 Ready

LCG System Deployment

RAL

FNAL

BNL

WEST1RegionGIIS

WEST2RegionGIIS

CERN

CNAF

LYON MOSCOW

FZK TOKYOEAST1RegionGIIS

EAST2RegionGIIS

EAST3RegionGIIS

TAIPEI(AS)

RegionA1GIIS

RegionA2GIIS

BDII ALDAP

BDII BLDAP

RB

RegionB1GIIS

RegionB2GIIS

CE1GRIS

CE2GRIS

SE1GRIS

SE2GRIS

SiteCGIIS

CE1GRIS

CE2GRIS

SE1GRIS

SE2GRIS

SiteDGIIS

CE1GRIS

CE2GRIS

SE1GRIS

SE2GRIS

SiteAGIIS

CE1GRIS

CE2GRIS

SE1GRIS

SE2GRIS

SiteBGIIS

Query

Register

secondary

primary

Current Status•Acting as the East GIIS

•LCG2 Deployment

–19/01/2004 Ready to be one of the 8 LCG2 Core Sites

–2/2004 Start supporting Data Challenge of Alice, CMS and ATLAS•Tier2 Sites in Taiwan will be ready and integrated in 1Q2004 (NTU, NCU & ASIP)

•Keep system availability to 99.8%

A second operations & support centre in Taipei

Grid Operations Centre at RAL

User Support Centre at FZK

LCG Global Operation and Support

• From WWW toward WWG– work with other institutes, especially in Asia, to develop

World Wide Grid infostructure together

• eScience– based on lessons learned from LCG, is extending Grid

technology to broader research areas applications

• Interoperability with other Grid Systems if needed

• Outreach and Collaboration– build a Grid supporting infrastructure with other Asian

Institutes

– promote LCG/ EGEE technology and applications

– collaborate in technology development and applications with other institutes, for example, Grid 3 in US

Future Works