Networks for HENP and ICFA SCIC Networks for HENP and ICFA SCIC Harvey B. Newman Harvey B. Newman California Institute of Technology APAN High Energy Physics.

Networks for HENP and ICFA SCICNetworks for HENP and ICFA SCIC

Harvey B. NewmanHarvey B. Newman California Institute of TechnologyCalifornia Institute of TechnologyAPAN High Energy Physics WorkshopAPAN High Energy Physics Workshop

January 21, 2003January 21, 2003

Next Generation Networks for Experiments: Goals and NeedsNext Generation Networks for Experiments: Goals and Needs

Providing rapid access to event samples, subsets Providing rapid access to event samples, subsets and analyzed physics results from massive data storesand analyzed physics results from massive data stores From Petabytes by 2002, ~100 Petabytes by 2007, From Petabytes by 2002, ~100 Petabytes by 2007,

to ~1 Exabyte by ~2012. to ~1 Exabyte by ~2012. Providing analyzed results with rapid turnaround, byProviding analyzed results with rapid turnaround, by

coordinating and managing the large but coordinating and managing the large but LIMITED LIMITED computing, computing, data handling and data handling and NETWORK NETWORK resources effectivelyresources effectively

Enabling rapid access to the data and the collaborationEnabling rapid access to the data and the collaboration Across an ensemble of networks of varying capabilityAcross an ensemble of networks of varying capability

Advanced integrated applications, such as Data Grids, Advanced integrated applications, such as Data Grids, rely on seamless operation of our LANs and WANsrely on seamless operation of our LANs and WANs With reliable, monitored, quantifiable high performanceWith reliable, monitored, quantifiable high performance

Large data samples explored and analyzed by thousands of Large data samples explored and analyzed by thousands of globally dispersed scientists, in hundreds of teamsglobally dispersed scientists, in hundreds of teams

Four LHC Experiments: The Four LHC Experiments: The Petabyte to Exabyte Challenge Petabyte to Exabyte Challenge

ATLAS, CMS, ALICE, LHCBATLAS, CMS, ALICE, LHCB Higgs + New particles; Quark-Gluon Plasma; CP ViolationHiggs + New particles; Quark-Gluon Plasma; CP Violation

Data storedData stored ~40 Petabytes/Year and UP; ~40 Petabytes/Year and UP; CPUCPU 0.30 Petaflops and UP 0.30 Petaflops and UP

0.1 to 1 Exabyte (1 EB = 100.1 to 1 Exabyte (1 EB = 101818 Bytes) Bytes) (2007) (~2012 ?) for the LHC Experiments(2007) (~2012 ?) for the LHC Experiments

LHC Data Grid HierarchyLHC Data Grid Hierarchy

Tier 1

Tier2 Center

Online System

CERN 700k SI95 ~1 PB Disk; Tape Robot

FNALIN2P3 Center INFN Center RAL Center

InstituteInstituteInstituteInstitute ~0.25TIPS

Workstations

~100-400 MBytes/sec

2.5 Gbps

0.1 to 10 Gbps

Tens of Petabytes by 2007-8.An Exabyte within ~5 Years later.Physics data cache

~PByte/sec

~2.5 Gbps

Tier2 CenterTier2 CenterTier2 Center

~2.5 Gbps

Tier 0 +1

Tier 3

Tier 4

Tier2 Center Tier 2

Experiment

CERN/Outside Resource Ratio ~1:2Tier0/( Tier1)/( Tier2) ~1:1:1

ICFA and Global Networks for HENPICFA and Global Networks for HENP ICFA and Global Networks for HENPICFA and Global Networks for HENP

National and International Networks, with sufficient National and International Networks, with sufficient (rapidly increasing) capacity and capability, are (rapidly increasing) capacity and capability, are essential foressential for The daily conduct of collaborative work in bothThe daily conduct of collaborative work in both

experiment and theory experiment and theory Detector development & construction on a global scale; Detector development & construction on a global scale;

Data analysis involving physicists from all world regions Data analysis involving physicists from all world regions The formation of worldwide collaborationsThe formation of worldwide collaborations The conception, design and implementation of The conception, design and implementation of

next generation facilities as “global networks” next generation facilities as “global networks” ““Collaborations on this scale would never have Collaborations on this scale would never have

been attempted, if they could not rely on excellent been attempted, if they could not rely on excellent networks”networks”

ICFA and International Networking ICFA and International Networking

ICFA Statement on Communications in Int’l HEPICFA Statement on Communications in Int’l HEPCollaborations of October 17, 1996Collaborations of October 17, 1996 See See http://www.fnal.gov/directorate/icfa/icfa_communicaes.htmlhttp://www.fnal.gov/directorate/icfa/icfa_communicaes.html

““ICFA urges that all countries and institutions wishing ICFA urges that all countries and institutions wishing to participate even more effectively and fully in to participate even more effectively and fully in international HEP Collaborations should:international HEP Collaborations should: Review their operating methods to ensure they Review their operating methods to ensure they

are fully adapted to remote participation are fully adapted to remote participation Strive to provide the necessary communications Strive to provide the necessary communications

facilities and adequate international bandwidth” facilities and adequate international bandwidth”

ICFA Network Task Force: 1998 Bandwidth Requirements Projection (Mbps)

ICFA Network Task Force: 1998 Bandwidth Requirements Projection (Mbps)

1998 2000 2005

BW Utilized Per Physicist(and Peak BW Used)

0.05 - 0.25(0.5 - 2)

0.2 – 2(2-10)

0.8 – 10(10 – 100)

BW Utilized by a UniversityGroup

0.25 - 10 1.5 - 45 34 - 622

BW to a Home Laboratory OrRegional Center

1.5 - 45 34 - 155 622 - 5000

BW to a Central LaboratoryHousing One or More MajorExperiments

34 - 155 155 - 622 2500 - 10000

BW on a Transoceanic Link 1.5 - 20 34 - 155 622 - 5000

100–1000 X Bandwidth Increase Foreseen for 1998-2005100–1000 X Bandwidth Increase Foreseen for 1998-2005See the ICFA-NTF Requirements Report:See the ICFA-NTF Requirements Report:

http://l3www.cern.ch/~newman/icfareq98.html

NTF

ICFA Standing Committee on Interregional Connectivity (SCIC)

ICFA Standing Committee on Interregional Connectivity (SCIC)

Created by ICFA in July 1998 in Vancouver ; Following ICFA-NTFCreated by ICFA in July 1998 in Vancouver ; Following ICFA-NTF CHARGE: CHARGE:

Make recommendations to ICFA concerning the connectivity between Make recommendations to ICFA concerning the connectivity between the Americasthe Americas, Asia and Europe (and network requirements of HENP), Asia and Europe (and network requirements of HENP) As part of the process of developing theseAs part of the process of developing these

recommendations, the committee should recommendations, the committee should Monitor traffic Monitor traffic Keep track of technology developmentsKeep track of technology developments Periodically review forecasts of future Periodically review forecasts of future

bandwidth needs, and bandwidth needs, and Provide early warning of potential problemsProvide early warning of potential problems

Create subcommittees when necessary to meet the chargeCreate subcommittees when necessary to meet the charge The chair of the committee should report to ICFA once perThe chair of the committee should report to ICFA once per

year, at its joint meeting with laboratory directors (Feb. 2003)year, at its joint meeting with laboratory directors (Feb. 2003) Representatives: Major labs, ECFA, ACFA, NA Users, S. AmericaRepresentatives: Major labs, ECFA, ACFA, NA Users, S. America

ICFA-SCIC Core MembershipICFA-SCIC Core Membership

Representatives from major HEP Representatives from major HEP laboratories:laboratories:

W. Von ReudenW. Von Reuden (CERN)(CERN)

Volker Guelzow Volker Guelzow (DESY)(DESY) Vicky White Vicky White (FNAL) (FNAL) Yukio Karita Yukio Karita (KEK)(KEK) Richard Mount Richard Mount (SLAC)(SLAC)

User Representatives User Representatives Richard Hughes-Jones (UK)Richard Hughes-Jones (UK) Harvey Newman Harvey Newman (USA) (USA)

Dean Karlen Dean Karlen (Canada)(Canada) For Russia: For Russia:

Slava Ilyin Slava Ilyin (MSU)(MSU)

ECFA representatives:ECFA representatives:

Denis Linglin (IN2P3, Lyon)Denis Linglin (IN2P3, Lyon)Frederico Ruggieri (INFN Frederico Ruggieri (INFN Frascati)Frascati)

ACFA representatives:ACFA representatives:

Rongsheng XuRongsheng Xu (IHEP Beijing) (IHEP Beijing)

H. Park, D. Son H. Park, D. Son (Kyungpook Nat’l (Kyungpook Nat’l University)University)

For South America:For South America: Sergio F. Novaes Sergio F. Novaes (University of Sao Paulo)(University of Sao Paulo)

SCIC Sub-Committees SCIC Sub-CommitteesWeb Page Web Page http://cern.ch/ICFA-SCIC/http://cern.ch/ICFA-SCIC/

Monitoring:Monitoring: Les Cottrell Les Cottrell (http://www.slac.stanford.edu/xorg/icfa/scic-netmon) (http://www.slac.stanford.edu/xorg/icfa/scic-netmon) With Richard Hughes-Jones (Manchester), With Richard Hughes-Jones (Manchester), Sergio Novaes Sergio Novaes (Sao Paolo); (Sao Paolo); Sergei Berezhnev (RUHEP), Fukuko Yuasa (KEK), Sergei Berezhnev (RUHEP), Fukuko Yuasa (KEK), Daniel Davids (CERN), Sylvain Ravot (Caltech), Daniel Davids (CERN), Sylvain Ravot (Caltech), Shawn McKee (Michigan)Shawn McKee (Michigan)

Advanced Technologies:Advanced Technologies: Richard Hughes-Jones, Richard Hughes-Jones,With With Vladimir Korenkov (JINR, Dubna), Olivier Martin(CERN), Vladimir Korenkov (JINR, Dubna), Olivier Martin(CERN), Harvey NewmanHarvey Newman

The Digital Divide:The Digital Divide: Alberto Santoro (Rio, Brazil) Alberto Santoro (Rio, Brazil) With Slava Ilyin, Yukio Karita, David O. WilliamsWith Slava Ilyin, Yukio Karita, David O. Williams Also Dongchul Son (Korea), Hafeez Hoorani (Pakistan), Also Dongchul Son (Korea), Hafeez Hoorani (Pakistan),

Sunanda Banerjee (India), Vicky White (FNAL)Sunanda Banerjee (India), Vicky White (FNAL) Key Requirements:Key Requirements: Harvey Newman Harvey Newman

Also Charlie Young (SLAC)Also Charlie Young (SLAC)

Transatlantic Net WG (HN, L. Price) Bandwidth Requirements [*]

Transatlantic Net WG (HN, L. Price) Bandwidth Requirements [*]

2001 2002 2003 2004 2005 2006

CMS 100 200 300 600 800 2500

ATLAS 50 100 300 600 800 2500

BaBar 300 600 1100 1600 2300 3000

CDF 100 300 400 2000 3000 6000

D0 400 1600 2400 3200 6400 8000

BTeV 20 40 100 200 300 500

DESY 100 180 210 240 270 300

CERN BW

155-310

622 2500 5000 10000 20000

[*] [*] BW Requirements Increasing Faster Than Moore’s LawBW Requirements Increasing Faster Than Moore’s LawSee http://gate.hep.anl.gov/lprice/TANSee http://gate.hep.anl.gov/lprice/TAN

History – One large Research Site

Current Traffic ~400 Mbps;ESNet Limitation

Projections: 0.5 to 24 Tbps by ~2012

Much of the Traffic:SLAC IN2P3/RAL/INFN;

via ESnet+France;Abilene+CERN

Tier0-Tier1 Link Requirements Estimate: for Hoffmann Report 2001

Tier0-Tier1 Link Requirements Estimate: for Hoffmann Report 2001

1)1) Tier1 Tier1 Tier0 Data Flow for Analysis Tier0 Data Flow for Analysis 0.5 - 1.0 Gbps0.5 - 1.0 Gbps

2)2) Tier2 Tier2 Tier0 Data Flow for Analysis Tier0 Data Flow for Analysis 0.2 - 0.5 Gbps0.2 - 0.5 Gbps

3)3) Interactive Collaborative Sessions (Interactive Collaborative Sessions (30 Peak30 Peak) ) 0.1 - 0.3 Gbps0.1 - 0.3 Gbps

4)4) Remote Interactive Sessions (Remote Interactive Sessions (30 Flows Peak30 Flows Peak) ) 0.1 - 0.2 Gbps0.1 - 0.2 Gbps

5)5) Individual (Tier3 or Tier4) data transfers 0.8 Individual (Tier3 or Tier4) data transfers 0.8 GbpsGbpsLimit to 10 Flows of 5 Mbytes/sec eachLimit to 10 Flows of 5 Mbytes/sec each

TOTAL Per Tier0 - Tier1 LinkTOTAL Per Tier0 - Tier1 Link 1.7 - 2.8 Gbps1.7 - 2.8 Gbps

NOTE:NOTE: Adopted by the LHC Experiments; given in the upcomingAdopted by the LHC Experiments; given in the upcoming

Hoffmann Steering Committee Report: “1.5 - 3 Gbps per Hoffmann Steering Committee Report: “1.5 - 3 Gbps per experiment”experiment”

Corresponds to ~10 Gbps Baseline BW Installed on US-CERN LinkCorresponds to ~10 Gbps Baseline BW Installed on US-CERN Link Hoffmann Panel also discussed the effects of higher bandwidthsHoffmann Panel also discussed the effects of higher bandwidths

For example all-optical 10 Gbps Ethernet across WANsFor example all-optical 10 Gbps Ethernet across WANs

Tier0-Tier1 BW Requirements Estimate: for Hoffmann Report 2001

Tier0-Tier1 BW Requirements Estimate: for Hoffmann Report 2001

Does Not IncludeDoes Not Include the more recent ATLAS Data Estimates the more recent ATLAS Data Estimates 270 Hz at 10270 Hz at 103333 Instead of 100Hz Instead of 100Hz 400 Hz at 10400 Hz at 103434 Instead of 100Hz Instead of 100Hz 2 MB/Event Instead of 1 MB/Event 2 MB/Event Instead of 1 MB/Event

Does Not Allow Fast Download to Tier3+4 Does Not Allow Fast Download to Tier3+4 of “Small” Object Collectionsof “Small” Object Collections Example: Download 10Example: Download 1077 Events of AODs (10 Events of AODs (104 4 Bytes) Bytes) 100 Gbytes; 100 Gbytes;

At 5 Mbytes/sec per person (above) that’s 6 Hours !At 5 Mbytes/sec per person (above) that’s 6 Hours ! This is a still a rough, bottoms-up, static, and This is a still a rough, bottoms-up, static, and

hence Conservative Model. hence Conservative Model. A Dynamic distributed DB or “Grid” system with Caching, A Dynamic distributed DB or “Grid” system with Caching,

Co-scheduling, and Pre-Emptive data movement Co-scheduling, and Pre-Emptive data movement may well require greater bandwidthmay well require greater bandwidth

Does Not Include “Virtual Data” operations:Does Not Include “Virtual Data” operations:Derived Data Copies; Data-description overheadsDerived Data Copies; Data-description overheads

Further MONARC Computing Model Studies are NeededFurther MONARC Computing Model Studies are Needed

ICFA SCIC Meetings[*] and TopicsICFA SCIC Meetings[*] and Topics

Focus on the Digital Divide This YearFocus on the Digital Divide This Year Identification of problem areas; work on ways to improveIdentification of problem areas; work on ways to improve

Network Status and Upgrade Plans in Each CountryNetwork Status and Upgrade Plans in Each Country Performance (Throughput) Evolution in Each Country,Performance (Throughput) Evolution in Each Country,

and Transatlantic and Transatlantic Performance Monitoring World-Overview Performance Monitoring World-Overview (Les Cottrell, IEPM Project) (Les Cottrell, IEPM Project) Specific Technical Topics (Examples):Specific Technical Topics (Examples):

Bulk transfer, New Protocols; Collaborative Systems, VOIPBulk transfer, New Protocols; Collaborative Systems, VOIP Preparation of Reports to ICFA (Lab Directors’ Meetings)Preparation of Reports to ICFA (Lab Directors’ Meetings)

Last Report: World Network Status and Outlook - Feb. 2002Last Report: World Network Status and Outlook - Feb. 2002 Next Report: Next Report: Digital Divide,Digital Divide, + + Monitoring, Advanced Monitoring, Advanced

Technologies; Requirements Evolution – Feb. 2003Technologies; Requirements Evolution – Feb. 2003

[*] Seven Meetings in 2002; at KEK In December 13.[*] Seven Meetings in 2002; at KEK In December 13.

Network Progress in 2002 andIssues for Major Experiments Network Progress in 2002 andIssues for Major Experiments

Backbones & major links advancing rapidly to 10 Gbps rangeBackbones & major links advancing rapidly to 10 Gbps range ““Gbps” end-to-end throughput data flows have beenGbps” end-to-end throughput data flows have been

tested; will be in production soon (in 12 to 18 Months) tested; will be in production soon (in 12 to 18 Months) Transition to Multi-wavelengths 1-3 yrs. in the Transition to Multi-wavelengths 1-3 yrs. in the

“most favored” regions “most favored” regions Network advances are changing the view of the net’s rolesNetwork advances are changing the view of the net’s roles

Likely to have a profound impact on the experiments’ Likely to have a profound impact on the experiments’ Computing Models, and bandwidth requirementsComputing Models, and bandwidth requirements

More dynamic view: GByte to TByte data transactions;More dynamic view: GByte to TByte data transactions;dynamic path provisioningdynamic path provisioning

Net R&D Driven by Advanced integrated applications, such Net R&D Driven by Advanced integrated applications, such as Data Grids, that rely on seamless LAN and WAN operationas Data Grids, that rely on seamless LAN and WAN operation With reliable, quantifiable (monitored), high performanceWith reliable, quantifiable (monitored), high performance

All of the above will further open the Digital Divide All of the above will further open the Digital Divide chasm. We need to take action chasm. We need to take action

ICFA SCIC: R&E Backbone and International Link Progress

ICFA SCIC: R&E Backbone and International Link Progress

GEANT Pan-European BackboneGEANT Pan-European Backbone ( (http://www.dante.net/geanthttp://www.dante.net/geant)) Now interconnects >31 countries; many trunks Now interconnects >31 countries; many trunks 2.5 and 10 Gbps2.5 and 10 Gbps

UKUK: : SuperJANET Core at SuperJANET Core at 10 Gbps10 Gbps 2.5 Gbps NY-London, with 622 Mbps to ESnet and Abilene2.5 Gbps NY-London, with 622 Mbps to ESnet and Abilene

France (IN2P3): France (IN2P3): 2.5 Gbps2.5 Gbps RENATER backbone from October 2002 RENATER backbone from October 2002 Lyon-CERN Link Upgraded to 1 Gbps EthernetLyon-CERN Link Upgraded to 1 Gbps Ethernet Proposal for dark fiber to CERN by end 2003 Proposal for dark fiber to CERN by end 2003

SuperSINET (Japan):SuperSINET (Japan): 10 Gbps IP and 10 Gbps Wavelength Core10 Gbps IP and 10 Gbps Wavelength Core Tokyo to NY Links: 2 X 2.5 Gbps started; Peer with ESNet by Feb.Tokyo to NY Links: 2 X 2.5 Gbps started; Peer with ESNet by Feb.

CA*net4 (Canada):CA*net4 (Canada): Interconnect customer-owned dark fiber Interconnect customer-owned dark fiber nets across Canada at nets across Canada at 10 Gbps10 Gbps, started July 2002, started July 2002 ““Lambda-Grids” by ~2004-5Lambda-Grids” by ~2004-5

GWIN (Germany):GWIN (Germany): 2.5 Gbps Core2.5 Gbps Core; Connect to US at 2 X 2.5 Gbps;; Connect to US at 2 X 2.5 Gbps;Support for SILK Project: Satellite links to FSU Republics Support for SILK Project: Satellite links to FSU Republics

Russia: Russia: 155 Mbps Links to Moscow (Typ. 30-45 Mbps for Science)155 Mbps Links to Moscow (Typ. 30-45 Mbps for Science) Moscow-Starlight Link to Moscow-Starlight Link to 155 Mbps155 Mbps (US NSF + Russia Support) (US NSF + Russia Support) Moscow-GEANT and Moscow-Stockholm Links Moscow-GEANT and Moscow-Stockholm Links 155 Mbps155 Mbps

R&E Backbone and Int’l Link ProgressR&E Backbone and Int’l Link Progress Abilene (Internet2) UpgradeAbilene (Internet2) Upgrade from 2.5 to from 2.5 to 10 Gbps10 Gbps in 2002 in 2002

Encourage high throughput use for targeted applications; FAST Encourage high throughput use for targeted applications; FAST ESNET: Upgrade:ESNET: Upgrade: to 10 Gbps “As Soon as Possible” to 10 Gbps “As Soon as Possible” US-CERNUS-CERN

to 622 Mbps in August; Move to STARLIGHTto 622 Mbps in August; Move to STARLIGHT 2.5G Research Triangle from 8/02; STARLIGHT-CERN-NL; 2.5G Research Triangle from 8/02; STARLIGHT-CERN-NL;

to 10G in 2003. [10Gbps SNV-Starlight Link Loan from Level(3) to 10G in 2003. [10Gbps SNV-Starlight Link Loan from Level(3) SLAC + IN2P3 (BaBar) SLAC + IN2P3 (BaBar)

Typically ~400 Mbps throughput on US-CERN, Renater linksTypically ~400 Mbps throughput on US-CERN, Renater links 600 Mbps Throughput is BaBar Target for Early 2003 600 Mbps Throughput is BaBar Target for Early 2003

(with ESnet and Upgrade)(with ESnet and Upgrade) FNAL: FNAL: ESnet Link Upgraded to 622 MbpsESnet Link Upgraded to 622 Mbps

Plans for dark fiber to STARLIGHT, proceedingPlans for dark fiber to STARLIGHT, proceeding NY-Amsterdam NY-Amsterdam Donation Donation from Tyco, from Tyco, September 2002: September 2002:

Arranged by IEEAF: 622 Gbps+10 Gbps Research WavelengthArranged by IEEAF: 622 Gbps+10 Gbps Research Wavelength US National Light RailUS National Light Rail Proceeding; Startup Expected this Year Proceeding; Startup Expected this Year

> 200 Primary ParticipantsAll 50 States, D.C. and Puerto Rico

75 Partner Corporations and Non-Profits23 State Research and Education Nets

15 “GigaPoPs” Support 70% of Members

2.5 10 Gbps Backbone

2003: OC192 and OC48 Links Coming Into Service;Need to Consider Links to US HENP Labs

National R&E Network ExampleGermany: DFN Transatlantic Connectivity 2002

STM 4

STM 16

STM 16

Virtual SILK Highway Project (from 11/01): Virtual SILK Highway Project (from 11/01): NATO ($ 2.5 M) and Partners ($ 1.1M) NATO ($ 2.5 M) and Partners ($ 1.1M) Satellite Links to South Caucasus Satellite Links to South Caucasus and Central Asia (8 Countries) and Central Asia (8 Countries)

In 2001-2 (pre-SILK) BW 64-512 kbpsIn 2001-2 (pre-SILK) BW 64-512 kbpsProposed VSAT to get 10-50 X BWProposed VSAT to get 10-50 X BW for same cost for same cost

See See www.silkproject.orgwww.silkproject.org[*] [*] Partners: CISCO, DESY. GEANT, Partners: CISCO, DESY. GEANT, UNDP, US State Dept., Worldbank, UNDP, US State Dept., Worldbank, UC London, Univ. Groenigen UC London, Univ. Groenigen

2 X OC48: NY-Hamburg 2 X OC48: NY-Hamburg and NY-Frankfurtand NY-Frankfurt

Direct Peering to Abilene (US) and Direct Peering to Abilene (US) and Canarie (Canada)Canarie (Canada)

UCAID said to be adding another 2 UCAID said to be adding another 2 OC48’s; in a Proposed Global Terabit OC48’s; in a Proposed Global Terabit Research Network (GTRN) Research Network (GTRN)

National Research Networks in Japan

National Research Networks in Japan

SuperSINET SuperSINET Started operation January 4, 2002Started operation January 4, 2002 Support for 5 important areas:Support for 5 important areas:

HEP,HEP, Genetics, Nano-Technology, Genetics, Nano-Technology,Space/Astronomy, Space/Astronomy, GRIDsGRIDs

Provides 10 Provides 10 ’s:’s: 10 Gbps IP connection 10 Gbps IP connection Direct intersite GbE linksDirect intersite GbE links 9 Universities Connected 9 Universities Connected

January 2003: Two TransPacific January 2003: Two TransPacific 2.5 Gbps Wavelengths (to NY); 2.5 Gbps Wavelengths (to NY); Japan-US-CERN Grid Testbed Soon Japan-US-CERN Grid Testbed Soon

Tokyo

Osaka

Nagoya

Internet

Osaka U

Kyoto U

ICRKyoto-U

Nagoya U

NIFS

NIG

KEK

Tohoku U

IMS

U-TokyoNAO

U Tokyo

NII Hitot.

NII Chiba

IP

WDM path

IP router

OXC

ISAS

SuperSINET Updated Map: October 2002SuperSINET Updated Map: October 2002

APAN Links in Southeast AsiaJanuary 15, 2003

APAN Links in Southeast AsiaJanuary 15, 2003