© 2006 – RNP Networking for Research and Education in Brazil US-Brazil Technical Workshop Rio de Janeiro, April 2006 Michael Stanton Director of Innovation.

© 2006 – RNP

Networking for Research and Education in Brazil

US-Brazil Technical WorkshopRio de Janeiro, April 2006

Michael StantonDirector of InnovationRede Nacional de Ensino e Pesquisa - [email protected]

Networking for Research and Education in Brazil 2

Summary

• New optical transmission and switching technologies allow significant reduction in the costs of setting up and operating research and education networks.

• By means of examples we show how these opportunities are being exploited in Brazil.

• Our agenda:– A brief look at RNP– Project GIGA – an optical networking testbed– IPÊ – the next-generation national network– Redecomep – Community-based Optical Metropolitan Networks– International connectivity– New services– Some special user application areas


RNP – Rede Nacional de Ensino e Pesquisa• RNP is the Brazilian national research and education network

– maintained by the Brazilian government (since 1989)– provides national (inter-state) and international connectivity

for more than 400 universities and research centers through the provision of advanced networking infrastructure

• collaboration – links to other similar networks internationally (Internet2, ESnet, NASA, GÉANT, APAN, RedCLARA)

• commodity – links to the commercial Internet

– supports the development of advanced networking and applications

• RNP is managed for the federal government by a non-profit private company, RNP-OS


Evolution of academic networks in Brazil

RNPPhase

Year Technology Link capacities Comment

1988 BITNET up to 9.6 kbps first national network

1 1992 Internet 9.6 and 64 kbps first national IP network (RNP)

2 1995 up to 2 Mbps also: commercial IP deployed

3 1999 IP/ATM, IP/FR

VC up to 45 Mbps, access up to 155 Mbps

RNP2 national backbone;

testbed metro networks in 14 cities (using ATM/dark fiber)

4 2003 IP/SDH 34, 155, 622 Mbps also: IP/WDM interstate testbed network (Project GIGA)

5 2005 IP/WDM 2.5 and 10 Gbps IPÊ national backbone;

metro networks in 27 capitals


Evolution of academic networks in Brazil

Capacidade dos enlaces

1

10

100

1.000

10.000

100.000

1.000.000

10.000.000

1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005

Ano

kbp

s

Phase 0BITNET

Phase 1Internet

Phase 2comercial Internet

Phase 3RNP2

Phase 4RNP2+

Phase 5Ipê

(Link capacity)


Phase 4 backbone network (until Nov 05)

• Introduced in 2004/5

• Provides links to state capitals(complemented by intra-state connectivity)

• Link speeds except to Amazonia:– mostly 34 Mbps– 155 Mbps to

some states– 622 Mbps

Rio-SPRNP2 – April/2005

(2 Gbps)


Project GIGA – optical networking testbed

• Partnership between

– RNP and CPqD (www.cpqd.com.br) – joint coordinators– R&D community in industry and universities

• Objectives:

– Build an advanced networking testbed for development and demonstration purposes

– Support R&D subprojects in optical and IP networking technology and advanced applications and services

• Industry participation (telcos provide the fibres; technology transfer of products and services to Brazilian Industries and telcos required)

• Government funding of US$ 20 M (via FUNTTEL/Finep) – project started December 2002

FUNTTELFUNTTEL


Project Organization

Optical Network Optical

Network TelecomServicesTelecomServices

ScientificApplications

ScientificApplications

IP and Optical Testbed NetworkIP and Optical Testbed Network

Executive Board

Executive Board

Advisory CommitteeAdvisory

Committee

Universities, R&D Centers,Industries, Telecom Operating Companies

Universities, R&D Centers,Industries, Telecom Operating Companies

RNPCPqDProtocols and

NetworkServices

CPqD + RNP

R&D areas


GIGA testbed network - objectives

• explore user control of optical fibre infrastructure– interconnect 20 academic R&D centres in S.E. Brazil

• provide Networking Research Testbed (NRT) for optical and IP network development

• provide Experimental Infrastructure Network (EIN) for development and demonstration of applications

(NRT and EIN are terms defined by NSF in 2002)

Network was inaugurated in May 2004


GIGA testbed network - localization• dark fiber-based 700-km

inter-city backbone in states of São Paulo and Rio de Janeiro

• Initially 20 universities and R&D centers in 7 cities

• Optical equipment supplied by Padtec (www.padtec.com.br)

– 2.5G DWDM in the inter-city backbone

– 2.5G CWDM used in the metropolitan area

testbed network


GIGA testbed network - localization

UniversitiesIMEPUC-RioPUC-CampinasUERJUFFUFRJMackenzieUNICAMPUSP

R&D Centers CBPF CPqDCPTECINCORCTA FIOCRUZ IMPA INPE LNCC LNLS


R&D activities

• 2/3 of the GIGA project budget is for R&D activities in the following areas:

– Optical networking (CPqD)

– Network protocols and services (RNP)

– Experimental telecommunications services (CPqD)

– Scientific Services and Applications (RNP)• Many of the R&D activities are contracted out to research groups in the

university community (at more than 50 different institutions throughout Brazil)

– Incentives for technology transfer to industry

– The network is also being used for the development and/or demonstration of high capacity networking applications by scientific researchers in various areas (HEP, computational biology, earth sciences, environmental sciences, etc), often using grid computing.


Optical networks: benefits for the R&E community

• Based on practical experience with the testbed network of Project GIGA, RNP began to deploy in 2005 a multi-Gbps network for the national R&E community

• This has two main components:

– IPÊ multi-Gbps backbone network• ipê: (a word in Tupi pronounced “ee-pay”) is

Brazil’s national flower (Tabebuia chrysotricha)• i-pê: IP (Internet Protocol) in Portuguese• IPE: Inovação, Pesquisa, Educação

(Innovation, Research, Education)

– Redecomep: community-based optical metropolitan networks

• for shared local Gbps access to IPÊ PoPs

yellow ipê in blossom


IPÊ: next generation network (2005)

• use of multiple Gbps for interstate links initially between 10 cities

• unprotected 2.5 and 10G waves from two telcos

• routers from Juniper Networks (M320, M40)

• commissioned in November 2005

IPÊ – Nov 2005(60 Gbps)

Fortaleza

Recife

Salvador

Rio de Janeiro

Belo Horizonte

Brasília

São PauloCuritiba

Florianópolis

Porto Alegre

2.5 Gbps10 Gbps


Redecomep - Optical Metropolitan Networks for the R&E community• Long distance networks arrive in a particular point of each city served

– Point of Presence (PoP)• To serve a set of clients in the same city, necessary to provide

individual access to the PoP – “Last Mile problem”• A similar problem arises when we wish to provide connectivity

between branches of a single organisation in the same city

• Traditional telco solution to the “Last Mile problem” :– Rent telco point to point data services to get to PoP– Recurrent cost a function of bandwidth– Often results in “under-provisioning” due to high cost

• Alternative solution (DIY networking):– Build and operate your own optical metro network


MetroBel: pilot project in Belém do Pará -12 universities and research centers

UFPAPoP of RNP

UFRA

MPEGcampus

EMBRAPA

NPI UFPA

CCS UFPA

CEFET

UEPA

UEPA

UEPA

Belem

CESUPACampus Nazaré

UNAMACampus Quintino

UNAMACampus Alcindo Cacela

UNAMACampus Sen. Lemos

UEPA

CESUPACampus Almte Barroso

CPRM

CESUPACampus Gov José Malcher

MPEGparque

IEC Campus I

Hospital BB

0 km 1 km 2 km


MetroBel: a possible topology (30 km ring)


RNP activities in metro networks 2005/6 (www.redecomep.rnp.br)

• In December 2004, RNP obtained US$15 financing from Finep to build optical metro networks in all 27 capital cities in Brazil (projects MetroBel and Redecomep)

• Situation of MetroBel project in Belém:– Cabling tender published in August 2005– Cabling begun in March 2006 (to be ready by June)

• Currently projects under way for installing metro networks in the following cities:Manaus, Belém, Fortaleza, Natal, Recife, Salvador, Vitória, Brasília, Curitiba, Florianópolis, Porto Alegre, …


International connectivityTwo kinds of traffic: “commodity” (Internet1) and “cooperation” (Internet2, or

Research and Education)

We will limit ourselves to talk about cooperation traffic, i.e. relationships with similar research and education networks in other countries and continents

This area has advanced greatly in the last 4 years due to government initiatives in the EU and the US:

• EU’s ALICE project and the RedCLARA network.• NSF’s IRNC program and the WHREN/LILA project

An important result has been the creation of the CLARA organization.


• Open association of national research and education networks (NRENs) in LA formally constituted in Uruguay– similar to TERENA (Europe) and APAN– target member countries are the Spanish and Portuguese-

speaking countries of Central and South America and the Caribbean

• Main objective:Build a regional network to interconnect LA NRENs and provide them with connectivity to Europe, North America and other regions

• www.redclara.net

Cooperação Latino Americana de Redes Avançadas


Building RedCLARA: the ALICE project

ALICE - América Latina Interconectada Con Europa

• Coordinated by DANTE (manager of GÉANT), with participation of NRENs from Italy, France, Spain, Portugal and the CLARA countries, and later CLARA itself

• May 2003: ALICE Project approved by European Commission with EUR 10 millions (80%) financing (remainder from LA users)

• Aug 2004: Network operational• Mar 2006: Connects 14 CLARA countries

• CLARA now represents the interests of LA users


Current RedCLARA topology (1Q2006)

• backbone ring: 155 Mbps(Global Crossing + Cisco)

• Access links of 10 to 45 Mbps

• Connection to Europe (GÉANT) at 622 Mbps from Brazil (Sep 2004)


New links to RedCLARA (2005-2006)

MIA

SD

WHREN/LILA (NSF)

1 – 1.2 Gbps

Tijuana – San DiegoSão Paulo – Miami

Part of NSF’s IRNC program for connecting US to LA

LAUREN (3Q2006)

2.5 Gbps

155 Mbps

45 Mbps

Various additional links to reinforce existing RedCLARA connectivity for serving US – LA collaborations.


Development of new services: RNP Working Groups (GTs)

• Objective

Promote innovation in services and applications offered by RNP

• How?

Create Working Groups, coordinated by research workers from the academic community (normally in ICT)

– financed by RNP (through the management contract)– participation of RNP and academic community– as many as 7 groups per year (5 in 2002, 7 afterwards), chosen

through na open, public process– 12 month duration– production of pilots of services (prototypes) with demonstration at

annual RNP workshop


History of Working Groups2002-2003 2003-2004 2004-2005 2005-2006

VoIP Advanced VoIP Advanced VoIP Network storage

Digital Video (VD) VD-II Reliable Multicast Digital TV

Vídeoconf. In education

Configuration Pervasive grids Wireless Mesh network

Diretories in Higher Education.

Diretories and Applications

Middleware Remote Visualization

Quality of Service (QoS)

QoS-II Measurements (MED)

MED-II

Public Key Infra. (ICP-Edu)

ICP-Edu-II ICP-Edu-III

Peer to Peer (P2P) P2P-II Management of Video

Basis for new service

Expected future basis for new service


Some special user application areas

• Health / Medicine• High-Energy Physics• Astrophysics• Cyberinfrastructure


RNP interactions with Health/Medicine

• Project GIGA– Subproject “Advanced Network for R&D in

Distributed Systems in Medicine”• Coordinator: Marco Gutierrez (INCOR/USP)• Partners: LARC/USP, FCM/UERJ• Participants: UNIFESP, UFPB, UFF• Objectives include:

– Remote access to medical images in a context-sensitive database

– Processing of 3-D medical images


RNP interactions with Health/Medicine

• ONCONET (2002-2004), ONCONET2 (2004-2006): Pilot TeleHealth network in pediatric oncology– Coordinator: Marcelo Zuffo (LSI/USP)– Partners: many– Objectives:

• Set up a national research network focused on TeleHealth and Tele-Medicine

• Establish basis for a future national Cancer register• Offer advanced services to support medical practice

– Digital patient records– Protocols and treatments– Distance Learning


ONCONET: Phase I 2002-2004

Hosp de Apoio CACON-I

(Brasília -DF)

Hospital Base de

(Porto Velho-RO)

Hospital NS Glória (Vitória-ES)

LSI- USP (SP)

UNIFESP (SP)

Hospital São Marcos (Teresina-PI)

CACON-II (Florianopolis-SC)

EDUMED (Campinas-SP)

Fund Centro

Controle Oncologia (Manaus-

AM)

SOBOPE (SP)


Onconet Phase II 2004-2006

• Strategic partnership with INCA (Instituto Nacional do Câncer)

• Extension to adult cancer• Deployment of nacional cancer register• Depoyment of onco-grid

– Data mining– Video-conferencing– Distributed database

• Integration Onconet with Datasus (Ministry of Health)

• Expansion of the university network


RUTE: University Network for Telemedicine

• Launched April 24th, 2006, in Rio de Janeiro• Coordinated by RNP, with financial support from

Finep• Objectives:

– Support improvement of existing telemedicine initiatives

– Encourage new collaborations• Initially 20 institutions in 14 states:

– mostly teaching hospitals attached to federal and state universities


RNP interactions with High-Energy Physics

• The Brazilian HEP community participates in international collaborations associated with large accelerators, such as those at Fermilab and CERN

• A prominent example is the CMS project for the future Large Hadron Collider (LHC) at CERN, expected to come online in 2007– 4 experiments (ATLAS, CMS, LHCb, ALICE)


HEPGRID (CMS) in BrazilHEPGRID-CMS/BRAZIL is a project to build a Grid thatAt Regional Level will include CBPF,UFRJ,UFRGS,UFBA, UERJ & UNESPAt International Level will be integrated with CMS Grids; Focal points include Grid3/OSG and bilateral projects with Caltech Group

France Italy USAGermany BRAZIL622 Mbps

UFRGS

UERJUFRJ

T1

IndividualMachines

On line sys ``tems

Brazilian HEPGRID

CBPFGigabit

CERN 1 - 2.5Gbps … 10 Gbps

UFBA

UERJ HEPGrid T2 Working

T4

T0 +T1

T2 T1T3 T2

UERJ: T2T1,

100500 Nodes;

Plus T2s to

100 Nodes

T2 Inauguration + GIGA/RNP Agreement

December 2004

UNESP/USPSPRACE Working


RNP support for HEPGrid participation in Supercomputing 2004• Support for participating in the winning consortium, led by Caltech, in the

Bandwidth Challenge (BWC) during SC2004 in the US

– participation by HEPGrid group from UERJ (Rio de Janeiro)

– used GIGA testbed + Red CLARA + GÉANT + Abilene (Rio to S. Paulo) (to Madrid) (to New York) (to Pittsburgh)

– peak traffic 500 Mbps, sustained traffic 400 Mbps (Nov 10-11, 2004)


RNP support for participation in SC2005

• With the inauguration of the IPÊ network and the WHREN/LILA link to Miami, connectivity to the US has greatly improved.

• The new route from Rio to the US used

– IPÊ network + WREN/LILA + Abilene(Rio to S. Paulo) (to Miami) (to Seattle)

– 2.5 Gbps was provisioned between S. Paulo and Miami to accommodate 2 HEP flows of 1 Gbps.

– bandwidth effectively used was around 1 Gbps

• Group from Rio transmitted around 600 Mbps (see below)


RNP interactions with Astrophysics(new projects)

• SOAR (Southern Observatory for Astrophysical Research), Cerro Pachón, Chile– 30% viewing time is for Brazilian scientists– demand for “assisted remote observation”– www.physics.unc.edu/research/astro/soar.php

• Brazilian Virtual Observatory– provide access to remote databases of astrophysical images for

data mining– will be integrated into IVOA (International Virtual Observatory

Alliance)

• e-VLBI using ROEN (Radio-Observatório Espacial do Nordeste) in Eusébio, near Fortaleza (collaboration with US and Japan)– expected to transmit initially 100 Mbps to MIT starting 4Q2006,

when GIGAFor metro network to be deployed– bandwidth needs should double in 2007


Cyberinfrastructure for e-Science

• Growing tendency to provide remote distributed computing resources for scientific users – grid computing

• RNP naturally involved due to provision of high-capacity national and international connectivity

• International partners in many countries including US, EU and LA.

• Important projects:– SINAPAD – EELA


SINAPAD (National System for HPC)• Currently comprises 7 HPC centers, interlinked by RNP• Originally based on supercomputers in many cases• Tendency to adopt cluster computing using grid middleware• Expected growth to include new centers starting 2006• International collaborations, e.g. NCSA• www.lncc.br/sinapad

Center Equipment

LNCC National Laboratory for Scientific Computing initially IBM SP2, later updated with SUN and SGI

UFRGS Federal University of Rio Grande do Sul initially Cray XMP and later updated to a Cray T90

UNICAMP State University of Campinas initially IBM SP2, later updated with SUN

UFMG Federal University of Minas Gerais initially IBM SP2, later updated with SUN

UFRJ Federal University of Rio de Janeiro initially CRAY, recently updated with SGI Altix

UFC Federal University of Ceara

INPE/CPTEC

National Space Research Institute/Climate and Weather Forecasting Center

initially NEC SX 4, later updated to a SX 6


EELA – Extending e-Infrastructure to LA

• EELA is a 2 year EU-financed project involving a consortium of 21 institutions from 7 LA and 4 EU countries– Main partners in Spain and Brazil– CLARA, RNP and REUNA (Chilean NREN) are partners

• Objective:– Investigate the feasibility of extending the EGEE model of

grid computing to LA– This involves:

• extending range of applications on the grid• demonstrating Pilot Grid network• CLARA leads network support activity

www.eu-eela.org


EELA: Pilot grid testbed

Brazil


Conclusion

• RNP is engaged in extending – the quality and capacity of its networking

infrastructure, – the range of the services offered to the end-user,

and – its participation in multidisciplinary collaboration

projects

Michael Stanton ([email protected])

www.rnp.br

Thank you!

© 2006 – RNP Networking for Research and Education in Brazil US-Brazil Technical Workshop Rio de Janeiro, April 2006 Michael Stanton Director of Innovation.

Documents

rnp networking

optical networking testbed

advanced networking

national ip network

backbone network

research centers

network services cpqd

education networks