RedIRIS-NOVA real experiencies of tendering and deploying an optical network in Spain

RedIRIS-NOVA real experiencies of tendering and deploying an

optical network in Spain

1

TERENA TF-MSP “Non-technical aspects of dark fibre” Workshop

Amsterdam - 9 and 10 November, 2010 [email protected] Network ManagerRedIRIS/Red.es

RedIRIS10 Highlights... 20 PoPs: > 13.000 km distance 156 Gbps backbone

43 links: 10GE, STM-16/4/1 Leased Capacity to T-Systems and Telefonica GEANT IP access:

10Gbps @ ES PoP 2.5Gbps @ FR PoP (bck)

GEANT Lambda Service: 3 x 10Gbps E2E links

2 Transit Providers (Madrid) Telia and Global Crossing @ 10Gbps

IXPs presence: ESPANIX @ 10Gbps (Madrid) – 59 peerings CATNIX @ GE (Barcelona) – 19 peerings

2

Institutions Access Links

• 10 GE

• n x GE

• FE

TF-MSP “Non-technical aspects of dark fibre” Workshop.

RedIRIS Users Classification

3

R&D Centers

35%

Universities20%

Health institutions

13%

R&D Management

Institutions17%

other15%

TF-MSP “Non-technical aspects of dark fibre” Workshop.

RedIRIS Traffic Trends (PBytes)

2.5Gbps Backbone2.5Gbps

Backbone10 Gbps

Backbone10 Gbps

Backbone4

40,5 PB40,5 PB

9,5 PB9,5 PB

around 1,45 /yeararound 1,45 /year

TF-MSP “Non-technical aspects of dark fibre” Workshop.

Network Resources Consumers Examp.

BSC-RES project: Supercomputing national initiative at 10GbpsDEISA project: EU supercomputing network at 10Gbps.LHC infrastructure support (nx10Gbps)PASITO: Spanish experimental testbed networkRENEM (National Emergency Network): high availability and specialized support.e-VLBI network support...

5TF-MSP “Non-technical aspects of dark fibre” Workshop.

... and telescopes in Canary Islands

10.4m telescope with a segmented primary mirror.Currently, the biggest telescope in the world.http://www.gtc.iac.es/

6TF-MSP “Non-technical aspects of dark fibre” Workshop.

• RedIRIS10 contracts will end in October 2011• The historical leased capacity model does not scale for the

new e-Science challenges: • no Flexibility• limitations to develop advanced functionalities • high Costs

• Globally, Educational and Research Networks are evolving to a model based on own dark fiber... or, more accurate, have evolved !

after RedIRIS10...

7

RedIRIS-NOVA

Spanish government commitment to build a

photonic network based on dark fiber

TF-MSP “Non-technical aspects of dark fibre” Workshop.

RedIRIS-NOVA project

8

138 MM€ : EU structural + Science and Innovation Ministry + Regional Governments funds National coverage requirements:

Penninsula and Islands ( Cannary and Balears) Ceuta and Melilla ( Norh Africa Spanish Cities)

Competitive Dialog Tender Process helps to know the dark fiber market in

Spain and to define the tender requirements: RFI in Oct/Nov 2008 Dialog Process: December 2008 to July 2009 Evaluation: September & October 2009 Tender structured in 3 lots:

Guaranteed Fiber within the penninsula and housing facilities Guaranteed Fiber with Canary Islands and housing facilities Optical Equipment

25 companies applied to participate and 23 companies joined in Dialog: 10 fiber providers 13 equipment vendors

TF-MSP “Non-technical aspects of dark fibre” Workshop.

Fiber Tender Results ...

9

Required ( improvements as criteria selection) AchievedIRU Duration

> 10 years 21 years and 30 for Canary Islands fiber( starting when last span is delivered – 2011)

Fiber Type G.652B/D, G.655 and G.656 (Subm.) G.652D and G.655

Fiber Age max. 1994 New Deployment ( terrestrial and submarine)

Attenuation ≤ 0,38 dB/Km (@1310nm)≤ 0,25 dB/Km (@1550nm)

≤ 0,34 dB/Km (@1310nm)≤ 0,20 dB/Km (@1550nm)

PMD ≤ 0.50 ps/√km ≤ 0.20 ps/√km

Coverage Peninsula: 48 add/drop PoPs mandatoryand 128 add/drop PoPs desired but optionalCanary Islands fiber: with and within

Peninsula: 148 add/drop PoPs ( 42 + 106 )[42 PoPs => 10.475 km ]Canary Islands fiber: 3 add/drop PoPs => 2.000 km of fiber

ILA sites Space without fitting-out Guaranteed fitting-out included for all ILAs

• Telefónica as peninsula fiber supplier

• Islalink fiber as Canary Islands supplier

TF-MSP “Non-technical aspects of dark fibre” Workshop.

10

Iberia Optical RingDual FCCN optical

fiber interconnection

Splices already done

Iberia Optical RingDual FCCN optical

fiber interconnection

Splices already done

Additional

PoPs will b

e

added Additional

PoPs will b

e

added

RedIRIS-NOVA fiber footprint I

TF-MSP “Non-technical aspects of dark fibre” Workshop.

RedIRIS-NOVA fiber footprint II

11

1.504 km

232 km

143 km

TF-MSP “Non-technical aspects of dark fibre” Workshop.

Guaranteed means...

12

QU

ALIT

YO

PERA

TIO

NM

AIN

TEN

ANCE

TF-MSP “Non-technical aspects of dark fibre” Workshop.

Failures and SLAs definition ...Failures classification

• Complex Failures ( CF): Fiber outages or degradations that require special (≈ long) works to be fixed

• Normal Failures ( NF): no special works

13

Service Level Agreements (to Fiber Links)

• Fiber Link Availability (monthly): 99,2% just for NF times

• PoP Availability (monthly): 99,98% both CF + NF

• Mean Times between Failures : 180 days for CF and 30 days for NF

• Maximum Unavailability Time for CF per 12 months periods: 30 hours for each 1.000km of fiber.

• Time to Repair: 12 hours for CF and 8 hours for NF

• Frequency of Failures (measured over 12 months periods):

• 3 for CF and 6 for NF.

• Fiber spans would be swapped if threshold is reached.

ILAILA PoPPoPPoPPoP

Fiber Link

Fiber span Fiber span

TF-MSP “Non-technical aspects of dark fibre” Workshop.

SLAs penalties ...Deployment phase

• Delays in deployment

14

Operational phase

• ILA housing conditions failures

• No collaboration with 3rd party entities

• Fiber link unavailability

• PoP unavailability ( simultaneous outage or degradation for all PoP fibers)

• To exceed Meant Time Between Failures parameter for each fiber link

• To exceed the Maximum Number of CF per 12 months periods

• To exceed the Maximun Time to Repair

• Improper fiber operations

TF-MSP “Non-technical aspects of dark fibre” Workshop.

How are the charged ... ... if the complete IRU contract is paid when deployment is finished and

accepted ? Provider set up a “1% contract budget” bank guarantee to support those

penallties. The 1% bank guarantee should be kept until IRU contract ends. Provider

must put back money when any penalty reduce it.

RedIRIS-NOVA PoPs I Requirements• Interconnection points for RedIRIS members

• Physically accesible to RedIRIS staff on a 7x24 basis

• Secure access

• Supply the required conditions to operate the RedIRIS-NOVA equipment (optical, data and management)

• Power Supply ( with backup power generators)

• Space ( ... and upto 600kg/rack)

• Temperature and humidity

• Neutral to the termination of 3rd party fibre

• Technical support and remote hands

15TF-MSP “Non-technical aspects of dark fibre” Workshop.

RedIRIS-NOVA PoPs II

16

Partnership with PoP sites

• Add/Drop PoPs (ROADM) site hosts are RedIRIS members

• Not a commercial relationship, Win-Win model supported on service.

• “Housing Agreement”

• Users can interconnect to RedIRIS-NOVA directly or through a Regional Network.

TF-MSP “Non-technical aspects of dark fibre” Workshop.

The Regional Networks (RNs)

17

E3

TF-MSP “Non-technical aspects of dark fibre” Workshop.

To Optical Regional Networks...

Extend RedIRIS-NOVA fiber footprint to reach RN points.• Great opportunity to improve the RN infrastructure

• Contribute to the concurrent evolution of national, regional and intercampus networks User Service Enhacement

• RedIRIS Support: As a means for regional networks to acquire and light dark fiber.

• Costs: • 12.500 km of fiber with national coverage• Favorable results by aggregating demand

• Agreements with Regional Governments• Current tender allows to reach 108 additional PoPs (phase I)• New tenders would be launched as needed (phase II)

18TF-MSP “Non-technical aspects of dark fibre” Workshop.

Optical Equipment Tender...

• List of mandatory and optional equipment functionalities.

• Hypothetical fiber footprint as working scenario for all bidders

• Management and Planification systems required.

19

• Virtual/logical Components Catalogue:

• Optical Functionality ≈ Virtual/Logical Component

• Vendors Equipment groupped and mapped their hardware list elements to each Virtual Component.

• Optical network design for the working scenario based only on Virtual Components

• Economical proposals include the cost for each Virtual Component:

• Only Virtual Components can be bought to light the real fiber footprint

TF-MSP “Non-technical aspects of dark fibre” Workshop.

Equipment and service guarantee provider : Telefonica Service Guarantee to end 2012. Alcatel-Lucent Equipment:1626 Light Manager Red 5.0A (6.0 update included)

WSS (Wavelength Selective Switch) technology. No O/E/O conversion.

50 Ghz grid spacing: 93 x 10 G / 80 x 40G

10G, 40G supported. 100G prepared to be supported when available

8-degree ( 7x1)

Directionless and colorless support.

EDFA and RAMAN amplification

Variable Optical Attenuators (VOA) in transponders and amplifiers.

Automatic Power Equalization

Automatic Pre-emphasis Adjustment

User ports ( required by RedIRIS): 10GE, GE and OTN.

OSNCP protection 1+1 included.

OSC running at 1510nm (4 Mbps)

GMPLS support

Network Management System: 1350 OMS Rel. 5.0A Optical Network Design Platform - ONDP Rel. 5.0A

20

Optical Equipment Tender Results

TF-MSP “Non-technical aspects of dark fibre” Workshop.

Optical Equipment Guarantee...

21

24/7 hot line to fix problems and technical support

• Hardware Replace Time: 4 hours

• Incident Time Resolution: 4 hours ( critical and high), NBD ( medium), 2 BD ( low)

• Direct access to the vendor support center

• 5-people operation team ( 24 hours @ RedIRIS offices)

Software Releases

• Upgrade upto 2 new software releases per year optical equipment, NMS and planification systeml

• Done by supplier ( remotely or in-situ, as needed)

Preventive Tasks

• Set of tasks to check the health of patch panels, fiber cords and optical equipments for all sites.

• At least, one per year.

TF-MSP “Non-technical aspects of dark fibre” Workshop.

Optical Equipment Guarantee...

22

Corrective & Scheduled Maintenance Works

Reports

Technical Documentation

• Complete access to the technical documentation ( even the private one): hardware, functionalities, bugs, interoperability...

• Regular (quarterly) Technical Workshops to present 12 months roadmap:: hardware and functionalties.

TF-MSP “Non-technical aspects of dark fibre” Workshop.

RedIRIS-NOVA services

23

Ethernet Layer Wavelengths between

RedIRIS PoPs:• Unprotected• Protected and/or• With Restoration

RedIRIS community RedIRIS community

Private CircuitsPrivate Circuits

RedIRIS community IP

services

RedIRIS community IP

services

Global IPv4 and IPv6 reachability

Multicast DNS IPv4 and IPv6 address

space management NTP

Optical Regional Networks

Optical Regional Networks

Wavelengths between Shared PoPs and/or RN PoPs:

Performance Monitoring Tools

By Type:• Unprotected• Protected and/or

with Restoration

By Use:• IP Regional

Network Support• Projects Support

TF-MSP “Non-technical aspects of dark fibre” Workshop.

24

Edificio Bronce, Plaza Manuel Gómez Moreno s/n28020 Madrid. España

Tel.: 91 212 76 20 / 25, Fax: 91 212 76 35