PIONIER – fiber based NREN from an idea to the fact Artur Binczewski, Michał Przybylski, Maciej Stroiński artur | michalp | [email protected] TERENA workshop on NREN-controlled fibers Copenhagen, 24th October 2003
Jan 16, 2016
PIONIER – fiber based NRENfrom an idea to the fact
Artur Binczewski, Michał Przybylski, Maciej Stroiński artur | michalp | [email protected]
TERENA workshop on NREN-controlled fibers Copenhagen, 24th October 2003
PIONIER - idea
The idea of PIONIER emerged in 1999, based on newly announced eEurope programme
Goals:– to provide research infrastructures fulfilling the demands of
modern science, education, services and applications– to develop and test new generation of applications for information
society– to enable international collaboration, especially in the area of new
software and services for information society
PIONIER has been presented in 1999 and accepted in 2000 by KBN (State Committee for Scientific Research)
Phase I – network planning
Market survey: • national providers unable to fulfill the requirements of science (lack of bandwidth, low
reach, high prices)• inability to provide dark fibers
Target: to find suitable solution for science
• 2000 - first DWDM over dark fiber testbed in Poland (done as PIONIER experiment), demonstration of pilot, lambda based applications
• 2001 – second DWDM testbed and MPLS test,
Results: decision to build own fiber network, DWDM selected as the transport technology in PIONIER
Problem: no dark fiber offers from telecoms
Solution: PSNC will build fibers for academic community (ndependent investor or together with telcos)
Phase II – fibers deployment
Financial limitations:– science cannot build fibers alone, need to cooperate with
industrySolution:
– some fibers were to be built with telco participation - green field deployments
• 2001 – Telbank, Szeptel (1434km)• 2002 – Telbank, (<1214)
– main investor in other relations (2002, coop. with regional power grids) (reszta z 1214km)
Financial participation proportional to the fiber share in the whole cable (usually 16 fibers are owned by PIONIER, rest belongs to telcos)
Phase II – fibers deployment cont.
Investment protection:– SMF (Standard Mode Fiber, G.652, general purpose –
regional and national; used currently for 10GE transmission)– NZDSF (Non-zero Dispersion Shifted Fiber, G.655, future
long range multi-lambda 40Gbit/s transmission for direct HPC connection)
– average span length 60km for national backbone (allows for different class of equipment to be used)
– new interesting areas emerged – customer owned pipes (for future applications)
Problems– local loop construction is sometimes difficult (urban area -
average 6 months waiting time for permissions)
Phase II – fibers deployment, 3Q2003.
ŁÓ DŹ
TO RUŃPO ZNAŃBYDG O SZCZ O LSZTYNBIA ŁYSTOK
G D AŃSKKO SZALINSZCZECIN
ZIELO NAG Ó RA W RO CŁAWCZĘSTO CHO WAKRAK Ó W RZESZÓ W
LUBLINKIELCE PUŁAW YRADO MKATOW ICEG LIW ICE BIELSKO -BIAŁA
O PO LE
G U BIN WARSZAWA
CIESZYN
SIEDLCE
10 G E nodes10G E links
ŁÓDŹ
TORUŃ
POZNAŃ
BYDG OSZCZ
OLSZTYN
BIA ŁYSTOK
GD AŃSK
KO SZALIN
SZCZECIN
ZIELO NAGÓ RA
W RO CŁAW
CZĘSTO CHOWA
KRAK ÓW RZESZÓ W
LUBLIN
KIELCE
PUŁAW Y
RADO M
KATOW ICEGLIW ICE
BIELSKO-BIAŁA
OPO LE
GU BIN WARSZAWA
CIESZYN
SIEDLCE
PIO NIER nodesInstalled fiber
F ibers planned in 2004PIO NIER nodes planned in 2004
Phase II½ – 10GE transmission
Late 2002: – the need to reduce operational costs.– availability of some fiber links scheduled at mid 2003– needs from VLBI and CERN for high bandwidth links
Decision to buy 10GE transmission equipment for intermediate stage – tender announced.
This solution shall exist until target 40Gbit/s DWDM system is installed.
Then the equipment will be moved to regional networks
Phase II½ – 10GE transmission
Tender conditions:– complete 10GE transmission equipment had to be
delivered, installed and trial-tested. – router for VLAN routing and international
connectivity
Tender results:– no appropriate 10GE switch interface/line amplifier found– transport on simplified DWDM from ADVA / INRANGE– Black Diamond 10GE switches used as core equipment– A7770 for international connectivity and VLAN routing
Phase II½ – 10GE transmission
ŁÓDŹ
TORUŃ
POZNAŃ
BYDG OSZCZ
OLSZTYN
BIA ŁYSTOK
GD AŃSK
KO SZALIN
SZCZECIN
ZIELO NAGÓ RA
W RO CŁAW
CZĘSTO CHOWA
KRAK ÓW RZESZÓ W
LUBLIN
KIELCE
PUŁAW Y
RADO M
KATOW ICEGLIW ICE
BIELSKO-BIAŁA
OPO LE
GU BIN WARSZAWA
CIESZYN
SIEDLCE
10 G E nodes10G E links
Technical details – link specification
Line Poznan – Zielona Góra
From To Distance [km]
Attenuation [dB]
Fiber type
Poznan Poznan-TB ? 10 Corning G.652
Poznan-TB Grodzisk 56.67 13.2 Corning G.652
Grodzisk Wolsztyn 25.75 6.23 Corning G.652
Wolsztyn Sulechów 42.03 8.97 Corning G.652
Sulechów Zielona Gora TB 23.64 5.1 Corning G.652
Zielona Gora TB Zielona Gora ? (4) 10 (2.1) Corning G.652
Link specification 2
Tender specification
• fiber optics parameters specification (span, attenuation., att. estimation @ 0.25dB/km, real att. approx. 0.23dB/km)
• node localisation (where, what voltage, rack space)
• regeneration points (where, what voltage, access etc.)
• 10GE switch-based transport technology required (no WAN/LAN specification), one standard for whole network
• number & type of required interfaces in each node
• functionality of 10GE nodes
• extra functionality (ATM transport)
Transmission equipment
– ADVA Spectrum 3000 SL (SNMP)
– WDM modules
• 10GBaseLR LAN PHY, 10.312Gbit/s
• SDH WAN-PHY STM-64, 9.953Gbit/s
• FEC
• Automatic laser shutdown, LOS
• 48V
– custom tailored optical filters (reduced)
– DCM dispersion compensation module (20km, 40km, 2x40km)
– EDFA (in-line, pre-amp, booster, 4 channels, SNMP, ALS, 20(L)-23(C)dB gain)
Quantities
BD 6808 switch - 16
10GE switch card 1310nm - 37
1GE card (GBIC) - 16 (63)
Juniper M5 - 7
ADVA shelf - 50
10Gbit transponder - 42
EDFA - 44
DCM - 56
Regeneration cost – 50%
Installation
Gdansk optical lines: G.652
1 port Tczew Grudziądz Chełmno 1 port
1310nm 6,00dB 1310nm
45 km 27 km 41 km 40 km 33 km 50 km
11,25dB 6,75dB 10,25dB 10,00dB 8,25dB 12,50dB
(shared shelf)
MAN
/ Active Repeater /
DCM40>EDFA
>In/Out
SCNFM> WCM > DCM20 DCM40>EDFA
>In/Out
<EDFA<
In/Out DCM40 DCM20 <Tx
WCM
>RxSCNFM
<EDFA<
In/Out DCM40 < WCM <SCNFM
(ter
min
ated
)
MAN
Rx<
WCM
Tx>
SCNFM
Malbork Kwidzyn
Toruń
Line #1 Gdańsk-Toruń
10GE Switch
10GESwitch
...
13dB
5dB 3dB10d 10dB
5dB8dB8dB
Problems
• real line attenuation different (lower!) than planned (extra attenuators needed)
• need to keep proper signal/noise ratio (NSR, carefull amp/WDM) operating point
selection
• last minute project changes (last mile length variation)
• equipment relocation (changes during fiber works)
• optimisation (changes wrt original project)
• others not yet known (but will surely come up!)
MaintenanceMaintenance agreement with line operator, in case of major failure
24hrs to restore connectivity.
Failures may result from:
a) improper installation
b) material defects
c) Force Majeure
d) others (aging... ?)
They are repaired by the specialized company and are paid respectively by:
a) installing company
b) cable manufacturer
c) PSNC
d) PSNC....?
Why CEF? The economy behind
Telco provided channels between 21 MANs, per year:
• 622Mb/s (real cost) : 4.8 MEuro
• 2.5Gb/s (estimated cost, no offers available) : 9.6 MEuro
• 10Gb/s (estimated cost, no offers available) : 19.2 MEuro
Estimated PIONIER costs (based on actual costs for 2600 km)
• cost of 5200km of fibers + 10GE transmission : 55.0 MEuro
• annual PIONIER maintenance costs : 2.1 MEuro
Return of Investment in 3 years!(calculations made for only 1 channel used)
other advantages not included in calculation ;)
2003
1. To continue the development of remaining 2500km of fibers (new funding of 5MEuro received)
2. To start the deployment
of regional networks
Questions?
Thank you!
Michal [email protected]