CESNET a.l.e. Czech Educational and Scientific Network June 4, 2002Development of the CESNET2 Optical Network1 Lada Altmannová Stanislav.

CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz

1Development of the CESNET2 Optical Network June 4, 2002

Development of the CESNET2 Optical Network

Lada Altmannová

Stanislav Šíma

June 4, 2002 Development of the CESNET2 Optical Network 2


Towards optical NRENs• In some cases, optical network must be

implemented in several consecutive phases, in which parts of an existing network are being replaced. This is the CESNET2 case.

• In this presentation, attention is paid mostly to information and experience, which can be useful for constructions of optical NRENs in other countries, and to problems, for which we would like to gain more experience from abroad.



First step: gigabit speed

• A relatively simple solution is to purchase SDH services operating at 2.5 Gb/s (STM-16 or OC-48) or 10 Gb/s (STM-64 or OC-192). These services are offered by telecommunication operators using fibre optics.

• However, this solution is rather expensive for NRENs, and from technical point of view it is quite complex for the given purpose. CESNET has different approach.



• We expect, that the wavelength lease will be preferred especially for long-distance connections (e.g., for fibre length over 400 km, which usually means an air distance of end points of about 200 - 350 km, considering curves of the path and its terrain profile).

• However, as WDM is just emerging as a new service, providers now try to include as much of the price of the installed WDM equipment as possible in the price of the wavelength lease. This can surprisingly make the wavelength lease more expensive than the fibre lease even for fibre length over 400 km.



TEN-34 CZ as initial network

• CESNET2, a national gigabit optical network for research and education in the Czech Republic, is gradually constructed by converting the TEN-34 CZ and subsequently TEN-155 CZ network, which used SDH lines (up to 34 Mb/s, and later up to 155 Mb/s)



Steps before: special solution• June 1997: 34 Mb/s wireless backbone

leased from Czech Radio Communication company

• July 1998: 34 Mb/s optical backbone with wireless first mile leased from Aliatel company (fiber is conducted in a ground cable on the top of high-voltage poles)

• June 1999: 155 Mb/s SDH Praha-Brno optical line with wireless first mile leased from Aliatel



First gigabit: leased fibre• Line Praha - Brno was launched in January 2000.• 323 km along oil distribution pipeline.• Cisco 12008 routers with 2.5 Gb/s (OC-48/STM-16)

adapters were installed on both ends. Transmitters used in the adapters had the range of 80 - 100 km.

• Three bidirectional regenerators Cisco ONS 15104 were also used on this line, located on provider premises along the line. ONS 15104 use the same optical transmitters and receivers as these adapters.

• This intercity gigabit line was one of the first in Europe to be entirely used for production IP traffic.





Building Gigabit Core• Tender was announced in the second half of the

year 2000 • Candidates could offer a fibre lease, a wavelength

lease or an SDH service.• We have chosen 7 lines from 6 different suppliers.• All circuits were put in service in the first half of

the year 2001: 4 leased fibre lines from 3 companies (Sloane, Selfservis, CEZtel) used for STM-16 transfer, 4 lambda services used for STM-16 transfer from CT, CRa and Aliatel.



Gigabit Lines of CESNET2 Network(June 2001)

Line Service type Road distance

(km)

Fibre length

(km)

Line type Regeneration Used since

Praha - Ostrava wavelength 386 N.A. 2,5 G supplier 12.2.01Praha - Č.Budějovice wavelength 139 N.A. 2,5 G supplier 22.2.01Praha - Plzeň wavelength 80 N.A. 2,5 G supplier 22.2.01Praha - Hradec Králové wavelength 90 N.A. 2,5 G supplier 5.3.01Praha - Brno fibre 202 323,3 2,5 G ONS15104 (3x) 10.1.00Praha - Pardubice fibre 114 188,6 2,5 G ONS15104 (1x) 1.3.01Praha -Liberec fibre 108 160,0 2,5 G ONS15104 (2x) 15.5.01Brno - Olomouc fibre 81 124,3 2,5 G ONS15104 (2x) 24.5.01

Nodes are equipped with CISCO 12016 routers with OC-48 adapters. ONS 15104 is bidirectional optoelectric OC-48/STM-16 regenerator.



• The number of installed regenerators depends also on possibilities for their placing along the line. E.g. the line Praha - Liberec is divided into three sections - 40 km, 80 km and 40 km - and it is not possible to place a regenerator in the 80 km section (fibre on the top of high-voltage poles).

• In one case, the regenerators were leased by the supplier of the line. In other cases, the regenerators belong to CESNET.

• Regenerator management: Local assistance is provided by the supplier of the line and CESNET can configure this regenerators remotely.





Changing topology• Based on the acquired experience, a tender was

announced in the second half of the year 2001 for additional fibre or wavelength lease.

• We requested preliminary offers to find out which lines could be provided by individual suppliers for comparatively low prices. This depended on the topology of their fibre infrastructure, which was not fully announced before.

• We try to use Gigabit Ethernet (and 10-Gigabit Ethernet, if possible) for new long distance lines.



General conclusion for year 2002• STM-16 lambda service price decreased - to be

comparable with leased fibre prices.• Gigabit or 10-Gigabit Ethernet is less expensive

solution for gigabit lines over long distances.• Constant budget allows further leased fibres or

lambdas – backbone topology change is feasible.• Is possible to lease fibre along railway, along oil, gas

or heat distribution pipelines and from electric power distribution or cable TV companies (but highway or road fibre leasing is not possible yet).

• Big problem is fibre for first mile of intercity lines.



First Optical Mile for intercity linesA. Supplier of an intercity line pays for the installation of

the necessary first optical mile B. Member of the CESNET association pays for the

installation of optical connection to its nodes.• The alternative A is convenient for the supplier in

locations with a sufficient demand for services.• The alternative B remains necessary in peripheral

locations, where providers do not want to invest into a new cable. Usually, more subjects interested in high-quality (that is optical) Internet access build their own "local optical network of fiber owners" in a joint-effort.



Prices for research - CZ 2002

Service Bandwidth Length (km) Price EURO /monthmicrowave - 2 steps 34 M up to 80 2 077microwave - 3 steps 34M up to 120 3 084

SDH 34 M 100 - 500 3 811 - 9 934colour 2,5 G 100 - 500 8 143 - 13 029fibre <= 40 G 30 - 500 779 - 16 286

We use microwave 34 M lines with FastEthernet interface





CESNET2 development: 2002• Dual connection to GigaPoPs on backbone

(higher reliability, circuit testing with real traffic).• GE, FE or Eth lines to other cities (better service

for remote users, more traffic for backbone).• 149 km GE fibre line Ostrava – Olomouc with

regenerator is operating since January 7, 2002• 189 km GE fibre line Praha – Pardubice without

in-line amplification or regeneration is operating since May 17, 2002

• 176 km 10 GE fibre line Praha - Plzen is prepared



Ostrava – Olomouc (Long distance GE line since January 7, 2002)

• 149 km leased fiber, in-line L2 switch used as regenerator

• Traffic statistics: http://www.cesnet.cz/provoz/zatizeni/

• Line cards: GE for GSR with GBIC-ZX• Catalyst 3512 XL with GBIC-ZX• GBIC-ZX: Pin: 0 to 4,77dBm, Pout: -23 to 0dBm,

power budget: 23dB



Hardware cost savings• Capital cost savings are achieved in the CESNET2

network by gradually deploying Gigabit Ethernet instead of STM-16 over optical fibre .

• Optical fibres are connected to GSR 12016 routers. Costs depend on price of GSR interface ports mainly:

~ 27.000 Euro for GE port instead of 88.000 Euro for STM-16 port,

~ 15.000 Euro for GE regeneration instead of 30.000 Euro for STM-16 regeneration.

(this example is from end of year 2000, relations are relatively stable despite of price decreasing)

• Capital savings are around 66 % for one fibre line with one regeneration point (approximately 160 km long line).



Praha-Pardubice(Long distance GE line since May 17, 2002)

• 189 km leased fibre G.652, attenuation 44.65dB, without in-line equipment

• Traffic statistics: http://www.cesnet.cz/provoz/zatizeni/

• Line cards: GE for GSR with GBIC-ZX• Optical amplifier: Keopsys KPS-BT-C-21-Bo-FA

21dBm booster, C-band single channel• Optical attenuator: 5dB (for optical amplifier

input)







Gigabit lines deployment(June 2002)

Line Service type Road distance

(km)

Fibre length

(km)

Line type Regeneration Used since

Praha - Č.Budějovice wavelength 139 N.A. 2,5 G supplier 22.2.01Liberec - H. Králové wavelength 96 N.A. 2,5 G supplier 21.1.02Ostrava - H. Králové wavelength 247 N.A. 2,5 G supplier 1.2.02Č. Budějovice - Brno wavelength 226 N.A. 2,5 G supplier 22.5.02Praha -Liberec wavelength 108 N.A. 2,5 G supplier 1.6.02Praha - Brno fibre 202 323,3 2,5 G ONS15104 (3x) 10.1.00

Brno - Olomouc fibre 81 124,3 2,5 G ONS15104 (1x) 24.5.01Ostrava - Olomouc fibre 105 149,0 1 GE C3512 (1x) 7.1.02Pardubice - H. Králové fibre 22 30,0 1 GE no 15.1.02Praha - Pardubice fibre 114 188,6 1 GE * 17.5.02

Praha - Plzeň fibre 80 176,7 2,5 G ONS15104 (1x) 1.6.02Praha - Ústí n. L. fibre 92 156,2 1 GE * 1.8.02

ONS 15104: bidirectional STM-16 regenerator , C3512: switch used as regenerator,

* without in-line regeneration or amplification, single colour optical post-amplifier (booster) 21dBm in both end points



Line upgrade without provider• BIP - Bandwidth Independent Price (e.g. fibre

leasing)• NIL – Nothing In-Line (without in-line housing,

pre- and post-amplification is possible): lower installation and operational costs

• UU – User Upgradeable (possibility of line upgrade by user ) = without provider assistance and without additional payment (up to physical limits)

• UU = BIP + NIL



UU possibilityLine Fibre length

(km)BIP NIL UU

Praha - Č.Budějovice wavelength No No NoLiberec - H. Králové wavelength No No NoOstrava - H. Králové wavelength No No NoČ. Budějovice - Brno wavelength No No NoPraha -Liberec wavelength No No NoPraha - Brno 323,3 Yes No NoBrno - Olomouc 124,3 Yes No NoOstrava - Olomouc 149 Yes No NoPraha - Plzeň 176,7 Yes No NoPardubice - H. Králové 30 Yes Yes YesPraha - Pardubice 188,6 Yes Yes YesPraha - Ústí n. L. 156,2 Yes Yes Yes

UU – Upgrade by User, NIL – Nothing In-Line, BIP – Bandwidth Independent Price







Possibilities for international fibre connection of NRENs

• Praha-Műnchen (525 km)

• Praha-Frankfurt a. M. (1022 km)

• Praha-Bratislava-Wien (682 km)

• Praha- Poznaň (1010 km)

• Praha-Warszava (1080 km)



Prices for research: international exampleLine Fibre

length (km)

Installation price (EUR)

Usage price km/pair/month

(EUR)

Leased time (years)

Praha (CZ) - Vohburg (D) 390 0 40 1

Vohburg (D) - Frankfurt a.M. (D) 632 53 745 100 565 15

Vohburg (D) - München (D) 135 32 247 54 532 15

Praha (CZ) - Ropice (CZ) 525 0 40 1

Ropice (CZ) - Bielsko Biala (POL) 70 0 50 1

Ropice (CZ)- Warszava (POL) 550 0 40 1Praha (CZ) - border CZ/SK 390 0 40 1

border CZ/SK - Bratislava (SK) 139 0 40 1

border CZ/SK - border SK/A 186 0 40 1

border SK/A - Wien (A) 106 0 100 5





Acknowledgments

The authors are particularly grateful to

Jan Gruntorád, Václav Novák, Jan Radil, Martin Míchal, Václav Fanta, Pavel Vachek, Sven Ubik, Jana Peroutíková and other colleagues from CESNET for their cooperation.

CESNET a.l.e. Czech Educational and Scientific Network June 4, 2002Development of the CESNET2 Optical Network1 Lada Altmannová Stanislav.

Documents

scientific network

czech educational

cesnet2 optical network7

cesnet2 optical network3

cesnet2 optical network11

cesnet2 optical network2

cesnet2 optical network5

cesnet2 optical network4