CNGI-CERNET2 Operation Oct 21, 2008
Deploy Topology of CNGI-CERNET2 (2004-12)Point2point link address IPv4range: 202.38.120.0/25start: 202.38.120.4/30IPv6range: 2001:DA8:1::/48start: 2001:DA8:1:1::/64
Loopback addressIPv4range: 202.38.120.192/27start: 202.38.120.192/32IPv6range: 2001:DA8:1:ff::/64start: 2001:DA8:1:ff::/128
北京
郑州
西安
武汉
合肥
上海
杭州
成都
沈阳
天津
重庆
济南
大连
长春
长沙
南京
厦门
兰州
哈尔滨
广州
2.5G
155M
juniper
bitway
huawei
CNGI-CERNET2 is Started to provide service at the end of 2004.
25 POPs, 1 core router for each POP. The speed of backbone link is from 155M to 2.5G
Due Topology of CNGI-CERNET2 (2006-8) topology when CNGI-CERNET2 project is finished
Still 25 POPs.2 core routers for each POP.1 or 2 edge routers for each CPN.Speed of backbone linkis from 2.5G to 10G.
10GPOS
2.5GPOS
比威 BE12016
华为 NE80
华为 NE5000
Juniper T640
CiscoCRS
Hitachi GR4000
北京-清华
西安武汉
合肥
上海-交大
广州
成都
沈阳
天津
重庆
厦门
南京
兰州
大连
哈尔滨长春
济南
杭州长沙
郑州
北京-北大北京-北邮
北京-北航
上海-复旦
上海-同济
CNGI-6IX上海
CNGI-6IX北京
Current State of CNGI-CERNET2
All on-line core routers are from single vendor to optimize advanced service support like multicast and MPLS.
Currently more than 200 customer networks, about 2M end users.
Statistics of Tickets and Traffic(2006-08 ~ 2008-08)
• Statistics of Tickets of 2007
• Statistics of Tickets of 2008
• Statistics of Backbone traffic of 2007
• Statistics of Backbone traffic of 2008
• Assigned IPv6 Address Blocks
Statistics of Tickets of 2007Stati sti cs of Ti ckets of 2007
(Total 604)
39%
25%
19%
5%
12%
Li nkMai ntai n
Li nkFai l ure
RouterMai ntai n
RouterFai l ure
POP
Router failure is 19%.
We find many bugs of routers of different vendors.
Statistics of Tickets of 2008Stati sti cs of Ti ckets of 2008
(Total 427)
43%
16%
15%1%
25%
Li nkMai ntai n
Li nkFai l ure
RouterMai ntai n
RouterFai l ure
POP
Router failure is cut down.
IPv6 goes more mature.
Statistics of Backbone traffic of 2007
64%
3%
4%
4%
8%
4%3% 2%
清华 武汉 广州
南京 上交 郑州
天津 济南 沈阳
大连 长春 哈尔滨
北大 北邮 北航
西安 成都 重庆
兰州 合肥 杭州
厦门 长沙 复旦
同济
18%
5%
7%
3%
3%
5%
2%
3%
3%
5%3%2%4%
3%
1%
2%
4%
4%
3%3%
4%
4%
3%
2%
3%
清华 武汉 广州
南京 上交 郑州
天津 济南 沈阳
大连 长春 哈尔滨
北大 北邮 北航
西安 成都 重庆
兰州 合肥 杭州
厦门 长沙 复旦
同济
Border Backbone
Inbound Traffic of Backbone Outbound Traffic of Backbone
Backbone traffic is 1.8G. Border traffic is low, the major traffic is generated by DVTS.
Information source is not balanced. Shanghai contribute the most. They have trial IPTV service.
Statistics of Backbone traffic of 2008
2%2%
3% 2%
2%
5%
29%
42%
3%
3%
清华 武汉 广州
南京 上交 郑州
天津 济南 沈阳
大连 长春 哈尔滨
北大 北邮 北航
西安 成都 重庆
兰州 合肥 杭州
厦门 长沙 复旦
同济
Border Backbone
Inbound Traffic of Backbone Outbound Traffic of Backbone
8%
9%
2%
3%
2%2%
2%
2%
11%
13%3%2%
3%
3%
6%
2%
3%
6%
3%3%
3%
3%
3%
3%
2%
清华 武汉 广州
南京 上交 郑州
天津 济南 沈阳
大连 长春 哈尔滨
北大 北邮 北航
西安 成都 重庆
兰州 合肥 杭州
厦门 长沙 复旦
同济
Backbone traffic doubled. Border traffic increased dramatically. Besides Shanghai, there are other POPs contribute much traffic, such as BUPT, Shenyang and Hefei.
Route Prefix
There are about 1100 IPv6 items.属于 2001:da8::/32且前缀长度为 48的BGP路由条数: 156
There are about 1100 IPv6 items.156 BGP route table items belong to 2001:da8::/32 and with prefix length48
CERNET2 NOC
• Team– NOC Director (1)– Engineers(2)– help-desk(6) – dedicated for CERNET2 operation
• 365*24 Service– 365×24 helpdesk– 365×24 On-Call Engineer
• Operation Procedure– Home-made ticket system for operation management– Documents– Ticket– Report(Daily, Weekly, Monthly)
Research Activities
• Softwire (4o6)
• SAVA (Source Address Authentication)
• Applications
• …..
Currently, there are a lot of research activities on CERNET2.
CERNET 主干网
上海交大华南理工
北大
东南大学
北邮
华中科技
清华
CERNET2主干网
IPv6网
IPv4网
4over6网关
Softwire
Softwire is a 4o6 solution.They deployed 8 testing nodes around 7 universities of 5 cities.They have now set up a working group in IETF and published RFC4925.
SAVA
SAVA is a source address authentication solution. They deployed 14 testing nodes on CERNET2.They also set up a working-group in IETF and published RFC5210.
6PlanetLab
6PlanetLab is another popular project which is cooperated with planetlab project.
Currently they have developed 50 nodes around china in 25 cities.
IPv6 based IPTVIPv6 based IPTV
Currently IPTV is the most popular application in CERNET2. Currently IPv6 network has no so much traffic as IPv4 network, but it may be a good situation for high bandwidth application.
3TNet connected to CNGI-CERNET2, transferring CCTV programs.
IPv6 IMSIPv6 IMS
IPv6 IMS system.
Support IP to phone based on SIP.
Currently, there are about 1000 on-line users.
ipv6.beijing2008.cnCERNET2 host official IPv6 website for Olympics Games 2008 at Beijing.This is the 1st official IPv6 website in the history of Olympics.
2. CPN Test
• Test 100 CPNs of 100 famous universities in China
• Focus on connectivity, Web and DNS services, Scale of IPv6 users
Test method
• Ping all CPN from a server on NOC
• Dig DNS of all CPN from a server on NOC
• Wget webpage of all CPN from a server on NOC
• Setup a website and ask for sign on– http://6rank.edu.cn/
Some Result
• There are more than 200,000 IPv6 users access our test website
• DNS Configuration is a major source of Problems – Availability
• Some websites are not reachable due to DNS miss configuration.
– Performance• DNS miss configuration may also cause long latency and thus cause low
performance of web access.
• IPv6 Performance of Unix is much better than Windows
I Pv6填写验证码的独立 地址增长曲线
0
50000
100000
150000
200000
250000
时间
IPv6地址数
1系列
i pv6填写验证码的独立 访问范围统计
3% 5%
87%
5%
>80004000-80001000-4000<1000
There are more than 200,000 persons visit testing websites.Most of CPN has more than 1000 users.During testing, the backbone traffic increased.
3. Research Project of NOC
• GPERF
• TRC
• BGP-Grid
CERNET2 NOC also involved in some research projects.
GPERF(http://gperf.edu.cn)
They develop a global active measurement system named GPERF. Currently GPERF has near 1000 probes covering more than 270 ASes.From Apr 2008, GPERF is used to monitor important information systems of Olympics.We will appreciate if any one would like host a gperf node.Gperf is very lightweight. It does not need a dedicated server.
TRC(http://dragonlab.org)
To support research of IPv6, CERNET2 NOC generate and publish IPv6 traffic trace.We also develop a IP anonymousized tools and open source.
BGP-Grid
We always meet much problems on inter-domain routing. However, it is not convenient to investigate them. It is hard to do emulation. And the testing works are very costly.The idea of BGP-grid is to construct a network by servers. This network has the same topology as real AS interconnection network. Use tunnel links to connect servers together. Inside each AS, the server learns routing information and policy from border router.We can do testing works in this BGP-grid without any affecting of commodity network.
• bgpgrid-113:~# bgping -c 1 203.91.120.0
• BGPING 203.91.120.0...
• Ping route => 203.91.120.0 [seq=0]• <- AS 24489 202.179.241.49• -> AS 23911 202.179.241.50• <- AS 23911 210.25.189.65• -> AS 23910 210.25.189.68• <- AS 23910 202.38.120.189• -> AS 24575 202.38.120.190• Pong route <= 203.91.120.0 [seq=0]• <- AS 24575 202.38.120.190• -> AS 23910 202.38.120.189• <- AS 23910 210.25.189.68• -> AS 23911 210.25.189.65• <- AS 23911 202.179.241.50• -> AS 24489 202.179.241.49
• bgpgrid-113:~# bgping -c 1 166.111.8.0
• BGPING 166.111.8.0...
• Ping route => 166.111.8.0 [seq=0]• <- AS 24489 202.179.241.49• -> AS 23911 202.179.241.50• <- AS 23911 210.25.189.65• -> AS 23910 210.25.189.68• Pong route <= 166.111.8.0 [seq=0]• <- AS 23910 210.25.189.68• -> AS 23911 210.25.189.65• <- AS 23911 202.179.241.50• -> AS 24489 202.179.241.49
This is a tool of BGP-grid named bgping.
It can show round-trip path and AS number.
4. Challenges
• The old question “what is the killer application”
• Interconnection between IPv4 and IPv6– IPv6 user access IPv4 resources– IPv4 user access IPv6 resources– For a user to set up tunnel himself is not a
good solution
• Self-sufficiency of current IPv6 infrastructure