National Knowledge Network Page 1 NKN Future Roadmap Challenges & Opportunities Prabhakar Dhekne Scientific Consultant to Principal Scientific Adviser to GOI & Former Associate Director E&I Group, BARC 2 nd Annual NKN workshop at IISC, Bangalore from Oct 17-19, 2013
36
Embed
NKN Future Roadmapworkshop.nkn.in/2013/images/presentation/Talk-2ndNKN... · 2013-10-24 · NKN Future Roadmap Challenges & Opportunities Prabhakar Dhekne ... serve as a test-bed
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
National Knowledge Network Page 1
NKN Future Roadmap
Challenges & Opportunities
Prabhakar Dhekne
Scientific Consultant to Principal Scientific
Adviser to GOI & Former Associate
Director E&I Group, BARC
2nd Annual NKN workshop at IISC, Bangalore from Oct 17-19, 2013
National Knowledge Network Page 2
Outline of Talk
• Global Research Collaborations
• Trends in e-infrastructure
• National Knowledge Network(NKN)
• Major Challenges & Opportunities
• Testing of Dark Fiber for NKN scaling
• Conclusions
National Knowledge Network Page 3
Research Collaborations
India is effectively participating in the major international experimental
programmes in Europe such as Large Hadron Collider (LHC), ITER, and
others. Participation in the European Framework Programmes has been very
fruitful and has enabled Indian scientists to collaborate in frontier research
activities with European colleagues.
Cooperation with Global Virtual Research Communities (GVRCs) through
projects like LHC Grid & EU-IndiaGrid gave India much needed impetus
for creating an e-infrastructure within the country. The cooperation has been
enhanced by two closely related EU-funded projects – EU-IndiaGrid2 and
CHAIN.
The EU-IndiaGrid project, which has allowed Indian scientists to access
major European and Indian Grid infrastructures exposing them to the grid
technology, made significant progress in last two years.
National Knowledge Network Page 4
Trend: Network Infrastructure
Grid & Cloud computing has demanded deployment of an advanced network infrastructure for Research & Education to be effective
Light (lambda network facility) is the response to the need for high-quality research and education. It will
help create a viable economy-of-scale model for the region to reduce networking costs per country,
serve as a test-bed for development of new services, and allow the R&E community to participate in international networking activities
support the growth of National Research & Education Networks (NRENs), accelerate research, fuel national and regional economic growth, and aid their integration with the rest of world.
Many countries today have Lambda Network Facility – an e-infrastructure
National Knowledge Network Page 5
The e-Infrastructure of India
Indian Grid
Certification
Authority
EU-IndiaGrid
CHAIN
TIFR-CERN link
National Knowledge Network: Enabling a Paradigm Shift in Research
Infrastructure And Global Science Cooperation
NKN is a state-of-the-art multi-gigabit pan-India network: www.nkn.in
National Knowledge Network Page 6
How Testing of NKN was done?
• Exhaustive testing was conducted
– Functional Testing (ping, test route, latency, packet loss)
– Sustainability Testing by HD Video-Con tests (Light weight,
lossy data permitted)
– End-to-End Performance & Reliability Testing using FTP data
transfer for short & long periods (Heavy weight, lossless data)
– Application testing
• Collab-CAD connecting BARC-IGCAR-NIC
• Grid Computing (DAE grid BARC-IGCAR-TIFR-VECC)
National Knowledge Network Page 7
Interconnect-Related Terms
Most critical component of HPC still remains to be interconnect
technology and network topology
Latency:
Networks: How long does it take to start sending a "message"?
Measured in microseconds- startup time
Round Robin Delay & Number of Hops
Processors: How long does it take to output results of some
operations, such as floating point add, divide etc., which are
pipelined?)
Bandwidth: What data rate can be sustained once the message is
started? Measured in Mbytes/sec or Gbytes/sec
National Knowledge Network Page 8 8
Best Effort is not Good Enough …
- Set up optimized
path
- Select Level 2,3
,4 switching
- Trade-off
between buffer
size & Appln
- Guaranteed end-
to-end
performance
Choice for QOS
National Knowledge Network Page 9 9
On the Network: Big Problems!
• Network Traffic Profile
• Mixing Traffic
• Trade of between buffer
size Vs Appln
## Better Data handling methods, Innovative Algorithms in Data analytics are
needed. Also high resolution data visualisation techniques & tools needed to be
developed !!!
National Knowledge Network Page 10
National Knowledge Network Progress Chart
NKN User Nodes Commissioned, Mar-14, 58
NKN User Nodes Commissioned, Apr-14, 60
NKN User Nodes Commissioned, May-14, 66
NKN User Nodes Commissioned, Jun-14, 69
NKN User Nodes Commissioned, Jul-14, 73
NKN User Nodes Commissioned, Aug-14, 75
NKN User Nodes Commissioned, Sep-14, 78
NKN User Nodes Commissioned, Oct-14, 81
NKN User Nodes Commissioned, Nov-14, 83
NKN User Nodes Commissioned, Dec-14, 85
NKN User Nodes Commissioned, Jan-15, 89
NKN User Nodes Commissioned, Feb-15, 104
NKN User Nodes Commissioned, Mar-15, 104
NKN User Nodes Commissioned, Apr-15, 152
NKN User Nodes Commissioned, May-15, 179
NKN User Nodes Commissioned, Jun-15, 199
NKN User Nodes Commissioned, Jul-15, 210
NKN User Nodes Commissioned, Aug-15, 248
NKN User Nodes Commissioned, Sep-15, 358
NKN User Nodes Commissioned, Oct-15, 382
NKN User Nodes Commissioned, Nov-15, 467
NKN User Nodes Commissioned, Dec-15, 606
NKN User Nodes Commissioned, Jan-16, 638
NKN User Nodes Commissioned, Feb-16, 672
712
NKN User Nodes Commissioned, Mar-17, 1500
NKN User Nodes Provisioned, Mar-14, 65
NKN User Nodes Provisioned, Apr-14, 67
NKN User Nodes Provisioned, May-14, 70
NKN User Nodes Provisioned, Jun-14, 72
NKN User Nodes Provisioned, Jul-14, 78
NKN User Nodes Provisioned, Aug-14, 79
NKN User Nodes Provisioned, Sep-14, 85
NKN User Nodes Provisioned, Oct-14, 91
NKN User Nodes Provisioned, Nov-14, 104
NKN User Nodes Provisioned, Dec-14, 121
NKN User Nodes Provisioned, Jan-15, 139
NKN User Nodes Provisioned, Feb-15, 157
NKN User Nodes Provisioned, Mar-15, 185
NKN User Nodes Provisioned, Apr-15, 224
NKN User Nodes Provisioned, May-15, 259
NKN User Nodes Provisioned, Jun-15, 270
NKN User Nodes Provisioned, Jul-15, 276
NKN User Nodes Provisioned, Aug-15, 418
NKN User Nodes Provisioned, Sep-15, 446
NKN User Nodes Provisioned, Oct-15, 471
NKN User Nodes Provisioned, Nov-15, 557
NKN User Nodes Provisioned, Dec-15, 667
NKN User Nodes Provisioned, Jan-16, 711
NKN User Nodes Provisioned, Feb-16, 754 774
NKN User Nodes Provisioned, Mar-17, 1500
No. of NKN User
Nodes
NKN Progress Chart
NKN User Nodes Commissioned NKN User Nodes Provisioned No. of user nodes
Explore Feasibility of setting up Sanitization Lab
Indigenization of Key NKN Components
Manufacturing & Quality Assurance
Deployment & Testing
Building Capacity & Capability in HR
Establishing International NKN PoPs
HLC Decisions
National Knowledge Network Page 14
NKN R&D Programme
Model Projects e-class rooms, edu-Medical, Collab-DDS, E-Foundry, DAE
outreach centre, Brain Grid, NBG
Design & Development of Indigenized Products
ITMA (SETS, BARC,NIC,ECIL)
SNAS (BARC, ECIL)
Optics Switch Router ESR series (IITB, ECIL)
Enterprise Router (C-DOT)
NMS (BARC, C-DAC, NIC, NTRO)
Establishing National Test Labs
Setting up of National Data Centres
National Knowledge Network Page 15
Participation in Model Projects
• Participation for model projects for key applications and to
take active part in feasibility, capability and sustainability
testing and ensuring effective use of high bandwidth of NKN
• Approach for using NKN
- Proposal in specific format to PSA’s office
- Make plan to implement close user group on NKN
- To demonstrate the potential/benefits of NKN
- Connecting additional sites to NKN
• Approx. 4-6 projects per year
National Knowledge Network Page 16
Via CERN NKN PoP
Via Singapore NKN PoP Singapore, Japan, Australia, and rest of Asia Pacific
Via USA NKN PoP
1. East Coast – NY
/ Wash DC / Chicago
2. West Coast –
Los Angeles / Seattle
NKN International Connectivity
Model Project scheme to showcase the
applicability across a spectrum of applications
focusing on education, health and life sciences
NKN HLC has cleared establishment of NKN PoPs overseas - US - Europe - Asia Pacific including Japan and Australia).
National Knowledge Network Page 17
Few aspects to be considered
• Sustainable applications of common
interest such as weather/climate
modeling & simulation, biodiversity,
Cancer and Brain Grids, Education
contents
• Agreeing on standard data formats
and data sharing policy
• R & D in advanced networking (100G
& above), software development etc
Enhancing Global Research Collaborations by enhancing network connectivity between NKN and the Research and Education Networks (RENs) of the world is becoming an absolute necessity.
Global Research Collaborations
National Knowledge Network Page 18
COMPUTE (more FLOPS)
DA
TA
(m
ore
BY
TE
S)
NETWORK
(more
BW)
Today’s Applications
Data and
High Performance
Computing
Data and
Cyberinfrastructure
Services
These applications, are both
data-intensive and compute-
intensive.
National Knowledge Network Page 19
ICFA Report 2009 - Main Trends Accelerate: Dark
Fiber Nets, Dynamic Circuits, 40-100G
Current generation of 10 Gbps network backbones and major Int’l links arrived in 2002-8 in US, Europe, Japan, Korea; Now China, Brazil
Bandwidth Growth: from 16 to 10,000X in 7 Yrs. >> Moore’s Law
Proliferation of 10G links across the Atlantic & Pacific since 2005
Bandwidth for LHC well above 100 Gbps in aggregate
Rapid Spread of “Dark Fiber” and DWDM: Emergence of Continental, Nat’l, State & Metro N X 10G “Hybrid” Networks in Many Nations
Appearance of terrestrial 40 and 100G MAN/WAN: 40G optical backbones in commercial and R&E networks are common
100G pilots/tests in 2009, first service deployments started
Point-to-point “Light-paths” for HEP and “Data Intensive Science”
Now Dynamic Circuits, and Managed Bandwidth Channels
Technology continues to drive Performance Higher, Costs Lower
Commoditization of GE now 10 GE ports on servers
Cheaper and faster storage ($ < 100/Tbyte); 100+ Mbyte/sec disks
National Knowledge Network Page 20
Dark Fiber Deployment & Testing
• NKN, NIC Team • Led by R S Mani
• IITB & ECIL Team • Led by Prof A Gumaste
• Railtel Team • Led by Mr. Bahuguna,CMD
: Evaluation & Testing on NKN
: Fiber lighting & Swiching
: Dark Fiber Provisioning
Dark Fiber was deployed for the first time in the
country using locally developed equipment
Experiment Coordinated by the PSA Office:
Organizations involved
National Knowledge Network Page 21
Test Setup Using ESR Router
• 5 ESRs (Routers developed by IIT Bombay & manufactured
by ECIL) operated at 10 G
• 2 Cisco ASR 9010
• 1 Cisco ASR 1002
• 1 Juniper MX 80
Devices Used :
National Knowledge Network Page 22
Network Connectivity
• Belapur ASR 9010 connected to Pune ASR 9010 through NKN
Cloud.
• Belapur ASR 1002 connected to Pune ASR 9010 through Railtel
dark fiber.
• 5 ESRs connected through Railtel dark fiber in the following
sequence.
NKN Belapur-Panvel-Lonavala-Pune Railway-NIC Pune
• Node A connected to Belapur ASR 9010.
• Node B connected to Belapur ASR 1002.
National Knowledge Network Page 23
Railtel dark fiber
Demo Institute at
Belapur
NKN
Cloud
LAN
ASR 1002
Belapur ESR
A
ASR 9K
Belapur
ESR
ASR 9K
Pune
B
14.139.4.62
14.139.109.244
FTP tested between A and B
Skype tested from B
Connectivity Diagram
ESR ESR
ESR
NIC Pune
Pune Railway
Lonavala Panvel NKN Belapur
National Knowledge Network Page 24
Applications Tested
• We have tested successfully following
applications through this darkfiber link
FTP.
Ping & Trace.
Internet.
Video Conferencing through Skype.
National Knowledge Network Page 25
Report Dated 27.09.2013
IP Address 14.139.4.62(Node A) connected to NKN cloud
IP Address 14.139.109.244 (Node B) connected to Pune ASR through Railtel dark fiber
Wan IP address Belapur Juniper MX80 end 10.119.252.45
Wan IP address Pune ASR9010 end 10.119.252.46
Test Reports with Juniper MX 80
1.Ping Report
2.Trace Report (Node B to Node A)
Sr. No. Time Source IP Address
Destination IP
Address
Minimum
Latency
Average
Latency Maximum Latency
Success
Rate
1 10:25 AM 10.119.252.45 10.119.252.46 3.53ms 11.53ms 29.19ms 100%