Fusion of Bandwidth on Demand and Virtual Organizations Harold Teunissen and Gerben van Malenstein — SURFnet I2JTW12 — January 2012
Nov 22, 2014
Fusion of Bandwidth on Demand and Virtual Organizations
Harold Teunissen and Gerben van Malenstein — SURFnetI2JTW12 — January 2012
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Changing Behaviors
2
HierarchicalSecrecy
Loose AllianceSluggishNovelty
Tunnel VisionInstitution
Single Discipline
Self OrganizingTransparencyCollaboration
UrgencyInnovationDidactic
IndividualMulti-Disciplinary
Source: Sir Ken Robison
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Motive
• Cloud cloud cloud — data explosion• Sharing sharing sharing — connectivity explosion• Go go go — study + work + play + collaborate +
organize + share + et cetera
• Collaboration is key to you and your team’s success!
3
Source: AMD
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
New core business
• Modern universities are developing towards loose conglomerates of (inter)discipline expertise
• Collaboration is therefore a core business• Scientific collaboration involves groups of people
in multiple institutions, disciplines and countries• Collaboration is about using shared services and
resources
Virtual Collaboration* = People + Groups + Resources + Services + Policies + Funding + ...
4
*a.k.a. Virtual Organization
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Distributed landscape
• Modern science combines resources from multiple sources across multiple (administrative) domains
‣ The core resources are within one virtual collaboration domain, but within multiple institutions, and
‣ the generic collaboration services can be foundin 'the cloud'
5
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Virtual Collaborations and Partnerships
6
• Virtual Research Team- Focussed on doing research- Small scale - Temporary and elastic- Little ICT awareness- Users
• “Virtual” Infrastructure Provider- Focussed on providing infrastructure for specific discipline- Well-organized with grands and budgets- Longer term- Better ICT awareness- Not virtual (ESFRI projects, CLARIN, Lifewatch, LOFAR,
NBIC)
Virtual Laboratory
Virtual Project
Virtual Colla-boration
Virtual Breeding Environment
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Researchers are knocking on our door
7
Radio Astronomy — Pulsar Research
Climate Modeling for Scientist and Decision Makers
CineGRID — 4K+ Video Distribution Testbed
Next Generation DNA Sequencing
Jungle Computing and Multi-Model Multi-Kernel Simulations
Centralized Imaging for Large Scale Population Imaging Studies
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 8
Collaboration Environments
Network C
Network BNetwork A
Open Lightpath Exchange
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
e-Research without limits
9
ƒ
Virtual Collaboration B
Virtual Collaboration A
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Multi-Disciplinary Collaboration
10
ƒ
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Circle of Pain...
11
Relationship
AuthorizationAccess Control
UsersVirtual Collaboration
Resources & Services
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Multi-Domain Service Delivery
12
Virtual Collaboration A
Domain II Domain III Domain IV Domain V Domain VI
Domain VIIDomain I
Key words: trust, mutual understanding and standardization!
S3
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
SURFconext
SURFconext allows you to create your own collaboration environment that organizes your applications, services and resources
• Provides the glue and lubrication middleware to make campus, cloud based services and resources usable for collaboration for both inter campus and virtual collaboration scenarios
• O!er the platform as a service for smaller & ad-hoc team collaboration
• O!er the platform software for large, virtual collaboration-type collaboration to run-you-own
13
• Federated Identity Management — SAML• Groups Management — Grouper• Social Network 'Portal' technology — OpenSocial• Collaboration Services and Resources
- Document Sharing- Video Collaboration- Learning Systems- Data Storage- Data Mining- Workspaces- Workflows- Et cetera
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 14
Key Elements
Virtual Collaboration
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Eco-system and supply chain
15
VirtualCollaboration
DNA Sequencer
Research Data StorageCollaboration Portal
ƒ
Bandwidth on demand
09 12 14
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Dynamic Network Service 1.0
16
Application
Network Management System
BoD GUI
NOC Engineer
Admin GUI Legacy API
Users
• User Management• Resource Management• Topology & Discovery• Path finding• Scheduling & Reservation• Network Element
Provisioning & Association
Network C
Network BNetwork A
Open Lightpath Exchange
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Resource Reservation 101
17
ƒ
238am-10pm
2510am-12pm
Bandwidth on Demand
2512.10pm-3pm
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Dynamic Network Service 2.0
18
NOC Engineer Users Applications
Network Management System
Bandwidth on Demand ServiceNSI
NSIBoD GUIAdmin GUI
CIENA NMS
NSI
NOC Engineer
Admin GUI
• Topology & Discovery• Path finding• Scheduling & Reservation• Network Element
Provisioning & Association
• Group Management• Resource Management
Inter Domain
• All Institutes are upgraded to a MultiService Port• Allows for On Demand Lightpath Services• Provide connectivity towards Cloud providers and
Netherlight• O!ers fixed lightpath Quality of Service
(bandwidth, latency, availability, et cetera)• Separation of lightpaths through VLAN tagging
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
New SURFnet7 and BoD
19
Lightpath
10 Gbps MultiService Port
2 Gbps 2 Gbps 4 Gbps 2 Gbps
Lightpath On Demand Lightpath Available
Institute X
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 20
BoD Admin Group
Physical Resource Group X
Physical Resource Group Y
BoD Physical Ports
Fusion between users and services
Bandwidth on Demand Service
Institute Y
Physical Resource Group Z
Institute Z
VirtualUser Group
Virtual Collaboration
Virtual Resource Group
Admin
Users
+ + =
Institute’s Admin
Ports are allocated to Institutes...
Institute’s Admin
Institute’s Admin
...and can be combined into a Virtual Resource
Group and then used by the collaboration
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 21
Architecture
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Simplified view
22
SAML2 Federation
SAML2 Identity ProviderADFS TBD
ConextEngine
JANUS
OpenSocialContainer
Web Portal
Service Registry
Policy Management
Attribute Management
Group Management
OpenSocialRest
XACML
TBDGadget
Grouper
OpenSocial RestOAuth
SAML2 SP SAML2 Metadata
Bandwidth on Demand Service
* Developed by SURFnet
Network Management System
CIENA NMS
NSI
NGE / Network
NGE
XACML
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Share services with your team
23
Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA
Getting started
24