The Chasm of Cyberinfrastructures
Harold Teunissen et al. #I2SUMMIT14, April 2014
A Dutch Perspective
Early adopters
2The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Serving Dutch Higher Education
3The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Cyberinfra Corp.
• All ICT activities for Higher Education and Research in the Netherlands are under one umbrella
4
Shared Professional Services
Scientific Computing& Data
Commercial ICT Products & Services
National Research & Education Network
eScience Collaboration and Tools
Core Elements
5The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Adapted from: Berman, 2001 & Lippincott, 2011
CYBERINFRASTRUCTURE
People & Training
Broadband Network Connectivity
Large Databases & Libraries
InstrumentationHigh Performance Computing
Collaboration
Big Hype
6The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
2005 130 EB
2010 1,227 EB
2015 7,910 EXABYTE
2020 1,000 ZETABYTE?
2000
Out or in control?
7The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Entropy
8The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
KNOWLEDGECHAOS
Too Big Data
Required Processing Power
Am
oun
t o
f D
ata
Max. AvailableProcessing Power
Long tail of science
9The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
# of researchers
Scal
e
Large Scale, Multi-
Disciplinary and Complex
Small Scale but getting complexer
ACCELERATION
Secret of their success
10The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Vision of Cyberinfra
11The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Glueing the components…
12The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
GLUE
…or just patchwork?
13The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Network BNetwork ANetwork C
Just within our reach
14The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
We started building
15The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
http://static4.depositphotos.com/1000992/514/i/950/depositphotos_5146031-Laboratory-glassware.jpg
Generic resource broker
16The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
• Interfacing to domain specific resource brokers • Aggregation of available resources provided by
specific brokers • Authorisation based on federated identity attributes • Advance reservation • Reporting and monitoring • Scheduling • Brokering • Accounting • Auditing
Ultimate functionality
17
Technical Challenges
18The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Organizational Differences
19The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Financial Hurdles
20The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
“How to eat an elephant?”
21The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
ENLIGHTEN YOUR RESEARCH
The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Enlighten your research
22
Radio Astronomy — Pulsar Research
Climate Modeling for Scientist and Decision Makers
CineGRID — 4K+ Video Distribution Testbed
Next Generation DNA Sequencing
Jungle ComputingCentralized Imaging for Large Scale Population Imaging
Contest
SURF Outreach & Support
23The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Erasmus MC
TU Delft
WUR
RUG
Life Science Grid ClusterLUMC
AMCVU MC
Complete Genomics, LA, CA. (BGI)
BGI, Hong Kong
EYR3 : NG DNA SQ
24The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Big Data Big Deal! - #tnc2013 - Maastricht, NL
Chasm
25The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Source: Geoffrey A. Moore c.s.
Techies Visionaries Pragmatics Conservatives Laggards
Chasm
WAITING TO HAPPEN
...solutionsand convenience
...technology and performance
time
# o
f cu
sto
mer
s
Big Data Big Deal! - #tnc2013 - Maastricht, NL
Bandwidth on demand
26The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Source: Geoffrey A. Moore c.s.
Techies Visionaries
Chasm
ALMOST HAPPENING
time
# o
f cu
sto
mer
s
… The Rest
7-9 YEARS
20142006 2009 2016
Rethinking the vision
27The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Physical Infrastructure Layer
Data Center (Storage & Compute) Network Constellation Science DMZ
S3
Virtualization of resources
28The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Infastructure Virtualization
Physical Infrastructure Layer
Data Center (Storage & Compute) Network Constellation Science DMZ
S3
Coordinated virtualization
29The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Infastructure Virtualization
Physical Infrastructure Layer
Coordinated Infrastructure Virtualization
Data Center Virtualization Network Vitualization Instrumentation Virtualization
Data Center (Storage & Compute) Network Constellation Science DMZ
S3
Link to the applications
30The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Physical Infrastructure Layer
Data Center (Storage & Compute) Network Constellation Science DMZ
S3
Cyberinfastructure as a Service
Infastructure VirtualizationCoordinated Infrastructure Virtualization
Data Center Virtualization Network Vitualization Instrumentation Virtualization
Orchestration of infrastructure
31The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Cyberinfastructure as a Service
Physical Infrastructure Layer
Virtual CyberinfrastructureComposition & Orchestration
Virtual Cyberinfrastructure Operation & Management
Data Center (Storage & Compute) Network Constellation Science DMZ
S3
Applications Applications Applications Business Logic
Infastructure VirtualizationCoordinated Infrastructure Virtualization
Data Center Virtualization Network Vitualization Instrumentation Virtualization
Inspired by: Brocade, “DS of the Future” & S. Peng et al., “DSaaS”, 2013
Cyberinfrastructure as a Service
32The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Cyberinfastructure as a Service
Physical Infrastructure Layer
Virtual CyberinfrastructureComposition & Orchestration
Virtual Cyberinfrastructure Operation & Management
Data Center (Storage & Compute) Network Constellation Science DMZ
S3
Applications Applications Applications Business Logic
Infastructure VirtualizationCoordinated Infrastructure Virtualization
Data Center Virtualization Network Vitualization Instrumentation Virtualization
CIaaS
Inspired by: Brocade, “DS of the Future” & S. Peng et al., “DSaaS”, 2013
Standards and implementations
33The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Cyberinfastructure as a Service
Physical Infrastructure Layer
Virtual CyberinfrastructureComposition & Orchestration
Virtual Cyberinfrastructure Operation & Management
Data Center (Storage & Compute) Network Constellation Science DMZ
S3
Applications Applications Applications Business Logic
Infastructure VirtualizationCoordinated Infrastructure Virtualization
Data Center Virtualization Network Vitualization Instrumentation Virtualization
CIaaS
OpenFlow
FortNOX
Fresco
NSI OSCARS
FlowScale
Beacon
FlowVisor
OpenStack
OCCI
Maestro
vSphere
Hypervisor
Ideal world
34The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Inspired by: S. Peng et al., 2013
Cyberinfastructure as a Service
Infastructure Virtualization
Physical Infrastructure Layer
CIaaS
Data Center Network Science DMZ
S3
Virtual Collaboration
Quite a challenge
35The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Cyberinfastructure as a Service
Infastructure Virtualization
Physical Infrastructure Layer
Data Center Network Science DMZ
S3
Domain I Domain II Domain III Domain IV Domain V
CIaaS
Virtual Collaboration
?
Federation of CIaaS
36The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Cyberinfrastructure as a Service
Infastructure Virtualization
Physical Infrastructure Layer
Virtual Data Center Composition & Orchestration
Virtual Data Center Operation & Management
Coordinated Infrastructure Virtualization
Data Center Virtualization Network Vitualization Instrumentation Virtualization
Data Center Network Science DMZ
S3
?
Big Data Big Deal! - #tnc2013 - Maastricht, NL
Outlook
37The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Innovation Trigger
Peak of Inflated
Expectation
Through of Disillusions Slope of Enlightment
Plateau of Productivity
Software Defined Networking
SDN
VIRTUALIZATION
SDx
time
Exp
ecta
tions
Source: Gartner July 2013
JULY 2013
5-10 YEARS
2-5 YEARS TO REACH PLATEAU
LESS THAN 2 YEARS
OpenFlow
OpenStack