Page 1
"The OptIPuter: an IP Over Lambda Testbed"
Invited Talk
NREN Workshop VII: Optical Network Testbeds (ONT)
NASA Ames Research Center
Mountain View, CA
August 9, 2004
Dr. Larry Smarr
Director, California Institute for Telecommunications and Information Technologies
Harry E. Gruber Professor,
Dept. of Computer Science and Engineering
Jacobs School of Engineering, UCSD
Page 2
The OptIPuter Project – Removing Bandwidth as an Obstacle In Data Intensive Sciences
• NSF Large Information Technology Research Proposal– Cal-(IT)2 and UIC Lead Campuses—Larry Smarr PI– USC, SDSU, NW, Texas A&M, Univ. Amsterdam Partnering Campuses
• Industrial Partners– IBM, Sun, Telcordia, Chiaro Networks, Calient, Glimmerglass, Lucent
• $13.5 Million Over Five Years• Optical IP Streams From Lab Clusters to Large Data Objects NIH Biomedical Informatics NSF EarthScope
and ORION
http://ncmir.ucsd.edu/gallery.html
siovizcenter.ucsd.edu/library/gallery/shoot1/index.shtml
Research Network
Page 3
What is the OptIPuter?
• Applications Drivers Interactive Large Data Objects
• OptIPuter Nodes Scalable PC Cluster LambdaGrid “Browser”
• IP over Lambda Connectivity Predictable Backplane
• Open Source LambdaGrid Middleware Network is Reservable
• Data Retrieval and Mining Global Virtual Disk Drives
• High Defn. Visualization, Collaboration “Ultra-Reality TV”
See Nov 2003 Communications of the ACM for Articles on OptIPuter Technologies
www.optiputer.net
Page 4
UCSD Packet Test BedOptIPuter Year 2
4 1
OptIPuter UCSD / San Diego Network and Nodes -- 2004
2
ChiaroEnstara
SDSC JSOE
CSE
4 4
Bonded GigE 1
8-nodecluster
(shared)
IBM 9-node Viz cluster
SIO
SOM
IBM 48-node storage cluster
IBM 128-node CPU cluster
Sun 128-node computecluster
Sun 24-32-node
compute cluster
CRCA
6th College
3-node Viz cluster
1
IBM 9 mpixeldisplay pairs
Geowall 2Tiled Display
10
Sun 22-node
Viz cluster
10
Extreme 400Extreme 400
1
1To UCI and ISI via
CalREN-HPR
DellGeowall
Preuss
IBM 9 mpixeldisplay pairs
Dell Viz
Dell 5224
Dell 5224
Dell 5224
Dell 5224
Dell 5224
Dell 5224
Juniper T320 Cisco 6509
HP28-nodecluster
(shared)
HP4-nodecontrol
Sun 24-32-node
computecluster
Infiniband4 nodes
Infiniband64 nodes
Sun 5-node cluster
Sun24-32-node
cluster
9-nodecluster
(shared)
Extreme 400
7-node cluster(shared)
Page 5
UCSD Quartzite Core at Completion (Year 5 of OptIPuter)
QuartziteCore
CalREN-HPRResearch
Cloud
Campus ResearchCloud
GigE Switch withDual 10GigE Upliks
.....To cluster nodes
GigE Switch withDual 10GigE Upliks
.....To cluster nodes
GigE Switch withDual 10GigE Upliks
.....To cluster nodes
GigE
10GigE
...Toothernodes
Quartzite CommunicationsCore Year 3
ProductionOOO
Switch
Juniper T320
4 GigE4 pair fiber
Wavelength Selective
Switch
To 10GigE clusternode interfaces
..... To 10GigE clusternode interfaces and
other switches
Chiaro Enstara
32 10GigE
• Recommended for Funding
• Physical HW to Enable Optiputer and Other Campus Networking Research
• Hybrid Network Instrument
Currently Under Review
by NSF
Page 6
Edge and Core OptIPuter Nodes: Using Parallel Lambdas to Prototype a Bandwidth-Rich World
Int’l GE, 10GE
Nat’l GE, 10GE
I-WIRE OC-192
16x1 GE 16x10 GE?
16-dual Xeon Cluster
16x1GE
OMNInet 10GEs
128x128 Calient
64x64GG
Original Plan -- More Now in Place
UIC/EVLNortel, SBC Partnership
With UIC &NU
@ NU
Page 7
EVL
10GE OptIPuter CAVEWAVEon the National LambdaRail
Next Step: Coupling NASA Centers
to NSF OptIPuter Source: Tom DeFanti, OptIPuter co-PI
Page 8
OptIPuter Software Architecture from Grid to LambdaGrid
Layer 4: XCPNode Operating Systems
-configuration, Net Management
Grid and Web Middleware – (Globus/OGSA/WebServices/J2EE)
Physical Resources
DVC #1
OptIPuter Applications
DVC #2 DVC #3
Layer 5: SABUL, RBUDP, Fast, GTP
Real-Time Objects
Security Models
Data Services:DWTP
Higher Level Grid Services
VisualizationDVC/
Middleware
High-Speed Transport
Optical Signaling/Mgmt
Source: Andrew Chien, UCSDOptIPuter Software Systems Architect
DVC=Distributed Virtual Computer
Page 9
Ultra-Resolution OptIPuter Displays Utilizing Photonic Multicasting --Scaling to 100 Million Pixels
GlimmerglassSwitch Used to
Multicast and Direct TeraVision Stream
from One Tile to Another on the
Geowall-2
Glimmerglass Switch
Driven by
Linux Graphics Clusters
30 Megapixel High-Resolution Visualizations= ~1 Gigapixel at 30fps = ~30Gb/s Bandwidth
UIC-EVL
Source: Jason Leigh, OptIPuter co-PI
Page 10
The OptIPuter Will be Used to Enhance Collaboration
OptIPuter Will ConnectFalko Kuester’s Cal-(IT)2@UCI
Smart Classroom and The 50M-Pixel Display
At UCSD Ellisman’sBIRN Laboratories
Page 11
OptIPuter Organization Chart
Larry SmarrPrincipal Investigator
Maxine BrownProject Manager
Frontier Advisory Board (FAB)
Network and Hardware
Infrastructure
Tom DeFanti and Phil Papadopoulos
Co-PIs
Software Architecture
Andrew Chien
Data, Visualization and Collaboration
Jason LeighCo-PI
Applications and Outreach
Mark Ellisman, co-PI
John OrcuttDebi Kilb/Tom
Moher
Campus Testbeds
SoCal Testbed (network, clusters, storage)
Chicago/ Int’l. Testbed (network, visualization clusters and displays)
National Testbed
Optical Signaling Protocols
Middleware/DVC
Real-Time OS
Data Storage
Security
Application Performance Modeling
Transport Protocols
Data
Visualization/ Collaboration
Volume Visualization
High-Performance Visualization and Data Analysis
Photonic Multicast
LambdaRAM
Bioscience (NCMIR/BIRN)
Geoscience (EarthScope, Oceanographic)
Education & Outreach
Page 12
Cyberinfrastructure in Design Phase--
Fiber Optic CablesSatelliteWireless
Future OptIPuter Driver: Gigabit Fibers on the Ocean FloorORION-Ocean Research Interactive Ocean Network
www.neptune.washington.edu
Currently Under Review by NSF