NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments Thrust Area Leader Professor, Molecular Biology The Scripps Research Institute La Jolla, CA
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Brains to Bays --Scaleable Visualization Toolkits
Arthur J. Olson
Interaction Environments Thrust Area Leader
Professor, Molecular Biology
The Scripps Research Institute
La Jolla, CA
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Evolution of Alpha Project
• IE Thrust Area Vision
• User Community feedback
• State of art challenges
• Successful projects/prototypes
• Successful and important applications
• Strong inter-thrust linkages
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
IE Thrust Area Vision
Provide a customizable Provide a customizable collaborative scientific collaborative scientific computing environment computing environment to explore data, facilitate to explore data, facilitate simulation, and simulation, and communicate ideas in communicate ideas in groung-breaking researchgroung-breaking research
Provide a customizable Provide a customizable collaborative scientific collaborative scientific computing environment computing environment to explore data, facilitate to explore data, facilitate simulation, and simulation, and communicate ideas in communicate ideas in groung-breaking researchgroung-breaking research
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
User Community Feedback
#1 Priority --Visualization Toolkits
• Aid in the exploration of scientific data and simulations
• Communicate results to the broader community
• Scaleable from desktop to teraflop systems
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Important Infrastructure Challenge
Large Data Visualization
• Parallel Visualization-- computing resources
• Interactive Navigation -- client/server control
• Compression/processing -- out-of-core manipulation
• Combining data at multiple scales
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Successful projects/prototypesIE Thrust
•MPIRE -massively parallel volume rendering -- SDSC
• VisualEyes -- multi-modal visualization and analysis toolkit -- U. Texas
• Déjà vu -- platform independent viewing component -- TSRI
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Successful and important applications
• Brain mapping -- Understanding the nature of the human brain -- Toga, Ellisman, et al.
• Ocean modeling -- Simulating and predicting the long range nature of global climate change -- Wunsch, et al.
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Strong Cross Thrust Linkages
• Data Intensive -- SRB, MCAT, XML
• Metasystems -- Legion
• Parallel Tools -- ADR, KELP
• EOT -- Materials transfer for teaching
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Successful projects/prototypesIE Thrust
•MPIRE -massively parallel volume rendering -- SDSC
• VisualEyes -- multi-modal visualization and analysis toolkit -- U. Texas
• Déjà vu -- platform independent viewing component -- TSRI
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
MPIRE: Massively Parallel Interactive Volume Rendering (Genetti,Johnson SDSC)
•Interactive, Distributed
•Direct Volume Rendering -- ray casting & splatting
Technology
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
MPIRE - Parallel Performance9 Gbyte data set on T3E
Processing Elements
160
192
224
256
Average Time(s)
14.8
12.4
10.6
9.2
Millions of voxels/s
225
258
302
350
Visible Female Data Set
Technology
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Successful projects/prototypesIE Thrust
•MPIRE -massively parallel volume rendering -- SDSC
• VisualEyes -- multi-modal visualization and analysis toolkit -- U. Texas
• Déjà vu -- platform independent viewing component -- TSRI
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
VisualEyes Interrogative Visualization(Bajaj, Utexas)
Technology
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Accelerated IsoContouring(VolVis’96)
Technology
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
The Contour Spectrum(IEEE Viz’97)
• The contour spectrum allows the development of an adaptive ability to separate interesting isovalues from the others.
r
Technology
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Successful projects/prototypesIE Thrust
•MPIRE -massively parallel volume rendering -- SDSC
• VisualEyes -- multi-modal visualization and analysis toolkit -- U. Texas
• Déjà vu -- platform independent viewing component -- TSRI
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Deja Vu / Python Provides Client Viewing and Manipulation (Olson,Sanner)
• Object orientedObject oriented• Component basedComponent based• Execution centric Execution centric • Inter-operableInter-operable• Platform IndependentPlatform Independent
• Object orientedObject oriented• Component basedComponent based• Execution centric Execution centric • Inter-operableInter-operable• Platform IndependentPlatform Independent
Deja vu
Technology
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Rapid Application Development withViewer component technology
• Concise Code• Interactive
development• GUI support• integration of
existing applications
Technology
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Successful and important applications
• Brain mapping -- Understanding the nature of the human brain -- Toga, Ellisman, et al.
• Ocean modeling -- Simulating and predicting the long range nature of global climate change -- Wunsch, et al.
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Brain Structure and Function (Toga,UCLA)
THE CHALLENGE OF MULTIPLE SCALES
THE CHALLENGE OF FUNCTIONAL CORRELATIONS
Testbed application
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Each Brain Represents a
lot of Data
AND COMPARISONS MUST BE MADE BETWEEN MANY
Testbed application
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Federate existing DBs
Today:
1 brain 10 Gbytes
Testbed application
With Teraflops:
comparisons of multiple brains,
several Pbytes
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Successful and important applications
• Brain mapping -- Understanding the nature of the human brain -- Toga, Ellisman, et al.
• Ocean modeling -- Simulating and predicting the long range nature of global climate change -- Wunsch, et al.
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Oceanographic Simulations on a Planetary Scale (Wunsch, MIT;Stammer, SIO)
• Goal: Understanding the ocean’s role in climate variability
• Will provide a complete global-scale ocean state estimation over 15 year period (1985-2000)
• CFD simulations constrained by satellite altimetry and other observational data
• Porting to MPP platforms (IBM SP, Teraflops)• Challenging time-dependent visualization
Testbed application
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Oceanographic Simulations -- Large Data Visualization
Today:
2o Latitude, Longitude2 GBytes
With Teraflops:0.5o Latitude, Longitude200 GBytes
Testbed application
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Milestones for Alpha Project: Brains to Bays -- FY00
• Harden and extend MPIRE , VisualEyes ,Deja Vu • Extend Interaction architecture for volume data• Develop APIs and GUIs for SRB , implement “data
floor plan” in KELP and ADR• Integrate viz toolkits within Legion metasystem.• Initiate visualization production in collaboration with
EOT for educational use• Generate and test large-scale multi-modal
volumetric data sets w/viz-toolkits
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
Milestones for Alpha Project: Brains to Bays -- FY01
• Distribute and test MPIRE, VisualEyes, and Deja Vu to several sites
• Implement advanced toolkit architecture that supports volumetric scene graph constructs
• Demonstrate remote parallel volume rendering over multi-site NPACI resources
• Develop training and technical documentation on the viz toolkits for wide distribution
• Produce scientific visualizations in collaboration with EOT for integration into school curricula
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE
EDUCATION/ OUTREACH/ TRAININGEDUCATION/ OUTREACH/ TRAINING
Advancing Visualization & Exploration
SRB/API’sSRB/API’s
KELPKELP
ADRADR
SHASTRA/ICESHASTRA/ICE
DOCUMENTATIONDOCUMENTATION
DICE
IE PTE Neuroscience
Metasystems Earth System Science
SINGLE MODE BRAIN DATA
SINGLE TIME SLICE OCEAN SIMULATION
MULTI-SCALE NEURO-
STRUCTURE
MULTI-MODAL OCEAN SIMULATIONS
INTERACTIVE STEERING OF OCEAN SIMULATIONS
DATA AND MODEL VISUALIZATION
DATA AND MODEL VISUALIZATION PARALLEL VOLUME
VISUALIZATION
PARALLEL VOLUMEVISUALIZATION LARGE DATA
NAVIGATION
LARGE DATANAVIGATION COLLABORATIVE
INTERACTION
COLLABORATIVEINTERACTION
200120001999 2002
LEGIONLEGIONMPIREMPIRE
Deja VuDeja Vu
VisualEyesVisualEyes
FEDERATED BRAIN DATA