Top Banner
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments Thrust Area Leader Professor, Molecular Biology The Scripps Research Institute La Jolla, CA
28

N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

Dec 27, 2015

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Brains to Bays --Scaleable Visualization Toolkits

Arthur J. Olson

Interaction Environments Thrust Area Leader

Professor, Molecular Biology

The Scripps Research Institute

La Jolla, CA

Page 2: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Evolution of Alpha Project

• IE Thrust Area Vision

• User Community feedback

• State of art challenges

• Successful projects/prototypes

• Successful and important applications

• Strong inter-thrust linkages

Page 3: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

IE Thrust Area Vision

Provide a customizable Provide a customizable collaborative scientific collaborative scientific computing environment computing environment to explore data, facilitate to explore data, facilitate simulation, and simulation, and communicate ideas in communicate ideas in groung-breaking researchgroung-breaking research

Provide a customizable Provide a customizable collaborative scientific collaborative scientific computing environment computing environment to explore data, facilitate to explore data, facilitate simulation, and simulation, and communicate ideas in communicate ideas in groung-breaking researchgroung-breaking research

Page 4: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

User Community Feedback

#1 Priority --Visualization Toolkits

• Aid in the exploration of scientific data and simulations

• Communicate results to the broader community

• Scaleable from desktop to teraflop systems

Page 5: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Important Infrastructure Challenge

Large Data Visualization

• Parallel Visualization-- computing resources

• Interactive Navigation -- client/server control

• Compression/processing -- out-of-core manipulation

• Combining data at multiple scales

Page 6: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Successful projects/prototypesIE Thrust

•MPIRE -massively parallel volume rendering -- SDSC

• VisualEyes -- multi-modal visualization and analysis toolkit -- U. Texas

• Déjà vu -- platform independent viewing component -- TSRI

Page 7: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Successful and important applications

• Brain mapping -- Understanding the nature of the human brain -- Toga, Ellisman, et al.

• Ocean modeling -- Simulating and predicting the long range nature of global climate change -- Wunsch, et al.

Page 8: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Strong Cross Thrust Linkages

• Data Intensive -- SRB, MCAT, XML

• Metasystems -- Legion

• Parallel Tools -- ADR, KELP

• EOT -- Materials transfer for teaching

Page 9: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Successful projects/prototypesIE Thrust

•MPIRE -massively parallel volume rendering -- SDSC

• VisualEyes -- multi-modal visualization and analysis toolkit -- U. Texas

• Déjà vu -- platform independent viewing component -- TSRI

Page 10: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

MPIRE: Massively Parallel Interactive Volume Rendering (Genetti,Johnson SDSC)

•Interactive, Distributed

•Direct Volume Rendering -- ray casting & splatting

Technology

Page 11: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

MPIRE - Parallel Performance9 Gbyte data set on T3E

Processing Elements

160

192

224

256

Average Time(s)

14.8

12.4

10.6

9.2

Millions of voxels/s

225

258

302

350

Visible Female Data Set

Technology

Page 12: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Successful projects/prototypesIE Thrust

•MPIRE -massively parallel volume rendering -- SDSC

• VisualEyes -- multi-modal visualization and analysis toolkit -- U. Texas

• Déjà vu -- platform independent viewing component -- TSRI

Page 13: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

VisualEyes Interrogative Visualization(Bajaj, Utexas)

Technology

Page 14: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Accelerated IsoContouring(VolVis’96)

Technology

Page 15: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

The Contour Spectrum(IEEE Viz’97)

• The contour spectrum allows the development of an adaptive ability to separate interesting isovalues from the others.

r

Technology

Page 16: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Successful projects/prototypesIE Thrust

•MPIRE -massively parallel volume rendering -- SDSC

• VisualEyes -- multi-modal visualization and analysis toolkit -- U. Texas

• Déjà vu -- platform independent viewing component -- TSRI

Page 17: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Deja Vu / Python Provides Client Viewing and Manipulation (Olson,Sanner)

• Object orientedObject oriented• Component basedComponent based• Execution centric Execution centric • Inter-operableInter-operable• Platform IndependentPlatform Independent

• Object orientedObject oriented• Component basedComponent based• Execution centric Execution centric • Inter-operableInter-operable• Platform IndependentPlatform Independent

Deja vu

Technology

Page 18: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Rapid Application Development withViewer component technology

• Concise Code• Interactive

development• GUI support• integration of

existing applications

Technology

Page 19: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Successful and important applications

• Brain mapping -- Understanding the nature of the human brain -- Toga, Ellisman, et al.

• Ocean modeling -- Simulating and predicting the long range nature of global climate change -- Wunsch, et al.

Page 20: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Brain Structure and Function (Toga,UCLA)

THE CHALLENGE OF MULTIPLE SCALES

THE CHALLENGE OF FUNCTIONAL CORRELATIONS

Testbed application

Page 21: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Each Brain Represents a

lot of Data

AND COMPARISONS MUST BE MADE BETWEEN MANY

Testbed application

Page 22: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Federate existing DBs

Today:

1 brain 10 Gbytes

Testbed application

With Teraflops:

comparisons of multiple brains,

several Pbytes

Page 23: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Successful and important applications

• Brain mapping -- Understanding the nature of the human brain -- Toga, Ellisman, et al.

• Ocean modeling -- Simulating and predicting the long range nature of global climate change -- Wunsch, et al.

Page 24: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Oceanographic Simulations on a Planetary Scale (Wunsch, MIT;Stammer, SIO)

• Goal: Understanding the ocean’s role in climate variability

• Will provide a complete global-scale ocean state estimation over 15 year period (1985-2000)

• CFD simulations constrained by satellite altimetry and other observational data

• Porting to MPP platforms (IBM SP, Teraflops)• Challenging time-dependent visualization

Testbed application

Page 25: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Oceanographic Simulations -- Large Data Visualization

Today:

2o Latitude, Longitude2 GBytes

With Teraflops:0.5o Latitude, Longitude200 GBytes

Testbed application

Page 26: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Milestones for Alpha Project: Brains to Bays -- FY00

• Harden and extend MPIRE , VisualEyes ,Deja Vu • Extend Interaction architecture for volume data• Develop APIs and GUIs for SRB , implement “data

floor plan” in KELP and ADR• Integrate viz toolkits within Legion metasystem.• Initiate visualization production in collaboration with

EOT for educational use• Generate and test large-scale multi-modal

volumetric data sets w/viz-toolkits

Page 27: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

Milestones for Alpha Project: Brains to Bays -- FY01

• Distribute and test MPIRE, VisualEyes, and Deja Vu to several sites

• Implement advanced toolkit architecture that supports volumetric scene graph constructs

• Demonstrate remote parallel volume rendering over multi-site NPACI resources

• Develop training and technical documentation on the viz toolkits for wide distribution

• Produce scientific visualizations in collaboration with EOT for integration into school curricula

Page 28: N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE Brains to Bays --Scaleable Visualization Toolkits Arthur J. Olson Interaction Environments.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE

EDUCATION/ OUTREACH/ TRAININGEDUCATION/ OUTREACH/ TRAINING

Advancing Visualization & Exploration

SRB/API’sSRB/API’s

KELPKELP

ADRADR

SHASTRA/ICESHASTRA/ICE

DOCUMENTATIONDOCUMENTATION

DICE

IE PTE Neuroscience

Metasystems Earth System Science

SINGLE MODE BRAIN DATA

SINGLE TIME SLICE OCEAN SIMULATION

MULTI-SCALE NEURO-

STRUCTURE

MULTI-MODAL OCEAN SIMULATIONS

INTERACTIVE STEERING OF OCEAN SIMULATIONS

DATA AND MODEL VISUALIZATION

DATA AND MODEL VISUALIZATION PARALLEL VOLUME

VISUALIZATION

PARALLEL VOLUMEVISUALIZATION LARGE DATA

NAVIGATION

LARGE DATANAVIGATION COLLABORATIVE

INTERACTION

COLLABORATIVEINTERACTION

200120001999 2002

LEGIONLEGIONMPIREMPIRE

Deja VuDeja Vu

VisualEyesVisualEyes

FEDERATED BRAIN DATA