This work performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344 A Self-Organizing Repository for Fusion Science 6 th Extremely Large Databases Conference, Stanford University September 10 - 13, 2012 Tim Frazier, Allan Casey, Matt Hutton, Prav Patel National Ignition Facility, Control and Information Systems LLNL-PRES-579672
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
This work performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344
A Self-Organizing Repository for Fusion Science
6th Extremely Large Databases Conference, Stanford University
September 10 - 13, 2012
Tim Frazier, Allan Casey, Matt Hutton, Prav Patel
National Ignition Facility, Control and Information Systems
LLNL-PRES-579672
High Energy Density
Science
Two simultaneous soccer matches can be played on top of the NIF!
NIF Data
Shot Data
Configuration
Calibration
Campaign
Control
Experimental
Results
Analysis
Results
IT Data
Code
Servers
Administration
Business Data
CAD/CAM
NPS
SMART
Shared File Services
User Data
Home Directories
Desktop
Shared File Services
The NIF Data taxonomy provides a map of the data
we generate and manage
The diversity of data, format and a 30-year
retention requirement present challenges &
opportunities
8 Frazier—XLDB 2012—Stanford, September 2012
Full Aperture
Backscatter
Diagnostic
Instrument
Manipulator
(DIM)
Diagnostic
Instrument
Manipulator (DIM)
X-ray imager
Streaked
x-ray detector
VISAR
Velocity
Measurements
Static x-ray
imager
FFLEX
Hard x-ray
spectrometer
Near Backscatter
Imager
DANTE
Soft x-ray
temperature
Diagnostic
Alignment
System
Cross Timing
System
Up to 50 high precision instruments are used to
observe each NIF experiment
Talk or Conference Name, Date 10 NIF-0000-12345.ppt
A Data Taxon is an annotation that specifies location,
instrument & type of data
A data taxon enables a specific data object to be retrieved without knowledge
of the database’s physical organization
Subsystem Location Unit Identifier Instance Data ID
TD
TD
TC143-274
TC143-274
DANTE
DANTE
SCOPE-01-DB
SCOPE-01-DB
SHOT
SHOT
RAW_DANTE_SCOPE
SCOPECORR
Where What Experiment Result /
Analysis Result
11 Frazier—XLDB 2012—Stanford, September 2012
The tools & methods we use for data presentation &
dissemination have evolved over the last five years
Frazier—XLDB 2012—Stanford, September 2012 12
Our ability to develop and deploy server-based analysis codes is no match for
the scientists’ appetite for new & varied ways of using data
File systems
Web pages that query databases
Viewer with tagging, suit casing & dashboarding
Wiki integration
The majority of tools used by the scientific
community remain file-based
Frazier - ICALEPCS Conference France, October 10-14, 2011 13
File systems provide one, and only one, organizing principle for data; despite
this deficiency, we can escape neither their utility nor their ubiquity
File systems
Web pages that query databases
Viewer with tagging, suit casing & dashboarding
Wiki integration
Simple web pages were easy to write and provided
the ability to quickly & visually survey data sets
Frazier - ICALEPCS Conference France, October 10-14, 2011 14
One of the most important requirements was the ability to download data sets,
as files, for offline analysis
File systems
Web pages that query databases
Viewer with tagging, suit casing & dashboarding
Wiki integration
Web page structure is identical to the data model of
the underlying database
Frazier - ICALEPCS Conference France, October 10-14, 2011 15 NIF-0911-22970s2.ppt