Introduction to DANSE Brent Fultz Prof. Materials Science and Applied Physics California Institute of Technology • Distributed Data Analysis Architecture for Neutron Scattering Experiments • Technical Issues, Scientific Organization • From a Concept to a National Project
24
Embed
Introduction to DANSE Brent Fultz Prof. Materials Science and Applied Physics California Institute of Technology Distributed Data Analysis Architecture.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Introduction to DANSE Brent Fultz
Prof. Materials Science and Applied PhysicsCalifornia Institute of Technology
• Distributed Data Analysis Architecture for Neutron Scattering Experiments• Technical Issues, Scientific Organization• From a Concept to a National Project
QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.
$ 1,411,000,000 hardware10,000,000 software
QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.
ARCS
Analysis Software for Neutron Scattering • Enables science
• Helps new users get up to speed
• Better science with better software optimize beamtime usage experimental procedures tuned on-the-fly sample knowledge can constrain data interpretations
• Some experiments are impossible with today’s software
• New opportunities to connect to materials theory
Logo for ARCS SpectrometerHeadstock
Neck
Frets
Pickups
Volume/ToneSolidBody
Tailpiece(Whammy Optional)
Logo for DANSE??
Software with Power and Beauty
$?
Software with Coherence
DANSE architecture is GeneralbutAll developers must know itHence this Workshop
Data Analysis as a Web Service• Data analysis is a service controlled by the user • User’s laptop issues commands and receives results • Computation is arranged by the web server
Present Example from inelastic scattering: Born - von Kármán Lattice Dynamics
Simplicity: Complexity:
1. Undergrowth of indices for tensor quantities:
2. Crystal structure:
€
mκ ˙ ̇ u κl = − Vκ ,l
∑ κl,κ ' l 'uκ ' l '
€
uκl
€
V κl ,κ ' l '
lattice, l, basis, allowed elements depend on symmetry
The Bigger Concept Underneath
Components Pre-compiled Python objects called and re-arranged
by the Python Interpreter
Data Streams Standard communication protocol between
components (standard streams can connect components located anywhere)
DANSE Project: Develop Tools for Programmers
Component Templates Standard Data Streams
Levels of User Expertise• For using existing scripts, entry barrier nearly zero.• For altering existing Python scripts, entry barrier is very
low. • For writing new Python code, entry barrier is modest.
Performance may be comparable to IDL or Matlab. • Transition to high performance compiled code
ARCS: Writing Python bindings for C++DANSE: Component templates for C++, FORTRAN,
Java? Focus of this Workshop
• Importance of remote control of neutron instruments• Remote collaboratory capability• Remote data analysis capability
• No strong support for remote control -- too risky
(sample temperature and saving data okay)• Strong support for remote data analysis capability• Overwhelming support for standardization of data analysis
(across different instruments and different facilities)
NSSA Neutron Software Poll
Making a Software Project Plan
• Define and justify scientific needs
• Define and justify the software architecture
• Define the scope of the project
• Accurately estimate the effort
Proposal -- what, why, who, where, when, how?
A DANSE Project Would Have 2 Parts
• Build Tools (hardware and software) for Developers