Introduction to the NEEShub

Introduction to the NEEShub

Ellen M. Rathje University of Texas at Austin

NEEScomm IT Development Team

Welcome to NEEShub!

We’ve got a HUB for that!

NEEShub

Project Warehouse: data repository Tools and resources:

◦ Databases◦ Simulation Tools ◦ Reports

Simulation: info on simulation Collaborate: group space, wish list

My NEEShub pageDashboard for your NEEShub activities

Your Projects in

the Warehous

e

Your current tools

sessions

Your contributions to the NEEShub

Your Groups

My NEEShub pageDashboard for your NEEShub activities

Your Wishes

Your Tickets

Your Messages

The tools you use

most often

Your NEEShub Spaces

Home Directory(private)

NEEShub

Project Warehouse(private/ public)

Group Spaces

(restricted)

There are different levels of sharing and collaboration within NEEShub

The Project Warehouse

The Project WarehouseA centralized data repository for managing, sharing, storing, and publishing research data

The Project WarehouseA centralized data repository for managing, sharing, storing, and publishing research data

DescriptionsDrawings

Mat’l Descriptions

Photos Publications

Data

Every project is created with the same structure

This provides consistency between projects and

aids in the navigation of project information

The Project Warehouse

Project Experiment Trial Repetition

A project represents an entire research project, which consists of a suite of tests and associated simulations

Each test is set up as an individual experiment

Within each experiment there are several trials or separate events for which data is measured

If the same trial is performed more than once, it may have multiple repetitions

The Data ModelThe model governing the organization of data within a project

Data OrganizationThe model governing the organization of data within a project

NEES-GC: Seismic Risk Mitigation for Port Systems

Centrifuge Test of PV Drains

Mar 2007

Crane Shake Table TestNov 2009

Pile-Wharf Connection Test

Sept 2007

Sine1

Cyclic Load Shake1 Shake2

Rep1

Rep1

Rep1

Rep1

Rep1

Project

ExperimentsSine

2Sine

3

Rep1Repetitions

Trials

Data OrganizationThe model governing the organization of data within a project

The Project WarehouseA centralized data repository for managing, sharing, storing, and publishing research data

For each repetition within a trial, there are four data folders that are automatically created1. Unprocessed data (data collected by Equipment Site)

Raw voltages, channel names, potentially non-standard formats (e.g., binary files)

2. Converted data Measurement units, instrument names

3. Corrected data Filtering, baseline corrections, removal of bad data

4. Derived data Corrected data plus values derived from measured data

Types of Sensor DataRemember the data within the Project Warehouse is PUBLIC

ASCII files recommended for all sensor dataPut all channels into a single ASCII file

Experiment Documentation◦ Metadata fields within the Project Display◦ Experimental Setup Report placed in

Documentation folder Sensor Measurement Data

◦ Unprocessed◦ Converted◦ Corrected◦ Derived

Data RequirementsData cannot be shared without proper documentation

Uploaded by Researcher

within 6 months of

experiment

Uploaded by Researcher

within 6 months of

experiment

Uploaded by Site within 1-month of experiment

Minimum data requirements: unprocessed data and sensor data in engineering units!

The Project Editor◦ Edit project and upload files through web interface

The Project Explorer for NEES (PEN)◦ Efficient upload/download for bulk file management◦ Files organized offline and then uploaded

inDEED Data Viewer◦ Facilitates browsing/viewing/investigating data within

Warehouse without download◦ Use inDEED data file format

https://nees.org/tools/indeed/wiki/CSVFileFormat

Project Warehouse ToolsThe nuts and bolts

Today we will have hands-on exercises to demonstrate these tools

Projects are created using the Project Editor

The Project Editor

Project Explorer for NEES (PEN2.1)Enhancing bulk upload of files

inDEED Data ViewerFacilitating data queries

inDEED Specimen Authoring Tool

Enhanced ProjectsProjects with Data Visualization

Definition of Enhanced◦ Metadata fields in Project Display are complete

(including drawings, material properties)◦ Project includes at least one visualization of data◦ inDEED is currently the only visualization tool that

allows for viewing data within the NEEShub without download

Enhanced ProjectsProjects with Data Visualization

Project Warehouse User GuideOne-stop shop for documentation related to project warehouse

Curation is requested by researcher at the experiment level◦ Should initiate within 6-months of an

experiment Digital Object Identifier (DOI)

◦ Assigned at experiment level after curation

Data Papers in EERI EQ Spectra◦ New manuscript type focused on

describing datasets

CurationAn important process to ensure long-term re-use of data

Collections of NEES and non-NEES data with a common theme

Data contained in figures in articles published by ACI Structural and Materials Journals and the Journal of Earthquake Engineering

Databases

Currently databases must be generated manually with earthquake engineers working together with NEEScomm IT team

Currently developing an auto-contribute feature (DataStore)

What databases are you interested in seeing?

Do you have a database you would like to contribute?

Databases

Group Spaces

Groups can be:◦ Public, restricted, or private

Purpose◦ To facilitate conversation, collaboration, and data

sharing between group members ◦ Discussions, wiki posts, and files are in one

central location available to all group members◦ Generate a webpage for your project

Features◦ Wiki, messaging, discussion boards, and file

sharing via the dropbox

Group SpaceAn easy way to share content and conversation

Creating/Finding Groups

A group is automatically created for all projects created in the Project Warehouse◦ Group name has Project in title

Membership is controlled by project team members listed in the Project Editor

Project Groups

Group Space/OverviewAn easy way to share content and conversation

About section can be expanded into a web page for your project

Group Space/WikiAn easy way to share content and conversation

Group Space/DiscussionAn easy way to share content and conversation

Group Space/Data SharingAn easy way to share content and conversation

SynchroNEES◦ A graphical user interface

for transferring files Local PC to/from NEES

Group workspace Local PC to/from NEES

Personal workspace

Group Space ToolsThe nuts and bolts

NEEShub: Simulation Section

NEEShub: Simulation Tools

NEEShub: Simulation Wiki

NEEShub: Computational Models

Access to HPC Resources

Access to: Kraken, Ranger, OpenScienceGrid, Steele and Hansen

(Purdue)

Contribute tools and resources to share with the community

Submit tickets to get problems/issues resolved

Submit wishes about things you would like to see on the NEEShub

NEEShub: a community

NEEShub: a community

Cyberinfrastructure Release Committee (CRC)◦ Chair: Ellen Rathje ([email protected])◦ Members: JoAnn Browning, Juan Caicedo, Shirley

Dyke, Rudi Eigenmann, Tom Hacker, Ayhan Irfanoglu, Santiago Pujol

NEEScomm IT Director ◦Dawn Weisman ([email protected])

Data Curator ◦Standa Pejsa ([email protected])

Contact Information

Questions