NEEShub

NEEShub

Ellen M. RathjeUniversity of Texas at Austin

NEEScomm IT Development Team

Introduction (Ellen Rathje) Procedures for Data Archiving and Sharing Data Management and Curation Process

◦ Standa Pejsa (NEEScomm Data Curator) Tools for Data Management

◦ Project Warehouse/Project Editor (Gaby Ou)◦ Specimen Authoring Tool and inDEED (Kari Nasi)◦ Project Explorer for NEES (Rachelle Howell)

Tools for Collaboration (Santiago Pujol)◦ Group Space◦ SynchroNEES

Agenda

Post-webinar survey

Welcome to NEEShub!

We’ve got a HUB for that!

Your NEEShub Spaces

Personal Workspace(private)

NEEShub

Project Warehouse(private/ public)

Group Spaces

(restricted)

There are different levels of sharing and collaboration within NEEShub

The Project Warehouse

The Project WarehouseA centralized data repository for managing, sharing, storing, and publishing research data Search Search Results

Project DisplayinDEED Data Viewer

The Project WarehouseA centralized data repository for managing, sharing, storing, and publishing research data

DescriptionsDrawings

Mat’l Descriptions

Photos Publications

Data

Every project is created with the same structure

This provides consistency between projects and

aids in the navigation of project information

The Project Warehouse

Project Experiment Trial Repetition

A project represents an entire research project, which consists of a suite of tests and associated simulations

Each test is set up as an individual experiment

Within each experiment there are several trials or separate events for which data is measured

If the same trial is performed more than once, it may have multiple repetitions

The Data ModelThe model governing the organization of data within a project

Data OrganizationThe model governing the organization of data within a project

NEES-GC: Seismic Risk Mitigation for Port Systems

Centrifuge Test of PV Drains

Mar 2007

Crane Shake Table TestNov 2009

Pile-Wharf Connection Test

Sept 2007

Sine1

Cyclic Load Shake1 Shake2

Rep1

Rep1

Rep1

Rep1

Rep1

Project

ExperimentsSine

2Sine

3

Rep1Repetitions

Trials

Data OrganizationThe model governing the organization of data within a project

The Project WarehouseA centralized data repository for managing, sharing, storing, and publishing research data

For each repetition within a trial, there are four data folders that are automatically created1. Unprocessed data

Raw voltages, channel names, potentially non-standard formats (e.g., binary files)

2. Converted data Measurement units, instrument names

3. Corrected data Filtering, baseline corrections, removal of bad data

4. Derived data Corrected data plus values derived from measured

units (data not directly measured).

Types of Sensor DataRemember the data within the Project Warehouse is PUBLIC

ASCII tab delimited files recommended for all sensor

data

Experiment Documentation◦ Metadata fields within the Project Display◦ Experimental Setup Report placed in

Documentation folder Sensor Measurement Data

◦ Unprocessed◦ Converted◦ Corrected◦ Derived

Data RequirementsData cannot be shared without proper documentation

Uploaded by Researcher

within 6 months of

experiment

Uploaded by Researcher

within 6 months of

experiment

Uploaded by Site within 1-week of experiment

Requirements and definitions have the goal of making data EASILY re-useable

The Project Editor◦ Create, edit, and update projects◦ File uploads through web interface

The Project Explorer for NEES (PEN)◦ Efficient upload/download for bulk file management◦ Direct file upload (not a web interface)◦ Files organized offline and then uploaded

inDEED Data Viewer◦ Facilitates browsing/viewing/investigating data within

Warehouse without download

Project Warehouse ToolsThe nuts and bolts

Projects are created using the Project Editor

The Project Editor

Project Explorer for NEES (PEN)Enhancing bulk upload of files

inDEED Data ViewerFacilitating data queries

Enhanced ProjectsProjects with Data Visualization

Definition of Enhanced◦ Metadata fields in Project Display are complete

(including drawings, material properties)◦ Project includes at least one visualization of data◦ inDEED is currently the only visualization tools that

allows for viewing data within the NEEShub without download

Enhanced ProjectsProjects with Data Visualization

Group Spaces

Groups can be:◦ Public, restricted, or private

Purpose◦ To facilitate conversation, collaboration, and data

sharing between group members. Discussions, wiki posts, and files are in one central location available to all group members.

Features◦ Wiki, messaging, discussion boards, and file

sharing via the dropbox

Group SpaceAn easy way to share content and conversation

Group SpaceAn easy way to share content and conversation

SynchroNEES◦ A graphical user interface

for transferring files

Local PC to NEES group workspace

NEES Personal workspace to NEES group workspace

Group Space ToolsThe nuts and bolts

Tools

Locating Tools and ResourcesThe first time you use them

Tools & Resources > Tools

My NEEShub pageTools that you use most often will appear on your “My NEEShub” page

My NEEShub

The tools you use

most often

Your current sessions

Data Documentation Wiki (under construction)nees.org/topics/DataDocumentation

◦ For documents describing recommended procedures for data sharing and archiving

NEEScomm IT Director Dawn Weisman ([email protected])

Data Curator Standa Pejsa ([email protected])◦ Standa is a resource for assisting in sharing and

archiving your data

Additional Information

Questions