Top Banner
PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich
24

PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Jan 04, 2016

Download

Documents

Dinah Carson
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

PermaSense Data Management

Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH

Zurich

Page 2: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

What we have today:

PermaSense Starting Points

Page 3: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Low-power Wireless Sensors

• Static, low-rate sensing (2 min)

• Temperatures, crack meters, resistivity

• 3 years operation• < 0.1 Mbyte/node/day

Page 4: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Base Station for Data Collection

Page 5: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

High Resolution Imaging – Mountainview Camera

• Dual network (TinyNode, WLAN)

• 12 Megapixel D-SLR imager • Calibrated optics• Remotely configurable• ~ 1 Gbyte/camera/day

Page 6: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Long-haul Communication

• 7.5 km from weather radar on Klein Matterhorn

• Leased fiber/DSL from Zermatt Bergbahnen AG

• Collaboration with APUNCH/CCES

Page 7: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Data Backend Integration and Tools

• Based on GSN (EPFL research project)• Collaboration with SwissEx/EPFL• Slowly gaining in-house knowledge• Limited visualization capabilities• Many different other components necessary for 24/7 operation and debugging

Page 8: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

The Big Picture – Network System Integration

Page 9: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Data Management Tools and Dataflow

Page 10: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Data Management – Online Semantic Data

• Global Sensor Network (GSN)– Data streaming framework from EPFL– Organized in “virtual sensors”, i.e. data types/semantics– Hierarchies and concatenation of virtual sensors enable on-line

processing– Translates data from machine representation to SI values– Adds metadata

Private

PublicMetadata==============PositionSensor type…

Import from field GSN GSN Web export

Page 11: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Multi-site, Multi-station Data Integration

Page 12: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

TinyOS Multiplexing Data Flow

Page 13: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Example: Sensor Network and Backlog/CoreStation

Page 14: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Example: Private GSN Data Intake

Page 15: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Example: Public GSN Data Mapping and Conversion

Page 16: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Sensor Type Mapping

Page 17: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Sensor Node DAQ Routines

Page 18: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Simple - One Sensor Type - One Usage - One Packet

Page 19: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Harder - Two Packets, Multiple Sensor Types

Page 20: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Complex - Multiple Configs, Reuse of MUX resource

Page 21: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Position/Type Mapping: XYZ_nodepositions.xls

Page 22: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.
Page 23: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Open Problems

Page 24: PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Open Problems - Random Order

• Merging of multi-packet data (ADCMUX1/2)• Multi-sink deployments

– Upstream/downstream data (protocol and control issue)• Multi-core station integration (proposal)• Visualization• Integration of further processing steps• Documentation• …