Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute Research.

Institut für Beispielsysteme | Forschungsgruppe Systembeispiele

Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview

Overview of Research Projects and DirectionsDr. Darren Carlson

Senior Research Fellow

Felicitous Computing Institute, Dept. of Computer Science

National University of Singaporehttp://fci.comp.nus.edu.sg and http://dynamix.ioThis presentation includes graphics from the Crystal Project, which is released under the LGPL license.



The Ambient Computing Initiative

2

Ambient Computing GroupDeveloping next-generation

frameworks and algorithms for the emerging Internet of Things

and Web of Things.

Technologies

Collaborators



Internet of Things Challenges (1/2)

Local Link Communications

RestrictedCloud

Web-proxiedDevices

ProprietaryCloud

Dual-modeDevices

WearableSensors

INTERNET

WLAN, PAN

Networked MediaDevices

EnvironmentalSensing, Control

Non-interoperable Prop. I/O Prop. I/O Prop. I/O, No External Access

Restricted/Limited External Access



Internet of Things Challenges (2/2)

4

Social Proximityand Networks

Mobile Context Sensing and Control

UserActivity

UnproxiedSensor Networks

BiotelemetryData

IndoorPositioning

Others…

Ad-hocInteractions

ExternalSensors

SensorFusion

Web Apps Still Can’t see the Internet of Things

IoT



Ambient Dynamix 1/2

5

Dynamix is a plug-and-play software framework that transforms a commodity mobile device into an adaptive smart-gateway to the Internet of Things.

Example Smart Space

SpheroControllable/Controller

DroneControllable/Controller

Phillips HueControllable

Apple TVControllable



Ambient Dynamix 2/2

6

Context domain expertise is packaged

into plug-ins

Plug-ins are dynamically provisioned at runtime

A Dynamix app requests context support



Open Collaboration

7

Context-domain experts use the Open Plug-in SDK to create

Dynamix plug-insPlug-ins can be published using public or private repositories

App developers use the Open App SDK to create Dynamix apps

Apps can be deployed from any Android

market or elsewhere

End-user installs the Dynamix

Framework once

Users can then run Dynamix apps and

Websites

1 2 3

App

Open Plug-in SDK

Open AppSDK



Example Dynamix Plug-insContext Plug-in

Location, NFC, iBeacon, Orientation, and Photo-detector Plug-ins

ArtNet Plug-in (ad-hoc discovery/control of DMX lighting equipment)

Acoustic Fingerprint Plug-in (Native Code Integration)

Speech Recognition Plug-in, Barcode Scanner Plug-in (ZXing port)

Sound Pressure Level Plug-in (Ambient Sound Detector)

Sleep State Plug-in (Zeo Mobile), Withings Weight and BMI Plug-in

Heart-rate Biotelemetry Plug-in (Zephyr Sensors)

OpenSocial Profile Data with Sensor-network Monitoring Plug-in (SmartAssist)

WeMo Switches and Sensors, Phillips Hue, LIFX

Ambient Media Plug-in (UPnP & AirPlay)

Sphero Robot Ball Plug-in and Parrot AR Drone Plug-in

Pedometer with Step Force Plug-in

8Many more plug-ins in development!



Research Direction: Context-aware Web Agents

DLNAProjector

UPnPPhoto Frame

Plug-inRepository

FacebookServers

Router

Internet

Local link

App Server

Nexus 7Standard Web Browser

Dynamix Framework

Browser

Only Demo!

Media CenterLaptop

ArtNet LightSystem



Research Direction: Context-aware Web Agents

10

Dynamix FrameworkBackground Service

UPnP Media Renderer

FacebookServers

App Server

Plug-inRepository

Web Content andImage Content

Web Content and Dynamix JavaScript

Dynamix Plug-ins:UPnP and ArtNet

Tapping Dims the Lights & Displays Media on the

Selected Media Renderer

ArtNet Light System



www.example.com Search

Research Direction: Legacy Website Context-awareness

11

Enhance Site!

Origin Server

Video Title

Original Page Content

Enhancement Request

Enhanced Content Injection

Request Site Content

Return Site Content

“Legacy” Website (No Dynamix Capabilities)

Injected Page Content

Dynamix Capabilities!

Amp Bookmarklet



12

Research Direction: Ambient Control

Media Server



ArtNet Light Controllable




13


SpheroPlug-in

ARDronePlug-in

AmbientControl Plug-in



DynamixDevice

BluetoothChannel

WIFIChannel

ArtNetPlug-in

EthernetChannel

ArtNet LightControllableRuntime Plug-in

Installation

Ambient MediaPlug-in Apple TV

Controllable

WIFIChannel




14



ArtNet LightControllable


Media Control



15




Research Direction: Ambient Fuse

16

Secure Pairing of a Desktop Browser and a Dynamix-based Device(The laptop uses the paired smartphone as a game controller on-the-fly)



Research Direction: Ambient Flow

17

Router

Internet

Local link

Ambient Flow

Server

Dynamix Plug-in

Repository

DynamixDevice

Connected DevicesFlow DesignerLaptop

ConnectionContext ScanGraph Deploy




18User Study Flowgraph

Sphero DynamixDevice

Hue Lamps




19

Dynamic Nodes• Late-binding• Context-based selection• Context-based config• Adaptive

Context-aware Flow-graph-based Program



20

Dynamix User Community“Context War-drivers”

PublishRefineRank

Research Direction: Ambient Ocean

Discover

Contextualize

Ambient Resource Index

Context Information



Research Direction: Ambient Ocean

21

CurrentContext

Request

Result rankingsPersonalization data

Query expansion data

Dynamix User Community

Discover

Context Information

Relevant Resources

Response



22

Thank You!Q&A



Selected Publications

23

Carlson, D. and Pagel, M. Tap to Interact: Towards Dynamically Remixing the Internet of Things. Proceedings of the Eleventh Annual International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MobiQuitous 2014), London, Great Britain, December 2-5, 2014. (Best Demo Paper Award)

Carlson, D. and Schrader, A. Ambient Ocean: A Web Search Engine for Context-aware Smart Resource Discovery. Proceedings of the 2014 IEEE International Conference on Internet of Things, Taipei, Taiwan, September 1-3, 2014.

Carlson, D. and Ruge, L. Ambient Amp: An Open Framework For Dynamically Augmenting Legacy Websites with Context-awareness. Proceedings of the Ninth IEEE International Conference on Intelligent Sensors, Sensor Networks and Information Processing, Singapore, April 21-24, 2014.

Carlson, D., Altakrouri, B. and Schrader, A. An Ad-hoc Smart Gateway Platform for the Web of Things. Proceedings of the 2013 IEEE International Conference on Internet of Things, Beijing, China, August 20-23, 2013. (Best Paper Award)

Carlson, D., Altakrouri, B. and Schrader, A. Reinventing the Share Button for Physical Spaces. Proceedings of the IEEE International Conference on Pervasive Computing and Communication (PerCom 2013), San Diego, California, USA, March 18-22, 2013. (Best Demo Award)

Carlson, D., Altakrouri, B. and Schrader, A. AmbientWeb: Bridging the Web's Cyber-physical Gap. Proceedings of the 3rd International Conference on the Internet of Things (IoT2012), Wuxi, China, October 24-26, 2012. (IoT Challenge Winner)

Carlson, D. and Schrader, A. Dynamix: A Plug-and-Play Context Framework for Android. Proceedings of the 3rd International Conference on the Internet of Things (IoT2012), Wuxi, China, October 24-26, 2012.

Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute Research.

Documents

dynamix appsapps

dynamix pluginsplug

dynamix framework onceusers

web of things

overview of research

emerging internet of

io prop

open app sdk