Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute Research.
Post on 01-Jan-2016
214 Views
Preview:
Transcript
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Overview of Research Projects and DirectionsDr. Darren Carlson
Senior Research Fellow
Felicitous Computing Institute, Dept. of Computer Science
National University of Singaporehttp://fci.comp.nus.edu.sg and http://dynamix.ioThis presentation includes graphics from the Crystal Project, which is released under the LGPL license.
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
The Ambient Computing Initiative
2
Ambient Computing GroupDeveloping next-generation
frameworks and algorithms for the emerging Internet of Things
and Web of Things.
Technologies
Collaborators
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Internet of Things Challenges (1/2)
Local Link Communications
RestrictedCloud
Web-proxiedDevices
ProprietaryCloud
Dual-modeDevices
WearableSensors
INTERNET
WLAN, PAN
Networked MediaDevices
EnvironmentalSensing, Control
Non-interoperable Prop. I/O Prop. I/O Prop. I/O, No External Access
Restricted/Limited External Access
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Internet of Things Challenges (2/2)
4
Social Proximityand Networks
Mobile Context Sensing and Control
UserActivity
UnproxiedSensor Networks
BiotelemetryData
IndoorPositioning
Others…
Ad-hocInteractions
ExternalSensors
SensorFusion
Web Apps Still Can’t see the Internet of Things
IoT
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Ambient Dynamix 1/2
5
Dynamix is a plug-and-play software framework that transforms a commodity mobile device into an adaptive smart-gateway to the Internet of Things.
Example Smart Space
SpheroControllable/Controller
DroneControllable/Controller
Phillips HueControllable
Apple TVControllable
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Ambient Dynamix 2/2
6
Context domain expertise is packaged
into plug-ins
Plug-ins are dynamically provisioned at runtime
A Dynamix app requests context support
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Open Collaboration
7
Context-domain experts use the Open Plug-in SDK to create
Dynamix plug-insPlug-ins can be published using public or private repositories
App developers use the Open App SDK to create Dynamix apps
Apps can be deployed from any Android
market or elsewhere
End-user installs the Dynamix
Framework once
Users can then run Dynamix apps and
Websites
1 2 3
App
Open Plug-in SDK
Open AppSDK
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Example Dynamix Plug-insContext Plug-in
Location, NFC, iBeacon, Orientation, and Photo-detector Plug-ins
ArtNet Plug-in (ad-hoc discovery/control of DMX lighting equipment)
Acoustic Fingerprint Plug-in (Native Code Integration)
Speech Recognition Plug-in, Barcode Scanner Plug-in (ZXing port)
Sound Pressure Level Plug-in (Ambient Sound Detector)
Sleep State Plug-in (Zeo Mobile), Withings Weight and BMI Plug-in
Heart-rate Biotelemetry Plug-in (Zephyr Sensors)
OpenSocial Profile Data with Sensor-network Monitoring Plug-in (SmartAssist)
WeMo Switches and Sensors, Phillips Hue, LIFX
Ambient Media Plug-in (UPnP & AirPlay)
Sphero Robot Ball Plug-in and Parrot AR Drone Plug-in
Pedometer with Step Force Plug-in
8Many more plug-ins in development!
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Research Direction: Context-aware Web Agents
DLNAProjector
UPnPPhoto Frame
Plug-inRepository
FacebookServers
Router
Internet
Local link
App Server
Nexus 7Standard Web Browser
Dynamix Framework
Browser
Only Demo!
Media CenterLaptop
ArtNet LightSystem
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Research Direction: Context-aware Web Agents
10
Dynamix FrameworkBackground Service
UPnP Media Renderer
FacebookServers
App Server
Plug-inRepository
Web Content andImage Content
Web Content and Dynamix JavaScript
Dynamix Plug-ins:UPnP and ArtNet
Tapping Dims the Lights & Displays Media on the
Selected Media Renderer
ArtNet Light System
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
www.example.com Search
Research Direction: Legacy Website Context-awareness
11
Enhance Site!
Origin Server
Video Title
Original Page Content
Enhancement Request
Enhanced Content Injection
Request Site Content
Return Site Content
“Legacy” Website (No Dynamix Capabilities)
Injected Page Content
Dynamix Capabilities!
Amp Bookmarklet
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
12
Research Direction: Ambient Control
Media Server
SpheroControllable/Controller
DroneControllable/Controller
ArtNet Light Controllable
Apple TVControllable
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
13
Research Direction: Ambient Control
SpheroPlug-in
ARDronePlug-in
AmbientControl Plug-in
SpheroControllable/Controller
DroneControllable/Controller
DynamixDevice
BluetoothChannel
WIFIChannel
ArtNetPlug-in
EthernetChannel
ArtNet LightControllableRuntime Plug-in
Installation
Ambient MediaPlug-in Apple TV
Controllable
WIFIChannel
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Research Direction: Ambient Control
14
SpheroControllable/Controller
DroneControllable/Controller
ArtNet LightControllable
Apple TVControllable
Media Control
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
15
Research Direction: Ambient Control
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Research Direction: Ambient Fuse
16
Secure Pairing of a Desktop Browser and a Dynamix-based Device(The laptop uses the paired smartphone as a game controller on-the-fly)
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Research Direction: Ambient Flow
17
Router
Internet
Local link
Ambient Flow
Server
Dynamix Plug-in
Repository
DynamixDevice
Connected DevicesFlow DesignerLaptop
ConnectionContext ScanGraph Deploy
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Research Direction: Ambient Flow
18User Study Flowgraph
Sphero DynamixDevice
Hue Lamps
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Research Direction: Ambient Flow
19
Dynamic Nodes• Late-binding• Context-based selection• Context-based config• Adaptive
Context-aware Flow-graph-based Program
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
20
Dynamix User Community“Context War-drivers”
PublishRefineRank
Research Direction: Ambient Ocean
Discover
Contextualize
Ambient Resource Index
Context Information
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Research Direction: Ambient Ocean
21
CurrentContext
Request
Result rankingsPersonalization data
Query expansion data
Dynamix User Community
Discover
Context Information
Relevant Resources
Response
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
22
Thank You!Q&A
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing InstituteResearch Overview
Selected Publications
23
Carlson, D. and Pagel, M. Tap to Interact: Towards Dynamically Remixing the Internet of Things. Proceedings of the Eleventh Annual International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MobiQuitous 2014), London, Great Britain, December 2-5, 2014. (Best Demo Paper Award)
Carlson, D. and Schrader, A. Ambient Ocean: A Web Search Engine for Context-aware Smart Resource Discovery. Proceedings of the 2014 IEEE International Conference on Internet of Things, Taipei, Taiwan, September 1-3, 2014.
Carlson, D. and Ruge, L. Ambient Amp: An Open Framework For Dynamically Augmenting Legacy Websites with Context-awareness. Proceedings of the Ninth IEEE International Conference on Intelligent Sensors, Sensor Networks and Information Processing, Singapore, April 21-24, 2014.
Carlson, D., Altakrouri, B. and Schrader, A. An Ad-hoc Smart Gateway Platform for the Web of Things. Proceedings of the 2013 IEEE International Conference on Internet of Things, Beijing, China, August 20-23, 2013. (Best Paper Award)
Carlson, D., Altakrouri, B. and Schrader, A. Reinventing the Share Button for Physical Spaces. Proceedings of the IEEE International Conference on Pervasive Computing and Communication (PerCom 2013), San Diego, California, USA, March 18-22, 2013. (Best Demo Award)
Carlson, D., Altakrouri, B. and Schrader, A. AmbientWeb: Bridging the Web's Cyber-physical Gap. Proceedings of the 3rd International Conference on the Internet of Things (IoT2012), Wuxi, China, October 24-26, 2012. (IoT Challenge Winner)
Carlson, D. and Schrader, A. Dynamix: A Plug-and-Play Context Framework for Android. Proceedings of the 3rd International Conference on the Internet of Things (IoT2012), Wuxi, China, October 24-26, 2012.
top related