Team: Thomas Bartoschek, Gerald Pape, Jim Jones, Christian Kray, Tomi Kauppinen Gestural Interaction with Spatiotemporal Linked Open Data FOSS4G. Nottingham, England. [email protected]
Jun 26, 2015
Team: Thomas Bartoschek, Gerald Pape,
Jim Jones, Christian Kray, Tomi Kauppinen
Gestural Interaction with Spatiotemporal Linked Open Data
FOSS4G. Nottingham, England.
Name: Jim Jones
The Author
Thomas Bartoschek
Gestural Interaction with Spatiotemporal Linked Open Data
2
“Dear Jim,
You lucky son of * *****! You’re going to substitute me in Nottingham at FOSS4G.
Best,Thomas ”
Name: Jim Jones
Agenda
•Motivation•Quick Introduction to Linked Open Data
•Application•Dataset Creation•Gesture-based Approach•Approach Evaluation
•Conclusion•Future Work
Gestural Interaction with Spatiotemporal Linked Open Data
3
Name: Jim Jones
Gestural Interaction with Spatiotemporal Linked Open Data
4
Name: Jim Jones
Gestural Interaction with Spatiotemporal Linked Open Data
5
Name: Jim Jones
Deforestation decreasing...
2004: 27.423 km²2012: 4.571 km²(Awesome!)
Gestural Interaction with SpatiotemporalLinked Open Data
6
Known Issues
Data produced queued for analysis (Huge amounts)
Hard to visualize
Hard to correlate the produced data with external variables.
Name: Jim Jones
Motivation
Gestural Interaction with Spatiotemporal Linked Open Data
7
•How to efficiently correlate the deforestation phenomena with external variables?
•How to effectively communicate it to the population?
Name: Jim Jones
Triangle of Sustainability● Wissenschaft Interaktiv
2012 (Interactive Science)
● Awarded with €10k for developing the project
● 4 weeks for development!
Gestural Interaction with Spatiotemporal Linked Open Data
8
Linked Open Data!
Name: Jim Jones
What is Linked Data?(In 2 minutes)
Gestural Interaction with Spatiotemporal Linked Open Data
9
Name: Jim Jones
The Web
Gestural Interaction with Spatiotemporal Linked Open Data
10
• Awesome Discoverability!
• But just for humans :(
Name: Jim Jones
Semantics
Gestural Interaction with Spatiotemporal Linked Open Data
11
?The forbidden fruit
Xxx xxxx x xxxx xxx xxxxXxx xxxxxxx xx x x xxxxxxxx.
Cheers,-God
● What is the article about?● Who is the author?● What is inside the picture?● Where, when and by whom was the picture taken?● ...
Name: Jim Jones
Linked Open Data
Gestural Interaction with Spatiotemporal Linked Open Data
12
“linked open data describes a method of publishing structured data so that it can be interlinked and become more useful.”
Raw Data now!
Name: Jim Jones
Gestural Interaction with Spatiotemporal Linked Open Data
13
ID 1(Uniquely Identified)
ID 5
ID 3
ID 4ID 2
ID 6
Name: Jim Jones
Some benefits of Linked Open Data
Gestural Interaction with Spatiotemporal Linked Open Data
14
• Attaches meaning to data• Allows efficient thematic searches (e.g. person, company, city,
book, etc.)
• Links different kinds of datasets making the WORLD a single big repository!
• Private data and public data can be mixed, enabling companies and individuals to make better decisions and generate innovations.
My Repository
Name: Jim Jones
Creating Dataset...
Gestural Interaction with Spatiotemporal Linked Open Data
15
Deforestation
• Soybeans Crops• Cattle• GDP• Population• Brazilian Municipalities' Area
• Download data from IBGE Servers• Create Triples
Name: Jim Jones
Dataset
Vocabularies• Time and Space Core Vocabulary (TISC)• Open Linked Amazon Vocabulary (OLA)
Gestural Interaction with Spatiotemporal Linked Open Data
16
Spatiotemporal Dataset
● Aggregated in grid cells of 25km x 25km
● Time-series 2004 - 2009
Name: Jim Jones
Motivation (Recap...)
Gestural Interaction with Spatiotemporal Linked Open Data
17
•How to efficiently correlate the deforestation phenomena with external variables?
•How to effectively communicate it to the population?
Gestural Interaction with Virtual Globes!
Name: Jim Jones
Gestural Interaction with Spatiotemporal Linked Open Data
18
Name: Jim Jones
Gestural Interaction with Spatiotemporal Linked Open Data
19
Name: Jim Jones
Gestures
Gestural Interaction with Spatiotemporal Linked Open Data
20
pan zoom in / out time travel
Name: Jim Jones
Video ( +1 minute)
http://www.youtube.com/watch?v=Jjzj84R1Tgc
Gestural Interaction with Spatiotemporal Linked Open Data
21
Name: Jim Jones
Evaluating the Approach
Gestural Interaction with Spatiotemporal Linked Open Data
22
Name: Jim Jones
Evaluation Procedure and Material
•5- 8 Minutes usage
•Questionnaire with 28 questions in two groups:
•1 group: demographic information •e.g. gender, age, primary hand, familiarity with gesture control
interfaces
•2 group: Task Load (NASA TLX – Task Load Index). Rating how well gestures and map actions fit together, from 0 to 20.
•e.g. In which scale you define the mental or physical workload for the gestures?
•No reward!
Gestural Interaction with Spatiotemporal Linked Open Data
23
Name: Jim Jones
Test Group
•Participants: 43•28 male•15 female
•Youngest : 10•Oldest: 59
•Left handed: 7•Right handed: 36
•Familiarity with gesture-based interfaces:
•Familiar: 19•Unfamiliar: 24
Gestural Interaction with Spatiotemporal Linked Open Data
24
Name: Jim Jones
ResultsGestural Interaction with Spatiotemporal Linked
Open Data25
Name: Jim Jones
Observations
•Most participants reported the gestures as mentally challenging in the first minutes
•Older people found the system very accessible, particularly when compared with their first time using a mouse.
•User recognition gets considerably affected when bystanders are ‘seen’ by the Kinect sensor.
Gestural Interaction with Spatiotemporal Linked Open Data
26
Name: Jim Jones
Software
Gestural Interaction with Spatiotemporal Linked Open Data
27
Virtual Globe (UI)
LOD Processing
Gestures (Kinect)
https://github.com/giatschool/triangle-of-sustainability
Name: Jim Jones
Hardware
Gestural Interaction with Spatiotemporal Linked Open Data
28
Name: Jim Jones
Triangle on Tour!
• SBPC Science Fair•Recife (August, 2013)
•KIT-Alumini Club Seminar•Recife (September,2013)
• GeoCamp•Campos do Jordao (November, 2013)
• Ecogerma•Belém (November, 2013)
Gestural Interaction with Spatiotemporal Linked Open Data
29
Name: Jim Jones
Conclusion•The triangle provides an attractive and easy to use solution for
displaying spatiotemporal LOD.
•It has a high acceptance in class-rooms (Already presented in many German schools)
•Participants were able to learn how to use 3 gestures without excessive workload.
•Linked Data offers a good bases for efficiently connecting deforestation data with external variables.
Gestural Interaction with Spatiotemporal Linked Open Data
30
Name: Jim Jones
Future Work
•Improve registration gestures•Inefficient when more than one person is in front of the sensor
•Try different Kinect frameworks.
•Enable registration by children (short people)•Minimum arm length problem.
Gestural Interaction with Spatiotemporal Linked Open Data
31
Name: Jim Jones
Gestural Interaction with Spatiotemporal Linked Open Data
32
Name: Jim Jones
Gestural Interaction with Spatiotemporal Linked Open Data
33
Muito obrigado.Danke Schön.
Kiitos.Dziękuję bardzo.
Thank you!