Page 1
Beat Signer - Department of Computer Science - [email protected]
1 December 20, 2013
2 December 2005
Web Information Systems Future Trends and Summary
Prof. Beat Signer
Department of Computer Science
Vrije Universiteit Brussel
http://www.beatsigner.com
Page 2
Beat Signer - Department of Computer Science - [email protected]
2 December 20, 2013
The Future of the Web
From a Web of documents (e.g. HTML pages)
to a Web of structured data and services semantic web and linked data
cloud computing
enabling technologies
- URI, XML, XHTML, RDF and OWL
The Internet as one global machine interoperability of services
automatic reasoning
The Mobile Web access information and services offered by the global machine
from everywhere at any time, feed the machine with new data and teach the machine new relationships between data
Page 3
Beat Signer - Department of Computer Science - [email protected]
3 December 20, 2013
The Future of the Web ...
Internet of Things integration of physical objects with the global machine
physical world gets reflected in digital space via sensor input data
- RFID, GPS, temperature, ...
information and services managed by the global machine get projected into the physical space via augmented reality
Personal data that is nowadays stored in folders on
personal computers might move to the global machine
User interfaces for the global machine personalised filtering and recommendation of related information
based on user profiling and AI technologies
cross-media browsers
Page 4
Beat Signer - Department of Computer Science - [email protected]
4 December 20, 2013
The Future of the Web ...
How will documents look like in the future? graph of linked data
documents as structural view of the linked data
will we still distinguish between data (document) and metadata?
How are the presented ideas related to approaches
introduced earlier in the course? e.g. Bush's Memex or Nelson's Xanadu
Do we need new publishing models for the creation of
linked data to be managed by the global machine?
Finally, it is not only about connecting our data, services
and machines but we are the machine
Page 5
Beat Signer - Department of Computer Science - [email protected]
5 December 20, 2013
Structured Data
Web of data instead of Web of documents Semantic Web
linked data as part of the Semantic Web
- based on URI, HTTP and RDF
various applications already make use of structured data on the Web
- search engines start to process microformats (e.g. hproduct) or RDFa markup
[http://upload.wikimedia.org/wikipedia/commons/2/23/Lod-datasets_2010-09-22_colored.png]
Page 6
Beat Signer - Department of Computer Science - [email protected]
6 December 20, 2013
Cloud Computing
The cloud hides technological details from the user accessed over the Internet (e.g. via web browser)
customer no longer owns the physical infrastructure
different models including utility computing or subscription-based services
Microsoft
Google
Yahoo
Amazon
Cloud
Page 7
Beat Signer - Department of Computer Science - [email protected]
7 December 20, 2013
Cloud Computing ...
Cloud computing providers offer different types of
services Infrastructure as a Service (IaaS)
- rent virtual servers with unique IP and storage space on demand
Platform as a Service (PaaS)
- access operating systems and associated services from the cloud
- platform to create applications
• e.g. Google App Engine
Software as a Service (SaaS)
- end user applications
• e.g. web-based email, Flickr or Delicious
Page 8
Beat Signer - Department of Computer Science - [email protected]
8 December 20, 2013
Social Computing
New forms of computations performed by groups of
people based on networks of trust etc. "The Wisdom of Crowds", James Surowiecki
e.g. Amazon Mechanical Turk (MTurk)
Instead of having a small group of collaborating users, in
the future these social computations may be performed
on the global machine
Applications with social computations include social tagging
collaborative filtering
Page 9
Beat Signer - Department of Computer Science - [email protected]
9 December 20, 2013
Personalisation
To deal with the sheer amount of data, we will have to
apply semantic filtering and recommedation on the web
of data
The filtering and recommendation can be based on personal profiling
- monitoring a user's interaction with the global machine
social profiling
- investigate a user's social network
item classication - find similar items based on intrinsic properties as well as collaborative
annotations
Page 10
Beat Signer - Department of Computer Science - [email protected]
10 December 20, 2013
PIM Meets the Machine
Integration of personal
information management
(PIM) tools with the cloud
how much privacy will there
be in the future?
will the cloud be able to
forget information or will we
end up with an "archive of
our life" (total recall)?
MyLifeBits, Microsoft Research
Page 11
Beat Signer - Department of Computer Science - [email protected]
11 December 20, 2013
Internet of Things
In the future we will see more and more network- or
Internet-enabled physical objects
Physical objects get linked to digital information and
services offered by the cloud
How many objects will there be? estimates of 100'000 billion and more objects
Is simple object tagging via RFID tags enough? what if only a part of an object should be linked to the cloud?
we need a flexible addressing mechanism for physical resources
Is the simple mapping to a web presence (URI) enough?
Page 12
Beat Signer - Department of Computer Science - [email protected]
12 December 20, 2013
New Forms of User Interfaces
Is the concept of a
document still the right
metaphor for accessing
linked data?
What about interfaces
with semantic zooming
functionality to seamlessly
dive into more details?
Will the increasing impact of social computing also be
manifested in future interfaces for the global machine e.g. filtering and ranking of information in Newsmap
Microsoft's Photosynth interface for digital images
Page 13
Beat Signer - Department of Computer Science - [email protected]
13 December 20, 2013
New Forms of User Interfaces ...
In the future we will no longer just access information
from the machine via a web browser but augment and
use the physical environment as natural user interface e.g. augmented reality interfaces as presented in one of the
previous lectures
The use of linked data could help to overcome some the
limitations of existing document-centric desktop
interfaces files as ultimate level of granularity
no links (associations) between files or parts of files
missing content annotation functionality
Page 14
Beat Signer - Department of Computer Science - [email protected]
14 December 20, 2013
New Forms of User Interfaces ...
augmented contact lens
augmented car windshield
augmented phone display
Wik
itude W
orld b
row
ser
B.A
. P
arv
iz,
Univ
ers
ity o
f W
ashin
gto
n
augm
ente
d r
ealit
y w
indshie
ld,
GM
Page 15
Beat Signer - Department of Computer Science - [email protected]
15 December 20, 2013
Social Implications
What are the effects of the remediation of print on digital
natives? in longterm studies it has been shown that the frequent use of the
Web has a negative impact on a person's deep reading skills
a recent study by King's College London (KCL) has shown the negative effects of information overload
- "Information Overload Harms Concentration More than Marijuana"
What is the trade-off between personalisation and
privacy? will we still be able to control all the captured data or will we be
continously monitored and profiled by smart objects?
Transparency and trust will become even more important
issues!
Page 16
Beat Signer - Department of Computer Science - [email protected]
16 December 20, 2013
The Future of the Internet
internet of things
web of data
self-organising
cloud computing
security and privacy
mobile web
social computing
one global machine
Page 17
Beat Signer - Department of Computer Science - [email protected]
17 December 20, 2013
01001000100 0101001100010010100010010 0100100010010001000100001001000 100010001100001001000110010101010110 1100010010100010010010010100010101011001 101001100001100 101010100 00101000100 110101010101 00100 01010101000 1001 1111111111 111 0000000010 0 11111111 0101001011 010101010 111010101 001010010110
Fluid Cross-Media Information Spaces
Page 18
Beat Signer - Department of Computer Science - [email protected]
18 December 20, 2013
Prof. Dr. Beat Signer Interactive Paper, Cross-Media
Information Architectures
Dr. Bruno Dumas Multimodal Interaction, Cross-
Media Information Architectures
Lode Hoste Multimodal Interaction, Midas
and Mudra Framework
Brecht De Rooms Implicit Context-aware Human-
Computer Interaction, HCII
CISA
Human-Machine &
Human-Information
Interaction
Information
Systems &
Management
Information
Visualisation
& Navigation
WEB & INFORMATION SYSTEMS ENGINEERING
CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA)
Page 19
Beat Signer - Department of Computer Science - [email protected]
19 December 20, 2013
Sandra Trullemans Personal Cross-Media
Information Management
Reinout Roels MindXpres Next Generation
Presentation Tool
Ahmed A.O. Tayeh Open Cross-Media Authoring,
Fluid Document Formats
WEB & INFORMATION SYSTEMS ENGINEERING
CISA
Human-Machine &
Human-Information
Interaction
Information
Systems &
Management
Information
Visualisation
& Navigation
CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA)
Page 20
Beat Signer - Department of Computer Science - [email protected]
20 December 20, 2013
Digital Documents as a Paper Simulator?
Vannevar Bush
Ted Nelson
Most people don't understand the logic of the concept: "What You See Is What You Get" is based on printing the document out ("get" means "get WHEN YOU PRINT IT OUT"). And that means a metaphysical shift: a document can only consist of what can be printed! [...] No overlays [...] – PAPER UNDER GLASS.
When data of any sort are placed in storage, they are filed alphabetically or numerically, and information is found (when it is) by tracing it down from subclass to subclass. It can be in only one place, unless duplicates are used [...] The human mind does not work that way. It operates by association.
As We May Think, Atlantic Monthly, July 1945
Geeks Bearing Gifts: How the Computer World Got This Way, Mindful Press 2009
Page 21
Beat Signer - Department of Computer Science - [email protected]
21 December 20, 2013
What is Wrong with Digital Documents?
Existing document formats are based on the simulation
of paper affordances on desktop computers
How to manage mixed-media "documents" in open and
fluid cross-media information spaces? on the data level
- context-sensitive adapatation
- cross-media transclusion
on the visualisation and navigation level
- zoomable user interfaces
on the cross-media interaction level
- fluid multimodal cross-media interfaces
Remediation of the "paper simulation" approach WYSIWYG is only one out of many options!
Page 22
Beat Signer - Department of Computer Science - [email protected]
22 December 20, 2013
Bridging the Paper-Digital Divide
Page 23
Beat Signer - Department of Computer Science - [email protected]
23 December 20, 2013
What is Wrong with Slideware?
Simulation of physical slides limited space due to the slide concept
linear navigation from slide to slide
difficult to reuse content and embed rich media types
MindXpres addresses these issues unlimited canvas with zoomable user interface
non-linear navigation and associative linking
content-based approach with automatic visualisation
Page 24
Beat Signer - Department of Computer Science - [email protected]
24 December 20, 2013
MindXpres Presentation Tool
HTML5-based extensible
core with three types of
JavaScript plug-ins
components
- source code, graph, video, ...
containers
- slide, image gallery, ...
structures
- grid, graph, clustered, ...
Presentation as RSL-
based overlay structure
enables navigation across
multiple presentations
Reinout Roels
Page 25
25
Multimodal User Interfaces
EPOC, emotiv Echo Smartpen, Livescribe
Kin
ect,
Mic
roso
ft
Page 26
Beat Signer - Department of Computer Science - [email protected]
26 December 20, 2013
Midas/Mudra Framework declarative definition of multimodal
and multi-touch interactions
rule-based language approach
rapid protoyping and application development
iGesture Workbench create and test gesture sets and algorithms
different modalities: digital pen, Wii remote, …
open source (www.igesture.org)
SpeeG multimodal speech- and body gesture-based
text input
real-time correction of recognised voice input
Multimodal and Multi-Touch Interaction
Page 27
Beat Signer - Department of Computer Science - [email protected]
27 December 20, 2013
SpeeG2
User
Speech recognition
(Microsoft SAPI 5.4)
Skeletal tracking
(Microsoft Kinect)
5
4
2
3
SpeeG2 GUI
6
1
Sven De Kock
Page 28
Beat Signer - Department of Computer Science - [email protected]
28 December 20, 2013
Video: SpeeG2 Performance (21 WPM)
Sven De Kock
Page 29
Beat Signer - Department of Computer Science - [email protected]
29 December 20, 2013
ArtVis
Page 30
Beat Signer - Department of Computer Science - [email protected]
30 December 20, 2013
WISE Student Projects
Cross-Media Information Spaces and
Architectures fluid cross-media document formats
personal information management (PIM)
MindXpres presentation tool, the office of the future, ...
Multimodal and Multi-touch Interaction next generation text input devices (e.g. combine voice and Kinect)
multimodal mobile interaction
Interactive paper and augmented reality
If you should be interested in one of these topics
(or if you have your own ideas) please contact us! http://wise.vub.ac.be/thesis_proposals
Page 31
Beat Signer - Department of Computer Science - [email protected]
31 December 20, 2013
Other Courses
Advanced Topics in Information Systems seminar about recent developments in information systems
information systems and information management
information visualisation and navigation
human-machine and human-information interaction
[http://wise.vub.ac.be/content/advanced-topics-information-systems]
Next Generation User Interfaces general HCI introduction
multimodal interaction (theoretical concepts, fusion and fission, ...)
adaptation
pen-based interaction
tangible interaction and augmented reality
[http://wise.vub.ac.be/content/next-generation-user-interfaces]
Page 32
Beat Signer - Department of Computer Science - [email protected]
32 December 20, 2013
Course Summary
1. Introduction history of the Web
- Memex, Xanadu and various hypertext systems
ARPANET and TCP/IP
World Wide Web
2. Web Architectures HTTP protocol and session management
client-server architectures, proxies, tunnels and gateways
caching
client-side processing
- JavaScript, Java Applets, ...
server-side processing
- CGI, Java Servlets, JavaServer Pages (JSP), ...
Page 33
Beat Signer - Department of Computer Science - [email protected]
33 December 20, 2013
Course Summary …
3. Markup Languages HTML (XHTML) and CSS
HTML5
4. XML and XML Applications SAX (Simple API for XML) and DOM (Document Object Model)
XSL (XSLT)
XPath, XPointer and XLink
Document Type Definition (DTD) and XML Schema
XML-RPC
VoiceXML
Page 34
Beat Signer - Department of Computer Science - [email protected]
34 December 20, 2013
Course Summary …
5. Web Application Frameworks Model-View-Controller (MVC)
Apache Struts 2 and tag libraries
Apache Flex, Microsoft Silverlight, OpenLaszlo, Ruby on Rails, ...
web content management systems
6. Web 2.0 Basics main concepts and interactions
various Web 2.0 applications
social implications
Page 35
Beat Signer - Department of Computer Science - [email protected]
35 December 20, 2013
Course Summary …
7. Web 2.0 Patterns and Technologies asynchronous partial updates and RIAs
- AJAX and JSON-RPC
service oriented architectures (SOAs)
- Big Web Services and RESTful Web Services
RSS
mashups
8. Mobile Web Information Systems mobile network technologies
Peer-to-Peer-like (P2P) systems
context awareness
location-based services
user interfaces
Page 36
Beat Signer - Department of Computer Science - [email protected]
36 December 20, 2013
Course Summary …
9. Semantic Web semantic web stack
- RDF and RDFS, OWL, SPARQL, ...
semantic web applications
XHTML extensions
- microformats
- RDFa
10.Web Search web search engine architectures
Google PageRank algorithm
search engine optimisations (SEO)
- white hat and black hat optimisations
Page 37
Beat Signer - Department of Computer Science - [email protected]
37 December 20, 2013
Course Summary …
11.Security, Privacy and Trust HTTP Authentication
- basic authentication, digest authentication and base64 encoding
symmetric key and public key cryptography
- RSA cipher
digital signatures and digital certificates
TLS/SSL and HTTP Secure (HTTPS)
privacy issues
12.Future Trends future of the Web
- cloud computing, social computing, personalisation, innovative user interfaces
internet of things
cross-media information spaces
Page 38
Beat Signer - Department of Computer Science - [email protected]
38 December 20, 2013
Exam
Exams in the week of January 20, 2013
Each student will be assigned an examination slot
of 30 minutes 10 minutes for questions about the assignment
15 minutes oral exam about different topics that have been covered in the course
- note that there will be no specific preparation time
You will have to register for a specific examination via
PointCarré
Overall grade = oral exam (60%) + assigment (40%)
Submission of the assignment via PointCarré (dropbox) deadline: December 23, 24:00 (UTC)
Page 39
Beat Signer - Department of Computer Science - [email protected]
39 December 20, 2013
Exam …
You can bring the copies of your solutions for the
exercise with you as they might be used as a basis for
discussion during the oral exam
The exam will cover all the content presented in the
lectures as well as any additional information from the
exercise sessions includes the videos shown in some of the lectures
Remember to read the following two papers as they form
part of the course material Vannevar Bush, As We May Think, Atlanic Monthly, July 1945
Mark Weiser, The Computer for the 21st Century, ACM Mobile Computing and Communications Review, July 1999
Page 40
Beat Signer - Department of Computer Science - [email protected]
40 December 20, 2013
Exam …
Make sure that you can sketch basic architectures of
web information systems possible roles of different technologies
know how the things presented in different lectures fit together
- e.g. security applied to varying architectures
- e.g. web search for RIAs
- …
Make sure that you understand the basic concepts however, we might ask questions at any level of detail to evaluate
your knowledge
Page 41
Beat Signer - Department of Computer Science - [email protected]
41 December 20, 2013
References
Cross-Media Information Spaces
and Architectures http://wise.vub.ac.be/content/cross-media-information-spaces-and-architectures
Interactive Paper and Augmented Reality http://wise.vub.ac.be/content/interactive-paper-and-augmented-reality
Multimodal and Multi-Touch Interaction http://wise.vub.ac.be/content/multimodal-and-multi-touch-interaction
Page 42
Beat Signer - Department of Computer Science - [email protected]
42 December 20, 2013
References ...
Beat Signer and Moira C. Norrie, As We May
Link: A General Metamodel for Hypermedia Systems, In
Proceedings of ER 2007, Auckland, New Zealand,
November 2007
Beat Signer, Fundamental Concepts for Interactive
Paper and Cross-Media Information Spaces,
ISBN 978-3-8370-2713-6, May 2008
Lode Hoste, Bruno Dumas and Beat Signer,
Mudra: A Unified Multimodal Interaction Framework, In
Proceedings of ICMI 2011, Alicante, Spain, November
2011
Page 43
Beat Signer - Department of Computer Science - [email protected]
43 December 20, 2013
References ...
Lode Hoste, Bruno Dumas and Beat Signer,
SpeeG: A Multimodal Speech- and Gesture-based Text
Input Solution, In Proceedings of AVI 2012, Capri Island,
Italy, May 2012
Beat Signer, Ueli Kurmann and Moira C. Norrie,
iGesture: A General Gesture Recognition Framework, In
Proceedings of ICDAR 2007, Curitiba, Brazil, September
2007
Page 44
Beat Signer - Department of Computer Science - [email protected]
44 December 20, 2013
2 December 2005
Web Information Systems The End
Good Luck with the Exam!