Presenting Knowledge on the Semantic Web Lynda Hardman Semantic Media Interfaces http://media.cwi.nl
Jan 06, 2016
Presenting Knowledgeon the Semantic Web
Lynda Hardman Semantic Media Interfaces
http://media.cwi.nl
Long-term goal• Develop knowledge-intensive models and document
processing technologies that are able to:
generate coherent multimedia presentations tailored to an individual user
taking into account their preferences, abilities, device capabilities and environment.
Goals of research
•Understand how to – incorporate design and discourse
knowledge into multimedia presentations
– represent this knowledge in Web and Semantic Web technologies
•Semantic Web provides– source content for inclusion in presentations
– a means of expressing knowledge needed
AmsterdamHypermedia
Model
Cuypers
Topia,DISC
Noadster
Vox Populi
From syntax to semantics
TimeSyn
tax
Sem
antic
s
AmsterdamHypermedia
Model
Cuypers
Topia,DISC
Noadster
Vox Populi
From syntax to semantics
TimeSyn
tax
Sem
antic
s
Space/time trade-offs
Space/time trade-offs
• Media repository from Rijksmuseum• Quantitative constraints insufficient
using pixel-based positioning• Qualitative constraints also used
specification of constraints at higher level A not-overlap B, B after C
• If insoluble then backtrack to other solutions using Prolog
• Joost GeurtsMMM 2001, WWW 2001
AmsterdamHypermedia
Model
Cuypers
Topia,DISC
Noadster
Vox Populi
From syntax to semantics
TimeSyn
tax
Sem
antic
s
Inferring document structure
•First name•Surname•Other name•Synonym•Year of birth•Year of death
Artist
•Title•Short title•Material•Style period•Creation year•Picture
Artefact
ArtTheme
part of
•ID•Type•Keyword text
Keyword
•ID•Type•Text
Presentation
•Sequence no.•Title•Description
Presentation part
Place andTime interval
contained in
description
description
creator
includes
includes
points to
subClassOf
Rijksmuseum domain model
Topia project
Inferring document structure•Topia•Rijksmuseum ARIA database -> RDF•Clustering on results of query•Presentation showing “table of
contents” and current focus
• Lloyd RutledgeACM Hypertext 2003
Semantic graph to presentation
Semantic graph to presentation• DISC• Rijksmuseum repository of media items• Semantic graph is not enoughRembrandt married-to Saskia also need discourse structuresfor deriving grouping, ordering and priorities
• Biography template createdpainter is-a profession
• Stefano Bocconi, Joost GeurtsISWC 2003
AmsterdamHypermedia
Model
Cuypers
Topia,DISC
Noadster
Vox Populi
From syntax to semantics
TimeSyn
tax
Sem
antic
s
Semantic Web browsing
•Noadster•Generalised semantic web browsing•Integrating global and local browsing
• Lloyd Rutledge,WWW 2005
AmsterdamHypermedia
Model
Cuypers
Topia,DISC
Noadster
Vox Populi
From syntax to semantics
TimeSyn
tax
Sem
antic
s
AmsterdamHypermedia
Model
Cuypers
Topia,DISC
Noadster
From syntax to semantics
TimeSyn
tax
Sem
antic
s
Eculture
MultimediaN Eculture
•Collection of vocabularies in RDF:– AAT, ULAN, TGN
•Artchive images•Interface for searching and browsing
http://eculture.multimedian.nl
• Partners:– Guus Schreiber, VU; Bob Wielinga & Jan Wielemaker, UvA
Eculture advanced search
Eculture search result
Eculture single artefact
Scientific challenges
• Making (multimedia) discourse and design knowledge explicit
• Expressing re-usable semantics of media assets
• Designing architectures for multimedia presentation generation
Conclusions & Future Work• From projects described we have learned much:
– distinguish stages in process– make discourse knowledge explicit– mappings between domain and discourse knowledge
• Explicit user model being worked on:– CHIP user interaction, partner Rijksmuseum
Passepartout media installation, partner V2_
• Investigating use of timeline:– to display artefacts to a user, MultimediaN Eculture
• Semantic Web Best Practices and Deployment Group, Multimedia Task Force– http://www.w3.org/2001/sw/BestPractices/MM/
• SWUIG Semantic Web User Interface Group
• NWO I2RPIntelligent Information Retrieval and Presentation
• NWO NASHNetworked Adaptive Structured Hypermedia
• Telematica Instituut Topia
• ICES KIS MultimediaN Eculture
• Images courtesy of Rijksmuseum, Amsterdam
• Acknowledgements:
– Jacco van Ossenbruggen, Frank Nack,Stefano Bocconi, Joost Geurts, Lloyd Rutledge,Alia Amin, Michiel Hildebrand, Zhisheng Huang
This research is supported by