Informatics and Telematics Institute Centre for Research and Technology Hellas ITI-CERTH Amsterdam, Multimedia Semantics XG, 10-11 July 2006 Vasileios Papastathis, Research Fellow Centre for Research and Technology Hellas (CERTH) Informatics and Telematics Institute (ITI) ( http://www.iti.gr ) Director Prof. Michael Strintzis Multimedia Knowledge Group (http://mkg.iti.gr ) Head Dr. Yiannis Kompatsiaris Thessaloniki, GREECE
19
Embed
Informatics and Telematics Institute Centre for Research and Technology Hellas ITI-CERTH Amsterdam, Multimedia Semantics XG, 10-11 July 2006 Vasileios.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Informatics and Telematics InstituteCentre for Research and Technology Hellas
ITI-CERTH
Amsterdam, Multimedia Semantics XG, 10-11 July 2006
Vasileios Papastathis, Research Fellow
Centre for Research and Technology Hellas (CERTH)
Informatics and Telematics Institute (ITI) (http://www.iti.gr)
Director Prof. Michael Strintzis
Multimedia Knowledge Group (http://mkg.iti.gr)Head Dr. Yiannis Kompatsiaris
Thessaloniki, GREECE
Informatics and Telematics InstituteCentre for Research and Technology Hellas
2
Presentation Overview
• ITI Multimedia Knowledge Group• Towards a Common Multimedia
Ontology Framework• IST BOEMIE Project
Informatics and Telematics InstituteCentre for Research and Technology Hellas
3
ITI Multimedia Knowledge Group
• Semantic Multimedia Analysis• Multimedia Indexing and Retrieval• Multimedia and the Semantic Web• Knowledge Structures, Languages and Tools for
Multimedia• Reasoning and Personalization for Multimedia Applications
• Ontology structures in OWL for knowledge-assisted multimedia analysis and reasoning
• Rules in SWRL including multimedia features for analysis and reasoning
• MPEG-7 Visual part representation in RDF• Graphical tool for ontology-based annotation of images
(M-Ontomat)
Informatics and Telematics InstituteCentre for Research and Technology Hellas
4
R&D Projects
• “aceMedia: Integrating knowledge, semantics and content for user centred intelligent media services”, IP 2004-2007
• “KnowledgeWeb: Realizing the Semantic Web”, funded by the DG XIII, NoE 2004-2007
• “MESH: Multimedia Semantic Syndication for Enhanced News Services”, IST – IP, 2006-2008
• “K-Space: Knowledge Space of Semantic Inference for Automatic Annotation and Retrieval of Multimedia Content, IST - NoE, 2006-2009
• “X-Media: Knowledge Sharing and Reuse Across Media”, IST – IP, 2006-2009
• “BOEMIE: Bootstrapping Ontology Evolution with Multimedia Information Extraction”, IST – STREP, 2006-2008
11. 'Signals and Images' Laboratory, Institute of Information Science and Technologies "A. Faedo" (ISTI–CNR), Italian National Research Council (CNR)
12. Image Bioinformatics Research Group, Department of Zoology, University of Oxford
13. Technical University of Crete,
14. CWI Amsterdam, Maryland Information and Network Dynamics Lab, National Technical University of Athens
15. University of Twente
Informatics and Telematics InstituteCentre for Research and Technology Hellas
9
Requirements for MM ontologies
• Scope and Usage• Media Description-Description of the
information object• Representation of Content Structure• Representation of Content Description• Knowledge Representation Formalism• Reasoning Support • Following an established methodology
Informatics and Telematics InstituteCentre for Research and Technology Hellas
10
Requirements (2)
• Scope and Usage Annotation Analysis Retrieval Reasoning Personalized
filtering Meta-Modeling
• Media description Image Video 3D Graphics Audio AudioVisual Multimedia
presentation
Informatics and Telematics InstituteCentre for Research and Technology Hellas
11
Requirements (3)
• Representation of content structure Multimedia
structure representation
Spatiotemporal relation representation
Localization
• Representation of content description Low-level description Multiple audiovisual
descriptors Alignment to existing
metadata standards Basic and complex
data types
Informatics and Telematics InstituteCentre for Research and Technology Hellas
12
Requirements (4)
• Knowledge representation formalism High complexity of
multimedia modeling Compliance to W3C
standards Inferencing support OWL
• Reasoning support DL-based
reasoning Rules Uncertainty Fuzziness
• Established methodology OntoKnowledge OntoClean
Informatics and Telematics InstituteCentre for Research and Technology Hellas
• Ontology cross-domain linking Alignment techniques for multimedia ontologies linking
with domain-specific ontologies Merging techniques for multimedia ontology
coordination
• Compliance to standards Semantic Web, W3C, MPEG-7, etc
Informatics and Telematics InstituteCentre for Research and Technology Hellas
14
Harmonization approaches (2)
• Harmonization of core ontologies Core ontologies cannot be simply mapped but
need to be “harmonized” Need to apply ontological modeling principles
during harmonization
• Development of a common upper ontology Starting point for new ontology construction Bridge between existing ontologies Act as the ground basis for the establishment of
an integrated ontology framework Back up the common upper ontology
Informatics and Telematics InstituteCentre for Research and Technology Hellas
BOEMIE
Multimedia annotation tool and
A proposed knowledge framework
Informatics and Telematics InstituteCentre for Research and Technology Hellas
16
M-OntoMat Annotizer
Mid-Level
Concepts
Selection of regions for mergingSemantic
labeling
Automatic segmentation
Region merging
functionality
Descriptor extractionDescriptor extraction
Informatics and Telematics InstituteCentre for Research and Technology Hellas
17
XML output
Informatics and Telematics InstituteCentre for Research and Technology Hellas
18
Knowledge framework
Core Ontology-Holistic Representation
Domain Ontology
Spatiotemporal Constraints
Modality Elements
Multimedia Content Ontology
Classifiers/ Algorithms
Features/ Multimedia Descriptor Ontology
Informatics and Telematics InstituteCentre for Research and Technology Hellas