PGNET, Liverpool JMU, June 2005 MediaHub: An Intelligent MultiMedia Distributed Platform Hub Glenn Campbell, Tom Lunney, Paul Mc Kevitt School of Computing and Intelligent Systems Faculty of Engineering University of Ulster, Magee Campus Northland Road, Derry {Campbell-g8, TF.Lunney, P.McKevitt} @ulster.ac.uk
29
Embed
PGNET, Liverpool JMU, June 2005 MediaHub: An Intelligent MultiMedia Distributed Platform Hub Glenn Campbell, Tom Lunney, Paul Mc Kevitt School of Computing.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Goals and objectives Key research problems Distributed Processing Distributed Platforms Architecture of MediaHub Decision making in MediaHub Comparison to related research Tools and future development
PGNET, Liverpool JMU, June 2005
Goals
The primary objectives of MediaHub are to:
Interpret/generate semantic representations of multimodal input/output
Perform fusion and synchronisation of multimodal data
(decision-making) Implement and evaluate a multimodal platform hub
(MediaHub)
PGNET, Liverpool JMU, June 2005
Goals
Research questions:
Semantic representation?
Communication with other elements of a platform?
• Semantic representation?
• Decision-making?
PGNET, Liverpool JMU, June 2005
Key research problems
Semantic Representation Represent language and vision Frames or XML?
Consists of nodes and directed edges between nodes
Node represents a variable Edge represents cause-effect relationship An edge connecting two nodes A and B
indicates a direct influence exists between state of A and the state of B
PGNET, Liverpool JMU, June 2005
Simple Bayesian Network
‘Diet’ and ‘Exercise’ nodes have influence over ‘Weight Loss’ node
PGNET, Liverpool JMU, June 2005
Future development
Define necessary decisions Develop Bayesian decision making using Hugin API for Java Semantic storage Communication Semantic representation scheme Semantic representation database Acquire multimodal corpora for testing Test MediaHub in an existing Multimodal Platform e.g.
CONFUCIUS (Ma & Mc Kevitt 2003)
PGNET, Liverpool JMU, June 2005
Conclusion An intelligent multimodal distributed platform hub called MediaHub
will be developed
MediaHub will interpret and generate semantic representations of multimodal input and output
MediaHub will perform fusion and synchronisation of language and vision data
MediaHub will provide a new method of decision making within a distributed platform hub
MediaHub will be tested within an existing multimodal platform (e.g. CONFUCIUS)