SCULPTEUR: Multimedia Retrieval for Museums S. Goodall, P. H. Lewis, K. Martinez, P. A. S. Sinclair, F. Giorgini, M. J. Addis, M. J. Boniface, C. Lahanier,

SCULPTEUR: Multimedia Retrieval for Museums

S. Goodall, P. H. Lewis, K. Martinez, P. A. S. Sinclair, F. Giorgini, M. J.

Addis, M. J. Boniface, C. Lahanier, J. Stevenson

Title

Project IST-2001-35372 - SCULPTEUR

1. Present overview of SCULPTEUR Project2. Present the idea of multimedia retrieval3. Present the research issues in the project

Overview

Project IST-2001-35372 - SCULPTEUR

●SCULPTEUR (Semantic and content-based multimedia exploitation for European benefit) ●Multidisciplinary partnership with participants from industrial, academic, research and cultural sectors ●Large EU, 3 year project (May 2002 – May 2005)

The SCULPTEUR Vision

Project IST-2001-35372 - SCULPTEUR

The vision of SCULPTEUR is to develop both the technology and the expertise to help create,

manipulate, manage and present these cultural archives, and make available cultural heritage to

European people and the world.

Some of the Aims

Project IST-2001-35372 - SCULPTEUR

• Multimedia information handling facilities for museums• Integrating content, metadata and concept based retrieval and

navigation• Use of semantic web technology to facilitate this• Extension of digital content to 3-D (capture and use)• 3-D Content based retrieval• “Agents” to cluster and classify content representations• “Agents” to try and find missing or additional information on

the web• Cross collection searching and interoperability

Project Partners

Project IST-2001-35372 - SCULPTEUR

Uffizi Gallery

Research Areas

Project IST-2001-35372 - SCULPTEUR

Talk about the research areas of the project

•3-D CBR•Classifier Agent•Web Crawler

Types of Questions to Address

Project IST-2001-35372 - SCULPTEUR

•Find similar objects to my object•Find all objects created by <NAME>•Find all objects created in the 19th century•Find all “gold” objects•Find all objects of a certain size•Find a 3-D object from my 2-D image

Architecture

Project IST-2001-35372 - SCULPTEUR

Multimedia Retrieval

Project IST-2001-35372 - SCULPTEUR

Types of Query:

●Content-Based Retreival (2-D and 3-D)●Concept-Based Retreival●Meta-data Retrieval

2-D Content-Based Retrieval

Project IST-2001-35372 - SCULPTEUR

●Developed during ARTISTE●Colour, Texture and Shape based descriptors

Sub-image matching

Query

Best Match

Project IST-2001-35372 - SCULPTEUR

“Cord” Histogram

ShapeDistribution

3-D Content-Based Retrieval

Concept-Based Retrieval

Project IST-2001-35372 - SCULPTEUR

•Browser based on Touch Graph•Graphically browse system ontology•“Shortcuts” allow navigation to commonly used concepts•Can obtain instance information from concepts for querying with

Metadata Retrieval

Project IST-2001-35372 - SCULPTEUR

Query: Find all “Vases”

•Free text fields•Controlled Lists

Interoperability

Project IST-2001-35372 - SCULPTEUR

e-Learning StuffLearn eXact (sp?)

•Uses SRW Interface

Challenges Ahead

Project IST-2001-35372 - SCULPTEUR

•2-D to 3-D CBR•Knowledge Acquistion

Closing Words

Project IST-2001-35372 - SCULPTEUR

More Information

Project IST-2001-35372 - SCULPTEUR

Consortium Website:http://www.sculpteurweb.org

Prototype Sytem:http://piltdownman.it-innovation.soton.ac.uk

Title

Project IST-2001-35372 - SCULPTEUR

Title

Project IST-2001-35372 - SCULPTEUR