MPEG-7(9_18)

MPEG-7 Multimedia Content Description Standard

Digital Media Value Chain (MPEG-7 Metadata Management) Content value chain:Distribute Sell

Life-cycle:

Metadata layer:DeliverAdaptPackage Search Index

Increase content asset value through repurposing First-class role of metadata (smart bits) throughout digital media lifecycle Central role of metadata management (XML schemas, catalog records, ontologies) MPEG-7 for content description MPEG-21 for packaging, rights mgmt, transactions Create: search, annotate, extract Manage: index, annotate, collate Transact/Distribute: search, package, adapt

Store

Plan

Search

Metadata Mgmt.

Annotate

Maintain

Annotate

Author Extract Collate

Create

Produce

Digital media metadata access functions:

Acquire

Organize

MPEG-7 Multimedia Indexing and Searching MPEG-7 Indexing & Searching:Digital Media RespositoryMPE G-7 SC HEM A

M PEG-7 Search Engi ne (X M L M etad ata)

Semantics-based (people, places, events, objects, scenes) Content-based (color, texture, motion, melody, timbre) Metadata (title, author, dates)

Sounds like ... Looks like ...

M odel Qu ery

Similarity Se arch

Sema ntics Que ry

MPEG-7 Search

User

MPEG-7 Model D escriptio ns

MPEG-7 D escriptors

MPEG-7 S emantics D escrip tions

NetworkI BM Conte nt M anager (Library Serve r & Obje ct S erver) MPEG-7 Metadata Storage

Pervasive Usage Environment MPEG-7 Processing

MPEG-7 Access & Delivery: Media personalization Adaptation & summarization Usage environment (user preferences, devices, context)

(XML for Multimedia Content Description) MPEG-7 Normative elements:Compression Coding MPEG-1,-2,-4 Transmission Retrieval Streaming Management Filtering

MPEG-7 Overview

Descriptors and Description Schemes DDL for defining Description Schemes Extensible for application domains DDL DS D D DS DApplication domaini.e., Medical imaging Remotesensing images Surveillance video Computer animations and graphics

Acquisition Authoring Editing MPEG-7 Browsing NavigationEvent Tree

MPEG-7 Standard

Searching IndexingTime Axis Shot1

D D

DS

Segment TreeShot2 Shot3

Segment 1 Sub-segment 1

Introduction Summary

Rich, highly granular multimedia content description:

Sub-segment 2

Program logo

Sub-segment 3

Studio Overview News Presenter

Video segments, moving regions, shots, frames, Audio-visual features: color, texture, shape, Semantics: people, events, objects, scenes,

Sub-segment 4 segment 2

News ItemsSegment 3

International Clinton Case Pope in Cuba National

Segment 4

Segment 5

Twins Sports Closing

Segment 6

Reference Region Motion

Reference Region Motion

Reference Region Motion

Segment 7

Harmonization of Multimedia Metadata StandardsMPEG-7, SMEF, P/Meta, SMPTE, Dublin Core, TV-Anytime, Indecs MPEG-7: Moving Picture Experts Group

SMEF Standard Media Exchange Framework:

Infrastructure standard for Multimedia Metadata Supports interpretation of the informations meaning Supports broad range of applications BBC developed data models for information involved in the Production, Development, Use, and Management of media assets Exchange of program content between high-level business functions of EBU members: Production, Delivery/Broadcast, & Archive Addresses Program Interchange independent of format Interoperable online metadata standards supporting broad range of purposes and business models. SMEF

Dublin Core MPEG-7 DescriptorsMPEG-7 Harmonized Model

P/Meta

P/Meta EBU P/Meta Project:

SMPTE Metadata dictionary & MXF: Dublin Core Metadata Initiative:

SMPTE

TV Anytime MPEG-7 Harmonized Model:

TV-Anytime TV-Anytime Metadata:

Indecs Indecs Metadata Framework

Attractors/descriptors used e.g. in Electronic Program Guides (EPG), or in Web pages to describe content. An international initiative of rights owners creating metadata standards for e-commerce.

Harmonized elements with other standards and existing practices Extensible framework Registration authority for classification schemes, controlled terms, ontologies

MPEG-7 MDS: Free Text Annotation Example The following example gives an MPEG-7 description of a car that is depicted in an image: Car Four wheel motorized vehicle image.jpg

MPEG-7 MDS: Event DS Example The following example gives an MPEG-7 description of the event of handshake between people: Shake hands Person A Person B Handshake Clasping of right hands by two people