OODB Research [Multimedia Database]

Multimedia DatabaseMultimedia Database

Content and StructureContent and Structure

By:

• Randa Mohamed Sameh

• Hisham Hassan Ali

• Mohamed Hassan Ali

December, 200931/12/2009 1

TopicsTopics

1. Introduction

2. Multimedia database management

system.

3. Multimedia database: types

1. Linked multimedia databases

2. Embedded multimedia database

4. Multimedia Databases usage

31/12/2009 2

Topics (Cont.)Topics (Cont.)

6. Structure of multimedia database:

1. Data analysis.

2. Data modeling.

3. Data Storage.

4. Data Retrieval

5. Query Language

6. Multimedia Communication

7. How to create a multimedia database?

31/12/2009 3

Part Part 1 1 ((7 7 slides) by:slides) by:

31/12/2009 4

Randa Mohamed Sameh

IntroductionIntroduction

Multimedia systems play more and more

impact on our lives.

Challenge: How to organize and

structure these huge multimedia

information so that we can get

information easily at any point of time.

Challenge: How to search for

multimedia data by attributes and

contents?

31/12/2009 5

Multimedia database Multimedia database

Management SystemManagement System It’s a system software that manages a

collection of multimedia data:

◦ Static Media: text, graphics, and images.

◦ Dynamic Media: animation, music, audio,

speech and video.

It provides access to users to query and

retrieve multimedia objects based on:

◦ Metadata.

◦ Content.

31/12/2009 6

Multimedia database TypesMultimedia database Types

(By data store)(By data store) There are generally two types of

multimedia databases:

1. Linked Multimedia Databases (small DB)

2. Embedded Multimedia Databases.

(large database)

31/12/2009 7

Title Description MediaPath

C:\Media\oodb.jpg

Title Description MediaData

<Binary data>

Binary Data Types in Binary Data Types in

SQLSQL ServerServer

31/12/2009 8

Data Type Allocated space Maximum

bit fixed-size single bit with a value

of 0, 1

binary(n) fixed-size 8,000 bytes

varbinary(n) variable-length 8,000 bytes

varbinary(max) variable-length 2 gigabytes

image

stores any type of data

file (not just images).

variable-length 2 gigabytes

Linked VS Embedded MMDBLinked VS Embedded MMDB

31/12/2009 9

Advantages Disadvantages

Linked

MMDB

• Easy to do programmatically

• Easy to edit media.

• DB size is small.

• No limitation for media size

in the application

• Application server needs

permissions to write to the file

system.

• Difficult to backup (Data is

contained in two locations (DB-

Media Folder).

Embedded

MMDB

• Application server doesn’t

need permissions to write

to the file system.

• Easy to backup (All data is

contained in a single

location).

• Requires more code

• Difficult to edit media.

• DB size is large.

• limitation for media size in the

application

Multimedia Databases usageMultimedia Databases usage

Digital Libraries.

News-On-Demand.

Video-On-Demand.

Music Database.

GIS.

GPS Maps.

31/12/2009 10

Multimedia Databases usageMultimedia Databases usage

Authentication Multimedia Database (also known as a Verification Multimedia Database, i.e. retina scanning), is a 1:1 data comparison

Identification Multimedia Database is a data comparison of one-to-many (i.e. passwords and personal identification numbers

Biometrics Multimedia Database; which specializes in automatic human verification based on the algorithms of their behavioral or physiological profile.

31/12/2009 11

Part Part 2 2 ((7 7 slides) by:slides) by:

31/12/2009 12

HishamHisham Hassan AliHassan Ali

Structure of multimedia Structure of multimedia

databasedatabase Multimedia database structure can best

be explained with the following

components:

◦ Data Types

◦ Operations on Data

◦ Data Storage

◦ Data Retrieval

◦ Query Language

◦ Multimedia Communication

31/12/2009 13

Data analysisData analysis

How are these data structured?How are these data structured? Unformatted (unstructured) form.

Data are presented in a unit where the

content cannot be retrieved by

accessing any structured details.

Formatted (structured) form.

Data are stored in variables, fields or

attributes with corresponding values

31/12/2009 14

Data Types

How can these data be stored? Raw data: Storing data only.

Registering data: data, data attributes.

Descriptive data: data, data attributes and

metadata. This metadata can be generated

by two ways:

◦ Manual.

◦ Automatic:

Automated speech recognition (ASR)

Automated image annotation

31/12/2009 15

Data Types Data Types -- ExamplesExamples

31/12/2009 16

Text Image Audio Video

Raw data Characters Pixels Digital Signals Pixel Matrices

Registering

data

(attributes)

Code (ASCII) Size, Format Audio Coding,

Length

+ Number of

images per

second

Descriptive

data

Colors, Shapes,

Borders

Lyrics, Music

Type, Artist,

Album

+ Scene

description

31/12/2009 17

keyframe summary

videotext summary

Descriptive data

Automated image annotationAutomated image annotation

Assigns metadata in the form of

captioning (scenes) or keywords (Full

text) to a digital image.

Used in image retrieval systems to

organize and locate images of interest

from a database.

http://www.alipr.com

31/12/2009 18

31/12/2009 19

31/12/2009 20

Part Part 3 3 ((10 10 slides) by:slides) by:

31/12/2009 21

Mohamed Hassan AliMohamed Hassan Ali

Operations on DataOperations on Data

Input (Insert / Record)

◦ Raw and registering data are required.

Output (Play)

◦ Read raw data according to registering data.

Modification

◦ Can be done for raw, registering and descriptive data.

Deletion

◦ Removes any entry from the database.

Evaluation

◦ Generating the descriptive data from the raw data.

31/12/2009 22

Data storageData storage

The dynamic media contents

recommended to be stored on a separate

server with a NIC that supports Off-Load

feature and a striped volume (Raid 0) to

meet the real time constraint

requirements.

To secure the dynamic data from hard

disk failure, Raid 1+0 is recommended.

31/12/2009 23

(Raid (Raid 11) VS (Raid ) VS (Raid 00))

31/12/2009 24

High Reliability High Performance

Raid Raid 11++0 0 is a challengeis a challenge

31/12/2009 25

Very High Reliability

+

High Performance

Data retrievalData retrieval

Multimedia objects can be classified into

two objects:

◦ Active Objects:

which participate in the retrieval process.

◦ Passive objects:

which don’t participate in the retrieval

process.

31/12/2009 26

Query LanguageQuery Language

Query language is a part of DBMS.

There are two types of queries used in

databases:

◦ Well-defined query

The users must know what they are intended

to search.

◦ Fuzzy query

The properties of query objects are

ambiguous.

31/12/2009 27

Multimedia Data QueriesMultimedia Data Queries

1. Keyword querying

Simple and popular - Search for images

by text.

2. Semantic querying

Search for similar image using the visual

properties of images like colors,

textures and their positions.

http://www.alipr.com

Uses Query By Image Content (QBIC)

31/12/2009 28

Multimedia Data QueriesMultimedia Data Queries

3. Visual querying

Search for detailed image by clicking an

icon on the master image which is

indexed.

Example: Google Erath.

Uses Query by Spatial Icons (QBSI)

31/12/2009 29

Multimedia communicationMultimedia communication

Communication is the sole objectives of

any information system.

Multimedia allows more than one users

to communicate at each other

simultaneously.

31/12/2009 30

How to create How to create a simple a simple

multimedia multimedia database?database?1. Collect multimedia elements.

2. Digitize multimedia materials.

3. Classify, catalog and index the digitized

multimedia elements.

4. Store the digitized multimedia into the

RDBMS in either linked or embedded

form.

5. Input descriptive text pertaining to the

multimedia data into the RDBMS.

31/12/2009 31

Thank YouThank You

See you in Data Security ISA

The big Three

31/12/2009 32