Multimedia Database

Content and Structure

By:
• Randa Mohamed Sameh
• Hisham Hassan Ali
• Mohamed Hassan Ali

December, 2009
31/12/2009 1
Topics
1. Introduction
2. Multimedia database management
system.
3. Multimedia database: types
1. Linked multimedia databases
2. Embedded multimedia database
4. Multimedia Databases usage

31/12/2009 2
Topics (Cont.)
6. Structure of multimedia database:
1. Data analysis.
2. Data modeling.
3. Data Storage.
4. Data Retrieval
5. Query Language
6. Multimedia Communication
7. How to create a multimedia database?

31/12/2009 3
Part 1 (7 slides) by:

Randa Mohamed Sameh

31/12/2009 4
Introduction
 Multimedia systems play more and more
impact on our lives.
 Challenge: How to organize and
structure these huge multimedia
information so that we can get
information easily at any point of time.
 Challenge: How to search for
multimedia data by attributes and
contents?
31/12/2009 5
Multimedia database
Management System
 It’s a system software that manages a
collection of multimedia data:
◦ Static Media: text, graphics, and images.
◦ Dynamic Media: animation, music, audio,
speech and video.
 It provides access to users to query and
retrieve multimedia objects based on:
◦ Metadata.
◦ Content.

31/12/2009 6
Multimedia database Types
(By data store)
 There are generally two types of
multimedia databases:
1. Linked Multimedia Databases (small DB)
Title Description MediaPath
C:\Media\oodb.jpg

2. Embedded Multimedia Databases.

(large database)

Title Description MediaData

<Binary data>

31/12/2009 7
Binary Data Types in
SQL Server
Data Type Allocated space Maximum

bit fixed-size single bit with a value

of 0, 1

binary(n) fixed-size 8,000 bytes

varbinary(n) variable-length 8,000 bytes

varbinary(max) variable-length 2 gigabytes

image variable-length 2 gigabytes

stores any type of data
file (not just images).

31/12/2009 8
 Linked VS Embedded MMDB
Advantages
Linked • Easy to do programmatically
MMDB • Easy to edit media.
• DB size is small.
• No limitation for media size
in the application
Embedded • Application server doesn’t
MMDB need permissions to write
to the file system.
• Easy to backup (All data is
contained in a single
location).
31/12/2009
Disadvantages
• Application server needs
permissions to write to the file
system.
• Difficult to backup (Data is
contained in two locations (DB-
Media Folder).
• Requires more code
• Difficult to edit media.
• DB size is large.
• limitation for media size in the
application
9
Multimedia Databases usage
 Digital Libraries.
 News-On-Demand.
 Video-On-Demand.
 Music Database.
 GIS.
 GPS Maps.

31/12/2009 10
Multimedia Databases usage
 Authentication Multimedia Database
(also known as a Verification Multimedia
Database, i.e. retina scanning), is a 1:1 data
comparison
 Identification Multimedia Database is a
data comparison of one-to-many (i.e.
passwords and personal identification
numbers
 Biometrics Multimedia Database; which
specializes in automatic human verification
based on the algorithms of their behavioral
or physiological profile.
31/12/2009 11
Part 2 (7 slides) by:

Hisham Hassan Ali

31/12/2009 12
Structure of multimedia
database
 Multimedia database structure can best
be explained with the following
components:
◦ Data Types
◦ Operations on Data
◦ Data Storage
◦ Data Retrieval
◦ Query Language
◦ Multimedia Communication

31/12/2009 13
Data analysis
How are these data structured?
 Unformatted (unstructured) form.
Data are presented in a unit where the
content cannot be retrieved by
accessing any structured details.
 Formatted (structured) form.
Data are stored in variables, fields or
attributes with corresponding values

31/12/2009 14
Data Types
How can these data be stored?
 Raw data: Storing data only.
 Registering data: data, data attributes.
 Descriptive data: data, data attributes and
metadata. This metadata can be generated
by two ways:
◦ Manual.
◦ Automatic:
 Automated speech recognition (ASR)
 Automated image annotation

31/12/2009 15
 Data Types - Examples
Text Image Audio Video

Raw data Characters Pixels Digital Signals Pixel Matrices

Registering Code (ASCII) Size, Format Audio Coding, + Number of

data Length images per
(attributes) second

Descriptive Colors, Shapes, Lyrics, Music + Scene

data Borders Type, Artist, description
Album

31/12/2009 16
 Descriptive data

keyframe summary

videotext summary

31/12/2009 17
Automated image annotation
 Assigns metadata in the form of
captioning (scenes) or keywords (Full
text) to a digital image.
 Used in image retrieval systems to
organize and locate images of interest
from a database.
 http://www.alipr.com

31/12/2009 18
31/12/2009 19
31/12/2009 20
Part 3 (10 slides) by:

Mohamed Hassan Ali

31/12/2009 21
Operations on Data
 Input (Insert / Record)
◦ Raw and registering data are required.
 Output (Play)
◦ Read raw data according to registering data.
 Modification
◦ Can be done for raw, registering and descriptive data.
 Deletion
◦ Removes any entry from the database.
 Evaluation
◦ Generating the descriptive data from the raw data.

31/12/2009 22
Data storage
 The dynamic media contents
recommended to be stored on a separate
server with a NIC that supports Off-Load
feature and a striped volume (Raid 0) to
meet the real time constraint
requirements.
 To secure the dynamic data from hard
disk failure, Raid 1+0 is recommended.

31/12/2009 23
(Raid 1) VS (Raid 0)

High Reliability High Performance

31/12/2009 24
Raid 1+0 is a challenge

Very High Reliability

+
High Performance
31/12/2009 25
Data retrieval
 Multimedia objects can be classified into
two objects:
◦ Active Objects:
which participate in the retrieval process.
◦ Passive objects:
which don’t participate in the retrieval
process.

31/12/2009 26
Query Language
 Query language is a part of DBMS.
 There are two types of queries used in
databases:
◦ Well-defined query
The users must know what they are intended
to search.
◦ Fuzzy query
The properties of query objects are
ambiguous.

31/12/2009 27
Multimedia Data Queries
1. Keyword querying
 Simple and popular - Search for images
by text.
2. Semantic querying
 Search for similar image using the visual
properties of images like colors,
textures and their positions.
http://www.alipr.com
 Uses Query By Image Content (QBIC)
31/12/2009 28
Multimedia Data Queries
3.Visual querying
 Search for detailed image by clicking an
icon on the master image which is
indexed.
 Example: Google Erath.
 Uses Query by Spatial Icons (QBSI)

31/12/2009 29
Multimedia communication
 Communication is the sole objectives of
any information system.
 Multimedia allows more than one users
to communicate at each other
simultaneously.

31/12/2009 30
How to create a simple
multimedia database?
1. Collect multimedia elements.
2. Digitize multimedia materials.
3. Classify, catalog and index the digitized
multimedia elements.
4. Store the digitized multimedia into the
RDBMS in either linked or embedded
form.
5. Input descriptive text pertaining to the
multimedia data into the RDBMS.
31/12/2009 31
 Thank You
See you in Data Security ISA

The big Three

31/12/2009 32