Introduction to Multimedia

What is multimedia?


The word multimedia is composed of two parts: the prefix multi and media. Multi = Plural, more than 1, many Media = Medium of communication

 

What is multimedia?
Multimedia is the combination of content forms

1. Text

2. Audio

3. Images/Graphics

4. Animation

5. Video

Interactivity among few or all types of content forms

What is multimedia?
Definition:

Multimedia is the presentation of a computer application incorporating media elements such as text, graphics, animations, audio, and video.

For example this presentation used for teaching/learning process.

Classification of media types

Time/Space nature

Sound
Continuous or time-based

Video

Animation

Photo
Discrete or space-based

Text

Graphics

Origin
Captured from real world Synthesized by computer

Definition of Multimedia


Multimedia is a combination of text, graphic, sound, animation, and video that is delivered interactively to the user by electronic or digitally manipulated means.
GRAPHIC TEXT

VIDEO AUDIO ANIMATION

Elements of Multimedia
GRAPHIC TEXT

EXT
VIDEO AUDIO ANIMATION

   

A broad term for something that contains words to express something.

Text is the most basic element of multimedia. A good choice of words could help convey the intended message to the users (keywords). Used in contents, menus, navigational buttons

Elements of Multimedia
GRAPHIC TEXT

TEXT
VIDEO AUDIO ANIMATION

Example

Elements of Multimedia
GRAPHIC TEXT

GRAPHIC
VIDEO AUDIO ANIMATION

Two-dimensional figure or illustration  Could be produced manually (by drawing, painting, carving, etc.) or by computer graphics technology.  Used in multimedia to show more clearly what a particular information is all about (diagrams, picture).


Elements of Multimedia
GRAPHIC TEXT

GRAPHIC
VIDEO AUDIO ANIMATION

Example

Elements of Multimedia
GRAPHIC TEXT

AUDIO
VIDEO AUDIO ANIMATION

 

Produced by vibration, as perceived by the sense of hearing. In multimedia, audio could come in the form of speech, sound effects and also music score.

Elements of Multimedia
GRAPHIC TEXT

AUDIO
VIDEO AUDIO ANIMATION

Example

Elements of Multimedia
GRAPHIC TEXT

ANIMATION
VIDEO AUDIO ANIMATION

The illusion of motion created by the consecutive display of images of static elements.  In multimedia, animation is used to further enhance / enriched the experience of the user to further understand the information conveyed to them.


Elements of Multimedia
GRAPHIC TEXT

ANIMATION
VIDEO AUDIO ANIMATION

Example

Elements of Multimedia
GRAPHIC TEXT

VIDEO
VIDEO AUDIO ANIMATION

Is the technology of capturing, recording, processing, transmitting, and reconstructing moving pictures.  Video is more towards photo realistic image sequence / live recording as in comparison to animation.  Video also takes a lot of storage space. So plan carefully before you are going to use it.


Multimedia Applications

Importance of Multimedia
 There

are a number of fields where multimedia applications can be used. Examples are:Business  Education  Entertainment  Home  Public Places


Applications of Multimedia


Business  Use and Applications  Sales / Marketing Presentation  Trade show production  Staff Training Application  Company Kiosk

Applications of Multimedia


Education  Use and Applications  Courseware / Simulations  E-Learning / Distance Learning  Information Searching

Applications of Multimedia


Entertainment  Use and Applications  Games (Leisure / Educational)  Movies  Video on Demand  Online

Applications of Multimedia


Home  Use and Applications  Television  SMS services (chats, voting)

 Satellite

TV

Applications of Multimedia


Public Places  Use and Applications  Information Kiosk  Smart Cards, Security  Instant Photo Booth

Multimedia Architecture

Multimedia Architecture
Multimedia involves interactivity among many numbers of technologies and integration of multiple architectures.  Device independent Application Programming Interfaces (APIs)



Isolates the application from hardware.

Compression/decompression drivers are essential part of MMS  We will se the following architectures

  

Multimedia workstation architecture MM architecture based on interfacing buses Network architecture for MMS

Multimedia Workstation Architecture

Standard device-independent APIs and file formats are used

Applications
Graphical User Interface Multimedia Extension Compression and Decompression software/hardware Drivers Operating System Software Drivers Multimedia Driver Support

System Hardware (Multimedia - Enabled)

Add-On Multimedia Devices and Peripherals

Faster Processors, Large size RAM, GPUs, DSPs

Scanners, cameras, VCRs and sound equipments

Multimedia Architecture
Based on interface Bus
Applications Applications

Application Compatibility Layer Systems Compatibility Layer Analog Devices Hardware Layer

Application Compatibility Layer Systems Compatibility Layer Hardware Layer Analog Devices

Multimedia Interface Bus

CD-ROM
Network File Server

Jukebox LAN

Object File Server

Compare these two..

Network Architecture for MMS



MMS needs a high bandwidth which wireless is not able to provide.



So till date we are dealing with wired systems for multimedia applications.

Broadband wireless is an attempt made as a solution.  Most of the bandwidth is consumed by audio and video applications like

    

Internet telephony Internet radio Voice & video chatting Video on demand etc. Multimedia signatures in mails

Causes of Network Congestion

 

  

Multiple users accessing the network Increased computing power of computers making them capable enough to handle multiple application at a time. Voice and video based application (chats) Business needs for audio and video data transmission (video conference) Solutions:
  

Task based multilevel networking. High speed server-to-server links. Fiber Optic Networking standards (ATM, FDDI/ii, SONET)

Evolving Technologies for MMS



Hypermedia Documents
  

Hypertext (http) Hyperspeech (hstp HyperSpeech Transfer Protocol) Hyperspeech is a speech-only hypermedia application that explores issues of speech user interfaces, navigation, and system architecture in a purely audio environment without a visual display. The system uses speech recognition input and synthetic speech feedback to aid in navigating through a database of digitally recorded speech segments. We need special purpose DSPs for the implementation of speech recognition software that converts the speech into an action or text.

Evolving Technologies for MMS



HDTV and UDTV

   

Generally we have 525-line on TV Japan developed a 1125-line analog MUSE system. (HDTV) USA developed a 1125-line digital system. (HDTV in 1990) Japan is trying to develop a UDTV with 3000-line 3D pointing devices 3D displays 3D HDTV

3D Technologies and Holography

  

3D HDTV by Panasonic

Evolving Technologies for MMS

  

Fuzzy Logic The processors that work on Fuzzy logic are called as FLSPs. The displays of 3D objects onto 2D screen involves lots of complex calculation and


hence more processing power and times is needed.

The effects of moving source of illumination (shading) needs complex calculations



But FLSPs gives better and faster results as compared to DSPs

Digital Signal Processing (Parts of DSP OS architecture)

    

Memory management Dynamic allocation of arrays Hardware-interrupt handling fast response Multitasking task prioritization Intertask synchronization and communication Device-independent I/O

Defining objects for Multimedia Systems

 Text  Images

Visible photograph, drawing, documnetns and paintings  Non-visible gauge recording  Abstract image fusions


 Audio

and voice  Full-motion and Live video

Multimedia Data Interface Standards



Standardization is essential key issue in MM.

  

Large volume data Shared hypermedia documents Wide range of applications from vendors

Video Processing Standards  They must have compression and decompression capability

  

Intels DVI Apples QuickTime Microsofts AVI (low cost, low resolution


160x120x15

Extra..!!

Panasonic 152 inch 3D TV

The Panasonic TH-152UX1 is probably the next best thing to watching a 3D movie in a theater. At 152 inches, this 11 foot by 6 foot giant dwarfs just about every existing 3D TV on the market. This flat screen's 4,096x2,160 resolution also means it can deliver four times the clarity of a regular full-HD panel coupled with a superb 5 million:1 native contrast for rich inky blacks. Its aspect ratio is 17:9

Interactive Multimedia
 When

the user is given the option of controlling the elements.

Hyper Media
A

combination of hypertext, graphics, audio, video, (linked elements) and interactivity culminating in a complete, non-linear computer-based experience.

Example
 Interactive

Multimedia

Example
 Hyper

Media
Main Page 1. 2. 3. Video link Image link Audio Link

Linear VS Non-Linear
LINEAR


A Multimedia Project is identified as Linear when:  It is not interactive  User have no control over the content that is being showed to them. Example:
 

A movie A non-interactive lecture / demo show

Linear VS Non-Linear
NON-LINEAR


A Multimedia Project is identified as Non-Linear when:  It is interactive  Users have control over the content that is being showed to them.  Users are given navigational control Example:  Games  Courseware  Interactive CD

Authoring Tools


Use to merge multimedia elements (text, audio, graphic, animation, video) into a project. Designed to manage individual multimedia elements and provide user interaction (if required).

Authoring Tools

   

Example:
Macromedia Authorware Macromedia Director Macromedia Flash Microsoft Power Point

Multimedia Products
1. 2. 3. 4. 5. 6.

Briefing Products Reference Products Database Products Education and Training Products Kiosk Entertainment and Games

Multimedia Products
Briefing Products
Small, straightforward, linear products used to present information quickly and concisely. Characteristic of briefing product:  Short Development Cycle  Limited Number of Presentations  Usage of text to present information with limited use of graphic, audio and video.  Have few navigational controls. (mouse click and button press to move from one page to another)  Content and the format are suitable for the audience and fulfill the purpose of the presentation.
1/2

Multimedia Products
Briefing Products
Good briefing presentation depends on:  The understanding of the presented subject.  Seamless integration of content.  Consistent layout Example:  Corporate Presentation  Sales Presentation  Educational Lectures
2/2

Multimedia Products
Reference Products
Often used for answering specific questions or for general browsing of information. (stored on CD/ DVD ROM) Characteristic of reference product:   Used by wide range of user (small adult)

Have navigational menu, book marking, searching, printing utility

2 Basic classes of reference product:   Generalized Content (dictionary/encyclopedia) Broad treatment of content at a limited depth Detailed Content Focus on specific area and provide extensive information. 1/2

Multimedia Products
Reference Products
Good usability and success depends on:  The developers understanding the body of information and how the end user will want to access it.  Help function should always available to explain how to access and use the information Examples are electronic forms of:  Encyclopedia  Dictionaries  Cookbooks, Historical, Informative  Scientific surveys.
2/2

Multimedia Products
Reference Products
Example:

2/2

Multimedia Products
Database Products
Similar to reference product in a sense that large amount of information are made available to the end user. Focus on storing and accessing the actual data (multimedia data such as text, graphic, audio, animation and video) Characteristics of Database Products are:     Manages multimedia data (large data) Descriptive finding methods   Content based search

Simultaneous access Online database

Relational consistency in data management. 1/2

Multimedia Products
Database Products
Examples are:   Google Search Google Earth

2/2

Multimedia Products
Education and Training Products
Similar to textbook or training manuals but have added media such as audio, animation and video. Make up a significant share of the multimedia market ranging from prekindergarten to postgraduate offerings from technical to corporate training products. 2 categories of reference product:    Instructor Support Products Standalone or Self-Paced Products Combination Products

Shares the same characteristics as Reference Product

1/2

Multimedia Products
Education and Training Products
Example

2/2

Multimedia Products
Kiosk Products
A product which is usually stationed at public places and allow the user to find information interactively and also other types of transaction.

Characteristics of Kiosk Products:   Limited target users and usage. User friendly and easily used by user. Fast response.

1/2

Multimedia Products
Kiosk Products
Categories of Kiosk   Point Of Information Provide certain information (example map, timetable etc) Point Of Sales System Allow users to purchase or make orders

Example of Kiosk Products:   Instant Photo Booth Banking Kiosk (money deposit, cheque) University Information Kiosk 2/2

Multimedia Products
Entertainment & Games
Most popular Shipped in the form of Interactive CD / DVD ROM. Characteristics of E & G Products:    Immersive. Requires constant feedback and interaction with the user. Challenging and sometimes intriguing for user Enabled online play for more than one user experience.