Building Next Generation

Digital Media Devices

Guest:

Kiran Injeti
Consultant
Applications Services Group
MontaVista Software

Moderator: Don Dingee, OpenSystems Media

 Agenda

Quick tour of viewer tools

A few topical thoughts
Our guest presentation
Your questions answered
 Opening up devices
• What do devices need today?
– Outstanding user interface
– Strong networking stacks
– High perf media playback
– Fast, expandable storage
– Multicore, multithreading
– App development ecosystem

• Linux fits both technically, economically

Building Next Generation Digital Media Devices
Agenda

• Digital Media Market Overview

• Challenges & the Need for a Software Framework

• Introducing iSense®

• What does the Future Hold?

• Q&A

MontaVista © 2010
Digital Media : Market Overview

Digital Home Entertainment

• DTV/STB/IPTV/IPSTB
• Digital Media Adapters, Residential Gateways,
Digital Photo-Frames, Universal Remotes, Hard-
Disk Recorders, BluRay players etc.

Mobile Entertainment
• Mobile A/V Players,
• In-vehicle information devices, PNDs &
other location based devices
• Portable TVs

Information and others

• Digital Signage & Kiosks
• IP-Surveillance
• Hospitality / Hotel & Medical Display devices

MontaVista © 2010 2
The Digital Home Today

•Devices continue to get more intelligent

•Consumers expect seamless interaction
•Ex: DLNA streaming of video to hi-def TV or Blu-ray players
•New home entertainment devices continue to appear
•Ex: Wi-fi enabled home surveillance cameras

MontaVista © 2010 3
Challenges

• Long Product Development Time

• To make a simple Digital TV Set-top Box from scratch, one
would need 12-18 months
• Longer product cycle leads to delayed time to Market

• User Friendliness
• Simple UI and easy to operate input devices are the key to user
friendliness
• UI should provide very quick user response

• Hardware Platform Dependency

• More features means “heavier” software
• Peripheral devices on two different platforms might behave
differently
• Software needs to understand the hardware for efficient usage
• Software capability can be limited by hardware
MontaVista © 2010 4
Challenges

• Tailoring a product to different market segments

• Need to expose cost/quality based variants
• Localization specific changes need to be incorporated like local
language support
• These variants need to created with minimal effort and time

• Software licensing
• Third party licensing costs affect product cost
• Open-source is good but not always easy to commercialize

• Unique products sell better

• There are far too many “standard” devices in the market to
compete with
• You have to keep innovating and adding new features to
survive and differentiate

MontaVista © 2010 5
Need for a Digital Media Software Framework

• Why do we need a digital media software framework?

• A software framework solves many of the challenges we just
discussed.
• A framework is like a “Product Function Template”
• Pick & choose Functions only what you need
A B C

D E F
B,C,E A,B,C,F

A,D,F

• The result? No need to re-invent the wheel!

• Customize, Commercialize, Release!
MontaVista © 2010 6
What is iSense?

“iSense”
• It’s an Application Platform for Digital AV Home Appliances
• It provides a highly configurable set of pre-validated middleware
components that reduce development time
• Includes ready support for multiple Digital Media platforms
• Delivered by an experienced services team with domain expertise

Home Server STB

STB for Cable Blu-ray recorder
IP-STB

Portable Navigation System

HD-TV
HDD recorder

Digital audio Player

Portable AV Player
Digital Signage

MontaVista © 2010 7
Why iSense?

• iSense reduces time to market!

Zero- 1.5 5.5 8 15 over18

month month month month month month
Using iSense

Spec Development Verificati

review
(1.5) (4.0) on (2.5)

Without iSense

Spec Development Verifi-

review cation
(1.5) (13.5) (3.0)

※The above is an example pertains to development of a DTV Set-Top Box with PVR. Actual period may differ
according to requirements.
※The showing data of “Without iSense” is an in-house comparison

MontaVista © 2010
 iSense: Digital Media Software Framework

• iSense offers a complete graphics, video &

entertainment middleware framework for
Digital Media Devices

Application for
Digital Media appliances Software image for Scratch Development case

Application for Digital Media appliances

（User Interface and others）
iSense
Middleware controlling software
・Middleware （AV Player, IP Player, Browser control, Settings, Controller）
・Controlling software for Middleware
・Hardware Control Middleware
（AV decode, Protocols, Browser library, DLNA library
* Most Digital Media Software required etc.）
are integrated already.
Hardware Control

Operating System Operating System

Hardware Platform Hardware Platform

MontaVista © 2010
iSense Architecture in Detail

TV Application EPG Application Multimedia and PVR Application Configuration

Web Applications Application Applications

Application Resource Communication Application Service

Management Management Management Toolkit Management Application
Manager

Media Service Web-Enabled DLNA Service UI Service Service

Recording Control DTV Control Services DMS
HTML Layer
DMP Third Party
DTV Stack DVB DTV Stack ISDB Browser Service UI Service
IPTV Client VOD Client YouTube Client Protocol Stack
File Celestial
RF Tuner BML UPnP UI Service
Streaming Core Playback Flickr Client SOAP
RTP, FEC, RTSP, HTTP Service Browser
Service GENA
SDP, RTCP Twitter Client SSDP

OS Adaptation Hardware Adaptation I/O Graphics Database

Adaptation Adaptation Adaptation
Adaptation
POSIX Utility Decoder Tuner IC-Card Storage Network Events
2D Engine Linter
Layer
Interface Features Adaptation Adaptation Adaptation Adaptation Adaptation Front Panel
GTK SQLite
IR Remote

OS Standard Libraries Graphics Sub-system A/V Decoder, I/O Sub-system

(Linux Kernel 2.6) Security Controller and Peripherals
Platform
And Drivers and Media Libraries Layer

MontaVista © 2010
Why use iSense?
• Conventional Approach -
Develop from Scratch
• Broadcasting standards are very
complex
• Needs good understanding to
define a product specification
• Study and Implementation phase
is very time consuming and high
risk
• Conventional Approach with
Third Party Library Integration
• Each variant comes with unique
Interfaces, processing models
• Difficult to integrate with rest of
the product software
• Functionality extension is difficult
MontaVista © 2010
• iSense Approach
• Core digital media functionality
available in pre-tested, standard
compliant form
• Configurable functional
specification, shorter
development cycle
• Layer based architecture, quick
porting to new platforms
• Multi-process architecture for
platform stability
• Well defined software debug
support, smaller issue fixing
cycle
• Simultaneously available on
multiple hardware platforms
iSense Features

• Live TV
• DTV Broadcast standards support (Record/Playback)
• ISDB* / ARIB – Digital Terrestrial, BS / CS, Satellite
• DVB* (C/S/T)
• IP Multicast / IP Broadcasting (Record/Playback)

MontaVista © 2010
iSense Features

• PVR (Recording and Playback of LiveTV)

• Complies with DTV Broadcast standards support
• ISDB* / ARIB – Digital Terrestrial, BS / CS, Satellite
• DVB* (C/S/T)
• Supports encryption before storage (for data security)
• Smooth trick play on recorded content
• can support Time-shift recording as well.

MontaVista © 2010
iSense Features

• Media Playback
• VOD Playback
• Support for both VOD-HTTP, VOD-RTSP
• Storage Media playback
• Support for various audio/video formats
• Smooth trick play
• HTTP Download and Playback
• Network Media using uPnP/DLNA Playback
• DLNA Specifications for media sharing (DMS, DMP etc.)

MontaVista © 2010
iSense Features

• Web based features

• Flickr Photo Viewer
• Youtube Video Player
• Twitter client
• Web Browser

MontaVista © 2010
Developing a DTV-Set Top Box using iSense

TV Application EPG Application Multimedia PVR Application Configuration

and Web Applications Application
Applications

Application Resource Communication Application Service

Management Management Management Toolkit Management Application
Manager

Media Service Web-Enabled DLNA Service UI Service

Services Service
Recording Control DTV Control DMS Layer
HTML Browser Service Third Party
DTV Stack DVB DTV Stack ISDB DMP Service

IPTV Client VOD Client YouTube Client Protocol Stack Celestial

File UPnP UI Service
Streaming Core RF Tuner BML Flickr Client
Playback SOAP
Service Browser GENA
RTP, FEC, RTSP, HTTP Service
SDP, RTCP Twitter Client SSDP

OS Adaptation Hardware Adaptation I/O Graphics Database

Adaptation Adaptation Adaptation Adaptation
POSIX Utility Decoder Tuner IC-Card Storage Network Events Layer
2D Engine Linter
Interface Features Adaptation Adaptation Adaptation Adaptation Adaptation Front Panel
GTK SQLite
IR Remote

MontaVista © 2010
Developing a IP-Set Top Box using iSense

TV Application EPG Application Multimedia and PVR Application Configuration

Web Applications Application Applications

Application Resource Communication Application Service

Management Management Management Toolkit Management Application
Manager

Media Service Web-Enabled DLNA Service UI Service

Services
Service
Recording Control DTV Control DMS Layer
HTML Browser Third Party
DTV Stack DVB DTV Stack ISDB DMP UI Service

IPTV Client VOD Client YouTube Client Protocol Stack Celestial

File UPnP UI Service
Streaming Core RF Tuner BML Flickr Client
Playback SOAP
Service Browser GENA
RTP, FEC, RTSP, HTTP Service
SDP, RTCP Twitter Client SSDP

OS Adaptation Hardware Adaptation I/O Graphics Database

Adaptation Adaptation Adaptation Adaptation
POSIX Utility Decoder TunerIC-Card Adaptation
Storage Network Events Layer
2D Engine Linter
Interface Features Adaptation Adaptation Adaptation Adaptation Front Panel
GTK SQLite
IR Remote

MontaVista © 2010
Developing a Digital Media Player using iSense

TV Application EPG Application Multimedia and Media Player UI Configuration

Web Applications Player Application Application Applications
Media Catalog

Application Resource Communication Application Service

Management Management Management Toolkit Management Application
Manager

Media Service Web-Enabled DLNA Service UI Service

Services
Service
Recording Control DTV Control DMS Layer
HTML Browser
DTV Stack DVB DTV Stack ISDB Service DMP Third Party
UI Service
IPTV Client VOD Client YouTube Client Protocol Stack
File UPnP Celestial
Streaming Core RF Tuner BML Flickr Client UI Service
Playback SOAP
Service Browser GENA
RTP, FEC, RTSP, HTTP Service
SDP, RTCP Twitter Client SSDP

OS Adaptation Hardware Adaptation I/O Graphics Database

Adaptation Adaptation Adaptation Adaptation
POSIX Utility Decoder Tuner IC-Card Storage Network Events Layer
2D Engine Linter
Interface Features Adaptation Adaptation Adaptation Adaptation Adaptation Front Panel
GTK SQLite
IR Remote

MontaVista © 2010
Developing a Home Media Server using iSense

TV Application EPG Application Multimedia and Portal Application Configuration

Web Applications HTML UI Application Applications
Network Access

Application Resource Communication Application Service

Management Management Management Toolkit Management Application
Manager

Media Service Web-Enabled DLNA Service UI Service Service

Services DMS
Recording Control DTV Control Layer
HTML Browser Third Party
DTV Stack DVB DTV Stack ISDB Service DMP
UI Service
IPTV Client VOD Client YouTube Client Protocol Stack
Celestial
File PlaybackRF Tuner BML UPnP UI Service
Streaming Core Flickr Client SOAP
RTP, FEC, RTSP, HTTP Service Service Browser GENA
SDP, RTCP Twitter Client SSDP

OS Adaptation Hardware Adaptation I/O Graphics Database

Adaptation Adaptation Adaptation
Adaptation
POSIX Utility Decoder Tuner IC-Card Storage Network Events
2D Engine Linter
Layer
Interface Features Adaptation Adaptation Adaptation Adaptation Adaptation Front Panel
GTK SQLite
IR Remote

MontaVista © 2010
CELUI: Powerful UI Engine

MontaVista © 2010 20
CELUI: Powerful UI Engine

• CELUI (graphics sub-system)

• GUI Development Toolkit
• Highly portable across platforms
• Layouts & Themes ready (Fast & customizable)
• Very fast engine with little memory requirement. Created for HD
(Native Full-HD)
• Interfaces are iSense friendly
• Highly customizable features
• Designed for embedded devices with rich multimedia
capability offering
• Widget Toolkit: Power to create a variety of widgets
• Templates and Dialogs: Faster Application Development
• Event Manager: Fast User response
• Locale Manager: Support for various languages
• Themes Manager: Comes with Pre-defined graphic layouts
• Resource Manager: Better Run time Performance
MontaVista © 2010 21
iSense Web-Browsers

• iSense Web-browser (HTML/Webkit Browser) for Digital

Media Devices
• Target Platforms: Intel CE3100/CE4100 & Sigma SD8654
• Web page browsing with HTML 5.0
• Webkit engine used as the base
• Support for both HD/SD resolution
• User Input using Remote control, USB/On-Screen Keyboard
• VOD on Walled-Garden network hosting with embedded
iSense player
• iSense BML-browser for Set Top Box
• BML Browser will support browsing of web pages provided by
broadcast while watching live TV
• Fully compatible with Japanese Broadcast standards
• Target Platforms: Intel CE3100/CE4100
• Webkit engine used as the base
• User Input using Remote control
MontaVista © 2010 22
CEL-DLNA: Home Networking Enhanced

• CEL-DLNA to fully comply with the DLNA Specifications

defined by DLNA Org.
• DLNA Stack to consist of following profiles:
• DMS – Digital Media Server
• Enables a device to share content over a connected network
• Typically, can be found in Digital Media Players/IP-Set top Boxes/
Network routers
• Typically files stored in a USB Memory/internal hard-disk
• DMP – Digital Media Player
• Typically should playback content shared by a DMS
• Audio/Video formats to be supported as per DLNA Specifications
• Supported in Digital Media Players/Adapters, HD TVs, Gaming
consoles
• DMC – Digital Media Controller
• DMC is typically a DMP without Rendering. Can receive,
understand the content from DMS and provide it to a external
rendering device like TV
MontaVista © 2010 23
Future of Digital Media in Home Entertainment

• Video conferencing at Home

• People would use home setup
for distant communication
• Hence these devices should
process real time data at high
speeds (imagine a video
conference with 4-5 members
logged in at different locations)
• Wireless devices to rule
• Networking media devices
could turn wireless
• This would mean digital
consumer devices need to
migrate, and ensure same
quality levels are met on a
wireless scenario
• What’s next?
MontaVista © 2010
 Questions & Answers

Guest:

Kiran Injeti
Consultant
Application Services Group
MontaVista Software
Thanks for joining us

Event archive available at:

http://ecast.opensystemsmedia.com/

E-mail us at: clong@opensystemsmedia.com