SIXTH SENSE TECHNOLOGY

Click to edit Master subtitle style

3/22/12

11

SIXTH SENSE TECHNOLOGY

Guided By Prof. Pokale M. S. Presented By Kshama S. Jirage Sujata S. Kattimani Maitreyee G. Tambe Ravindra Kadam

3/22/12

22

CONTENTS

Introduction Components Concepts Technology Behind Sixth Sense. How It Works? Applications Computer Vision and its methods for processing Estimation Advantages Conclusion And Future Scope References
33

3/22/12

INTRODUCTION
Sixth Sense is a wearable gestural interface device that augments the physical world with digital information without use of keyboard and mouse.

3/22/12

44

Developed by Pranav Mistry.

Bridges the gap by bringing intangible, digital information out into the tangible world.

To connect with internet seamlessly. Speech IC

Analog data is converted into digital and performed as action.

3/22/12

55

3/22/12

66

COMPONENTS

A pocket projector A mirror A camera Mobile component Colored markers

77

3/22/12

CONCEP TS Active zone.

Gestures Gesture recognition Computer vision Speech Recognition Speech IC store commands Remote computer

3/22/12

88

TECHNOLOGY BEHIND SIXTH SENSE

Software Setup Hardware Setup. Events & Gestures. System Architecture.
3/22/12 99

SOFTWARE SETUP
Implemented using JAVA 2 MICRO edition. Computer vision library is written in symbian c+ +(used in Gesture tracking). Prototype is developed on a Microsoft Windows platform using C#, WPF and open CV.

3/22/12

1010

The software recognizes there kinds of gestures:

MULTI-TOUCH GESTURES FREEHAND GESTURES ICONIC GESTURES

3/22/12

1111

Events and gestures

detected using colored markers.

can zoom in or out.

can draw on any surfaces.

supports freehand gestures (postures).

3/22/12

1212

3/22/12

1313

HARDWARE SETUP
Camer a

1.3 megapixel sensor Provides natural and realistic images

Allows more natural conversations with the built-in microphone or included headset

Ultra-wide field of view

1414

3/22/12

Project or

We can either use L.E.D or Laser projectors

Laser

AAXA Microvision 3MMPro110

L.E.D

3/22/12

Projection Image 10 to 50 inches Life 15,000 hours 0.5 Watt Mono Speaker Aspect Ratio Control: 4.3 Supports MP4/MPG/3GP/AVI/JPG/TXT Composite A/V Input

AAXA Projector

3/22/12

Microvision Projector

Image is always in focus.

Rich and vivid laser colors which amplify up to 200 inches.

High resolution (WVGA 848x480), Widescreen (16:9) aspect ratio.

Lightweight (4oz) and slim (14mm). Plug-n-play operation Single charge (up to 2-3 hours).

3/22/12

Mirro r

Manually can change the tilt of the mirror to change the location of the projection.

Overcome the limitation of the limited projection space of the projector.

Suggested Product: Any 1X1 surface mirror

3/22/12

Smart Phone

The software program runs on this computing device.

The camera, the projector and the microphone are connected to this device using wired or wireless connection.

3/22/12

Connected to the Internet via 3G network or wireless connection.

Color Markers

Tip of the users fingers . Helps the webcam recognize gestures .

The movements and arrangements of these markers are interpreted into gestures.

3/22/12

SPEECH IC

The actions are converted to commands and are trained to a speech IC. Storage as a database in the integrated circuit and corresponding actions are performed.

3/22/12

MICROPHONE

When the user wants to use a sheet of paper as an interactive surface, he or she clips the microphone to the paper. The microphone attached this way captures the sound signals of users touching the paper. Here, the sound signal captured by the microphone provides time information whereas the camera performs tracking.

3/22/12

3/22/12

2323

How it works..???
Send for processin g captu re Images Pictures Gestures Comman ds

Send Info Informa t-ion on Reflect on surface

3/22/12

Project

desired 2424 surface

applications

Click Images

3/22/12

2525

Call up a map

3/22/12

2626

Portable Mobile

3/22/12

2727

Rate the Books

3/22/12

2828

Video Annotation On Newspaper

3/22/12

2929

Flight/Ticket Status

3/22/12

3030

Real Time Clock

3/22/12

3131

Browsing Net

3/22/12

3232

Drawing Application

3/22/12

3333

Zooming Features

3/22/12

3434

Feed Information On People

3/22/12

3535

CompUTER Computer Vision: Definition VISION

Examples Tasks Of Computer Vision

Recognition: 1. Object recognition 2. Content-Based image retrieval 3. Pose Estimation Motion Analysis: 1. Ego motion 2. Tracking 3. Optical Flow
.

Scene Reconstruction Image Restoration

3/22/12

Computer vision System Methods

Image Acquisition Pre-processing Feature Extraction Detection/segmentation High -level processing Decision Making

3/22/12

ESTIMATION
The current prototype system costs approximately $350 to build, mainly due to the micro-projector. The software may be available for free on the model of open and editable freeware.

3/22/12

3838

ADVANTAGES

Portable Supports multi touch and multi-user interaction

Connectedness between world and information

Cost effective Data access directly from machine in real time

3/22/12

It is open source

3939

FUTURE SCOPE

Interactive Advertisements. 3d visualizations. Solar batteries via small solar panel. Camera can act as a third eye for the blind person

According to researchers, after 10 years we will be here with the ultimate sixth-sense brain implant.

3/22/12

4040

CONCLUSION
Sixth Sense recognizes the objects , displaying information automatically and to access it anywhere needed. The Sixth Sense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system. Allowing to interact with this information via natural hand gestures with speech recognition. The potential of becoming the ultimate "transparent" user interface for accessing information about everything . 4141

3/22/12

RefereNces
1. www.blendernation.com/sixth-sensetechnology/ 2. http://boingboing.net/2009/11/12/sixthsense-technolo.html 3. http://gizmodo.com/5167790/sixth-sensetechnology-may-change-how-we-lookat-theworld-forever 4. http://theviewspaper.net/sixth-sensetechnology-will-revolutionize-the-world/ 5.http://lucasrichter.wordpress.com/2009/03/13/ pattie-maes-sixth-sensetechnology-whatsstopping-this/ 6.http://www.pranavmistry.com 7.http://www.TED.com
3/22/12 4242

Thank You
3/22/12 4343

Questio ns
3/22/12 4444