SixthSense

From Wikipedia, the free encyclopedia

This article is about the gestural interface device. For the reporting product by YouGov, see YouGov#sixthsense.

SixthSense is a wearable gestural interface device developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT Media Lab. It is similar to Telepointer, a neckworn projector/camera system developed by Media Lab student Steve Mann[1] (which Mann originally referred to as "Synthetic Synesthesia of the Sixth Sense").[2]
Contents
[hide]

1 Construction and workings

2 Example applications

3 Cost and license

4 Current status

5 References

6 External links

[edit]Construction

and workings

The SixthSense prototype comprises a pocket projector, a mirror and a camera contained in a pendant like, wearable device. Both the projector and the camera are connected to amobile computing device in the users pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user's hand gestures and physical objects using computer-vision based techniques.[3] The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tips of the users fingers. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. SixthSense supports multi-touch and multi-user interaction. [edit]Example

applications

This section does not cite any references or sources. Please help improve this section by adding citations to reliable sources. Unsourced material may be challenged and removed. (August 2010)

The SixthSense prototype contains a number of demonstration applications.

The map application lets the user navigate a map displayed on a nearby surface using hand gestures to zoom and pan

The drawing application lets the user draw on any surface by tracking the fingertip movements of the users index finger.

SixthSense also implements Augmented reality; projecting information onto objects the user interacts with.

The system recognizes a user's freehand gestures as well as icons/symbols drawn in the air with the index finger, for example:

A 'framing' gesture takes a picture of the scene. The user can stop by any surface or wall and flick through the photos he/she has taken. Drawing a magnifying glass symbol takes the user to the map application while an @ symbol lets the user check his mail. The gesture of drawing a circle on the users wrist projects an analog watch.

[edit]Cost

and license

SixthSense prototypes cost approximately $350 to build (not including the computer),[4][5][6] the main cost being the micro-projector. The source code will be released under Open Source[7] [edit]Current

status

Despite declarations, no software which references project named SixthSense has been released till date (June 2011) neither under open source license, nor under proprietary one. [edit]References

1.

^ "Telepointer: Hands-Free Completely Self Contained Wearable Visual Augmented Reality without Headwear and without any Infrastructural Reliance", IEEE International Symposium on Wearable Computing (ISWC00), pp. 177, 2000, Los Alamitos, CA, USA

2.

^ "Cyborg: Digital Destiny and Human Possibility in the Age of the Wearable Computer", Steve Mann with Hal Niedzviecki, ISBN 0385658257 (Hardcover), Random House Inc, 304 pages, 2001.

3. 4. 5. 6. 7.
[edit]External

^ Intelligent Image Processing, John Wiley and Sons, 384pp, 02001NOV02, ISBN 0-471-40637-6

^ sixthsense. Pranav Mistry.

^ CNet News: MIT's 6th Sense device could trump Apple's multitouch

^ New York Times - At TED, Virtual Worlds Collide With Reality

^ http://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technology.html TED Talks - Pranav Mistry: The thrilling potential of SixthSense technology

links

Pranav Mistry's personal site

Pranav Mistry at TED Conferences Pattie Maes at TED Conferences

Categories: Virtual reality | Graphical user interfaces | Surface computing

Log in / create account

Article Discussion Read Edit View history

Top of Form

Bottom of Form

Main page Contents Featured content Current events Random article Donate to Wikipedia Interaction Help About Wikipedia Community portal Recent changes Contact Wikipedia

Toolbox Print/export Languages

Catal Franais Bahasa Indonesia

This page was last modified on 21 July 2011 at 09:56. Text is available under the Creative Commons Attribution-ShareAlike License; additional terms may apply. See Terms of use for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a non-profit organization.

Contact us

Privacy policy

About Wikipedia

Disclaimers