Microsoft Holo Lens (AR)

JOHN MICHAEL O. GONZALES

BSCS 4-1N
Advanced Topics in Computer Science

Microsoft Holo Lens

Page 1 |
9

AUGMENTED REALITY
Augmented reality (AR) is a live direct or indirect view of a physical, real-world
environment whose elements are augmented (or supplemented) by computergenerated sensory input such as sound, video, graphics or GPS data. It is related to
a more general concept called mediated reality, in which a view of reality is
modified (possibly even diminished rather than augmented) by a computer. As a
result, the technology functions by enhancing ones current perception of reality.
By contrast, virtual reality replaces the real world with a simulated one.
Augmentation is conventionally in real-time and in semantic context with
environmental elements, such as sports scores on TV during a match. With the
help of advanced AR technology (e.g. adding computer vision and object
recognition) the information about the surrounding real world of the user becomes
interactive and digitally manipulable. Information about the environment and its
objects is overlaid on the real world. This information can be virtual or real, e.g.
seeing other real sensed or measured information such as electromagnetic radio
waves overlaid in exact alignment with where they actually are in space.

WHAT IS MICROSOFT HOLO LENS?

Is it an Oculus Rift or HTC Vive rival? Does it have more in common with the
discontinued Google Glass?
HoloLens is essentially a holographic computer built into a headset
that lets you see, hear and interact with holograms within an environment
such as a living room or an office space.
Microsoft HoloLens is the first fully untethered, holographic computer, enabling
high-definition holograms to integrate with your world. The premier device for
Windows Holographic, Microsoft HoloLens is a smart-glass headset that is a
cordless, self-contained Windows 10 computer. It uses advanced sensors, a highdefinition stereoscopic 3D optical head-mounted display, and spatial sound to allow
for augmented reality applications, with a natural user interface that the user
interacts with through gaze, voice, and hand gestures.
Windows Holographic is a "mixed reality" computing platform, enabling
applications in which the live presentation of physical real-world elements is
incorporated with that of virtual elements (referred to as "holograms" by Microsoft
such that they are perceived to exist together in a shared environment. A variant of
Windows for augmented reality computers (which augment a real-world physical

Microsoft Holo Lens

Page 2 |
9

environment with virtual elements) Windows Holographic features an augmentedreality operating environment in which any Universal Windows App can run. In
addition, with Holographic APIs, which are part of the Universal Windows Platform,
and supported as standard in Windows 10 (including versions for mobile devices
and Xbox One), mixed reality features can be readily implemented in any Universal
Windows App, for a wide range of Windows 10-based devices.

KNOW MORE ABOUT MICROSOFT HOLO LENS

HISTORY
HoloLens had been in development for five years before its announcement in
2015, but was conceived earlier as the original pitch made in late 2007 for what
would become the Kinect technology platform.
Microsoft said that this project is a secret. No one knows about that it has being
developed.

HOW IT FEELS LIKE TO WEAR THE HOLO LENS?

As a HoloLens wearer, you'll still see the real world in front of you. You can walk
around
and talk to others without worrying about bumping
into
walls. The goggles will track your movements, watch
your
gaze and transform what you see by blasting light at
your
eyes (it doesn't hurt). Because the device tracks where
you
are, you can use hand gestures -- right now it's only a midair click
by
raising and lowering your finger -- to interact with the 3D
images.
There's a whole bunch of other hardware that's designed
to help
the HoloLens' effects feel believable. The device has a
plethora of
sensors to sense your movements in a room and it uses
this
information along with layers of colored glass to create images
you
can
interact with or investigate from different angles. Want to see
the back
of a virtual bike in the middle of your kitchen? Just walk to
the other
side of it.
The
goggles also have a camera that looks at the room, so the HoloLens
knows where tables, chairs and other objects are. It then uses that information to
project 3D images on top of and even inside them - place virtual dynamite on your
desk and you might blow a hole to see what's inside.
Microsoft has revealed its HoloLens virtual reality headset will only work for five
and a half hours with light use or a rather paltry two and a half hours for intensive
users. The vision seen through HoloLens is comparable to having a 15-inch screen

Microsoft Holo Lens

Page 3 |
9

two feet in front of the face. The reason Microsoft chose to have a virtual screen this
size was to preserve battery life and drive down costs. Microsoft HoloLens' device
link, which enables the user to hook up two devices together to share an
experience, allowing multiple users to see the same thing in exactly the same way
at the same time.
This sharing can happen over the internet rather than in the same room, making
it useful for applications such as product development where two people may need
to view an object at the same time, despite being on opposite sides of the world.

WHAT'S POWERING THE HOLO LENS?

Under the hood, Microsoft has packed the HoloLens with a series of sensors,
along with a high-end CPU and GPU, although it has yet to talk specifics about the
chipset architecture. All we know is that Microsoft has created custom-built silicon
and a holographic chip to power its augmented reality headset.
To create an intuitive interaction with holograms, the HoloLens also includes a
Holographic Processing Unit (HPU) to smoothly process real-time data captured by
the on-board sensors. Microsoft revealed that it worked closely with NASA to help
bring the headset to life.

Sensors

Among the sensor types used in HoloLens is an energy-efficient depth

camera with a 120120 angle of view, a microphone array, a
photographic video camera, and an inertial measurement unit (IMU).
The inertial measurement unit includes an accelerometer, gyroscope,
and a magnetometer.

Hologram Processing Unit

Microsoft Holo Lens

Page 4 |
9

In addition to a high-end CPU and GPU, HoloLens features a

holographic processing unit (HPU), a custom coprocessor by Microsoft.
The HPU processes and integrates data from the sensorshandling
tasks such as spatial mapping, gesture recognition, and voice and
speech recognition. According to HoloLens chief inventor Alex Kipman,
the HPU processes "terabytes of information" from the HoloLens's
sensors in real time.

Optics

The visor front is tinted; enclosed in the visor piece is a pair of

transparent combiner lenses, in which the projected images are
displayed in the lower half. The HoloLens must be calibrated to the
interpupillary distance (IPD) of the individual user.

Microsoft Holo Lens

Page 5 |
9

Speakers

Along the bottom edges of the side arms by wearer's ears are a pair of
small red stereo speakers. As opposed to headphones, the speakers do
not obstruct external sound, allowing the user to hear virtual sounds
together with the real-world environment. Using scientific models of
human sound localization, the HoloLens generates binaural audio,
which can simulate spatial effects, such that the user can perceive a
sound as coming from a specific location.

Vents

Vent

The device is more powerful than a laptop but wont overheat-warm air
flows to the sides, where it vents up and out.

Microsoft Holo Lens

Page 6 |
9

DEVELOPMENT
Microsoft announced Windows Holographic at its "Windows 10: The Next
Chapter" press event on January 21, 2015. It is set to be introduced through the
smart glasses headset Microsoft HoloLens, as part of the general rollout of Windows
10. The Windows 10 launch began July 29, 2015 with release of the PC version, with
the Microsoft HoloLens Development Edition to be released in the first quarter of
2016.
Develop holographic apps. All holographic apps are Universal Windows apps, and all
Universal Windows apps can be made to run on Microsoft HoloLens. The good news
is that Windows 10 universal apps, like the suite of Office apps, Outlook and the new
Photos app, will work with the HoloLens. Additionally, Windows 10 will include the
APIs to enable developers to create holograms. So there's the potential there for
those who have created apps for other augmented-reality devices like Google Glass,
or virtual-reality headsets like the Oculus Rift, to make holographic experiences for
Microsoft's headset.

FEATURES AND APPLICATIONS

Microsoft Holo lens lets you Go beyond the screen. Shape holograms to finetune a design. Interact with them to learn something new. When you share ideas,
show and tell from multiple perspectives. Microsoft HoloLens enables you to make
decisions more confidently, work more effectively, and bring ideas to life before
your eyes.

Your world as a canvas.

o Microsoft HoloLens intelligently maps your room, mixing holograms
with the environment around you. Pin holograms in physical locations

Microsoft Holo Lens

Page 7 |
9

as easily as you would place a physical object in a room. Interact with

holograms and everyday objects together.
A more natural way to interact.
o There isnt a screen to touch or a mouse to click. Create and shape
holograms with gestures. Communicate with apps using your voice.
Navigate with a glance. Microsoft HoloLens understands your gestures,
gaze, and voice, enabling you to interact in the most natural way
possible.
Connect, create, and explore like never before.
o Transform the ways you communicate, create, collaborate, and
explore. Your ideas are one step closer to becoming real when you can
use holograms to show your designs, collaborate remotely, and learn
new things in relation to the real world.
New ways to teach and learn.
o Its easier to show than to tell. With HoloNotes in Skype, friends and
colleagues can help you with difficult tasks. They can see your
environment as you see it and from their tablet or PC they can draw
instructions that appear as holograms in your world. Get real-time help
from someone who sees what you see.
New ways to create what you imagine.
o Create your own holograms and share them with others. Use
holograms to visualize how something will look in the physical world
whether its a new piece of furniture in your home, a toy for your kids,
or a new creation for work. HoloStudio will even let you turn your
holograms into physical objects with 3D print compatibility.
New ways to visualize your work.
o Go beyond what a 2D render can do by working in three dimensions.
Pin holograms to physical objects so you can size and scale them in
real time. Make smarter decisions when you see your work from every
angle, in relation to the world around you.
New ways to collaborate and explore.
o Go somewhere youve never been and examine it from every angle.
See holograms from your colleagues perspective if hes in the next
room or on the other side of the world. Explore a new dimension
grounded in, but not limited to, the physical world.
A new way to see your world.
o Transparent lenses and no wires let you interact freely with holograms
without losing sight of your world.

REFERENCES
[1] https://www.microsoft.com/microsoft-hololens/en-us
[2] http://www.cnet.com/news/microsoft-hololens-explained-how-it-works-and-whyits-different/

Microsoft Holo Lens

Page 8 |
9

[3] http://www.techradar.com/news/wearables/everything-you-need-to-know-aboutmicrosoft-hololens-1306850
[4] https://en.wikipedia.org/wiki/Windows_Holographic
[5] http://www.trustedreviews.com/opinions/hololens-release-date-news-and-price

Microsoft Holo Lens

Page 9 |
9