Difference between revisions of "Microsoft HoloLens"

From Virtual Reality, Augmented Reality Wiki
Jump to: navigation, search
(Hardware)
 
(23 intermediate revisions by 4 users not shown)
Line 4: Line 4:
 
|Type=[[Optical head-mounted display]]
 
|Type=[[Optical head-mounted display]]
 
|Subtype=[[Integrated HMD]]
 
|Subtype=[[Integrated HMD]]
|Platform=[[Windows Holographic]]
+
|Platform=[[Windows Mixed Reality]]
 
|Creator=[[Alex Kipman]]
 
|Creator=[[Alex Kipman]]
 
|Developer=[[Microsoft]]
 
|Developer=[[Microsoft]]
Line 13: Line 13:
 
|Predecessor=None
 
|Predecessor=None
 
|Successor=[[Microsoft HoloLens 2]]
 
|Successor=[[Microsoft HoloLens 2]]
|CPU=Intel Cherry Trail Atom
+
|CPU=Intel 32 bit architecture
|GPU=Intel Cherry Trail Atom
+
|GPU=
|HPU=Holographic processing unit
+
|HPU=[[Holographic processing unit]]
 
|Memory=2 GB
 
|Memory=2 GB
|Storage=64 GB
+
|Storage=64 GB Flash
|Display=
+
|Display=2 HD 16:9 light engines
|Resolution=
+
|Resolution=Holographic resolution: 2.3M total light points
|Pixel Density=
+
|Pixel Density=Holographic density: over 2.5k radiants (light points per radian)
|Refresh Rate=
+
|Refresh Rate=240Hz (60Hz content rate, each frame consists of four sequential colors: R-G-B-G)
|Persistence=
+
|Persistence=2.5ms
 
|Precision=
 
|Precision=
 
|Field of View=30°H and 17.5°V
 
|Field of View=30°H and 17.5°V
|Optics=??
+
|Optics=See-through holographic lenses (waveguides)
 
|Tracking=6DOF
 
|Tracking=6DOF
|Rotational Tracking=IMUs
+
|Rotational Tracking=[[Gyroscope]], [[Magnetometer]], [[Accelerometer]]
|Positional Tracking=Depth Camera with 120°×120° FOV
+
|Positional Tracking=Depth Camera with 120°×120° FOV, 4 greyscale cameras
 
|Update Rate=
 
|Update Rate=
|Latency=
+
|Latency=Motion to Photon: less than 2ms
|Audio=Spatial Sound
+
|Audio=Built-in speakers, Audio 3.5mm jack
|Camera=2MP photo / HD video camera, depth camera
+
|Camera=2MP photo / HD video camera, depth camera, 4 greyscale cameras
|Sensors=ambient light sensor, 4 environment sensing cameras, array of 4 microphones
+
|Sensors=ambient light sensor, array of 4 microphones
|Input=Gaze, Gesture, Voice, HoloLens Clicker, Keyboard
+
|Input=Gaze, Gesture, Voice, HoloLens Clicker, Keyboard, Mouse
 
|Connectivity=WiFi, Bluetooth
 
|Connectivity=WiFi, Bluetooth
 
|Power=Battery (2.5 to 5.5 hours per charge)
 
|Power=Battery (2.5 to 5.5 hours per charge)
Line 44: Line 44:
 
|Website=[http://www.microsoft.com/microsoft-hololens/en-us Microsoft HoloLens]
 
|Website=[http://www.microsoft.com/microsoft-hololens/en-us Microsoft HoloLens]
 
}}
 
}}
[[Microsoft HoloLens]] is a [[Augmented Reality]] [[device]] developed by [[Microsoft]]. It is part of the [[Windows Holographic]] [[AR Platform]] incorporated with [[Windows 10]] OS. Similar to other [[OHMD]]s, HoloLens is a see through display worn over your eyes. Unlike [[Oculus Rift]] and [[Virtual Reality#Devices|VR Devices]], the eye-piece component of HoloLens is transparent and the headset requires neither PC nor smartphone. It is able to project high-definition virtual content or [[hologram]]s over real world objects.
+
==Introduction==
 +
[[Microsoft HoloLens]] is an [[Augmented Reality]] [[device]] developed by [[Microsoft]]. It is part of the [[Windows Mixed Reality]] [[AR Platform]] incorporated with [[Windows 10]] OS. Similar to other [[OHMD]]s (optical head-mounted displays), HoloLens is a see-through display worn over your eyes. Unlike the [[Oculus Rift]] and other [[Virtual Reality#Devices|VR Devices]], the eye-piece component of HoloLens is transparent and the headset requires neither PC nor smartphone. It is able to project high-definition (HD) virtual content or [[hologram]]s over real world objects. <ref name=”one”>Microsoft. Microsoft HoloLens. Retrieved from https://www.microsoft.com/en-us/hololens</ref> <ref name=”two”>Microsoft. Why HoloLens. Retrieved from https://www.microsoft.com/en-us/hololens/why-hololens</ref>
 +
__TOC__
 +
==General Information==
 +
Microsoft HoloLens runs a self-contained Windows 10 computer.  It features an HD 3D optical head-mounted display, spatial sound projection and advanced sensors to allow its users to interact with AR applications through head movements, [[#Gesture|gestures]] and [[#Voice|voices]]. Microsoft has said that “The key to a great holographic experience is holograms that are light point rich, i.e. have a high holographic density, and are pinned or anchored to the world around you. To achieve this, HoloLens has been designed for optimal holographic density of 2.5K radiants. The more radiants and light points there are, the brighter and richer the holograms become.” <ref name=”four”>Roberts, J. (2016). What is HoloLens? Microsoft’s holographic headset explained. Retrieved from http://www.trustedreviews.com/opinion/hololens-release-date-news-and-price-2922378</ref>
  
Microsoft HoloLens runs a self-contained Windows 10 computer. It features HD 3D optical head-mounted display, spatial sound projection and advanced sensors to allow its users to interact its AR applications through head movements, gestures and voices.  
+
HoloLens has various sensors and a high-end CPU and GPU, which Microsoft says gives the headset more processing power than an average laptop. <ref name=”four”></ref>
  
HoloLens was announced in Windows 10 Event on January 21st, 2015. The Development Edition was released on March 30, 2016 for $3,000 or £2,000.
+
The potential uses of the HoloLens are vast. From social apps to games, to navigation, there’s an incredible potential that this [[mixed reality]] device can tap into. Indeed, Microsoft collaborated with NASA in the making of HoloLens, and there is the potential to control the Mars rover Curiosity via the headset, allowing Nasa staff to work as if they were on the planet themselves. Microsoft also partnered with Volvo to showcase another possible use - using it in car showrooms for customers to view different color configurations for their chosen car and see features in action. <ref name=”four”></ref>
 +
 
 +
At the end of March 2016, holoportation was showcased. The video demonstration showed how it could be possible - through the use of multiple cameras - to use the HoloLens to view a 3D version of a person. <ref name=”four”></ref>
 +
 
 +
While the HoloLens price is high, it is an impressive piece of hardware and indicates that Microsoft is taking the augmented reality and virtual reality markets seriously. <ref name=”three”></ref>
 +
 
 +
==Announcement and Release==
 +
Microsoft HoloLens was announced during a Windows 10 Event on January 21st, 2015. The Development Edition was released on March 30, 2016, for $3,000 or £2,000. It allowed developers to start making apps and games for the headset. Months later, it became available to anyone with a Microsoft account. During the last quarter of 2016, the program expanded beyond the United States into countries like the United Kingdom, Ireland, France, Germany, Australia and New Zealand. Currently, there’s still no information regarding a consumer edition release date. <ref name=”three”>Sophie, C. (2017). Microsoft HoloLens: Everything you need to know about the $3,000 AR headset. Retrieved from https://www.wareable.com/microsoft/microsoft-hololens-everything-you-need-to-know-about-the-futuristic-ar-headset-735</ref> <ref name=”four”></ref> <ref name=”five”>Spence, E. (2017). Microsoft HoloLens Review: Winning the reality wars. Retrieved from https://www.forbes.com/sites/ewanspence/2017/01/14/microsoft-hololens-review-experience-review/2/#4053cf3d43f9</ref>
  
 
==Features==
 
==Features==
Line 55: Line 66:
 
[[Spatial Mapping]] - scans the environment in real time to create a mesh of an X/Y/Z coordinate plane. Objects can be accurately projected into the mesh.
 
[[Spatial Mapping]] - scans the environment in real time to create a mesh of an X/Y/Z coordinate plane. Objects can be accurately projected into the mesh.
  
[[Spatial Audio]] - audio that sounds like they originate from specific points in the real environment.
+
[[Spatial Audio]] - in-app audio will come from different directions which depend on where you are in relation to the virtual object making the sound
  
 
[[#Voice|Voice Recognition]] - recognizes various voice commands.
 
[[#Voice|Voice Recognition]] - recognizes various voice commands.
Line 61: Line 72:
 
[[#Gesture|Gesture Recognition]] - recognizes various gesture commands such as the [[Air Tap]].
 
[[#Gesture|Gesture Recognition]] - recognizes various gesture commands such as the [[Air Tap]].
  
[[Gaze Recognition]] -
+
[[#Gaze|Gaze Recognition]] - HoloLens tracks your gaze.
  
 
==Hardware==
 
==Hardware==
 
===Review===
 
===Review===
'''Headset and Display''':
+
'''Headset and Display'''
  
HoloLens requires neither cords nor phones. It features [[optical head-mounted display]] mounted on top of a plastic ring that wraps around your head. The plastic ring has a soft foam cushion on the inside. Like other HMDs, the weight of HoloLens is front loaded and feels a bit bulky. HoloLens can be used with most prescription glasses.
+
HoloLens requires neither cords nor phones. It features an optical [[HMD]] on top of a plastic ring that wraps around the head. The plastic ring has a soft foam cushion on the inside. Like other HMDs, the weight of HoloLens is front loaded and feels a bit bulky. HoloLens can be used with most prescription glasses.
  
The transparent dual displays are made of out 3 layers of glass (red, blue and green). A light engine is mounted above the displays and projects light on the lenses. The tiny corrugated grooves in each layer of glass diffract these light particles, making them bounce around and helping to trick your eyes into perceiving virtual objects at virtual distances.
+
The transparent dual displays are made of three layers of glass (red, blue and green). A light engine is mounted above the displays and projects light on the lenses. The tiny corrugated grooves in each layer of glass diffract these light particles, making them bounce around and helping to trick your eyes into perceiving virtual objects at virtual distances.
  
The [[field of view]] where the holograms appear is quite small, 30° Horizontal and 17.5° Vertical. It is the same as a 16:9 monitor with 15 feet diagonal, 2 feet away from you face.
+
The [[field of view]] where the holograms appear is quite small - 30° horizontal and 17.5° vertical. It is the same as a 16:9 monitor with 15 feet diagonal, 2 feet away from you face.
  
'''Sensors''':
+
'''Sensors'''
  
Sensors include head tracking [[IMU]]s, sound capture system consist of an array of 4 microphones, an energy efficient depth camera with 120°×120° [[FOV]], a RGB 2-megapixel photo / HD video camera and an ambient light sensor. Additionally, it has 4 greyscale environment sensing cameras that work with the depth camera to track your head, hands and the surrounding environment.
+
Sensors include head tracking [[IMU]]s (Inertial Measuring Unit); a sound capture system consisting of an array of 4 microphones; an energy efficient depth camera with 120°×120° [[FOV]], an RGB 2-megapixel photo / HD video camera and an ambient light sensor. Additionally, it has 4 greyscale environment sensing cameras that work with the depth camera to track the head, hands and the surrounding environment.
  
'''Processors''':
+
'''Processors'''
  
For processors, in addition to [[CPU]] and [[GPU]], HoloLens possess an [[HPU]], [[holographic processing unit]]. HPU is a coprocessor that is dedicated to integrating real world and virtually generated content. It consolidates and processes all the data from various sensors and produces a thin stream of useful information to the other processors. HPU removes the burden of handling heavy external data from the CPU and GPU, allowing them to focus on creating content.
+
For processors, in addition to [[CPU]] and [[GPU]], HoloLens possess an [[HPU]], ([[holographic processing unit]]). The HPU is a coprocessor dedicated to integrating real world and virtually generated content. It consolidates and processes all the data from various sensors and produces a thin stream of useful information to the other processors. HPU removes the burden of handling heavy external data from the CPU and GPU, allowing them to focus on creating content.
  
 
[[HPU]] - processes all of the data from its sensors, depth camera, microphone etc.
 
[[HPU]] - processes all of the data from its sensors, depth camera, microphone etc.
  
'''Audio''':
+
'''Audio'''
  
[[3D audio|Spatial sound system]] consist of 2 small speakers are located on the sides of OHMD. Unlike headphones, these speakers do not prevent the user from hearing external sound.
+
The [[3D audio|Spatial sound system]] consists of 2 small speakers are located on the sides of the OHMD, sitting above the ears. Unlike headphones, these speakers do not prevent the user from hearing external sounds. In-app audio will come from different directions which depend on where you are in relation to the virtual object making the sound.
  
'''Input and Interface''':
+
'''Input and Interface'''
  
A pair of buttons responsible for brightness is above the left ear while another pair of buttons responsible for volume is above the right ear. In each pair, one of the buttons is concave while the other one is convex. There is also a Power button. These are the only physical inputs, HoloLens is largely controlled by [[#Voice|voice]], [[#Gesture|gesture]] and [[gaze]] along with [[HoloLens Clicker|a bluetooth clicker]]
+
A pair of buttons responsible for brightness is above the left ear while another pair of buttons responsible for volume is above the right ear. In each pair, one of the buttons is concave while the other one is convex. There is also a Power button. These are the only physical inputs - HoloLens is largely controlled by [[#Voice|voice]], [[#Gesture|gesture]] and [[#Gaze|gaze]] along with [[HoloLens Clicker|a bluetooth clicker]]
  
5 LEDs are present on the left side of the OHMD. These LEDs display various system statuses such as power and battery conditions. A microUSB port is present for charging and connection.
+
5 LEDs are present on the left side of the OHMD. These LEDs display various system statuses such as power and battery conditions. A microUSB port is present for charging and connection. It is possible to use Microsoft HoloLens while it’s charging over microUSB. <ref name=”four”></ref>
  
'''Power and Connectivity''':
+
'''Power and Connectivity'''
  
Battery in HoloLens lasts around 2.5 hours during processor intensive use. It lasts around 5.5 hours during regular use.  
+
The battery in HoloLens lasts around 2.5 hours during processor intensive use. It lasts around 5.5 hours during regular use.  
  
HoloLens can connect to any any WiFi or Bluetooth-equipped device.  
+
HoloLens can connect to any WiFi or Bluetooth-equipped device.  
  
 
HoloLens can run any universal Windows 10 app.
 
HoloLens can run any universal Windows 10 app.
Line 144: Line 155:
 
|[[Tracking]] || 6 degrees of freedom
 
|[[Tracking]] || 6 degrees of freedom
 
|-
 
|-
|[[Rotational tracking]] || [[IMU]]
+
|[[Rotational tracking]] || [[Gyroscope]], [[Magnetometer]], [[Accelerometer]]
 
|-
 
|-
|[[Positional tracking]] ||  
+
|[[Positional tracking]] || depth camera, 4 greyscale environment understanding cameras
 
|-
 
|-
 
|Update Rate ||  
 
|Update Rate ||  
Line 152: Line 163:
 
|[[#Tracking volume|Tracking Volume]] ||  
 
|[[#Tracking volume|Tracking Volume]] ||  
 
|-
 
|-
|Latency ||  
+
|Latency || Motion to Photon: less than 2ms
 
|-
 
|-
 
|Audio || Built-in speakers, Audio 3.5mm jack
 
|Audio || Built-in speakers, Audio 3.5mm jack
Line 164: Line 175:
 
|User Input || [[Gaze]], [[voice]], [[gesture]]
 
|User Input || [[Gaze]], [[voice]], [[gesture]]
 
|-
 
|-
|Buttons || Built-in speakers, audio 3.5mm jack
+
|Buttons || Brightness, volume, power
 
|-
 
|-
 
|OS || Windows 10
 
|OS || Windows 10
Line 173: Line 184:
  
 
==Commands==
 
==Commands==
HoloLens tacks your gaze. When you perform a gesture such as air tap, look at the part of hologram where you want to place your tap.  
+
===Gaze===
 +
HoloLens tracks your gaze. When you perform a gesture such as air tap, look at the part of hologram where you want to place your tap.  
 
===Gesture===
 
===Gesture===
 
{| class="wikitable sortable"
 
{| class="wikitable sortable"
Line 201: Line 213:
  
 
==Input Devices==
 
==Input Devices==
'''[[HoloLens Clicker]]''' - a small clicker with a loop that wraps around your middle or index finger. It is held with the microUSB port towards your body and your thumb resting on top of the click, in the indentation.
+
'''[[HoloLens Clicker]]''' - a small clicker with a loop that wraps around your middle or index finger. It is held with the microUSB port towards your body and your thumb resting on top of the click, in the indentation. The clicker features a single button and [[rotational tracking]]. It allows a user to click and scroll with minimal hand motion as a replacement for the air-tap gesture.
  
'''Bluetooth Keyboard'''
+
'''Bluetooth Mouse and Keyboard'''
  
 
==Apps==  
 
==Apps==  
HoloLens can project various Windows 10 Apps, programs and browsers onto walls and other objects. One of the example Microsoft used was Windows-like interfaces were projected onto walls and furniture. Users can interact with these projections with gaze, gestures and voice commands.
+
HoloLens can project various Windows 10 Apps, programs, and browsers onto walls and other objects. One of the examples Microsoft used was Windows-like interfaces projected onto walls and furniture. Users can interact with these projections with gaze, gestures and voice commands.
  
 
[[SketchUp]]  
 
[[SketchUp]]  
  
[[Holo Studio]] allows the user to create 3D models used for [[3D Printing]]. In addition to gesture commands it allow accepts voice commands.
+
[[Holo Studio]] - Allows the user to create 3D models used for [[3D Printing]]. In addition to gesture commands, it also accepts voice commands.
  
[[Minecraft]] is a Augmented Reality version of Minecraft.
+
[[Minecraft]] - An Augmented Reality version of Minecraft.
  
[[Project Xray]] - [[Mixed reality]] shooter game.
+
[[Project Xray]] - A [[mixed reality]] shooter game.
  
[[Actiongram]] - place 3D models into real world environments and recording videos with them in it.
+
[[Actiongram]] - Place 3D models into real world environments and record videos with them, mixing reality with digital overlays.
 +
 
 +
[[HoloGuide]] - Guides a user through low visibility areas.
 +
 
 +
[[HoloHear]] - Instantly translates speech into sign language for deaf people.
 +
 
 +
[[Teomirn]] - Overlays prompts and instructions on a real piano to help people learn how to play. <ref name=”three”></ref>
  
 
==Developer==
 
==Developer==
[[Windows Holographic]] is Microsoft's AR platform incorporated in Windows 10 OS. Windows Holographic API is implemented in all devices running Windows 10 including smartphones and tablets.
+
[[Windows Mixed Reality]] is Microsoft's AR platform incorporated in Windows 10 OS. Windows Mixed Reality API is implemented in all devices running Windows 10 including smartphones and tablets.
  
 
To develop for HoloLens, you need a Windows 10 PC able to run [[Visual Studio 2015]] and [[Unity]].
 
To develop for HoloLens, you need a Windows 10 PC able to run [[Visual Studio 2015]] and [[Unity]].
  
===HoloLens Emulator===
+
===Tools===
[[HoloLens Emulator]] allows the user to test Holographic apps on their PCs with the need of a physical HoloLens. The human and environmental inputs that would usually be read by the sensors on the HoloLens are instead simulated using your keyboard, mouse, or Xbox controller. Apps don't need to be modified to run on the emulator and don't know that they aren't running on a real HoloLens. <ref>https://developer.microsoft.com/en-us/windows/holographic/using_the_hololens_emulator</ref>
+
[[Unity]]
 +
 
 +
[[Visual Studio 2015]]
 +
 
 +
[[Windows SDK]]
 +
 
 +
[[Windows Device Portal]]
 +
====HoloLens Emulator====
 +
[[HoloLens Emulator]] allows the user to test Holographic apps on their PCs without the need of a physical HoloLens. The human and environmental inputs that would usually be read by the sensors on the HoloLens are instead simulated using your keyboard, mouse, or Xbox controller. Apps don't need to be modified to run on the emulator and don't know that they aren't running on a real HoloLens. <ref>Microsoft. Using the HoloLens emulator. Retrieved from https://developer.microsoft.com/en-us/windows/holographic/using_the_hololens_emulator</ref>
  
 
==History==
 
==History==

Latest revision as of 11:28, 15 December 2017

Microsoft HoloLens
Microsoft hololens2.jpg
Basic Info
VR/AR Augmented Reality
Type Optical head-mounted display
Subtype Integrated HMD
Platform Windows Mixed Reality
Creator Alex Kipman
Developer Microsoft
Manufacturer Microsoft
Release Date March 30, 2016
Price $3,000 / £2,000
Website Microsoft HoloLens
Requires Nothing
Predecessor None
Successor Microsoft HoloLens 2
System
Operating System Windows 10
CPU Intel 32 bit architecture
HPU Holographic processing unit
Storage
Storage 64 GB Flash
Memory 2 GB
Display
Display 2 HD 16:9 light engines
Resolution Holographic resolution: 2.3M total light points
Pixel Density Holographic density: over 2.5k radiants (light points per radian)
Refresh Rate 240Hz (60Hz content rate, each frame consists of four sequential colors: R-G-B-G)
Persistence 2.5ms
Image
Field of View 30°H and 17.5°V
Optics
Optics See-through holographic lenses (waveguides)
Tracking
Tracking 6DOF
Rotational Tracking Gyroscope, Magnetometer, Accelerometer
Positional Tracking Depth Camera with 120°×120° FOV, 4 greyscale cameras
Latency Motion to Photon: less than 2ms
Audio
Audio Built-in speakers, Audio 3.5mm jack
Camera 2MP photo / HD video camera, depth camera, 4 greyscale cameras
Connectivity
Connectivity WiFi, Bluetooth
Power Battery (2.5 to 5.5 hours per charge)
Device
Weight 579g
Sensors ambient light sensor, array of 4 microphones
Input Gaze, Gesture, Voice, HoloLens Clicker, Keyboard, Mouse
Cable Length Wireless

Introduction

Microsoft HoloLens is an Augmented Reality device developed by Microsoft. It is part of the Windows Mixed Reality AR Platform incorporated with Windows 10 OS. Similar to other OHMDs (optical head-mounted displays), HoloLens is a see-through display worn over your eyes. Unlike the Oculus Rift and other VR Devices, the eye-piece component of HoloLens is transparent and the headset requires neither PC nor smartphone. It is able to project high-definition (HD) virtual content or holograms over real world objects. [1] [2]

General Information

Microsoft HoloLens runs a self-contained Windows 10 computer. It features an HD 3D optical head-mounted display, spatial sound projection and advanced sensors to allow its users to interact with AR applications through head movements, gestures and voices. Microsoft has said that “The key to a great holographic experience is holograms that are light point rich, i.e. have a high holographic density, and are pinned or anchored to the world around you. To achieve this, HoloLens has been designed for optimal holographic density of 2.5K radiants. The more radiants and light points there are, the brighter and richer the holograms become.” [3]

HoloLens has various sensors and a high-end CPU and GPU, which Microsoft says gives the headset more processing power than an average laptop. [3]

The potential uses of the HoloLens are vast. From social apps to games, to navigation, there’s an incredible potential that this mixed reality device can tap into. Indeed, Microsoft collaborated with NASA in the making of HoloLens, and there is the potential to control the Mars rover Curiosity via the headset, allowing Nasa staff to work as if they were on the planet themselves. Microsoft also partnered with Volvo to showcase another possible use - using it in car showrooms for customers to view different color configurations for their chosen car and see features in action. [3]

At the end of March 2016, holoportation was showcased. The video demonstration showed how it could be possible - through the use of multiple cameras - to use the HoloLens to view a 3D version of a person. [3]

While the HoloLens price is high, it is an impressive piece of hardware and indicates that Microsoft is taking the augmented reality and virtual reality markets seriously. [4]

Announcement and Release

Microsoft HoloLens was announced during a Windows 10 Event on January 21st, 2015. The Development Edition was released on March 30, 2016, for $3,000 or £2,000. It allowed developers to start making apps and games for the headset. Months later, it became available to anyone with a Microsoft account. During the last quarter of 2016, the program expanded beyond the United States into countries like the United Kingdom, Ireland, France, Germany, Australia and New Zealand. Currently, there’s still no information regarding a consumer edition release date. [4] [3] [5]

Features

Holograms - realistic 3D projections that can be anchored onto real life objects. These virtual objects are projected at about 60 cm (near plane) to few meters.

Spatial Mapping - scans the environment in real time to create a mesh of an X/Y/Z coordinate plane. Objects can be accurately projected into the mesh.

Spatial Audio - in-app audio will come from different directions which depend on where you are in relation to the virtual object making the sound

Voice Recognition - recognizes various voice commands.

Gesture Recognition - recognizes various gesture commands such as the Air Tap.

Gaze Recognition - HoloLens tracks your gaze.

Hardware

Review

Headset and Display

HoloLens requires neither cords nor phones. It features an optical HMD on top of a plastic ring that wraps around the head. The plastic ring has a soft foam cushion on the inside. Like other HMDs, the weight of HoloLens is front loaded and feels a bit bulky. HoloLens can be used with most prescription glasses.

The transparent dual displays are made of three layers of glass (red, blue and green). A light engine is mounted above the displays and projects light on the lenses. The tiny corrugated grooves in each layer of glass diffract these light particles, making them bounce around and helping to trick your eyes into perceiving virtual objects at virtual distances.

The field of view where the holograms appear is quite small - 30° horizontal and 17.5° vertical. It is the same as a 16:9 monitor with 15 feet diagonal, 2 feet away from you face.

Sensors

Sensors include head tracking IMUs (Inertial Measuring Unit); a sound capture system consisting of an array of 4 microphones; an energy efficient depth camera with 120°×120° FOV, an RGB 2-megapixel photo / HD video camera and an ambient light sensor. Additionally, it has 4 greyscale environment sensing cameras that work with the depth camera to track the head, hands and the surrounding environment.

Processors

For processors, in addition to CPU and GPU, HoloLens possess an HPU, (holographic processing unit). The HPU is a coprocessor dedicated to integrating real world and virtually generated content. It consolidates and processes all the data from various sensors and produces a thin stream of useful information to the other processors. HPU removes the burden of handling heavy external data from the CPU and GPU, allowing them to focus on creating content.

HPU - processes all of the data from its sensors, depth camera, microphone etc.

Audio

The Spatial sound system consists of 2 small speakers are located on the sides of the OHMD, sitting above the ears. Unlike headphones, these speakers do not prevent the user from hearing external sounds. In-app audio will come from different directions which depend on where you are in relation to the virtual object making the sound.

Input and Interface

A pair of buttons responsible for brightness is above the left ear while another pair of buttons responsible for volume is above the right ear. In each pair, one of the buttons is concave while the other one is convex. There is also a Power button. These are the only physical inputs - HoloLens is largely controlled by voice, gesture and gaze along with a bluetooth clicker

5 LEDs are present on the left side of the OHMD. These LEDs display various system statuses such as power and battery conditions. A microUSB port is present for charging and connection. It is possible to use Microsoft HoloLens while it’s charging over microUSB. [3]

Power and Connectivity

The battery in HoloLens lasts around 2.5 hours during processor intensive use. It lasts around 5.5 hours during regular use.

HoloLens can connect to any WiFi or Bluetooth-equipped device.

HoloLens can run any universal Windows 10 app.

In the Box

  • HoloLens Development Edition
  • HoloLens Clicker
  • Carrying case
  • Charger and cable
  • Microfiber cloth
  • Nose pads
  • Overhead strap

Specifications

Part Spec
CPU Intel 32 bit architecture
GPU  ??
HPU Custom-built Microsoft Holographic Processing Unit (HPU 1.0)
RAM 2 GB
Storage 64 GB Flash
Display 2 HD 16:9 light engines
Optics See-through holographic lenses (waveguides)
IPD Automatic pupillary distance calibration
Holographic Resolution 2.3M total light points
Holographic Density >2.5k radiants (light points per radian)
Field of View 30°H and 17.5°V
Cameras 2 Mega-pixel photo / HD video camera, depth camera, 4 greyscale environment understanding cameras
Sensors ambient light sensor, 4 microphones
Tracking 6 degrees of freedom
Rotational tracking Gyroscope, Magnetometer, Accelerometer
Positional tracking depth camera, 4 greyscale environment understanding cameras
Update Rate
Tracking Volume
Latency Motion to Photon: less than 2ms
Audio Built-in speakers, Audio 3.5mm jack
Connectivity Wi-Fi 802.11ac, Micro USB 2.0, Bluetooth 4.1 LE
Power Battery: 2-3 hours of active use, Up to 2 weeks of standby time
Weight 579g
User Input Gaze, voice, gesture
Buttons Brightness, volume, power
OS Windows 10

Setup Tutorial

Commands

Gaze

HoloLens tracks your gaze. When you perform a gesture such as air tap, look at the part of hologram where you want to place your tap.

Gesture

Action Description Effect
Air Tap With your index finger pointed upward, bend it forward Simulates a mouse click in a desktop environment. Activates the interactive component
Home/Start Opening your hand with palm facing up Simulates the Windows key on a keyboard or Home button on a Windows Tablet. Opens up the holographic start menu.

Voice

Microsoft's virtual assistant Cortana is incorporated into the HoloLens. Users can interact with her with natural language commands.

Action Effect
"Follow me" The window follows the user, along the wall.

Input Devices

HoloLens Clicker - a small clicker with a loop that wraps around your middle or index finger. It is held with the microUSB port towards your body and your thumb resting on top of the click, in the indentation. The clicker features a single button and rotational tracking. It allows a user to click and scroll with minimal hand motion as a replacement for the air-tap gesture.

Bluetooth Mouse and Keyboard

Apps

HoloLens can project various Windows 10 Apps, programs, and browsers onto walls and other objects. One of the examples Microsoft used was Windows-like interfaces projected onto walls and furniture. Users can interact with these projections with gaze, gestures and voice commands.

SketchUp

Holo Studio - Allows the user to create 3D models used for 3D Printing. In addition to gesture commands, it also accepts voice commands.

Minecraft - An Augmented Reality version of Minecraft.

Project Xray - A mixed reality shooter game.

Actiongram - Place 3D models into real world environments and record videos with them, mixing reality with digital overlays.

HoloGuide - Guides a user through low visibility areas.

HoloHear - Instantly translates speech into sign language for deaf people.

Teomirn - Overlays prompts and instructions on a real piano to help people learn how to play. [4]

Developer

Windows Mixed Reality is Microsoft's AR platform incorporated in Windows 10 OS. Windows Mixed Reality API is implemented in all devices running Windows 10 including smartphones and tablets.

To develop for HoloLens, you need a Windows 10 PC able to run Visual Studio 2015 and Unity.

Tools

Unity

Visual Studio 2015

Windows SDK

Windows Device Portal

HoloLens Emulator

HoloLens Emulator allows the user to test Holographic apps on their PCs without the need of a physical HoloLens. The human and environmental inputs that would usually be read by the sensors on the HoloLens are instead simulated using your keyboard, mouse, or Xbox controller. Apps don't need to be modified to run on the emulator and don't know that they aren't running on a real HoloLens. [6]

History

January 21, 2015 - Microsoft HoloLens was officially announced.

April 28, 2015 - First live stage presentation of the HoloLens.

March 30, 2016 - Developer Edition of the HoloLens is officially released.

Images

Microsoft hololens3.jpg Microsoft hololens4.jpg Microsoft hololens5.jpg Microsoft hololens6.jpg

References

  1. Microsoft. Microsoft HoloLens. Retrieved from https://www.microsoft.com/en-us/hololens
  2. Microsoft. Why HoloLens. Retrieved from https://www.microsoft.com/en-us/hololens/why-hololens
  3. 3.0 3.1 3.2 3.3 3.4 3.5 Roberts, J. (2016). What is HoloLens? Microsoft’s holographic headset explained. Retrieved from http://www.trustedreviews.com/opinion/hololens-release-date-news-and-price-2922378
  4. 4.0 4.1 4.2 Sophie, C. (2017). Microsoft HoloLens: Everything you need to know about the $3,000 AR headset. Retrieved from https://www.wareable.com/microsoft/microsoft-hololens-everything-you-need-to-know-about-the-futuristic-ar-headset-735
  5. Spence, E. (2017). Microsoft HoloLens Review: Winning the reality wars. Retrieved from https://www.forbes.com/sites/ewanspence/2017/01/14/microsoft-hololens-review-experience-review/2/#4053cf3d43f9
  6. Microsoft. Using the HoloLens emulator. Retrieved from https://developer.microsoft.com/en-us/windows/holographic/using_the_hololens_emulator