Microsoft HoloLens

From Virtual Reality, Augmented Reality Wiki
Jump to: navigation, search
Microsoft HoloLens
Microsoft hololens2.jpg
Basic Info
VR/AR Augmented Reality
Type Optical head-mounted display
Subtype Integrated HMD
Platform Windows Mixed Reality
Creator Alex Kipman
Developer Microsoft
Manufacturer Microsoft
Release Date March 30, 2016
Price $3,000 / £2,000
Website Microsoft HoloLens
Requires Nothing
Predecessor None
Successor Microsoft HoloLens 2
System
Operating System Windows 10
CPU Intel 32 bit architecture
HPU Holographic processing unit
Storage
Storage 64 GB Flash
Memory 2 GB
Display
Display 2 HD 16:9 light engines
Resolution Holographic resolution: 2.3M total light points
Pixel Density Holographic density: over 2.5k radiants (light points per radian)
Refresh Rate 240Hz (60Hz content rate, each frame consists of four sequential colors: R-G-B-G)
Persistence 2.5ms
Image
Field of View 30°H and 17.5°V
Optics
Optics See-through holographic lenses (waveguides)
Tracking
Tracking 6DOF
Rotational Tracking Gyroscope, Magnetometer, Accelerometer
Positional Tracking Depth Camera with 120°×120° FOV, 4 greyscale cameras
Latency Motion to Photon: less than 2ms
Audio
Audio Built-in speakers, Audio 3.5mm jack
Camera 2MP photo / HD video camera, depth camera, 4 greyscale cameras
Connectivity
Connectivity WiFi, Bluetooth
Power Battery (2.5 to 5.5 hours per charge)
Device
Weight 579g
Sensors ambient light sensor, array of 4 microphones
Input Gaze, Gesture, Voice, HoloLens Clicker, Keyboard, Mouse
Cable Length Wireless

Introduction

Microsoft HoloLens is an Augmented Reality device developed by Microsoft. It is part of the Windows Mixed Reality AR Platform incorporated with Windows 10 OS. Similar to other OHMDs (optical head-mounted displays), HoloLens is a see-through display worn over your eyes. Unlike the Oculus Rift and other VR Devices, the eye-piece component of HoloLens is transparent and the headset requires neither PC nor smartphone. It is able to project high-definition (HD) virtual content or holograms over real world objects. [1] [2]

General Information

Microsoft HoloLens runs a self-contained Windows 10 computer. It features an HD 3D optical head-mounted display, spatial sound projection and advanced sensors to allow its users to interact with AR applications through head movements, gestures and voices. Microsoft has said that “The key to a great holographic experience is holograms that are light point rich, i.e. have a high holographic density, and are pinned or anchored to the world around you. To achieve this, HoloLens has been designed for optimal holographic density of 2.5K radiants. The more radiants and light points there are, the brighter and richer the holograms become.” [3]

HoloLens has various sensors and a high-end CPU and GPU, which Microsoft says gives the headset more processing power than an average laptop. [3]

The potential uses of the HoloLens are vast. From social apps to games, to navigation, there’s an incredible potential that this mixed reality device can tap into. Indeed, Microsoft collaborated with NASA in the making of HoloLens, and there is the potential to control the Mars rover Curiosity via the headset, allowing Nasa staff to work as if they were on the planet themselves. Microsoft also partnered with Volvo to showcase another possible use - using it in car showrooms for customers to view different color configurations for their chosen car and see features in action. [3]

At the end of March 2016, holoportation was showcased. The video demonstration showed how it could be possible - through the use of multiple cameras - to use the HoloLens to view a 3D version of a person. [3]

While the HoloLens price is high, it is an impressive piece of hardware and indicates that Microsoft is taking the augmented reality and virtual reality markets seriously. [4]

Announcement and Release

Microsoft HoloLens was announced during a Windows 10 Event on January 21st, 2015. The Development Edition was released on March 30, 2016, for $3,000 or £2,000. It allowed developers to start making apps and games for the headset. Months later, it became available to anyone with a Microsoft account. During the last quarter of 2016, the program expanded beyond the United States into countries like the United Kingdom, Ireland, France, Germany, Australia and New Zealand. Currently, there’s still no information regarding a consumer edition release date. [4] [3] [5]

Features

Holograms - realistic 3D projections that can be anchored onto real life objects. These virtual objects are projected at about 60 cm (near plane) to few meters.

Spatial Mapping - scans the environment in real time to create a mesh of an X/Y/Z coordinate plane. Objects can be accurately projected into the mesh.

Spatial Audio - in-app audio will come from different directions which depend on where you are in relation to the virtual object making the sound

Voice Recognition - recognizes various voice commands.

Gesture Recognition - recognizes various gesture commands such as the Air Tap.

Gaze Recognition - HoloLens tracks your gaze.

Hardware

Review

Headset and Display

HoloLens requires neither cords nor phones. It features an optical HMD on top of a plastic ring that wraps around the head. The plastic ring has a soft foam cushion on the inside. Like other HMDs, the weight of HoloLens is front loaded and feels a bit bulky. HoloLens can be used with most prescription glasses.

The transparent dual displays are made of three layers of glass (red, blue and green). A light engine is mounted above the displays and projects light on the lenses. The tiny corrugated grooves in each layer of glass diffract these light particles, making them bounce around and helping to trick your eyes into perceiving virtual objects at virtual distances.

The field of view where the holograms appear is quite small - 30° horizontal and 17.5° vertical. It is the same as a 16:9 monitor with 15 feet diagonal, 2 feet away from you face.

Sensors

Sensors include head tracking IMUs (Inertial Measuring Unit); a sound capture system consisting of an array of 4 microphones; an energy efficient depth camera with 120°×120° FOV, an RGB 2-megapixel photo / HD video camera and an ambient light sensor. Additionally, it has 4 greyscale environment sensing cameras that work with the depth camera to track the head, hands and the surrounding environment.

Processors

For processors, in addition to CPU and GPU, HoloLens possess an HPU, (holographic processing unit). The HPU is a coprocessor dedicated to integrating real world and virtually generated content. It consolidates and processes all the data from various sensors and produces a thin stream of useful information to the other processors. HPU removes the burden of handling heavy external data from the CPU and GPU, allowing them to focus on creating content.

HPU - processes all of the data from its sensors, depth camera, microphone etc.

Audio

The Spatial sound system consists of 2 small speakers are located on the sides of the OHMD, sitting above the ears. Unlike headphones, these speakers do not prevent the user from hearing external sounds. In-app audio will come from different directions which depend on where you are in relation to the virtual object making the sound.

Input and Interface

A pair of buttons responsible for brightness is above the left ear while another pair of buttons responsible for volume is above the right ear. In each pair, one of the buttons is concave while the other one is convex. There is also a Power button. These are the only physical inputs - HoloLens is largely controlled by voice, gesture and gaze along with a bluetooth clicker

5 LEDs are present on the left side of the OHMD. These LEDs display various system statuses such as power and battery conditions. A microUSB port is present for charging and connection. It is possible to use Microsoft HoloLens while it’s charging over microUSB. [3]

Power and Connectivity

The battery in HoloLens lasts around 2.5 hours during processor intensive use. It lasts around 5.5 hours during regular use.

HoloLens can connect to any WiFi or Bluetooth-equipped device.

HoloLens can run any universal Windows 10 app.

In the Box

  • HoloLens Development Edition
  • HoloLens Clicker
  • Carrying case
  • Charger and cable
  • Microfiber cloth
  • Nose pads
  • Overhead strap

Specifications

Part Spec
CPU Intel 32 bit architecture
GPU  ??
HPU Custom-built Microsoft Holographic Processing Unit (HPU 1.0)
RAM 2 GB
Storage 64 GB Flash
Display 2 HD 16:9 light engines
Optics See-through holographic lenses (waveguides)
IPD Automatic pupillary distance calibration
Holographic Resolution 2.3M total light points
Holographic Density >2.5k radiants (light points per radian)
Field of View 30°H and 17.5°V
Cameras 2 Mega-pixel photo / HD video camera, depth camera, 4 greyscale environment understanding cameras
Sensors ambient light sensor, 4 microphones
Tracking 6 degrees of freedom
Rotational tracking Gyroscope, Magnetometer, Accelerometer
Positional tracking depth camera, 4 greyscale environment understanding cameras
Update Rate
Tracking Volume
Latency Motion to Photon: less than 2ms
Audio Built-in speakers, Audio 3.5mm jack
Connectivity Wi-Fi 802.11ac, Micro USB 2.0, Bluetooth 4.1 LE
Power Battery: 2-3 hours of active use, Up to 2 weeks of standby time
Weight 579g
User Input Gaze, voice, gesture
Buttons Brightness, volume, power
OS Windows 10

Setup Tutorial

Commands

Gaze

HoloLens tracks your gaze. When you perform a gesture such as air tap, look at the part of hologram where you want to place your tap.

Gesture

Action Description Effect
Air Tap With your index finger pointed upward, bend it forward Simulates a mouse click in a desktop environment. Activates the interactive component
Home/Start Opening your hand with palm facing up Simulates the Windows key on a keyboard or Home button on a Windows Tablet. Opens up the holographic start menu.

Voice

Microsoft's virtual assistant Cortana is incorporated into the HoloLens. Users can interact with her with natural language commands.

Action Effect
"Follow me" The window follows the user, along the wall.

Input Devices

HoloLens Clicker - a small clicker with a loop that wraps around your middle or index finger. It is held with the microUSB port towards your body and your thumb resting on top of the click, in the indentation. The clicker features a single button and rotational tracking. It allows a user to click and scroll with minimal hand motion as a replacement for the air-tap gesture.

Bluetooth Mouse and Keyboard

Apps

HoloLens can project various Windows 10 Apps, programs, and browsers onto walls and other objects. One of the examples Microsoft used was Windows-like interfaces projected onto walls and furniture. Users can interact with these projections with gaze, gestures and voice commands.

SketchUp

Holo Studio - Allows the user to create 3D models used for 3D Printing. In addition to gesture commands, it also accepts voice commands.

Minecraft - An Augmented Reality version of Minecraft.

Project Xray - A mixed reality shooter game.

Actiongram - Place 3D models into real world environments and record videos with them, mixing reality with digital overlays.

HoloGuide - Guides a user through low visibility areas.

HoloHear - Instantly translates speech into sign language for deaf people.

Teomirn - Overlays prompts and instructions on a real piano to help people learn how to play. [4]

Developer

Windows Mixed Reality is Microsoft's AR platform incorporated in Windows 10 OS. Windows Mixed Reality API is implemented in all devices running Windows 10 including smartphones and tablets.

To develop for HoloLens, you need a Windows 10 PC able to run Visual Studio 2015 and Unity.

Tools

Unity

Visual Studio 2015

Windows SDK

Windows Device Portal

HoloLens Emulator

HoloLens Emulator allows the user to test Holographic apps on their PCs without the need of a physical HoloLens. The human and environmental inputs that would usually be read by the sensors on the HoloLens are instead simulated using your keyboard, mouse, or Xbox controller. Apps don't need to be modified to run on the emulator and don't know that they aren't running on a real HoloLens. [6]

History

January 21, 2015 - Microsoft HoloLens was officially announced.

April 28, 2015 - First live stage presentation of the HoloLens.

March 30, 2016 - Developer Edition of the HoloLens is officially released.

Images

Microsoft hololens3.jpg Microsoft hololens4.jpg Microsoft hololens5.jpg Microsoft hololens6.jpg

References

  1. Microsoft. Microsoft HoloLens. Retrieved from https://www.microsoft.com/en-us/hololens
  2. Microsoft. Why HoloLens. Retrieved from https://www.microsoft.com/en-us/hololens/why-hololens
  3. 3.0 3.1 3.2 3.3 3.4 3.5 Roberts, J. (2016). What is HoloLens? Microsoft’s holographic headset explained. Retrieved from http://www.trustedreviews.com/opinion/hololens-release-date-news-and-price-2922378
  4. 4.0 4.1 4.2 Sophie, C. (2017). Microsoft HoloLens: Everything you need to know about the $3,000 AR headset. Retrieved from https://www.wareable.com/microsoft/microsoft-hololens-everything-you-need-to-know-about-the-futuristic-ar-headset-735
  5. Spence, E. (2017). Microsoft HoloLens Review: Winning the reality wars. Retrieved from https://www.forbes.com/sites/ewanspence/2017/01/14/microsoft-hololens-review-experience-review/2/#4053cf3d43f9
  6. Microsoft. Using the HoloLens emulator. Retrieved from https://developer.microsoft.com/en-us/windows/holographic/using_the_hololens_emulator