Microsoft HoloLens

From Virtual Reality and Augmented Reality Wiki
Jump to: navigation, search
Microsoft HoloLens
Microsoft hololens2.jpg
Information
VR/AR Augmented Reality
Type Optical head-mounted display
Subtype Integrated HMD
Platform Windows Mixed Reality
Creator Alex Kipman
Developer Microsoft
Manufacturer Microsoft
Operating System Windows 10
Requires Nothing
Predecessor None
Successor Microsoft HoloLens 2
CPU Intel 32 bit architecture
HPU Holographic processing unit
Memory 2 GB
Storage 64 GB Flash
Display 2 HD 16:9 light engines
Resolution Holographic resolution: 2.3M total light points
Pixel Density Holographic density: over 2.5k radiants (light points per radian)
Refresh Rate 240Hz (60Hz content rate, each frame consists of four sequential colors: R-G-B-G)
Persistence 2.5ms
Field of View 30°H and 17.5°V
Optics See-through holographic lenses (waveguides)
Tracking 6DOF
Rotational Tracking Gyroscope, Magnetometer, Accelerometer
Positional Tracking Depth Camera with 120°×120° FOV, 4 greyscale cameras
Audio Built-in speakers, Audio 3.5mm jack
Camera 2MP photo / HD video camera, depth camera, 4 greyscale cameras
Sensors ambient light sensor, array of 4 microphones
Input Gaze, Gesture, Voice, HoloLens Clicker, Keyboard, Mouse
Connectivity WiFi, Bluetooth
Power Battery (2.5 to 5.5 hours per charge)
Weight 579g
Cable Length Wireless
Release Date March 30, 2016
Price $3,000 / £2,000
Website Microsoft HoloLens
Microsoft HoloLens is a Augmented Reality device developed by Microsoft. It is part of the Windows Mixed Reality AR Platform incorporated with Windows 10 OS. Similar to other OHMDs, HoloLens is a see through display worn over your eyes. Unlike Oculus Rift and VR Devices, the eye-piece component of HoloLens is transparent and the headset requires neither PC nor smartphone. It is able to project high-definition virtual content or holograms over real world objects.

Microsoft HoloLens runs a self-contained Windows 10 computer. It features HD 3D optical head-mounted display, spatial sound projection and advanced sensors to allow its users to interact its AR applications through head movements, gestures and voices.

HoloLens was announced in Windows 10 Event on January 21st, 2015. The Development Edition was released on March 30, 2016 for $3,000 or £2,000.

Features

Holograms - realistic 3D projections that can be anchored onto real life objects. These virtual objects are projected at about 60 cm (near plane) to few meters.

Spatial Mapping - scans the environment in real time to create a mesh of an X/Y/Z coordinate plane. Objects can be accurately projected into the mesh.

Spatial Audio - in-app audio will come from different directions which depend on where you are in relation to the virtual object making the sound

Voice Recognition - recognizes various voice commands.

Gesture Recognition - recognizes various gesture commands such as the Air Tap.

Gaze Recognition - HoloLens tracks your gaze.

Hardware

Review

Headset and Display:

HoloLens requires neither cords nor phones. It features a optical head-mounted display mounted on top of a plastic ring that wraps around your head. The plastic ring has a soft foam cushion on the inside. Like other HMDs, the weight of HoloLens is front loaded and feels a bit bulky. HoloLens can be used with most prescription glasses.

The transparent dual displays are made of out 3 layers of glass (red, blue and green). A light engine is mounted above the displays and projects light on the lenses. The tiny corrugated grooves in each layer of glass diffract these light particles, making them bounce around and helping to trick your eyes into perceiving virtual objects at virtual distances.

The field of view where the holograms appear is quite small, 30° Horizontal and 17.5° Vertical. It is the same as a 16:9 monitor with 15 feet diagonal, 2 feet away from you face.

Sensors:

Sensors include head tracking IMUs, sound capture system consist of an array of 4 microphones, an energy efficient depth camera with 120°×120° FOV, a RGB 2-megapixel photo / HD video camera and an ambient light sensor. Additionally, it has 4 greyscale environment sensing cameras that work with the depth camera to track your head, hands and the surrounding environment.

Processors:

For processors, in addition to CPU and GPU, HoloLens possess an HPU, holographic processing unit. HPU is a coprocessor that is dedicated to integrating real world and virtually generated content. It consolidates and processes all the data from various sensors and produces a thin stream of useful information to the other processors. HPU removes the burden of handling heavy external data from the CPU and GPU, allowing them to focus on creating content.

HPU - processes all of the data from its sensors, depth camera, microphone etc.

Audio:

Spatial sound system consist of 2 small speakers are located on the sides of OHMD, sitting above the ears. Unlike headphones, these speakers do not prevent the user from hearing external sound. In-app audio will come from different directions which depend on where you are in relation to the virtual object making the sound.

Input and Interface:

A pair of buttons responsible for brightness is above the left ear while another pair of buttons responsible for volume is above the right ear. In each pair, one of the buttons is concave while the other one is convex. There is also a Power button. These are the only physical inputs, HoloLens is largely controlled by voice, gesture and gaze along with a bluetooth clicker

5 LEDs are present on the left side of the OHMD. These LEDs display various system statuses such as power and battery conditions. A microUSB port is present for charging and connection.

Power and Connectivity:

Battery in HoloLens lasts around 2.5 hours during processor intensive use. It lasts around 5.5 hours during regular use.

HoloLens can connect to any any WiFi or Bluetooth-equipped device.

HoloLens can run any universal Windows 10 app.

In the Box

  • HoloLens Development Edition
  • HoloLens Clicker
  • Carrying case
  • Charger and cable
  • Microfiber cloth
  • Nose pads
  • Overhead strap

Specifications

Part Spec
CPU Intel 32 bit architecture
GPU  ??
HPU Custom-built Microsoft Holographic Processing Unit (HPU 1.0)
RAM 2 GB
Storage 64 GB Flash
Display 2 HD 16:9 light engines
Optics See-through holographic lenses (waveguides)
IPD Automatic pupillary distance calibration
Holographic Resolution 2.3M total light points
Holographic Density >2.5k radiants (light points per radian)
Field of View 30°H and 17.5°V
Cameras 2 Mega-pixel photo / HD video camera, depth camera, 4 greyscale environment understanding cameras
Sensors ambient light sensor, 4 microphones
Tracking 6 degrees of freedom
Rotational tracking Gyroscope, Magnetometer, Accelerometer
Positional tracking depth camera, 4 greyscale environment understanding cameras
Update Rate
Tracking Volume
Latency
Audio Built-in speakers, Audio 3.5mm jack
Connectivity Wi-Fi 802.11ac, Micro USB 2.0, Bluetooth 4.1 LE
Power Battery: 2-3 hours of active use, Up to 2 weeks of standby time
Weight 579g
User Input Gaze, voice, gesture
Buttons Brightness, volume, power
OS Windows 10

Setup Tutorial

Commands

Gaze

HoloLens tacks your gaze. When you perform a gesture such as air tap, look at the part of hologram where you want to place your tap.

Gesture

Action Description Effect
Air Tap With your index finger pointed upward, bend it forward Simulates a mouse click in a desktop environment. Activates the interactive component
Home/Start Opening your hand with palm facing up Simulates the Windows key on a keyboard or Home button on a Windows Tablet. Opens up the holographic start menu.

Voice

Microsoft's virtual assistant Cortana is incorporated into the HoloLens. Users can interact with her with natural language commands.

Action Effect
"Follow me" The window follows the user, along the wall.

Input Devices

HoloLens Clicker - a small clicker with a loop that wraps around your middle or index finger. It is held with the microUSB port towards your body and your thumb resting on top of the click, in the indentation. The clicker features a single button and rotational tracking. It allows a user to click and scroll with minimal hand motion as a replacement for the air-tap gesture.

Bluetooth Mouse and Keyboard

Apps

HoloLens can project various Windows 10 Apps, programs and browsers onto walls and other objects. One of the example Microsoft used was Windows-like interfaces were projected onto walls and furniture. Users can interact with these projections with gaze, gestures and voice commands.

SketchUp

Holo Studio allows the user to create 3D models used for 3D Printing. In addition to gesture commands it allow accepts voice commands.

Minecraft is a Augmented Reality version of Minecraft.

Project Xray - Mixed reality shooter game.

Actiongram - place 3D models into real world environments and recording videos with them in it.

Developer

Windows Mixed Reality is Microsoft's AR platform incorporated in Windows 10 OS. Windows Mixed Reality API is implemented in all devices running Windows 10 including smartphones and tablets.

To develop for HoloLens, you need a Windows 10 PC able to run Visual Studio 2015 and Unity.

Tools

Unity

Visual Studio 2015

Windows SDK

Windows Device Portal

HoloLens Emulator

HoloLens Emulator allows the user to test Holographic apps on their PCs with the need of a physical HoloLens. The human and environmental inputs that would usually be read by the sensors on the HoloLens are instead simulated using your keyboard, mouse, or Xbox controller. Apps don't need to be modified to run on the emulator and don't know that they aren't running on a real HoloLens. [1]

History

January 21, 2015 - Microsoft HoloLens was officially announced.

April 28, 2015 - First live stage presentation of the HoloLens.

March 30, 2016 - Developer Edition of the HoloLens is officially released.

Images

Microsoft hololens3.jpg Microsoft hololens4.jpg Microsoft hololens5.jpg Microsoft hololens6.jpg

References

  1. https://developer.microsoft.com/en-us/windows/holographic/using_the_hololens_emulator