Changes

Positional tracking

10,536 bytes added, 07:44, 17 April 2024

→‎Magnetic Tracking: Typo

{{TOCRIGHT}}{{see also|Tracking}}Positional tracking tracks is a technology that allows a device to estimate its position relative to the environment around it. It uses a combination of hardware and software to achieve the detection of its absolute position of the . It is an essential technology for [[HMDvirtual reality]](VR), hands and other devices and body parts within the 3 dimensional space. Positional tracking records the making it possible to track movement with six [[translational movementdegrees of freedom]]s, left(6DOF) <ref name=”1”> StereoLabs. Positional Tracking. Retrieved from https://www.stereolabs.com/documentation/overview/right, forwardpositional-tracking/backward and upintroduction.html</downref> <ref name=”2”> Lang, B. (2013). An introduction to positional tracking and degrees of your devicefreedom (DOF). Retrieved from http://www.roadtovr. Precise and low [[latency]] com/introduction-positional -tracking is essential to have a good [[VR]] experience and produce [[presence]]-degrees-freedom-dof/</ref>.

By contrast, [[rotational Positional tracking is not the same as 3DOF head tracking. 3DOF head tracking]], records only registers the rotation of the head ([[rotational movementRotational tracking]]s of your HMD), with movements such as turning pitch, yaw, and tiling roll. Positional tracking registers the exact position and orientation of your headthe headset in space, recognizing forward/backward, up/down and left/right movement <ref name=”3”> Rohr, F. (2015). Positional tracking in VR: what it is and how it works. Retrieved from http://data-reality.com/positional-tracking-in-vr-what-it-is-and-how-it-works</ref>.

Positional tracking VR technology brings various benefits to the VR experience. It can change the viewpoint of the user to reflect different actions like jumping, ducking, or leaning forward; allow for an exact representation of the user’s hands and other objects in the virtual environment; increase the connection between the physical and virtual world by, for example, using hand position to move virtual objects by touch; and detect gestures by analyzing position over time <ref name=”2”></ref> <ref name=”4”> Boger, Y. (2014). Overview of positional tracking technologies for virtual reality. Retrieved from http://www.roadtovr.com/overview-of-positional-tracking-technologies-virtual-reality/</ref>. It is also known that positional tracking improves the 3D perception of the virtual environment because of parallax (the way objects closer to the eyes move faster than objects farther away). Parallax helps inform the brain about the perception of distance along with stereoscopy <ref name=”2”></ref> <ref name=Types”4”></ref>. Also, the 6DOF tracking helps reduce drastically motion sickness during the VR experience that is caused due the disconnect between the inputs of what is being seen with the eyes and what is being felt by the ear vestibular system <ref name=”2”></ref> <ref name=”3”></ref>. There are different methods of positional tracking. Choosing which one to apply is dependent on various factors such as the tracking accuracy and the refresh rate required, the tracking area, if the tracking is indoor or outdoor, cost, power consumption, computational power available, whether the tracked object is rigid or flexible, and whether the objects are well known of can change <ref name=”4”></ref>. Positional tracking VR technology is a necessity for VR to work properly since an accurate representation of objects like the head or the hands in the virtual world contribute towards achieving immersion and a greater sense of presence <ref name=”2”></ref> <ref name=”3”></ref> <ref name=”4”></ref> <ref name=”5”> RealVision. The dilemma of positional tracking in cinematic vr films. Retrieved from http://realvision.ae/blog/2016/06/the-dilemma-of-positional-tracking-in-cinematic-vr-films/</ref>. ==Methods of positional tracking== [[File:HMD and markers.png|thumb|1. Markers on an HMD (Image: www.roadtovr.com)]]'''[[InsideFile:Optical marker.png|thumb|2. Optical marker by Intersense (Image: www.roadtovr.com)]] There are various methods of positional tracking. The description of the methods provided below is based on Boger (2014) <ref name=”4”></ref>. ===Acoustic Tracking=== The measurement of the time it takes for a known acoustic signal to travel between an emitter and a receiver is known as acoustic tracking. Generally, several transmitters are placed in the tracked area and various receivers placed on the tracked objects. The distance between the receiver and transmitter is calculated by the amount of time the acoustic signal takes to reach the receiver. However, for this to work, the system must be aware of when the acoustic signal was sent. The orientation of a rigid object can be known if this object has multiple receivers placed in a known position. The difference between the time of arrival of the acoustic signal to the multiple receivers will provide data about the orientation of the object relative to the transmitters. One of the downsides of acoustic tracking is that it requires time-out consuming calibration to function properly. The acoustic trackers are also susceptible to measurement error due to ambient disturbances such as noise and do not provide high update rates. Due to these disadvantages, acoustic tracking systems are commonly used with other sensors (e.g. inertial sensors) to provide better accuracy. Intersense, an American technology company, has developed successful acoustic tracking systems. ===Wireless tracking===Wireless tracking uses a set of anchors that are placed around the perimeter of the tracking space and one or more tags that are tracked. This system is similar in concept to GPS, but works both indoors and outdoors. Sometimes referred to as indoor GPS. The tags [[triangulation (computer vision)|triangulate]] their 3D position using the anchors placed around the perimeter. A wireless technology called Ultra Wideband has enabled the position tracking to reach a precision of under 100 mm. By using sensor fusion and high speed algorithms, the tracking precision can reach 5 mm level with update speeds of 200 Hz or 5 ms [[Latency (engineering)|latency]]''' .<ref name=”6”> IndoTraq. Positional Tracking. Retrieved from http://indotraq.com/?page_id=122</ref><ref name=”7”> Hands-On With Indotraq. Retrieved from https://www.vrfocus.com/2016/01/hands-on-with-indotraq/</ref><ref name=”8”> INDOTRAQ INDOOR TRACKING FOR VIRTUAL REALITY. Retrieved from https://blog.abt.com/2016/01/ces-2016-indotraq-indoor-tracking-for-virtual- reality/</ref> ===Inertial Tracking=== Inertial tracking camera is placed made possible by the use of accelerometers and gyroscopes. Accelerometers measure linear acceleration, which is used to calculate velocity and the position of the object relative to an initial point. This is possible due to the mathematical relationship between position over time and velocity, and velocity and acceleration (4). A gyroscope measures angular velocity. It is a solid-state component based on microelectromechanical systems (MEMS) technology and operates based on the device same principles as a mechanical gyro. From the angular velocity data provided by the gyroscope, angular position relative to the initial point is calculated. This technology is inexpensive and can provide high update rates as well as low latency. On the other side, the calculations (i.e. integration and double-integration) of the values given by the accelerometers (acceleration) and gyroscope (angular velocity) that lead to the object’s position can result in a significant drift in position information - decreasing this method’s accuracy. ===Magnetic Tracking=== This method measures the magnitude of the magnetic field in different directions. Normally, the system has a base station that generates a magnetic field, with the strength of the field diminishing as distance increases between the measurement point and base station. Furthermore, a magnetic field allows for the determination of orientation. For example, if the measured object is rotated, the distribution of the magnetic field along the various axes is modified. In a controlled environment, magnetic tracking’s accuracy is good. However, it can be influenced by interference from conductive materials near the emitter of sensors, from other magnetic fields generated by other devices and from ferromagnetic materials in the tracking area.The [[Razer Hydra]] motion controllers is an example of implementation of this specific type of positional tracking in a product. Most [[HMDHead-mounted display|Head-mounted displays]](HMDs) being and smartphones contain [[IMUs]] or [[magnetometer|magnetometers]] that detect the magnetic field of Earth. Magnetic tracking can be AC or DC. Magnetic tracking is great because it doesn't need a Kalman filter. It is much higher quality than all other tracking methods, but there are constraints on its usage, like how it cannot be used in environments with a lot of metal due to interference. ===Optical Tracking=== For optical tracking, there are various methods available. The commonality between them all is the use of cameras to gather positional information. ====Tracking with markers==== This optical trackingmethod uses a specific pattern of markers placed on an object (Figure 1). One or more cameras then seek the markers, using algorithms to extract the position of the object from the visible markers. From the difference between what the video camera is detecting and the known marker pattern, an algorithm calculates the position and orientation of the tracked object. The pattern of markers that are placed in the tracked object is not random. The number, location, and arrangement of the markers are carefully chosen in order to provide the system with as much information possible so the algorithms do not have missing data. There are two types of markers: passive and active. Passive markers reflect infrared light (IR) towards the light source. In this case, the camera provides the IR signal that is reflected from the markers for detection. Active markers are IR lights that flash periodically and are detected by the cameras. Choosing between the two types of markers depends on several variables like distance, type of surface, required viewing direction, and others.

'''[[Outside-in tracking]]''' - tracking camera(s) is placed in the external environment where the tracked device (HMD) is within its view.====Tracking with visible markers====

'''[[Markerless Visible markers (Figure 2) placed in a predetermined arrangement are also used in optical tracking]]''' - . The camera detects the markers and their positions leading to the determination of the position and orientation of the object. For example, visible markers can be placed in a specific pattern on the tracking system that does not area, and an HMD with cameras would then use [[fiducial this to calculate its position. The shape and size of this type of markers]]can vary. What is important is that they can be easily identified by the cameras.

'''[[====Markerless, inside-out tracking]]'''====

==Systems=='''[[Lighthouse]]''' - laser-based Objects can be tracked without markers if their geometry is known. With markerless tracking, the system developed by [[Valve]] camera searches and compares the received image with the known 3D model for [[SteamVR]]features like edges or color transitions, for example.

'''[[Constellation]]''' - optical-based system developed by [[Oculus VR]] for [[Oculus Rift]].====Depth map tracking====

==Methods=====Acoustic===Acoustic A depth camera uses various technologies to create a real-time map of the distances of the objects in the tracking area from the camera. The tracking measures is performed by extracting the object to be tracked (e.g. hang) from the length of time general depth map and analyzing it. An example of an acoustic signal takes to reach various receiversa depth map camera is Microsoft’s Kinect.

Acoustic tracking can be influenced by surrounding noise causing inaccurate measurements. It also demands careful calibration and does not provide high update rates. Even with its faults, acoustic tracking can be used injunction with other methods to improve positional tracking.===Inertial=Sensor Fusion====Inertial tracking is performed by [[accelerometer]] and [[gyroscope]]. Accelerometer measures the linear acceleration while gyroscope measures the angular velocity.

While accelerometer Sensor fusion is a method of using more than one tracking technique in order to improve the detection of position and orientation of the tracked object. By using a combination of techniques, one method’s disadvantage can be compensated by another. An example of this would be the combination of inertial tracking and gyroscope supply low latency optical tracking. The former can develop drift, and high update ratethe latter is susceptible to markers being hidden (occlusion). They do not By combining both, if markers are occluded, the position can be estimated by the inertial trackers, and even if the optical markers are completely visible, the inertial sensors provide updates at a higher rate, improving the overall positional information accurately due to factors like drifttracking.

===MagneticOculus Rift and HTC Vive’s positional tracking===Magnetic tracking determines the strength of the magnetic field in different directions.

Magnetic The [[Oculus Rift]] positional tracking is utilized in different from the one the HTC Vive uses. While the Oculus Rift uses [[Razer HydraConstellation]]. It , an IR-LED array that is usually tracked by a very accurate tracking methodcamera, although it can be influenced by magnetic fields generated by other electronics and objects near the sensor or emitterHTC Vive uses Valve’s [[Lighthouse]] technology, which is a laser-based system <ref name=”3”></ref>.

Most [[HMD]]s and smartphones contain [[magnetometer]]sIn the Oculus Rift, movement is limited to the sight area of the camera - when not enough LEDs are in sight of the camera, [[the software relies on data sent by the headset’s IMU]]sensors. With Valve’s position tracking system, the tracking area is flooded with non-visible light which the HTC Vive detects using photosensors <ref name=”3”></ref> <ref name=”6”> Buckley, S. (2015). This is how Valve’s amazing lighthouse tracking technology works. Retrieved from http://gizmodo.com/this-is-how-valve-s that detect the magnetic field of Earth-amazing-lighthouse-tracking-technol-1705356768</ref>.

===Optical===One weakness of optical Positional tracking is occlusion. Occlusion occurs when objects are hidden from the camera because they are behind other objects.====Marker=and smartphones===Optical tracking with mark consist of adding an unique marker onto an object you want to track. Then use a camera or multiple cameras to follow the movement and position of the marker. Finally algorithms are used to figure out the position and orientation of the object.

The marker Positional tracking in mobile VR still struggles to achieve a good level of accuracy mainly due to the power needed to handle a positional tracking VR system and the fact that using QR codes and cameras for tracking would contradict the essence of having a simple, intuitive, and mobile VR experience (3). Currently, mobile devices are limited by their form factor and can be active or passonly track the movements of a user’s head. Active markerNevertheless, such as companies are still investing in the development of an IR light, can flash periodically accurate positional tracking system for smartphones. Having this system available to sync anyone with a phone capable of VR would facilitate the camera. A retroreflector can be used as a passive marker to reflect IR light emitted adoption of VR by the camera to create general public, possibly unlocking the potential of the same effect as a active oneVR market <ref name=”3”></ref> <ref name=”7”> Grubb, J. (2016). Why positional tracking for mobile virtual reality is so damn hard. Retrieved from https://venturebeat.com/2016/02/24/why-positional-tracking-for-mobile-virtual-reality-is-so-damn-hard</ref>.

Multiple markers with unique designs can be deployed. They allow the camera(s) to track the positions ==Types of multiple objects at the same time. positional tracking==

====Markerless====Certain identifiable features, such as '''[[Inside-out tracking]]''' - tracking camera is placed on the fingers on your hands, can be tracked by camera(s) even without markerdevice (s). [[Leap MotionHMD]] employs this to find the position and movement of your fingers) being tracking.

====Depth Map==== '''[[Depth Map cameraOutside-in tracking]] constructs a live view of ''' - tracking camera(s) is placed in the distances of external environment where the objects from the cameratracked device (HMD) is within its view. '''[[Markerless tracking]]''' - tracking system that does not use [[fiducial markers]].

'''[[MicrosoftMarkerless inside-out tracking]]'s [[Kinect]] uses depth map camera.'' - combines markerless tracking with inside-out tracking

===Sensor Fusion===Sensor fusion is when multiple '''[[Markerless outside-in tracking methods are used. The different methods can cover each other]]'s weaknesses.'' - combines markerless tracking with outside-in tracking

Inertial ==Comparison of tracking can be used in conjunction with optical tracking. While optical tracking would be the main tracking method, when occlusion occurs, inertial tracking could estimate the position til the objects are visible to the optical camera again. inertial tracking could systems=={{see also generate position data in-between optical |Comparison of tracking's position data because inertial systems}}{{:Comparison of tracking has higher update rate.systems}}

==References==

<references />

[[Category:Terms]] [[Category:Technical Terms]]

• ← Older edit

Acro

1,003

edits