HomeTechnologyComputingWatch Meta's full-body VR tracking with just Quest headset

Watch Meta’s full-body VR tracking with just Quest headset

Meta Reality Labs is making great strides in avatar rendering with the latest advancements that combine machine learning (ML) with sensor data from Quest VR headsets to show your entire body, including arms, legs, torso and head. The result is a highly realistic and accurate representation of the poses and movements of a person wearing a Quest 2 headset.

This is quite amazing because only the positions and orientations of the Quest VR headset and the two controllers were used to estimate leg movement and position. There are no tracking bands placed on the legs and no external cameras are used for this remarkable system. Meta Research Scientist Alexander Winkler shared several videos on Twitter along with links to the scientific article on arXiv and a Youtube video with more details.

In a scientific sense, this is known as motion tracking from sparse sensors and ML is particularly adept at extracting meaningful information from very little, if there are sufficient dependencies between what is known and unknown. Because we swing our arms for balance when walking and running, arm movement is a good indicator of what the legs usually do. Combined with head tilt and direction, the ML system can predict most human movements very accurately.

More traditional approaches to limb tracking rely on additional hardware, such as reflective markers on your legs and torso that are identified by remote cameras, or bands of wireless beacons worn in different locations on your legs to transmit position and movement data. .

While these methods work, they are usually sold as accessory items that cost more and are not well supported in most apps and games. If Meta can get such good results with a Quest 2 headset, developers are more likely to build body tracking into their games and apps.

Must Read
New supercomputer for climate research inaugurated in Hamburg

Despite these significant advances, Meta Reality Labs admits that more work needs to be done. If you move fast enough, the ML model won’t be able to identify your pose correctly. Unusual postures are difficult for the computer to estimate and if the virtual environment has obstacles that do not exist in reality, the movement will not fit. The overall effect seems to be very good though, and it would be a nice upgrade to be able to see a full body instead of floating torsos when chatting with friends in VR.

Hopefully this technology will be ready for launch soon. Of Meta’s Quest Pro Headset Announcement expected in just a few weeks, the timing for full-body avatars seems perfect. The Meta Quest Pro can track eye movements and facial expressions, giving your friends, family and colleagues a better sense of presence in the near future.

Editor’s Recommendations



Please enter your comment!
Please enter your name here

Most Popular

Recent Comments