Skip to main content

Tongue-tracking in VR has arrived

Meta Quest Pro face-tracking demo shows a green-skinned flower person with surprised expression.
Meta

A new face-tracking extension lets Meta Quest Pro users poke their tongues out at you in a wordless statement of their feelings or even blow a raspberry.

How better to express a sweltering day or an exhausting workout? This could be the technology that revolutionizes VR in 2024. Am I being too tongue-in-cheek?

Honestly, it’s a nice option to add to the Quest Pro’s current hand-, eye-, and face-tracking. Meta’s most expensive VR headset allows quite a range of expression already. I can gesture with my hands, blink, wink, move my eyes, and open and close my mouth in various positions. You can’t do that with the new Quest 3.

Tongues were wagging when @0GUzzuqPjUVpY57 broke the news on X (formerly Twitter), along with providing a video demonstration showing two animated avatars alongside a Quest Pro user controlling the action.

Rleased new #VRCFT modules for new #QuestPro v2 facial tracking with support for tongue.

Supports (Air)Link and VD via VDX (when VD adds support) using the ALXR Local module and ALXR clients with the ALXR Remote module

You can download from here https://t.co/F37U2zA8is#VRChat pic.twitter.com/sUmfLaXVpN

— コレヂャン (@0GUzzuqPjUVpY57) December 14, 2023

Since the Quest Pro includes face-tracking, it seems like Meta should have included tongue-tracking, but perhaps felt it would be controversial. HTC makes a Face Tracker accessory to synchronize mouth and tongue movements with an avatar, and it’s compatible with many VR headsets.

Of course, you shouldn’t add more weight and extra expense if you can avoid it. With the new ALXR module from korejan on Github, you can emote with your tongue in compatible PC VR apps and games like VRChat.

The developer shows off Quest Pro tongue tracking extension.
A developer shows off the Quest Pro tongue-tracking extension. korejan

The extension reportedly works with Meta’s AirLink and Virtual Desktop via an app called VDX. You can install a tongue-tracking extension as a local module for ALXR or as a remote module if you use ALVR streaming.

If you’re unfamiliar with VRChat and ALXR, you’ll need to do a bit of reading to understand how to use the tongue-tracking extension. In the tweet thread, there’s a link to Reddit for more details about how to get started.

Note that installing this extension won’t add tongues to your Meta avatar and can’t help with the Quest version of VRChat. Also, few games and apps support face-tracking. It’s probably only worth the effort if you are already enjoying face- or body-tracking in VRChat or another social VR app on your PC.

Editors' Recommendations

Alan Truly
Computing Writer
Alan is a Computing Writer living in Nova Scotia, Canada. A tech-enthusiast since his youth, Alan stays current on what is…
This VR headset made me never want to go back to my Quest 2
Alan Truly wears the Pimax Crystal, a premium VR headset with incredible sharpness.

Meta's Quest 2 longevity is almost supernatural in the VR world. It's the headset that keeps on giving, but it's time to retire that classic model released in 2020 and try something new. Ahead of the launch of the Quest 3, I tested the much more expensive Pimax Crystal, a VR headset that puts resolution and fidelity as first priority.

In many ways, it's a throwback to an older era of VR headsets, requiring a powerful gaming PC to take full advantage of its capabilities. And like every modern PC VR headset, it will outperform and deliver a sharper picture than the stand-alone Quest 2. However, the hassle of plugging in a tether, setting up base stations, and pairing controllers is overwhelming for many gamers. Pimax has a solution for that, and after using it for a while, it made me never want to go back to my Quest 2.
My Pimax Crystal experience
SteamVR games are available now with Pimax stand-alone games planned. Photo by Tracey Truly

Read more
The Meta Quest Pro may already be dead
From a side view, you can see how glasses can be worn along with a Quest Pro.

Meta's big push into the metaverse may already be slowing down significantly. According to a report from The Information, Meta has a limited supply of material for VR/AR headsets and will only produce devices as long as it has the capacity.

In particular, that means the death of the Quest Pro, despite being less than a year old. A potential Quest Pro 2 seems to be off the table.

Read more
The Vision Pro SDK has arrived. Here’s what it’s revealed so far
The UI of Apple's Vision Pro headset.

We've already learned quite a bit about the Vision Pro since Apple's WWDC event, but many details are still unknown.

Now that the software developers kit (SDK) is available, coders are digging in and uncovering more about Apple's first mixed-reality headset. Here are some of the best finds so far.
Limited VR range

Read more