Lex Fridman conducted a virtual reality interview with Mark Zuckerberg using Meta's cutting-edge prototype photorealistic Codec Avatars.
The person behind the creation of Facebook, which was initially designed for sharing text updates among friends, has recently engaged in a demonstration of Meta's advancing technology. Developed by Meta, this technology bears the potential to revolutionize remote communication in the future.
Yesterday, Lex Fridman, a computer scientist, podcaster, and writer shared another interview with Mark Zuckerberg, which this time was conducted in Metaverse. The participants conversed in virtual space, using Meta Quest Pro VR headsets.
During the interview, Fridman and Zuckerberg used photorealistic avatars from the ongoing development of Codec Avatars. Meta's Codec Avatars represent a significant and ongoing research project aimed at transforming remote communication. The goal is to create remarkably convincing, real-time avatars driven by headsets equipped with face-tracking sensors, and eventually extend the technology to glasses as well.
Image credt: Lex Fridman
The key feature of Codec Avatars' VR avatars is the usage of machine learning during the scanning process. This advanced system gathers extensive data on a person's facial expressions, which is then used to create a virtual model that accurately replicates those expressions during conversations.
Fridman expressed his admiration for the striking realism of the 3D model portraying Zuckerberg within the Metaverse. According to the blogger, it genuinely felt as if they were both present in the same room. Fridman further emphasized that Mark's 3D avatar not only resembled him but was an impeccable replica, accurately mirroring his facial expressions and distinctive features.
Image credt: Lex Fridman
The advantage of Codec Avatars is that this technology generates a three-dimensional model, which is rendered directly on the receiving device. This means that VR headsets do not need to constantly record and transmit video over the network during conversations.
Image credt: Lex Fridman
Also, it's worth noting that Codec Avatars has been in development since at least 2019, but as for now, it's unknown when this technology will become available to users.
Earlier on, Meta revealed the release date and specs of their next-generation virtual and mixed-reality headset Quest 3. If you want to learn more details, have a look at our recent article.
Also, don't forget to join our 80 Level Talent platform and our Telegram channel, follow us on Instagram, Twitter, and LinkedIn, where we share breakdowns, the latest news, awesome artworks, and more.