The 1st interview in the Metaverse (Codec Avatars)

What if you could have a truly photorealistic representation of yourself and use that to interact with people in the Metaverse? Well this is actually possible now.

This is what worked on for a few months! I was one of the many PMs in the core team of productionizing this work: Avatars that truly create a genuine sense of social presence. I am not working on this anymore, but surely loved the experience.

So how does this work?

In order for Codec Avatars to get created, people need to enter this Facebook Reality Labs' capture system. This image was published here. Yes, I’ve been there!

As part data collection, researchers mentioned that: “participants will do things like mimic expressions, read sentences and converse, and make eye movements”. In order to create virtual interactions that are indistinguishable from real ones, having extremely high quality data really makes a difference.

Watch the full interview here:

And make sure to read all the tech behind this: https://tech.facebook.com/reality-labs/2019/3/codec-avatars-facebook-reality-labs/

What future use cases do you envision?