WellSaid Voice Avatars are used in a wide range of groundbreaking products. As tech applications continue to push the bounds of immersive experiences, lifelike AI voices are an essential ingredient. Companies like Five9 and Super Hi-Fi have built incredible products using WellSaid Avatars, and now Digital Domain is making news, too.
Digital Domain Presents “Zoey” at FMX in Stuttgart
Recently, at a presentation at FMX, Digital Domain introduced the world to Zoey. A combination of machine learning, video animation, and the realistic voices from WellSaid API, Zoey is capable of complex interactions. She can react with appropriate facial expressions, answer questions, and even fidget during a conversation.
The use of a high-quality AI voice is essential to preserving the realistic experience of Zoey’s interactions. By using WellSaid API, Digital Domain is able to create the experience nearly in real-time.
Full Press Release
STUTTGART, Germany, May 06, 2022 (GLOBE NEWSWIRE) — Today at FMX, Oscar-winning VFX studio and leaders in digital human technology, Digital Domain, announces “Zoey,” the world’s most advanced autonomous human. Powered by machine learning and created using an advanced version of the technology and process that helped bring Thanos to the big screen, the photorealistic Zoey can engage in conversations with multiple participants at once, remember people, access the internet to answer questions and more, paving the way for the next step in the evolution of AI.
“With the potential of the metaverse and continued advancements in AI, the desire to interact with autonomous humans face-to-face is becoming more important and part of modern life,” said Daniel Seah, Global CEO of Digital Domain. “For decades, Digital Domain has been pioneering digital human technology, and Zoey takes the concepts of virtual assistants like Alexa and Siri several steps further, creating a digital helper you can truly interact with.”
Building on its proof-of-concept autonomous human, “Douglas,” Zoey is the result of years of research and development from the award-winning visual effects house, spearheaded by its internal Digital Humans Group. The physical appearance of Zoey is based on actress Zoey Moses, who worked with Digital Domain to create a comprehensive set of facial movements and mannerisms, as well as a full range of emotive expressions. Using that data and its proprietary facial animation tool “Charlatan” — recently seen in blockbuster films, including the Oscar-nominated Free Guy — artists were able to take the real footage of Moses and create a flexible digital face, capable of reacting in real time.
To give Zoey her personality, Digital Domain used multiple forms of machine learning to ensure she could understand most questions and formulate proper replies, and then access the internet (or stored data) for its answer. But rather than simply give a verbal or text response, Zoey can fully emote. If a question is confusing, she will look perplexed; if she is told a joke, she’ll smile. Throughout a conversation Zoey will also move and fidget in accordance with her answers, and even get annoyed when interrupted. She can engage with participants, asking them questions and opinions, and facial recognition software lets her recognize and remember people. Chatbots can also be added, giving Zoey the potential to quickly assume the role of an established virtual assistant for deployment in hospitality, the service industry and much more.
To provide Zoey with a robust and flexible voice system capable of more than just reciting scripted answers, Digital Domain employed AI-powered text-to-speech technology from WellSaid Labs. Using WellSaid Labs’ tools, Zoey can access a vast vocabulary of words and phrases, ensuring that no answer is beyond its capacity to vocalize. There are also multiple options to control the tone of her replies, including different levels of enthusiasm to reflect the goal of the interactions. For a retail setting, for instance, a more upbeat approach would be required, where a conversation would be more level. Zoey also has the ability to expand her speech capabilities by incorporating multiple language packs, making her fully bilingual.
Once Zoey is “educated” and ready to interact with the real world, she can then be added to multiple platforms, including custom systems designed by potential users, or game engines like Unity and Epic Games’ software. For today’s introductory presentation at FMX, Zoey can be seen running in real time on Epic Games’ Unreal Engine 4.
“For the last 30 years, Digital Domain has been one of the world leaders behind some of the most sophisticated and memorable visual effects ever seen, so it was a natural progression for us to become a leader in digital and virtual humans and to create ‘Zoey,’ the world’s most advanced autonomous human,” said John Fragomeni, global president of Digital Domain. “We will continue to push the boundaries of visual effects in all fields and on any screen, as we look for ways to offer people a better experience, regardless of the medium or delivery platform.”
Zoey will be available to license from Digital Domain in the near future.
About Digital Domain
Digital Domain creates genre-defining experiences that entertain, inform and inspire. Throughout the last quarter of a century, the studio has established itself as a leader in the film visual effects industry, expanding to encompass episodics, commercials and game cinematics, while also embracing pre-visualization and virtual production. Digital Domain has also become a pioneer in digital humans and virtual reality, adding to a rich legacy that consists of hundreds of blockbuster feature films for every major studio, thousands of commercials, music videos, game cinematics and digital content by world-renowned directors and brands.
A creative force in visual effects and premium content, Digital Domain have brought artistry and technology to films including Titanic, The Curious Case of Benjamin Button and blockbusters Ready Player One, Avengers: Infinity War and Avengers: Endgame. Staff artists have won more than 100 major awards, including Academy Awards, Clios, BAFTA awards and Cannes Lions.
Digital Domain has successfully become the first independent visual effects studio to enter Greater China. In 2018, Digital Domain acquired one of China’s VR hardware equipment pioneers and leaders – VR Technology Holdings Ltd, Shenzhen (“3Glasses”).
Digital Domain has locations in Los Angeles, Vancouver, Montreal, Beijing, Shanghai, Shenzhen, Hong Kong, Taipei and Hyderabad. Digital Domain Holdings Limited is listed on the Hong Kong Stock Exchange (stock code: 547).
