Omniverse Audio2Face: Real-Time 3D Character Animation Tool

Omniverse Audio2Face

Pricing model
Free
Upvote 1
Omniverse Audio2Face is a reference application that facilitates the animation of a 3D character to align with any voice-over track. It comes equipped with a 3D character model that can be animated using a voice-over track, where the audio input is processed by a pre-trained Deep Neural Network. The output then manipulates the 3D vertices of the character mesh to generate real-time facial animation. Additionally, it includes a character transfer feature, enabling users to retarget any 3D human or human-like face and scale the output with multiple characters in the scene, while controlling the character's emotion through an AI network. It also offers data conversion features for blendshape conversion and blendweight export options, and it supports export-import with Blendshapes for Blender and Epic Games Unreal Engine to produce character motion.

Similar neural networks:

Freemium
Upvote 0
Skyglass provides AI-crafted backgrounds and visual effects for video production. It allows users to generate AI-based settings, eliminate backgrounds without the need for green screens, and utilize live compositing. The platform also features various subscription options, granting access to a collection of 3D environments and offering manual camera controls.
Free
Upvote 0
Rokoko offers a range of motion capture solutions and services designed to help users craft more lifelike and engaging animations. Their offerings include comprehensive performance capture, the Smartsuit Pro II, Smartgloves, and Face Capture, as well as the free Rokoko Video tool, which lets users animate quickly using a webcam. Additionally, real-time tracking is provided to further enrich the animation process.
Free
Upvote 1
Omniverse Audio2Face is a reference application that facilitates the animation of a 3D character to align with any voice-over track. It comes equipped with a 3D character model that can be animated using a voice-over track, where the audio input is processed by a pre-trained Deep Neural Network. The output then manipulates the 3D vertices of the character mesh to generate real-time facial animation. Additionally, it includes a character transfer feature, enabling users to retarget any 3D human or human-like face and scale the output with multiple characters in the scene, while controlling the character's emotion through an AI network. It also offers data conversion features for blendshape conversion and blendweight export options, and it supports export-import with Blendshapes for Blender and Epic Games Unreal Engine to produce character motion.