Omniverse Audio2Face
Pricing model
Upvote
1
Omniverse Audio2Face is a reference application that facilitates the animation of a 3D character to align with any voice-over track. It comes equipped with a 3D character model that can be animated using a voice-over track, where the audio input is processed by a pre-trained Deep Neural Network. The output then manipulates the 3D vertices of the character mesh to generate real-time facial animation. Additionally, it includes a character transfer feature, enabling users to retarget any 3D human or human-like face and scale the output with multiple characters in the scene, while controlling the character's emotion through an AI network. It also offers data conversion features for blendshape conversion and blendweight export options, and it supports export-import with Blendshapes for Blender and Epic Games Unreal Engine to produce character motion.
Similar neural networks:
Upvote
0
MagicTime is a tool designed to create time-lapse videos with increased realism. It leverages metamorphic simulators to generate videos from given prompts, focusing on enhancing the accuracy of video generation models. MagicTime includes features such as model training, inference, and integration with DiT-based architectures like Open-Sora-Plan. The project offers comprehensive documentation, including installation instructions, training guides, and community contributions. Additionally, it includes a dataset, ChronoMagic, for training. Released under the Apache 2.0 license, MagicTime encourages citation for research applications.
Upvote
0
Introducing the inaugural video-3D foundational model that incorporates real physics comprehension, enabling you to direct character movements as desired. Simply upload an image with a text prompt and witness it animate according to your instructions. Merge an image with a video to seamlessly integrate any character into any footage.
Upvote
0
D-ID leverages generative AI to produce personalized videos with speaking avatars at the click of a button for entrepreneurs and content creators. The Creative Reality Studio employs advanced AI technologies to craft talking avatars from images, audio, or text inputs. Moreover, the Live Portrait and Speaking Portrait services allow users to transform photos into videos and create talking head videos from text or audio, respectively.