Logo Logo
directory schraeg
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Compositing· Color correction· DV Editing

Shooting· Sound
Forschung· Reviews· Streaming
/// News
Free Nvidia AI tool: Animate faces simply by speech in real time

Free Nvidia AI tool: Animate faces simply by speech in real time

[16:08 mon,14.March 2022   by ]    

Nvidia has unveiled Omniverse Audio2Face, a free program that allows 3D facial models to be animated simply by voice input - even real-time. Omniverse Audio2Face beta enables the animation of a 3D character using any voice recording, whether the character is to be animated for a game, a movie, a real-time digital assistant, or just for fun. Its special feature is that it not only animates the face in lip-sync with the voice recording, but it can also express the corresponding emotions via facial expressions to match the tone and content of the spoken words.

The tool understands a whole range of different languages and can be used for real-time interactive applications live via microphone or as a traditional tool for creating facial animations using voice recordings. Audio2Face comes pre-installed with "Digital Mark" - a 3D character model that can be easily animated using your own audio for an easy start, you can of course also import and use your own models (for example from Epic Games Unreal Engine 4 Meta-Human). The audio input is then fed into a pre-trained Deep Neural Network and the output drives the 3D vertices of the character mesh to create the facial animation in real-time. Using various different post-processing parameters, the performance of the character can be optimized.

Nvidia Omniverse Audio2Face

Animation of multiple faces

Per Audio2Face, both human and human-like 3D faces, whether realistic or stylized, can be animated. Using multiple instances of Audio2Face, it is also possible to animate several different characters in a scene - all animated from the same or different audio tracks. For example, dialogue between a duo, a sing-off between a trio, a synchronized quartet - and much more can be brought to life. The facial expressions of individual faces can be selectively enhanced or attenuated au vh

Nvidia Omniverse Audio2Face

Targeted control of emotions

Audio2Face provides the ability to select specific emotions (such as anger, fear, sadness, or excitement) or for a face and control their expression. The AI then automatically animates the face, eyes, mouth, tongue, and head movement appropriately to achieve the selected emotional range and level of intensity.

System requirements

System requirements are Windows 10 64-bit, at least an Intel i7 or AMD Ryzen CPU with 4 cores and 2.5 GHz, 16 GB RAM, a 500 GB SSD, and (of course) an Nvidia RTX GPU with at least 6 GB VRAM. Omniverse Audio2Face beta, which is based on a already published in 2017 study from Nvidia, can be downloaded for free at here.

Link more infos at bei www.nvidia.com

deutsche Version dieser Seite: Kostenloses Nvidia KI-Tool: Gesichter einfach per Sprache in Echtzeit animieren


  Vorige News lesen Nächste News lesen 
bildThinkPad X1 Extreme Gen 5: Mobile 16" Workstation mit 3.840 x 2.400 Display und RTX 3080 Ti bildAccsoon M1 verwandelt Smartphones in Kamera-Vorschaumonitor samt Livestreaming

related news:1E0See in the dark by AI with color 22.May 2022
Illuminated only by starlight: New AI algorithm denoises videos perfectly 16.May 2022
NAB 2022 Tutorialclip: DaVinci Resolve 18 - AI-Mask Objects, Depth Mask, Surface Tracker 27.April 2022
AI helps to synchronize motion pictures 16.April 2022
Apple Final Cut Pro update brings duplicate detection and voice isolation via AI 13.April 2022
DALL-E 2: AI generates and edits images based on text description only 10.April 2022
AI generates frighteningly accurate portraits - based on voice alone 9.April 2022
alle Newsmeldungen zum Thema Machine Learning
1E0AMD previews processor future Ryzen 7000 and Mendocino 23.May 2022
Razer Blade 15 OLED: First notebook with 240 Hz OLED display 9.May 2022
First Intel Arc GPUs are available - competition for AMD and Nvidia? 31.March 2022
Nvidia Instant NeRF - 3D scene from 2D images in record time 28.March 2022
MSI: New CreatorPro workstations with new Nvidia RTX A5500 GPU with 16 GB VRAM 24.March 2022
Numerous new workstation GPUs from Nvidia - including RTX A5500. 23.March 2022
First Apple M1 Ultra benchmarks: only just behind 64-core AMD Threadripper 3990X 9.March 2022
alle Newsmeldungen zum Thema Computers

[nach oben]

Archiv Newsmeldungen


May - April - March - February - January

December - November - October - September - August - July - June - May - April - March - February - January






















deutsche Version dieser Seite: Kostenloses Nvidia KI-Tool: Gesichter einfach per Sprache in Echtzeit animieren

last update : 24.Mai 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version