Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· KI· Reviews· Streaming
/// News
Free Nvidia AI tool: Animate faces simply by speech in real time

Free Nvidia AI tool: Animate faces simply by speech in real time

[16:08 Mon,14.March 2022   by ]    

Nvidia has unveiled Omniverse Audio2Face, a free program that allows 3D facial models to be animated simply by voice input - even real-time. Omniverse Audio2Face beta enables the animation of a 3D character using any voice recording, whether the character is to be animated for a game, a movie, a real-time digital assistant, or just for fun. Its special feature is that it not only animates the face in lip-sync with the voice recording, but it can also express the corresponding emotions via facial expressions to match the tone and content of the spoken words.





The tool understands a whole range of different languages and can be used for real-time interactive applications live via microphone or as a traditional tool for creating facial animations using voice recordings. Audio2Face comes pre-installed with "Digital Mark" - a 3D character model that can be easily animated using your own audio for an easy start, you can of course also import and use your own models (for example from Epic Games Unreal Engine 4 Meta-Human). The audio input is then fed into a pre-trained Deep Neural Network and the output drives the 3D vertices of the character mesh to create the facial animation in real-time. Using various different post-processing parameters, the performance of the character can be optimized.

Audio2Face-2
Nvidia Omniverse Audio2Face



Animation of multiple faces

.
Per Audio2Face, both human and human-like 3D faces, whether realistic or stylized, can be animated. Using multiple instances of Audio2Face, it is also possible to animate several different characters in a scene - all animated from the same or different audio tracks. For example, dialogue between a duo, a sing-off between a trio, a synchronized quartet - and much more can be brought to life. The facial expressions of individual faces can be selectively enhanced or attenuated au vh

Audio2Face-1
Nvidia Omniverse Audio2Face



Targeted control of emotions

.
Audio2Face provides the ability to select specific emotions (such as anger, fear, sadness, or excitement) or for a face and control their expression. The AI then automatically animates the face, eyes, mouth, tongue, and head movement appropriately to achieve the selected emotional range and level of intensity.



System requirements

.
System requirements are Windows 10 64-bit, at least an Intel i7 or AMD Ryzen CPU with 4 cores and 2.5 GHz, 16 GB RAM, a 500 GB SSD, and (of course) an Nvidia RTX GPU with at least 6 GB VRAM. Omniverse Audio2Face beta, which is based on a already published in 2017 study from Nvidia, can be downloaded for free at here.

Link more infos at bei www.nvidia.com

deutsche Version dieser Seite: Kostenloses Nvidia KI-Tool: Gesichter einfach per Sprache in Echtzeit animieren

  

  Vorige News lesen Nächste News lesen 
bildThinkPad X1 Extreme Gen 5: Mobile 16" Workstation mit 3.840 x 2.400 Display und RTX 3080 Ti bildAccsoon M1 verwandelt Smartphones in Kamera-Vorschaumonitor samt Livestreaming


related news:1E0The Paragraphica AI camera is here: taking pictures without a lens of the environment through AI? 5.June 2023
AMD's new Adrenalin drivers 23.5.1 double computing power in Stable Diffusion 3.June 2023
AI military drone kills operator to kill more effectively - in simulation 2.June 2023
Japan and Israel with liberal copyright positions on AI training 2.June 2023
Roll - virtual AI ministudio for interviews (iPhone and web) 1.June 2023
Making of - How the viral Wes Anderson AI videos are created 29.May 2023
Microsoft Olive: New free tool doubles performance of Stable Diffusion 24.May 2023
alle Newsmeldungen zum Thema KI
1E0AMD's new Adrenalin drivers 23.5.1 double computing power in Stable Diffusion 3.June 2023
Spacetop: Notebook mit virtuellem 100 19.May 2023
Now live streaming at 4K and 60 fps with Nvidia RTX 40 graphics cards. 8.May 2023
New NVIDIA AI can simulate tennis matches - using only TV images 7.May 2023
Radeon RX 7950 XTX and XT - AMD accidentally reveals RTX 4090 competitor 3.May 2023
NVIDIA RTX 5000 ADA - graphics card with 32 GB ram in the starting blocks 24.April 2023
Soon to be cinematic? New NVIDIA AI creates high-definition videos 20.April 2023
alle Newsmeldungen zum Thema Computers


[nach oben]
















Archiv Newsmeldungen

2023

June - May - April - March - February - January

2022
December - November - October - September - August - July - June - May - April - March - February - January

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Kostenloses Nvidia KI-Tool: Gesichter einfach per Sprache in Echtzeit animieren



last update : 6.Juni 2023 - 00:06 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version