Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
DeepFaceVideoEditing: AI enables changing facial expressions in videos via sketching

DeepFaceVideoEditing: AI enables changing facial expressions in videos via sketching

[11:38 Thu,11.August 2022   by ]    

Another step on the way to object-based video editing via AI has been taken by a team of Chinese researchers accomplished - their algorithm, named "DeepFaceVideoEditing" and based on DeepLearning methods, enables the manipulation of facial expressions or even other features by means of a simple sketch of the desired change.

DeepFaceVideoEditing-Bart
Changes to hairstyle, beard and eyebrows via DeepFaceVideoEditing




Users can select multiple frames from a video where a face is prominent and manually define a rough mask in the face in which the desired change is sketched. This change can affect the expression of the eyes or mouth as well as features such as a beard, hairstyle or eyebrows. Two fundamentally different types of changes can be realized: either part of the appearance of a face can be changed consistently over the length of the entire video (such as the hairstyle or a beard), or the change can affect only a small sequence of frames, such as a momentary change in facial expression like a smile or a brief raise of the eyebrows or sniffle.



In the future, video editors will be able to use DeepFaceVideoEditing (or similar methods that are still being developed and will hopefully be integrated into editing tools) to change the facial expressions or appearance of actors much more easily than before (e.g. by rotoscoping) (or to remove or add a tattoo or scar, for example). This opens up a whole new range of options in post-production, meaning that even serious artistic decisions can be made after the shoot and implemented with relative ease.

DeepFaceVideoEditing-Algorithm
DeepFaceVideoEditing algorithm


DeepFaceVideoEditing uses, among other things, the StyleGAN3 algorithm developed by Nvidia, which specializes in the generation and also manipulation of human faces. It is known, among other things, for the online project Thispersondoesnotexist, which can be used to generate arbitrarily realistic-looking faces. And also this algorithm for artificially aging faces by photo, which can also be tried out online, uses StyleGAN.

DeepFaceVideoEditing-methods
Changing the Minim and the Hairstyle via DeepFaceVideoEditing


Since similar algorithms for editing faces in video are basically very similar to those for manipulating photos, but are again significantly more complex due to the large number of slightly different individual images, experience shows that they always take a little longer to develop. In addition, they require more computing power due to this higher complexity. But as the new algorithm shows, these problems can be overcome, so it is only a matter of time before (AI) algorithms that work for photos also work with videos.

Link more infos at bei geometrylearning.com

deutsche Version dieser Seite: DeepFaceVideoEditing: KI ermöglicht das Ändern von Gesichtsausdrücken in Videos

  

  Vorige News lesen Nächste News lesen 
bildAJA Mini-Config v2.26.4 bringt Mini Convertern u.a. 12-Bit SDI bildVegas Pro 20 erschienen mit einigen Verbesserungen


related news:1E0Whisper: New free AI turns speech into text and automatically translates into all languages 26.September 2022
VFX made easy: animate faces and fake voices with AI 22.September 2022
AI images with stable diffusion can now be used directly ni Photoshop and Gimp via plugin 18.September 2022
Generate and edit personalized images via AI 15.September 2022
Free image generation via AI: Stable Diffusion now with easy Windows Installer 13.September 2022
Insta360 X3 - 360° actioncam with new image sensors and KI functions 11.September 2022
How to produce an animated fashion show with free AI tools 2.September 2022
alle Newsmeldungen zum Thema Machine Learning


[nach oben]
















Archiv Newsmeldungen

2022

September - August - July - June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: DeepFaceVideoEditing: KI ermöglicht das Ändern von Gesichtsausdrücken in Videos



last update : 28.September 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version