Logo Logo
deutsch
directory schraeg
Knowledge

Hardware
Actioncam / 360°· Camcorders· Cinema-Kamera· Kamera(technik)· Kamera-Zubehör· Kameradrohnen· Lenses· Smartphone-Kamera· Video-DSLM/DSLR
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Filmmaking· Generative KI
Misc
Audio· Live-Streaming· Sonstige
/// News
DeepFaceVideoEditing: AI enables changing facial expressions in videos via sketching

DeepFaceVideoEditing: AI enables changing facial expressions in videos via sketching

[11:38 Thu,11.August 2022   by ]    

Another step on the way to object-based video editing via AI has been taken by a team of Chinese researchers accomplished - their algorithm, named "DeepFaceVideoEditing" and based on DeepLearning methods, enables the manipulation of facial expressions or even other features by means of a simple sketch of the desired change.

DeepFaceVideoEditing-Bart
Changes to hairstyle, beard and eyebrows via DeepFaceVideoEditing




Users can select multiple frames from a video where a face is prominent and manually define a rough mask in the face in which the desired change is sketched. This change can affect the expression of the eyes or mouth as well as features such as a beard, hairstyle or eyebrows. Two fundamentally different types of changes can be realized: either part of the appearance of a face can be changed consistently over the length of the entire video (such as the hairstyle or a beard), or the change can affect only a small sequence of frames, such as a momentary change in facial expression like a smile or a brief raise of the eyebrows or sniffle.



In the future, video editors will be able to use DeepFaceVideoEditing (or similar methods that are still being developed and will hopefully be integrated into editing tools) to change the facial expressions or appearance of actors much more easily than before (e.g. by rotoscoping) (or to remove or add a tattoo or scar, for example). This opens up a whole new range of options in post-production, meaning that even serious artistic decisions can be made after the shoot and implemented with relative ease.

DeepFaceVideoEditing-Algorithm
DeepFaceVideoEditing algorithm


DeepFaceVideoEditing uses, among other things, the StyleGAN3 algorithm developed by Nvidia, which specializes in the generation and also manipulation of human faces. It is known, among other things, for the online project Thispersondoesnotexist, which can be used to generate arbitrarily realistic-looking faces. And also this algorithm for artificially aging faces by photo, which can also be tried out online, uses StyleGAN.

DeepFaceVideoEditing-methods
Changing the Minim and the Hairstyle via DeepFaceVideoEditing


Since similar algorithms for editing faces in video are basically very similar to those for manipulating photos, but are again significantly more complex due to the large number of slightly different individual images, experience shows that they always take a little longer to develop. In addition, they require more computing power due to this higher complexity. But as the new algorithm shows, these problems can be overcome, so it is only a matter of time before (AI) algorithms that work for photos also work with videos.

Link more infos at bei geometrylearning.com

deutsche Version dieser Seite: DeepFaceVideoEditing: KI ermöglicht das Ändern von Gesichtsausdrücken in Videos

  

  Vorige News lesen Nächste News lesen 
bildAJA Mini-Config v2.26.4 bringt Mini Convertern u.a. 12-Bit SDI bildVegas Pro 20 erschienen mit einigen Verbesserungen


related news:1E0PIKA 1.0 announced - Generative AI videos with amazing quality 29.November 2023
The next step is here: AI trains AI (and no longer needs humans) 28.November 2023
Insta360 Ace Pro - Action Cam with 8K sensor, Leica optics and lots of AI 24.November 2023
Stable Video Diffusion - Free AI diffusion model for video generation presented 23.November 2023
Boris FX: Continuum gets AI functions - denoiser and upscaler 21.November 2023
Meta Emu Video / Edit - improves consistency in generative AI videos 20.November 2023
Adobe AI splits audio clip into different tracks - Project Sound Lift 17.November 2023
alle Newsmeldungen zum Thema KI


[nach oben]
















Archiv Newsmeldungen

2023

December - November - October - September - August - July - June - May - April - March - February - January

2022
December - November - October - September - August - July - June - May - April - March - February - January

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: DeepFaceVideoEditing: KI ermöglicht das Ändern von Gesichtsausdrücken in Videos



last update : 2.Dezember 2023 - 23:03 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version