Logo Logo
deutsch
directory schraeg
Knowledge

Hardware
Actioncam / 360°· Camcorders· Cinema-Kamera· Kamera(technik)· Kamera-Zubehör· Kameradrohnen· Lenses· Smartphone-Kamera· Video-DSLM/DSLR
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Filmmaking· Generative KI
Misc
Audio· Live-Streaming· Sonstige
/// News
Video editing via AI: Simply replace backgrounds or make objects disappear

Video editing via AI: Simply replace backgrounds or make objects disappear

[13:06 Fri,21.January 2022   by ]    

A team of researchers from Israel&s Weizmann Institute of Science and Adobe Research has unveiled an interesting new algorithm that represents another milestone on the road to easy-to-use object-based video editing via AI, even for beginners.





The algorithm analyzes the input video and decomposes it into foreground (objects) and background. What is special about this is that the algorithm develops an understanding of the objects and their relationships in space from the 2D video and can thus manipulate individual objects and the background spatially correctly, including, for example, occlusions, i.e. when a moving object is briefly obscured.

Stylized


This makes it easy, for example, to change the background of a video, to manipulate (moving) objects in the foreground (including - as can be seen in the example video - the fabric of a dress with the inclusion of a fold that changes while walking), or to remove objects from a video in a very classical way. And the algorithm copes with changes in the background or foreground resulting from movements, even a moving water surface or dynamic reflections and shadows.

Such manipulations, which are actually complex, work thanks to the new method by simply editing a single frame of the background or foreground - the adjustments to perspective or motion are then handled by the algorithm.

Ship


The method is not yet perfect, but it is already better and, above all, much easier and more universal to use than previous ones. If it is further optimized in the future, this algorithm could perhaps replace traditional chroma keying via green screen in many cases.

Neuro-Path


Adobe has already proven with its AI Sensei technology that interesting AI research in the field of video can also be incorporated into consumer software such as Adobe&s Premiere Pro, for example at changing facial expressions after the fact or transcribing dialogs. We are curious to see when the new technology will be ready for use in Premiere Pro, for example, but its potential to simplify complicated tasks in video editing is great.

And here is the presentation of the new algorithm by 2 Minute Papers:


Link more infos at bei layered-neural-atlases.github.io

deutsche Version dieser Seite: Video Editing per KI läßt Objekte verschwinden und ersetzt Hintergründe

  

  Vorige News lesen Nächste News lesen 
bildSamsung Odyssey Neo G Monitor mit Quantum Mini LED Display und 2.000 nits Helligkeit bildKostenloses Einsteigertraining-Webinar für DaVinci Resolve von Blackmagic


related news:1E0Meta Emu AI image generator - free online, but currently only in the USA 7.December 2023
SDXL-Turbo - New AI algorithm accelerates stable diffusion dramatically 6.December 2023
PIKA 1.0 announced - Generative AI videos with amazing quality 29.November 2023
The next step is here: AI trains AI (and no longer needs humans) 28.November 2023
Insta360 Ace Pro - Action Cam with 8K sensor, Leica optics and lots of AI 24.November 2023
Stable Video Diffusion - Free AI diffusion model for video generation presented 23.November 2023
Boris FX: Continuum gets AI functions - denoiser and upscaler 21.November 2023
alle Newsmeldungen zum Thema KI
1E0Control panel for AI video editing - 1stAI Machine 10.November 2023
Filmora 13 - Video editing with many AI features incl. text-based editing 31.October 2023
YouTube: new editing app available - and video AI tools coming soon 22.September 2023
Atomos Edit Public Beta available - cloud-based video editing for fastest possible playout 27.June 2023
Node-based editing for After Effects - Hollywood Illusion launches Magic Nodes 1.5 31.May 2023
Atomos Edit introduced: Online Editing Coupled with Connect/Coud Capabilities 28.April 2023
Asus ROG Ally: Gaming handheld as an ultra-mobile editing system? 27.April 2023
alle Newsmeldungen zum Thema Montage
1E0Apple Final Cut Pro updates for iOS and MacOS available: Automatic timeline scrolling, voice-over and much more. 1.December 2023
Black Friday deals 2023 for photo+video - Part 1 with DJI, AVID, DZOfilm, Hollyland, Zhiyun... 17.November 2023
Blackmagic DaVinci Resolve 18.6.3 Update - including more proxy options 14.November 2023
Control panel for AI video editing - 1stAI Machine 10.November 2023
Apple announces major Final Cut Pro updates for Mac and iPad 7.November 2023
Filmora 13 - Video editing with many AI features incl. text-based editing 31.October 2023
New Adobe Premiere Pro and After Effects versions 24.0 released 12.October 2023
alle Newsmeldungen zum Thema DV Editing


[nach oben]
















Archiv Newsmeldungen

2023

December - November - October - September - August - July - June - May - April - March - February - January

2022
December - November - October - September - August - July - June - May - April - March - February - January

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Video Editing per KI läßt Objekte verschwinden und ersetzt Hintergründe



last update : 7.Dezember 2023 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version