Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
Video editing via AI: Simply replace backgrounds or make objects disappear

Video editing via AI: Simply replace backgrounds or make objects disappear

[13:06 Fri,21.January 2022   by ]    

A team of researchers from Israel&s Weizmann Institute of Science and Adobe Research has unveiled an interesting new algorithm that represents another milestone on the road to easy-to-use object-based video editing via AI, even for beginners.





The algorithm analyzes the input video and decomposes it into foreground (objects) and background. What is special about this is that the algorithm develops an understanding of the objects and their relationships in space from the 2D video and can thus manipulate individual objects and the background spatially correctly, including, for example, occlusions, i.e. when a moving object is briefly obscured.

Stylized


This makes it easy, for example, to change the background of a video, to manipulate (moving) objects in the foreground (including - as can be seen in the example video - the fabric of a dress with the inclusion of a fold that changes while walking), or to remove objects from a video in a very classical way. And the algorithm copes with changes in the background or foreground resulting from movements, even a moving water surface or dynamic reflections and shadows.

Such manipulations, which are actually complex, work thanks to the new method by simply editing a single frame of the background or foreground - the adjustments to perspective or motion are then handled by the algorithm.

Ship


The method is not yet perfect, but it is already better and, above all, much easier and more universal to use than previous ones. If it is further optimized in the future, this algorithm could perhaps replace traditional chroma keying via green screen in many cases.

Neuro-Path


Adobe has already proven with its AI Sensei technology that interesting AI research in the field of video can also be incorporated into consumer software such as Adobe&s Premiere Pro, for example at changing facial expressions after the fact or transcribing dialogs. We are curious to see when the new technology will be ready for use in Premiere Pro, for example, but its potential to simplify complicated tasks in video editing is great.

And here is the presentation of the new algorithm by 2 Minute Papers:


Link more infos at bei layered-neural-atlases.github.io

deutsche Version dieser Seite: Video Editing per KI läßt Objekte verschwinden und ersetzt Hintergründe

  

  Vorige News lesen Nächste News lesen 
bildSamsung Odyssey Neo G Monitor mit Quantum Mini LED Display und 2.000 nits Helligkeit bildKostenloses Einsteigertraining-Webinar für DaVinci Resolve von Blackmagic


related news:1E0Mobile editing app LumaFusion: New version 3.2 - and now also for Android 11.November 2022
Video editing by text command: After text-to-image comes text-to-video 11.September 2022
LumaFusion v3.1 update - mobile editing app now offers video scopes 20.July 2022
Is AI Revolutionizing Photography? Object-based editing with the help of DALL-E 2 30.June 2022
Events @ Filmfest München: Series editing, studio tour and more 20.June 2022
Audio Design Desk 1.9: Real-time editing tool for sound effects now with new features and Lite versi 15.January 2022
Hedge Postlab for Media Composer enables team editing in the cloud for Avid editors 6.November 2021
alle Newsmeldungen zum Thema Montage
1E0Meta Encodec uses AI to compress audio files significantly more than MP3 21.November 2022
AI copies movie style of "Into the Spider-Verse" in record time 14.November 2022
MAXIM - AI tool combines various image enhancements in one model 13.November 2022
Blackmagic DaVinci Resolve 18.1 Update - with AI voice isolation 11.November 2022
Photostock portal Shutterstock gives an answer to the big question and integrates AI images 5.November 2022
AvatarCLIP: New AI generates and animates 3D avatars by text description 28.October 2022
Topaz Video Enhance AI 3.0: New AI features and special price 24.October 2022
alle Newsmeldungen zum Thema Machine Learning
1E0UPDATE 2: Black Friday and Cyber Monday deals from Avid, Laowa, Filmconvert, Viltrox and more. 25.November 2022
Mobile editing app LumaFusion: New version 3.2 - and now also for Android 11.November 2022
Even more Black Friday deals: Blackmagic, Smallrig, Pinnacle, Anton Bauer, Glidecam, Amar 10.November 2022
Stabilized Canon full-frame RF 135mm F1.8 L IS USM lens announced for January 2023 3.November 2022
New Apple Mac Pro with M2 Extreme chip with 48 CPU and 152 GPU cores and 256 GB delayed 1.November 2022
BRAW Toolbox allows native Blackmagic RAW file import under Final Cut Pro 1.November 2022
Apple unveils updates for better performance for Final Cut Pro, Compressor, iMovie, and more 27.October 2022
alle Newsmeldungen zum Thema DV Editing


[nach oben]
















Archiv Newsmeldungen

2022

November - October - September - August - July - June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Video Editing per KI läßt Objekte verschwinden und ersetzt Hintergründe



last update : 29.November 2022 - 15:09 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version