Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
Video editing via AI: Simply replace backgrounds or make objects disappear

Video editing via AI: Simply replace backgrounds or make objects disappear

[13:06 fri,21.January 2022   by ]    

A team of researchers from Israel&s Weizmann Institute of Science and Adobe Research has unveiled an interesting new algorithm that represents another milestone on the road to easy-to-use object-based video editing via AI, even for beginners.





The algorithm analyzes the input video and decomposes it into foreground (objects) and background. What is special about this is that the algorithm develops an understanding of the objects and their relationships in space from the 2D video and can thus manipulate individual objects and the background spatially correctly, including, for example, occlusions, i.e. when a moving object is briefly obscured.

Stylized


This makes it easy, for example, to change the background of a video, to manipulate (moving) objects in the foreground (including - as can be seen in the example video - the fabric of a dress with the inclusion of a fold that changes while walking), or to remove objects from a video in a very classical way. And the algorithm copes with changes in the background or foreground resulting from movements, even a moving water surface or dynamic reflections and shadows.

Such manipulations, which are actually complex, work thanks to the new method by simply editing a single frame of the background or foreground - the adjustments to perspective or motion are then handled by the algorithm.

Ship


The method is not yet perfect, but it is already better and, above all, much easier and more universal to use than previous ones. If it is further optimized in the future, this algorithm could perhaps replace traditional chroma keying via green screen in many cases.

Neuro-Path


Adobe has already proven with its AI Sensei technology that interesting AI research in the field of video can also be incorporated into consumer software such as Adobe&s Premiere Pro, for example at changing facial expressions after the fact or transcribing dialogs. We are curious to see when the new technology will be ready for use in Premiere Pro, for example, but its potential to simplify complicated tasks in video editing is great.

And here is the presentation of the new algorithm by 2 Minute Papers:


Link more infos at bei layered-neural-atlases.github.io

deutsche Version dieser Seite: Video Editing per KI läßt Objekte verschwinden und ersetzt Hintergründe

  

  Vorige News lesen Nächste News lesen 
bildSamsung Odyssey Neo G Monitor mit Quantum Mini LED Display und 2.000 nits Helligkeit bildKostenloses Einsteigertraining-Webinar für DaVinci Resolve von Blackmagic


related news:1E0Audio Design Desk 1.9: Real-time editing tool for sound effects now with new features and Lite versi 15.January 2022
Hedge Postlab for Media Composer enables team editing in the cloud for Avid editors 6.November 2021
Sony C3 Portal: Cloud solution for Sony cameras - from shooting directly to the editing suite 23.September 2021
Perfect for music videos: Spatial object-based video editing via AI and 16 cameras 19.September 2021
Adobe acquires Frame.io to strenghten collaborative editing with Premiere Pro 21.August 2021
Magix Vegas 19 available - including BRAW Editing and Text-to-Speech 19.August 2021
Audio Design Desk 1.7: Real-time editing tool for SFX now with DAW synchronization 18.July 2021
alle Newsmeldungen zum Thema Montage
1E0Illuminated only by starlight: New AI algorithm denoises videos perfectly 16.May 2022
NAB 2022 Tutorialclip: DaVinci Resolve 18 - AI-Mask Objects, Depth Mask, Surface Tracker 27.April 2022
AI helps to synchronize motion pictures 16.April 2022
Apple Final Cut Pro update brings duplicate detection and voice isolation via AI 13.April 2022
DALL-E 2: AI generates and edits images based on text description only 10.April 2022
AI generates frighteningly accurate portraits - based on voice alone 9.April 2022
New AJA Ki Pro GO firmware 4.0 brings new playback options 3.April 2022
alle Newsmeldungen zum Thema Machine Learning
1E0Adobe Premiere Pro Update 22.4 brings 10x faster 4:2:0 HEVC export 12.May 2022
Open source video editor Olive 0.2 said to be nearing completion 9.May 2022
NAB 2022 Interview: Camera to Cloud, Frame IO and Premiere Pro 2.May 2022
NAB 2022 Tutorialclip/Interview: How does Frame.IO work in Premiere Pro? 28.April 2022
Camera app FiLMiC Pro gets support for Frame.io Camera-to-Cloud 22.April 2022
Apple Final Cut Pro update brings duplicate detection and voice isolation via AI 13.April 2022
Canon's first full-frame cine zooms cover 20-50mm and 45-135mm focal lengths 12.April 2022
alle Newsmeldungen zum Thema DV Editing


[nach oben]
















Archiv Newsmeldungen

2022

May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Video Editing per KI läßt Objekte verschwinden und ersetzt Hintergründe



last update : 18.Mai 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version