Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
Omnimatte: Nearly perfect masks of moving objects via AI

Omnimatte: Nearly perfect masks of moving objects via AI

[12:14 fri,27.August 2021   by ]    

As early as last year, a deep-learning algorithm developed by researchers at Google and Oxford University achieved astonishing results in recognizing moving objects in a video and manipulating them in a targeted manner. For example, people could be removed from a video almost without a trace, or the timing of their movements could be changed.





A new version of the algorithm from the same team (plus researchers from Israel&s Weizmann Institute of Science) now delivers even better results because it detects not only the objects but also their secondary effects, such as shadows or reflections. This means that objects can even be removed from moving videos together with the complex dynamic effects they cause, such as waves and clouds of dust or smoke.

Omnimatte-examplexs


Starting from an input video ("Original" in the image above) and rough masks of the objects ("Input mask"), the algorithm creates an omnimatte - an alpha matte "Omnimatte (alpha)" including the foreground color "Omnimatte (RGBA)", which contains the person itself and all scene elements associated with it, as well as the background ("Background") without the selected objects and their secondary tracks in the image.

The method allows very easy creation of moving masks/layers of multiple objects together with their correlating tracks in the image and their simple manipulation (such as by retiming) in a compositing program. The possibilities of intelligent, object-based video editing and compositing by such an algorithm are enormous: for example, for the purpose of a better image composition, the movements of objects in a video can be completely changed afterwards, objects can be removed from the video or multiplied (stroboscope effect) or, for example, the color can be changed selectively.

Stroboskop-Effekt
Stroboscope effect via Omnimatte


How well the new method works can be seen on the following page Here are numerous videos with different motifs from which moving objects were removed. The study itself can be downloaded here - and here the program code.

As always, the new method is not yet perfect and also the resolution of the videos is still very low due to the high computing power required - but it shows the fast progress of on.

Here is the presentation of the "Ominimatte" method (also in comparison to the predecessor) by Two Minute Papers:


Link more infos at bei omnimatte.github.io

deutsche Version dieser Seite: Omnimatte: Nahezu perfekte Masken bewegter Objekte per KI

  

  Vorige News lesen Nächste News lesen 
bildDokumentarfilm-Festival Longshots: Filme kostenlos anschauen und abstimmen bildTilta Kühlungsmodul für Canon R5/R6 ist jetzt tatsächlich erhältlich


related news:1E0fylm.ai: Professional AI-supported color grading via browser 16.October 2021
AI learns to fight - and synthesizes new martial arts moves 10.October 2021
AI separates music into separate vocal and accompaniment audio tracks 20.September 2021
Perfect for music videos: Spatial object-based video editing via AI and 16 cameras 19.September 2021
Nvidia Broadcast App 1.3: Better live streaming and video conferencing via AI 6.September 2021
Per DeepFake itself star in the movie trailer of 22.August 2021
Alias-Free GAN: Nvidia's AI creates even more realistic animations of faces 27.July 2021
alle Newsmeldungen zum Thema Machine Learning


[nach oben]
















Archiv Newsmeldungen

2021

October - September - August - July - June - May - April - March - February - January

2020
December - November - October - September - August - July - June - May - April - March - February - January

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Omnimatte: Nahezu perfekte Masken bewegter Objekte per KI



last update : 18.Oktober 2021 - 15:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version