.footer { } Logo Logo
deutsch
/// News
New February Updates (22.2) for Adobe Premiere Pro and After Effects - Remix and Speech to Text

Define video masks simply by description using new AI algorithm

[13:21 Wed,1.December 2021   by Thomas Richter]    

This new Deep Learning algorithm from a team in Israel does something very interesting for video editing: based on a simple description of an object in a video in the form of a short sentence, it recognizes the object and exposes it via mask.

TextMask-Example




The description of the desired object can be quite complex and can also describe it by dynamic relations to other objects or its position in space, like "a man in a white T-shirt and blue pants riding a surfboard", "a big monkey playing with a baby monkey", "the zebra in the back on the right standing behind another one looking to the left" or "a person on a motorcycle".

TextMask-Algo


To do this, the AI algorithm performs a whole series of complex tasks from the areas of text and video understanding: first it must "understand" the input text, then it must correctly recognize all the objects in a video, including dynamic relationships, and identify the correct object based on the description given by the user (including its properties, such as its color and relationships to another object, such as "the tennis racket in the hand of the player with the, red shirt").



Then the object must be separated from the background and tracked across all frames in which it appears, forming a dynamic mask from it - even as it changes appearance through movement and perspective changes. This no longer has to be adjusted by hand afterwards. Even dynamic actions that span a video sequence are correctly detected in a longer video, such as "the hand giving the dog a ball."

TextMask-Examples


The new algorithm demonstrates quite vividly the complex tasks that can now be accomplished by combining different Deep Learning methods. It could be used, for example, to find specific objects in a video archive together with their relationship to other objects and to extract them.
As always, the corresponding program code can also be tried out for yourself - assuming the appropriate prior knowledge.

Link more infos at bei github.com

deutsche Version dieser Seite: Videomasken einfach per Beschreibung definieren durch neuen KI-Algorithmus

  



[nach oben]












Archiv Newsmeldungen

2025

July - June - May - April - March - February - January

2024
December - November - October - September - August - July - June - May - April - March - February - January

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Videomasken einfach per Beschreibung definieren durch neuen KI-Algorithmus



last update : 5.Juli 2025 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version