Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
Change the background of videos by description via AI

Change the background of videos by description via AI

[22:37 Sat,13.August 2022   by ]    

We already reported about the AI-supported image generator DALL-E 2 and about the fact that it is only a matter of time until something similar will be available for videos. Now it&s almost time - sooner than expected: Heidelberg AI researcher Patrick Esser has shown a demonstration on Twitter of what text-based editing of video will soon be possible as part of the online video editor Runway, where Esser works. A short clip featuring a tennis player shows how the background of the tennis court is dynamically changed using only different text prompts.


Tennis-court-duo
Tennis court original and on the moon


For example, the background of the tennis court becomes a beach or the match takes place on the moon or in a fantasy landscape. In the demo clip, the dynamic cropping of the tennis player including shadow and ball seems to be done in real time, including tracking of the motion to move the background correctly, as well as the generation of a new background. It is not yet possible to judge how good the image quality will ultimately be due to the fairly low quality of the clip, but once the feature is implemented, various aspects of the algorithm can also be improved quite easily by optimizing the algorithm and adding more computing power.



This demo shows a still quite early stage of Machine Learning based functions - only the background seems to be changeable - but it already impressively shows what powerful functions will soon be possible by object based editing/generation of videos (be it like here with text commands or also by sketches).

Tennis-court-beach
Tennis court on the beach


The collaborative online video editor Runway already offers some interesting AI features like intelligent removal or masking of objects. We are curious when the new functionality shown here will be available.

Link more infos at bei twitter.com

deutsche Version dieser Seite: KI statt Greenscreen: Videohintergründe per Kommandozeile ändern

  

  Vorige News lesen Nächste News lesen 
bildNeue Intel Arc Pro Desktop GPUs für Workstations - bahnt sich Konkurrenz für Nvidia und AMD an? bildSeagate kündigt 30 TB Festplatten für 2023 an, 50 TB und mehr sollen 2026 kommen


related news:1E0Whisper: New free AI turns speech into text and automatically translates into all languages 26.September 2022
VFX made easy: animate faces and fake voices with AI 22.September 2022
AI images with stable diffusion can now be used directly ni Photoshop and Gimp via plugin 18.September 2022
Generate and edit personalized images via AI 15.September 2022
Free image generation via AI: Stable Diffusion now with easy Windows Installer 13.September 2022
Insta360 X3 - 360° actioncam with new image sensors and KI functions 11.September 2022
How to produce an animated fashion show with free AI tools 2.September 2022
alle Newsmeldungen zum Thema Machine Learning


[nach oben]
















Archiv Newsmeldungen

2022

September - August - July - June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: KI statt Greenscreen: Videohintergründe per Kommandozeile ändern



last update : 28.September 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version