Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
AI calculates video clip from image sequence - ADOP

AI calculates video clip from image sequence - ADOP

[11:59 tue,30.November 2021   by ]    

This is not the first time that AI has been used to try to compute intermediate images from a sequence of images. However, the quality of ADOP (Approximate Differentiable One-Pixel Point Rendering) now achieved is so good that the paper made it into the popular stream of Two Minute Papers.

KI-Pic2vid





In fact, the visual impression of the AI interpolation with ADOP is hardly distinguishable from reality, unless the program is confronted with extremely hard-to-resolve problems (including reflective surfaces or moving objects between images). A slight flickering of surfaces is also occasionally noticeable, but hardly anyone would suspect from the playground video shown that it was created from a sequence of images.



It's also worth noting that the work was done entirely at Friedrich Alexander University, or rather at its Chair of Computer Graphics in Erlangen. If one skims over the research work of the three authors (Darius Rückert, Linus Franke and Marc Stamminger) there, ADOP seems to have been just one project among many.

If you have some compiler and AI experience, you can get the project running yourself thanks to the Github page as a C++/CUDA/ libTorch project. A fast Nvidia GPU should be sufficient for acceptable training times.

On the Github page you can also find an experimental VR viewer for the interpolated scene, as well as a tool that generates HDR scenes if the input image sequences were captured with different exposures.

As you can well see, AI opens here a wide field of application beyond frame interpolation, which we will surely find in various commercial applications in the next years. And "computational cinematography" will certainly not disappear any more...



deutsche Version dieser Seite: KI berechnet Videoclip aus Bildsequenz - ADOP

  

  Vorige News lesen Nächste News lesen 
bildKompaktes 2x Makro-Objektiv: Laowa 85mm f/5.6 2x Ultra Macro APO vorgestellt bildSony stellt wegen Chipmangel die Produktion von Sony Alpha 7 II, Alpha 6100/6400 und PXW-Z190 ein


related news:1E0CAME-TV 5.4 24.January 2022
Video editing via AI: Simply replace backgrounds or make objects disappear 21.January 2022
Irix 21mm T1.5 - one more wide angle cine lens 13.January 2022
Micro LED, Neo QLED and (not yet) QD OLED - Samsung's TV technologies 2022 3.January 2022
Say again? Why some movie dialogs are so hard to understand 7.December 2021
Disney combines CGI with AI for movie-like facial animations 5.December 2021
Hedge Postlab for Media Composer enables team editing in the cloud for Avid editors 6.November 2021
alle Newsmeldungen zum Thema Film
1E0Video editing via AI: Simply replace backgrounds or make objects disappear 21.January 2022
HumanNeRF - AI models human bodies 14.January 2022
Try it out for yourself: This AI changes the age of faces 12.December 2021
Disney combines CGI with AI for movie-like facial animations 5.December 2021
Adobe shows AI tools to change facial expressions in videos - Project Morpheus 4.December 2021
Neural Nano Optics -With Metamaterial Optics and AI to the Salt Grain Camera 2.December 2021
Define video masks simply by description using new AI algorithm 1.December 2021
alle Newsmeldungen zum Thema Machine Learning
1E0Filmmaker Mode for TVs takes ambient light into account in the future 10.January 2022
DJI introduces modular action camera - Action 2 - with innovative magnetic clips 27.October 2021
Sony C3 Portal: Cloud solution for Sony cameras - from shooting directly to the editing suite 23.September 2021
NAB 2021 takes place in October - IBC 2021 is postponed to December 1.June 2021
Better than DJI?: New 4K 60p footage from Sony's Airpeak drone with mounted A7S III 24.May 2021
The First 100 Years: The Evolution of Car Chases in Film 11.April 2021
Enlightening Golem interview on 20 years of VLC player 6.March 2021
alle Newsmeldungen zum Thema Shooting


[nach oben]
















Archiv Newsmeldungen

2022

January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: KI berechnet Videoclip aus Bildsequenz - ADOP



last update : 28.Januar 2022 - 12:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version