Logo Logo
directory schraeg
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Compositing· Color correction· DV Editing

Shooting· Sound
Forschung· Reviews· Streaming
/// News
AI calculates video clip from image sequence - ADOP

AI calculates video clip from image sequence - ADOP

[11:59 Tue,30.November 2021   by ]    

This is not the first time that AI has been used to try to compute intermediate images from a sequence of images. However, the quality of ADOP (Approximate Differentiable One-Pixel Point Rendering) now achieved is so good that the paper made it into the popular stream of Two Minute Papers.


In fact, the visual impression of the AI interpolation with ADOP is hardly distinguishable from reality, unless the program is confronted with extremely hard-to-resolve problems (including reflective surfaces or moving objects between images). A slight flickering of surfaces is also occasionally noticeable, but hardly anyone would suspect from the playground video shown that it was created from a sequence of images.

It's also worth noting that the work was done entirely at Friedrich Alexander University, or rather at its Chair of Computer Graphics in Erlangen. If one skims over the research work of the three authors (Darius Rückert, Linus Franke and Marc Stamminger) there, ADOP seems to have been just one project among many.

If you have some compiler and AI experience, you can get the project running yourself thanks to the Github page as a C++/CUDA/ libTorch project. A fast Nvidia GPU should be sufficient for acceptable training times.

On the Github page you can also find an experimental VR viewer for the interpolated scene, as well as a tool that generates HDR scenes if the input image sequences were captured with different exposures.

As you can well see, AI opens here a wide field of application beyond frame interpolation, which we will surely find in various commercial applications in the next years. And "computational cinematography" will certainly not disappear any more...

deutsche Version dieser Seite: KI berechnet Videoclip aus Bildsequenz - ADOP


  Vorige News lesen Nächste News lesen 
bildKompaktes 2x Makro-Objektiv: Laowa 85mm f/5.6 2x Ultra Macro APO vorgestellt bildSony stellt wegen Chipmangel die Produktion von Sony Alpha 7 II, Alpha 6100/6400 und PXW-Z190 ein

related news:1E0New AI automatically perfectly exposes objects from photos 7.August 2022
Film simulation tool Dehancer Film Pro now also available as beta for Final Cut Pro 2.August 2022
Sony Future Filmmaker competition entices with visit to Sony Pictures film studios in Hollywood 1.August 2022
Large online auction of over 2,000 pieces of professional film equipment: ARRI, Canon, RED, ZEISS... 28.July 2022
Cinematic HFR: Titanic and Avatar get 25.July 2022
How Everything Everywhere All At Once was filmed 24.July 2022
Netflix removes movie noise, saves 30% bandwidth and adds it back again 21.July 2022
alle Newsmeldungen zum Thema Film
1E0New AI automatically perfectly exposes objects from photos 7.August 2022
AI-based grading solution fylm.ai v1.3 learns some context 26.July 2022
Anyone can do art: Meta's new AI acts as a painter at will 19.July 2022
Video stabilization: AI-supported Mercalli V6 SAL introduced 18.July 2022
Is AI Revolutionizing Photography? Object-based editing with the help of DALL-E 2 30.June 2022
DaVinci Resolve 18 Beta 5 - incl. AI stabilizer for gyro metadata and 10 bit preview 25.June 2022
See in the dark by AI with color 22.May 2022
alle Newsmeldungen zum Thema Machine Learning
1E0Hollyland Lark M1: Affordable two-channel wireless clip-on microphone system 6.July 2022
NAB 2022 Interview: Camera to Cloud, Frame IO and Premiere Pro 2.May 2022
NAB 2022 Interview: Tilta's mobile, affordable shoulder rest for DSLMs to compact cine cams 30.April 2022
NAB 2022 Tutorialclip/Interview: How does Frame.IO work in Premiere Pro? 28.April 2022
NAB 2022 Interview: Atomos and Shogun Connect - powerful cloud tools coming 26.April 2022
NAB 2022 interview: Blackmagic Design - User Senarios for the New Cloud Products 25.April 2022
DJI Mic: 2-channel clip-on wireless microphone system with two transmitters 5.April 2022
alle Newsmeldungen zum Thema Shooting

[nach oben]

Archiv Newsmeldungen


August - July - June - May - April - March - February - January

December - November - October - September - August - July - June - May - April - March - February - January






















deutsche Version dieser Seite: KI berechnet Videoclip aus Bildsequenz - ADOP

last update : 10.August 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version