Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· GPU· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Reviews
/// News
From 30fps to 480fps: Smooth frame rates and extreme slow motion thanks to AI

From 30fps to 480fps: Smooth frame rates and extreme slow motion thanks to AI

[14:14 tue,21.January 2020   by ]    

In many areas, new AI/Deep Learning algorithms are revolutionizing the way we work with video - one area of this is the intelligent interpolation of frame rates, i.e. the calculation of one (or even several) frames between two existing frames of a video. The problem is to interpolate movements of objects in a way that they are logically continued on the synthesized images. This can only work really well if the algorithm can not only identify objects (and parts of them) and interpolate their movement and shape changes, but also recognize in which spatial depth which object is located in order to correctly predict mutual occlusions.





This (and more) is done by the new DAIN (Depth-Aware Video FrameFrame im Glossar erklärt Interpolation) algorithm developed by a research team from the universities of Shanghai and California plus Google. It uses four different neural networks (one each for Optical Flow Estimation, Depth Estimation, Content Extraction and Kernel Estimation) for the different problems of correct interpolation and then synthesizes their results into a video. The result works amazingly well - as you can see from the embedded sample videos below - and demonstrates what is state-of-the-art in frame interpolation.

This is not only useful for making animations more fluid afterwards - (old) 24p footage can also be interpolated to 60fps afterwards. Another application would be to record 8K e.g. as a single frame sequence and subsequently pump it up to a higher frame rate.

In the following video a 16x smooth slow motion is calculated by DAIN:



Also the limitation of REDs new Komodo camera of 6K with 40 fps could be lifted by interpolated 60p.

DAIN-Workflow
The DAIN Workflow



Someone has kindly put together code from DAIN in the form of a DAIN app for Windows. This way, every user can easily test how well the interpolation of the frame rate via DAIN works on the basis of his own video material - however, CUDA is required for the calculation.

DAIN-APP
DAIN App



The app is still at an early stage and is not yet optimized (and therefore 1 GB in size). Depending on the GPU power, the calculations can take quite a long time. Post your experiences, we are curious!

Even more examples:



Harryhausen animations:


Link more infos at bei sites.google.com

deutsche Version dieser Seite: Von 30fps zu 480fps: Flüssige Bildraten und extreme Zeitlupen Dank KI

  

  Vorige News lesen Nächste News lesen 
bildVideogrüße aus Absurdistan: David Lynchs neuer Kurzfilm What Did Jack Do? Jetzt auf Netflix bildNeuer Edelkrone JibONE Mini-Jib-Arm für automatisierte Kamerafahrten und -schwenks


related news:1E0Blackmagic Desktop Video 11.5 update brings HDR support to Adobe Premiere Pro 17.February 2020
iOS video editing app LumaFusion 2.2 with Final Cut Pro X XML export of projects 17.February 2020
Adobe Premiere Rush 1.5 available with new audio function 11.February 2020
Indie film editing: Adobe increasingly popular among Sundance productions 5.February 2020
Audio Design Desk: New real-time editing of sound effects in the timeline 2.February 2020
Magix introduces new live streaming solution Vegas STREAM 31.January 2020
About the award-winning editing of Parasite -- live first edting on set, hidden VFX cuts and FCP 7 26.January 2020
alle Newsmeldungen zum Thema DV Editing


[nach oben]
















Archiv Newsmeldungen

2020

February - January

2019
December - November - October - September - August - July - June - May - April - March - February - January

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Von 30fps zu 480fps: Flüssige Bildraten und extreme Zeitlupen Dank KI



last update : 26.Februar 2020 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version