[11:18 Sun,29.November 2020 by Thomas Richter] |
And again, some AI magic: a new neural algorithm can exchange the sky and its special lighting mood in videos. Already the first version had opened up very interesting possibilities in 2017 (even if the resulting videos were not perfect) and were able to convert daytime shots into night shots or winter into summer shots quite convincingly - including changing the lighting and reflections of these (new) lights in (moving) image objects. ;) Day to night 2017
The new version ("Dynamic Sky Replacement and Harmonization in Videos") focuses on a different aspect of sky substitution - it allows not only to replace the sky, but also to fade in objects such as a castle in the air or change the weather. A whole series of related operations must be performed to achieve the final result, such as detecting camera movement, separating the sky and the rest of the scene into different layers, and replacing the sky with the image of another, including the adjustment of lighting. The results of the new algorithm are relatively high-quality - with a single NVIDIA Titan XP graphics card, it achieves real-time processing speed (24 fps) at an output resolution of 640 x 320 pixels and near real-time processing speed (15 fps) at a resolution of 854 x 480 pixels.  As always, the "Sky Replacement" algorithm for photos has been around for a long time and is therefore already used in commercial photo editing programs like Photos Adobe Photoshop and Luminar - similar algorithms for videos are more and more complicated, because in addition to the actual function, a temporal consistency between the individual images has to be ensured. ;) Day to night 2020 It probably won&t be too long before the new algorithm will also find its way into video editing or even be available as a filter on the smartphone for videos, making possible what only large film productions have been able to do so far: a credible exchange of the sky including lighting mood, for example to make a scene more dramatic. Here is a comparison of the results of an exchange of the sky in photos using Adobe Photoshop 2021 and Luminar 4:  more infos at bei jiupinjia.github.iodeutsche Version dieser Seite: KI ersetzt den Himmel in Videos und macht den Tag zur Nacht |
 |
|
|