Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· GPU· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Reviews
/// News
TecoGAN: New AI Super-Resolution Algorithm makes video 4x sharper

TecoGAN: New AI Super-Resolution Algorithm makes video 4x sharper

[11:45 sun,6.September 2020   by ]    

Actually, it is common sense that missing details in blurred images cannot be added afterwards. However, so-called super resolution methods have been developed for quite some time to sharpen images afterwards, for example by using information from previous and subsequent images to supplement the information of an image or by trying to recognize known patterns in an image section which can be supplemented.

Over the years, we have had several articles about the different stages of development of Super-Resolution, such as ehr Bildschärfe durch künstliche Intelligenz - Super-Resolution and Grundlagen : Hocus Bogus - Super-Resolution.


TecoGAN-Examples
TecoGAN Examples





Through (deep-layered) neural networks, these super resolution procedures have made great progress in terms of quality and speed in recent years, since they are perfectly suited for recognizing (blurred) structures in a large number of images, even in unknown images, by means of training, and for supplementing these structures with more image information through their existing knowledge, thus sharpening them.

Strictly speaking, however, this is not about the realistic recovery of lost information, but rather about "guessing" based on experience, similar to what human perception often does (which can be well observed with some optical illusions).

TecoGAN-Smoke
TecoGAN smoke


First such procedures were developed for photos or single images from videos, then also for whole videos. The training is simple - clips are played in low resolution and based on the originals the algorithm then evaluates how well it has just "guessed" the lost content and then improves the next guessing attempt.



Up to now, however, such methods have suffered from the fact that jumps between successive images often occurred because the algorithm - whether due to artifacts or image noise - believed it could recognize different patterns and complemented them. The TecoGAN algorithm of the Technical University of Munich, which has just been presented at Siggraph 2020, now achieves great progress in exactly this aspect and generates spatially and temporally coherent image sequences. The results are truly astonishing - the clips resulting from blurred videos are clearly visible 4x sharper and show more details.

The possibilities for a good and reliable sharpening afterwards are of course fascinating. Old films could be extrapolated to a higher resolution or in the future a sharpening could be done in the camera and generate sharper images than the respective sensor and the actual LGA can produce.

Here the TecoGAN algorithm is explained a bit more:



And even more examples:

ge.in.tum.de/wp-content/uploads/2020/05/ClickMe.html

If you want and have the necessary knowledge, you can try TecoGAN yourself, the code can be found at here on GitHub.

Link more infos at bei ge.in.tum.de

deutsche Version dieser Seite: TecoGAN: Neuer KI Super-Resolution Algorithmus macht Videos 4x schärfer

  

  Vorige News lesen Nächste News lesen 
bildWestern Digital ArmorLock: Mobile sichere SSD mit Entschlüsselung per Smartphone bildNetflix optimiert seine 4K Filme und spart 50% Daten


related news:1E0Neural network DAIN interpolates stop-motion frames 9.September 2020
Canon EOS R5 and R6 - Stabilized full frame up to 8K RAW with Dual Pixel AF 9.July 2020
8K and Dual Pixel AF in new Samsung ISOCELL GN1 smartphone camera sensor 25.May 2020
More details about the Canon EOS R5 -- Dual Pixel CMOS AF also in 8K mode 13.March 2020
Hgher resolution for 360°: Kandao QooCam 8K Kamera announced 9.November 2019
Interesting Concept for HDR-Sensor from Germany - Self-Reset Pixel Cells 16.October 2019
Full format Canon EOS C500 MKII with internal (!) 5.9K RAW recording and better Dual Pixel AF // IBC 19.September 2019
alle Newsmeldungen zum Thema Basics


[nach oben]
















Archiv Newsmeldungen

2020

September - August - July - June - May - April - March - February - January

2019
December - November - October - September - August - July - June - May - April - March - February - January

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: TecoGAN: Neuer KI Super-Resolution Algorithmus macht Videos 4x schärfer



last update : 22.September 2020 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version