Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
TecoGAN: New AI Super-Resolution Algorithm makes video 4x sharper

TecoGAN: New AI Super-Resolution Algorithm makes video 4x sharper

[11:45 sun,6.September 2020   by ]    

Actually, it is common sense that missing details in blurred images cannot be added afterwards. However, so-called super resolution methods have been developed for quite some time to sharpen images afterwards, for example by using information from previous and subsequent images to supplement the information of an image or by trying to recognize known patterns in an image section which can be supplemented.

Over the years, we have had several articles about the different stages of development of Super-Resolution, such as ehr Bildschärfe durch künstliche Intelligenz - Super-Resolution and Grundlagen : Hocus Bogus - Super-Resolution.


TecoGAN-Examples
TecoGAN Examples





Through (deep-layered) neural networks, these super resolution procedures have made great progress in terms of quality and speed in recent years, since they are perfectly suited for recognizing (blurred) structures in a large number of images, even in unknown images, by means of training, and for supplementing these structures with more image information through their existing knowledge, thus sharpening them.

Strictly speaking, however, this is not about the realistic recovery of lost information, but rather about "guessing" based on experience, similar to what human perception often does (which can be well observed with some optical illusions).

TecoGAN-Smoke
TecoGAN smoke


First such procedures were developed for photos or single images from videos, then also for whole videos. The training is simple - clips are played in low resolution and based on the originals the algorithm then evaluates how well it has just "guessed" the lost content and then improves the next guessing attempt.



Up to now, however, such methods have suffered from the fact that jumps between successive images often occurred because the algorithm - whether due to artifacts or image noise - believed it could recognize different patterns and complemented them. The TecoGAN algorithm of the Technical University of Munich, which has just been presented at Siggraph 2020, now achieves great progress in exactly this aspect and generates spatially and temporally coherent image sequences. The results are truly astonishing - the clips resulting from blurred videos are clearly visible 4x sharper and show more details.

The possibilities for a good and reliable sharpening afterwards are of course fascinating. Old films could be extrapolated to a higher resolution or in the future a sharpening could be done in the camera and generate sharper images than the respective sensor and the actual LGA can produce.

Here the TecoGAN algorithm is explained a bit more:



And even more examples:

ge.in.tum.de/wp-content/uploads/2020/05/ClickMe.html

If you want and have the necessary knowledge, you can try TecoGAN yourself, the code can be found at here on GitHub.

Link more infos at bei ge.in.tum.de

deutsche Version dieser Seite: TecoGAN: Neuer KI Super-Resolution Algorithmus macht Videos 4x schärfer

  

  Vorige News lesen Nächste News lesen 
bildWestern Digital ArmorLock: Mobile sichere SSD mit Entschlüsselung per Smartphone bildNetflix optimiert seine 4K Filme und spart 50% Daten


related news:1E0New firmware turns RØDE Wireless GO II transmitter into field recorder 1.April 2021
New Dell UltraSharp U4021QW: 40-inch monitor with 5K resolution and Thunderbolt 3 6.January 2021
Zoom F2 Field Recorder - extra small with 32-bit float technology 11.November 2020
Neural network DAIN interpolates stop-motion frames 9.September 2020
Canon EOS R5 and R6 - Stabilized full frame up to 8K RAW with Dual Pixel AF 9.July 2020
8K and Dual Pixel AF in new Samsung ISOCELL GN1 smartphone camera sensor 25.May 2020
More details about the Canon EOS R5 -- Dual Pixel CMOS AF also in 8K mode 13.March 2020
alle Newsmeldungen zum Thema Basics
1E0AnkerWork PowerConf C300 Smart HD webcam with integrated AI support 13.April 2021
Video stabilization via AI: Better than anything before? 12.April 2021
Change age, gender or facial expression of a face via AI Photo Editing 4.April 2021
AI generates photorealistic images according to description 28.March 2021
Flim - the AI search engine for film stills 28.February 2021
Topaz Labs Video Enhance AI 2.0: Video enhancements via AI at a special price 28.February 2021
Colourlab Ai 1.1 brings AI color correction via Look Designer for DaVinci Resolve 27.February 2021
alle Newsmeldungen zum Thema Machine Learning


[nach oben]
















Archiv Newsmeldungen

2021

April - March - February - January

2020
December - November - October - September - August - July - June - May - April - March - February - January

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: TecoGAN: Neuer KI Super-Resolution Algorithmus macht Videos 4x schärfer



last update : 14.April 2021 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version