Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
TecoGAN: New AI Super-Resolution Algorithm makes video 4x sharper

TecoGAN: New AI Super-Resolution Algorithm makes video 4x sharper

[11:45 sun,6.September 2020   by ]    

Actually, it is common sense that missing details in blurred images cannot be added afterwards. However, so-called super resolution methods have been developed for quite some time to sharpen images afterwards, for example by using information from previous and subsequent images to supplement the information of an image or by trying to recognize known patterns in an image section which can be supplemented.

Over the years, we have had several articles about the different stages of development of Super-Resolution, such as ehr Bildschärfe durch künstliche Intelligenz - Super-Resolution and Grundlagen : Hocus Bogus - Super-Resolution.


TecoGAN-Examples
TecoGAN Examples





Through (deep-layered) neural networks, these super resolution procedures have made great progress in terms of quality and speed in recent years, since they are perfectly suited for recognizing (blurred) structures in a large number of images, even in unknown images, by means of training, and for supplementing these structures with more image information through their existing knowledge, thus sharpening them.

Strictly speaking, however, this is not about the realistic recovery of lost information, but rather about "guessing" based on experience, similar to what human perception often does (which can be well observed with some optical illusions).

TecoGAN-Smoke
TecoGAN smoke


First such procedures were developed for photos or single images from videos, then also for whole videos. The training is simple - clips are played in low resolution and based on the originals the algorithm then evaluates how well it has just "guessed" the lost content and then improves the next guessing attempt.



Up to now, however, such methods have suffered from the fact that jumps between successive images often occurred because the algorithm - whether due to artifacts or image noise - believed it could recognize different patterns and complemented them. The TecoGAN algorithm of the Technical University of Munich, which has just been presented at Siggraph 2020, now achieves great progress in exactly this aspect and generates spatially and temporally coherent image sequences. The results are truly astonishing - the clips resulting from blurred videos are clearly visible 4x sharper and show more details.

The possibilities for a good and reliable sharpening afterwards are of course fascinating. Old films could be extrapolated to a higher resolution or in the future a sharpening could be done in the camera and generate sharper images than the respective sensor and the actual LGA can produce.

Here the TecoGAN algorithm is explained a bit more:



And even more examples:

ge.in.tum.de/wp-content/uploads/2020/05/ClickMe.html

If you want and have the necessary knowledge, you can try TecoGAN yourself, the code can be found at here on GitHub.

Link more infos at bei ge.in.tum.de

deutsche Version dieser Seite: TecoGAN: Neuer KI Super-Resolution Algorithmus macht Videos 4x schärfer

  

  Vorige News lesen Nächste News lesen 
bildWestern Digital ArmorLock: Mobile sichere SSD mit Entschlüsselung per Smartphone bildNetflix optimiert seine 4K Filme und spart 50% Daten


related news:1E0Zoom introduces F8N Pro field recorder with 32bit Float and dual AD-converter 28.February 2022
Zoom F3 - professional mini field recorder with XLR and 32-bit float 19.January 2022
Google'amp;s new super-resolution algorithm SR3 upscales faces almost perfectly 14.July 2021
New firmware turns RØDE Wireless GO II transmitter into field recorder 1.April 2021
New Dell UltraSharp U4021QW: 40-inch monitor with 5K resolution and Thunderbolt 3 6.January 2021
Zoom F2 Field Recorder - extra small with 32-bit float technology 11.November 2020
Neural network DAIN interpolates stop-motion frames 9.September 2020
alle Newsmeldungen zum Thema Basics
1E0Is AI Revolutionizing Photography? Object-based editing with the help of DALL-E 2 30.June 2022
DaVinci Resolve 18 Beta 5 - incl. AI stabilizer for gyro metadata and 10 bit preview 25.June 2022
See in the dark by AI with color 22.May 2022
Illuminated only by starlight: New AI algorithm denoises videos perfectly 16.May 2022
NAB 2022 Tutorialclip: DaVinci Resolve 18 - AI-Mask Objects, Depth Mask, Surface Tracker 27.April 2022
AI helps to synchronize motion pictures 16.April 2022
Apple Final Cut Pro update brings duplicate detection and voice isolation via AI 13.April 2022
alle Newsmeldungen zum Thema Machine Learning


[nach oben]
















Archiv Newsmeldungen

2022

July - June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: TecoGAN: Neuer KI Super-Resolution Algorithmus macht Videos 4x schärfer



last update : 5.Juli 2022 - 16:42 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version