Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
TecoGAN: New AI Super-Resolution Algorithm makes video 4x sharper

TecoGAN: New AI Super-Resolution Algorithm makes video 4x sharper

[11:45 sun,6.September 2020   by ]    

Actually, it is common sense that missing details in blurred images cannot be added afterwards. However, so-called super resolution methods have been developed for quite some time to sharpen images afterwards, for example by using information from previous and subsequent images to supplement the information of an image or by trying to recognize known patterns in an image section which can be supplemented.

Over the years, we have had several articles about the different stages of development of Super-Resolution, such as ehr Bildschärfe durch künstliche Intelligenz - Super-Resolution and Grundlagen : Hocus Bogus - Super-Resolution.


TecoGAN-Examples
TecoGAN Examples





Through (deep-layered) neural networks, these super resolution procedures have made great progress in terms of quality and speed in recent years, since they are perfectly suited for recognizing (blurred) structures in a large number of images, even in unknown images, by means of training, and for supplementing these structures with more image information through their existing knowledge, thus sharpening them.

Strictly speaking, however, this is not about the realistic recovery of lost information, but rather about "guessing" based on experience, similar to what human perception often does (which can be well observed with some optical illusions).

TecoGAN-Smoke
TecoGAN smoke


First such procedures were developed for photos or single images from videos, then also for whole videos. The training is simple - clips are played in low resolution and based on the originals the algorithm then evaluates how well it has just "guessed" the lost content and then improves the next guessing attempt.



Up to now, however, such methods have suffered from the fact that jumps between successive images often occurred because the algorithm - whether due to artifacts or image noise - believed it could recognize different patterns and complemented them. The TecoGAN algorithm of the Technical University of Munich, which has just been presented at Siggraph 2020, now achieves great progress in exactly this aspect and generates spatially and temporally coherent image sequences. The results are truly astonishing - the clips resulting from blurred videos are clearly visible 4x sharper and show more details.

The possibilities for a good and reliable sharpening afterwards are of course fascinating. Old films could be extrapolated to a higher resolution or in the future a sharpening could be done in the camera and generate sharper images than the respective sensor and the actual LGA can produce.

Here the TecoGAN algorithm is explained a bit more:



And even more examples:

ge.in.tum.de/wp-content/uploads/2020/05/ClickMe.html

If you want and have the necessary knowledge, you can try TecoGAN yourself, the code can be found at here on GitHub.

Link more infos at bei ge.in.tum.de

deutsche Version dieser Seite: TecoGAN: Neuer KI Super-Resolution Algorithmus macht Videos 4x schärfer

  

  Vorige News lesen Nächste News lesen 
bildWestern Digital ArmorLock: Mobile sichere SSD mit Entschlüsselung per Smartphone bildNetflix optimiert seine 4K Filme und spart 50% Daten


related news:1E0Google'amp;s new super-resolution algorithm SR3 upscales faces almost perfectly 14.July 2021
New firmware turns RØDE Wireless GO II transmitter into field recorder 1.April 2021
New Dell UltraSharp U4021QW: 40-inch monitor with 5K resolution and Thunderbolt 3 6.January 2021
Zoom F2 Field Recorder - extra small with 32-bit float technology 11.November 2020
Neural network DAIN interpolates stop-motion frames 9.September 2020
Canon EOS R5 and R6 - Stabilized full frame up to 8K RAW with Dual Pixel AF 9.July 2020
8K and Dual Pixel AF in new Samsung ISOCELL GN1 smartphone camera sensor 25.May 2020
alle Newsmeldungen zum Thema Basics
1E0Alias-Free GAN: Nvidia's AI creates even more realistic animations of faces 27.July 2021
New Parrot Anafi Ai drone can be flown via LTE 19.July 2021
Deep yes, fake no? Documentary filmmaker uses AI generated quotes 18.July 2021
Topaz Video Enhance AI 2.3: New super slow motion via AI and discount promotion 2.July 2021
In color and 4K: Pornhub restores over 100 years old porn movies via AI 11.June 2021
Flim: AI-based film still search gets intelligence upgrade 4.June 2021
Professional AI speakers for everyone? MARVEL.ai 27.May 2021
alle Newsmeldungen zum Thema Machine Learning


[nach oben]
















Archiv Newsmeldungen

2021

August - July - June - May - April - March - February - January

2020
December - November - October - September - August - July - June - May - April - March - February - January

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: TecoGAN: Neuer KI Super-Resolution Algorithmus macht Videos 4x schärfer



last update : 3.August 2021 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version