Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
Illuminated only by starlight: New AI algorithm denoises videos perfectly

Illuminated only by starlight: New AI algorithm denoises videos perfectly

[12:44 mon,16.May 2022   by ]    

In order to record recognizable videos despite poor lighting conditions, the gain is increased - this makes each pixel more light-sensitive. However, this also increases the noise in each image: the brighter the image is made via gain, the more noise it also produces. With particularly sensitive CMOS cameras, it is currently possible to record videos at night only in moonlight (i.e. an illuminance of only 0.05-0.3 lux), but these are relatively noisy.

Denoise-Photos




A team from Intel Labs and the University of California Berkeley, in a new research paper nicely titled "Dancing under the stars: video denoising in starlight", has now presented a new AI method for denoising videos recorded under extremely low illumination of fractions of a lux.

Noise-Generator


The new deep-learning denoising method is demonstrated using 5-10 fps video recordings with a special RGB plus NIR (near infrared light) camera illuminated only by starlight at 0.6 millilux. The end result is photo-realistic footage with virtually no image noise or other image defects normally associated with low-light conditions. The algorithm was tested with several challenging scenes with lots of motion, where people dance illuminated only by the light of the Milky Way, while a meteor shower rains down from above.



The new algorithm was trained using video footage that was artificially noisy using a special method as well as real noisy video. The artificially noisy videos automatically produced reference material which could be used to estimate how well the denoising works and could be improved based on this (otherwise it is very difficult to record original material together with an otherwise identical noisy version in parallel or successively for moving images).

Denoized


The new algorithm also performs very well in comparison with other methods:


Inserted sensor

.
The extremely fast Canon LI3030 SAI RGB-NIR sensor with a resolution of 2,160 x 1,280 19µm pixels, analog 16-channel output and increased quantum efficiency in the near infrared rangeg (NIR) was used. This uses a Bayer pattern consisting of red, green, blue (RGB) and NIR channels (800-950nm). Each RGB channel has an additional transmittance peak that overlaps with the NIR channel to increase light throughput at night. During daylight, the NIR channel can be subtracted from each RGB channel Channel



Limitations

.
However, the method chosen by the researchers has its limitations. First, the noise generator used for training currently mimics only a single gain setting (in this case, the highest gain). In addition, the colors of the denoised night videos tend to be dull, since a large portion of the image comes from the monochrome near-infrared spectral range. However, special DeepLearning methods could be used to colorize the images correctly in the future.

Translated with www.DeepL.com/Translator (free version)

Link more infos at bei kristinamonakhova.com

deutsche Version dieser Seite: Nur Sternenlicht als Beleuchtung: Neuer KI-Algorithmus entrauscht Videos perfekt

  

  Vorige News lesen Nächste News lesen 
bildSanDisk Professional Pro-Blade: Modulares SSD Speichersystem für Kameras mit USB-C Aufnahme bildNeue SanDisk Extreme Pro microSD und SD UHS-I Karten: Die schnellsten der Welt


related news:1E0Is AI Revolutionizing Photography? Object-based editing with the help of DALL-E 2 30.June 2022
DaVinci Resolve 18 Beta 5 - incl. AI stabilizer for gyro metadata and 10 bit preview 25.June 2022
See in the dark by AI with color 22.May 2022
NAB 2022 Tutorialclip: DaVinci Resolve 18 - AI-Mask Objects, Depth Mask, Surface Tracker 27.April 2022
AI helps to synchronize motion pictures 16.April 2022
Apple Final Cut Pro update brings duplicate detection and voice isolation via AI 13.April 2022
DALL-E 2: AI generates and edits images based on text description only 10.April 2022
alle Newsmeldungen zum Thema Machine Learning


[nach oben]
















Archiv Newsmeldungen

2022

July - June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Nur Sternenlicht als Beleuchtung: Neuer KI-Algorithmus entrauscht Videos perfekt



last update : 5.Juli 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version