Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· KI· Reviews· Streaming
/// News
New Google AI perfectly de-noises RAW photos of dark scenes - soon also from video?

New Google AI perfectly de-noises RAW photos of dark scenes - soon also from video?

[14:23 Sun,28.August 2022   by ]    

A team of Google researchers has developed an algorithm that can use multiple (noisy) RAW photos of a dark scene taken from different angles to generate low-noise, brighter images that show much more detail than the original photos. The new, MultiNeRF method is based on the Neural Radiance Fields (NeRF) technique, which can synthesize new views from multiple images from different perspectives, and has been enhanced with the ability to work with dark photos.

RAW-NeRF-Beispiel1
Demo of RawNeRF





The new method, called RawNeRF, complements the previous algorithm so that it can create new synthetic views that also use noisy RAW raw material. It is demonstrated, among other things, using the example of a scene photographed with a smartphone and lit only by a candle. The smartphone does produce a fairly vivid image, but at the cost of losing a lot of detail. The RAW version of the photo, on the other hand, shows much more detail when the brightness of the image is increased, but at the cost of much more noise.




When the images are fed into the RawNeRF algorithm, clear bright images are generated - or, if desired, a virtual tracking shot that shows the original dark scene, along with the otherwise hard-to-see objects, much brighter and without image noise. RawNeRF uses a relatively large amount of noisy RAW photos (25-200) and, according to the researchers, outperforms dedicated previous single-frame and multi-frame denoising methods that use the same photo series. I

NeRF-pipeline


But the method is not limited to that - it offers other interesting possibilities to change the representation of the newly synthesized view: for example, not only the perspective, but also the exposure of the scene, the tone mapping as well as the focus can be changed dynamically afterwards.



So the new algorithm can be used to create interesting animations of photos, but for filmmakers it might be especially interesting to apply the denoising method also to low-light (RAW) videos of dark scenes with a lot of noise, which are nothing else than sequences of single frames. Although the image sensors of professional cameras are much larger and thus more light-sensitive than those of smartphone cameras, the method should also enable significant image improvements of dark images here.


Here is the as always very entertaining and educational presentation of MultiNeRF by "2 Minute Papers":


Experience shows that useful new image techniques from research will soon find their way into commercial (or even open source) software for the user - so we can hope for high-quality denoising of even low-light photos or videos soon. Here the research paper ("NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images") plus links to the code.

RAW-NeRF-Beispiel2


Link more infos at bei bmild.github.io

deutsche Version dieser Seite: Neue Google KI entrauscht RAW Photos dunkler Szenen perfekt - bald auch Videos?

  

  Vorige News lesen Nächste News lesen 
bildSamsung 990 PRO: Neues NVMe SSD Spitzenmodell kommt mit 7.450 MB/s an die Grenze von PCIe 4.0 bildMehr Vollformat 1.6x-Anamorphoten und ein 1.25x Adapter von Sirui


related news:1E0First pictures, then sounds: New Google AI generates arbitrary music according to text description 30.January 2023
New NVIDIA Eye Contact AI Effect: Bye bye Teleprompter? 25.January 2023
The total remix: New AI Tune-A-Video makes new videos from old clips 24.January 2023
Big comparison test: upscaling via AI - which tool is best? Free or Paid? 23.January 2023
OpenAI VALL-E: New AI mimics any voice - using only 3s voice sample 9.January 2023
New NVIDIA Video Super Resolution AI scales video from 1080p to 4K 6.January 2023
AMD's mobile Ryzen 70xx with Zen 4, RDNA 3 and XDNA AI 5.January 2023
alle Newsmeldungen zum Thema Machine Learning
1E0DZO Film completes affordable full-frame cine zoom series Catta Ace with 18-35mm T2.9 17.January 2023
Cinecred: Create professional movie credits easily with free tool 10.January 2023
ARRI'amp;s virtual film set for the Netflix series 31.December 2022
million lawsuit because character from movie trailer missing from film 26.December 2022
Zoom introduces new MicTrak 32-bit float microphone and recorder series 19.December 2022
Story & Film App - film planning on the smartphone from the idea to the cut 14.November 2022
AI copies movie style of "Into the Spider-Verse" in record time 14.November 2022
alle Newsmeldungen zum Thema Film


[nach oben]
















Archiv Newsmeldungen

2023

February - January

2022
December - November - October - September - August - July - June - May - April - March - February - January

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Neue Google KI entrauscht RAW Photos dunkler Szenen perfekt - bald auch Videos?



last update : 2.Februar 2023 - 08:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version