Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
New Google AI perfectly de-noises RAW photos of dark scenes - soon also from video?

New Google AI perfectly de-noises RAW photos of dark scenes - soon also from video?

[14:23 Sun,28.August 2022   by ]    

A team of Google researchers has developed an algorithm that can use multiple (noisy) RAW photos of a dark scene taken from different angles to generate low-noise, brighter images that show much more detail than the original photos. The new, MultiNeRF method is based on the Neural Radiance Fields (NeRF) technique, which can synthesize new views from multiple images from different perspectives, and has been enhanced with the ability to work with dark photos.

RAW-NeRF-Beispiel1
Demo of RawNeRF





The new method, called RawNeRF, complements the previous algorithm so that it can create new synthetic views that also use noisy RAW raw material. It is demonstrated, among other things, using the example of a scene photographed with a smartphone and lit only by a candle. The smartphone does produce a fairly vivid image, but at the cost of losing a lot of detail. The RAW version of the photo, on the other hand, shows much more detail when the brightness of the image is increased, but at the cost of much more noise.




When the images are fed into the RawNeRF algorithm, clear bright images are generated - or, if desired, a virtual tracking shot that shows the original dark scene, along with the otherwise hard-to-see objects, much brighter and without image noise. RawNeRF uses a relatively large amount of noisy RAW photos (25-200) and, according to the researchers, outperforms dedicated previous single-frame and multi-frame denoising methods that use the same photo series. I

NeRF-pipeline


But the method is not limited to that - it offers other interesting possibilities to change the representation of the newly synthesized view: for example, not only the perspective, but also the exposure of the scene, the tone mapping as well as the focus can be changed dynamically afterwards.



So the new algorithm can be used to create interesting animations of photos, but for filmmakers it might be especially interesting to apply the denoising method also to low-light (RAW) videos of dark scenes with a lot of noise, which are nothing else than sequences of single frames. Although the image sensors of professional cameras are much larger and thus more light-sensitive than those of smartphone cameras, the method should also enable significant image improvements of dark images here.


Here is the as always very entertaining and educational presentation of MultiNeRF by "2 Minute Papers":


Experience shows that useful new image techniques from research will soon find their way into commercial (or even open source) software for the user - so we can hope for high-quality denoising of even low-light photos or videos soon. Here the research paper ("NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images") plus links to the code.

RAW-NeRF-Beispiel2


Link more infos at bei bmild.github.io

deutsche Version dieser Seite: Neue Google KI entrauscht RAW Photos dunkler Szenen perfekt - bald auch Videos?

  

  Vorige News lesen Nächste News lesen 
bildSamsung 990 PRO: Neues NVMe SSD Spitzenmodell kommt mit 7.450 MB/s an die Grenze von PCIe 4.0 bildMehr Vollformat 1.6x-Anamorphoten und ein 1.25x Adapter von Sirui


related news:1E0Whisper: New free AI turns speech into text and automatically translates into all languages 26.September 2022
VFX made easy: animate faces and fake voices with AI 22.September 2022
AI images with stable diffusion can now be used directly ni Photoshop and Gimp via plugin 18.September 2022
Generate and edit personalized images via AI 15.September 2022
Free image generation via AI: Stable Diffusion now with easy Windows Installer 13.September 2022
Insta360 X3 - 360° actioncam with new image sensors and KI functions 11.September 2022
How to produce an animated fashion show with free AI tools 2.September 2022
alle Newsmeldungen zum Thema Machine Learning
1E0LETsDOK: Nationwide Documentary Film Days 11.September 2022
DeepFake instead of reshoot: swear words retroactively removed from feature film 19.August 2022
Mega fraud: YouTube pays 23 Millionen Dollar to content-ID scammers 17.August 2022
New AI automatically perfectly exposes objects from photos 7.August 2022
Film simulation tool Dehancer Film Pro now also available as beta for Final Cut Pro 2.August 2022
Sony Future Filmmaker competition entices with visit to Sony Pictures film studios in Hollywood 1.August 2022
Large online auction of over 2,000 pieces of professional film equipment: ARRI, Canon, RED, ZEISS... 28.July 2022
alle Newsmeldungen zum Thema Film


[nach oben]
















Archiv Newsmeldungen

2022

September - August - July - June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Neue Google KI entrauscht RAW Photos dunkler Szenen perfekt - bald auch Videos?



last update : 28.September 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version