Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
See in the dark by AI with color

See in the dark by AI with color

[19:22 sun,22.May 2022   by ]    

Light-sensitive camera sensors that can record images even in very dark conditions usually also use the near infrared spectrum (NIR). Similarly, special night vision systems can detect infrared light and convert it into images that can be perceived by humans. However, images taken in this way suffer from the fact that - similar to the human eye at night - they no longer show the original colors, but only pixels differentiated by their brightness. For this reason, scientists at the University of California have now developed a deep-learning algorithm that can be used to transform monochromatic images taken by an infrared camera into colored photos even in complete darkness (plus infrared light).


infra-plus-deep
Face in visible light and reconstruction of colors by neural network from infrared image only


The new imaging algorithm, based on optimized deep-learning architectures, can use the infrared image of a scene to predict the scene&s appearance in the visible spectrum and render it as if it were illuminated by light in the spectrum visible to humans. Thus, a scene could be digitally rendered in the visible spectrum for humans, i.e., in color, even if it is otherwise in complete darkness and illuminated only by infrared light.

To this end, the researchers used a monochromatic camera sensitive to visible and near-infrared light to capture an image dataset of printed images of faces under multispectral illumination that includes standard visible wavelengths of red (604 nm), green (529 nm) and blue (447 nm), as well as infrared (at 718, 777 and 807 nm). A neural network was then trained to predict visible spectrum images from near-infrared images only.

color-and-infra
Object illuminated by visible and infrared light.


The new algorithm was indeed able to predict visible spectrum images from near infrared information only. However, the neural network trained in the research work only with human faces. In order to be able to correctly colorize scenes with other objects, such scenes would have to be trained accordingly in the future. Then this method would be a perfect complement, for example, for the new AI method (recently presented) by us www.slashcam.de/news/single/Nur-Sternenlicht-als-Beleuchtung--Neuer-KI-Algorit-17213.html, which is able to remove the image noise almost completely from videos recorded under extremely weak illumination of fractions of a lux.

Link more infos at bei journals.plos.org

deutsche Version dieser Seite: In der Dunkelheit farbig sehen: KI gibt schwarz-weißen Infrarotbildern die Farbe zurück

  

  Vorige News lesen Nächste News lesen 
bildAOC Agon Pro AG274QZM mit MiniLED, HDR1000 und 97% DCI-P3 Abdeckung angekündigt bildAMD Ryzen 7000 und Mendocino - neue Prozessoren für Herbst angekündigt


related news:1E0Is AI Revolutionizing Photography? Object-based editing with the help of DALL-E 2 30.June 2022
DaVinci Resolve 18 Beta 5 - incl. AI stabilizer for gyro metadata and 10 bit preview 25.June 2022
Illuminated only by starlight: New AI algorithm denoises videos perfectly 16.May 2022
NAB 2022 Tutorialclip: DaVinci Resolve 18 - AI-Mask Objects, Depth Mask, Surface Tracker 27.April 2022
AI helps to synchronize motion pictures 16.April 2022
Apple Final Cut Pro update brings duplicate detection and voice isolation via AI 13.April 2022
DALL-E 2: AI generates and edits images based on text description only 10.April 2022
alle Newsmeldungen zum Thema Machine Learning
1E0Zhiyun Weebill 3: Professional one-hand gimbal for DSLRs and DSLMs integrated light and mic 16.June 2022
Rotolight SmartSoft Box: electronic diffuser attachment as a practical alternative to gels 29.May 2022
Litepanels Gemini 2×1 Hard RGBWW LED Panel with 23,000 Lux 18.May 2022
Aputure introduces cheaper LS600d high-power LED 18.April 2022
Zhiyun Crane-M2 S: one-hand gimbal with its own light for compact cameras and smartphones 10.March 2022
Canon EOS C70 gets Cinema RAW Light Option 19.January 2022
Filmmaker Mode for TVs takes ambient light into account in the future 10.January 2022
alle Newsmeldungen zum Thema Lighting
1E0Zhiyun Weebill 3: Professional one-hand gimbal for DSLRs and DSLMs integrated light and mic 16.June 2022
Zhiyun Crane-M2 S: one-hand gimbal with its own light for compact cameras and smartphones 10.March 2022
ARRI expands Approved Certified Pre-Owned program to include lighting products 17.February 2022
Canon EOS C70 gets Cinema RAW Light Option 19.January 2022
Filmmaker Mode for TVs takes ambient light into account in the future 10.January 2022
Zhiyun Crane M3: New universal one-hand gimbal with integrated light 10.November 2021
Light Storm 1200d Pro: New high-performance LED light from Aputure 27.September 2021
alle Newsmeldungen zum Thema Lighting


[nach oben]
















Archiv Newsmeldungen

2022

June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: In der Dunkelheit farbig sehen: KI gibt schwarz-weißen Infrarotbildern die Farbe zurück



last update : 30.Juni 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version