Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· KI· Reviews· Streaming
/// News
See in the dark by AI with color

See in the dark by AI with color

[19:22 Sun,22.May 2022   by ]    

Light-sensitive camera sensors that can record images even in very dark conditions usually also use the near infrared spectrum (NIR). Similarly, special night vision systems can detect infrared light and convert it into images that can be perceived by humans. However, images taken in this way suffer from the fact that - similar to the human eye at night - they no longer show the original colors, but only pixels differentiated by their brightness. For this reason, scientists at the University of California have now developed a deep-learning algorithm that can be used to transform monochromatic images taken by an infrared camera into colored photos even in complete darkness (plus infrared light).


infra-plus-deep
Face in visible light and reconstruction of colors by neural network from infrared image only


The new imaging algorithm, based on optimized deep-learning architectures, can use the infrared image of a scene to predict the scene&s appearance in the visible spectrum and render it as if it were illuminated by light in the spectrum visible to humans. Thus, a scene could be digitally rendered in the visible spectrum for humans, i.e., in color, even if it is otherwise in complete darkness and illuminated only by infrared light.

To this end, the researchers used a monochromatic camera sensitive to visible and near-infrared light to capture an image dataset of printed images of faces under multispectral illumination that includes standard visible wavelengths of red (604 nm), green (529 nm) and blue (447 nm), as well as infrared (at 718, 777 and 807 nm). A neural network was then trained to predict visible spectrum images from near-infrared images only.

color-and-infra
Object illuminated by visible and infrared light.


The new algorithm was indeed able to predict visible spectrum images from near infrared information only. However, the neural network trained in the research work only with human faces. In order to be able to correctly colorize scenes with other objects, such scenes would have to be trained accordingly in the future. Then this method would be a perfect complement, for example, for the new AI method (recently presented) by us www.slashcam.de/news/single/Nur-Sternenlicht-als-Beleuchtung--Neuer-KI-Algorit-17213.html, which is able to remove the image noise almost completely from videos recorded under extremely weak illumination of fractions of a lux.

Link more infos at bei journals.plos.org

deutsche Version dieser Seite: In der Dunkelheit farbig sehen: KI gibt schwarz-weißen Infrarotbildern die Farbe zurück

  

  Vorige News lesen Nächste News lesen 
bildAOC Agon Pro AG274QZM mit MiniLED, HDR1000 und 97% DCI-P3 Abdeckung angekündigt bildAMD Ryzen 7000 und Mendocino - neue Prozessoren für Herbst angekündigt


related news:1E0New NVIDIA Eye Contact AI Effect: Bye bye Teleprompter? 25.January 2023
The total remix: New AI Tune-A-Video makes new videos from old clips 24.January 2023
Big comparison test: upscaling via AI - which tool is best? Free or Paid? 23.January 2023
OpenAI VALL-E: New AI mimics any voice - using only 3s voice sample 9.January 2023
New NVIDIA Video Super Resolution AI scales video from 1080p to 4K 6.January 2023
AMD's mobile Ryzen 70xx with Zen 4, RDNA 3 and XDNA AI 5.January 2023
Photoshoots plus AI: Is this what the future of photography looks like? 27.December 2022
alle Newsmeldungen zum Thema Machine Learning
1E0DJI RS ‎3 ‎Mini - light weight gimbal for vertical filming 10.January 2023
Loupedeck Live S: Freely configurable control panel for streaming and more 2.December 2022
Indiegogo campaign for Pro version of Rotolight Neo 3 and AES 2 - 14 days left 4.November 2022
Apple iPhone 14 and iPhone 14 Pro: emergency call via satellite, better low-light recordings and act 8.September 2022
New Rotolight app enables LED lighting control via smartphone 19.August 2022
MT Pro - Aputure introduce their first full-color mini LED tube light 5.August 2022
Zhiyun Weebill 3: Professional one-hand gimbal for DSLRs and DSLMs integrated light and mic 16.June 2022
alle Newsmeldungen zum Thema Lighting
1E0DJI RS ‎3 ‎Mini - light weight gimbal for vertical filming 10.January 2023
Apple iPhone 14 and iPhone 14 Pro: emergency call via satellite, better low-light recordings and act 8.September 2022
New Rotolight app enables LED lighting control via smartphone 19.August 2022
Panasonic S5, S1, S1H and BS1H: Firmware updates bring improved white balance settings with Blackmag 9.August 2022
MT Pro - Aputure introduce their first full-color mini LED tube light 5.August 2022
Zhiyun Weebill 3: Professional one-hand gimbal for DSLRs and DSLMs integrated light and mic 16.June 2022
Zhiyun Crane-M2 S: one-hand gimbal with its own light for compact cameras and smartphones 10.March 2022
alle Newsmeldungen zum Thema Lighting


[nach oben]
















Archiv Newsmeldungen

2023

January

2022
December - November - October - September - August - July - June - May - April - March - February - January

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: In der Dunkelheit farbig sehen: KI gibt schwarz-weißen Infrarotbildern die Farbe zurück



last update : 27.Januar 2023 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version