Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
Nvidia Instant NeRF - 3D scene from 2D images in record time

Nvidia Instant NeRF - 3D scene from 2D images in record time

[13:02 mon,28.March 2022   by ]    

A process known as "inverse rendering" uses artificial intelligence (AI) to mimic the behavior of light in the real world, allowing researchers to reconstruct a 3D scene from a handful of 2D images taken from different angles. NVIDIA has applied this approach to new AI technology called Neural Radiance Fields (NeRFs), which are designed to produce results particularly quickly - and appropriately christened the process "Instant NeRF."

NeRFs use neural networks to display and render realistic 3D scenes based on a collection of 2D images. To do this, the neural network needs a few dozen images taken from different positions around the scene - as well as the camera position for each of those shots. For a scene with people or other moving elements, the faster these shots are taken, the better. If too much movement occurs during 2D image capture, the 3D scene generated by the AI will be blurred.



NerF



A NeRF then fills in the gaps by training a small neural network to reconstruct the scene by predicting the color of light radiating from each point in 3D space in each direction. If objects seen in some images are obscured by obstacles such as columns in others, the technique can even factor out those obscurations.

Creating a 3D scene using traditional methods takes hours or longer, depending on the complexity and resolution of the visualization. Early NeRF models rendered crisp scenes without artifacts in minutes, but still required hours to train.
Instant NeRF, on the other hand, cuts rendering time by several orders of magnitude. The result is said to be the fastest NeRF technique to date, achieving more than 1,000x speedup in some cases. The model takes only a few seconds to train on a few dozen photos - though it also needs data on the camera angles from which they were taken. It can then render the resulting 3D scene within ten milliseconds. Since it is a lightweight neural network, it can be trained and run on a single NVIDIA GPU.



Instant NeRF was unveiled this week at the NVIDIA GPU Technolgy Conference and could be used to create avatars or scenes for virtual worlds, capture video conference participants and their surroundings in 3D, or reconstruct scenes for 3D digital maps. So, of course, this technology fits very well with the current hype around the upcoming metaverses.



deutsche Version dieser Seite: Nvidia Instant NeRF - 3D-Szene aus 2D-Bildern in Rekordzeit

  

  Vorige News lesen Nächste News lesen 
bildOscars 2022: "Coda" von Apple TV+ bester Film - Dune mit den meisten Einzeltiteln bildBlackmagic Design DaVinci Resolve Version 17.4.6 Update - u.a. mit Nikon RAW


related news:1E0The 35mm film camera from the 3D printer 20.May 2022
Four new analog 65mm IMAX film cameras in development 21.March 2022
Simulated Reality - Dimenco SR Pro Display offers 3D without glasses 19.February 2022
3D objects without 3D scanner - Moves by Maxon in Cinema4D 14.December 2021
Blackmagic: New Micro Converter 12G models with 3D LUTs and 4K support 16.November 2021
Epic Games MetaHuman Creator: Realistic 3D Models of Humans with a Single Click 19.April 2021
Adobe After Effects 18.0 update brings real-time 3D design preview and multi-frame rendering 12.March 2021
alle Newsmeldungen zum Thema 3D
1E0AMD previews processor future Ryzen 7000 and Mendocino 23.May 2022
Razer Blade 15 OLED: First notebook with 240 Hz OLED display 9.May 2022
First Intel Arc GPUs are available - competition for AMD and Nvidia? 31.March 2022
MSI: New CreatorPro workstations with new Nvidia RTX A5500 GPU with 16 GB VRAM 24.March 2022
Numerous new workstation GPUs from Nvidia - including RTX A5500. 23.March 2022
Free Nvidia AI tool: Animate faces simply by speech in real time 14.March 2022
First Apple M1 Ultra benchmarks: only just behind 64-core AMD Threadripper 3990X 9.March 2022
alle Newsmeldungen zum Thema Computers


[nach oben]
















Archiv Newsmeldungen

2022

May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Nvidia Instant NeRF - 3D-Szene aus 2D-Bildern in Rekordzeit



last update : 24.Mai 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version