Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
Nvidia Instant NeRF - 3D scene from 2D images in record time

Nvidia Instant NeRF - 3D scene from 2D images in record time

[13:02 Mon,28.March 2022   by ]    

A process known as "inverse rendering" uses artificial intelligence (AI) to mimic the behavior of light in the real world, allowing researchers to reconstruct a 3D scene from a handful of 2D images taken from different angles. NVIDIA has applied this approach to new AI technology called Neural Radiance Fields (NeRFs), which are designed to produce results particularly quickly - and appropriately christened the process "Instant NeRF."

NeRFs use neural networks to display and render realistic 3D scenes based on a collection of 2D images. To do this, the neural network needs a few dozen images taken from different positions around the scene - as well as the camera position for each of those shots. For a scene with people or other moving elements, the faster these shots are taken, the better. If too much movement occurs during 2D image capture, the 3D scene generated by the AI will be blurred.



NerF



A NeRF then fills in the gaps by training a small neural network to reconstruct the scene by predicting the color of light radiating from each point in 3D space in each direction. If objects seen in some images are obscured by obstacles such as columns in others, the technique can even factor out those obscurations.

Creating a 3D scene using traditional methods takes hours or longer, depending on the complexity and resolution of the visualization. Early NeRF models rendered crisp scenes without artifacts in minutes, but still required hours to train.
Instant NeRF, on the other hand, cuts rendering time by several orders of magnitude. The result is said to be the fastest NeRF technique to date, achieving more than 1,000x speedup in some cases. The model takes only a few seconds to train on a few dozen photos - though it also needs data on the camera angles from which they were taken. It can then render the resulting 3D scene within ten milliseconds. Since it is a lightweight neural network, it can be trained and run on a single NVIDIA GPU.



Instant NeRF was unveiled this week at the NVIDIA GPU Technolgy Conference and could be used to create avatars or scenes for virtual worlds, capture video conference participants and their surroundings in 3D, or reconstruct scenes for 3D digital maps. So, of course, this technology fits very well with the current hype around the upcoming metaverses.



deutsche Version dieser Seite: Nvidia Instant NeRF - 3D-Szene aus 2D-Bildern in Rekordzeit

  

  Vorige News lesen Nächste News lesen 
bildOscars 2022: "Coda" von Apple TV+ bester Film - Dune mit den meisten Einzeltiteln bildBlackmagic Design DaVinci Resolve Version 17.4.6 Update - u.a. mit Nikon RAW


related news:1E0Nvidia Magic3D - create any 3D object by text description 29.November 2022
AvatarCLIP: New AI generates and animates 3D avatars by text description 28.October 2022
Luma AI: New smartphone app creates 3D models of any object 21.October 2022
DreamFusion: New Google AI generates 3D models by text description only 11.October 2022
Nvidia creates editable 3D model from photos of an object 24.June 2022
The 35mm film camera from the 3D printer 20.May 2022
Four new analog 65mm IMAX film cameras in development 21.March 2022
alle Newsmeldungen zum Thema 3D
1E0Nvidia Magic3D - create any 3D object by text description 29.November 2022
RTX 4090 - Nvidia suspects application error as reason for cable fires 22.November 2022
Nvidia RTX 4070 Ti available as of January 5 10.November 2022
AMD introduces new graphics card generation - RX 7900 XT(X) with two video engines 4.November 2022
New Apple Mac Pro with M2 Extreme chip with 48 CPU and 152 GPU cores and 256 GB delayed 1.November 2022
New Thunderbolt version will be up to 4x faster: 120 instead of 40 Gbit/s 21.October 2022
Nvidia RTX 4090 successor makes power supplies melt? 11.October 2022
alle Newsmeldungen zum Thema Computers


[nach oben]
















Archiv Newsmeldungen

2022

November - October - September - August - July - June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Nvidia Instant NeRF - 3D-Szene aus 2D-Bildern in Rekordzeit



last update : 29.November 2022 - 12:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version