Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· KI· Reviews· Streaming
/// News
Nvidia Instant NeRF - 3D scene from 2D images in record time

Nvidia Instant NeRF - 3D scene from 2D images in record time

[13:02 Mon,28.March 2022   by ]    

A process known as "inverse rendering" uses artificial intelligence (AI) to mimic the behavior of light in the real world, allowing researchers to reconstruct a 3D scene from a handful of 2D images taken from different angles. NVIDIA has applied this approach to new AI technology called Neural Radiance Fields (NeRFs), which are designed to produce results particularly quickly - and appropriately christened the process "Instant NeRF."

NeRFs use neural networks to display and render realistic 3D scenes based on a collection of 2D images. To do this, the neural network needs a few dozen images taken from different positions around the scene - as well as the camera position for each of those shots. For a scene with people or other moving elements, the faster these shots are taken, the better. If too much movement occurs during 2D image capture, the 3D scene generated by the AI will be blurred.



NerF



A NeRF then fills in the gaps by training a small neural network to reconstruct the scene by predicting the color of light radiating from each point in 3D space in each direction. If objects seen in some images are obscured by obstacles such as columns in others, the technique can even factor out those obscurations.

Creating a 3D scene using traditional methods takes hours or longer, depending on the complexity and resolution of the visualization. Early NeRF models rendered crisp scenes without artifacts in minutes, but still required hours to train.
Instant NeRF, on the other hand, cuts rendering time by several orders of magnitude. The result is said to be the fastest NeRF technique to date, achieving more than 1,000x speedup in some cases. The model takes only a few seconds to train on a few dozen photos - though it also needs data on the camera angles from which they were taken. It can then render the resulting 3D scene within ten milliseconds. Since it is a lightweight neural network, it can be trained and run on a single NVIDIA GPU.



Instant NeRF was unveiled this week at the NVIDIA GPU Technolgy Conference and could be used to create avatars or scenes for virtual worlds, capture video conference participants and their surroundings in 3D, or reconstruct scenes for 3D digital maps. So, of course, this technology fits very well with the current hype around the upcoming metaverses.



deutsche Version dieser Seite: Nvidia Instant NeRF - 3D-Szene aus 2D-Bildern in Rekordzeit

  

  Vorige News lesen Nächste News lesen 
bildOscars 2022: "Coda" von Apple TV+ bester Film - Dune mit den meisten Einzeltiteln bildBlackmagic Design DaVinci Resolve Version 17.4.6 Update - u.a. mit Nikon RAW


related news:1E0Runway Gen1: New video AI stylizes videos, masks objects, renders 3D models 6.February 2023
Nvidia Magic3D - create any 3D object by text description 29.November 2022
AvatarCLIP: New AI generates and animates 3D avatars by text description 28.October 2022
Luma AI: New smartphone app creates 3D models of any object 21.October 2022
DreamFusion: New Google AI generates 3D models by text description only 11.October 2022
Nvidia creates editable 3D model from photos of an object 24.June 2022
The 35mm film camera from the 3D printer 20.May 2022
alle Newsmeldungen zum Thema 3D
1E0VideoFusion: First open source video AI is here - and also runs on the home PC 20.March 2023
Apple: New Macs before launch - is the new Mac Pro with M2 Ultra finally coming? 10.March 2023
New Nvidia AI generates images 30x faster than Stable Diffusion 8.March 2023
Stream more effectively: FFmpeg 6.0 brings among other things acceleration of AV1 via GPU 1.March 2023
Free AI tool NVIDIA Canvas: design photorealistic dream landscapes yourself 15.February 2023
More beautiful time-lapse shots thanks to new NVIDIA AI 11.February 2023
Have fun with NVIDIA's new eye contact effect: Robert De Niro looks you in the eye 27.January 2023
alle Newsmeldungen zum Thema Computers


[nach oben]
















Archiv Newsmeldungen

2023

March - February - January

2022
December - November - October - September - August - July - June - May - April - March - February - January

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Nvidia Instant NeRF - 3D-Szene aus 2D-Bildern in Rekordzeit



last update : 29.März 2023 - 14:24 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version