Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· GPU· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Reviews
/// News
AI generates 3D scenes from photos

AI generates 3D scenes from photos

[16:10 sun,27.September 2020   by ]    

The new NeRF-W algorithm, christened NeRF-W by a team of Google researchers, uses a neural network of multiple photos of a scene to create a model that allows new images of the scene to be synthesized from additional, previously unavailable perspectives and even produces virtual camera movements. This is demonstrated very nicely in the following clip using the example of the Brandenburger Tor and the Fontana di Trevi, among others:





A challenge for the Neural Radiance FieldField im Glossar erklärt (NeRF) based algorithm is the extremely different light and weather conditions of the different photos and other dynamic differences between the shooting situations, such as visual obstructions like cars, people or signs, from which it must abstract in order to obtain a 3D model of the static objects including the prevailing lighting conditions of a scene.

BrandenburgerTor-Input
Input photos with different lighting conditions


This allows both camera pans and zooms. In addition, the model allows to change the look of the new virtual views, for example to simulate the special lighting conditions of a certain light situation (midday, night with headlights).

Trevi-Output
Generated Output


The method naturally has difficulties with those parts of a scene that only appear in a few photos because they tend to be in the background and are only visible from certain perspectives. The nice thing about the new method is that you can use any photo from the net, which was taken by different users with different cameras. The training using 8 GPUs for a scene with several hundred photos took about 2 days.
§PIC3:NeRF-W Algorithm
The "2 Minute Papoers" clip beautifully demonstrates the great progress that the new method has achieved within only a few months compared to the predecessor model:



We remember a very early predecessor from 2007, Microsoft&s Photosynth, which was able to create 3D models of the photos in space from photos using a completely different method than NeRF-W.


Bild zur Newsmeldung:
NN

Link more infos at bei nerf-w.github.io

deutsche Version dieser Seite: KI generiert virtuelle Kamerafahrten aus Photos

  

  Vorige News lesen Nächste News lesen 
bildLaowa 14mm f/4 FF RL Zero-D - leichtes Ultraweitwinkel-Objektiv bildCine-Optik speziell für S35: Meike Prime 35mm T2.1


related news:1E0Sony FX9 v2.0 update released with FF5K-Crop, C4K, HLG, User 3D-LUTs, RAW-Ausgabe und mehr 10.September 2020
miniDSP ambiMIK-1: Ambisonic USB microphone for 3D 360° audio 16.August 2020
3D LUTs now also available for Fujifilm X-T4 -- including Bleach Bypass 29.April 2020
Nikon: New REC 709 N-Log 3D LUT for Nikon D780 DSLR as free download 11.March 2020
New system allows subsequent modification of illumination of 3D body capturings 27.November 2019
Try out 3D-Ken Burns effects with PyTorch yourself 19.November 2019
RED halves the price of the Hydrogen One 3D smartphone 20.October 2019
alle Newsmeldungen zum Thema 3D


[nach oben]
















Archiv Newsmeldungen

2020

October - September - August - July - June - May - April - March - February - January

2019
December - November - October - September - August - July - June - May - April - March - February - January

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: KI generiert virtuelle Kamerafahrten aus Photos



last update : 25.Oktober 2020 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version