Logo Logo
directory schraeg
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Compositing· Color correction· DV Editing

Shooting· Sound
Forschung· Reviews· Streaming
/// News
AI generates 3D scenes from photos

AI generates 3D scenes from photos

[16:10 sun,27.September 2020   by ]    

The new NeRF-W algorithm, christened NeRF-W by a team of Google researchers, uses a neural network of multiple photos of a scene to create a model that allows new images of the scene to be synthesized from additional, previously unavailable perspectives and even produces virtual camera movements. This is demonstrated very nicely in the following clip using the example of the Brandenburger Tor and the Fontana di Trevi, among others:

A challenge for the Neural Radiance FieldField im Glossar erklärt (NeRF) based algorithm is the extremely different light and weather conditions of the different photos and other dynamic differences between the shooting situations, such as visual obstructions like cars, people or signs, from which it must abstract in order to obtain a 3D model of the static objects including the prevailing lighting conditions of a scene.

Input photos with different lighting conditions

This allows both camera pans and zooms. In addition, the model allows to change the look of the new virtual views, for example to simulate the special lighting conditions of a certain light situation (midday, night with headlights).

Generated Output

The method naturally has difficulties with those parts of a scene that only appear in a few photos because they tend to be in the background and are only visible from certain perspectives. The nice thing about the new method is that you can use any photo from the net, which was taken by different users with different cameras. The training using 8 GPUs for a scene with several hundred photos took about 2 days.
§PIC3:NeRF-W Algorithm
The "2 Minute Papoers" clip beautifully demonstrates the great progress that the new method has achieved within only a few months compared to the predecessor model:

We remember a very early predecessor from 2007, Microsoft&s Photosynth, which was able to create 3D models of the photos in space from photos using a completely different method than NeRF-W.

Bild zur Newsmeldung:

Link more infos at bei nerf-w.github.io

deutsche Version dieser Seite: KI generiert virtuelle Kamerafahrten aus Photos


  Vorige News lesen Nächste News lesen 
bildLaowa 14mm f/4 FF RL Zero-D - leichtes Ultraweitwinkel-Objektiv bildCine-Optik speziell für S35: Meike Prime 35mm T2.1

related news:1E0Epic Games MetaHuman Creator: Realistic 3D Models of Humans with a Single Click 19.April 2021
Adobe After Effects 18.0 update brings real-time 3D design preview and multi-frame rendering 12.March 2021
Sony FX9 v2.0 update released with FF5K-Crop, C4K, HLG, User 3D-LUTs, RAW-Ausgabe und mehr 10.September 2020
miniDSP ambiMIK-1: Ambisonic USB microphone for 3D 360° audio 16.August 2020
3D LUTs now also available for Fujifilm X-T4 -- including Bleach Bypass 29.April 2020
Nikon: New REC 709 N-Log 3D LUT for Nikon D780 DSLR as free download 11.March 2020
New system allows subsequent modification of illumination of 3D body capturings 27.November 2019
alle Newsmeldungen zum Thema 3D
1E0In color and 4K: Pornhub restores over 100 years old porn movies via AI 11.June 2021
Flim: AI-based film still search gets intelligence upgrade 4.June 2021
Professional AI speakers for everyone? MARVEL.ai 27.May 2021
Visual dubbing by AI makes every actor a native speaker 25.May 2021
Colourlab Ai 1.2: New camera profile tool and new formats 30.April 2021
Dynascore Musik-Engine -- AI times background music to videos 19.April 2021
Simon Says : Audio transcription via AI now available in Adobe Premiere Pro 18.April 2021
alle Newsmeldungen zum Thema Machine Learning

[nach oben]

Archiv Newsmeldungen


June - May - April - March - February - January

December - November - October - September - August - July - June - May - April - March - February - January





















deutsche Version dieser Seite: KI generiert virtuelle Kamerafahrten aus Photos

last update : 15.Juni 2021 - 12:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version