Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
AI generates 3D scenes from photos

AI generates 3D scenes from photos

[16:10 sun,27.September 2020   by ]    

The new NeRF-W algorithm, christened NeRF-W by a team of Google researchers, uses a neural network of multiple photos of a scene to create a model that allows new images of the scene to be synthesized from additional, previously unavailable perspectives and even produces virtual camera movements. This is demonstrated very nicely in the following clip using the example of the Brandenburger Tor and the Fontana di Trevi, among others:





A challenge for the Neural Radiance FieldField im Glossar erklärt (NeRF) based algorithm is the extremely different light and weather conditions of the different photos and other dynamic differences between the shooting situations, such as visual obstructions like cars, people or signs, from which it must abstract in order to obtain a 3D model of the static objects including the prevailing lighting conditions of a scene.

BrandenburgerTor-Input
Input photos with different lighting conditions


This allows both camera pans and zooms. In addition, the model allows to change the look of the new virtual views, for example to simulate the special lighting conditions of a certain light situation (midday, night with headlights).

Trevi-Output
Generated Output


The method naturally has difficulties with those parts of a scene that only appear in a few photos because they tend to be in the background and are only visible from certain perspectives. The nice thing about the new method is that you can use any photo from the net, which was taken by different users with different cameras. The training using 8 GPUs for a scene with several hundred photos took about 2 days.
§PIC3:NeRF-W Algorithm
The "2 Minute Papoers" clip beautifully demonstrates the great progress that the new method has achieved within only a few months compared to the predecessor model:



We remember a very early predecessor from 2007, Microsoft&s Photosynth, which was able to create 3D models of the photos in space from photos using a completely different method than NeRF-W.


Bild zur Newsmeldung:
NN

Link more infos at bei nerf-w.github.io

deutsche Version dieser Seite: KI generiert virtuelle Kamerafahrten aus Photos

  

  Vorige News lesen Nächste News lesen 
bildLaowa 14mm f/4 FF RL Zero-D - leichtes Ultraweitwinkel-Objektiv bildCine-Optik speziell für S35: Meike Prime 35mm T2.1


related news:1E0Epic Games MetaHuman Creator: Realistic 3D Models of Humans with a Single Click 19.April 2021
Adobe After Effects 18.0 update brings real-time 3D design preview and multi-frame rendering 12.March 2021
Sony FX9 v2.0 update released with FF5K-Crop, C4K, HLG, User 3D-LUTs, RAW-Ausgabe und mehr 10.September 2020
miniDSP ambiMIK-1: Ambisonic USB microphone for 3D 360° audio 16.August 2020
3D LUTs now also available for Fujifilm X-T4 -- including Bleach Bypass 29.April 2020
Nikon: New REC 709 N-Log 3D LUT for Nikon D780 DSLR as free download 11.March 2020
New system allows subsequent modification of illumination of 3D body capturings 27.November 2019
alle Newsmeldungen zum Thema 3D
1E0In color and 4K: Pornhub restores over 100 years old porn movies via AI 11.June 2021
Flim: AI-based film still search gets intelligence upgrade 4.June 2021
Professional AI speakers for everyone? MARVEL.ai 27.May 2021
Visual dubbing by AI makes every actor a native speaker 25.May 2021
Colourlab Ai 1.2: New camera profile tool and new formats 30.April 2021
Dynascore Musik-Engine -- AI times background music to videos 19.April 2021
Simon Says : Audio transcription via AI now available in Adobe Premiere Pro 18.April 2021
alle Newsmeldungen zum Thema Machine Learning


[nach oben]
















Archiv Newsmeldungen

2021

June - May - April - March - February - January

2020
December - November - October - September - August - July - June - May - April - March - February - January

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: KI generiert virtuelle Kamerafahrten aus Photos



last update : 15.Juni 2021 - 12:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version