Logo Logo
directory schraeg
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Compositing· Color correction· DV Editing

Shooting· Sound
Forschung· Reviews· Streaming
/// News
Nvidia creates editable 3D model from photos of an object

Nvidia creates editable 3D model from photos of an object

[10:59 Fri,24.June 2022   by ]    

A team of researchers at Nvidia has developed a new algorithm that makes it easy to create a 3D model of an object from a series of photos of it. Dubbed "Nvidia 3D MoMa," the algorithm could allow filmmakers, architects, designers, FX specialists, or even game developers to quickly import an object into a graphics engine such as Unreal or a 3D program to work with it, change the scale, change the material, experiment with different lighting effects, or use it in a 3D scene.


How Nvidia 3D MoMa Works

The new method has the advantage over others of not only being very fast, but also of being able to export the resulting 3D models in the form of a 3D mesh with textured materials, a common format that is compatible with existing 3D graphics engines and 3D modeling software.

The pipeline reconstruction includes three features: a 3D mesh model, materials and lighting. The mesh is a kind of papier-mâché model of a 3D shape made up of triangles. It allows developers to modify an object to fit their creative vision. Materials are 2D textures that are placed over the 3D meshes like a skin. And thanks to Nvidia 3D MoMa&s assessment of how the scene is lit, developers can later change how objects are lit.

The 3D model exported by Nvidia 3D MoMa consists of three components: the 3D mesh model made up of triangles, the parameters for the textures that make up the object, and the parameters for how the scene is lit. This comprehensive data makes it easier to use the 3D model in other applications. According to Nvidia, 3D MoMa can create triangle models within an hour using a single Nvidia Tensor Core graphics processor.


Demo using jazz instruments

To demonstrate the capabilities of Nvidia 3D MoMa, the Nvidia team first collected about 100 images of five jazz band instruments - trumpet, trombone, saxophone, drums and clarinet - from different angles.

The algorithm then reconstructed 3D models of each instrument from these 2D images, which were displayed as 3D meshes. The Nvidia team then took the instruments out of their original scenes and imported them into the Nvidia Omniverse 3D simulation platform for processing. In any conventional graphics engine, the texture of an Nvidia 3D MoMa-generated shape can be easily replaced - the team did this with the trumpet model, for example, replacing the original plastic with with gold, marble, wood or cork.


For demonstration, the Nvidia team dropped the instruments into a Cornell box - a classic graphics test for rendering quality. They showed that the virtual instruments responded to light just as they would in the real world, with the shiny brass instruments reflecting brightly and the matte drumheads absorbing the light.

These new objects, created by inverse rendering, can be used as building blocks for a complex animated scene presented as a virtual jazz band in the video&s finale.

If you want to know more, you can find the research paper on Nvidia 3D MoMa here.

Link more infos at bei blogs.nvidia.com

deutsche Version dieser Seite: Neuer Nvidia Algorithmus erschafft aus Photos eines Objekts ein bearbeitbares 3D-Modell


  Vorige News lesen Nächste News lesen 
bildBlackmagic Pocket Cinema Camera 6K G2 - Größerer Akku, 2x XLR und Klappdisplay bildBlackmagic Camera 7.9 Update bringt besseren Autofokus und Bildstabilisation per Gyrodaten

related news:1E0The 35mm film camera from the 3D printer 20.May 2022
Nvidia Instant NeRF - 3D scene from 2D images in record time 28.March 2022
Four new analog 65mm IMAX film cameras in development 21.March 2022
Simulated Reality - Dimenco SR Pro Display offers 3D without glasses 19.February 2022
3D objects without 3D scanner - Moves by Maxon in Cinema4D 14.December 2021
Blackmagic: New Micro Converter 12G models with 3D LUTs and 4K support 16.November 2021
Epic Games MetaHuman Creator: Realistic 3D Models of Humans with a Single Click 19.April 2021
alle Newsmeldungen zum Thema 3D
1E0Which effects are GPU-accelerated in Blackmagic DaVinci Resolve 18? 7.August 2022
Four x M2 Max? Is an Apple Mac Pro with a new M2 Extreme chip coming this year? 28.June 2022
Dell Precision 7865: Workstation mit 64 Core Threadripper Pro 5995WX, 1 TB RAM und 48 GB Nvidia RTX 14.June 2022
WWDC 2022: Apple presents new MacBook Air with M2 processor, iOS 16, macOS 13 (Ventura) and much mor 7.June 2022
MSI announces new top-of-the-line laptop models with Intel Core HX CPUs with 16 cores 5.June 2022
Asus ROG Flow X16 Notebook: 1.100 nits Mini-LED-Display, Ryzen 9 6900HS und RTX 3070 Ti 31.May 2022
Acer equips ConceptD series with 12th generation Intel Core processors and Nvidia RTX GPUs 29.May 2022
alle Newsmeldungen zum Thema Computers
1E0New AI automatically perfectly exposes objects from photos 7.August 2022
Film simulation tool Dehancer Film Pro now also available as beta for Final Cut Pro 2.August 2022
Sony Future Filmmaker competition entices with visit to Sony Pictures film studios in Hollywood 1.August 2022
Large online auction of over 2,000 pieces of professional film equipment: ARRI, Canon, RED, ZEISS... 28.July 2022
Cinematic HFR: Titanic and Avatar get 25.July 2022
How Everything Everywhere All At Once was filmed 24.July 2022
Netflix removes movie noise, saves 30% bandwidth and adds it back again 21.July 2022
alle Newsmeldungen zum Thema Film

[nach oben]

Archiv Newsmeldungen


August - July - June - May - April - March - February - January

December - November - October - September - August - July - June - May - April - March - February - January






















deutsche Version dieser Seite: Neuer Nvidia Algorithmus erschafft aus Photos eines Objekts ein bearbeitbares 3D-Modell

last update : 12.August 2022 - 12:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version