Logo Logo
deutsch
directory schraeg
Knowledge

Hardware
Actioncam / 360°· Camcorders· Cinema-Kamera· Kamera(technik)· Kamera-Zubehör· Kameradrohnen· Lenses· Smartphone-Kamera· Video-DSLM/DSLR
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Filmmaking· Generative KI
Misc
Audio· Live-Streaming· Sonstige
/// News
Nvidia creates editable 3D model from photos of an object

Nvidia creates editable 3D model from photos of an object

[10:59 Fri,24.June 2022   by ]    

A team of researchers at Nvidia has developed a new algorithm that makes it easy to create a 3D model of an object from a series of photos of it. Dubbed "Nvidia 3D MoMa," the algorithm could allow filmmakers, architects, designers, FX specialists, or even game developers to quickly import an object into a graphics engine such as Unreal or a 3D program to work with it, change the scale, change the material, experiment with different lighting effects, or use it in a 3D scene.

Trumpet-Photos





How Nvidia 3D MoMa Works

.
The new method has the advantage over others of not only being very fast, but also of being able to export the resulting 3D models in the form of a 3D mesh with textured materials, a common format that is compatible with existing 3D graphics engines and 3D modeling software.

The pipeline reconstruction includes three features: a 3D mesh model, materials and lighting. The mesh is a kind of papier-mâché model of a 3D shape made up of triangles. It allows developers to modify an object to fit their creative vision. Materials are 2D textures that are placed over the 3D meshes like a skin. And thanks to Nvidia 3D MoMa&s assessment of how the scene is lit, developers can later change how objects are lit.

The 3D model exported by Nvidia 3D MoMa consists of three components: the 3D mesh model made up of triangles, the parameters for the textures that make up the object, and the parameters for how the scene is lit. This comprehensive data makes it easier to use the 3D model in other applications. According to Nvidia, 3D MoMa can create triangle models within an hour using a single Nvidia Tensor Core graphics processor.

instruments



Demo using jazz instruments

.
To demonstrate the capabilities of Nvidia 3D MoMa, the Nvidia team first collected about 100 images of five jazz band instruments - trumpet, trombone, saxophone, drums and clarinet - from different angles.



The algorithm then reconstructed 3D models of each instrument from these 2D images, which were displayed as 3D meshes. The Nvidia team then took the instruments out of their original scenes and imported them into the Nvidia Omniverse 3D simulation platform for processing. In any conventional graphics engine, the texture of an Nvidia 3D MoMa-generated shape can be easily replaced - the team did this with the trumpet model, for example, replacing the original plastic with with gold, marble, wood or cork.

trumpet-omniverse


For demonstration, the Nvidia team dropped the instruments into a Cornell box - a classic graphics test for rendering quality. They showed that the virtual instruments responded to light just as they would in the real world, with the shiny brass instruments reflecting brightly and the matte drumheads absorbing the light.

These new objects, created by inverse rendering, can be used as building blocks for a complex animated scene presented as a virtual jazz band in the video&s finale.

If you want to know more, you can find the research paper on Nvidia 3D MoMa here.

Link more infos at bei blogs.nvidia.com

deutsche Version dieser Seite: Neuer Nvidia Algorithmus erschafft aus Photos eines Objekts ein bearbeitbares 3D-Modell

  

  Vorige News lesen Nächste News lesen 
bildBlackmagic Pocket Cinema Camera 6K G2 - Größerer Akku, 2x XLR und Klappdisplay bildBlackmagic Camera 7.9 Update bringt besseren Autofokus und Bildstabilisation per Gyrodaten


related news:1E0Blender 4.0 is here - free 3D software package with numerous new features 16.November 2023
The Creator - IMAX uses AI models for film scaling 5.October 2023
IMAX blockbuster The Creator shot with 5,000 Euro camera - Sony'amp;s FX3 28.September 2023
Premiere Pro, After Effects and Frame.io - More AI, 3D Workspace and AWS Cloud 13.September 2023
Boris FX buys 3D tracking software SynthEyes 23.August 2023
Christopher Nolan, film dialogue and rattling IMAX cameras 20.August 2023
Apple, Adobe and Nvidia among others to extend open USD standard for 3D content 2.August 2023
alle Newsmeldungen zum Thema 3D
1E0Team Group T-CREATE CinemaPr P31 - External USB-C SSD with mounting holes 2.December 2023
The cinematography of Dariusz Wolski in Ridley Scott's Napoleon 27.November 2023
Kodak introduces Super 8 film camera with digital technology and C-mount for 5,495 dollars 23.November 2023
Will the 2024 Oscars be an analog film festival? 20.November 2023
Adobe AI splits audio clip into different tracks - Project Sound Lift 17.November 2023
Behind the Scenes Clip from Apple: Launch Event Produced with the iPhone 15 Pro Max 1.November 2023
From Taxi Driver to Silence - Martin Scorsese comments on his cult films 21.October 2023
alle Newsmeldungen zum Thema Film


[nach oben]
















Archiv Newsmeldungen

2023

December - November - October - September - August - July - June - May - April - March - February - January

2022
December - November - October - September - August - July - June - May - April - March - February - January

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Neuer Nvidia Algorithmus erschafft aus Photos eines Objekts ein bearbeitbares 3D-Modell



last update : 4.Dezember 2023 - 08:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version