Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
Nvidia creates editable 3D model from photos of an object

Nvidia creates editable 3D model from photos of an object

[10:59 Fri,24.June 2022   by ]    

A team of researchers at Nvidia has developed a new algorithm that makes it easy to create a 3D model of an object from a series of photos of it. Dubbed "Nvidia 3D MoMa," the algorithm could allow filmmakers, architects, designers, FX specialists, or even game developers to quickly import an object into a graphics engine such as Unreal or a 3D program to work with it, change the scale, change the material, experiment with different lighting effects, or use it in a 3D scene.

Trumpet-Photos





How Nvidia 3D MoMa Works

.
The new method has the advantage over others of not only being very fast, but also of being able to export the resulting 3D models in the form of a 3D mesh with textured materials, a common format that is compatible with existing 3D graphics engines and 3D modeling software.

The pipeline reconstruction includes three features: a 3D mesh model, materials and lighting. The mesh is a kind of papier-mâché model of a 3D shape made up of triangles. It allows developers to modify an object to fit their creative vision. Materials are 2D textures that are placed over the 3D meshes like a skin. And thanks to Nvidia 3D MoMa&s assessment of how the scene is lit, developers can later change how objects are lit.

The 3D model exported by Nvidia 3D MoMa consists of three components: the 3D mesh model made up of triangles, the parameters for the textures that make up the object, and the parameters for how the scene is lit. This comprehensive data makes it easier to use the 3D model in other applications. According to Nvidia, 3D MoMa can create triangle models within an hour using a single Nvidia Tensor Core graphics processor.

instruments



Demo using jazz instruments

.
To demonstrate the capabilities of Nvidia 3D MoMa, the Nvidia team first collected about 100 images of five jazz band instruments - trumpet, trombone, saxophone, drums and clarinet - from different angles.



The algorithm then reconstructed 3D models of each instrument from these 2D images, which were displayed as 3D meshes. The Nvidia team then took the instruments out of their original scenes and imported them into the Nvidia Omniverse 3D simulation platform for processing. In any conventional graphics engine, the texture of an Nvidia 3D MoMa-generated shape can be easily replaced - the team did this with the trumpet model, for example, replacing the original plastic with with gold, marble, wood or cork.

trumpet-omniverse


For demonstration, the Nvidia team dropped the instruments into a Cornell box - a classic graphics test for rendering quality. They showed that the virtual instruments responded to light just as they would in the real world, with the shiny brass instruments reflecting brightly and the matte drumheads absorbing the light.

These new objects, created by inverse rendering, can be used as building blocks for a complex animated scene presented as a virtual jazz band in the video&s finale.

If you want to know more, you can find the research paper on Nvidia 3D MoMa here.

Link more infos at bei blogs.nvidia.com

deutsche Version dieser Seite: Neuer Nvidia Algorithmus erschafft aus Photos eines Objekts ein bearbeitbares 3D-Modell

  

  Vorige News lesen Nächste News lesen 
bildBlackmagic Pocket Cinema Camera 6K G2 - Größerer Akku, 2x XLR und Klappdisplay bildBlackmagic Camera 7.9 Update bringt besseren Autofokus und Bildstabilisation per Gyrodaten


related news:1E0Nvidia Magic3D - create any 3D object by text description 29.November 2022
AvatarCLIP: New AI generates and animates 3D avatars by text description 28.October 2022
Luma AI: New smartphone app creates 3D models of any object 21.October 2022
DreamFusion: New Google AI generates 3D models by text description only 11.October 2022
The 35mm film camera from the 3D printer 20.May 2022
Nvidia Instant NeRF - 3D scene from 2D images in record time 28.March 2022
Four new analog 65mm IMAX film cameras in development 21.March 2022
alle Newsmeldungen zum Thema 3D
1E0Nvidia RTX 6000 with 48 GB memory and 8 pin power connector for 7349 Dollar 1.December 2022
Nvidia Magic3D - create any 3D object by text description 29.November 2022
RTX 4090 - Nvidia suspects application error as reason for cable fires 22.November 2022
Nvidia RTX 4070 Ti available as of January 5 10.November 2022
AMD introduces new graphics card generation - RX 7900 XT(X) with two video engines 4.November 2022
New Apple Mac Pro with M2 Extreme chip with 48 CPU and 152 GPU cores and 256 GB delayed 1.November 2022
New Thunderbolt version will be up to 4x faster: 120 instead of 40 Gbit/s 21.October 2022
alle Newsmeldungen zum Thema Computers
1E0Story & Film App - film planning on the smartphone from the idea to the cut 14.November 2022
AI copies movie style of "Into the Spider-Verse" in record time 14.November 2022
SLATE: The digital film flap made of e-paper that requires no electricity 13.November 2022
Silver Student Oscar for Babelsberg Animation Film "Laika & Nemo 31.October 2022
Flying into photos of landscapes with new Google AI 16.October 2022
LETsDOK: Nationwide Documentary Film Days 11.September 2022
New Google AI perfectly de-noises RAW photos of dark scenes - soon also from video? 28.August 2022
alle Newsmeldungen zum Thema Film


[nach oben]
















Archiv Newsmeldungen

2022

December - November - October - September - August - July - June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Neuer Nvidia Algorithmus erschafft aus Photos eines Objekts ein bearbeitbares 3D-Modell



last update : 1.Dezember 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version