Logo Logo
directory schraeg
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Compositing· Color correction· DV Editing

Shooting· Sound
Forschung· KI· Reviews· Streaming
/// News
Nvidia creates editable 3D model from photos of an object

Nvidia creates editable 3D model from photos of an object

[10:59 Fri,24.June 2022   by ]    

A team of researchers at Nvidia has developed a new algorithm that makes it easy to create a 3D model of an object from a series of photos of it. Dubbed "Nvidia 3D MoMa," the algorithm could allow filmmakers, architects, designers, FX specialists, or even game developers to quickly import an object into a graphics engine such as Unreal or a 3D program to work with it, change the scale, change the material, experiment with different lighting effects, or use it in a 3D scene.


How Nvidia 3D MoMa Works

The new method has the advantage over others of not only being very fast, but also of being able to export the resulting 3D models in the form of a 3D mesh with textured materials, a common format that is compatible with existing 3D graphics engines and 3D modeling software.

The pipeline reconstruction includes three features: a 3D mesh model, materials and lighting. The mesh is a kind of papier-mâché model of a 3D shape made up of triangles. It allows developers to modify an object to fit their creative vision. Materials are 2D textures that are placed over the 3D meshes like a skin. And thanks to Nvidia 3D MoMa&s assessment of how the scene is lit, developers can later change how objects are lit.

The 3D model exported by Nvidia 3D MoMa consists of three components: the 3D mesh model made up of triangles, the parameters for the textures that make up the object, and the parameters for how the scene is lit. This comprehensive data makes it easier to use the 3D model in other applications. According to Nvidia, 3D MoMa can create triangle models within an hour using a single Nvidia Tensor Core graphics processor.


Demo using jazz instruments

To demonstrate the capabilities of Nvidia 3D MoMa, the Nvidia team first collected about 100 images of five jazz band instruments - trumpet, trombone, saxophone, drums and clarinet - from different angles.

The algorithm then reconstructed 3D models of each instrument from these 2D images, which were displayed as 3D meshes. The Nvidia team then took the instruments out of their original scenes and imported them into the Nvidia Omniverse 3D simulation platform for processing. In any conventional graphics engine, the texture of an Nvidia 3D MoMa-generated shape can be easily replaced - the team did this with the trumpet model, for example, replacing the original plastic with with gold, marble, wood or cork.


For demonstration, the Nvidia team dropped the instruments into a Cornell box - a classic graphics test for rendering quality. They showed that the virtual instruments responded to light just as they would in the real world, with the shiny brass instruments reflecting brightly and the matte drumheads absorbing the light.

These new objects, created by inverse rendering, can be used as building blocks for a complex animated scene presented as a virtual jazz band in the video&s finale.

If you want to know more, you can find the research paper on Nvidia 3D MoMa here.

Link more infos at bei blogs.nvidia.com

deutsche Version dieser Seite: Neuer Nvidia Algorithmus erschafft aus Photos eines Objekts ein bearbeitbares 3D-Modell


  Vorige News lesen Nächste News lesen 
bildBlackmagic Pocket Cinema Camera 6K G2 - Größerer Akku, 2x XLR und Klappdisplay bildBlackmagic Camera 7.9 Update bringt besseren Autofokus und Bildstabilisation per Gyrodaten

related news:1E0Runway Gen1: New video AI stylizes videos, masks objects, renders 3D models 6.February 2023
Nvidia Magic3D - create any 3D object by text description 29.November 2022
AvatarCLIP: New AI generates and animates 3D avatars by text description 28.October 2022
Luma AI: New smartphone app creates 3D models of any object 21.October 2022
DreamFusion: New Google AI generates 3D models by text description only 11.October 2022
The 35mm film camera from the 3D printer 20.May 2022
Nvidia Instant NeRF - 3D scene from 2D images in record time 28.March 2022
alle Newsmeldungen zum Thema 3D
1E0VideoFusion: First open source video AI is here - and also runs on the home PC 20.March 2023
Apple: New Macs before launch - is the new Mac Pro with M2 Ultra finally coming? 10.March 2023
New Nvidia AI generates images 30x faster than Stable Diffusion 8.March 2023
Stream more effectively: FFmpeg 6.0 brings among other things acceleration of AV1 via GPU 1.March 2023
Free AI tool NVIDIA Canvas: design photorealistic dream landscapes yourself 15.February 2023
More beautiful time-lapse shots thanks to new NVIDIA AI 11.February 2023
Have fun with NVIDIA's new eye contact effect: Robert De Niro looks you in the eye 27.January 2023
alle Newsmeldungen zum Thema Computers
1E0This is what the AI-generated winning films of the Runway AI Film Festival look like 27.March 2023
Sennheiser Profile USB Microphone - easy to use for podcasts & co 25.March 2023
How to produce a SF clip in just 3h using AI tools 24.March 2023
New Nvidia AI generates images 30x faster than Stable Diffusion 8.March 2023
This could be expensive: Beware of photo wallpaper during film shooting or photo shoot 5.March 2023
Ruben Östlund: Why the pitch is the crucial step in film development 4.March 2023
Home-made virtual film studio: a little test 22.February 2023
alle Newsmeldungen zum Thema Film

[nach oben]

Archiv Newsmeldungen


March - February - January

December - November - October - September - August - July - June - May - April - March - February - January























deutsche Version dieser Seite: Neuer Nvidia Algorithmus erschafft aus Photos eines Objekts ein bearbeitbares 3D-Modell

last update : 29.März 2023 - 15:24 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version