Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
HumanNeRF - AI models human bodies

HumanNeRF - AI models human bodies

[09:41 fri,14.January 2022   by ]    

And once again an AI paper that you could actually foresee - and still marvel that such things are now simply possible. This time it's about being able to "estimate" dancing people from Youtube videos in every phase of their movement from all sides. Sounds cumbersome at first, so it's explained by example. After HumanNeRF has watched a video from the net, it can...

a) crop the dancing human in the video from an almost arbitrary background and
b) let the camera move arbitrarily around the generated human 3D object.

HumanNERF





So the AI learns from a relatively arbitrary dance how the object looks from all sides and can thus also render to each frame its idea of how the object would look from a different angle. This goes so far that even the correct drape of the clothes is simulated.

In extreme cases, the AI model can even "invent" a plausible 180 degree view of the person from behind. In other words, a perspective in which no real pixel from the original clip can be seen. The astonishing thing about this algorithm is that a program can create a model of the 3D structure of people and clothes from the view of a single camera. And subsequently reproduces this model quite as an impressive 3D model.



The quality of the generated perspective change is very variable and of course extremely dependent on the training material. However, it is clearly above older AI methods and mostly at least on the level of a good video game 3D simulation. And thus already today certainly useful to move people in a virtual environment in the background or to let them blur in the bokeh.

In contrast to special 3D scans, HumanNeRF obtains its data only by looking at a movement. So there is no need for specific dancing. The body should only have been seen once from all sides. Fantastic Times....



deutsche Version dieser Seite: HumanNeRF - KI modelliert menschliche Körper

  

  Vorige News lesen Nächste News lesen 
bildLeica M11 mit 60 MP Sensor vorgestellt: Ohne Video besser? bildAudio Design Desk 1.9: Echtzeit-Editing Tool für Sound-Effekte jetzt mit neuen Funktionen und Lite Version


related news:1E0Illuminated only by starlight: New AI algorithm denoises videos perfectly 16.May 2022
NAB 2022 Tutorialclip: DaVinci Resolve 18 - AI-Mask Objects, Depth Mask, Surface Tracker 27.April 2022
AI helps to synchronize motion pictures 16.April 2022
Apple Final Cut Pro update brings duplicate detection and voice isolation via AI 13.April 2022
DALL-E 2: AI generates and edits images based on text description only 10.April 2022
AI generates frighteningly accurate portraits - based on voice alone 9.April 2022
New AJA Ki Pro GO firmware 4.0 brings new playback options 3.April 2022
alle Newsmeldungen zum Thema Machine Learning


[nach oben]
















Archiv Newsmeldungen

2022

May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: HumanNeRF - KI modelliert menschliche Körper



last update : 20.Mai 2022 - 18:45 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version