Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
AvatarCLIP: New AI generates and animates 3D avatars by text description

AvatarCLIP: New AI generates and animates 3D avatars by text description

[10:56 Fri,28.October 2022   by ]    

New AI algorithms are currently revolutionizing the creation of images, videos and even 3D models, making them more accessible than before. The just introduced AI AvatarCLIP now also allows the creation and animation of 3D avatars using only text input. Thus, unlike professional software that requires expert knowledge, AvatarCLIP allows you to generate a 3D avatar of any desired shape and texture and then control its movements - using only text commands.





The process is done in three steps: first a rough body shape is generated after text description (in the clip, for example, "a very thin man"), then the appearance (details of the body of the as well as clothing) is defined ("a ninja"), and then finally a movement ("throw basketball"). Bodies can be generated based on famous personalities ("Barack Obama") as well as fictional characters ("Iron Man") or according to a general description (such as "gardener" or "wizard"). Here is the code of AvatarCLIP.

AVATARCLIP
AvatarCLIP



In the future: automatically generated animated movies?


As always, this work is still early and mainly shows that the proposed method basically works - texture errors and other inconsistencies will be improved in future versions. However, it demonstrates how easily three-dimensional avatars of arbitrary persons could be generated and animated in the future - the final goal would then be the automatic generation of entire animated movies based only on text descriptions, including interactions of the characters with each other and the also automatically generated environment and its objects.

Celeb
Avatars of famous personalities generated by AvatarCLIP



Human Motion Diffusion Model: text-to-motion

.
Another new AI that is also interesting for users working with 3D models and animations is Tel Aviv University&s Human Motion Diffusion Model (MDM), which uses "text-to-motion" to control the movements of 3D models of humans via text input. Here the associated program code including models.

Link more infos at bei hongfz16.github.io

deutsche Version dieser Seite: AvatarCLIP: Neue KI generiert und animiert 3D-Avatare per Textbeschreibung

  

  Vorige News lesen Nächste News lesen 
bildApple stellt Updates für mehr Performance für Final Cut Pro, Compressor, iMovie u.a. vor bildRøde X - Mikrofone und Unify Software Mixer fürs Streaming - XCM-50, XDM-100


related news:1E0Nvidia Magic3D - create any 3D object by text description 29.November 2022
Luma AI: New smartphone app creates 3D models of any object 21.October 2022
DreamFusion: New Google AI generates 3D models by text description only 11.October 2022
Nvidia creates editable 3D model from photos of an object 24.June 2022
The 35mm film camera from the 3D printer 20.May 2022
Nvidia Instant NeRF - 3D scene from 2D images in record time 28.March 2022
Four new analog 65mm IMAX film cameras in development 21.March 2022
alle Newsmeldungen zum Thema 3D
1E0Heavy Metal meets Midjourney: Music video made from 10,000 AI-generated images 4.December 2022
Meta Encodec uses AI to compress audio files significantly more than MP3 21.November 2022
AI copies movie style of "Into the Spider-Verse" in record time 14.November 2022
MAXIM - AI tool combines various image enhancements in one model 13.November 2022
Blackmagic DaVinci Resolve 18.1 Update - with AI voice isolation 11.November 2022
Photostock portal Shutterstock gives an answer to the big question and integrates AI images 5.November 2022
Topaz Video Enhance AI 3.0: New AI features and special price 24.October 2022
alle Newsmeldungen zum Thema Machine Learning


[nach oben]
















Archiv Newsmeldungen

2022

December - November - October - September - August - July - June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: AvatarCLIP: Neue KI generiert und animiert 3D-Avatare per Textbeschreibung



last update : 6.Dezember 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version