Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
First the image revolution, then the video revolution: New meta AI

First the image revolution, then the video revolution: New meta AI

[14:11 Fri,30.September 2022   by ]    

bildIt was clear that the next step after generating images by text description would be to generate videos - now Meta AI, the AI research division of Meta (formerly Facebook) has unveiled just such an algorithm. Dubbed "Make-a-Video," the text-to-video AI is similar to the text-to-image AIs DALL-E 2 and Stable Diffusion that have made a splash in recent months.





Like these, it has learned what the real world looks like, what objects it consists of, and how people describe it, based on billions of images including text descriptions. In addition to this, however, it was trained by means of additional layers of the neural network for the temporal sequences of images with about 20 million videos to learn how different objects typically move.



So now, using only text descriptions, the Make-a-Video AI can generate arbitrary short video clips, such as "A teddy bear paints a portrait" or "A fluffy baby sloth in an orange knit cap trying to operate a laptop, with a detailed studio light screen reflected in its eye." Similar to the image-generating AIs, the image style (realistic, surreal, abstract, stylized, ...) can be defined arbitrarily.



Bring images to life

.
As input, however, instead of a text, a single image can be used (analogous to the image-2-image method in image AIs) to animate it, or two images (a start and an end image, between which the make-a-video algorithm then generates the intermediate images. Alternatively, quasi by video-2-video, a video can also act as input, from which Make-a-Video then generates variations.



Meta AI has published the research work of Make-a-Video, but not the associated code or model - however, attempts to replicate an algorithm based on it should follow soon.

The quality of the generated videos still leaves something to be desired and the videos are more like small image animations than real (complex) video and they are only a few seconds long, but Make-a-Video clearly shows where the journey is going. Generation of videos and object-based editing via text even for consumers is getting closer.



Longer videos with new AI

.
How fast the development is progressing right now is also proven by the fact that at the same time as Meta&s "Make-a-Video" another project called Phenaki by a (still) anonymous research team has appeared, which has a much lower resolution, but in one important aspect is even more interesting than this one, because it allows the generation of videos lasting several minutes. Thus, in the following example, a lengthy text description (complete with instructions for the virtual camera movements) was used to generate an impressive 2 minute video:


Link more infos at bei makeavideo.studio

deutsche Version dieser Seite: Nach der Bild- die Videorevolution: Neue KI "Make-a-Video" generiert Videos nach Text

  

  Vorige News lesen Nächste News lesen 
bildIntel ARC A770 Desktop-Grafikkarte ab 12.Oktober für ca. 400 Euro im Handel bildDeepfake: Bruce Willis digitaler Zwilling tritt in Werbeclips auf


related news:1E0Meta Encodec uses AI to compress audio files significantly more than MP3 21.November 2022
AI copies movie style of "Into the Spider-Verse" in record time 14.November 2022
MAXIM - AI tool combines various image enhancements in one model 13.November 2022
Blackmagic DaVinci Resolve 18.1 Update - with AI voice isolation 11.November 2022
Photostock portal Shutterstock gives an answer to the big question and integrates AI images 5.November 2022
AvatarCLIP: New AI generates and animates 3D avatars by text description 28.October 2022
Topaz Video Enhance AI 3.0: New AI features and special price 24.October 2022
alle Newsmeldungen zum Thema Machine Learning


[nach oben]
















Archiv Newsmeldungen

2022

November - October - September - August - July - June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Nach der Bild- die Videorevolution: Neue KI "Make-a-Video" generiert Videos nach Text



last update : 30.November 2022 - 12:30 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version