Logo Logo
directory schraeg

Actioncam / 360°· Camcorders· Cinema-Kamera· Kamera(technik)· Kamera-Zubehör· Kameradrohnen· Lenses· Smartphone-Kamera· Video-DSLM/DSLR
Compositing· Color correction· DV Editing

Filmmaking· Generative KI
Audio· Live-Streaming· Sonstige
/// News

First the image revolution, then the video revolution: New meta AI

[14:11 Fri,30.September 2022   by ]    

bildIt was clear that the next step after generating images by text description would be to generate videos - now Meta AI, the AI research division of Meta (formerly Facebook) has unveiled just such an algorithm. Dubbed "Make-a-Video," the text-to-video AI is similar to the text-to-image AIs DALL-E 2 and Stable Diffusion that have made a splash in recent months.

Like these, it has learned what the real world looks like, what objects it consists of, and how people describe it, based on billions of images including text descriptions. In addition to this, however, it was trained by means of additional layers of the neural network for the temporal sequences of images with about 20 million videos to learn how different objects typically move.

So now, using only text descriptions, the Make-a-Video AI can generate arbitrary short video clips, such as "A teddy bear paints a portrait" or "A fluffy baby sloth in an orange knit cap trying to operate a laptop, with a detailed studio light screen reflected in its eye." Similar to the image-generating AIs, the image style (realistic, surreal, abstract, stylized, ...) can be defined arbitrarily.

Bring images to life

As input, however, instead of a text, a single image can be used (analogous to the image-2-image method in image AIs) to animate it, or two images (a start and an end image, between which the make-a-video algorithm then generates the intermediate images. Alternatively, quasi by video-2-video, a video can also act as input, from which Make-a-Video then generates variations.

Meta AI has published the research work of Make-a-Video, but not the associated code or model - however, attempts to replicate an algorithm based on it should follow soon.

The quality of the generated videos still leaves something to be desired and the videos are more like small image animations than real (complex) video and they are only a few seconds long, but Make-a-Video clearly shows where the journey is going. Generation of videos and object-based editing via text even for consumers is getting closer.

Longer videos with new AI

How fast the development is progressing right now is also proven by the fact that at the same time as Meta&s "Make-a-Video" another project called Phenaki by a (still) anonymous research team has appeared, which has a much lower resolution, but in one important aspect is even more interesting than this one, because it allows the generation of videos lasting several minutes. Thus, in the following example, a lengthy text description (complete with instructions for the virtual camera movements) was used to generate an impressive 2 minute video:

Link more infos at bei makeavideo.studio

deutsche Version dieser Seite: Nach der Bild- die Videorevolution: Neue KI "Make-a-Video" generiert Videos nach Text


  Vorige News lesen Nächste News lesen 
bildIntel ARC A770 Desktop-Grafikkarte ab 12.Oktober für ca. 400 Euro im Handel bildDeepfake: Bruce Willis digitaler Zwilling tritt in Werbeclips auf

related news:1E0PIKA 1.0 announced - Generative AI videos with amazing quality 29.November 2023
The next step is here: AI trains AI (and no longer needs humans) 28.November 2023
Insta360 Ace Pro - Action Cam with 8K sensor, Leica optics and lots of AI 24.November 2023
Stable Video Diffusion - Free AI diffusion model for video generation presented 23.November 2023
Boris FX: Continuum gets AI functions - denoiser and upscaler 21.November 2023
Meta Emu Video / Edit - improves consistency in generative AI videos 20.November 2023
Adobe AI splits audio clip into different tracks - Project Sound Lift 17.November 2023
alle Newsmeldungen zum Thema KI

[nach oben]

Archiv Newsmeldungen


December - November - October - September - August - July - June - May - April - March - February - January

December - November - October - September - August - July - June - May - April - March - February - January























deutsche Version dieser Seite: Nach der Bild- die Videorevolution: Neue KI "Make-a-Video" generiert Videos nach Text

last update : 3.Dezember 2023 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version