Logo Logo
directory schraeg
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Compositing· Color correction· DV Editing

Shooting· Sound
Forschung· KI· Reviews· Streaming
/// News
New Google Dreamix AI Demonstrates Video Editing of the Future

New Google Dreamix AI Demonstrates Video Editing of the Future

[12:27 Fri,10.February 2023   by ]    

Almost simultaneously with Runway&s Gen1 video AI, Google has introduced a similar AI. Google&s calls Dreamix an AI video editor and emphasizes its capabilities to not only freely generate videos via text prompt but also modify targeted objects videos. Dreamix offers three methods to generate videos: subject-driven video generation, video editing and image-to-video.

Using Subject Driven Video Generation, an object can be animated by 10-20 photos per prompt. In the video example, four pictures of a teddy bear and the description "a walking bear" are used to create a short clip in which the teddy bear seen in the photos is walking. Color, posture, object size, image composition and camera position from the source video are kept. However, it is also possible to simply replace one object with another without affecting the rest of the scene.

In Video Editing mode, a video serves as input - text prompts can then be used to manipulate specific elements. Thus, the movement or texture of an object appearing in the video can be changed, as well as the background. Objects can also be added in a meaningful way.


Likewise, a single photo can be used as a template (image-to-video) and an object can be animated from it in a video via prompt or new objects can be added. Camera movements are also possible in the new scene or a subsequent time-lapse recording.

Google uses a video diffusion model for Dreamix, which is a similar method to current image AIs such as DALL-E2 or the open-source Stable Diffusion. This involves heavily downscaling an input video, adding artificial noise, and then processing it in a video diffusion model, which then uses a text prompt to generate a new video from it that retains some properties of the original video and re-renders others according to the text input.

Dreamix Model

Runway&s just unveiled Video AI Gen 1 for its online AI Viceo Editor had primarily demonstrated the ability to change textures of videos via text-driven style transfer, but a demo released in September had also already demonstrated capabilities of object-based video editing, such as masking objects via text command - Google has demonstrated even more capabilities with Dreamix.

Object-based editing: making complex work simple

In the very near future, such video AI promise numerous extremely useful functions and promise a revolution for working with video. For example, with the help of video AIs, individual objects in videos can be selectively masked or manipulated using only a text prompt, and VFX can be added to a scene. Everything only by text prompt (or soon presumably also by voice command) completely without sophisticated compositing. Also, with such AIs, animations of objects could be produced simply by image template and text description. These universal capabilities would replace a large number of previous special functions in compositing and video editing programs with simple text prompts, thus greatly simplifying and shortening previously complex work.

Link more infos at bei dreamix-video-editing.github.io

deutsche Version dieser Seite: Google Dreamix: Neue KI demonstriert die Videobearbeitung der Zukunft


  Vorige News lesen Nächste News lesen 
bildNeue DJI Mini 2 SE: Verbessertes Einsteigermodell für 389 Euro bildLightworks 2023 mit flexibler Oberfläche, HDR-Workflows und Masken

related news:1E0Edit your transcript and get a rough cut - text-based editing in Premiere Pro (Beta) 12.February 2023
DaVinci Resolve for iPad: Professional video editing and color correction for free 22.December 2022
Photoshop for videos? Pixelmator Pro 3.2 gets Video Editing / Compositing Layer 7.December 2022
Mobile editing app LumaFusion: New version 3.2 - and now also for Android 11.November 2022
Video editing by text command: After text-to-image comes text-to-video 11.September 2022
LumaFusion v3.1 update - mobile editing app now offers video scopes 20.July 2022
Is AI Revolutionizing Photography? Object-based editing with the help of DALL-E 2 30.June 2022
alle Newsmeldungen zum Thema Montage
1E0Stream more effectively: FFmpeg 6.0 brings among other things acceleration of AV1 via GPU 1.March 2023
Sony introduces new full-frame G Master 50mm F1.4: Lighter, more responsive and optimized for video 21.February 2023
Adobe Premiere Pro 23.2 Update bringt automatisches Tone Mapping und mehr 16.February 2023
New version of Avid Media Composer brings better collaboration with Pro Tools, among others 12.February 2023
Edit your transcript and get a rough cut - text-based editing in Premiere Pro (Beta) 12.February 2023
Lightworks 2023 with flexible interface, HDR workflows and masks 10.February 2023
Canon EOS R8 - Full frame hybrid camera with 10 bit log under 2000 Euro 8.February 2023
alle Newsmeldungen zum Thema DV Editing
1E0Runway Gen2: New text-to-video AI from the Stable Diffusion creators 20.March 2023
VideoFusion: First open source video AI is here - and also runs on the home PC 20.March 2023
Version 5 of the image AI Midjourney delivers photorealistic images - and even the hands are correct 19.March 2023
AI turns WLAN router into room radar 18.March 2023
AI and Copyright- No land in sight. 17.March 2023
Only 15s per image: Image AI Stable Diffusion runs on the smartphone 14.March 2023
Wonder Studio: Integrate virtual characters into movies easily and cheaply via AI 12.March 2023
alle Newsmeldungen zum Thema Machine Learning

[nach oben]

Archiv Newsmeldungen


March - February - January

December - November - October - September - August - July - June - May - April - March - February - January























deutsche Version dieser Seite: Google Dreamix: Neue KI demonstriert die Videobearbeitung der Zukunft

last update : 20.März 2023 - 20:00 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version