In its Runway Academy, the AI video pioneer teases another upcoming feature of the generative video generator Gen-3 Alpha Turbo: ‘Expand Video’
The technology is not completely unknown. The term ‘outpainting’ has long been used to describe the artificial expansion of a still image beyond its frame - and 16 months ago we already showed in 
a workshop on slashCAM how moving images and generaive fill of a still image can be used for a virtual superzoom.
With ‘Expand Video’, however, Runway goes a big step further and allows moving content to be seamlessly ‘added’ over the edges of a video. As a practical application, Runway mentions the possibility of converting horizontal videos into vertical videos and vice versa. However, this is of course only a very modest application horizon for this technology. In fact, text prompts can also be used to define the invented content in more detail. Or even use generated outpainting still images as a template for a further animation. The following Runway Academy video only hints at the possibilities this can open up:
If you have uploaded your own video as the basis, the following options are currently available:
Using the “Generate” button without further text prompts, you can simply let Gen-3 Alpha Turbo fill in the margins automatically. If the result does not meet your expectations, you can use a detailed text prompt to specify what you want to see in the non-visible parts outside the frame.
Alternatively, you can have the first frame of the start image filled in by another AI tool. Gen-3 Alpha Turbo then spins this content further.
Runway recommends three application rules for successful results:
- The main subject should be near the center of the image.
- No graphics or text in the base video or in the inserted backgrounds
- Use the prompt for your own requirements
If you want to create superzooms, the generations can also be cascaded - i.e. the generated video can be inserted into another one. Super wide-angle shots can also be created using this trick.
As expected, the web is currently filling up with demos from users who already have access to “Expand Video”.
Expand Video also offers the option of scaling old 4:3 formats such as Startrek to 16:9:
The feature will be activated for all paying Runway users “soon”.
;)