Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
Flying into photos of landscapes with new Google AI

Flying into photos of landscapes with new Google AI

[13:40 Sun,16.October 2022   by ]    

A team of researchers from Google Research at Cornell University and UC Berkeley have unveiled a new AI called InfiniteNature-Zero that allows photos of natural landscapes to come to life through virtual camera movement. Using a combination of inpainting, outpainting and super-resolution techniques, the new AI algorithm produces a quasi-infinite landscape flight shot - starting from just a single given photo. The resulting video simulates a flight motion and gives the impression of a drone flight over a natural landscape by constantly zooming or morphing. The viewer can even interactively change the direction of the flight live.





The quality of the videos is not yet very high and the resolution is only 512 x 512 pixels, but as always with such research, a new method is first demonstrated in principle before attention is then given to higher quality results.

InfiniteZero-Examples


Interestingly, the InfiniteNature-Zero AI was not trained using real flight photos but only using single photos of landscapes (no photo series) without any further data like camera position or orientation. The previous version still required video footage filmed by drones for training.

InfiniteZero-Algo


To produce the virtual flight shots, several individual problems had to be solved:
image information must be added that does not appear in the original initial image, such as hidden areas in a photograph, but which then become visible when the camera moves. For example, a location hidden behind trees must be generated.



This can be done by "inpainting," a method also offered by image-generating AIs such as Stable Diffusion. The AI produces a likely image content for the previously occluded location based on the imagery it learns.



To create the effect of flying, the AI must also generate image content that is outside the boundaries of the photo. This is called "outpainting" and, again, the AI must suitably generate missing image information via Deep Learning based on the original photo. Since virtual zooming into the photo also increases blurriness and image content appeared pixelated, the image is additionally sharpened afterwards via AI super-resolution.

The following video from 2 Minute Papers also shows how much better the new method is than older versions:

Link more infos at bei infinite-nature-zero.github.io

deutsche Version dieser Seite: Mit neuer Google KI in Photos von Landschaften hineinfliegen

  

  Vorige News lesen Nächste News lesen 
bildKostenlose Online-Sessions zu Premiere Pro und After Effects auf der Adobe MAX 2022 bildYouTranscription - Youtube Videos in durchsuchbare PDFs transkribieren


related news:1E0Meta Encodec uses AI to compress audio files significantly more than MP3 21.November 2022
AI copies movie style of "Into the Spider-Verse" in record time 14.November 2022
MAXIM - AI tool combines various image enhancements in one model 13.November 2022
Blackmagic DaVinci Resolve 18.1 Update - with AI voice isolation 11.November 2022
Photostock portal Shutterstock gives an answer to the big question and integrates AI images 5.November 2022
AvatarCLIP: New AI generates and animates 3D avatars by text description 28.October 2022
Topaz Video Enhance AI 3.0: New AI features and special price 24.October 2022
alle Newsmeldungen zum Thema Machine Learning
1E0Story & Film App - film planning on the smartphone from the idea to the cut 14.November 2022
AI copies movie style of "Into the Spider-Verse" in record time 14.November 2022
SLATE: The digital film flap made of e-paper that requires no electricity 13.November 2022
Silver Student Oscar for Babelsberg Animation Film "Laika & Nemo 31.October 2022
LETsDOK: Nationwide Documentary Film Days 11.September 2022
New Google AI perfectly de-noises RAW photos of dark scenes - soon also from video? 28.August 2022
DeepFake instead of reshoot: swear words retroactively removed from feature film 19.August 2022
alle Newsmeldungen zum Thema Film


[nach oben]
















Archiv Newsmeldungen

2022

November - October - September - August - July - June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Mit neuer Google KI in Photos von Landschaften hineinfliegen



last update : 29.November 2022 - 15:09 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version