Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
Is AI Revolutionizing Photography? Object-based editing with the help of DALL-E 2

Is AI Revolutionizing Photography? Object-based editing with the help of DALL-E 2

[12:23 Thu,30.June 2022   by ]    

We have already reported about Images AI DALLE-2 and its amazing ability to generate impressive images just by text prompt, but photographer Nicholas Sherlock has turned his attention to another interesting field of application - as an assistant for intelligent photo editing.

Already now there are quite a number of AI tools or in plugins for image processing, but all of them are specialized only for a certain task, like sharpening the image - in contrast to that DALLE-2 impresses with its very comprehensive possibilities of "intelligent" image manipulation.


DALLE2-editing
Targeted processing



Sherlock makes use of some special capabilities of DALLE-2, which until now were rather overshadowed by the photogeneration of images. DALLE-2 can be fed with an image as input, which can then be changed selectively. And here, too, the changes to the image are made only by an instruction via text that describes what exactly is to be changed in the image.

Thus with the help of the AI just as purposefully an object in a photo can be exchanged as also certain picture characteristics be changed or missing picture areas - for instance because something retouched - be meaningfully "supplemented" by the AI.

In-Painting


By so-called "in-painting", rough objects/areas in the image can be marked manually, which can then be replaced by another object (generated by DALLE-2 via text description), as can be seen in the following examples. Details can also be added or replaced by other matching ones:

Editing-context
A dog is inserted at different places in an image - each in the style of the context.



Or an object can simply be sharpened afterwards:

DALLE-2-fixed-photo
Post-sharpening of a macro shot of a June beetle.



DALLE-2&s extensive "knowledge" of image context, as well as the physics of objects in three-dimensional space, acquired through training on millions of images, allows for correct perspective as well as size and exposure to seamlessly insert the new object into the image. Even textures, shadows and reflections caused by the new object are taken into account as you can see in the following example.

elephant
The heron in the image is replaced by an elephant - including correct reflection in the water





Out-Painting

.
Further possibilities of the photo treatment supplies the "Out Painting" (also "Uncropping" mentioned)can be supplemented pictures contextually meaningfully by DALLE-2 around picture areas. This can be used to create whole panoramas from famous paintings (here more Out-Painting examples ):

Starry-Night-uncroped-pur
Vincent van Gogh&s Starry Night



Users of DALL-E 2 are already experimenting with the possibility to change objects in the picture, e.g. to show them from a different angle or to generate more visually appealing variations of an own photo:

DALLE-2-Variations-of-photo
Variations



KI: The Future of Photo and Video Editing?


DALLE-2 thus acts as a quasi-intelligent photoediting assistant that easily handles otherwise rather complex and tedious changes to a photo by command. DALLE-2 thus enables a new level of working with photos, object-based photoediting. Of course it will take some time until this technology is available to users in sufficiently good quality, but there is no doubt that it will come. What is hard to predict, however, are the consequences - will AI make the job of photographers easier or (in many cases) superfluous if masses of images can simply be generated as desired?

Photographer Micael Widell, for one, sees DALLE-2 (and other developments) as calling the future of photography into question (from 2:40):



Experience also shows that developments in image processing in the photographic field will soon arrive in video processing as well - the manipulation of temporal image series simply requires more processor (or GPU) power, in addition to changes in the structure of a neural network. Video editing with the help of AI could at least greatly simplify many workflows - such as in color grading - and also facilitate many tasks in compositing via object-based editing, but the development will not stop at the intelligent AI assistant and could also not stop at the creative aspect of many jobs - so one can be curious about the further development.

Link more infos at bei petapixel.com

deutsche Version dieser Seite: KI revolutioniert die Photographie: Objektbasiertes Editing mit Hilfe von DALL-E 2

  

  Vorige News lesen Nächste News lesen 
bildAnamorphotischer Adapter von Moment - kompatibel mit vielen Objektiven bildXiaomi 12S Ultra Smartphone wird mit 1" Sensor filmen


related news:1E0Mobile editing app LumaFusion: New version 3.2 - and now also for Android 11.November 2022
Video editing by text command: After text-to-image comes text-to-video 11.September 2022
LumaFusion v3.1 update - mobile editing app now offers video scopes 20.July 2022
Events @ Filmfest München: Series editing, studio tour and more 20.June 2022
Video editing via AI: Simply replace backgrounds or make objects disappear 21.January 2022
Audio Design Desk 1.9: Real-time editing tool for sound effects now with new features and Lite versi 15.January 2022
Hedge Postlab for Media Composer enables team editing in the cloud for Avid editors 6.November 2021
alle Newsmeldungen zum Thema Montage
1E0UPDATE 2: Black Friday and Cyber Monday deals from Avid, Laowa, Filmconvert, Viltrox and more. 25.November 2022
Mobile editing app LumaFusion: New version 3.2 - and now also for Android 11.November 2022
Even more Black Friday deals: Blackmagic, Smallrig, Pinnacle, Anton Bauer, Glidecam, Amar 10.November 2022
Stabilized Canon full-frame RF 135mm F1.8 L IS USM lens announced for January 2023 3.November 2022
New Apple Mac Pro with M2 Extreme chip with 48 CPU and 152 GPU cores and 256 GB delayed 1.November 2022
BRAW Toolbox allows native Blackmagic RAW file import under Final Cut Pro 1.November 2022
Apple unveils updates for better performance for Final Cut Pro, Compressor, iMovie, and more 27.October 2022
alle Newsmeldungen zum Thema DV Editing
1E0Meta Encodec uses AI to compress audio files significantly more than MP3 21.November 2022
AI copies movie style of "Into the Spider-Verse" in record time 14.November 2022
MAXIM - AI tool combines various image enhancements in one model 13.November 2022
Blackmagic DaVinci Resolve 18.1 Update - with AI voice isolation 11.November 2022
Photostock portal Shutterstock gives an answer to the big question and integrates AI images 5.November 2022
AvatarCLIP: New AI generates and animates 3D avatars by text description 28.October 2022
Topaz Video Enhance AI 3.0: New AI features and special price 24.October 2022
alle Newsmeldungen zum Thema Machine Learning


[nach oben]
















Archiv Newsmeldungen

2022

December - November - October - September - August - July - June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: KI revolutioniert die Photographie: Objektbasiertes Editing mit Hilfe von DALL-E 2



last update : 1.Dezember 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version