Logo Logo
directory schraeg
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Compositing· Color correction· DV Editing

Shooting· Sound
Forschung· Reviews· Streaming
/// News
Is AI Revolutionizing Photography? Object-based editing with the help of DALL-E 2

Is AI Revolutionizing Photography? Object-based editing with the help of DALL-E 2

[12:23 Thu,30.June 2022   by ]    

We have already reported about Images AI DALLE-2 and its amazing ability to generate impressive images just by text prompt, but photographer Nicholas Sherlock has turned his attention to another interesting field of application - as an assistant for intelligent photo editing.

Already now there are quite a number of AI tools or in plugins for image processing, but all of them are specialized only for a certain task, like sharpening the image - in contrast to that DALLE-2 impresses with its very comprehensive possibilities of "intelligent" image manipulation.

Targeted processing

Sherlock makes use of some special capabilities of DALLE-2, which until now were rather overshadowed by the photogeneration of images. DALLE-2 can be fed with an image as input, which can then be changed selectively. And here, too, the changes to the image are made only by an instruction via text that describes what exactly is to be changed in the image.

Thus with the help of the AI just as purposefully an object in a photo can be exchanged as also certain picture characteristics be changed or missing picture areas - for instance because something retouched - be meaningfully "supplemented" by the AI.


By so-called "in-painting", rough objects/areas in the image can be marked manually, which can then be replaced by another object (generated by DALLE-2 via text description), as can be seen in the following examples. Details can also be added or replaced by other matching ones:

A dog is inserted at different places in an image - each in the style of the context.

Or an object can simply be sharpened afterwards:

Post-sharpening of a macro shot of a June beetle.

DALLE-2&s extensive "knowledge" of image context, as well as the physics of objects in three-dimensional space, acquired through training on millions of images, allows for correct perspective as well as size and exposure to seamlessly insert the new object into the image. Even textures, shadows and reflections caused by the new object are taken into account as you can see in the following example.

The heron in the image is replaced by an elephant - including correct reflection in the water


Further possibilities of the photo treatment supplies the "Out Painting" (also "Uncropping" mentioned)can be supplemented pictures contextually meaningfully by DALLE-2 around picture areas. This can be used to create whole panoramas from famous paintings (here more Out-Painting examples ):

Vincent van Gogh&s Starry Night

Users of DALL-E 2 are already experimenting with the possibility to change objects in the picture, e.g. to show them from a different angle or to generate more visually appealing variations of an own photo:


KI: The Future of Photo and Video Editing?

DALLE-2 thus acts as a quasi-intelligent photoediting assistant that easily handles otherwise rather complex and tedious changes to a photo by command. DALLE-2 thus enables a new level of working with photos, object-based photoediting. Of course it will take some time until this technology is available to users in sufficiently good quality, but there is no doubt that it will come. What is hard to predict, however, are the consequences - will AI make the job of photographers easier or (in many cases) superfluous if masses of images can simply be generated as desired?

Photographer Micael Widell, for one, sees DALLE-2 (and other developments) as calling the future of photography into question (from 2:40):

Experience also shows that developments in image processing in the photographic field will soon arrive in video processing as well - the manipulation of temporal image series simply requires more processor (or GPU) power, in addition to changes in the structure of a neural network. Video editing with the help of AI could at least greatly simplify many workflows - such as in color grading - and also facilitate many tasks in compositing via object-based editing, but the development will not stop at the intelligent AI assistant and could also not stop at the creative aspect of many jobs - so one can be curious about the further development.

Link more infos at bei petapixel.com

deutsche Version dieser Seite: KI revolutioniert die Photographie: Objektbasiertes Editing mit Hilfe von DALL-E 2


  Vorige News lesen Nächste News lesen 
bildAnamorphotischer Adapter von Moment - kompatibel mit vielen Objektiven bildXiaomi 12S Ultra Smartphone wird mit 1" Sensor filmen

related news:1E0LumaFusion v3.1 update - mobile editing app now offers video scopes 20.July 2022
Events @ Filmfest München: Series editing, studio tour and more 20.June 2022
Video editing via AI: Simply replace backgrounds or make objects disappear 21.January 2022
Audio Design Desk 1.9: Real-time editing tool for sound effects now with new features and Lite versi 15.January 2022
Hedge Postlab for Media Composer enables team editing in the cloud for Avid editors 6.November 2021
Sony C3 Portal: Cloud solution for Sony cameras - from shooting directly to the editing suite 23.September 2021
Perfect for music videos: Spatial object-based video editing via AI and 16 cameras 19.September 2021
alle Newsmeldungen zum Thema Montage
1E0Which effects are GPU-accelerated in Blackmagic DaVinci Resolve 18? 7.August 2022
Film simulation tool Dehancer Film Pro now also available as beta for Final Cut Pro 2.August 2022
Adobe publishes extensive guide for Premiere Pro long form editors 1.August 2022
AI-based grading solution fylm.ai v1.3 learns some context 26.July 2022
LumaFusion v3.1 update - mobile editing app now offers video scopes 20.July 2022
Avid Media Composer Update 2022.7 brings multi-monitor workspaces and keyboard mapping alternatives 15.July 2022
Laowa introduces 12-24mm f/5.6 zoom lens for full frame 10.July 2022
alle Newsmeldungen zum Thema DV Editing
1E0New AI automatically perfectly exposes objects from photos 7.August 2022
AI-based grading solution fylm.ai v1.3 learns some context 26.July 2022
Anyone can do art: Meta's new AI acts as a painter at will 19.July 2022
Video stabilization: AI-supported Mercalli V6 SAL introduced 18.July 2022
DaVinci Resolve 18 Beta 5 - incl. AI stabilizer for gyro metadata and 10 bit preview 25.June 2022
See in the dark by AI with color 22.May 2022
Illuminated only by starlight: New AI algorithm denoises videos perfectly 16.May 2022
alle Newsmeldungen zum Thema Machine Learning

[nach oben]

Archiv Newsmeldungen


August - July - June - May - April - March - February - January

December - November - October - September - August - July - June - May - April - March - February - January






















deutsche Version dieser Seite: KI revolutioniert die Photographie: Objektbasiertes Editing mit Hilfe von DALL-E 2

last update : 7.August 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version