Logo Logo
directory schraeg
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Compositing· Color correction· DV Editing

Shooting· Sound
Forschung· Reviews· Streaming
/// News
Deep yes, fake no? Documentary filmmaker uses AI generated quotes

Deep yes, fake no? Documentary filmmaker uses AI generated quotes

[12:02 sun,18.July 2021   by ]    

The question of where authenticity ends and pure storytelling begins in documentary film is a recurring topic of discussion, and not just since it became possible to manipulate images and sounds digitally. However, with increasingly better manipulation possibilities, the discussion is becoming more and more urgent as to which of these means are harmless in documentary storytelling or when a line is crossed.

The documentary Roadrunner: A Film About Anthony Bourdain which has just opened in U.S. theaters and will later be shown on HBO Max, provides a current occasion for this. In it, director Morgan Neville portrays the well-known chef and author who, among other things, undertook culinary journeys for TV until he took his own life in 2018. He does this with the help of all kinds of film and sound recordings from TV, radio, podcasts and audio books, etc., as well as self-conducted interviews - so far, so classic. Bourdain&s typical off-screen voice can often be heard, which is not unusual, so you end up knitting a narrative during editing, with him partly acting as the narrator of his own story.

However, it turns out that they are not always original sounds spoken by Bourdain himself, but among them are also three "audio deepfakes", which were subsequently created especially for the film by an AI, after it was trained with over 10 hours of audio material to be able to deceptively imitate Bourdain&s voice. This was noticed, among others, by a reporter from the New Yorker, who was surprised to hear Bourdain read out an e-mail he had written himself, but the director also speaks openly about this in this interview.

Neville emphasizes that he did not put words into Bourdain&s mouth that he had not written himself, but for dramaturgical reasons he had wished to be able to use them as "original sound" for some quotations. In addition, he had received the green light from Bourdain&s widow and his executor.

So everything is not so bad in this case, one might think. And yet one gets the feeling that the documentary film has -- once again? -- lost its innocence. After all, original sounds were constructed that didn&t exist as such; moreover, a voice automatically adds emotions to a statement that one doesn&t know whether they were contained in the same way in the written passage. In fact, Neville says it wasn&t that easy to decide on a voice pitch, because Bourdain&s voice pitch also changed over the years.

Last but not least, every rule violation stretches the realm of possibility - if it&s OK to have an AI repeat a protagonist&s written sentences, it might not be so far-fetched to tweak the sentence structure a bit, or maybe combine two sentences into one, just as you need for your timing. Perhaps it will soon be possible to link the fake voice with an artificially calculated image, including simulated facial expressions.

The truthfulness of a documentary has always depended to a large extent on the integrity of the person who creates it. But the technical temptations are undoubtedly increasing.

Bild zur Newsmeldung:

Link more infos at bei www.newyorker.com

deutsche Version dieser Seite: Deep ja, Fake nein? Dokumentarfilmer läßt O-Töne von KI einsprechen


  Vorige News lesen Nächste News lesen 
bildNeu: Gewindeadapter-Set und Miniaturstativ von RØDE bildAudio Design Desk 1.7: Echtzeit-Editing Tool für SFX jetzt mit DAW Synchronisation

related news:1E0Illuminated only by starlight: New AI algorithm denoises videos perfectly 16.May 2022
NAB 2022 Tutorialclip: DaVinci Resolve 18 - AI-Mask Objects, Depth Mask, Surface Tracker 27.April 2022
AI helps to synchronize motion pictures 16.April 2022
Apple Final Cut Pro update brings duplicate detection and voice isolation via AI 13.April 2022
DALL-E 2: AI generates and edits images based on text description only 10.April 2022
AI generates frighteningly accurate portraits - based on voice alone 9.April 2022
New AJA Ki Pro GO firmware 4.0 brings new playback options 3.April 2022
alle Newsmeldungen zum Thema Machine Learning
1E0Filmmaker Mode for TVs takes ambient light into account in the future 10.January 2022
Fantastic Fungi by time lapse Behind the Scenes 5.September 2021
Samsung: Filmmaker Mode on QLED TVs via firmware update 14.July 2020
Filmmaker Mode for television gets further support 12.January 2020
SKYWATCH - Hollywood-ready SciFi short film with Blender and Kickstarter 6.December 2019
Filmmaker fashion for television shows films as intended by the directors 29.August 2019
Meyer Optik Görlitz: first successful with Kickstarter, now insolvent 26.August 2018
alle Newsmeldungen zum Thema Filmmakers

[nach oben]

Archiv Newsmeldungen


May - April - March - February - January

December - November - October - September - August - July - June - May - April - March - February - January






















deutsche Version dieser Seite: Deep ja, Fake nein? Dokumentarfilmer läßt O-Töne von KI einsprechen

last update : 21.Mai 2022 - 15:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version