Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· GPU· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Reviews
/// News
Edit the words of a speaker in a video using a text editor // Siggraph 2019

Edit the words of a speaker in a video using a text editor // Siggraph 2019

[10:19 mon,24.June 2019   by ]    

A new deepfake algorithm will soon give filmmakers and editors completely new freedom when editing clips with spoken words. If only a new take could save a scene in which an actor missed or missed a spoken word, the new post-production method would make it easy to make far-reaching changes to the spoken text.

It&s enough to just edit a transcript of the spoken text with a kind of text editor to change, delete or rearrange words - the algorithm developed by researchers at Stanford University, the Max Planck Institute for Computer Science, Princeton University and Adobe Research automatically does the rest: it synthesizes the new words with the actor&s voice and adjusts the lip movements accordingly.





A prerequisite for convincing work with the algorithm is a minimum of 40 minutes of training material from the speaker and a transcript of the spoken words (which, however, can also be generated automatically by increasingly better tools). Based on the training material, the algorithm learns which facial expressions a speaker makes when speaking each phonetic syllable and how he pronounces them - the basis for the synthetic pronunciation of new words. In tests with 138 participants, the manipulations were classified as "real" in almost 60 percent of the cases. The visual quality of the new passages is so good that it comes very close to the original, but there is still plenty of room for improvement.

Speech-Editjpg


In addition to the obvious benefits for professional video work, such as the subsequent modification of dialogues without new recordings, such a simple manipulation option can of course also be misused to fake videos. Although algorithms are also being developed to detect such fakes - be they images, videos or audio - to recognize, in return the fakes are becoming more and more realistic - neural networks can even be trained in interaction to produce fakes that are increasingly difficult to identify (Generative Adversarial Networks).

Link more infos at bei news.stanford.edu

deutsche Version dieser Seite: Per Texteditor die Worte eines Sprechers in einem Video verändern // Siggraph 2019



Zur Übersicht aller unserer News zur Siggraph 2019

  

  Vorige News lesen Nächste News lesen 
bildVimeo kündigt Unterstützung für freien AV1 Codec an bildBremst Chrome Final Cut Pro X?


related news:1E0Edius X now available with new background rendering 17.September 2020
Blackmagic DaVinci Resolve Update 16.2.7 brings support for new Nvidia RTX 3080, RTX 3090 and RTX 30 17.September 2020
Adobe Creative Cloud - new features for Premiere Pro and After Effects 2020 15.September 2020
Blackmagic: Updates for DaVinci Resolve, Pocket Cinema Camera 4K/6K and Video Assist 12G 29.August 2020
Adobe's Premiere Rush gets Auto Reframe and Pan'Zoom effect 27.August 2020
Blackmagic DaVinci Resolve Update 16.3 Beta 2: Now also support for BRAW 12K on Windows 10.August 2020
Blackmagic DaVinci Resolve 16.2.5 Update 1.August 2020
alle Newsmeldungen zum Thema Compositing
1E0AI synchronizes lip movements with audio in real time 23.September 2020
Sennheiser MKE 200: New compact mini microphone for DSLRs and mirrorless cameras 1.September 2020
miniDSP ambiMIK-1: Ambisonic USB microphone for 3D 360° audio 16.August 2020
Zoom-PodTrack-Podcasting-Recorder P4 and ZDM-1 Podcast Mic Pack 14.August 2020
New: Magix Vegas Pro 18 with Sound Forge Pro integration -- cloud tools for teams to follow 4.August 2020
Zoom H8 Handy Recorder offers up to 10 XLR microphone-inputs 3.July 2020
June update: Adobe Premiere Pro CC integrates stock audio libraries for easy licensing 16.June 2020
alle Newsmeldungen zum Thema Sound


[nach oben]
















Archiv Newsmeldungen

2020

September - August - July - June - May - April - March - February - January

2019
December - November - October - September - August - July - June - May - April - March - February - January

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Per Texteditor die Worte eines Sprechers in einem Video verändern // Siggraph 2019



last update : 25.September 2020 - 12:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version