Logo Logo
deutsch
directory schraeg
Knowledge

Hardware
Actioncam / 360°· Camcorders· Cinema-Kamera· Kamera(technik)· Kamera-Zubehör· Kameradrohnen· Lenses· Smartphone-Kamera· Video-DSLM/DSLR
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Filmmaking· Generative KI
Misc
Audio· Live-Streaming· Sonstige
/// News
HeyGen Video Translate offers easy translation and dubbing of video clips

HeyGen Video Translate offers easy translation and dubbing of video clips

[10:30 Thu,28.September 2023   by ]    

A new AI service that can translate videos into eight different languages, while also adjusting the lip movements of the speaker, has been making the rounds for a few days now. Basically, the thing is not new, but HeyGen Video Translate (still in beta) makes it extremely easy to use - the video to be translated is simply uploaded via drag/drop and after a waiting period the new video is ready.

heygen_video_translate
Simple interface


HeyGen, it seems, relies on technology from ElevenLabs to generate the sound of the original voices in another language, while the translation presumably comes from ChatGPT. Whether the altered mouth movements are created in-house (à la Deepfake) is not entirely clear. Originally, HeyGen provides digital avatars that can be used in videos and recite a desired text (AI spokesperson video creator).



The automatic dubbing with the original voice works quite well. However, the text translation sounds faulty or awkward in some places, as can be heard in the following video from about 1:50 in the German version (there is talk of a "vowel translator", for example). Unfortunately, there is no possibility to correct the translation itself. The lip movement is also not perfect, but looks slightly out of sync, plus the picture is lightened.

According to HeyGen, the videos to be translated should preferably only show individual people and have little distracting noise in the background. Supported are MP4, Quicktime and WebM in resolutions between 360x360 and 4096x4096. The clips must also be at least 30s long, the maximum length is 5 minutes or 500MB.

Die Nutzung von HeyGen Video Translate ist probeweise kostenlos, man muss sich jedoch anmelden. Dann bekommt man einmalig 2 Credits zur Verfügung gestellt, die insgesamt für die Übersetzung von 2 Videominuten reichen; abgerechnet wird im 30-Sekundentakt. Danach gibt es verschiedene Abo-Pläne für 15 bis 120 Credits pro Monat, wobei ein Credit bei jährlicher Abrechnung 1,60 Dollar kostet. Wer einen bezahlten Account hat, wird in der Warteschlange für die Videoausspielung bevorzugt.

Im Mai hatte Google ja einen "Universal Translator" vorgestellt, der ziemlich genau die jetzt von HeyGen gebotene Funktionalität für YouTube-Videos bieten wird, jedoch noch nicht frei zugänglich ist.



deutsche Version dieser Seite: HeyGen Video Translate bietet einfaches Übersetzen und Dubben von Videoclips

  

  Vorige News lesen Nächste News lesen 
bildDrehbuchstreik in Hollywood endet nach 148 Tagen mit gutem Deal für Autoren - auch in Punkto KI bildIMAX-Blockbuster The Creator mit 5.000 Euro Kamera gedreht - Sonys FX3


related news:1E0New tutorial clips from Blackmagic Design: Getting started with the Camera App and Filesync with BM Cloud 29.November 2023
Adobe AI splits audio clip into different tracks - Project Sound Lift 17.November 2023
Behind the Scenes Clip from Apple: Launch Event Produced with the iPhone 15 Pro Max 1.November 2023
Video clip: The new Atomos monitor/recorder line-up explained: new features, applications and more, 22.September 2023
Video clip: Canon RF Cine fixed focal length explained 20.September 2023
Video clip - Adobe Premiere Pro explained: Automatically remove pauses and filler words with AI, etc. 19.September 2023
Video Clip: SmallRigs new VB99 Pro Battery, ultra-compact 60W LED and Smartphone Cage 18.September 2023
alle Newsmeldungen zum Thema Shooting
1E0Meta Emu AI image generator - free online, but currently only in the USA 7.December 2023
SDXL-Turbo - New AI algorithm accelerates stable diffusion dramatically 6.December 2023
PIKA 1.0 announced - Generative AI videos with amazing quality 29.November 2023
The next step is here: AI trains AI (and no longer needs humans) 28.November 2023
Insta360 Ace Pro - Action Cam with 8K sensor, Leica optics and lots of AI 24.November 2023
Stable Video Diffusion - Free AI diffusion model for video generation presented 23.November 2023
Boris FX: Continuum gets AI functions - denoiser and upscaler 21.November 2023
alle Newsmeldungen zum Thema KI


[nach oben]
















Archiv Newsmeldungen

2023

December - November - October - September - August - July - June - May - April - March - February - January

2022
December - November - October - September - August - July - June - May - April - March - February - January

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: HeyGen Video Translate bietet einfaches Übersetzen und Dubben von Videoclips



last update : 8.Dezember 2023 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version