Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
Meta Encodec uses AI to compress audio files significantly more than MP3

Meta Encodec uses AI to compress audio files significantly more than MP3

[11:20 Mon,21.November 2022   by ]    

This sounds exciting: Meta / Facebook Research have presented an AI-based audio codec called Encodec, which (at least on the research paper) is really something. Compared to MP3 files, this codec is supposed to achieve a compression that is better by a factor of 10, especially at very low data rates and with comparable quality.

This would mean that MP3 audio files could be reduced to a tenth of their data storage requirements on average. This in turn would have an enormous impact on offline storage and audio streaming.

The structure of Encodec is strongly reminiscent of typical VACs/GANs. The compressor generates samples that a following discriminator classifies as real or reconstructed. The compression model then modifies its output until the discriminator considers all samples to be real. At the same time, the discriminator also learns to distinguish "real" from "reconstructed" more and more reliably. This interplay subsequently perfects the audio quality with minimal data input in the model.



encodec
The structure of Encodec (image source: Meta)



According to Meta, Encodec can thus reconstruct audio with a low bit rate (64 kb/s) without loss of quality and also has potential for further improvements. For example, they also trained a transformer-based speech model that could save another 40 per cent bandwidth while maintaining the same quality, if latency was not crucial, as it is in streaming. In other words, if the encoder does not have to work in real time, even greater compression gains are possible for MP3 audio applications.

Interestingly, special hardware is also not necessary for the application. A single CPU core is said to be sufficient for encoding and decoding with the new method in real time.

And that is still not enough. Meta has announced that it will also use AI to compress video more effectively in an upcoming research project.



deutsche Version dieser Seite: Meta Encodec komprimiert mit KI Audio-Dateien deutlich stärker als MP3

  

  Vorige News lesen Nächste News lesen 
bildARRI Rental stellt mit HEROES weitere LF Objektiv-Kollektion vor: T.One und LOOK bildUmfrage unter 1.000 Fotografen (Pros und Amateure): Welche Kamera nutzt ihr?


related news:1E0Heavy Metal meets Midjourney: Music video made from 10,000 AI-generated images 4.December 2022
AI copies movie style of "Into the Spider-Verse" in record time 14.November 2022
MAXIM - AI tool combines various image enhancements in one model 13.November 2022
Blackmagic DaVinci Resolve 18.1 Update - with AI voice isolation 11.November 2022
Photostock portal Shutterstock gives an answer to the big question and integrates AI images 5.November 2022
AvatarCLIP: New AI generates and animates 3D avatars by text description 28.October 2022
Topaz Video Enhance AI 3.0: New AI features and special price 24.October 2022
alle Newsmeldungen zum Thema Machine Learning
1E0BRAW Toolbox allows native Blackmagic RAW file import under Final Cut Pro 1.November 2022
Blackmagic DaVinci Resolve 18.0.4 bringt Blackmagic RAW 2.7 1.October 2022
Nvidia RTX 6000: 48 GB VRAM und 18.176 CUDA Kerne 23.September 2022
Apple finally works on universal support for AV1 codec 26.June 2022
Adobe Premiere Pro Update 22.4 brings 10x faster 4:2:0 HEVC export 12.May 2022
AJA HELO Plus: Professional dual H.264 streaming and recording 27.April 2022
Teradek Prism Flex: H.264/H.265-Enkodierung/Dekodierung und Streaming in 4K HDR 27.March 2022
alle Newsmeldungen zum Thema Codecs
1E0UPDATE 3: Cyber Monday and other discount offers from Dedolight, Sennheiser, Asus, Samyang, Lowepro, 27.November 2022
UPDATE 2: Black Friday and Cyber Monday deals from Avid, Laowa, Filmconvert, Viltrox and more. 25.November 2022
Philipp's 4K UHD mini LED monitor incl. Thunderbolt 4 (MSRP. 1,299) goes on sale 25.November 2022
UPDATE: Black Friday discount promotions for 2022 filmmakers - Hollyland, Western Digital, SanDisk P 23.November 2022
Blackmagic Design launches new DaVinci Resolve update 18.1.1 23.November 2022
Beware of Sony's new firmware update for ILME-FX3 and FX30 18.November 2022
RØDE NT-USB+: Professional USB condenser microphone with integrated DSP 18.November 2022
alle Newsmeldungen zum Thema PC


[nach oben]
















Archiv Newsmeldungen

2022

December - November - October - September - August - July - June - May - April - March - February - January

2021
December - November - October - September - August - July - June - May - April - March - February - January

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Meta Encodec komprimiert mit KI Audio-Dateien deutlich stärker als MP3



last update : 4.Dezember 2022 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version