Logo Logo
directory schraeg
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Compositing· Color correction· DV Editing

Shooting· Sound
Forschung· KI· Reviews· Streaming
/// News
Meta Encodec uses AI to compress audio files significantly more than MP3

Meta Encodec uses AI to compress audio files significantly more than MP3

[11:20 Mon,21.November 2022   by ]    

This sounds exciting: Meta / Facebook Research have presented an AI-based audio codec called Encodec, which (at least on the research paper) is really something. Compared to MP3 files, this codec is supposed to achieve a compression that is better by a factor of 10, especially at very low data rates and with comparable quality.

This would mean that MP3 audio files could be reduced to a tenth of their data storage requirements on average. This in turn would have an enormous impact on offline storage and audio streaming.

The structure of Encodec is strongly reminiscent of typical VACs/GANs. The compressor generates samples that a following discriminator classifies as real or reconstructed. The compression model then modifies its output until the discriminator considers all samples to be real. At the same time, the discriminator also learns to distinguish "real" from "reconstructed" more and more reliably. This interplay subsequently perfects the audio quality with minimal data input in the model.

The structure of Encodec (image source: Meta)

According to Meta, Encodec can thus reconstruct audio with a low bit rate (64 kb/s) without loss of quality and also has potential for further improvements. For example, they also trained a transformer-based speech model that could save another 40 per cent bandwidth while maintaining the same quality, if latency was not crucial, as it is in streaming. In other words, if the encoder does not have to work in real time, even greater compression gains are possible for MP3 audio applications.

Interestingly, special hardware is also not necessary for the application. A single CPU core is said to be sufficient for encoding and decoding with the new method in real time.

And that is still not enough. Meta has announced that it will also use AI to compress video more effectively in an upcoming research project.

deutsche Version dieser Seite: Meta Encodec komprimiert mit KI Audio-Dateien deutlich stärker als MP3


  Vorige News lesen Nächste News lesen 
bildARRI Rental stellt mit HEROES weitere LF Objektiv-Kollektion vor: T.One und LOOK bildUmfrage unter 1.000 Fotografen (Pros und Amateure): Welche Kamera nutzt ihr?

related news:1E0Inspiring AI image variations at the click of a mouse with Stable Diffusion Reimagine / unCLIP 31.March 2023
Insta360 Flow - smartphone gimbal with AI tracking introduced 29.March 2023
Runway Gen-1 available- expensive AI video generator to get you started 28.March 2023
This is what the AI-generated winning films of the Runway AI Film Festival look like 27.March 2023
How to produce a SF clip in just 3h using AI tools 24.March 2023
Microsoft with generative AI models for everyone in the browser - Bing Image Creator 23.March 2023
Adobe announces Firefly: Generative AI models now directly from Adobe 21.March 2023
alle Newsmeldungen zum Thema KI
1E0Blackmagic: Camera Update 8.0 and new recommendations for USB-C SSDs for BRAW capture 3.March 2023
Stream more effectively: FFmpeg 6.0 brings among other things acceleration of AV1 via GPU 1.March 2023
BRAW Toolbox - Blackmagic RAW Import in FCPX to be available on Monday 27.January 2023
BRAW Toolbox allows native Blackmagic RAW file import under Final Cut Pro 1.November 2022
Blackmagic DaVinci Resolve 18.0.4 bringt Blackmagic RAW 2.7 1.October 2022
Nvidia RTX 6000: 48 GB VRAM und 18.176 CUDA Kerne 23.September 2022
Apple finally works on universal support for AV1 codec 26.June 2022
alle Newsmeldungen zum Thema Codecs
1E0IP Workflows: NDI HX2 Update Available for Atomos Connect Series 29.March 2023
Faster and more durable than any SSD: the DDRAM disk with 15 GB/s read speed 26.March 2023
Sennheiser Profile USB Microphone - easy to use for podcasts & co 25.March 2023
Blackmagic HyperDeck 8.3 update brings among other things recording and playback via network 22.March 2023
AI turns WLAN router into room radar 18.March 2023
Sony Creators& App now available (incl. Sony A7IV firmware update 2.0) 9.March 2023
Another update - Blackmagic DaVinci Resolve 18.1.4 6.March 2023
alle Newsmeldungen zum Thema PC

[nach oben]

Archiv Newsmeldungen


April - March - February - January

December - November - October - September - August - July - June - May - April - March - February - January























deutsche Version dieser Seite: Meta Encodec komprimiert mit KI Audio-Dateien deutlich stärker als MP3

last update : 1.April 2023 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version