OGG support in MultiDecoder? #2131

z-l-p · 2025-08-16T19:09:26Z

z-l-p
Aug 16, 2025

I have an Icecast stream receiver application where the sources may be MP3 or OGG format. In recent projects I have used the MultiDecoder class to handle MP3 and AAC (and the amazing new HLS capability too). Now I'm stumbling over ogg support.

I've read here that OGG decoding is different than the others, but I'm not sure how to incorporate it into my MultiDecoder structure (with the default automatic mime type detection). If that's not possible, maybe there's a way to hook into the mime detection and switch to a second pipeline / copier when "application/ogg" is detected?

I tried a MultiDecoder pattern like below, but it won't compile.

URLStream url("SSID","PASSWORD");
I2SStream i2s;
MultiDecoder multi(url);
MP3DecoderHelix mp3;
AACDecoderHelix aac;
VorbisDecoder ogg;
EncodedAudioStream dec(&i2s, &multi); // Decoding stream
StreamCopy copier(dec, url); // copy url to decoder

In Setup...

// register supported codecs with their mime type
  multi.addDecoder(mp3, "audio/mpeg");
  multi.addDecoder(aac, "audio/aac");
  multi.addDecoder(ogg, "application/ogg");

  // setup i2s
  auto config = i2s.defaultConfig(TX_MODE);
  // you could define e.g your pins and change other settings
  i2s.begin(config);

  // setup I2S based on sampling rate provided by decoder
  dec.begin();

Compiler error:

error: no matching function for call to 'audio_tools::MultiDecoder::addDecoder(audio_tools::VorbisDecoder&, const char [16])'
   26 |   multi.addDecoder(ogg, "application/ogg");
      |   ~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~

Answered by pschatzmann

Aug 16, 2025

You can try to convert a StreamingDecoder to an AudioDecoder with the help of the DecoderAdapter class.
However, I am not sure how reliable this is and there is quite some overhead.

The opposite would be much more efficient: use the new MultiStreamingDecoder class and convert your AudioDecoder to StreamingDecoder with the StreamingDecoderAdapter

View full answer

pschatzmann · 2025-08-16T23:23:08Z

pschatzmann
Aug 16, 2025
Maintainer

You can try to convert a StreamingDecoder to an AudioDecoder with the help of the DecoderAdapter class.
However, I am not sure how reliable this is and there is quite some overhead.

The opposite would be much more efficient: use the new MultiStreamingDecoder class and convert your AudioDecoder to StreamingDecoder with the StreamingDecoderAdapter

1 reply

z-l-p Aug 17, 2025
Author

I'm not sure about the difference between an audio decoder and a streaming decoder, but I'm willing to try! I synced the recent commits to gain the MultiStreamingDecoder and tried this:

#include "AudioTools.h"
#include "AudioTools/AudioCodecs/CodecMP3Helix.h"
#include "AudioTools/AudioCodecs/CodecAACHelix.h"
#include "AudioTools/AudioCodecs/CodecVorbis.h"
#include "AudioTools/AudioLibs/AudioBoardStream.h"

URLStream url("SSID","PASS");  
I2SStream i2s;
MP3DecoderHelix mp3;
AACDecoderHelix aac;
VorbisDecoder ogg;
MultiStreamingDecoder multi;

void setup(){
  Serial.begin(115200);
  AudioToolsLogger.begin(Serial, AudioToolsLogLevel::Info);  

  // setup i2s
  auto config = i2s.defaultConfig(TX_MODE);
    // Custom I2S pins for my Xaio board
  config.pin_ws = 9; // (DAC "LRCK")
  config.pin_bck = 7; // (DAC "BCK")
  config.pin_data = 8; // (DAC "DIN")
  i2s.begin(config);

  // register supported codecs with their mime type
  multi.addDecoder(mp3, "audio/mpeg");
  multi.addDecoder(aac, "audio/aac");
  multi.addDecoder(ogg, "audio/ogg");
  // setup I2S based on sampling rate provided by decoder
  multi.setInput(url);
  multi.setOutput(i2s);
  multi.begin();

  // mp3 radio
  //url.begin("http://stream.srg-ssr.ch/m/rsj/mp3_128");
  url.begin("https://locus.creacast.com:9443/santander_bay.ogg");

}

void loop(){
  multi.copy();
}

Using the OGG URL I get a crash when the Vorbis decoder starts:

[I] HttpRequest.h : 316 - Request written ... waiting for reply
[I] HttpHeader.h : 230 - Waiting for data...
[I] HttpHeader.h : 239 - Data available: 473
[I] HttpHeader.h : 110 - Content-Type: application/ogg
[I] HttpRequest.h : 181 - no CONTENT_LENGTH found in reply
[I] URLStream.h : 98 - contentLength: 0
[I] URLStream.h : 241 - Request written ... waiting for reply
[I] URLStream.h : 105 - ==> http status: 200
[I] StreamingDecoder.h : 505 - mime from mime_detector: audio/ogg
[I] StreamingDecoder.h : 566 - Using StreamingDecoder for audio/ogg (audio/ogg)
[I] CodecVorbis.h : 40 - begin
Guru Meditation Error: Core  1 panic'ed (LoadProhibited). Exception was unhandled.

Using the MP3 URL it seems to mis-identify the stream as M4A so it fails:

[I] HttpHeader.h : 196 -  -> Accept-Encoding: identity 
[I] HttpHeader.h : 196 -  -> Accept: */* 
[I] HttpHeader.h : 338 -  -> <CR LF> 
[I] HttpRequest.h : 316 - Request written ... waiting for reply
[I] HttpHeader.h : 230 - Waiting for data...
[I] HttpHeader.h : 239 - Data available: 5760
[I] HttpHeader.h : 110 - Content-Type: audio/mpeg
[I] HttpRequest.h : 181 - no CONTENT_LENGTH found in reply
[I] URLStream.h : 98 - contentLength: 0
[I] URLStream.h : 105 - ==> http status: 200
[I] StreamingDecoder.h : 505 - mime from mime_detector: audio/m4a
[E] StreamingDecoder.h : 508 - The decoder could not be found for audio/m4a

z-l-p · 2025-08-17T14:40:36Z

z-l-p
Aug 17, 2025
Author

Further attempts (using the last updates from August 16):
I ran the test-streaming-adapter.ino sketch and verified that StreamingAdapter works OK with MP3 codec. (This bypasses mime detection step.)

I ran the OGG sketch from the Streaming Decoding section of the "Encoding and Decoding of audio" wiki page. I think this ran OK a few days ago, but today the codec seems to start but doesn't decode anything:

[I] URLStream.h : 105 - ==> http status: 200
[I] CodecVorbis.h : 40 - begin

NOTE: That wiki page needs an update, because the StreamingDecoder methods setInputStream() and setOutputStream() are now renamed to setInput() and setOutput()

Ah! I just realized from the commits that you're working on the mime stuff right now. I'll be quiet so I don't add any more noise!

0 replies

pschatzmann · 2025-08-17T19:01:41Z

pschatzmann
Aug 17, 2025
Maintainer

I committed my final corrections and it should work now:

I have added a setMimeSource() method to allow to get the mime from the URLStream: multi.setMimeSource(url);
I extended the audio/ogg definitions to contain the codec in the MimeDetector: e.g. "audio/ogg; codec=vorbis"

you can handle both cases with

  multi.addDecoder(ogg, "audio/ogg; codec=vorbis"); // from mime detector
  multi.addDecoder(ogg, "application/ogg"); // from url

I also corrected the functionality to notify the output about the actual AudioInfo from the streaming decoder.

2 replies

z-l-p Aug 17, 2025
Author

Amazing. Thanks! MP3 works great. OGG gets much further tan before, but fails like this:

[I] StreamingDecoder.h : 798 - mime from detector: audio/ogg; codec=vorbis
[I] StreamingDecoder.h : 539 - bool audio_tools::MultiStreamingDecoder::selectDecoder(const char*)
[I] StreamingDecoder.h : 569 - Using Decoder audio/ogg; codec=vorbis for audio/ogg; codec=vorbis
[I] CodecVorbis.h : 40 - begin
[I] StreamingDecoder.h : 586 - StreamingDecoder audio/ogg; codec=vorbis started
[I] CodecVorbis.h : 80 - available: 58
[E] CodecVorbis.h : 147 - ov_open_callbacks: -132
[E] CodecVorbis.h : 87 - not open
[E] CodecVorbis.h : 147 - ov_open_callbacks: -128
(repeated)

pschatzmann Aug 17, 2025
Maintainer

Just double check that you really got the latest changes:
For me ogg is working with both cases (mime detector and mime source)

z-l-p · 2025-08-17T20:57:23Z

z-l-p
Aug 17, 2025
Author

I just re-downloaded the recent changes. Problem persists. Here's my full code in case I'm doing something wrong:

#include "AudioTools.h"
#include "AudioTools/AudioCodecs/CodecMP3Helix.h"
#include "AudioTools/AudioCodecs/CodecAACHelix.h"
#include "AudioTools/AudioCodecs/CodecVorbis.h"
#include "AudioTools/AudioLibs/AudioBoardStream.h"

URLStream url("SSID","PASSWORD"); 
I2SStream i2s;
MP3DecoderHelix mp3;
AACDecoderHelix aac;
VorbisDecoder ogg;
MultiStreamingDecoder multi;

void setup(){
  Serial.begin(115200);
  AudioToolsLogger.begin(Serial, AudioToolsLogLevel::Info);  

  // setup i2s
  auto config = i2s.defaultConfig(TX_MODE);
    // Custom I2S pins for my Xaio board
  config.pin_ws = 9; // (DAC "LRCK")
  config.pin_bck = 7; // (DAC "BCK")
  config.pin_data = 8; // (DAC "DIN")
  i2s.begin(config);

  // register supported codecs with their mime type
  multi.addDecoder(mp3, "audio/mpeg");
  multi.addDecoder(aac, "audio/aac");
  multi.addDecoder(ogg, "audio/ogg; codec=vorbis"); // from mime detector
  multi.addDecoder(ogg, "application/ogg"); // from url
  // setup I2S based on sampling rate provided by decoder
  multi.setInput(url);
  multi.setOutput(i2s);
  multi.begin();

  // mp3 radio
  //url.begin("http://stream.srg-ssr.ch/m/rsj/mp3_128");
  //url.begin("https://audio.wavefarm.org/pondstation.mp3");
  url.begin("https://locus.creacast.com:9443/santander_bay.ogg");

}

void loop(){
  multi.copy();
}

2 replies

pschatzmann Aug 17, 2025
Maintainer

Can you double check if the following makes a difference:

multi.setMimeSource(url);
in VorbisDecoder (CodecVorbis.h) line 76: increase the delay
activate PSRAM

z-l-p Aug 18, 2025
Author

Success with multi.setMimeSource(url); Many thanks!
(PSRAM was already enabled)
This library literally gets better every day. (Now I need to read more about the difference between StreamingDecoder and AudioDecoder to understand the benefits of this approach.)

pschatzmann · 2025-08-18T19:01:11Z

pschatzmann
Aug 18, 2025
Maintainer

I finally managed to resolve the bug when using the MimeDetector: It should work now w/o calling multi.setMimeSource(url); as well...

0 replies

z-l-p · 2025-08-18T23:51:17Z

z-l-p
Aug 18, 2025
Author

Confirmed that it now works without setMimeSource. Thanks

0 replies

Uh oh!

OGG support in MultiDecoder? #2131

Uh oh!

z-l-p Aug 16, 2025

Replies: 6 comments · 5 replies

Uh oh!

pschatzmann Aug 16, 2025 Maintainer

Uh oh!

z-l-p Aug 17, 2025 Author

Uh oh!

z-l-p Aug 17, 2025 Author

Uh oh!

pschatzmann Aug 17, 2025 Maintainer

Uh oh!

z-l-p Aug 17, 2025 Author

Uh oh!

Uh oh!

pschatzmann Aug 17, 2025 Maintainer

Uh oh!

z-l-p Aug 17, 2025 Author

Uh oh!

Uh oh!

pschatzmann Aug 17, 2025 Maintainer

Uh oh!

z-l-p Aug 18, 2025 Author

Uh oh!

Uh oh!

pschatzmann Aug 18, 2025 Maintainer

Uh oh!

z-l-p Aug 18, 2025 Author

z-l-p
Aug 16, 2025

Replies: 6 comments 5 replies

pschatzmann
Aug 16, 2025
Maintainer

z-l-p Aug 17, 2025
Author

z-l-p
Aug 17, 2025
Author

pschatzmann
Aug 17, 2025
Maintainer

z-l-p Aug 17, 2025
Author

pschatzmann Aug 17, 2025
Maintainer

z-l-p
Aug 17, 2025
Author

pschatzmann Aug 17, 2025
Maintainer

z-l-p Aug 18, 2025
Author

pschatzmann
Aug 18, 2025
Maintainer

z-l-p
Aug 18, 2025
Author