Is the server running?

[marty90]

Since Mar 15 2025, 6 AM CET, I have received no data :(
Is the server running?

[fnk0c]

Same here.

[Baoxd123]

Same, but I used certstream-go
:(

[aviyachki]

Yes, same for me. There is no connection

[AndreC10002]

Yes, Calidog's server is down again and, although I am thankful for their service to the community, it becomes obvious we need alternatives. I have looked into collecting data directly from the Certificate Logs, but am having a hard time finding their API URLs. None of the following work directly on 'certstream --url' tool:

Google's CT Log:
wss://ct.googleapis.com:443/ct/v1/get-roots

Cloudflare's CT Log:
wss://ct.cloudflare.com:443/ct/v1/get-roots

Let’s Encrypt CT Log:
wss://ct.letsencrypt.org:443/ct/v1/get-roots

Amazon’s CT Log:
wss://ct.ws.amazon.com:443/ct/v1/get-roots

Although the CT website lists the logs, it doesn't provide their API URLs: https://certificate.transparency.dev/logs/

Is anybody aware of a central location that publishes all current Certificate Log API URLs that can be queried with tools like 'certstream'?

[fnk0c]

@AndreC10002 have you looked at this Certstream Server Project? I just found it and am going to dig to understand and test it

[Baoxd123]

Hey @fnk0c Have you successfully deployed locally for the https://github.com/d-Rickyy-b/certstream-server-go?

There is also an official version of certstream-server project: https://github.com/CaliDog/certstream-server/,
but I don't know which one can work.

[AndreC10002]

Yes, I looked into the Go implementation and got it working easily. In fact, I'm collecting many more certificates compared to Calidog's. Thank you for the reference.

[fnk0c]

Hey @Baoxd123 yes! I just got time today but it is pretty straightforward.

You can compile or use the pre compiled binary. Give execution permission (chmod +x) and create a config.yaml file. A sample can be found here

After that, just execute your certstream script and connect it to your server. In my case, ws://localhost (I'm not using certificate)

All this information was gathered from Certstream Go Server project itself.

[URLSecureCheck]

Yes, Calidog's server is down again and, although I am thankful for their service to the community, it becomes obvious we need alternatives. I have looked into collecting data directly from the Certificate Logs, but am having a hard time finding their API URLs. None of the following work directly on 'certstream --url' tool:

Google's CT Log: wss://ct.googleapis.com:443/ct/v1/get-roots

Cloudflare's CT Log: wss://ct.cloudflare.com:443/ct/v1/get-roots

Let’s Encrypt CT Log: wss://ct.letsencrypt.org:443/ct/v1/get-roots

Amazon’s CT Log: wss://ct.ws.amazon.com:443/ct/v1/get-roots

Although the CT website lists the logs, it doesn't provide their API URLs: https://certificate.transparency.dev/logs/

Is anybody aware of a central location that publishes all current Certificate Log API URLs that can be queried with tools like 'certstream'?

Les URLs que vous avez testées (ex: wss://ct.googleapis.com/ct/v1/get-roots) ne fonctionnent pas car elles ne sont pas conçues pour un flux temps réel (CertStream). Ce sont des endpoints pour récupérer des root certificates, pas des nouveaux certificats émis.

Je constate aussi un problème d'affichage avec CertStream depuis plusieurs semaines.

Les vrais flux temps réel utilisent le protocole SSE (Server-Sent Events) ou WebSocket, et non des APIs REST classiques.
Je pense pour ma part développer ma propre solution personnelle, bon courage.

[Baoxd123]

Yes, I looked into the Go implementation and got it working easily. In fact, I'm collecting many more certificates compared to Calidog's. Thank you for the reference.

Yes, I also found the certs from certstream-go server are more than the CaliDog's. I think the official server's overloading is an important reason. According to my local log, the CaliDog's speed for publishing certs was usually around 100 certs/sec but certstream-go server's speed which is around 300 certs/sec should be the correct speed.

By the way, I observed that the collection speed of certstream would also reduce if my program machine was overloading, even if the certstream-go server was deployed on another machine.

[aviyachki]

Hi, I briefly looked into the certstream-go and my understanding so far is that all the registrars can be found here: https://www.gstatic.com/ct/log_list/v3/log_list.json
Problem is that they are not serving via websockets but http and you need to ingest the data in badges and keep track of what you ingested. I am looking to implement it in python because go is not yet approved in my company. If anyone has a python equivalent pls share.

[fnk0c]

According to my local log, the CaliDog's speed for publishing certs was usually around 100 certs/sec but certstream-go server's speed which is around 300 certs/sec should be the correct speed.

Exactly the same metrics I'm getting/was getting on my RabbitMQ

[dig-sec]

Down so I made this https://github.com/dig-sec/CertSentinel Maybe it helps someone.

[aviyachki]

hey @dig-sec thank you so much! I will test it now, I was just trying to figure out how to parse the DER format in memory and properly split the MerkleTreeLeaf as I haven't done before. TY