Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

when using a proxy like scrapoxy it seems that driver cut the connection because your connection is not private #222

Open
pbrns opened this issue Jan 25, 2025 · 1 comment

Comments

@pbrns
Copy link

pbrns commented Jan 25, 2025

From some test that I did, it seems that there an issue with proxies.
Even I put in the @browser a proxy like scrapoxy that supports many proxy management "http://xxxxxxxxx:[email protected]:8888" also i tested with zyte "http://xxxxxxxxx:@api.zyte.com:8011" , all the connections it seems that cut because of connection is not private. (see the attachment)

Image

even if you put

  • cp scrapoxy-ca.crt /usr/local/share/ca-certificates/scrapoxy-ca.crt
  • update-ca-certificates

or do the same with zyte certification
and then

  • export REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt

it seems that with proxy there is an issue. I don't know what this happened, but didn't the driver need to have a verify property or having to give the path of custom certificate?

Any help it will be very helpful, because I sent many hours to learn the tools and use it and the most important part is that because I will have it in docker inside my VPS can't risk to have any port ban so need to have some proxy.

@pbrns
Copy link
Author

pbrns commented Jan 26, 2025

I manage to put in os with certutil the ca to pass from proxy lile scrapoxy and use the certificate. But don't need to have the verify and ca_cert property on the driver?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant