httpx.RemoteProtocolError: illegal request line

[MartinThoma]

See https://stackoverflow.com/q/69084783/562769 for more context , here is the first part:

I'm working on push notifications on Apple Push Notifications and keep getting httpx.RemoteProtocolError: illegal request line. I have no clue what this means:

>>> import httpx
>>> httpx.__version__
'0.18.2'
>>> httpx.post('https://api.development.push.apple.com:443/3/device/<device-token>')
Traceback (most recent call last):
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_transports/default.py", line 61, in map_httpcore_exceptions
    yield
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_transports/default.py", line 181, in handle_request
    status_code, headers, byte_stream, extensions = self._pool.handle_request(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpcore/_sync/connection_pool.py", line 237, in handle_request
    response = connection.handle_request(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpcore/_sync/connection.py", line 148, in handle_request
    return self.connection.handle_request(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpcore/_sync/http11.py", line 128, in handle_request
    ) = self._receive_response(timeout)
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpcore/_sync/http11.py", line 189, in _receive_response
    event = self._receive_event(timeout)
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpcore/_sync/http11.py", line 222, in _receive_event
    event = self._h11_state.next_event()
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpcore/_exceptions.py", line 12, in map_exceptions
    raise to_exc(exc) from None
httpcore.RemoteProtocolError: illegal request line

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_api.py", line 304, in post
    return request(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_api.py", line 100, in request
    return client.request(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_client.py", line 785, in request
    return self.send(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_client.py", line 871, in send
    response = self._send_handling_auth(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_client.py", line 907, in _send_handling_auth
    response = self._send_handling_redirects(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_client.py", line 943, in _send_handling_redirects
    response = self._send_single_request(request, timeout)
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_client.py", line 977, in _send_single_request
    (status_code, headers, stream, extensions) = transport.handle_request(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_transports/default.py", line 181, in handle_request
    status_code, headers, byte_stream, extensions = self._pool.handle_request(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_transports/default.py", line 78, in map_httpcore_exceptions
    raise mapped_exc(message) from exc
httpx.RemoteProtocolError: illegal request line

How can I investigate that further? What is the issue? (I've removed the headers / the payload / the device token for this question; I keep getting this issue)

[agronholm]

Curiously it's using HTTP/1.1 here while it used HTTP/2 in your curl example. That should be a good starting point for the investigation.

[martin-thoma]

Is the following expected?

>>> import httpx
>>> client = httpx.Client(http2=True)
>>> client.post('https://api.development.push.apple.com:443/3/device/<device-token>')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_client.py", line 1103, in post
    return self.request(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_client.py", line 785, in request
    return self.send(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_client.py", line 871, in send
    response = self._send_handling_auth(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_client.py", line 907, in _send_handling_auth
    response = self._send_handling_redirects(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_client.py", line 943, in _send_handling_redirects
    response = self._send_single_request(request, timeout)
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_client.py", line 977, in _send_single_request
    (status_code, headers, stream, extensions) = transport.handle_request(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_transports/default.py", line 181, in handle_request
    status_code, headers, byte_stream, extensions = self._pool.handle_request(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpcore/_sync/connection_pool.py", line 237, in handle_request
    response = connection.handle_request(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpcore/_sync/connection.py", line 148, in handle_request
    return self.connection.handle_request(
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpcore/_sync/http2.py", line 148, in handle_request
    self.send_connection_init(timeout)
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpcore/_sync/http2.py", line 196, in send_connection_init
    h2.settings.SettingCodes.ENABLE_CONNECT_PROTOCOL
  File "/home/martin/.pyenv/versions/3.8.9/lib/python3.8/enum.py", line 384, in __getattr__
    raise AttributeError(name) from None
AttributeError: ENABLE_CONNECT_PROTOCOL

[lovelydinosaur]

Nope, not expected.

It looks like your dependencies are not fully up to date there. (I can see a similar issue here... python-hyper/h2#1255)

It'd be interesting to know how you installed the http2 support here...

• Did you use pip install httpx[http2] or something else?
• Which versions of h2 and hyperframe are installed?

I'd expect updating the h2 and hyper frame packages to resolve this issue, although you shouldn't really need to be doing that in the first place.

Also we probably ought to have some simple tooling for helping display the installed versions of httpx and it's dependancies.

[martin-thoma]

That is the issue! Thank you! I've simply installed httpx and not httpx[http2]. To me, the only reason to use httpx instead of requests is for http2. Hence it didn't even come to my mind that this might be an extra dependency (btw: Why would somebody use httpx without http2? What does "pure" httpx offer over requests?)

[lovelydinosaur]

What does "pure" httpx offer over requests?

Neater timeout behaviour. Fully type annotated API. Sync or Async.

We've full parity with everything that requests offers, plus a bunch of carefully thought out refinements. I'd hope as things mature we'll have more folks asking what does requests offer over httpx, rather than the other way around. 😅

[martin-thoma]

After installing httpx[http2] it works:

>>> import httpx
>>> client = httpx.Client(http2=True)
>>> client.post('https://api.development.push.apple.com:443/3/device/<device-token>')
<Response [403 Forbidden]>