Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: ONNX Opset 21 Support #2180

Open
aendk opened this issue Feb 4, 2025 · 0 comments
Open

Feature Request: ONNX Opset 21 Support #2180

aendk opened this issue Feb 4, 2025 · 0 comments

Comments

@aendk
Copy link

aendk commented Feb 4, 2025

Feature request

Opset 21 is out for a while now, and it added int4 quantization back in march of last year.

When do you plan to support it? Are you currently blocked by the PyTorch dynamo onnx exporter which is still in beta?

@gedoensmax

Motivation

Opset 21 would expose cutting-edge features of the ONNX standard like more advanced quantization.
The mission statement of this library is to make production grade Inference available for everyone.
Adding better quantization matches with this.

Your contribution

Currently I do not have the bandwidth to help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant