Skip to content

Pull requests: huggingface/text-generation-inference

New pull request New
39 Open 1,641 Closed
39 Open 1,641 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Retrieve the correct cached model batch size in Neuron config checker for Neuron Backend
#3300 opened Jul 19, 2025 by jimburtoft Loading…
3 tasks
some gptq case could not be handled by ipex. but could be handle by t…
#3298 opened Jul 18, 2025 by sywangyi Loading…
5 tasks
2
Attempt to fix CI errors
#3292 opened Jul 8, 2025 by danieldk Loading…
5 tasks
fix: enable defs references in tool calls
#3291 opened Jul 7, 2025 by drbh Loading…
Update quantization kernels
#3288 opened Jul 7, 2025 by danieldk • Draft
5 tasks
Multi modality fix
#3283 opened Jun 30, 2025 by sywangyi Loading…
5 tasks
8
fix outline import issue
#3282 opened Jun 30, 2025 by sywangyi Loading…
5 tasks
5
feat: allow json_schema in response format and add test
#3276 opened Jun 25, 2025 by drbh Loading…
3
HuggingFaceM4/Idefics3-8B-Llama3 crash fix
#3267 opened Jun 16, 2025 by sywangyi Loading…
5
Disable mamba in CPU platform
#3266 opened Jun 13, 2025 by casassg Loading…
3 of 5 tasks
Migrate to V2 Pydantic interface
#3262 opened Jun 11, 2025 by emmanuel-ferdman Loading…
1 of 5 tasks
1
fix multi-modality apply chat template issue
#3258 opened Jun 6, 2025 by sywangyi Loading…
5 tasks
6
feat: improve llava next pooling for granite vision
#3255 opened Jun 4, 2025 by drbh Loading…
Xccl
#3252 opened Jun 2, 2025 by sywangyi • Draft
5 tasks
Trtllm backend improvements
#3231 opened May 17, 2025 by leejuyuu Loading…
1 of 5 tasks
1
Fix typos
#3210 opened May 6, 2025 by omahs Loading…
1 of 5 tasks
feat: lock updated kernel versions
#3201 opened Apr 29, 2025 by drbh Loading…
Set uv UV_PYTHON_INSTALL_DIR explicitly
#3197 opened Apr 27, 2025 by sebastianliebscher Loading…
1 of 5 tasks
2
README: minimum Python version is 3.10
#3194 opened Apr 25, 2025 by Frenzie Loading…
1 of 5 tasks
feat: support logit bias in chat request
#3186 opened Apr 22, 2025 by drbh Loading…
28
Fix flashinfer plan call to use positional arguments for #3165
#3166 opened Apr 11, 2025 by ruckc Loading…
2 of 5 tasks
1
1
Update to flashinfer 0.2.5
#3164 opened Apr 11, 2025 by danieldk • Draft
5 tasks
Add chunked attn for L4
#3162 opened Apr 10, 2025 by mht-sharma • Draft
2 of 7 tasks
Update links Inferentia refer docs
#3154 opened Apr 9, 2025 by guspan-tanadi Loading…
1 of 5 tasks
feat: align function id with tool call response
#3111 opened Mar 13, 2025 by drbh Loading…
ProTip! Filter pull requests by the default branch with base:main.