Skip to content

Pull requests: huggingface/trl

New pull request New
87 Open 2,213 Closed
87 Open 2,213 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Bug Fix] OnlineDPOTrainer with vLLM Server Mode
#4500 opened Nov 7, 2025 by YangKai0616 Loading…
1
Consistency regarding relative imports
#4498 opened Nov 6, 2025 by qgallouedec Loading…
2
Add vLLM quantization option for colocate
#4496 opened Nov 6, 2025 by sergiopaniego • Draft
7 tasks
1
adding [SimPER](https://arxiv.org/abs/2502.00883)
#4486 opened Nov 6, 2025 by leeparkuky Loading…
2 of 5 tasks
1
Move RLOOTrainer to trl.experimental.rloo
#4484 opened Nov 6, 2025 by behroozazarkhalili Loading…
1
1
Move PRMTrainer to trl.experimental.prm
#4483 opened Nov 6, 2025 by behroozazarkhalili Loading…
1
1
Move PPOTrainer to trl.experimental.ppo
#4482 opened Nov 6, 2025 by behroozazarkhalili Loading…
1
1
[ORPO] Move ORPOTrainer to experimental
#4480 opened Nov 6, 2025 by behroozazarkhalili Loading…
1
10
refactor: Move NashMDTrainer to experimental module
#4477 opened Nov 5, 2025 by behroozazarkhalili Loading…
1
1
Move KTOTrainer to experimental module
#4475 opened Nov 5, 2025 by behroozazarkhalili Loading…
1
1
Move GKDTrainer to experimental module
#4474 opened Nov 5, 2025 by behroozazarkhalili Loading…
7 tasks done
1
1
Move OnlineDPOTrainer to experimental module
#4473 opened Nov 5, 2025 by behroozazarkhalili Loading…
1
1
refactor: Move CPOTrainer to experimental module
#4470 opened Nov 5, 2025 by behroozazarkhalili Loading…
1
1
Add attention_mask to signature_columns
#4459 opened Nov 5, 2025 by shubhamjain0594 Loading…
5 tasks
5
Add num_generations_eval parameter for efficient evaluation
#4458 opened Nov 5, 2025 by mingxuetian Loading…
1
2
Prevent upcasting layers in prepare_model_for_kbit_training
#4457 opened Nov 5, 2025 by sergiopaniego Loading…
5 tasks
3
added 10 papers (+trainer cross-links) for #4407
#4441 opened Nov 3, 2025 by SSusantAchary Loading…
4 tasks done
23
docs: add KTO (2402.01306) to Paper Index + link ref to KTOTrainer
#4440 opened Nov 3, 2025 by SSusantAchary Loading…
1
refactor: Move Mergekit integration to experimental submodule
#4438 opened Nov 3, 2025 by behroozazarkhalili Loading…
1
3
docs: Unify model examples to use trl-lib namespace
#4431 opened Nov 2, 2025 by behroozazarkhalili Loading…
1
6
docs: Expand speeding up training guide with acceleration methods
#4428 opened Nov 2, 2025 by behroozazarkhalili Loading…
1
6
docs: Expand training customization examples
#4427 opened Nov 2, 2025 by behroozazarkhalili Loading…
4 tasks done
1
5
Replace flash attention2 with kernels-community/flash-attn2
#4426 opened Nov 2, 2025 by tamoghnokandar Loading…
4 of 5 tasks
2
1
docs: Extend CLI basic usage examples to all supported CLIs
#4425 opened Nov 2, 2025 by behroozazarkhalili Loading…
1
4
docs: Rewrite PEFT integration guide with comprehensive examples
#4421 opened Nov 2, 2025 by behroozazarkhalili Loading…
1
17
ProTip! Exclude everything labeled bug with -label:bug.