Skip to content

Pull requests: huggingface/trl

New pull request New
74 Open 2,330 Closed
74 Open 2,330 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Move compute_accuracy to PRM Trainer file
#4656 opened Dec 10, 2025 by qgallouedec Loading…
1
Move AutoModelForCausalLMWithValueHead and AutoModelForSeq2SeqLMWithValueHead to experimental
#4654 opened Dec 10, 2025 by qgallouedec Loading…
2
Move clone_chat_template to chat_template_utils
#4653 opened Dec 10, 2025 by qgallouedec Loading…
1
feature: Add RTPO Trainer
#4652 opened Dec 9, 2025 by SolarWindRider Loading…
6 tasks done
Remove deprecated functions and parameters
#4651 opened Dec 9, 2025 by qgallouedec Loading…
5 tasks
2
Set version to packaged one in notebooks
#4648 opened Dec 9, 2025 by sergiopaniego Loading…
5 tasks
1
Overwrite model default generation config
#4647 opened Dec 9, 2025 by albertvillanova Loading…
2 of 5 tasks
8
Include generation_config for tiny model uploads
#4643 opened Dec 9, 2025 by qgallouedec Loading…
4
CPOTrainer - Incorrect handling of different length chosen/rejected p…
#4639 opened Dec 8, 2025 by davmels Loading…
Preserve truncated tokens in BFD packing
#4632 opened Dec 5, 2025 by qgallouedec Loading…
1
11
Update docs landing with latest details
#4624 opened Dec 4, 2025 by sergiopaniego Loading…
6 tasks
1
Support async reward functions and parallelize call to reward functions.
#4567 opened Nov 24, 2025 by pramodith Loading…
3 of 5 tasks
1
8
Add cross-tokenizer distillation support for GKD and MiniLLM trainers
#4561 opened Nov 22, 2025 by sambhavnoobcoder Loading…
1
Add PSPO trust region method as alternative to clipping in GRPOTrainer
#4548 opened Nov 19, 2025 by MCDwyer Loading…
2 of 5 tasks
@kashif
4
Add compute_metrics parameter for GRPOTrainer
#4534 opened Nov 17, 2025 by colinzhaoxp Loading…
3
[GRPO] switch grpo liger loss to triton version
#4519 opened Nov 13, 2025 by kashif Loading…
1 of 8 tasks
10
adding [SimPER](https://arxiv.org/abs/2502.00883)
#4486 opened Nov 6, 2025 by leeparkuky Loading…
2 of 5 tasks
1
added 10 papers (+trainer cross-links) for #4407
#4441 opened Nov 3, 2025 by SSusantAchary Loading…
4 tasks done
24
docs: Unify model examples to use trl-lib namespace
#4431 opened Nov 2, 2025 by behroozazarkhalili Loading…
1
6
Use explicit tiny-Qwen2ForCausalLM-2.5 model_id param in CI tests
#4331 opened Oct 23, 2025 by albertvillanova Loading…
4
refactor: simplify parameter freezing in modeling_base.py
#4305 opened Oct 20, 2025 by Ki-Seki Loading…
2 of 5 tasks
2
Add CISPO loss option and documentation
#4298 opened Oct 16, 2025 by gustavorubim Loading…
4
feat: Add Multi-Token Prediction (MTP) support to SFTTrainer
#4290 opened Oct 15, 2025 by KLGR123 Loading…
1
Remove FSDP1 support: use FSDP2 exclusively
#4260 opened Oct 11, 2025 by behroozazarkhalili Loading…
2
Fix DPO Trainer Bug For Qwen2-VL (Issue 2660)
#4257 opened Oct 11, 2025 by FabianSchuetze Loading…
1 of 3 tasks
4
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.