Skip to content

Navigation Menu

Appearance settings

- AI CODE CREATION
  GitHub CopilotWrite better code with AI
  GitHub Copilot appDirect agents from issue to merge
  MCP Registry^NewIntegrate external tools
- DEVELOPER WORKFLOWS
  ActionsAutomate any workflow
  CodespacesInstant dev environments
  IssuesPlan and track work
  Code ReviewManage code changes
- APPLICATION SECURITY
  GitHub Advanced SecurityFind and fix vulnerabilities
  Code securitySecure your code as you build
  Secret protectionStop leaks before they start
- EXPLORE
  Why GitHub
  Documentation
  Blog
  Changelog
  Marketplace
View all features
- BY COMPANY SIZE
  Enterprises
  Small and medium teams
  Startups
  Nonprofits
- BY USE CASE
  App Modernization
  DevSecOps
  DevOps
  CI/CD
  View all use cases
- BY INDUSTRY
  Healthcare
  Financial services
  Manufacturing
  Government
  View all industries
View all solutions
- EXPLORE BY TOPIC
  AI
  Software Development
  DevOps
  Security
  View all topics
- EXPLORE BY TYPE
  Customer stories
  Events & webinars
  Ebooks & reports
  Business insights
  GitHub Skills
- SUPPORT & SERVICES
  Documentation
  Customer support
  Community forum
  Trust center
  Partners
View all resources
- COMMUNITY
  GitHub SponsorsFund open source developers
- PROGRAMS
  Security Lab
  Maintainer Community
  Accelerator
  GitHub Stars
  Archive Program
- REPOSITORIES
  Topics
  Trending
  Collections
- ENTERPRISE SOLUTIONS
  Enterprise platformAI-powered developer platform
- AVAILABLE ADD-ONS
  GitHub Advanced SecurityEnterprise-grade security features
  Copilot for BusinessEnterprise-grade AI features
  Premium SupportEnterprise-grade 24/7 support
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

huggingface / trl Public

Notifications You must be signed in to change notification settings
Fork 2.8k
Star 18.6k

Code
Issues 400
Pull requests 184
Discussions
Actions
Projects
Security and quality
Insights

Additional navigation options

Code
Issues
Pull requests
Discussions
Actions
Projects
Security and quality
Insights

Rollout generation#5299

Closed

AmineDiro wants to merge 80 commits into

mainhuggingface/trl:mainfrom

rollout-generationhuggingface/trl:rollout-generationCopy head branch name to clipboard

Conversation Commits80 (80)Checks Files changed

Closed

Rollout generation#5299
AmineDiro wants to merge 80 commits into
mainfrom
rollout-generation

Commits

Commits on Mar 16, 2026

first commit
qgallouedec
committed
consistency
qgallouedec
committed
fix
qgallouedec
committed
address review
qgallouedec
committed
wire timeout + fix name tool
qgallouedec
committed
Merge branch 'main' into async-grpo
qgallouedec
authored
add buffer queue size metric to samples in AsyncRolloutWorker
qgallouedec
committed

Commits on Mar 17, 2026

added aiohttp
AmineDiro
committed
style
qgallouedec
committed
support async scoring of reward functions and enhance metrics reporting
qgallouedec
committed
style
qgallouedec
committed
docstring + consistency
qgallouedec
committed
better segment trainer/rollout
qgallouedec
committed
inherit from base trainer and allow max_steps=None and stub for test
qgallouedec
committed
refactor: adjust max_steps calculation to consider accelerator processes
qgallouedec
committed
doc
qgallouedec
committed
better log tok/sec
qgallouedec
committed
fix: update max_completion_length default value to 2048
qgallouedec
committed
fix timeout, tok/sec, and vllm import
qgallouedec
committed
style
qgallouedec
committed
style
qgallouedec
committed
Update async_grpo_trainer.md
qgallouedec
authored
Add AsyncGRPOTrainer with async rollout worker and weight transfer
AmineDiro
committed
init weight sync"
AmineDiro
committed
aiohttp in vllm dep
AmineDiro
committed
fix tracking metrics namespace
AmineDiro
committed
Add logging to weight sync initialization and train metrics
AmineDiro
committed
license
qgallouedec
committed
fix conditional import + allow 0.17.1
qgallouedec
committed
fix type hint
qgallouedec
committed
fix vllm segment in pyproject
qgallouedec
committed
Merge branch 'main' into async-grpo
qgallouedec
authored
align server timeout
qgallouedec
committed
rename Prompt type alias to Messages for clarity
qgallouedec
committed
update vllm version requirement and clarify installation instructions
qgallouedec
committed
oups
qgallouedec
committed
add max-model-len parameter and usage tip for vLLM server configuration
qgallouedec
committed
Fix DDP/FSDP1 module prefix handling and vLLM pause mode
AmineDiro
committed
some debug logging, remove get and better default values
qgallouedec
committed
no need to log bsz (already in config)
qgallouedec
committed
revert pause mode change
qgallouedec
committed
more logging
qgallouedec
committed

Commits on Mar 18, 2026

Enhance max_inflight_tasks handling and documentation for vLLM server requests
qgallouedec
committed
keep
qgallouedec
committed
style
qgallouedec
committed
Improve timeout handling and retry logic for HTTP requests in AsyncRolloutWorker
qgallouedec
committed
Add max_tool_calling_iterations parameter to AsyncRolloutWorker and AsyncGRPOConfig
qgallouedec
committed
fix config
qgallouedec
committed
Raise exceptions from tasks in AsyncRolloutWorker if present
qgallouedec
committed
Improve error handling for server connection issues in AsyncRolloutWorker
qgallouedec
committed
Improve queue handling in AsyncRolloutWorker to prevent blocking on full queue
qgallouedec
committed
first sync and then start generation
qgallouedec
committed
nits
qgallouedec
committed
we don't need to set max-num-seq apparently
qgallouedec
committed
remove dead code
qgallouedec
committed
Add AsyncGRPOTrainer example with MBPP dataset and improve async rollout
AmineDiro
committed
cancel inflight when pausing
AmineDiro
committed
fix max_seq_len
AmineDiro
committed
debug msg
AmineDiro
committed
Add callback to sync weights before training begins
AmineDiro
committed
Fix attribute access in AsyncGRPOTrainer._inner_training_loop
AmineDiro
committed
Fix missing iteration counter increment and add reward_mean metric
AmineDiro
committed
Add advantage to rollout worker reward output
AmineDiro
committed
Add tool-calling completion tracking and schema conversion
AmineDiro
committed
Remove errored iteration_num increments
AmineDiro
committed

Commits on Mar 19, 2026

Add turn-level and tool-call timing records to async rollout worker
AmineDiro
committed
Refactor RolloutGroup to use append_rollout helper method
AmineDiro
committed
merged main
AmineDiro
committed
fix main problems
AmineDiro
committed
fix logprobs main
AmineDiro
committed
Refactor RolloutCompletion to store turns and compute fields lazily
AmineDiro
committed
Apply suggestion from @qgallouedec

AmineDiro
and
qgallouedec
authored
Apply suggestion from @qgallouedec

AmineDiro
and
qgallouedec
authored
Apply suggestion from @qgallouedec

AmineDiro
and
qgallouedec
authored
Apply suggestion from @qgallouedec

AmineDiro
and
qgallouedec
authored
Apply suggestion from @qgallouedec

AmineDiro
and
qgallouedec
authored
Apply suggestion from @qgallouedec

AmineDiro
and
qgallouedec
authored
Apply suggestion from @qgallouedec

AmineDiro
and
qgallouedec
authored
Improve metrics collection in async rollout worker
AmineDiro
committed
Rename `max_completion_tokens` to `max_completion_length`
AmineDiro
committed

Footer

© 2026 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Community
Docs
Contact

You can’t perform that action at this time.