Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
fb3fcf1
Extract vLLM generation from GRPOTrainer
albertvillanova Dec 15, 2025
5f7326f
Merge remote-tracking branch 'upstream/main' into refactor-vllm-1
albertvillanova Dec 16, 2025
793ecc0
Extract vLLM generation from RLOOTrainer
albertvillanova Dec 16, 2025
b5d27e1
Merge remote-tracking branch 'upstream/main' into refactor-vllm-1
albertvillanova Dec 17, 2025
264febc
Update deprecated max_prompt_length with vllm_max_model_length after …
albertvillanova Dec 17, 2025
dae8c28
Set logprobs_mode in RLOOTrainer as well
albertvillanova Dec 17, 2025
ae18630
Remove back-reference to trainer
albertvillanova Dec 18, 2025
5d6eb43
Remove unused param 'mode'
albertvillanova Dec 18, 2025
1a9ca52
Merge remote-tracking branch 'upstream/main' into refactor-vllm-1
albertvillanova Dec 18, 2025
fcd3f56
Pass profiler to decouple trainer from VLLMGeneration
albertvillanova Dec 19, 2025
3f11f99
Decouple trainer by making rollout_func a single-argument callable
albertvillanova Dec 19, 2025
ec26f47
Merge remote-tracking branch 'upstream/main' into refactor-vllm-1
albertvillanova Dec 22, 2025
35f6b4b
Pass profiler to generate
albertvillanova Dec 22, 2025
54b52f8
Merge remote-tracking branch 'upstream/main' into refactor-vllm-1
albertvillanova Dec 23, 2025
1323ef3
Merge remote-tracking branch 'upstream/main' into refactor-vllm-1
albertvillanova Dec 23, 2025
7201755
Merge remote-tracking branch 'upstream/main' into refactor-vllm-1
albertvillanova Jan 7, 2026
c607a8e
Fix style
albertvillanova Jan 7, 2026
9a91585
Make precommit
albertvillanova Jan 7, 2026
da8f976
Replace args with explicit parameters
albertvillanova Jan 7, 2026
9580b71
Rename vllm_quantization as quantization
albertvillanova Jan 7, 2026
b66ab8a
Merge remote-tracking branch 'upstream/main' into refactor-vllm-1
albertvillanova Jan 16, 2026
2ae35cc
Merge branch 'main' into refactor-vllm-1
albertvillanova Jan 19, 2026
17b57a1
Import VLLMGeneration unconditionally
albertvillanova Jan 21, 2026
67c93c8
Fix server_timeout type and align default value
albertvillanova Jan 21, 2026
62ff3cc
Move __init__ docstring to class header
albertvillanova Jan 21, 2026
4b0c483
Add explanatory comments
albertvillanova Jan 21, 2026
a21e401
Fix misleading renaming
albertvillanova Jan 21, 2026
167be7d
Remove mention to old code lines
albertvillanova Jan 21, 2026
f80a327
Add type hints
albertvillanova Jan 21, 2026
b7726f4
Pass kwargs directly
albertvillanova Jan 27, 2026
04138e7
Merge remote-tracking branch 'upstream/main' into refactor-vllm-1
albertvillanova Jan 27, 2026
1b0c2a6
Update docstring
albertvillanova Jan 27, 2026
edd0101
Update param defaults
albertvillanova Jan 27, 2026
ddb9ce5
Sort params
albertvillanova Jan 27, 2026
ea03910
Fix param renaming
albertvillanova Jan 27, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
25 changes: 25 additions & 0 deletions trl/generation/__init__.py
Copy link
Member

@qgallouedec qgallouedec Jan 19, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not necessarily for this PR, but since we add a generation submodule, we could have vllm_client in this submodule as well

Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
# Copyright 2020-2026 The HuggingFace Team. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

"""Generation backends for TRL trainers."""

from ..import_utils import is_vllm_available


__all__ = []

if is_vllm_available():
from .vllm_generation import VLLMGeneration

__all__.append("VLLMGeneration")
Loading
Loading