[None][refactor] Improve request processing function in sampler#9671

Merged

Funatiq merged 8 commits intoNVIDIA:mainfrom

Funatiq:dev/refactor/sampler_process_requests

Dec 5, 2025

Commits on Dec 4, 2025

[test] Improve error handling in test_overlap_scheduler_consistency
Funatiq
committed
[refactor] Remove resource_manager from TorchSampler._process_requests
Funatiq
committed
[refactor] Move return_log_probs check inside _select_generated_logits
Funatiq
committed
[refactor] Move logprobs handling to separate function
Funatiq
committed
[refactor] Move index calculation inside _select_generated_logits
Funatiq
committed
[refactor] Improve separation of indexing for context and generation logits
Funatiq
committed
[test] Fix test_select_generated_logits
Funatiq
committed
[refactor] Refactor TorchSampler._process_requests to return SamplingRequestsMetadata
Funatiq
committed