Move to using the Inference OpenAI API server (bis) - #3395

Merged

chtruong814 merged 94 commits into

NVIDIA:mainfrom

tdene:rkirby/rl_inference_server_integration

Feb 14, 2026

Commits on Nov 4, 2025

feat: add router replay
litianjian
committed
cbd57c1

Commits on Nov 20, 2025

Merge branch 'main' into feat/router_replay
ISEEKYAN
authored
2b92df8

Commits on Nov 24, 2025

refactor(router): rename RouterMode to RouterReplayAction
litianjian
committed
bd32db8

Commits on Dec 8, 2025

Merge branch 'main' into feat/router_replay
ISEEKYAN
authored
054942d

Commits on Dec 9, 2025

Merge branch 'main' into feat/router_replay
ISEEKYAN
authored
0cc1b08

Commits on Dec 10, 2025

Merge branch 'main' into feat/router_replay
ISEEKYAN
authored
fc668b6

Commits on Dec 12, 2025

Merge branch 'main' into feat/router_replay
ISEEKYAN
authored
e9d1a52

Commits on Dec 15, 2025

Merge branch 'main' into feat/router_replay
ISEEKYAN
authored
31bdce4

Commits on Dec 16, 2025

simplify compute topk function
litianjian
committed
1aec041

Commits on Dec 17, 2025

update router replay
litianjian
committed
39fd47a

Commits on Dec 23, 2025

add unit test and doc
litianjian
committed
49da256
format code
litianjian
committed
590ce52

Commits on Jan 20, 2026

first attempt
sidsingh-nvidia
committed
15395b8
merge conflict resolution
sidsingh-nvidia
committed
39d36cc

Commits on Jan 21, 2026

Commits on Jan 23, 2026

save router routing in functional tests and correctly handle inference request record merge
sidsingh-nvidia
committed
d62038d

Commits on Feb 4, 2026

Move to using the Inference OpenAI API server; Remove all conversation templating code from rl; Move RL to only use messages for prompts

Robert Kirby
authored and
ArEsKay3
committed
351c00e
Remove base model prompting special cases

Robert Kirby
authored and
ArEsKay3
committed
c195e24
Add tool and reasoning parsers

Robert Kirby
authored and
ArEsKay3
committed
6489600
Fix reasoning parser. Add some logging.

Robert Kirby
authored and
ArEsKay3
committed
09b83eb
Fix RL code to match new OpenAI server

Robert Kirby
authored and
ArEsKay3
committed
f32d215
Force exit

Robert Kirby
authored and
ArEsKay3
committed
055964d
Update configs, remove more arguments

Robert Kirby
authored and
ArEsKay3
committed
076fac5
Fix review comments. Remove 'n' from RL code altogether

Robert Kirby
authored and
ArEsKay3
committed
3f0bb15
remove extra logging

Robert Kirby
authored and
ArEsKay3
committed
ebf542c
Remove unused code, Fix typo

Robert Kirby
authored and
ArEsKay3
committed
9a5207b
formatter

Robert Kirby
authored and
ArEsKay3
committed
fc0307d
Fix lint

Robert Kirby
authored and
ArEsKay3
committed
d321cc5
Fix test args

Robert Kirby
authored and
ArEsKay3
committed
d69730f
Fix test args

Robert Kirby
authored and
ArEsKay3
committed
d5edaaa
Add copyright

Robert Kirby
authored and
ArEsKay3
committed
2412044
Really important newline.

Robert Kirby
authored and
ArEsKay3
committed
dc4fcbc
More copyright

Robert Kirby
authored and
ArEsKay3
committed
441e49a
Update regex library

Robert Kirby
authored and
ArEsKay3
committed
81c78f9
More linting
ArEsKay3
committed
fc27fa3
Merge branch 'main' into rkirby/rl_inference_server_integration
ArEsKay3
authored
2216694

Commits on Feb 5, 2026

Merge branch 'main' into rkirby/rl_inference_server_integration
ArEsKay3
authored
652431c

Commits on Feb 6, 2026

Merge branch 'main' into rkirby/rl_inference_server_integration
ArEsKay3
authored
338f36d

Commits on Feb 9, 2026

Merge branch 'main' into inference-router-record
sidsingh-nvidia
committed
ad40331
Merge branch 'main' into inference-router-record
sidsingh-nvidia
authored
ee45dd6
make it work with merge
sidsingh-nvidia
committed
0666c2e

Commits on Feb 10, 2026

hook upto openAI API
sidsingh-nvidia
committed
9109ca1
Merge branch 'main' into inference-router-record
sidsingh-nvidia
authored
7a36e5e
format
sidsingh-nvidia
committed
7feee53
minor
sidsingh-nvidia
committed
473a652
Merge branch 'main' into rkirby/rl_inference_server_integration
ArEsKay3
committed
23ceea5
Merge branch 'main' into rkirby/rl_inference_server_integration
ArEsKay3
authored
0bd3202
Merge branch 'main' into rkirby/rl_inference_server_integration
ko3n1g
authored
3912fd7
Merge branch 'main' into inference-router-record
sidsingh-nvidia
authored
120c22f
remove unnecessary methods
sidsingh-nvidia
committed
452acb2
Merge remote-tracking branch 'gh/main' into rkirby/rl_inference_server_integration
tdene
committed
20760a5
Add dependencies
tdene
committed
9b8843a
Merge remote-tracking branch 'gh/main' into rkirby/rl_inference_server_integration
tdene
committed
1ca3a82
Update uv.lock
tdene
committed
96dc390
miinor bugfix
sidsingh-nvidia
committed
bf27426
attempt to reactivate functional test
sidsingh-nvidia
committed
26002fc
Merge branch 'main' into inference-router-record
sidsingh-nvidia
authored
75d31e1
update functional test to run router recording
sidsingh-nvidia
committed
db37b3b
add routing indices to metrics
sidsingh-nvidia
committed
e0d3dd5
Merge branch 'main' into inference-router-record
sidsingh-nvidia
authored
601b77d

Commits on Feb 11, 2026

Merge branch 'main' into rkirby/rl_inference_server_integration
tdene
authored
a13eafb
move test to github
sidsingh-nvidia
committed
dda0b6a
Merge branch 'main' into inference-router-record
sidsingh-nvidia
authored
045b07b
Merge branch 'main' into inference-router-record
sidsingh-nvidia
authored
48bb9b9
Update test_inference_regular_pipeline.py
sidsingh-nvidia
authored
b632151
Merge branch 'main' into rkirby/rl_inference_server_integration
tdene
authored
5072d5d
Merge branch 'main' into inference-router-record
sidsingh-nvidia
authored
e3c6cab
Merge branch 'main' into inference-router-record
sidsingh-nvidia
authored
061228c
Merge branch 'main' into rkirby/rl_inference_server_integration
tdene
authored
aeb73d1
Merge branch 'main' into inference-router-record
sidsingh-nvidia
authored
e084310
Merge branch 'main' into inference-router-record
sidsingh-nvidia
authored
c05da3b
Merge branch 'main' into inference-router-record
sidsingh-nvidia
authored
a99ddee
Merge branch 'main' into rkirby/rl_inference_server_integration
tdene
authored
8657146
Fix new GRPO functional test
tdene
committed
2594c39

Commits on Feb 12, 2026

Commits on Feb 13, 2026

Fix test
tdene
committed
f2f0b6c
Fix BOS issue
tdene
committed
be42aa6
Fix typo
tdene
committed
0aa4aa6
Fix extra body
tdene
committed
53d8f74
Merge remote-tracking branch 'gh/main' into rkirby/rl_inference_server_integration
tdene
committed
f61e5b5
Account for engine modifying prompts
tdene
committed
cf2d71b
Fix README
tdene
committed
d6df874
Fix typo
tdene
committed
c0dba97
Serialize correctly
tdene
committed
ca51104
Fix add_BOS
tdene
committed
58fb099
Merge branch 'main' into rkirby/rl_inference_server_integration
tdene
authored
82e98be