[TRTLLM-5085][fix] Nemotron H correctness test - #4444

Merged

Naveassaf merged 16 commits into

NVIDIA:mainfrom

tomeras91:add_nemotron_h_correctness_test

May 20, 2025

Commits on May 15, 2025

replace sanity test for nemotron h with a correctness test
omera-nv
committed
321f72c
skip if not enough memory
omera-nv
committed
93ecd2a
refactor test and remove prints
omera-nv
committed
b529605
fix for new api
omera-nv
committed
05de495

Commits on May 18, 2025

Merge branch 'main' into add_nemotron_h_correctness_test
tomeras91
committed
55b388c
adapt test to work for batched requests as well
tomeras91
committed
516b3cf
Add prefill+decode reference logprobs from initial implementation + batched forward test
tomeras91
committed
e5b2f88
Add testing that decode matches prefill - compare decode vs all prefilling the decoded tokens
tomeras91
committed
1a88b87
relax tolerance
tomeras91
committed
5984afc
relax tolerance
tomeras91
committed
b30e068

Commits on May 20, 2025

Merge branch 'main' into add_nemotron_h_correctness_test
tomeras91
authored
876aead