We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent e2dd6a2 commit fbb3804Copy full SHA for fbb3804
docs/source/blogs/tech_blog/blog10_GPT_OSS_Eagle3.md
@@ -98,6 +98,7 @@ EOF
98
Notes:
99
- Ensure your base model directory is `/config/models/gpt-oss-120b`.
100
- Ensure your Eagle3 assets are present under `/config/models/eagle/`.
101
+- If you are running on Top of Tree, replace `use_torch_sampler: true` with `sampler_type: TorchSampler`.
102
103
### Launch the server (Eagle3 speculative decoding)
104
0 commit comments