|
3 | 3 | By NVIDIA TensorRT-LLM Team |
4 | 4 |
|
5 | 5 | ## Table of Contents |
6 | | -- [Inference-Time Compute Implementation in TensorRT-LLM (Part 1: Design and Implementation](inference-time-compute-implementation-in-tensorrt-llm) |
7 | | - -[Table of Content](table-of-content) |
8 | | - -[Background and Motivation](background-and-motivation) |
9 | | - -[Introduction for Scaffolding: A Framework for inference-time compute](introduction-for-scaffolding) |
10 | | - -[Core Features](scaffolding-core-feature) |
11 | | - -[Architecture](scaffolding-architecture) |
12 | | - -[Worker](scaffolding-architecture-worker) |
13 | | - -[Controller](scaffolding-architecture-controller) |
14 | | - -[ScaffoldingLlm](scaffolding-architecture-scaffoldingllm) |
15 | | - -[An Example: Implement Dynasor on Scaffolding](example-for-scaffolding) |
16 | | - -[Introduction for Dynasor](dynasor-introduction) |
17 | | - -[Implement Dynasor-CoT in Scaffolding](dynasor-cot-implement-in-scaffolding) |
18 | | - -[Implement Dynasor-CoT based Majority Voting in Scaffolding](dynasor-cot-based-majority-vote-in-scaffolding) |
19 | | - -[Feature List on Scaffolding](scaffolding-feature-list) |
20 | | - -[Future Work](scaffolding-future-work) |
| 6 | +- [Inference-Time Compute Implementation in TensorRT-LLM (Part 1: Design and Implementation](#inference-time-compute-implementation-in-tensorrt-llm) |
| 7 | + - [Table of Content](#table-of-content) |
| 8 | + - [Background and Motivation](#background-and-motivation) |
| 9 | + - [Introduction for Scaffolding: A Framework for inference-time compute](#introduction-for-scaffolding) |
| 10 | + -[Core Features](#scaffolding-core-feature) |
| 11 | + -[Architecture](#scaffolding-architecture) |
| 12 | + -[Worker](#scaffolding-architecture-worker) |
| 13 | + -[Controller](#scaffolding-architecture-controller) |
| 14 | + -[ScaffoldingLlm](#scaffolding-architecture-scaffoldingllm) |
| 15 | + -[An Example: Implement Dynasor on Scaffolding](#example-for-scaffolding) |
| 16 | + -[Introduction for Dynasor](#dynasor-introduction) |
| 17 | + -[Implement Dynasor-CoT in Scaffolding](#dynasor-cot-implement-in-scaffolding) |
| 18 | + -[Implement Dynasor-CoT based Majority Voting in Scaffolding](#dynasor-cot-based-majority-vote-in-scaffolding) |
| 19 | + -[Feature List on Scaffolding](#scaffolding-feature-list) |
| 20 | + -[Future Work](#scaffolding-future-work) |
21 | 21 |
|
22 | 22 |
|
23 | 23 | ## Background and Motivation |
|
0 commit comments