Skip to content
Open
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
63 commits
Select commit Hold shift + click to select a range
b604eb4
calibrate cache
eitanturok Mar 28, 2026
d814bc1
undo
eitanturok Mar 28, 2026
5c975da
refactor teacache
eitanturok Mar 28, 2026
6b053aa
teacacheparms is stateless
eitanturok Mar 28, 2026
9f8f300
fix spelling in params
eitanturok Mar 28, 2026
a5b765a
precommit
eitanturok Mar 28, 2026
d15d4b9
make method private
eitanturok Mar 28, 2026
a82d3de
Merge branch 'main' into refactor-teacache-2
eitanturok Mar 28, 2026
86a3e1d
Merge branch 'main' into refactor-teacache-2
eitanturok Mar 29, 2026
eba648a
Merge branch 'main' into refactor-teacache-2
eitanturok Mar 30, 2026
55c7e1a
Merge branch 'main' into refactor-teacache-2
eitanturok Mar 31, 2026
a607193
Merge branch 'main' into refactor-teacache-2
eitanturok Mar 31, 2026
1391194
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 1, 2026
ed04c02
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 2, 2026
cb4f4a6
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 3, 2026
54f5d1b
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 5, 2026
c9a7648
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 12, 2026
09253fa
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 13, 2026
db02c5d
update docs
eitanturok Apr 13, 2026
8f84678
better param name; better docs
eitanturok Apr 13, 2026
3c54d34
move get_coefficents, get_skip_boundaries to TeaCacheParams
eitanturok Apr 14, 2026
3a23fc7
update
eitanturok Apr 14, 2026
56a00c1
init changes after first generation
eitanturok Apr 14, 2026
0261acc
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 14, 2026
25a3486
fix
eitanturok Apr 14, 2026
01ab387
remove maybe_reset
eitanturok Apr 14, 2026
54ff4bf
state is dataclass, better skip step parsing
eitanturok Apr 14, 2026
8d9aa40
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 14, 2026
cdba9e0
update doc
eitanturok Apr 14, 2026
ab61887
cleaner
eitanturok Apr 14, 2026
af18a7a
variable length polynomial
eitanturok Apr 14, 2026
d88c2bb
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 14, 2026
c1d4b4c
make reset_states and fix weight updater
eitanturok Apr 14, 2026
b153f17
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 14, 2026
6f160e0
remove unused logging
eitanturok Apr 14, 2026
3b16cdb
better docs
eitanturok Apr 14, 2026
9ccf3a3
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 14, 2026
ee31fb6
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 15, 2026
5f48522
update
eitanturok Apr 15, 2026
e33fc5a
Merge branch 'refactor-teacache-2' of https://github.com/eitanturok/s…
eitanturok Apr 15, 2026
af3b086
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 15, 2026
268344d
fix test_wan_teacache_boundaries_match_legacy_behavior: remove stale …
eitanturok Apr 17, 2026
82657c7
fix TeaCacheStrategy: always advance previous_modulated_input each step
eitanturok Apr 17, 2026
cd2e907
refactor TeaCacheStrategy: split should_skip into advance() + should_…
eitanturok Apr 17, 2026
a272b4a
simplify TeaCacheStrategy: use None as sentinel, drop skippable flag
eitanturok Apr 17, 2026
d2dc793
redesign TeaCacheStrategy: should_skip decides, advance updates
eitanturok Apr 17, 2026
20402c8
simplify: always reset accumulated to zeros, drop None sentinel
eitanturok Apr 17, 2026
9ceff59
[diffusion] Merge TeaCache should_skip + advance into single step()
eitanturok Apr 17, 2026
9a7de9c
[diffusion] Add inline comments to TeaCache step() and update docs
eitanturok Apr 17, 2026
037e30e
Merge branch 'main' into refactor-teacache-2
mickqian Apr 17, 2026
6ca1e7e
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 18, 2026
1976e2b
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 19, 2026
4b26c09
Fix TeaCache step(): use accumulated_rel_l1_distance=None as window s…
eitanturok Apr 20, 2026
4d7d64f
fix
eitanturok Apr 24, 2026
d626aab
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 24, 2026
ed6b182
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 24, 2026
811233f
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 24, 2026
d51aab3
numerical precision
eitanturok Apr 24, 2026
b950148
Merge branch main into refactor-teacache-2
eitanturok Apr 24, 2026
cc69f63
Merge branch 'main' into refactor-teacache-2
eitanturok Apr 25, 2026
a3f2c95
Merge branch 'main' into refactor-teacache-2
eitanturok May 1, 2026
f9be5e5
Merge branch 'main' into refactor-teacache-2
mickqian May 1, 2026
adf6d01
update perf
eitanturok May 4, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 8 additions & 3 deletions python/sglang/multimodal_gen/configs/sample/sampling_params.py
Original file line number Diff line number Diff line change
Expand Up @@ -161,9 +161,8 @@ class SamplingParams:

# TeaCache parameters
enable_teacache: bool = False
teacache_params: Any = (
None # TeaCacheParams or WanTeaCacheParams, set by model-specific subclass
)
cache_params: Any | None = None
Comment thread
eitanturok marked this conversation as resolved.
Outdated
Comment thread
eitanturok marked this conversation as resolved.
Outdated
calibrate_cache: bool = False
Comment thread
eitanturok marked this conversation as resolved.
Outdated

# Profiling
profile: bool = False
Expand Down Expand Up @@ -615,6 +614,12 @@ def add_argument(*name_or_flags, **kwargs):
"--enable-teacache",
action="store_true",
)
add_argument(
"--calibrate-cache",
action="store_true",
default=SamplingParams.calibrate_cache,
help="Compute the values needed for caching.",
)

# profiling
add_argument(
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -84,7 +84,7 @@ def coefficients_callback(_: TeaCacheParams) -> list[float]:

params = SamplingParams(
prompt="callable teacache",
teacache_params=TeaCacheParams(
cache_params=TeaCacheParams(
coefficients_callback=coefficients_callback,
),
)
Expand Down
Loading