Skip to content

revert continuous_batching signiture, which is more meaningful

d93cdd1
Select commit
Loading
Failed to load commit list.
Merged

fix to accept cumulative_seqlens from TransformersKwargs in FA #40194

revert continuous_batching signiture, which is more meaningful
d93cdd1
Select commit
Loading
Failed to load commit list.