Commit 58daeb4
1 file changed
+1
-1
lines changedSubmodule flashinfer updated 20 files
- include/flashinfer/decode.cuh+77-85
- include/flashinfer/handler.cuh+149-71
- include/flashinfer/mma.cuh+35
- include/flashinfer/prefill.cuh+101-121
- include/flashinfer/utils.cuh+1-10
- python/csrc/batch_decode.cu+88
- python/csrc/batch_prefill.cu+100-11
- python/csrc/flashinfer_ops.cu+14-2
- python/csrc/flashinfer_ops.h+43-2
- python/flashinfer/__init__.py+17
- python/flashinfer/ops/__init__.py+216-2
- python/setup.py+1-1
- python/tests/test_batch_decode_kernels.py+97
- python/tests/test_batch_prefill_kernels.py+34-11
- python/tests/test_shared_prefix_kernels.py+15
- scripts/formatter.sh+7
- src/bench_batch_decode.cu+9-5
- src/test_batch_decode.cu+4-2
- src/test_batch_prefill.cu+6-6
- src/tvm_wrapper.cu+44-52
0 commit comments