The present amd-integration branch is a fork of an older version of flashinfer-ai/flashinfer (v0.2.5.1). We should plan to update the version to the latest trunk.
There are few design decisions that need to be sorted out prior to the upgrade:
- rocm-flashinfer made changes to the directory layout of the project.
a. ./csrc -> ./flashinfer/csrc
b. ./include -> ./libflashinfer/include
- We still use the removed aot-build-utils for AOT builds
- We use an old torch compile for JIT compilation.
There might be other issues that we need to discuss and resolve before we decide upon an upgrade strategy. The issue serves as a medium to discuss and decide the best way forward.
The present
amd-integrationbranch is a fork of an older version of flashinfer-ai/flashinfer (v0.2.5.1). We should plan to update the version to the latest trunk.There are few design decisions that need to be sorted out prior to the upgrade:
a. ./csrc -> ./flashinfer/csrc
b. ./include -> ./libflashinfer/include
There might be other issues that we need to discuss and resolve before we decide upon an upgrade strategy. The issue serves as a medium to discuss and decide the best way forward.