Repository navigation

[wip] - #4560

Closed

rkooo567 wants to merge 37 commits into

vllm-project:mainfrom

rkooo567:flash-attention-decode-trial

Closed

[wip]#4560
rkooo567 wants to merge 37 commits into
vllm-project:mainfrom
rkooo567:flash-attention-decode-trial

Commits on Mar 27, 2024
- vendor flash-attention
  skrider
  committed
  bbf023b
- update vendored flash-attention
  skrider
  committed
  38d422d
- add reshape_and_cache_flash
  skrider
  committed
  00dc8ad
- refactor reshape_and_cache_flash
  skrider
  committed
  4ffe256
- refactor reshape_and_cache_flash
  skrider
  committed
  6a2ddf4
- implement flash attention decode backend
  skrider
  committed
  0e45f5d
- FlashAttentionDecode -> FlashAttention
  WoosukKwon
  committed
  45c3662
- Remove gitmodule
  WoosukKwon
  committed
  18132d2
- Minor
  WoosukKwon
  committed
  3cc5ebd
- Minor
  WoosukKwon
  committed
  70f6b16
- Remove submodule
  WoosukKwon
  committed
  1ebf12e
Commits on Mar 28, 2024
- Use prefix-enabled attention
  WoosukKwon
  committed
  8a209ff
- Disable flash-attn backend
  WoosukKwon
  committed
  31f741d
- Minor
  WoosukKwon
  committed
  70efebb
- Remove __ldg for AMD portability
  WoosukKwon
  committed
  56b78e6
- Remove assert
  WoosukKwon
  committed
  f119396
- Add causal=True
  WoosukKwon
  committed
  b6a1833
- Enable when vllm_flash_attn
  WoosukKwon
  committed
  da50678
- Merge branch 'main' into flash-attention-decode
  WoosukKwon
  committed
  6d5b4ec
- Add vllm-flash-attn as dependency
  WoosukKwon
  committed
  37cb5a9
- Fix prefix attention
  WoosukKwon
  committed
  df13824
- Fix prefix attention
  WoosukKwon
  committed
  9a02294
- add test
  LiuXiaoxuanPKU
  committed
  4553846
- Merge branch 'flash-attention-decode' of github.com:skrider/vllm into flash-attention-decode
  LiuXiaoxuanPKU
  committed
  2669902
- fix
  LiuXiaoxuanPKU
  committed
  ff19304
Commits on Apr 2, 2024
- fix test
  skrider
  committed
  dbeeb8a
Commits on Apr 22, 2024
- Merge branch 'main' into flash-attention-decode
  WoosukKwon
  committed
  f489dee
- Add vllm-flash-attn to requirements-cuda
  WoosukKwon
  committed
  358886f
- Minor
  WoosukKwon
  committed
  0013859
- Fix
  WoosukKwon
  committed
  45cb2d6
- yapf
  WoosukKwon
  committed
  2800f2e
- isort
  WoosukKwon
  committed
  0fe3ec5
- Fix
  WoosukKwon
  committed
  977afb6
- Fix
  WoosukKwon
  committed
  c55627a
Commits on May 2, 2024
- .
  rkooo567
  committed
  bf3abdc
- Merge branch 'main' into flash-attention-decode-trial
  rkooo567
  committed
  6bc5a6c
- working?
  rkooo567
  committed
  fd3b465

Commits

Commits on Mar 27, 2024

Commits on Mar 28, 2024

Commits on Apr 2, 2024

Commits on Apr 22, 2024

Commits on May 2, 2024