Skip to content

Actions: ModelTC/lightllm

Actions

Docker

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
334 workflow runs
334 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

add vllm moe configs (#580)
Docker #281: Commit 75b4910 pushed by hiworldwzj
October 25, 2024 06:52 3m 49s main
October 25, 2024 06:52 3m 49s
add max len prefill infer check (#578)
Docker #280: Commit 67ee79a pushed by hiworldwzj
October 25, 2024 05:01 3m 46s main
October 25, 2024 05:01 3m 46s
add lightllm_vllm_kernel (#576)
Docker #279: Commit 789637f pushed by hiworldwzj
October 24, 2024 08:53 3m 35s main
October 24, 2024 08:53 3m 35s
add profile max_total_token_nums (#574)
Docker #278: Commit b1bde26 pushed by hiworldwzj
October 24, 2024 05:52 2m 4s main
October 24, 2024 05:52 2m 4s
support to read eos_id from config.json (#569)
Docker #277: Commit 7ca5b21 pushed by shihaobai
October 18, 2024 05:58 1m 52s main
October 18, 2024 05:58 1m 52s
release local tensors alloc during cudagraph warmup (#568)
Docker #276: Commit 71d1208 pushed by hiworldwzj
October 17, 2024 10:48 2m 21s main
October 17, 2024 10:48 2m 21s
[op] Modify embedding (#567)
Docker #275: Commit 9bf04ae pushed by hiworldwzj
October 16, 2024 02:20 1m 55s main
October 16, 2024 02:20 1m 55s
attention decode use self.alloc_tensor interface. (#566)
Docker #274: Commit 72c5fa8 pushed by hiworldwzj
October 15, 2024 04:19 2m 1s main
October 15, 2024 04:19 2m 1s
[misc] modify flash decoding function (#564)
Docker #273: Commit eb9cf81 pushed by hiworldwzj
October 15, 2024 02:44 1m 56s main
October 15, 2024 02:44 1m 56s
[misc] In-place add for embedding (#565)
Docker #272: Commit 7a02b84 pushed by hiworldwzj
October 15, 2024 02:43 1m 53s main
October 15, 2024 02:43 1m 53s
W4a16 fix (#562)
Docker #271: Commit 22cd8d0 pushed by shihaobai
October 11, 2024 11:31 3m 37s main
October 11, 2024 11:31 3m 37s
New embedding (#561)
Docker #270: Commit 9e627ff pushed by shihaobai
October 11, 2024 06:48 2m 3s main
October 11, 2024 06:48 2m 3s
Update README.md (#559)
Docker #269: Commit b7b6204 pushed by hiworldwzj
October 10, 2024 06:10 3m 16s main
October 10, 2024 06:10 3m 16s
slim dockerfile (#558)
Docker #268: Commit 0442a20 pushed by shihaobai
October 10, 2024 05:38 11m 59s main
October 10, 2024 05:38 11m 59s
fix llama3 prelayer weight load. (#557)
Docker #267: Commit a7ab39b pushed by shihaobai
October 9, 2024 08:03 31m 43s main
October 9, 2024 08:03 31m 43s
fix llama3 pre_layer_weight loading (#556)
Docker #266: Commit f80ad72 pushed by shihaobai
October 9, 2024 07:43 33m 0s main
October 9, 2024 07:43 33m 0s
add docker clean (#555)
Docker #265: Commit 018611c pushed by shihaobai
October 9, 2024 06:03 31m 7s main
October 9, 2024 06:03 31m 7s
fix cudagraph warmup for multimodal (#554)
Docker #264: Commit 635e645 pushed by shihaobai
October 8, 2024 12:01 25m 49s main
October 8, 2024 12:01 25m 49s
【bug】 fix alloc_tensor for torch.__version__ < 2.1.0 (#553)
Docker #263: Commit b11f9f7 pushed by hiworldwzj
October 8, 2024 02:56 26m 22s main
October 8, 2024 02:56 26m 22s
add cudagraph warmup (#551)
Docker #262: Commit ed439b4 pushed by hiworldwzj
October 8, 2024 02:14 26m 44s main
October 8, 2024 02:14 26m 44s
upgrade cuda graph mem manager (#549)
Docker #261: Commit e05be2d pushed by shihaobai
September 30, 2024 07:49 30m 50s main
September 30, 2024 07:49 30m 50s
fix cuda graph (#548)
Docker #260: Commit 452baa7 pushed by hiworldwzj
September 27, 2024 09:04 29m 3s main
September 27, 2024 09:04 29m 3s
add cudagraph for lightllm (#544)
Docker #259: Commit c1d7c6d pushed by hiworldwzj
September 27, 2024 08:45 29m 15s main
September 27, 2024 08:45 29m 15s
fix context_flashattention_nopad.py (#547)
Docker #258: Commit 6a6aa3d pushed by hiworldwzj
September 27, 2024 04:15 28m 13s main
September 27, 2024 04:15 28m 13s
New prefill op (#543)
Docker #257: Commit c99307c pushed by hiworldwzj
September 27, 2024 04:01 28m 51s main
September 27, 2024 04:01 28m 51s