Popular repositories Loading

1. FasterTransformer FasterTransformer Public

   Forked from void-main/FasterTransformer

   Transformer related optimization, including BERT, GPT

   C++

2. llm_benchmark llm_benchmark Public

   Python 1

3. triton-trtllm-models triton-trtllm-models Public

   Python

4. DeepSpeedExamples DeepSpeedExamples Public

   Forked from microsoft/DeepSpeedExamples

   Example models using DeepSpeed

   Python

5. deepspeed-mii deepspeed-mii Public

   Forked from sfc-gh-vichan/deepspeed-mii

   test

   Python

6. tensorrtllm_backend tensorrtllm_backend Public

   Forked from triton-inference-server/tensorrtllm_backend

   The Triton TensorRT-LLM Backend

   Python