Popular repositories Loading

1. WPipe WPipe Public

   Implement WPipe from Paper: Group-based Interleaved Pipeline Parallelism for Large-scale DNN Training

   Python 3

2. StreamingSP StreamingSP Public

   A new streaming sequence parallel method.

   1

3. deep-learning deep-learning Public

   deep learning

4. miniModelInferenceEngine miniModelInferenceEngine Public

   A small deep learning model inference engine.

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

6. onnxruntime onnxruntime Public

   Forked from microsoft/onnxruntime

   ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

   C++