Skip to content
@ModelTC

ModelTC

Model Infra

Pinned Loading

  1. MQBench MQBench Public

    Model Quantization Benchmark

    Python 781 140

  2. United-Perception United-Perception Public

    United Perception

    Python 430 66

  3. NNLQP NNLQP Public

    Python 34 3

  4. Dipoorlet Dipoorlet Public

    Offline Quantization Tools for Deploy.

    Python 121 16

  5. lightllm lightllm Public

    LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

    Python 2.8k 222

Repositories

Showing 10 of 41 repositories
  • lightllm Public

    LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

    ModelTC/lightllm’s past year of commit activity
    Python 2,784 Apache-2.0 222 65 9 Updated Jan 22, 2025
  • lightllm-blog Public
    ModelTC/lightllm-blog’s past year of commit activity
    SCSS 0 MIT 0 0 0 Updated Jan 22, 2025
  • MQBench Public

    Model Quantization Benchmark

    ModelTC/MQBench’s past year of commit activity
    Python 781 Apache-2.0 140 5 5 Updated Jan 20, 2025
  • llmc Public

    [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

    ModelTC/llmc’s past year of commit activity
    Python 390 Apache-2.0 45 5 0 Updated Jan 17, 2025
  • general-sam-py Public

    Python bindings for general-sam and some utilities

    ModelTC/general-sam-py’s past year of commit activity
    Python 3 Apache-2.0 0 0 2 Updated Jan 13, 2025
  • mtc-token-healing Public

    Token healing implementation in Rust

    ModelTC/mtc-token-healing’s past year of commit activity
    Rust 3 Apache-2.0 0 0 4 Updated Jan 13, 2025
  • quant_horizon Public
    ModelTC/quant_horizon’s past year of commit activity
    Cuda 9 Apache-2.0 2 0 0 Updated Jan 10, 2025
  • general-sam Public

    A general suffix automaton implementation in Rust with Python bindings

    ModelTC/general-sam’s past year of commit activity
    Rust 5 Apache-2.0 0 0 1 Updated Oct 18, 2024
  • EasyLLM Public

    Built upon Megatron-Deepspeed and HuggingFace Trainer, EasyLLM has reorganized the code logic with a focus on usability. While enhancing usability, it also ensures training efficiency.

    ModelTC/EasyLLM’s past year of commit activity
    Python 44 Apache-2.0 7 0 0 Updated Sep 18, 2024
  • DeepSpeed Public Forked from microsoft/DeepSpeed

    DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

    ModelTC/DeepSpeed’s past year of commit activity
    Python 0 Apache-2.0 4,368 0 0 Updated Sep 13, 2024
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…