Skip to content
@ModelTC

ModelTC

Model Infra

Pinned

  1. MQBench MQBench Public

    Model Quantization Benchmark

    Shell 748 136

  2. United-Perception United-Perception Public

    United Perception

    Python 426 65

  3. NNLQP NNLQP Public

    Python 33 3

  4. Dipoorlet Dipoorlet Public

    Offline Quantization Tools for Deploy.

    Python 109 14

  5. lightllm lightllm Public

    LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

    Python 2.2k 186

Repositories

Showing 10 of 38 repositories
  • llmc Public

    This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

    ModelTC/llmc’s past year of commit activity
    Python 199 Apache-2.0 22 3 0 Updated Aug 24, 2024
  • lightllm Public

    LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

    ModelTC/lightllm’s past year of commit activity
    Python 2,227 Apache-2.0 186 59 7 Updated Aug 24, 2024
  • xtuner Public Forked from InternLM/xtuner

    An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

    ModelTC/xtuner’s past year of commit activity
    Python 0 Apache-2.0 298 0 0 Updated Aug 22, 2024
  • InternVL Public Forked from OpenGVLab/InternVL

    [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的可商用开源多模态对话模型

    ModelTC/InternVL’s past year of commit activity
    Python 0 MIT 409 0 0 Updated Aug 16, 2024
  • DeepSpeed Public Forked from microsoft/DeepSpeed

    DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

    ModelTC/DeepSpeed’s past year of commit activity
    Python 0 Apache-2.0 4,167 0 0 Updated Aug 16, 2024
  • EasyLLM Public

    Built upon Megatron-Deepspeed and HuggingFace Trainer, EasyLLM has reorganized the code logic with a focus on usability. While enhancing usability, it also ensures training efficiency.

    ModelTC/EasyLLM’s past year of commit activity
    Python 36 Apache-2.0 7 0 0 Updated Aug 16, 2024
  • general-sam Public

    A general suffix automaton implementation in Rust with Python bindings

    ModelTC/general-sam’s past year of commit activity
    Rust 3 Apache-2.0 0 0 1 Updated Aug 12, 2024
  • mtc-token-healing Public

    Token healing implementation in Rust

    ModelTC/mtc-token-healing’s past year of commit activity
    Rust 3 Apache-2.0 0 0 3 Updated Aug 12, 2024
  • OmniBal Public
    ModelTC/OmniBal’s past year of commit activity
    Python 15 0 2 0 Updated Aug 9, 2024
  • TFMQ-DM Public

    [CVPR 2024 Highlight] This is the official PyTorch implementation of "TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models".

    ModelTC/TFMQ-DM’s past year of commit activity
    Jupyter Notebook 52 Apache-2.0 3 0 0 Updated Aug 1, 2024
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…