Skip to content

Add generation server scripts using HF accelerate and DS-inference#328

Merged
mayank31398 merged 33 commits intomainfrom
add-generation-server
Sep 1, 2022
Merged

Add generation server scripts using HF accelerate and DS-inference#328
mayank31398 merged 33 commits intomainfrom
add-generation-server

Commits

Commits on Aug 12, 2022

Commits on Aug 13, 2022

Commits on Aug 15, 2022

  • cli

    Mayank MishraMayank Mishra
    Mayank Mishra
    authored and
    Mayank Mishra
    committed
    5c31d9a

  • server

    Mayank MishraMayank Mishra
    Mayank Mishra
    authored and
    Mayank Mishra
    committed
    2905955

Commits on Aug 16, 2022

Commits on Aug 17, 2022

Commits on Aug 18, 2022

Commits on Aug 19, 2022

Commits on Aug 20, 2022

Commits on Aug 21, 2022

  • drop nccl

    Mayank MishraMayank Mishra
    Mayank Mishra
    authored and
    Mayank Mishra
    committed
    997a5fa

Commits on Aug 24, 2022

  • fix

    Mayank MishraMayank Mishra
    Mayank Mishra
    authored and
    Mayank Mishra
    committed
    85d9fcb

  • default values

    Mayank MishraMayank Mishra
    Mayank Mishra
    authored and
    Mayank Mishra
    committed
    11d50f1

  • resolve issues

    Mayank MishraMayank Mishra
    Mayank Mishra
    authored and
    Mayank Mishra
    committed
    403424b

Commits on Aug 25, 2022

Commits on Aug 27, 2022

Commits on Aug 29, 2022

Commits on Sep 1, 2022