Skip to content

a playground to place lot of things about phi. Maybe trainer/inference ui/optimizations/some addon archs...etc

Notifications You must be signed in to change notification settings

KohakuBlueleaf/HakuPhi

Repository files navigation

Haku-Phi: A Phi playground

Haku - 珀

Original model: https://huggingface.co/microsoft/phi-1_5

What is this repo

Just a playground to place lot of things about phi. Maybe trainer/inference ui/optimizations/some addon archs...etc

Plans:

  • optimizations: like xformers/pytorch sdp attn
  • trainer: trainer for LLM/VQA/Image Captioner
  • inference ui: Like what I have done on Guanaco-7B (not the Q-LoRA one).
  • some addon archs: For VQA or t2i model.

About

a playground to place lot of things about phi. Maybe trainer/inference ui/optimizations/some addon archs...etc

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages