Skip to content
federicamtk edited this page Feb 7, 2023 · 13 revisions

Welcome to the FishLeg wiki!

Monthly Meetings:
2023/02/02 - FishLeg Status – Execution Ready?

Next scheduled merge to master:

  • After MINST and FACES are reproduced correctly (Ritwik+Jamie), and the Speedups are implemented (Rui)

FishLeg Library Status:

Task Status
Library v1 Done
MNIST Reproduced Done
FACES Reproduced In progress
Time Profiling In progress
Speedups In progress
Implement New Layers -

FishLeg Pruning:

Task Status
Investigate SparseML library and compatibility Done
Review state-of-the-art literature for pruning In progress
Implement transformer layer for FishLeg -
Reproduce reference benchmark results for pruning -
Implement FishLeg pruning -

FishLeg Finetuning:

Task Status
Running BLOOM+1 finetuning For review
Review Literature In progress
Clone this wiki locally