Enable Falcon FP8 inference#777

Merged

regisss merged 16 commits into

synapse_1.15from

schoi/falcon_180_quant_OH

Mar 27, 2024

Commits on Mar 14, 2024

enable Falcon FP8 inference

Local Lab User
authored and
schoi-habana
committed
added example command in readme, code cleanup

Local Lab User
authored and
schoi-habana
committed
resolve issues in finetuning

Local Lab User
authored and
schoi-habana
committed
enable non reuse cache flow for fp8

Local Lab User
authored and
schoi-habana
committed
revert non reuse_cache flow for training due to perf drop

Local Lab User
authored and
schoi-habana
committed
add falcon180B FP8 test

Local Lab User
authored and
schoi-habana
committed

Commits on Mar 18, 2024

Commits on Mar 19, 2024

modify comments
schoi-habana
committed

Commits on Mar 21, 2024

Commits on Mar 25, 2024

Commits on Mar 26, 2024

address comments by removing redundant
schoi-habana
committed

Commits on Mar 27, 2024

Merge branch 'main' into schoi/falcon_180_quant_OH
regisss
committed