feat: Llama2 Chat Inference with Inf2 instances#356

Merged

ovaleanu merged 9 commits intomainfrom inf2

Oct 27, 2023

+2,170-62

Commits on Oct 10, 2023

feat: Inference node group added for inf2
vara-bonthu
committed

Commits on Oct 11, 2023

feat: Inf2 with Llama2 chat serving with ray
vara-bonthu
committed

Commits on Oct 24, 2023

Commits on Oct 25, 2023

updates to rayserve models
vara-bonthu
committed

Commits on Oct 26, 2023

Commits on Oct 27, 2023