Added Hugging Face Inference API Endpoint Support#49

Merged

fingerthief merged 3 commits intomainfrom dev/add-hugging-face-inference-api-support

Apr 20, 2024

+307-17

Commits on Apr 20, 2024

Added hugging face inference endpoints support
fingerthief
committed
Added new max_tokens settings for Hugging Face models as context windows vary greatly between models and for some reason hugging face defaults to a 500 token window for responses...
fingerthief
committed
Bringing the readme up to date with info
fingerthief
committed