You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This is basically a "hidden" feature which is very useful.
Solution
Document it in Wiki - Per model config or Model specific config. Also the "inline_model_loading" is also missing doc but it's self-explanatory.
Additional context
Currently because of "merged_kwargs = {**override_args, **kwargs}" not "merged_kwargs = {**kwargs, **override_args}", config.yml will override tabby_config.yml On First Load(API request "Inline load" will always prefer tabby_config.yml), so you need to keep config.yml blank to avoid confusion. Is this intended behaviour? With presence of "use_as_default" this get even more confusing. Is there a better/cleaner/nicer, more restrictive but no ambiguity way? /First step at least use latter merged_kwargs= to make load behavior consistent.
Acknowledgements
I have looked for similar requests before submitting this one.
I understand that the developers have lives and my issue will be answered when possible.
I understand the developers of this program are human, and I will make my requests politely.
The text was updated successfully, but these errors were encountered:
Problem
This is basically a "hidden" feature which is very useful.
Solution
Document it in Wiki - Per model config or Model specific config. Also the "inline_model_loading" is also missing doc but it's self-explanatory.
Additional context
Currently because of "merged_kwargs = {**override_args, **kwargs}" not "merged_kwargs = {**kwargs, **override_args}", config.yml will override tabby_config.yml On First Load(API request "Inline load" will always prefer tabby_config.yml), so you need to keep config.yml blank to avoid confusion. Is this intended behaviour? With presence of "use_as_default" this get even more confusing. Is there a better/cleaner/nicer, more restrictive but no ambiguity way? /First step at least use latter merged_kwargs= to make load behavior consistent.
Acknowledgements
The text was updated successfully, but these errors were encountered: