Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Add a way to select another model in Config #16

Open
mtoniott opened this issue Mar 18, 2024 · 5 comments
Open

[Feature Request] Add a way to select another model in Config #16

mtoniott opened this issue Mar 18, 2024 · 5 comments
Labels
enhancement New feature or request
Milestone

Comments

@mtoniott
Copy link

Not all computers can run codellama. Being able to select another model would be quite cool for those.

@yusufcanb yusufcanb added this to the 1.2 milestone Mar 18, 2024
@yusufcanb
Copy link
Owner

yusufcanb commented Mar 18, 2024

This feature requested very often (e.g. #14). Initially, I thought it is better to separate user from underlying models so they can only focus on the efficiency provided by tlm and went with codellama:7b as the most optimal solution. But I'm planning to include an option to go with models with less parameters like starcoder2:3b.

Thank you for your feedback.

@yusufcanb yusufcanb modified the milestones: 1.2, 1.3 Apr 5, 2024
@yusufcanb yusufcanb added the enhancement New feature or request label Apr 6, 2024
@alirezanet
Copy link
Contributor

alirezanet commented Jun 24, 2024

+1 on this, it is better to give users the ability to choose the desired model, but tlm can set the system prompts ... otherwise with any new model release, users have to wait for the new tlm release to use it (if you decide to change the default). for example, right now the more optimal model might be deepseek-coder-v2 or codestral but there is no way to change it

@damajor
Copy link

damajor commented Jul 26, 2024

This feature is a must have !

@unkwn1-repo
Copy link

would love to see this, being suck with codellama as the only model has made me move to aichat.

@alirezanet
Copy link
Contributor

would love to see this, being suck with codellama as the only model has made me move to aichat.

I also switched to aichat ... it is better than what I expected initially

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

When branches are created from issues, their pull requests are automatically linked.

5 participants