Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

deepseek-r1 not working with Ollama format correctly #29317

Open
5 tasks done
alyahmedaly opened this issue Jan 20, 2025 · 0 comments
Open
5 tasks done

deepseek-r1 not working with Ollama format correctly #29317

alyahmedaly opened this issue Jan 20, 2025 · 0 comments
Labels
🤖:bug Related to a bug, vulnerability, unexpected error with an existing feature

Comments

@alyahmedaly
Copy link

Checked other resources

  • I added a very descriptive title to this issue.
  • I searched the LangChain documentation with the integrated search.
  • I used the GitHub search to find a similar question and didn't find it.
  • I am sure that this is a bug in LangChain rather than my code.
  • The bug is not resolved by updating to the latest stable version of LangChain (or the specific integration package).

Example Code

No Code needed

Error Message and Stack Trace (if applicable)

There is no exception

Description

I was trying deepseek-r1:14b today with ollama format:Json schema

looks like the integration need to be update as this kind of model when you ask question it start with thinking section before it start answering

so I was getting wrong output mainly the output was part of the thinking process

same code works with Phi4 and llamaa 3.2

System Info

I'm using the js version of langchain

@dosubot dosubot bot added the 🤖:bug Related to a bug, vulnerability, unexpected error with an existing feature label Jan 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🤖:bug Related to a bug, vulnerability, unexpected error with an existing feature
Projects
None yet
Development

No branches or pull requests

1 participant