bug: dynamic_context does not seem to work #652
Description
- I have looked for existing issues (including closed) about this
Bug Report
When I run the MistyRal model locally using the example code, I simply replaced the agent model name in the example code.
The example code file is here: https://github.com/0xPlaygrounds/rig/blob/main/rig-core/examples/rag_ollama.rs
The result did not return the expected definition of the glarb-glarb term mentioned in the documentation.
In the debug log, the payload sent to the model contains an empty value {"role":"user","content":""}.
When I tried to use cursor to fix this code, the conclusion given by cursor was that dynamic_context does not seem to work
Reproduction
Expected behavior
This is the model output
2025-08-01T08:38:22.139165Z DEBUG starting new connection: http://localhost:11434/
2025-08-01T08:38:22.140234Z DEBUG connecting to [::1]:11434
2025-08-01T08:38:22.140432Z DEBUG connecting to 127.0.0.1:11434
2025-08-01T08:38:22.140606Z DEBUG connected to 127.0.0.1:11434
2025-08-01T08:38:22.280729Z DEBUG pooling idle connection for ("http", localhost:11434)
2025-08-01T08:38:22.285957Z DEBUG reuse idle connection for ("http", localhost:11434)
2025-08-01T08:38:22.301163Z DEBUG pooling idle connection for ("http", localhost:11434)
2025-08-01T08:38:22.304026Z INFO Selected documents: doc1 (0.9036040050682345)
2025-08-01T08:38:22.304143Z DEBUG Chat mode payload: {"model":"mistral:latest","messages":[{"role":"system","content":"\n You are a dictionary assistant here to assist the user in understanding the meaning of words.\n You will find additional non-standard word definitions that could be useful below.\n "},{"role":"user","content":""},{"role":"user","content":"What does \"glarb-glarb\" mean?"}],"options":{"temperature":null},"stream":false}
2025-08-01T08:38:22.304233Z DEBUG reuse idle connection for ("http", localhost:11434)
2025-08-01T08:38:23.970659Z DEBUG pooling idle connection for ("http", localhost:11434)
2025-08-01T08:38:23.971008Z DEBUG Ollama chat response: {"model":"mistral:latest","created_at":"2025-08-01T08:38:23.970257Z","message":{"role":"assistant","content":" In this context, as there seems to be no standard definition for \"glarb-glarb\", I cannot provide a precise meaning based on commonly accepted language usage or dictionary references. However, it is often used humorously in online communities and forums, where it's used to represent nonsensical sounds or words that don't have any specific meaning."},"done_reason":"stop","done":true,"total_duration":1665824000,"load_duration":7220666,"prompt_eval_count":58,"prompt_eval_duration":180000000,"eval_count":74,"eval_duration":1476000000}
In this context, as there seems to be no standard definition for "glarb-glarb", I cannot provide a precise meaning based on commonly accepted language usage or dictionary references. However, it is often used humorously in online communities and forums, where it's used to represent nonsensical sounds or words that don't have any specific meaning.
Screenshots
