Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bug] cannot get Tokens in Langfuse Pipeline #344

Open
anonymousmaharaj opened this issue Nov 22, 2024 · 0 comments
Open

[bug] cannot get Tokens in Langfuse Pipeline #344

anonymousmaharaj opened this issue Nov 22, 2024 · 0 comments

Comments

@anonymousmaharaj
Copy link

anonymousmaharaj commented Nov 22, 2024

In outlet func I got this body for example

{'stream': True, 'model': 'openai/gpt-4o-mini', 'messages': [{'role': 'user', 'content': '****!'}, {'role': 'assistant', 'content': '********'}, {'role': 'user', 'content': '******'}], 'session_id': '0Wvu0hBT7534RXkmAAFX', 'chat_id': '773a5127-7f0a-4471-ab8f-03856556e2cc', 'id': '46a01fdd-9280-4f49-835a-c27c030fc40b'}

There used to be fields with the number of tokens. It used to work fine for me. Now I can't get tokens anywhere. I debugged all the values and now there are no tokens anywhere, so now it is impossible to get tokens? Is this a bug or a feature?

I use Openwebui 0.3.35 (because the new one slows down) and the latest pipeline. Can you tell me what it depends on? I can roll back the pipeline to the right version if that's the reason. I only need it for langfuse.

Pipeline version: git-1367d95

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant