Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

.Net Add possibility of see the LogProbs on the StreamingChatMessages. #7007

Open
RogerBarreto opened this issue Jun 28, 2024 · 0 comments
Open

.Net Add possibility of see the LogProbs on the StreamingChatMessages. #7007

RogerBarreto opened this issue Jun 28, 2024 · 0 comments
Assignees
@RogerBarreto
Labels
ai connector Anything related to AI connectors .NET Issue or Pull requests regarding .NET code

Comments

@RogerBarreto
Copy link
Member

There's no way today to retrieve the LogProbs information of each chunk using the StreamingChatMessage abstraction.

There's a simpler way thru Breaking GLass for it using the InnerContent providing the update Azure SDK abstraction in it or improve the OpenAIStreamingChatMessage to enable traversal of that information.
@markwallace-microsoft markwallace-microsoft added .NET Issue or Pull requests regarding .NET code triage labels Jun 28, 2024
@RogerBarreto RogerBarreto self-assigned this Jun 28, 2024
@markwallace-microsoft markwallace-microsoft added ai connector Anything related to AI connectors and removed triage labels Jul 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@RogerBarreto RogerBarreto

Labels
ai connector Anything related to AI connectors .NET Issue or Pull requests regarding .NET code
Projects
Semantic Kernel
Status: Backlog: Planned
Milestone
No milestone
Development

No branches or pull requests
2 participants
@RogerBarreto @markwallace-microsoft