Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(api): add correlationID to Track Chat requests #3668

Merged
merged 6 commits into from
Sep 28, 2024

Conversation

siddimore
Copy link
Contributor

@siddimore siddimore commented Sep 26, 2024

Description

This PR does not fix but a feature to add correlationID to track chat requests

  1. Add CorrelationID to chat completions endpt
  2. Pass this CorrelationID to backend grpc-cpp server
  3. Log CorrelationID to help track requests

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

Copy link

netlify bot commented Sep 26, 2024

Deploy Preview for localai ready!

Name Link
🔨 Latest commit 5418ce6
🔍 Latest deploy log https://app.netlify.com/sites/localai/deploys/66f753c4346ae50008932a2a
😎 Deploy Preview https://deploy-preview-3668--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@siddimore siddimore changed the title Add correlationID to Track requests Add correlationID to Track Chat requests Sep 27, 2024
@mudler mudler changed the title Add correlationID to Track Chat requests feat(api: add correlationID to Track Chat requests Sep 27, 2024
@mudler mudler changed the title feat(api: add correlationID to Track Chat requests feat(api): add correlationID to Track Chat requests Sep 27, 2024
@mudler
Copy link
Owner

mudler commented Sep 27, 2024

@siddimore This looks good here!

I need DCO to be cleared out before merging - can you sign-off your commits with git rebase origin/master --signoff ?

@siddimore
Copy link
Contributor Author

@siddimore This looks good here!

I need DCO to be cleared out before merging - can you sign-off your commits with git rebase origin/master --signoff ?

yup @mudler will do it today. I also have another PR in the wings for exposing tokens_per_second as a metric. Will raise it with signed off commits.

@siddimore siddimore marked this pull request as ready for review September 27, 2024 16:32
@siddimore siddimore force-pushed the add_correlation_id branch 3 times, most recently from 714b641 to 98ab46b Compare September 27, 2024 17:19
@mudler mudler enabled auto-merge (squash) September 27, 2024 21:53
siddimore and others added 6 commits September 27, 2024 17:54
Signed-off-by: Siddharth More <[email protected]>
Signed-off-by: Siddharth More <[email protected]>
Signed-off-by: Siddharth More <[email protected]>
Co-authored-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Siddharth More <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Siddharth More <[email protected]>
auto-merge was automatically disabled September 28, 2024 00:54

Head branch was pushed to by a user without write access

@siddimore
Copy link
Contributor Author

@mudler had to rebase please kindly re-approve

@mudler mudler enabled auto-merge (squash) September 28, 2024 07:58
@mudler mudler merged commit 50a3b54 into mudler:master Sep 28, 2024
29 checks passed
@siddimore
Copy link
Contributor Author

@mudler thanks, i am PST TZ watching the build lastnight until 11:30pm noticed the merge.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants