-
Notifications
You must be signed in to change notification settings - Fork 678
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix(watsonx): set span with exception information #2172
base: main
Are you sure you want to change the base?
Conversation
The fix is to resolve the problem of no trace for the erroneous call that's caused by incorrect watsonx API key. cc @gyliu513 |
|
||
if "generate" in name: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think this won't work well with the generator response. You need to manually close the span on all cases
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks, I will investigate and update with more details.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Explicitly call span.__exit__
for exception, just like using with
statement to do it automatically.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@nirga please review again. span.__exit__
is the default operation to record exception information and call span.end(), and no impact to generator response.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
BTW, bedrock instrumentation use with
statement and no 'Generator' problem, so the exception can be handled by span.__exit__
automatically when exception raised from line 166 response = fn(*args, **kwargs)
https://github.com/traceloop/openllmetry/blob/main/packages/opentelemetry-instrumentation-bedrock/opentelemetry/instrumentation/bedrock/__init__.py#L163-L171
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
span.__exit__
implementation:
https://github.com/open-telemetry/opentelemetry-python/blob/main/opentelemetry-sdk/src/opentelemetry/sdk/trace/__init__.py#L986-L1008
span.__exit__
of parent class:
https://github.com/open-telemetry/opentelemetry-python/blob/main/opentelemetry-api/src/opentelemetry/trace/span.py#L186-L194
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes @jinsongo but you're setting the exception yourself anyway so you don't really need this, right?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I prefer to set the exception information into the span by simply calling __exit__
.
As you know, without the fix, I cannot see any span sent after the exception raised.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@jinsongo why? You didn't call __enter__
so I don't think it's preferred on explicitly logging the exception on the span
e41216d
to
74eaaa0
Compare
feat(instrumentation): ...
orfix(instrumentation): ...
.Use
with
statement to catch the exception and automatically mark the span as being in an error state, then if an exception occurs, the span can be properly ended and contain information about the exception.