Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Archived traces 404ing with elasticsearch storage #1511

Closed
zdicesare opened this issue Apr 30, 2019 · 5 comments · Fixed by #1617
Closed

Archived traces 404ing with elasticsearch storage #1511

zdicesare opened this issue Apr 30, 2019 · 5 comments · Fixed by #1617

Comments

@zdicesare
Copy link
Contributor

zdicesare commented Apr 30, 2019

Problem - what in Jaeger blocks you from solving the requirement?

With archive storage configured, I am getting 404s when trying to view an archived trace in the UI.

I am running Jaeger 1.11 with elasticsearch storage, version 6.2
The UI has a config w/ archiveEnabled set to true, --es-archive.enabled=true, and ES_SERVER_URLS and ES_ARCHIVE_SERVER_URLS pointing to the same cluster.

I can successfully archive a trace in the UI and can see it stored in the jaeger-span-archive index.

However, accessing a trace via direct lookup at "trace/TRACE_ID" gives a 404.

@chandresh-pancholi
Copy link
Contributor

I will look into it.

@zdicesare
Copy link
Contributor Author

Also to be clear, the trace continues to load fine via direct lookup while it's still newer than 2 days, but after that point, it fails to load when I believe it should be loading it via archive storage

@zdicesare
Copy link
Contributor Author

zdicesare commented May 20, 2019

I confirmed this is because of the lookback logic in the SpanReader.

Specifically, it is not finding traces because it is still querying jaeger-span-archive with a SearchAfter(time) configured on the elastic.SearchSource.

@pavolloffay Does it sound reasonable to have a function similar to timeRangeIndexFn and only set SearchAfter() on the SearchSource if the span is non-archive?

@pavolloffay
Copy link
Member

I haven't looked at the code yet. Would you like to submit a PR for it?

@pavolloffay
Copy link
Member

I am looking into this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants