-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Symlinks aren't created for all buffers #4316
Comments
Well, seems like buffers always use tag as an unique ID. In my example, both log streams had same tag (but other variables, which should be included and separated by the buffers). Anyway, I removed 'tag' from section and now it works properly. But what's the point of defining custom variables for the buffer, if it still uses 'tag' as a determinant of uniqueness? |
Thank you for your report!
|
But it may be a bug that there is no check for the setting in symlink_path. |
This issue has been automatically marked as stale because it has been open 30 days with no activity. Remove stale label or comment or this issue will be closed in 7 days |
From this fix, warnings occur when the setting is insufficient. |
Describe the bug
Hey there,
recently I noticed an issue, related to symlink_path mechanism in td-agent/fluentd receiver agent. It seems like td-agent successfully receives two (or more) log streams from k8s cluster and creates two (or more) buffers for them, but it always create only one symlink in provided directory.
From agent's logs we can read, that td-agent recognized and created two buffers for two log streams:
And when I checked buffers' directory, both of them was present and was continuously written:
So far so good. But I configured td-agent to create symlinks for me. And it also works, but only for one buffer:
The second buffer exists, but symlink wasn't created. I didn't find anything interesting in td-agent logs. It just skips creating symlink for the other buffer for some reason.
In the meantime I recreated my k8s pods many times and td-agent always creates only one symlink. It's definitely not related to my system or permissions. Seems like td-agent internal logic issue...
To Reproduce
To reproduce this issue, use td-agent.conf provided below.
Expected behavior
Symlinks should be created for every open buffer.
Your Environment
Your Configuration
Your Error Log
There isn't any error in the logs.
Additional context
No response
The text was updated successfully, but these errors were encountered: