Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

otel2influx: traces and logs yield conflicting column types #273

Closed
2 tasks
jacobmarble opened this issue Aug 22, 2023 · 0 comments · Fixed by #274
Closed
2 tasks

otel2influx: traces and logs yield conflicting column types #273

jacobmarble opened this issue Aug 22, 2023 · 0 comments · Fixed by #274
Assignees
@jacobmarble

Comments

@jacobmarble
Copy link
Member

jacobmarble commented Aug 22, 2023 •
edited
Loading

When writing both logs and tracdes to one InfluxDB bucket/database, some columns are written as both tag and field:

go.opentelemetry.io/collector/exporter/exporterhelper/internal.(*boundedMemoryQueue).StartConsumers.func1
        go.opentelemetry.io/collector/[email protected]/exporterhelper/internal/bounded_memory_queue.go:47
2023-07-20T19:17:56.536Z        error   exporterhelper/queued_retry.go:391      Exporting failed. The error is not retryable. Dropping data.   {"kind": "exporter", "data_type": "metrics", "name": "influxdb", "error": "Permanent error: line protocol write returned \"400 Bad Request\" \"{\\\"code\\\":\\\"invalid\\\",\\\"message\\\":\\\"failed to parse line protocol: error writing line 1: Unable to insert iox::column_type::field::string type into column telemetry.sdk.name with type iox::column_type::tag\\\"}\"", "dropped_items": 104}
@jacobmarble jacobmarble mentioned this issue Aug 22, 2023
Merged
@jacobmarble jacobmarble self-assigned this Aug 22, 2023
@jacobmarble jacobmarble mentioned this issue Aug 30, 2023
Merged
jacobmarble added a commit to influxdata/telegraf that referenced this issue Aug 30, 2023
@jacobmarble
feat(inputs.opentelemetry): Add configurable log record dimensions
3c5a927 
Helps influxdata/influxdb-observability#273

Adds configurable log record dimensions to the influxdbexporter. This
allows the user to manage which log record attributes translate to
InfluxDB tags.

Similar to #13404
@jacobmarble jacobmarble mentioned this issue Aug 30, 2023
Merged
3 tasks
jacobmarble added a commit to influxdata/telegraf that referenced this issue Aug 30, 2023
@jacobmarble
feat(inputs.opentelemetry): Add configurable log record dimensions
3dcdf71 
Helps influxdata/influxdb-observability#273

Adds configurable log record dimensions to the influxdbexporter. This
allows the user to manage which log record attributes translate to
InfluxDB tags.

Similar to #13404
jacobmarble added a commit to influxdata/telegraf that referenced this issue Aug 30, 2023
@jacobmarble
feat(inputs.opentelemetry): Add configurable log record dimensions
76d12e9 
Helps influxdata/influxdb-observability#273

Adds configurable log record dimensions to the influxdbexporter. This
allows the user to manage which log record attributes translate to
InfluxDB tags.

Similar to #13404
@jacobmarble jacobmarble reopened this Aug 31, 2023
jacobmarble added a commit that referenced this issue Aug 31, 2023
@jacobmarble
chore: resolve integration test failures
38cf08b 
Helps #273

Allow integration tests to pass by importing WIP branches of
otelcontribcol and telegraf.
@jacobmarble jacobmarble mentioned this issue Aug 31, 2023
Merged
jacobmarble added a commit that referenced this issue Aug 31, 2023
@jacobmarble
chore: resolve integration test failures
020d4c5 
Helps #273

Allow integration tests to pass by importing WIP branches of
otelcontribcol and telegraf.
dmitryax pushed a commit to open-telemetry/opentelemetry-collector-contrib that referenced this issue Sep 2, 2023
@jacobmarble
[exporter/influxdb] configurable LogRecord dimensions (#26342)
ebdf15c 
**Description:** <Describe what has changed.>
Adds new config value `LogRecordDimensions` to influxdbexporter, similar
to #23230. This allows the user to specify which otel attributes
translate to InfluxDB tags, and which should be written to the
`attributes` InfluxDB field.

Incidentally, this change also updates the main dependency of
influxdbreceiver, but no important changes were made to that module.

**Link to tracking Issue:**

influxdata/influxdb-observability#273
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jacobmarble jacobmarble

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix(otel2influx): configurable logs dimensions influxdata/influxdb-observability
1 participant
@jacobmarble