Skip to content

Certain OTLP log fields dropped when output #10143

@nbroyles

Description

@nbroyles

Bug Report

Describe the bug

Certain OTLP log fields are dropped when output. Those fields are LogRecord.event_name, ResourceLogs.schema_url, ScopeLogs.schema_url. They're defined in the OTLP logs proto here.

To Reproduce

  • Use this FB config
service:
    flush: 0.2
pipeline:
    inputs:
        - name: opentelemetry
          listen: 0.0.0.0
          port: 4318
    outputs:
        - name: stdout
          match: '*'
  • (Optional, can just use config above directly) Spin up a docker container:
docker run -ti   -v <path/to/config/above>:/fluent-bit/etc/config.yaml:ro  -p 4318:4318 -p 2020:2020 fluent/fluent-bit:3.2.10   -c /fluent-bit/etc/config.yaml
curl -X POST http://localhost:4318/v1/logs -H "Content-Type: application/json" -d @log.json

Expected behavior
eventName and both schemaUrl references in JSON are present in output

Actual behavior
Data is missing in the output below:

GROUP METADATA :

{"schema"=>"otlp", "resource_id"=>0, "scope_id"=>0}

GROUP ATTRIBUTES :

{"resource"=>{"attributes"=>{"service.name"=>"fbtest"}}, "scope"=>{"name"=>"foo", "version"=>"1.0.0", "attributes"=>{"baz"=>42, "foo"=>"bar", "qux"=>["a", "b", "c"]}}}

[0] v1_logs: [[1743102495.18446744071648179025, {"otlp"=>{"observed_timestamp"=>1743102495259334000, "severity_number"=>10, "severity_text"=>"info", "attributes"=>{"attr1"=>"attr1-value1", "attr2"=>"attr2-value2", "attr3"=>3, "attr4"=>["v1", "v2", "v3"], "foo"=>{"bar"=>"baz", "qux"=>"quux"}}, "trace_id"=>"5B8EFFF798038103D269B633813FC60C", "span_id"=>"EEE19B7EC3C1B174"}}], {"key1"=>"value1", "key2"=>"value2"}]

Your Environment

  • Version used: 3.2.10
  • Configuration: See above
  • Environment name and version (e.g. Kubernetes? What version?): Docker
  • Server type and version:
  • Operating System and version:
  • Filters and plugins:

Additional context

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions