Beat exporter need support filebeat.inputs - type: log; but not the deprecated filebeat.prospectors: - input_type: log

[duhang]

beat-exporter/collector/filebeat.go

Line 30 in 67af338

} `json:"prospector"`

Basically, just need replace "prospector" with "input" at the above line.

Please note that filebeat.prospectors is now deprecated and people should start using filebeat.inputs in their filebeat.yml instead.

Deprecated:

filebeat.prospectors:
- input_type: log

New:

filebeat.inputs:
- type: log
  paths:
  - /var/log/*.log
  - /var/log/*/*.log
  - /var/log/*/*/*.log
  - /var/log/*/*/*/*.log

Here is what curl http://localhost:5066/stats will show for filebeat.input from FB 6.4.1

  "filebeat": {
    "events": {
      "active": 11,
      "added": 497,
      "done": 486
    },
    "harvester": {
      "closed": 0,
      "open_files": 6,
      "running": 6,
      "skipped": 0,
      "started": 6
    },
    "input": {
      "log": {
        "files": {
          "renamed": 0,
          "truncated": 0
        }
      }
    }
  }

[shivas]

@duhang thanks, i'll check it out, maybe you could grab whole json output of /stats endpoint and attach it to this issue?

[duhang]

Here you go!

# curl localhost:5066
{"beat":"filebeat","hostname":"logging-1001","name":"logging-1001","uuid":"9c15ca6e-17b5-4e2d-b068-822b6f8db768","version":"6.4.1"}

# curl localhost:5066/stats
{"beat":{"cpu":{"system":{"ticks":50,"time":{"ms":53}},"total":{"ticks":140,"time":{"ms":143},"value":140},"user":{"ticks":90,"time":{"ms":90}}},"info":{"ephemeral_id":"646ba668-0c93-45ba-91cf-e6c0398136d3","uptime":{"ms":11200}},"memstats":{"gc_next":4352240,"memory_alloc":2803896,"memory_total":8912144,"rss":29347840}},"filebeat":{"events":{"active":12,"added":165,"done":153},"harvester":{"closed":0,"open_files":4,"running":4,"skipped":0,"started":4},"input":{"log":{"files":{"renamed":0,"truncated":0}}}},"libbeat":{"config":{"module":{"running":0,"starts":0,"stops":0},"reloads":0},"output":{"events":{"acked":135,"active":0,"batches":11,"dropped":0,"duplicates":0,"failed":0,"total":135},"read":{"bytes":39064,"errors":0},"type":"elasticsearch","write":{"bytes":90225,"errors":0}},"pipeline":{"clients":1,"events":{"active":12,"dropped":0,"failed":0,"filtered":18,"published":147,"retry":17,"total":165},"queue":{"acked":135}}},"registrar":{"states":{"cleanup":0,"current":14,"update":153},"writes":{"fail":0,"success":27,"total":27}},"system":{"cpu":{"cores":32},"load":{"1":0.12,"15":0.22,"5":0.2,"norm":{"1":0.0038,"15":0.0069,"5":0.0063}}}}