Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Drop metric on buffer there is some error on its data/format #392

Open
sbengo opened this issue Jan 25, 2019 · 1 comment
Labels
output-db Related to new output devices to send metrics performance Related to performance bugs, info, improvements runtime-control Related to task to control device gathering or metric sending to db online
Milestone

Comments

@sbengo
Copy link
Collaborator

sbengo commented Jan 25, 2019

Hi,

We have a device trying to poll a metric defined as:

  • Datasource type: COUNTER64
  • Conversion: INTEGER

We have an old InfluxDB with 1.0 version on our test/dev environment which INTEGER metric type (uint) is not supported.

Description

When the SNMPCollector tries to send the metric, InfluxDB is returning the following error:

msg="ERROR on Write batchPoint in DB influx_MAIN (1 points) | elapsed : 18.310755ms | Error: {\"error\":\"unable to parse 'paloalto_gc_dropCounters,firewall=MYFIREWALL flowFwdL3TtlZero=0,flowHostServiceDeny=0,flowHostServiceUnknown=0,flowMeterHostThrottle=0,pktAllocFailure=65921,pktAllocFailureCos=842,sessionDiscard=0u 1548296280': invalid number\"}\n "

As it is not send, it is being stored on internal buffer, trying, on every cycle, to resend it, filling the buffer and, indirectly, consuming memory and affecting the other devices.

image

Feature request

SNMPCollector should be able to:

  • Keep the metric on buffer in case of connectivity problems
  • Drop the metric if there is some error with metric format/data
@sbengo
Copy link
Collaborator Author

sbengo commented Feb 15, 2019

A member of our team created a metric setup as Gauge32 - INTEGER and it was throwing an error trying to write the invalid point on InfluxDB.

We have changed the metric and it spent more than 10 min to complete, seems to be related with the buffer

image

@toni-moreno toni-moreno added this to the 0.10 milestone Feb 28, 2021
@toni-moreno toni-moreno modified the milestones: 0.10, 1.0 Mar 7, 2021
@toni-moreno toni-moreno added output-db Related to new output devices to send metrics performance Related to performance bugs, info, improvements runtime-control Related to task to control device gathering or metric sending to db online labels Mar 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
output-db Related to new output devices to send metrics performance Related to performance bugs, info, improvements runtime-control Related to task to control device gathering or metric sending to db online
Projects
None yet
Development

No branches or pull requests

2 participants