(Permanent persistence) Process the accumulated logs only when exporter instance is up

[amanmoar277]

I am collecting logs via HTTP endpoint and sending this data to elasticsearch(ES) using elasticsearchexporter.

Everything is working perfectly fine if the ES instance is up and working.
But here are two issue

1. What will happen if ES is down and we are continuously getting logs over HTTP receiver?
2. What will happen to in memory logs which are accumulated when ES was down?

Few points -

1. I am already using retry option of elasticsearchexporter, but things are not working well if there are a lot of logs received per seconds.
2. It is suggested to use kafka as persistence buffer, but the same issue will occur when logs are consumed from kafka but ES is down at that time. Because as of now I didn't found and acknowledgement related control.

The end goal is -

1. No logs should me missed
2. If ES is down for sometime, logs should be properly aggregated and replayed once ES is up (Even after downtime of 30 mins)
3. If something went wrong with opentelemetry instance, no logs should be lost

Please suggest some approach on this.