[improve][test] Disable disk usage threshold & geoip download and enable logging for Elastic Testcontainers

[lhotari]

Fixes #20661

Motivation

master branch is blocked by PulsarSinksTest.testElasticSearch8Sink failing, see #20661

Modifications

• disable downloading of geoip database when Elastic container starts
• enable logging of Elastic container output
• upgrade Elastic 8 container version from 8.5.1 to 8.5.3
• allow disk usage to go beyond 90% when running Elastic in integration tests

Matching PR in forked repository

PR in forked repository: lhotari#151

• doc
• doc-required
• doc-not-needed
• doc-complete

[eolivelli]

Great
Thank you very much

[nicoloboschi]

Nice

[lhotari]

I finally found the root cause. It's not the geoip download, but it's the default Elastic configuration that it stops writes when the disk usage goes over 90%. I've now added a setting to disable the disk usage threshold.
commit is d959eb4 . Similar setting is applied in https://github.com/elastic/elastic-github-actions/blob/562b8b6ae4677da97273ff6bc4d630ce96ecbaa5/elasticsearch/run-elasticsearch.sh#L41

[lhotari]

The logging helped find the issue. However, it's only a warning that gets printed:

2023-06-28T15:14:43,179 - INFO - [docker-java-stream--1170024553:ElasticSearchSinkTester@113] - elastic> {"@timestamp":"2023-06-28T15:14:43.176Z", "log.level": "WARN", "message":"high disk watermark [90%] exceeded on [WSN4y7xITamrUzTvic-eEg][94f6a74e1f83][/usr/share/elasticsearch/data] free: 8.1gb[9.7%], shards will be relocated away from this node; currently relocating away shards totalling [0] bytes; the node is expected to continue to exceed the high disk watermark when these relocations are complete", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[94f6a74e1f83][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.cluster.routing.allocation.DiskThresholdMonitor","elasticsearch.cluster.uuid":"_NqZoH7vRxqPTe21y53uhQ","elasticsearch.node.id":"WSN4y7xITamrUzTvic-eEg","elasticsearch.node.name":"94f6a74e1f83","elasticsearch.cluster.name":"docker-cluster"}