confgenerator: Send Log Pipeline Ping every 10 minutes.

[franciscovalentecastro]

Description

Add fluent-bit component that generates a "Ping" LogEntry every 10 minutes. This log verifies the Ops Agent is currently able to send logs correctly to Google Cloud Logging. The resulting LogEntry will follow the Structured Ops Agent Health Logs (#1290) format.

Sample LogEntry

{
  "insertId": "...",
  "jsonPayload": {
    "code": "LogPingOpsAgent"
  },
  "resource": {
    "type": "gce_instance",
    "labels": {
      "instance_id": "...",
      "project_id": "...",
      "zone": "..."
    }
  },
  "timestamp": "2023-11-06T19:12:05.723238757Z",
  "severity": "DEBUG",
  "labels": {
    "agent.googleapis.com/health/schemaVersion": "v1",
    "agent.googleapis.com/health/agentKind": "ops-agent",
    "agent.googleapis.com/health/agentVersion": "2.44.0"
  },
  "logName": "projects/.../logs/ops-agent-health",
  "receiveTimestamp": "2023-11-06T19:12:06.749694991Z"
}

Related issue

b/308825141

How has this been tested?

Checklist:

• Unit tests
  • Unit tests do not apply.
  • Unit tests have been added/modified and passed for this PR.
• Integration tests
  • Integration tests do not apply.
  • Integration tests have been added/modified and passed for this PR.
• Documentation
  • This PR introduces no user visible changes.
  • This PR introduces user visible changes and the corresponding documentation change has been made.
• Minor version bump
  • This PR introduces no new features.
  • This PR introduces new features, and there is a separate PR to bump the minor version since the last release already.
  • This PR bumps the version.

[franciscovalentecastro]

Current State of PR :

• Synced with @jefferbrecht. Feature code is correct. We need to verify the first appearance of the Ping.
• Currently the Ping shows 10 minutes after startup, due to how the in_dummy plugin works.
• Updated the TestLoggingSelfLogs to verify for the ping. In most platforms takes ~13 mins to complete. Currently it is not the longest running test.
• Created in_dummy: Add flush_on_startup config. fluent/fluent-bit#8222 in upstream fluent-bit to be able to flush on startup the ping and reduce the length of this test (b/319102785).
• This PR is blocked by the update of the fluent-bit submodule Update fluent-bit to 2.2.0 release. #1513 to 2.20.0+.

[franciscovalentecastro]

All test passed (see cec1a95). Rebasing and merging.