-
Notifications
You must be signed in to change notification settings - Fork 100
[8.0] Support multiple endpoints #966
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[8.0] Support multiple endpoints #966
Conversation
…ng (elastic#829) Co-authored-by: apmmachine <[email protected]>
…ng (elastic#833) Co-authored-by: apmmachine <[email protected]>
…ng (elastic#842) Co-authored-by: apmmachine <[email protected]>
…ng (elastic#849) Co-authored-by: apmmachine <[email protected]>
…ng (elastic#852) Co-authored-by: apmmachine <[email protected]>
(cherry picked from commit 8a4855b) Co-authored-by: Sean Cunningham <[email protected]>
This was coming out of the debugging session around fleet-server where some of the log messages were not too clear to me on what these mean.
…ticsearch Fleet APIs, remove holes detection and refreshes (elastic#814) (elastic#863) * Switch to the new _fleet/_fleet_search and _fleet/_fleet_msearch Elasticsearch Fleet APIs, remove holes detection and refreshes * Switch to the new _fleet/_fleet_msearch and _fleet/_fleet_search Fleet APIs endpoints for the searches that required refreshes and wait for checkpoints. The new API handles refreshes and checkpoints waits. * Separate queues for _msearch and _fleet_msearch, to avoid delays on searches without checkpoints wait. Use _fleet/_fleet_msearch endpoint if search is requested with wait_for_checkpoints. Use _fleet/_fleet_search for the monitor hits fetch. * Had to copy over the search and msearch wrappers from go-elasticsearch library and customize them for _fleet_search and _fleet_msearch. These could be removed once the library is updated for these new endpoints. * Removed the holes detection and refresh op code as it's not longer used. (cherry picked from commit a2fb073) Co-authored-by: Aleksandr Maus <[email protected]>
…elastic#864) * Do not depend on agent.Id ad that field was not added until 7.15 (cherry picked from commit 6382114) * Migrate agent.id field from 7.14 to 7.15+ (cherry picked from commit aeb4b66) * Handle 404 on .fleet-agent index as a noop during migration. (cherry picked from commit 130056a) Co-authored-by: Sean Cunningham <[email protected]>
…ng (elastic#867) Co-authored-by: apmmachine <[email protected]>
…ng (elastic#870) Co-authored-by: apmmachine <[email protected]>
* Periodic expired actions cleanup * Fix make check * Fix TestConfig unit test * Put back WithRefresh in integration tests actions setup * Switch the actions cleanup to use bulker.MDelete instead of Delete * Improve 404 status handling (cherry picked from commit 6694c08) Co-authored-by: Aleksandr Maus <[email protected]>
…ng (elastic#878) Co-authored-by: apmmachine <[email protected]>
…astic#881) (cherry picked from commit 9d8666e) Co-authored-by: Aleksandr Maus <[email protected]>
* use ecs zerolog lib for logging (cherry picked from commit 6627876) * update checksums (cherry picked from commit 998db6a) * run check on 1.17 (cherry picked from commit 72dccaa) Co-authored-by: bryan <[email protected]>
…ndex (elastic#882) (elastic#889) (cherry picked from commit 3f02142) Co-authored-by: Aleksandr Maus <[email protected]>
…ng (elastic#891) Co-authored-by: apmmachine <[email protected]>
…lastic#895) (cherry picked from commit 7937c63) Co-authored-by: Aleksandr Maus <[email protected]>
* Add default_api_key_history field to the agent schema * Append agent.default_api_key_history on API key change and invalidate the keys on ack (cherry picked from commit dff3595) Co-authored-by: Aleksandr Maus <[email protected]>
…lastic#897) (cherry picked from commit d643e6b) Co-authored-by: Aleksandr Maus <[email protected]>
…ng (elastic#902) Co-authored-by: apmmachine <[email protected]>
Adds support to enable instrumentation via the APM Go agent. New config
options have been added to the `Server` input which could be set up in
the `fleet-server` integration configuration.
The added instrumentation covers the `fleet-server` http server and the
Adds support to enable instrumentation via the APM Go agent. New config
options have been added to the `Server` input which could be set up in
the `fleet-server` integration configuration.
The added instrumentation covers the `fleet-server` http server and the
`go-elasticsearch` client.
A sample of the configuration that's been added (`instrumentation`):
```yaml
inputs:
- type: fleet-server
server:
instrumentation:
enabled: true
hosts: ["localhost:8200"]
environment: production
secret_token: token
api_key: apikey
```
Signed-off-by: Marc Lopez Rubio <[email protected]>
(cherry picked from commit ade74c7)
Co-authored-by: Marc Lopez Rubio <[email protected]>
…c#906) (elastic#910) * Improve expired actions cleanup, use _delete_by_query instead (cherry picked from commit fae23a3) Co-authored-by: Aleksandr Maus <[email protected]>
…ng (elastic#914) Co-authored-by: apmmachine <[email protected]>
…ng (elastic#918) Co-authored-by: apmmachine <[email protected]>
…ng (elastic#921) Co-authored-by: apmmachine <[email protected]>
…ng (elastic#925) Co-authored-by: apmmachine <[email protected]>
…ng (elastic#933) Co-authored-by: apmmachine <[email protected]>
) * keep trucking on ES availability errors; more tests to come (cherry picked from commit 7fb0138) * don't attempt to distinguish between errors, just keep retrying (cherry picked from commit 2c75552) * move error blackholing up the stack so the monitor will never crash, added additional logging (cherry picked from commit f5fead9) * pr feedback (cherry picked from commit 1886dc5) * upped logging level, properly wrapped errors (cherry picked from commit 97524dc) Co-authored-by: bryan <[email protected]>
…ng (elastic#938) Co-authored-by: apmmachine <[email protected]>
…ng (elastic#945) Co-authored-by: apmmachine <[email protected]>
…ng (elastic#951) Co-authored-by: apmmachine <[email protected]>
…ng (elastic#959) Co-authored-by: apmmachine <[email protected]>
…ic#964) Adds TLS configuration options for the APM instrumentation, using env vars to configure the APM HTTP Tracer since it currently doesn't support setting those values in Golang. We'll follow up on this once the apm tracer has a function to create a new tracer with configurable settings via config struct. Signed-off-by: Marc Lopez Rubio <[email protected]> (cherry picked from commit 155d0e9) Co-authored-by: Marc Lopez Rubio <[email protected]>
Multiple endpoints
|
This pull request is now in conflicts. Could you fix it @michalpristas? 🙏 |
|
This pull request does not have a backport label. Could you fix it @michalpristas? 🙏
NOTE: |
What is the problem this PR solves?
What this PR solves is a problem when agent got unenrolled on heavier load when agent managing fleet server cannot checkin to it's own server so it will fallback to unenroll.
Closes #741
How does this PR solve the problem?
Problem is solved by adding internal endpoint which is used for communication on local network (with agent handling fleet server)
It lets FS to spin up 2 set of handlers, one on public 8220 and one on port defined in config.
How to test this PR locally
This needs to be tested with work on
elastic-agentLink: elastic/beats#28993Checklist
CHANGELOG.next.asciidocorCHANGELOG-developer.next.asciidoc.