Skip to content

[8.19](backport #47260) Add AWS auth method for cel and httpjson inputs#50141

Merged
olegsu merged 1 commit into8.19from
mergify/bp/8.19/pr-47260
Apr 16, 2026
Merged

[8.19](backport #47260) Add AWS auth method for cel and httpjson inputs#50141
olegsu merged 1 commit into8.19from
mergify/bp/8.19/pr-47260

Conversation

@mergify
Copy link
Copy Markdown
Contributor

@mergify mergify Bot commented Apr 15, 2026

Proposed commit message

Add a new auth method for cel and httpjson that wraps the aws v4 signer.

As discussed here this PR introduces an new auth method that can be used in cel and httpjson integrations.

This AWS auth method is implemented by creating an HTTP transport that wraps the transport of the client, uses a configuration, AWS credentials, and v4 signer, and signs the request just before passing it to the next (actual) HTTP transport.

example of cel and httpjson configs that uses the aws auth:

### cel
config_version: 2
interval: {{interval}}
auth.aws:
  access_key_id: {{access_key_id}}
  secret_access_key: {{secret_access_key}}
### cel
config_version: 2
interval: {{interval}}
auth.aws:
  role_arn: {{role_arn}}
  external_id: {{external_id}}
### httpjson
config_version: "2"
interval: {{interval}}
auth.aws:
  role_arn: {{role_arn}}
  external_id: {{external_id}}

The auth method config can be initialized with static credentials as well as assume role arn and every other available config in ConfigAWS.

The service name and default region can be configured or inferred from the URL of the request.

When using this method, the integration (cel or httpjson file) does not need to re-implement the aws sing process inside the file, while at the same time having the singer as http.Transport, offers some advantages (described here; like enabling an integration using all available aws auth methods based on user config with a single cel/httpjson file) and will enable the cloud connectors project to be expanded to other aws integrations (cloud connector specific changes will be introduced in a later PR).

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in ./changelog/fragments using the changelog tool.

Disruptive User Impact

Author's Checklist

  • [ ]

How to test this PR locally

Related issues

Use cases

Screenshots

Logs


This is an automatic backport of pull request #47260 done by [Mergify](https://mergify.com).

@mergify mergify Bot added the backport label Apr 15, 2026
@mergify mergify Bot requested review from a team as code owners April 15, 2026 19:11
@mergify mergify Bot requested review from AndersonQ and orestisfl and removed request for a team April 15, 2026 19:11
@botelastic botelastic Bot added the needs_team Indicates that the issue/PR needs a Team:* label label Apr 15, 2026
@github-actions
Copy link
Copy Markdown
Contributor

🤖 GitHub comments

Just comment with:

  • run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

@github-actions github-actions Bot added enhancement Team:obs-ds-hosted-services Label for the Observability Hosted Services team Team:Elastic-Agent-Data-Plane Label for the Agent Data Plane team Team:Security-Service Integrations Security Service Integrations Team labels Apr 15, 2026
@botelastic botelastic Bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Apr 15, 2026
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/obs-ds-hosted-services (Team:obs-ds-hosted-services)

@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane)

@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/security-service-integrations (Team:Security-Service Integrations)

@andrewkroh andrewkroh assigned olegsu and unassigned moukoublen Apr 15, 2026
@olegsu
Copy link
Copy Markdown

olegsu commented Apr 15, 2026

more context #49956 (comment)

@olegsu olegsu merged commit 917271c into 8.19 Apr 16, 2026
122 of 125 checks passed
@olegsu olegsu deleted the mergify/bp/8.19/pr-47260 branch April 16, 2026 12:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport enhancement Team:Elastic-Agent-Data-Plane Label for the Agent Data Plane team Team:obs-ds-hosted-services Label for the Observability Hosted Services team Team:Security-Service Integrations Security Service Integrations Team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants