Skip to content

Set GOMEMLIMIT in charts#61853

Merged
hugoShaka merged 1 commit intomasterfrom
hugo/set-gomemlimit
Dec 2, 2025
Merged

Set GOMEMLIMIT in charts#61853
hugoShaka merged 1 commit intomasterfrom
hugo/set-gomemlimit

Conversation

@hugoShaka
Copy link
Copy Markdown
Contributor

@hugoShaka hugoShaka commented Nov 28, 2025

This PR sets GOMEMLIMIT to 90% of the memory limit in theteleport-cluster, teleport-kube-agent, and teleport-relay charts.

Setting this environment variable reduces the probability of an OOM kill in case of spike/ high memory allocation rate. This was required when troubleshooting #61839

We are already doing this in Teleport Cloud, with values between 98% and 90% depending on the tenant size/activity. With this change I opted for the most conservative default.

This should not be a breaking change as I took extra care to not override potential existing GOMEMLIMIT vars set thorugh extraEnv so I'll backport this as a bugfix to both v17 and v18.

Changelog: Tuned teleport-cluster, teleport-kube-agent, and teleport-relay Helm charts to reduce the probability of Teleport exceeding its memory limits and being OOM-Killed. GOMEMLIMIT defaults to 90% of the configured memory limits.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Nov 28, 2025

Amplify deployment status

Branch Commit Job ID Status Preview Updated (UTC)
hugo/set-gomemlimit d975044 3 ✅SUCCEED hugo-set-gomemlimit 2025-12-02 23:42:55

@hugoShaka hugoShaka requested review from webvictim and removed request for mmcallister and ptgott November 28, 2025 21:21
{{- end -}}

{{/* This renders the GOMEMLIMIT env var unless the user already specified it
in exrtaEnv, goMemLimitRatio is set to 0, or requests.memory.limit is unset. */}}
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
in exrtaEnv, goMemLimitRatio is set to 0, or requests.memory.limit is unset. */}}
in extraEnv, goMemLimitRatio is set to 0, or requests.memory.limit is unset. */}}

@hugoShaka hugoShaka force-pushed the hugo/set-gomemlimit branch from 4759023 to d975044 Compare December 2, 2025 23:36
@hugoShaka hugoShaka enabled auto-merge December 2, 2025 23:36
@hugoShaka hugoShaka added this pull request to the merge queue Dec 2, 2025
Merged via the queue into master with commit d34351c Dec 2, 2025
44 checks passed
@hugoShaka hugoShaka deleted the hugo/set-gomemlimit branch December 2, 2025 23:55
@backport-bot-workflows
Copy link
Copy Markdown
Contributor

@hugoShaka See the table below for backport results.

Branch Result
branch/v17 Failed
branch/v18 Failed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants