Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -178,6 +178,7 @@ Then perform the following commands on the root folder:
| enable\_k8s\_beta\_apis | (Optional) - List of Kubernetes Beta APIs to enable in cluster. | `list(string)` | `[]` | no |
| enable\_kubernetes\_alpha | Whether to enable Kubernetes Alpha features for this cluster. Note that when this option is enabled, the cluster cannot be upgraded and will be automatically deleted after 30 days. | `bool` | `false` | no |
| enable\_l4\_ilb\_subsetting | Enable L4 ILB Subsetting on the cluster | `bool` | `false` | no |
| enable\_legacy\_lustre\_port | Set it to true for GKE cluster runs a version earlier than 1.33.2-gke.4780000. Allows the Lustre CSI driver to initialize LNet (the virtual network layer for Lustre kernel module) using port 6988. This flag is required to workaround a port conflict with the gke-metadata-server on GKE nodes | `bool` | `false` | no |
| enable\_mesh\_certificates | Controls the issuance of workload mTLS certificates. When enabled the GKE Workload Identity Certificates controller and node agent will be deployed in the cluster. Requires Workload Identity. | `bool` | `false` | no |
| enable\_multi\_networking | Whether multi-networking is enabled for this cluster | `bool` | `null` | no |
| enable\_network\_egress\_export | Whether to enable network egress metering for this cluster. If enabled, a daemonset will be created in the cluster to meter network egress traffic. | `bool` | `false` | no |
Expand Down Expand Up @@ -215,6 +216,7 @@ Then perform the following commands on the root folder:
| logging\_enabled\_components | List of services to monitor: SYSTEM\_COMPONENTS, APISERVER, CONTROLLER\_MANAGER, KCP\_CONNECTION, KCP\_SSHD, KCP\_HPA, SCHEDULER, and WORKLOADS. Empty list is default GKE configuration. | `list(string)` | `[]` | no |
| logging\_service | The logging service that the cluster should write logs to. Available options include logging.googleapis.com, logging.googleapis.com/kubernetes (beta), and none | `string` | `"logging.googleapis.com/kubernetes"` | no |
| logging\_variant | (Optional) The type of logging agent that is deployed by default for newly created node pools in the cluster. Valid values include DEFAULT and MAX\_THROUGHPUT. | `string` | `null` | no |
| lustre\_csi\_driver | The status of the Lustre CSI driver addon, which allows the usage of a Lustre instances as volumes | `bool` | `null` | no |
| maintenance\_end\_time | Time window specified for recurring maintenance operations in RFC3339 format | `string` | `""` | no |
| maintenance\_exclusions | List of maintenance exclusions. A cluster can have up to three | `list(object({ name = string, start_time = string, end_time = string, exclusion_scope = string }))` | `[]` | no |
| maintenance\_recurrence | Frequency of the recurring maintenance window in RFC5545 format. | `string` | `""` | no |
Expand Down Expand Up @@ -436,7 +438,7 @@ The [project factory](https://github.com/terraform-google-modules/terraform-goog
#### Terraform and Plugins

- [Terraform](https://www.terraform.io/downloads.html) 1.3+
- [Terraform Provider for GCP][terraform-provider-google] v6.41+
- [Terraform Provider for GCP][terraform-provider-google] v6.47+

#### gcloud

Expand Down
4 changes: 2 additions & 2 deletions autogen/main/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -319,9 +319,9 @@ The [project factory](https://github.com/terraform-google-modules/terraform-goog

- [Terraform](https://www.terraform.io/downloads.html) 1.3+
{% if beta_cluster %}
- [Terraform Provider for GCP Beta][terraform-provider-google-beta] v6.41+
- [Terraform Provider for GCP Beta][terraform-provider-google-beta] v6.47+
{% else %}
- [Terraform Provider for GCP][terraform-provider-google] v6.41+
- [Terraform Provider for GCP][terraform-provider-google] v6.47+
{% endif %}

#### gcloud
Expand Down
8 changes: 8 additions & 0 deletions autogen/main/cluster.tf.tmpl
Original file line number Diff line number Diff line change
Expand Up @@ -401,6 +401,14 @@ resource "google_container_cluster" "primary" {
enabled = var.filestore_csi_driver
}

dynamic "lustre_csi_driver_config" {
for_each = var.lustre_csi_driver == null ? [] : ["lustre_csi_driver_config"]
content {
enabled = var.lustre_csi_driver
enable_legacy_lustre_port = var.enable_legacy_lustre_port
}
}

{% if autopilot_cluster != true %}
network_policy_config {
disabled = !var.network_policy
Expand Down
14 changes: 13 additions & 1 deletion autogen/main/variables.tf.tmpl
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
/**
* Copyright 2022 Google LLC
* Copyright 2022-2025 Google LLC
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
Expand Down Expand Up @@ -778,6 +778,18 @@ variable "filestore_csi_driver" {
default = false
}

variable "lustre_csi_driver" {
type = bool
description = "The status of the Lustre CSI driver addon, which allows the usage of a Lustre instances as volumes"
default = null
}

variable "enable_legacy_lustre_port" {
type = bool
description = "Set it to true for GKE cluster runs a version earlier than 1.33.2-gke.4780000. Allows the Lustre CSI driver to initialize LNet (the virtual network layer for Lustre kernel module) using port 6988. This flag is required to workaround a port conflict with the gke-metadata-server on GKE nodes"
default = false
}

{% if autopilot_cluster != true %}
variable "network_policy" {
type = bool
Expand Down
8 changes: 8 additions & 0 deletions cluster.tf
Original file line number Diff line number Diff line change
Expand Up @@ -309,6 +309,14 @@ resource "google_container_cluster" "primary" {
enabled = var.filestore_csi_driver
}

dynamic "lustre_csi_driver_config" {
for_each = var.lustre_csi_driver == null ? [] : ["lustre_csi_driver_config"]
content {
enabled = var.lustre_csi_driver
enable_legacy_lustre_port = var.enable_legacy_lustre_port
}
}

network_policy_config {
disabled = !var.network_policy
}
Expand Down
5 changes: 5 additions & 0 deletions docs/upgrading_to_v39.0.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
# Upgrading to v39.0
The v39.0 release of *kubernetes-engine* is a backwards incompatible release.

### Google Cloud Platform Provider upgrade
The Terraform Kubernetes Engine Module now requires version 6.47 or higher of the Google Cloud Platform Providers.
9 changes: 9 additions & 0 deletions metadata.display.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -141,6 +141,9 @@ spec:
enable_l4_ilb_subsetting:
name: enable_l4_ilb_subsetting
title: Enable L4 Ilb Subsetting
enable_legacy_lustre_port:
name: enable_legacy_lustre_port
title: Enable Legacy Lustre Port
enable_mesh_certificates:
name: enable_mesh_certificates
title: Enable Mesh Certificates
Expand Down Expand Up @@ -252,6 +255,9 @@ spec:
logging_variant:
name: logging_variant
title: Logging Variant
lustre_csi_driver:
name: lustre_csi_driver
title: Lustre Csi Driver
maintenance_end_time:
name: maintenance_end_time
title: Maintenance End Time
Expand Down Expand Up @@ -360,6 +366,9 @@ spec:
ray_operator_config:
name: ray_operator_config
title: Ray Operator Config
rbac_binding_config:
name: rbac_binding_config
title: Rbac Binding Config
region:
name: region
title: Region
Expand Down
7 changes: 7 additions & 0 deletions metadata.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -601,6 +601,13 @@ spec:
description: The status of the Filestore CSI driver addon, which allows the usage of filestore instance as volumes
varType: bool
defaultValue: false
- name: lustre_csi_driver
description: The status of the Lustre CSI driver addon, which allows the usage of a Lustre instances as volumes
varType: bool
- name: enable_legacy_lustre_port
description: Set it to true for GKE cluster runs a version earlier than 1.33.2-gke.4780000. Allows the Lustre CSI driver to initialize LNet (the virtual network layer for Lustre kernel module) using port 6988. This flag is required to workaround a port conflict with the gke-metadata-server on GKE nodes
varType: bool
defaultValue: false
- name: network_policy
description: Enable network policy addon
varType: bool
Expand Down
4 changes: 3 additions & 1 deletion modules/beta-autopilot-private-cluster/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -98,6 +98,7 @@ Then perform the following commands on the root folder:
| enable\_fqdn\_network\_policy | Enable FQDN Network Policies on the cluster | `bool` | `null` | no |
| enable\_k8s\_beta\_apis | (Optional) - List of Kubernetes Beta APIs to enable in cluster. | `list(string)` | `[]` | no |
| enable\_l4\_ilb\_subsetting | Enable L4 ILB Subsetting on the cluster | `bool` | `false` | no |
| enable\_legacy\_lustre\_port | Set it to true for GKE cluster runs a version earlier than 1.33.2-gke.4780000. Allows the Lustre CSI driver to initialize LNet (the virtual network layer for Lustre kernel module) using port 6988. This flag is required to workaround a port conflict with the gke-metadata-server on GKE nodes | `bool` | `false` | no |
| enable\_multi\_networking | Whether multi-networking is enabled for this cluster | `bool` | `null` | no |
| enable\_network\_egress\_export | Whether to enable network egress metering for this cluster. If enabled, a daemonset will be created in the cluster to meter network egress traffic. | `bool` | `false` | no |
| enable\_private\_endpoint | Whether the master's internal IP address is used as the cluster endpoint | `bool` | `false` | no |
Expand Down Expand Up @@ -129,6 +130,7 @@ Then perform the following commands on the root folder:
| issue\_client\_certificate | Issues a client certificate to authenticate to the cluster endpoint. To maximize the security of your cluster, leave this option disabled. Client certificates don't automatically rotate and aren't easily revocable. WARNING: changing this after cluster creation is destructive! | `bool` | `false` | no |
| kubernetes\_version | The Kubernetes version of the masters. If set to 'latest' it will pull latest available version in the selected region. | `string` | `"latest"` | no |
| logging\_enabled\_components | List of services to monitor: SYSTEM\_COMPONENTS, APISERVER, CONTROLLER\_MANAGER, KCP\_CONNECTION, KCP\_SSHD, KCP\_HPA, SCHEDULER, and WORKLOADS. Empty list is default GKE configuration. | `list(string)` | `[]` | no |
| lustre\_csi\_driver | The status of the Lustre CSI driver addon, which allows the usage of a Lustre instances as volumes | `bool` | `null` | no |
| maintenance\_end\_time | Time window specified for recurring maintenance operations in RFC3339 format | `string` | `""` | no |
| maintenance\_exclusions | List of maintenance exclusions. A cluster can have up to three | `list(object({ name = string, start_time = string, end_time = string, exclusion_scope = string }))` | `[]` | no |
| maintenance\_recurrence | Frequency of the recurring maintenance window in RFC5545 format. | `string` | `""` | no |
Expand Down Expand Up @@ -230,7 +232,7 @@ The [project factory](https://github.com/terraform-google-modules/terraform-goog
#### Terraform and Plugins

- [Terraform](https://www.terraform.io/downloads.html) 1.3+
- [Terraform Provider for GCP Beta][terraform-provider-google-beta] v6.41+
- [Terraform Provider for GCP Beta][terraform-provider-google-beta] v6.47+

#### gcloud

Expand Down
8 changes: 8 additions & 0 deletions modules/beta-autopilot-private-cluster/cluster.tf
Original file line number Diff line number Diff line change
Expand Up @@ -236,6 +236,14 @@ resource "google_container_cluster" "primary" {
enabled = var.filestore_csi_driver
}

dynamic "lustre_csi_driver_config" {
for_each = var.lustre_csi_driver == null ? [] : ["lustre_csi_driver_config"]
content {
enabled = var.lustre_csi_driver
enable_legacy_lustre_port = var.enable_legacy_lustre_port
}
}


dynamic "gke_backup_agent_config" {
for_each = local.gke_backup_agent_config
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -106,6 +106,9 @@ spec:
enable_l4_ilb_subsetting:
name: enable_l4_ilb_subsetting
title: Enable L4 Ilb Subsetting
enable_legacy_lustre_port:
name: enable_legacy_lustre_port
title: Enable Legacy Lustre Port
enable_multi_networking:
name: enable_multi_networking
title: Enable Multi Networking
Expand Down Expand Up @@ -205,6 +208,9 @@ spec:
logging_enabled_components:
name: logging_enabled_components
title: Logging Enabled Components
lustre_csi_driver:
name: lustre_csi_driver
title: Lustre Csi Driver
maintenance_end_time:
name: maintenance_end_time
title: Maintenance End Time
Expand Down Expand Up @@ -265,6 +271,9 @@ spec:
ray_operator_config:
name: ray_operator_config
title: Ray Operator Config
rbac_binding_config:
name: rbac_binding_config
title: Rbac Binding Config
region:
name: region
title: Region
Expand Down
7 changes: 7 additions & 0 deletions modules/beta-autopilot-private-cluster/metadata.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -426,6 +426,13 @@ spec:
description: The status of the Filestore CSI driver addon, which allows the usage of filestore instance as volumes
varType: bool
defaultValue: false
- name: lustre_csi_driver
description: The status of the Lustre CSI driver addon, which allows the usage of a Lustre instances as volumes
varType: bool
- name: enable_legacy_lustre_port
description: Set it to true for GKE cluster runs a version earlier than 1.33.2-gke.4780000. Allows the Lustre CSI driver to initialize LNet (the virtual network layer for Lustre kernel module) using port 6988. This flag is required to workaround a port conflict with the gke-metadata-server on GKE nodes
varType: bool
defaultValue: false
- name: database_encryption
description: "Application-layer Secrets Encryption settings. The object format is {state = string, key_name = string}. Valid values of state are: \"ENCRYPTED\"; \"DECRYPTED\". key_name is the name of a CloudKMS key."
varType: list(object({ state = string, key_name = string }))
Expand Down
14 changes: 13 additions & 1 deletion modules/beta-autopilot-private-cluster/variables.tf
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
/**
* Copyright 2022 Google LLC
* Copyright 2022-2025 Google LLC
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
Expand Down Expand Up @@ -496,6 +496,18 @@ variable "filestore_csi_driver" {
default = false
}

variable "lustre_csi_driver" {
type = bool
description = "The status of the Lustre CSI driver addon, which allows the usage of a Lustre instances as volumes"
default = null
}

variable "enable_legacy_lustre_port" {
type = bool
description = "Set it to true for GKE cluster runs a version earlier than 1.33.2-gke.4780000. Allows the Lustre CSI driver to initialize LNet (the virtual network layer for Lustre kernel module) using port 6988. This flag is required to workaround a port conflict with the gke-metadata-server on GKE nodes"
default = false
}

variable "database_encryption" {
description = "Application-layer Secrets Encryption settings. The object format is {state = string, key_name = string}. Valid values of state are: \"ENCRYPTED\"; \"DECRYPTED\". key_name is the name of a CloudKMS key."
type = list(object({ state = string, key_name = string }))
Expand Down
4 changes: 3 additions & 1 deletion modules/beta-autopilot-public-cluster/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -91,6 +91,7 @@ Then perform the following commands on the root folder:
| enable\_fqdn\_network\_policy | Enable FQDN Network Policies on the cluster | `bool` | `null` | no |
| enable\_k8s\_beta\_apis | (Optional) - List of Kubernetes Beta APIs to enable in cluster. | `list(string)` | `[]` | no |
| enable\_l4\_ilb\_subsetting | Enable L4 ILB Subsetting on the cluster | `bool` | `false` | no |
| enable\_legacy\_lustre\_port | Set it to true for GKE cluster runs a version earlier than 1.33.2-gke.4780000. Allows the Lustre CSI driver to initialize LNet (the virtual network layer for Lustre kernel module) using port 6988. This flag is required to workaround a port conflict with the gke-metadata-server on GKE nodes | `bool` | `false` | no |
| enable\_multi\_networking | Whether multi-networking is enabled for this cluster | `bool` | `null` | no |
| enable\_network\_egress\_export | Whether to enable network egress metering for this cluster. If enabled, a daemonset will be created in the cluster to meter network egress traffic. | `bool` | `false` | no |
| enable\_resource\_consumption\_export | Whether to enable resource consumption metering on this cluster. When enabled, a table will be created in the resource export BigQuery dataset to store resource consumption data. The resulting table can be joined with the resource usage table or with BigQuery billing export. | `bool` | `true` | no |
Expand Down Expand Up @@ -120,6 +121,7 @@ Then perform the following commands on the root folder:
| issue\_client\_certificate | Issues a client certificate to authenticate to the cluster endpoint. To maximize the security of your cluster, leave this option disabled. Client certificates don't automatically rotate and aren't easily revocable. WARNING: changing this after cluster creation is destructive! | `bool` | `false` | no |
| kubernetes\_version | The Kubernetes version of the masters. If set to 'latest' it will pull latest available version in the selected region. | `string` | `"latest"` | no |
| logging\_enabled\_components | List of services to monitor: SYSTEM\_COMPONENTS, APISERVER, CONTROLLER\_MANAGER, KCP\_CONNECTION, KCP\_SSHD, KCP\_HPA, SCHEDULER, and WORKLOADS. Empty list is default GKE configuration. | `list(string)` | `[]` | no |
| lustre\_csi\_driver | The status of the Lustre CSI driver addon, which allows the usage of a Lustre instances as volumes | `bool` | `null` | no |
| maintenance\_end\_time | Time window specified for recurring maintenance operations in RFC3339 format | `string` | `""` | no |
| maintenance\_exclusions | List of maintenance exclusions. A cluster can have up to three | `list(object({ name = string, start_time = string, end_time = string, exclusion_scope = string }))` | `[]` | no |
| maintenance\_recurrence | Frequency of the recurring maintenance window in RFC5545 format. | `string` | `""` | no |
Expand Down Expand Up @@ -216,7 +218,7 @@ The [project factory](https://github.com/terraform-google-modules/terraform-goog
#### Terraform and Plugins

- [Terraform](https://www.terraform.io/downloads.html) 1.3+
- [Terraform Provider for GCP Beta][terraform-provider-google-beta] v6.41+
- [Terraform Provider for GCP Beta][terraform-provider-google-beta] v6.47+

#### gcloud

Expand Down
8 changes: 8 additions & 0 deletions modules/beta-autopilot-public-cluster/cluster.tf
Original file line number Diff line number Diff line change
Expand Up @@ -236,6 +236,14 @@ resource "google_container_cluster" "primary" {
enabled = var.filestore_csi_driver
}

dynamic "lustre_csi_driver_config" {
for_each = var.lustre_csi_driver == null ? [] : ["lustre_csi_driver_config"]
content {
enabled = var.lustre_csi_driver
enable_legacy_lustre_port = var.enable_legacy_lustre_port
}
}


dynamic "gke_backup_agent_config" {
for_each = local.gke_backup_agent_config
Expand Down
9 changes: 9 additions & 0 deletions modules/beta-autopilot-public-cluster/metadata.display.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -103,6 +103,9 @@ spec:
enable_l4_ilb_subsetting:
name: enable_l4_ilb_subsetting
title: Enable L4 Ilb Subsetting
enable_legacy_lustre_port:
name: enable_legacy_lustre_port
title: Enable Legacy Lustre Port
enable_multi_networking:
name: enable_multi_networking
title: Enable Multi Networking
Expand Down Expand Up @@ -196,6 +199,9 @@ spec:
logging_enabled_components:
name: logging_enabled_components
title: Logging Enabled Components
lustre_csi_driver:
name: lustre_csi_driver
title: Lustre Csi Driver
maintenance_end_time:
name: maintenance_end_time
title: Maintenance End Time
Expand Down Expand Up @@ -247,6 +253,9 @@ spec:
ray_operator_config:
name: ray_operator_config
title: Ray Operator Config
rbac_binding_config:
name: rbac_binding_config
title: Rbac Binding Config
region:
name: region
title: Region
Expand Down
Loading