Skip to content

Commit

Permalink
Merge branch 'v-WIP/24.3' into DOC-677
Browse files Browse the repository at this point in the history
  • Loading branch information
JakeSCahill authored Dec 2, 2024
2 parents e4ab7ab + 1232e88 commit 293bdcd
Showing 1 changed file with 195 additions and 1 deletion.
196 changes: 195 additions & 1 deletion modules/reference/pages/properties/cluster-properties.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -770,6 +770,24 @@ The percentage of available memory in the transform subsystem to use for write b

---

=== datalake_coordinator_snapshot_max_delay_secs

Maximum amount of time the coordinator waits to snapshot after a command appears in the log.

*Unit*: seconds

*Requires restart:* No

*Visibility:* `tunable`

*Type:* integer

*Accepted values:* [`-17179869184`, `17179869183`]

*Default:* `900`

---

=== debug_bundle_auto_removal_seconds

If set, how long debug bundles are kept in the debug bundle storage directory after they are created. If not set, debug bundles are kept indefinitely.
Expand Down Expand Up @@ -1522,6 +1540,66 @@ A list of supported HTTP authentication mechanisms.

---

=== iceberg_catalog_base_location

Base path for the object storage backed Iceberg catalog. After Iceberg is enabled, do not change this value.

*Requires restart:* Yes

*Visibility:* `user`

*Type:* string

*Default:* `redpanda-iceberg-catalog`

---

=== iceberg_catalog_commit_interval_ms

The frequency at which the Iceberg coordinator commits topic files to the catalog. This is the interval between commit transactions across all topics monitored by the coordinator, not the interval between individual commits.

*Unit:* milliseconds

*Requires restart:* No

*Visibility:* `tunable`

*Type:* integer

*Accepted values:* [`-17592186044416`, `17592186044415`]

*Default:* `60000`

---

=== iceberg_catalog_type

Iceberg catalog type that Redpanda will use to commit table metadata updates. Supported types: 'rest', 'object_storage'.

*Requires restart:* Yes

*Visibility:* `user`

*Accepted values:* `rest`, `object_storage`

*Default:* `object_storage`

---

=== iceberg_delete

Default value for the `redpanda.iceberg.delete` topic property that determines if the corresponding Iceberg table is deleted upon deleting the topic.

*Requires restart:* No

*Visibility:* `user`

*Type:* boolean

*Default:* `true`

---

=== iceberg_enabled

Enables the translation of topic data into Iceberg tables. Setting `iceberg_enabled` to `true` activates the feature at the cluster level, but each topic must also set the `redpanda.iceberg.enabled` topic-level property to `true` to use it. If `iceberg_enabled` is set to `false`, then the feature is disabled for all topics in the cluster, overriding any topic-level settings.
Expand All @@ -1536,6 +1614,122 @@ Enables the translation of topic data into Iceberg tables. Setting `iceberg_enab

---

=== iceberg_rest_catalog_client_id

Iceberg REST catalog user ID. This ID is used to query the catalog API for the OAuth token. Required if catalog type is set to `rest`.

*Requires restart:* Yes

*Visibility:* `user`

*Type:* string

*Default:* `null`

---

=== iceberg_rest_catalog_client_secret

Secret to authenticate against Iceberg REST catalog. Required if catalog type is set to `rest`.

*Requires restart:* Yes

*Visibility:* `user`

*Type:* string

*Default:* `null`

---

=== iceberg_rest_catalog_crl_file

Path to certificate revocation list for `iceberg_rest_catalog_trust_file`.

*Requires restart:* Yes

*Visibility:* `user`

*Type:* string

*Default:* `null`

---

=== iceberg_rest_catalog_endpoint

URL of Iceberg REST catalog endpoint.

*Requires restart:* Yes

*Visibility:* `user`

*Type:* string

*Default:* `null`

---

=== iceberg_rest_catalog_prefix

Prefix part of the Iceberg REST catalog URL. Prefix is appended to the catalog path, for example `/v1/{prefix}/namespaces`.

*Requires restart:* Yes

*Visibility:* `user`

*Type:* string

*Default:* `null`

---

=== iceberg_rest_catalog_request_timeout_ms

Maximum length of time that Redpanda waits for a response from the REST catalog before aborting the request.

*Unit:* milliseconds

*Requires restart:* No

*Visibility:* `tunable`

*Type:* integer

*Accepted values:* [`-17592186044416`, `17592186044415`]

*Default:* `10000`

---

=== iceberg_rest_catalog_token

Token used to access the REST Iceberg catalog. If the token is present, Redpanda ignores credentials stored in the properties <<iceberg_rest_catalog_client_id,`iceberg_rest_catalog_client_id`>> and <<iceberg_rest_catalog_client_secret,`iceberg_rest_catalog_client_secret`>>.

*Requires restart:* Yes

*Visibility:* `user`

*Type:* string

*Default:* `null`

---

=== iceberg_rest_catalog_trust_file

Path to a file containing a certificate chain to trust for the REST Iceberg catalog.

*Requires restart:* Yes

*Visibility:* `user`

*Type:* string

*Default:* `null`

---

=== id_allocator_batch_size

The ID allocator allocates messages in batches (each batch is a one log record) and then serves requests from memory without touching the log until the batch is exhausted.
Expand Down Expand Up @@ -4193,7 +4387,7 @@ The maximum number of connections a broker will open to each of its peers.

*Accepted values:* [`-2147483648`, `2147483647`]

*Default:* `32`
*Default:* `128`

---

Expand Down

0 comments on commit 293bdcd

Please sign in to comment.