Skip to content

Conversation

@graham-rp
Copy link
Contributor

@graham-rp graham-rp commented Sep 18, 2025

Categorize and sort topic configuration options

🔗 CONSOLE-131

The topic config options we know about are significantly out of date. This updates the set of options that we know about.

Currently the groups on the frontend are sorted arbitrarily by the order that we receive the current options in. This update allows us to specify a group ordering to help push common configuration groups towards the top of the page.

Before

Screenshot 2025-09-18 at 2 01 48 PM

After

Screenshot 2025-09-18 at 2 10 21 PM

The topic config options we know about are significantly
out of date. This updates the set of options that we know
about.

Currently the groups on the frontend are sorted arbitrarily
by the order that we receive the current options in. This
update allows us to specify a group ordering to help push
common configuration groups towards the top of the page.

* Backfill redpanda.iceberg topic config entries
@graham-rp graham-rp requested a review from weeco September 18, 2025 18:11
@graham-rp graham-rp self-assigned this Sep 18, 2025
@graham-rp graham-rp marked this pull request as ready for review September 18, 2025 18:24
Comment on lines +107 to +112
{
"name": "replication.factor",
"type": "INT",
"documentation": "The number of replicas of a topic to save in different nodes (brokers) of a cluster. If replication.factor is set to a positive value, it overrides the cluster property default_topic_replication for the topic.",
"category": "Replication"
},
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's not a topic config I think. I remember that Redpanda used to transmit this as a topic config, but we removed it eventually - since the Kafka API didn't expose it. Has this changed again? Maybe worth double checking.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@weeco weeco requested a review from kbatuigas September 18, 2025 18:51
@kbatuigas
Copy link
Contributor

@graham-rp @weeco Will these categories show up in the Cloud UI too? And pardon my ignorance but are the Kafka configs visible for anyone who has access to the topic config tab? Just checking because I see a few configs that we don't seem to have documented.

@graham-rp
Copy link
Contributor Author

@graham-rp @weeco Will these categories show up in the Cloud UI too? And pardon my ignorance but are the Kafka configs visible for anyone who has access to the topic config tab? Just checking because I see a few configs that we don't seem to have documented.

@kbatuigas I believe it's anything with access to the tab, but the actual options shown will depend on the underlying nodes. A good number of the options are specific to apache - do you have a list of ones we don't currently have documented?

@paulohtb6
Copy link

AFAIK the list on https://docs.redpanda.com/current/reference/properties/topic-properties/ are all topic properties supported by Redpanda.

We have a list of properties that are considered no-ops from Redpanda's perspective. We have agreed to not document them.
I created the list here
https://redpandadata.atlassian.net/browse/DOC-1647

On source, the list can be found here
https://github.com/redpanda-data/redpanda/blob/dev/src/v/kafka/server/handlers/topics/types.h#L140

Copying here for brevity

unclean.leader.election.enable
message.downconversion.enable
segment.index.bytes
segment.jitter.ms
min.insync.replicas
message.timestamp.difference.max.ms
message.format.version
leader.replication.throttled.replicas
index.interval.bytes
follower.replication.throttled.replicas
flush.messages
file.delete.delay.ms
preallocate

@graham-rp
Copy link
Contributor Author

AFAIK the list on https://docs.redpanda.com/current/reference/properties/topic-properties/ are all topic properties supported by Redpanda.

We have a list of properties that are considered no-ops from Redpanda's perspective. We have agreed to not document them. I created the list here https://redpandadata.atlassian.net/browse/DOC-1647

On source, the list can be found here https://github.com/redpanda-data/redpanda/blob/dev/src/v/kafka/server/handlers/topics/types.h#L140

Copying here for brevity

unclean.leader.election.enable
message.downconversion.enable
segment.index.bytes
segment.jitter.ms
min.insync.replicas
message.timestamp.difference.max.ms
message.format.version
leader.replication.throttled.replicas
index.interval.bytes
follower.replication.throttled.replicas
flush.messages
file.delete.delay.ms
preallocate

That makes perfect sense - these are there mainly to be grouped in the event that the node lists them (ie: apache). These shouldn't show up in practice in an RP environment.

@graham-rp
Copy link
Contributor Author

Add registry validation options per this docs PR:

Screenshot 2025-09-18 at 5 27 51 PM

@graham-rp graham-rp merged commit 5f3fce8 into master Sep 19, 2025
8 checks passed
@graham-rp graham-rp deleted the CONSOLE-131/update-missing-options branch September 19, 2025 12:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants