bring in prometheus/parquet-common code to new package (#11490)

* bring in prometheus/parquet-common code to new package; replace efficient-go errors with pkg/errors; satisfy mimir-prometheus ChunkSeries interface

* revert breaking upgrade to thanos/objstore

* fix test require

* attempt to update go version for strange errors

* fix stringlabels issues

* update license headers with AGPL and upstream attribution

* fix errors.Is lints

fix errors.Is lints

* fix sort and cancel cause lints

* correct go.mod & vendor in from main to solve conflicts

* use env var to flag parquet promql acceptance

* fix deps from main again

* fix deps from main again

* fix deps from main again

* fix deps from main again

implement new parquet-converter service (#11499)

* bring in parquet-converter from parquet-mimir PoC

* make docs

* make reference-help

* stop using the compactor's config

* remove BlockRanges config, convert all levels of blocks

* drop unused BlockWithExtension struct

* rename ownBlock to own

* move index fetch outside of for loop

* lowercase logs

* wording: compact => convert

* some cleanup

* skip blocks for which compaction mark failed download

* simplfy convertBlock function

* cleanup

* Write Compact Mark

* remove parquetIndex, we don't neeed it

yet at least

* use MetaFetcher to discover blocks

* make reference-help and mark as experimental

* cleanup: we don't need indexes anymore

* revert index loader changes

* basic TestParquetConverter

* make reference-help

* lint

* happy linter

* make docs

* fix: correctly initialize memerlist KV for  parquet converter

* lint: sort lines

* more wording fixes: compact => convert

* licence header

* version 1

* remove parquet-converter from 'backend' and 'all' modules

it's experimental and meant to be run alone

* address docs feedback

* remove unused consts

* increase timeout for a test

TestPartitionReader_ShouldNotMissRecordsIfKafkaReturnsAFetchBothWithAnErrorAndSomeRecords

parquet-converter: Introduce metrics and ring test (#11600)

* parquet-converter: Introduce metrics and ring test

This commit introduces a ring test to verify that sharding is working as
expected.

It also introduces metrics to measure total conversions, failures and
durations.

Signed-off-by: Jesus Vazquez <[email protected]>

converter: proper error handling to measure failures

parquet converter in docker compose (#11633)

* add parquet-converter to docker-compose microservices setup

* format jsonnet

fix(parquet converter): close TSDB block after conversion (#11635)

parquet: vendor back from parquet-common (#11644)

introduce store-gateway.parquet-enabled flag & docs (#11722)

upgrade prometheus parquet-common dependency (#11723)

parquet store-gateways introduce stores interface (#11724)

* declare Stores interface satisfied by BucketStores and future Parquet store

* add casts to for uses of existing impl which are not protected by interface

* stub out parquet bucket stores implementation

* most minimal initialization of Parquet Bucket Stores when flag is enabled

* license header

parquet: Scaffolding for parquet bucket store Series() (#11729)

* parquet: Scaffolding for parquet bucket store

* use parquetshardopener and be sure to close them

* gci pkg/storegateway/parquet_bucket_stores.go

Signed-off-by: Jesus Vazquez <[email protected]>

---------

Signed-off-by: Jesus Vazquez <[email protected]>

fix split between Parquet Stores and each tenant's Store (#11735)

fix split between Parquet Stores and each tenant's Store

parquet store-gateways blocks sync and  lazy reader (#11759)

parquet-bucket-store: finish implementing Stores interface (#11772)

We're trying to mirror the existing bucket store structure for the
parquet implementation and in this PR i'm just trying to implement some
of the necessary methods starting with building up the series sets for
labels calls.
- Series
- LabelNames
- LabelValues

---------

Signed-off-by: Jesus Vazquez <[email protected]>
Signed-off-by: Nicolás Pazos <[email protected]>
Co-authored-by: Nicolas Pazos <[email protected]>
Co-authored-by: Nicolás Pazos <[email protected]>

fix(parquet): share `ReaderPoolMetrics` instance (#11851)

We create multiple instances of `ReaderPool`, passing the registry and
creating the metrics on the fly causes panics.

fix(parquet store gateway): close things that should be closed (#11865)

feat(parquet store gateway): support download labels file without validating (#11866)

Signed-off-by: Nicolás Pazos <[email protected]>
Co-authored-by: francoposa <[email protected]>

fix(parquet store gateway): pass blockReader to bucket block constructor (#11875)

fix: don't stop nil services

fix(parquet store gateways): correctly locate labels parquet files locally (#11894)

parquet bucket store: add some debug logging (#11925)

Adding few log statements to the existing code path with useful
information to understand when and why we are returning 0 series.

Signed-off-by: Jesus Vazquez <[email protected]>

parquet store gateways: several fixes and basic tests  (#11929)

Co-authored-by: francoposa <[email protected]>
Co-authored-by: Jesus Vazquez <[email protected]>

parquet converter: include user id in converter counter metrics (#11966)

Adding user id to the converter metrics to better track converter
progress through tenants.

Signed-off-by: Jesus Vazquez <[email protected]>

Parquet converter: Implement priority queue for block conversion (#11980)

This PR redesigns the parquet converter to use a non-blocking priority
queue that prioritises recently uploaded blocks for conversion.

* Priority Queue Implementation:
- Replaces blocking nested loops with a thread-safe priority queue using
container/heap
- Blocks are prioritized by ULID timestamp, ensuring older blocks are
processed first
* Separate block discovery:
- There is a new discovery goroutine that periodically discovers users
and blocks, enqueuing them for processing
- If the block was previously processed it will be marked as converted
and skipped the next time its discovered.
- There is a new configuration flag `parquet-converter.max-block-age`
that allows us to have a rolling window of blocks so we dont queue up
all the work at once. We can set this to 30 days and only blocks up to
30 days old will be converted, when the work is completed we can go and
increase that window again.
- There is a new processing goroutine that continuously consumes from
the priority queue and converts blocks
- Main Loop remains responsive and handles only service lifecycle events
* New metrics
- Since we added a priority queue, I added 5 new metrics for queue
monitoring:
    - cortex_parquet_converter_queue_size - Current queue depth
- cortex_parquet_converter_queue_wait_time_seconds - Time blocks spend
queued
- cortex_parquet_converter_queue_items_enqueued_total - Total blocks
enqueued
- cortex_parquet_converter_queue_items_processed_total - Total blocks
processed
- cortex_parquet_converter_queue_items_dropped_total - Total blocks
dropped when queue closed

The idea here is that by looking at the queue metrics we can have an
idea of how much scaling up we need to deal with the pending work. Also,
before this PR we had no idea of how much work was left to be done but
now we will.

---------

Signed-off-by: Jesus Vazquez <[email protected]>

fix(parquet store gateway): obey query sharding matchers (#12018)

Inefficient, but at least correct query sharding. The new test on
sharding fails on the base branch.

It's not trivial to add caching to the hashes like the main path does,
because we don't have a `SeriesRef` to use as a cache key at the block
level (to match what the main path does). We could in theory use
something like the row number in the parquet file, but we don't have
easy access to that in this part of the code. In any case, the priority
right now is correctness, we'll work on optimizing later as appropriate.

For referece, see how query sharding is handled on the main path:
https://github.com/grafana/mimir/blob/604775d447c0a9e893fa6930ef8f2d403ebe6757/pkg/storegateway/series_refs.go#L1021-L1047

fix(parquet store gateway): panic in Series call with SkipChunks (#12020)

`chunksIt` is `nil` when `SkipChunks` is `true`.

parquet-converter debug log messages (#12021)

Co-authored-by: Jesus Vazquez <[email protected]>

chore(parquet): Bump parquet-common dependency (#12023)

Brings the last commit from parquet-common
[0811a700a852759c16799358b4424d9888afec3f](prometheus-community/parquet-common@0811a70)

See link for the diff between the two commits
prometheus-community/parquet-common@76512c6...0811a70

---------

Co-authored-by: francoposa <[email protected]>

feature(parquet): Implement store-gateway limits (#12040)

This PR is based on the upstream work
prometheus-community/parquet-common#81

The idea is to implement a set of basic quota limiters that can protect
us against potential bad queries for the gateways.

Note we had to bring bits of the code available in the querier in
upstream because we have our own chunk querier in Mimir.

---------

Signed-off-by: Jesus Vazquez <[email protected]>

Author: francoposa

cmd/mimir/config-descriptor.json

@@ -609,6 +609,12 @@ Usage of ./cmd/mimir/mimir:
     	How long to cache list of blocks for each tenant. (default 5m0s)
   -blocks-storage.bucket-store.metadata-cache.tenants-list-ttl duration
     	How long to cache list of tenants in the bucket. (default 15m0s)
+  -blocks-storage.bucket-store.parquet-max-chunk-size-bytes uint
+    	Maximum size in bytes that can be fetched from the parquet chunks file. If the size exceeds this value the query will stop with limit error.
+  -blocks-storage.bucket-store.parquet-max-data-size-bytes uint
+    	Maximum size in bytes that can be fetched from the parquet labels and chunks data files combined in a single query. If the size exceeds this value the query will stop with limit error.
+  -blocks-storage.bucket-store.parquet-max-row-count uint
+    	Maximum number of rows in a parquet file. If the number of rows exceeds this value the query will stop with limit error.
   -blocks-storage.bucket-store.partitioner-max-gap-bytes uint
     	Max size - in bytes - of a gap for which the partitioner aggregates together two bucket GET object requests. (default 524288)
   -blocks-storage.bucket-store.posting-offsets-in-mem-sampling int
@@ -2023,6 +2029,90 @@ Usage of ./cmd/mimir/mimir:
     	Maximum time to wait for ring stability at startup. If the overrides-exporter ring keeps changing after this period of time, it will start anyway. (default 5m0s)
   -overrides-exporter.ring.wait-stability-min-duration duration
     	Minimum time to wait for ring stability at startup, if set to positive value. Set to 0 to disable.
+  -parquet-converter.conversion-interval duration
+    	The frequency at which the conversion runs. (default 1m0s)
+  -parquet-converter.data-dir string
+    	Directory to temporarily store blocks during conversion. This directory is not required to persist between restarts. (default "./data-parquet-converter/")
+  -parquet-converter.disabled-tenants comma-separated-list-of-strings
+    	Comma-separated list of tenants that cannot have their TSDB blocks converted into Parquet. If specified, and the Parquet-converter would normally pick a given tenant to convert the blocks to Parquet (via -parquet-converter.enabled-tenants or sharding), it is ignored instead.
+  -parquet-converter.discovery-interval duration
+    	The frequency at which user and block discovery runs. (default 5m0s)
+  -parquet-converter.enabled-tenants comma-separated-list-of-strings
+    	Comma-separated list of tenants that can have their TSDB blocks converted into Parquet. If specified, the Parquet-converter only converts these tenants. Otherwise, it converts all tenants. Subject to sharding.
+  -parquet-converter.max-block-age duration
+    	Maximum age of blocks to convert. Blocks older than this will be skipped. Set to 0 to disable age filtering.
+  -parquet-converter.ring.consul.acl-token string
+    	ACL Token used to interact with Consul.
+  -parquet-converter.ring.consul.cas-retry-delay duration
+    	Maximum duration to wait before retrying a Compare And Swap (CAS) operation. (default 1s)
+  -parquet-converter.ring.consul.client-timeout duration
+    	HTTP timeout when talking to Consul (default 20s)
+  -parquet-converter.ring.consul.consistent-reads
+    	Enable consistent reads to Consul.
+  -parquet-converter.ring.consul.hostname string
+    	Hostname and port of Consul. (default "localhost:8500")
+  -parquet-converter.ring.consul.watch-burst-size int
+    	Burst size used in rate limit. Values less than 1 are treated as 1. (default 1)
+  -parquet-converter.ring.consul.watch-rate-limit float
+    	Rate limit when watching key or prefix in Consul, in requests per second. 0 disables the rate limit. (default 1)
+  -parquet-converter.ring.etcd.dial-timeout duration
+    	The dial timeout for the etcd connection. (default 10s)
+  -parquet-converter.ring.etcd.endpoints string
+    	The etcd endpoints to connect to.
+  -parquet-converter.ring.etcd.max-retries int
+    	The maximum number of retries to do for failed ops. (default 10)
+  -parquet-converter.ring.etcd.password string
+    	Etcd password.
+  -parquet-converter.ring.etcd.tls-ca-path string
+    	Path to the CA certificates to validate server certificate against. If not set, the host's root CA certificates are used.
+  -parquet-converter.ring.etcd.tls-cert-path string
+    	Path to the client certificate, which will be used for authenticating with the server. Also requires the key path to be configured.
+  -parquet-converter.ring.etcd.tls-cipher-suites string
+    	Override the default cipher suite list (separated by commas).
+  -parquet-converter.ring.etcd.tls-enabled
+    	Enable TLS.
+  -parquet-converter.ring.etcd.tls-insecure-skip-verify
+    	Skip validating server certificate.
+  -parquet-converter.ring.etcd.tls-key-path string
+    	Path to the key for the client certificate. Also requires the client certificate to be configured.
+  -parquet-converter.ring.etcd.tls-min-version string
+    	Override the default minimum TLS version. Allowed values: VersionTLS10, VersionTLS11, VersionTLS12, VersionTLS13
+  -parquet-converter.ring.etcd.tls-server-name string
+    	Override the expected name on the server certificate.
+  -parquet-converter.ring.etcd.username string
+    	Etcd username.
+  -parquet-converter.ring.heartbeat-period duration
+    	Period at which to heartbeat to the ring. 0 = disabled. (default 15s)
+  -parquet-converter.ring.heartbeat-timeout duration
+    	The heartbeat timeout after which parquet-converters are considered unhealthy within the ring. 0 = never (timeout disabled). (default 1m0s)
+  -parquet-converter.ring.instance-addr string
+    	IP address to advertise in the ring. Default is auto-detected.
+  -parquet-converter.ring.instance-enable-ipv6
+    	Enable using a IPv6 instance address. (default false)
+  -parquet-converter.ring.instance-id string
+    	Instance ID to register in the ring. (default "<hostname>")
+  -parquet-converter.ring.instance-interface-names string
+    	List of network interface names to look up when finding the instance IP address. (default [<private network interfaces>])
+  -parquet-converter.ring.instance-port int
+    	Port to advertise in the ring (defaults to -server.grpc-listen-port).
+  -parquet-converter.ring.multi.mirror-enabled
+    	Mirror writes to secondary store.
+  -parquet-converter.ring.multi.mirror-timeout duration
+    	Timeout for storing value to secondary store. (default 2s)
+  -parquet-converter.ring.multi.primary string
+    	Primary backend storage used by multi-client.
+  -parquet-converter.ring.multi.secondary string
+    	Secondary backend storage used by multi-client.
+  -parquet-converter.ring.prefix string
+    	The prefix for the keys in the store. Should end with a /. (default "parquet-converters/")
+  -parquet-converter.ring.store string
+    	Backend storage to use for the ring. Supported values are: consul, etcd, inmemory, memberlist, multi. (default "memberlist")
+  -parquet-converter.ring.wait-active-instance-timeout duration
+    	Timeout for waiting on Parquet-converter to become ACTIVE in the ring. (default 10m0s)
+  -parquet-converter.ring.wait-stability-max-duration duration
+    	Maximum time to wait for ring stability at startup. If the Parquet-converter ring keeps changing after this period of time, the Parquet-converter starts anyway. (default 5m0s)
+  -parquet-converter.ring.wait-stability-min-duration duration
+    	Minimum time to wait for ring stability at startup. Set to 0 to disable.
   -print.config
     	Print the config and exit.
   -querier.active-series-results-max-size-bytes int
@@ -3253,6 +3343,8 @@ Usage of ./cmd/mimir/mimir:
     	[experimental] Multiple of the default replication factor that should be used for recent blocks. Minimum value is 2 (default 5)
   -store-gateway.enabled-tenants comma-separated-list-of-strings
     	Comma separated list of tenants that can be loaded by the store-gateway. If specified, only blocks for these tenants will be loaded by the store-gateway, otherwise all tenants can be loaded. Subject to sharding.
+  -store-gateway.parquet-enabled
+    	[experimental] Whether to query Parquet files for block instead of the native Prometheus TSDB files.
   -store-gateway.sharding-ring.auto-forget-enabled
     	[deprecated] When enabled, a store-gateway is automatically removed from the ring after failing to heartbeat the ring for a period longer than the configured -store-gateway.sharding-ring.auto-forget-unhealthy-periods times the configured -store-gateway.sharding-ring.heartbeat-timeout. This setting is deprecated. Set -store-gateway.sharding-ring.auto-forget-unhealthy-periods to 0 to disable auto-forget. (default true)
   -store-gateway.sharding-ring.auto-forget-unhealthy-periods int

cmd/mimir/help-all.txt.tmpl

@@ -551,6 +551,26 @@ Usage of ./cmd/mimir/mimir:
     	List of network interface names to look up when finding the instance IP address. (default [<private network interfaces>])
   -overrides-exporter.ring.store string
     	Backend storage to use for the ring. Supported values are: consul, etcd, inmemory, memberlist, multi. (default "memberlist")
+  -parquet-converter.conversion-interval duration
+    	The frequency at which the conversion runs. (default 1m0s)
+  -parquet-converter.data-dir string
+    	Directory to temporarily store blocks during conversion. This directory is not required to persist between restarts. (default "./data-parquet-converter/")
+  -parquet-converter.discovery-interval duration
+    	The frequency at which user and block discovery runs. (default 5m0s)
+  -parquet-converter.max-block-age duration
+    	Maximum age of blocks to convert. Blocks older than this will be skipped. Set to 0 to disable age filtering.
+  -parquet-converter.ring.consul.hostname string
+    	Hostname and port of Consul. (default "localhost:8500")
+  -parquet-converter.ring.etcd.endpoints string
+    	The etcd endpoints to connect to.
+  -parquet-converter.ring.etcd.password string
+    	Etcd password.
+  -parquet-converter.ring.etcd.username string
+    	Etcd username.
+  -parquet-converter.ring.instance-interface-names string
+    	List of network interface names to look up when finding the instance IP address. (default [<private network interfaces>])
+  -parquet-converter.ring.store string
+    	Backend storage to use for the ring. Supported values are: consul, etcd, inmemory, memberlist, multi. (default "memberlist")
   -print.config
     	Print the config and exit.
   -querier.cardinality-analysis-enabled

cmd/mimir/help.txt.tmpl

@@ -32,6 +32,9 @@ std.manifestYamlDoc({
 
     // If true, a query-tee instance with a single backend is started.
     enable_query_tee: false,
+
+    // If true, start parquet-converter
+    enable_parquet: false,
   },
 
   // We explicitely list all important services here, so that it's easy to disable them by commenting out.
@@ -41,6 +44,7 @@ std.manifestYamlDoc({
     self.read_components +  // querier, query-frontend, and query-scheduler.
     self.store_gateways(3) +
     self.compactor +
+    (if $._config.enable_parquet then self.parquet_converter else {}) +
     self.rulers(2) +
     self.alertmanagers(3) +
     self.nginx +
@@ -128,6 +132,14 @@ std.manifestYamlDoc({
     }),
   },
 
+  parquet_converter:: {
+    'parquet-converter': mimirService({
+      name: 'parquet-converter',
+      target: 'parquet-converter',
+      httpPort: 8040,
+    }),
+  },
+
   rulers(count):: if count <= 0 then {} else {
     ['ruler-%d' % id]: mimirService({
       name: 'ruler-' + id,
@@ -156,6 +168,8 @@ std.manifestYamlDoc({
       target: 'store-gateway',
       httpPort: 8010 + id,
       jaegerApp: 'store-gateway-%d' % id,
+      extraArguments:
+        if $._config.enable_parquet then '-store-gateway.parquet-enabled=true' else '',
     })
     for id in std.range(1, count)
   },

development/mimir-microservices-mode/docker-compose.jsonnet

@@ -451,6 +451,124 @@ overrides_exporter:
   # CLI flag: -overrides-exporter.enabled-metrics
   [enabled_metrics: <string> | default = "ingestion_rate,ingestion_burst_size,max_global_series_per_user,max_global_series_per_metric,max_global_exemplars_per_user,max_fetched_chunks_per_query,max_fetched_series_per_query,max_fetched_chunk_bytes_per_query,ruler_max_rules_per_rule_group,ruler_max_rule_groups_per_tenant"]
 
+parquet_converter:
+  # (advanced) Comma-separated list of tenants that can have their TSDB blocks
+  # converted into Parquet. If specified, the Parquet-converter only converts
+  # these tenants. Otherwise, it converts all tenants. Subject to sharding.
+  # CLI flag: -parquet-converter.enabled-tenants
+  [enabled_tenants: <string> | default = ""]
+
+  # (advanced) Comma-separated list of tenants that cannot have their TSDB
+  # blocks converted into Parquet. If specified, and the Parquet-converter would
+  # normally pick a given tenant to convert the blocks to Parquet (via
+  # -parquet-converter.enabled-tenants or sharding), it is ignored instead.
+  # CLI flag: -parquet-converter.disabled-tenants
+  [disabled_tenants: <string> | default = ""]
+
+  # Directory to temporarily store blocks during conversion. This directory is
+  # not required to persist between restarts.
+  # CLI flag: -parquet-converter.data-dir
+  [data_dir: <string> | default = "./data-parquet-converter/"]
+
+  # The frequency at which the conversion runs.
+  # CLI flag: -parquet-converter.conversion-interval
+  [conversion_interval: <duration> | default = 1m]
+
+  # The frequency at which user and block discovery runs.
+  # CLI flag: -parquet-converter.discovery-interval
+  [discovery_interval: <duration> | default = 5m]
+
+  # Maximum age of blocks to convert. Blocks older than this will be skipped.
+  # Set to 0 to disable age filtering.
+  # CLI flag: -parquet-converter.max-block-age
+  [max_block_age: <duration> | default = 0s]
+
+  sharding_ring:
+    # The key-value store used to share the hash ring across multiple instances.
+    kvstore:
+      # Backend storage to use for the ring. Supported values are: consul, etcd,
+      # inmemory, memberlist, multi.
+      # CLI flag: -parquet-converter.ring.store
+      [store: <string> | default = "memberlist"]
+
+      # (advanced) The prefix for the keys in the store. Should end with a /.
+      # CLI flag: -parquet-converter.ring.prefix
+      [prefix: <string> | default = "parquet-converters/"]
+
+      # The consul block configures the consul client.
+      # The CLI flags prefix for this block configuration is:
+      # parquet-converter.ring
+      [consul: <consul>]
+
+      # The etcd block configures the etcd client.
+      # The CLI flags prefix for this block configuration is:
+      # parquet-converter.ring
+      [etcd: <etcd>]
+
+      multi:
+        # (advanced) Primary backend storage used by multi-client.
+        # CLI flag: -parquet-converter.ring.multi.primary
+        [primary: <string> | default = ""]
+
+        # (advanced) Secondary backend storage used by multi-client.
+        # CLI flag: -parquet-converter.ring.multi.secondary
+        [secondary: <string> | default = ""]
+
+        # (advanced) Mirror writes to secondary store.
+        # CLI flag: -parquet-converter.ring.multi.mirror-enabled
+        [mirror_enabled: <boolean> | default = false]
+
+        # (advanced) Timeout for storing value to secondary store.
+        # CLI flag: -parquet-converter.ring.multi.mirror-timeout
+        [mirror_timeout: <duration> | default = 2s]
+
+    # (advanced) Period at which to heartbeat to the ring. 0 = disabled.
+    # CLI flag: -parquet-converter.ring.heartbeat-period
+    [heartbeat_period: <duration> | default = 15s]
+
+    # (advanced) The heartbeat timeout after which parquet-converters are
+    # considered unhealthy within the ring. 0 = never (timeout disabled).
+    # CLI flag: -parquet-converter.ring.heartbeat-timeout
+    [heartbeat_timeout: <duration> | default = 1m]
+
+    # (advanced) Instance ID to register in the ring.
+    # CLI flag: -parquet-converter.ring.instance-id
+    [instance_id: <string> | default = "<hostname>"]
+
+    # List of network interface names to look up when finding the instance IP
+    # address.
+    # CLI flag: -parquet-converter.ring.instance-interface-names
+    [instance_interface_names: <list of strings> | default = [<private network interfaces>]]
+
+    # (advanced) Port to advertise in the ring (defaults to
+    # -server.grpc-listen-port).
+    # CLI flag: -parquet-converter.ring.instance-port
+    [instance_port: <int> | default = 0]
+
+    # (advanced) IP address to advertise in the ring. Default is auto-detected.
+    # CLI flag: -parquet-converter.ring.instance-addr
+    [instance_addr: <string> | default = ""]
+
+    # (advanced) Enable using a IPv6 instance address. (default false)
+    # CLI flag: -parquet-converter.ring.instance-enable-ipv6
+    [instance_enable_ipv6: <boolean> | default = false]
+
+    # (advanced) Minimum time to wait for ring stability at startup. Set to 0 to
+    # disable.
+    # CLI flag: -parquet-converter.ring.wait-stability-min-duration
+    [wait_stability_min_duration: <duration> | default = 0s]
+
+    # (advanced) Maximum time to wait for ring stability at startup. If the
+    # Parquet-converter ring keeps changing after this period of time, the
+    # Parquet-converter starts anyway.
+    # CLI flag: -parquet-converter.ring.wait-stability-max-duration
+    [wait_stability_max_duration: <duration> | default = 5m]
+
+    # (advanced) Timeout for waiting on Parquet-converter to become ACTIVE in
+    # the ring.
+    # CLI flag: -parquet-converter.ring.wait-active-instance-timeout
+    [wait_active_instance_timeout: <duration> | default = 10m]
+
 # The common block holds configurations that configure multiple components at a
 # time.
 [common: <common>]
@@ -3122,6 +3240,7 @@ The `etcd` block configures the etcd client. The supported CLI flags `<prefix>`
 - `ingester.ring`
 - `overrides-exporter.ring`
 - `querier.ring`
+- `parquet-converter.ring`
 - `query-scheduler.ring`
 - `ruler.ring`
 - `store-gateway.sharding-ring`
@@ -3228,6 +3347,7 @@ The `consul` block configures the consul client. The supported CLI flags `<prefi
 - `ingester.ring`
 - `overrides-exporter.ring`
 - `querier.ring`
+- `parquet-converter.ring`
 - `query-scheduler.ring`
 - `ruler.ring`
 - `store-gateway.sharding-ring`
@@ -5007,6 +5127,22 @@ bucket_store:
   # CLI flag: -blocks-storage.bucket-store.series-fetch-preference
   [series_fetch_preference: <float> | default = 0.75]
 
+  # (advanced) Maximum number of rows in a parquet file. If the number of rows
+  # exceeds this value the query will stop with limit error.
+  # CLI flag: -blocks-storage.bucket-store.parquet-max-row-count
+  [parquet_max_row_count: <int> | default = 0]
+
+  # (advanced) Maximum size in bytes that can be fetched from the parquet chunks
+  # file. If the size exceeds this value the query will stop with limit error.
+  # CLI flag: -blocks-storage.bucket-store.parquet-max-chunk-size-bytes
+  [parquet_max_chunk_size_bytes: <int> | default = 0]
+
+  # (advanced) Maximum size in bytes that can be fetched from the parquet labels
+  # and chunks data files combined in a single query. If the size exceeds this
+  # value the query will stop with limit error.
+  # CLI flag: -blocks-storage.bucket-store.parquet-max-data-size-bytes
+  [parquet_max_data_size_bytes: <int> | default = 0]
+
 tsdb:
   # Directory to store TSDBs (including WAL) in the ingesters. This directory is
   # required to be persisted between restarts.
@@ -5646,6 +5782,11 @@ dynamic_replication:
 # ignored instead.
 # CLI flag: -store-gateway.disabled-tenants
 [disabled_tenants: <string> | default = ""]
+
+# (experimental) Whether to query Parquet files for block instead of the native
+# Prometheus TSDB files.
+# CLI flag: -store-gateway.parquet-enabled
+[parquet_enabled: <boolean> | default = false]
 ```
 
 ### memcached