Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
71 commits
Select commit Hold shift + click to select a range
920d6ab
Table throttler: --throttler-config-via-topo now defaults to 'true'
shlomi-noach May 22, 2023
7c2ed12
add deprecation message
shlomi-noach May 23, 2023
018b680
endtoend tests: remove '--enable-lag-throttler' and use 'UpdateThrott…
shlomi-noach May 23, 2023
930fb2c
always use vtctldclient
shlomi-noach May 23, 2023
2903164
use cluster.VtctldClientProcess
shlomi-noach May 23, 2023
681e401
disable --throttler-config-via-topo in old throttler tests
shlomi-noach May 23, 2023
5aea00b
Remove --throttler-config-via-topo where used, since it now defaults …
shlomi-noach May 23, 2023
7e5b0fb
fix vreplication cluster setup, waiting for throttler config to apply
shlomi-noach May 23, 2023
3402fcc
changelog
shlomi-noach May 23, 2023
6b02492
extend throttler threshold
shlomi-noach May 23, 2023
e3b8dd1
a bit more verbose
shlomi-noach May 23, 2023
9bd46a2
fixed CLI test
shlomi-noach May 23, 2023
c6b9a21
remove old '--enable-lag-throttler' flag, introduce '--heartbeat_on_d…
shlomi-noach May 23, 2023
4c7a944
Merge branch 'main' into throttler-config-default-enable
shlomi-noach May 24, 2023
2979d00
more log info in throttler.Open()
shlomi-noach May 24, 2023
0890c75
more logging
shlomi-noach May 24, 2023
3c893c5
Merge branch 'throttler-config-default-enable' of github.com:planetsc…
shlomi-noach May 24, 2023
3d3f6b2
Revert to --heartbeat_enable
shlomi-noach May 30, 2023
cd2cc1b
Protect throttler config change application with initMutex
mattlord May 31, 2023
7c5b416
More CI testing
mattlord May 31, 2023
82b7385
CI testing cont
mattlord May 31, 2023
5854273
Yes...
mattlord May 31, 2023
5efdc96
Somebody doesn't like force pushes so msg here
mattlord May 31, 2023
5a60e39
Increase on-demand heartbeat duration from 10s to 1m
mattlord May 31, 2023
34e5dd8
Use only on-demand heartbeats everywhere
mattlord May 31, 2023
c420c4a
Use same throttler config everywhere
mattlord May 31, 2023
e03df30
Update all keyspaces and don't fail test on missing JSON keys
mattlord May 31, 2023
70570a5
Use constant heartbeats in vrepl e2e tests
mattlord May 31, 2023
dc7b397
Increase workflow command timeout
mattlord May 31, 2023
0fc37df
Don't wait for throttler on non-serving primaries
mattlord May 31, 2023
a02478d
Merge branch 'main' into throttler-config-default-enable
shlomi-noach Jun 1, 2023
11ca17a
https://github.com/vitessio/vitess/issues/13175 is fixed, therefore r…
shlomi-noach Jun 1, 2023
065fd16
Merge remote-tracking branch 'upstream/main' into throttler-config-de…
shlomi-noach Jun 1, 2023
f4d277d
Added ToC
shlomi-noach Jun 1, 2023
b7c0419
Merge branch 'main' into throttler-config-default-enable
shlomi-noach Jun 1, 2023
0de6a72
Tweak comment and kick CI
mattlord Jun 1, 2023
261b06a
Treat isOpen as the ready/running signal.
mattlord Jun 1, 2023
d9bfece
Re-adjust comment
mattlord Jun 1, 2023
d6a9f33
Adjust CheckIsReady() to match OnlineDDL's expectation/usage
mattlord Jun 1, 2023
bbbb351
Get rid of log messages from SrvKeyspaceWatcher when no node/key
mattlord Jun 1, 2023
48e71a5
More corrections/tweaks
mattlord Jun 1, 2023
9aef276
Use more convenient/clear new IsRunning function
mattlord Jun 1, 2023
fc12e4a
Revert "Use more convenient/clear new IsRunning function"
mattlord Jun 1, 2023
ba7aa05
Further fix correct use of IsOpen(), IsRunning(), IsEnabled()
shlomi-noach Jun 4, 2023
af0ea43
throttler.throttledApps cannot be nil
shlomi-noach Jun 4, 2023
04a4908
Remove --enable_lag_throttler flag
shlomi-noach Jun 5, 2023
b974eec
Deprecate --throttler_config_via_topo
shlomi-noach Jun 5, 2023
a085d55
remove throttler mitigation code, as the problem was solved in https:…
shlomi-noach Jun 5, 2023
0f5f4d1
deperecate throttler config flags
shlomi-noach Jun 5, 2023
a7fea0c
Removed tabletmanager_throttler and tabletmanager_throttler_custom_co…
shlomi-noach Jun 5, 2023
ba7e3c6
resolved conflict
shlomi-noach Jun 6, 2023
5893434
changelog
shlomi-noach Jun 6, 2023
fafed16
remove EnableThrottler() call
shlomi-noach Jun 6, 2023
f29a548
restore default value
shlomi-noach Jun 7, 2023
f478e6c
update threshold
shlomi-noach Jun 7, 2023
96f2572
resolved conflict
shlomi-noach Jun 8, 2023
6f3a057
update flags desc
shlomi-noach Jun 8, 2023
37d445a
resolved conflict
shlomi-noach Jun 14, 2023
1db2301
resolved conflict
shlomi-noach Jun 15, 2023
29847bb
resolved conflict
shlomi-noach Jun 29, 2023
ce6b94c
using atomic.Bool
shlomi-noach Jul 5, 2023
3fb71de
Update changelog/18.0/18.0.0/summary.md
shlomi-noach Jul 5, 2023
d460cdc
Merge branch 'throttler-deprecate-flags' of github.com:planetscale/vi…
shlomi-noach Jul 5, 2023
bc9027e
use MarkDeprecated
shlomi-noach Jul 5, 2023
1fc2595
resolved conflict
shlomi-noach Jul 5, 2023
01324bb
do not expect flags in vttablet --help
shlomi-noach Jul 5, 2023
391f20f
remove --throttler-config-via-topo from examples scripts
shlomi-noach Jul 5, 2023
15b6a28
resolved conflict
shlomi-noach Jul 6, 2023
c3bfcb2
Merge branch 'main' into throttler-deprecate-flags
shlomi-noach Jul 12, 2023
8260ce4
resolved conflict
shlomi-noach Jul 13, 2023
acde739
resolved conflict
shlomi-noach Jul 13, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
139 changes: 0 additions & 139 deletions .github/workflows/cluster_endtoend_tabletmanager_throttler.yml

This file was deleted.

This file was deleted.

12 changes: 12 additions & 0 deletions changelog/18.0/18.0.0/summary.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@
- **[VTAdmin](#vtadmin)**
- [Updated to node v18.16.0](#update-node)
- **[Deprecations and Deletions](#deprecations-and-deletions)**
- [Deprecated Flags](#deprecated-flags)
- [Deleted `k8stopo`](#deleted-k8stopo)
- [Deleted `vtgr`](#deleted-vtgr)
- **[New stats](#new-stats)**
Expand Down Expand Up @@ -39,6 +40,17 @@ here https://nodejs.org/en/blog/release/v18.16.0.

### <a id="deprecations-and-deletions"/>Deprecations and Deletions

#### <a id="deprecated-flags"/>Deprecated Command Line Flags

Throttler related `vttablet` flags:

- `--enable-lag-throttler` is now removed after being deprecated in `v17.0`
- `--throttle_threshold` is deprecated and will be removed in `v19.0`
- `--throttle_metrics_query` is deprecated and will be removed in `v19.0`
- `--throttle_metrics_threshold` is deprecated and will be removed in `v19.0`
- `--throttle_check_as_check_self` is deprecated and will be removed in `v19.0`
- `--throttler-config-via-topo` is deprecated after asummed `true` in `v17.0`. It will be removed in a future version.

#### <a id="deleted-k8stopo"/>Deleted `k8stopo`

The `k8stopo` has been deprecated in Vitess 17, also see https://github.com/vitessio/vitess/issues/13298. With Vitess 18
Expand Down
5 changes: 4 additions & 1 deletion examples/common/scripts/vttablet-up.sh
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,10 @@ vttablet \
--service_map 'grpc-queryservice,grpc-tabletmanager,grpc-updatestream' \
--pid_file $VTDATAROOT/$tablet_dir/vttablet.pid \
--vtctld_addr http://$hostname:$vtctld_web_port/ \
--throttler-config-via-topo --heartbeat_enable --heartbeat_interval=250ms --heartbeat_on_demand_duration=5s \
--disable_active_reparents \
--heartbeat_enable \
--heartbeat_interval=250ms \
--heartbeat_on_demand_duration=5s \
> $VTDATAROOT/$tablet_dir/vttablet.out 2>&1 &

# Block waiting for the tablet to be listening
Expand Down
7 changes: 0 additions & 7 deletions go/flags/endtoend/vttablet.txt
Original file line number Diff line number Diff line change
Expand Up @@ -99,14 +99,12 @@ Usage of vttablet:
--emit_stats If set, emit stats to push-based monitoring and stats backends
--enable-consolidator Synonym to -enable_consolidator (default true)
--enable-consolidator-replicas Synonym to -enable_consolidator_replicas
--enable-lag-throttler Synonym to -enable_lag_throttler
--enable-per-workload-table-metrics If true, query counts and query error metrics include a label that identifies the workload
--enable-tx-throttler Synonym to -enable_tx_throttler
--enable_consolidator This option enables the query consolidator. (default true)
--enable_consolidator_replicas This option enables the query consolidator only on replicas.
--enable_hot_row_protection If true, incoming transactions for the same row (range) will be queued and cannot consume all txpool slots.
--enable_hot_row_protection_dry_run If true, hot row protection is not enforced but logs if transactions would have been queued.
--enable_lag_throttler If true, vttablet will run a throttler service, and will implicitly enable heartbeats
--enable_replication_reporter Use polling to track replication lag.
--enable_transaction_limit If true, limit on number of transactions open at the same time will be enforced for all users. User trying to open a new transaction after exhausting their limit will receive an error immediately, regardless of whether there are available slots or not.
--enable_transaction_limit_dry_run If true, limit on number of transactions open at the same time will be tracked for all users, but not enforced.
Expand Down Expand Up @@ -313,12 +311,7 @@ Usage of vttablet:
--tablet_manager_grpc_server_name string the server name to use to validate server certificate
--tablet_manager_protocol string Protocol to use to make tabletmanager RPCs to vttablets. (default "grpc")
--tablet_protocol string Protocol to use to make queryservice RPCs to vttablets. (default "grpc")
--throttle_check_as_check_self Should throttler/check return a throttler/check-self result (changes throttler behavior for writes)
--throttle_metrics_query SELECT Override default heartbeat/lag metric. Use either SELECT (must return single row, single value) or `SHOW GLOBAL ... LIKE ...` queries. Set -throttle_metrics_threshold respectively.
--throttle_metrics_threshold float Override default throttle threshold, respective to --throttle_metrics_query (default 1.7976931348623157e+308)
--throttle_tablet_types string Comma separated VTTablet types to be considered by the throttler. default: 'replica'. example: 'replica,rdonly'. 'replica' aways implicitly included (default "replica")
--throttle_threshold duration Replication lag threshold for default lag throttling (default 1s)
--throttler-config-via-topo When 'true', read config from topo service and ignore throttle_threshold, throttle_metrics_threshold, throttle_metrics_query, throttle_check_as_check_self (default true)
--topo_consul_lock_delay duration LockDelay for consul session. (default 15s)
--topo_consul_lock_session_checks string List of checks for consul session. (default "serfHealth")
--topo_consul_lock_session_ttl string TTL for consul session.
Expand Down
Loading