Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: configure max prometheus samples per request #412

Merged
merged 1 commit into from
Dec 15, 2023

Conversation

akvlad
Copy link
Collaborator

@akvlad akvlad commented Dec 15, 2023

Introduced new env var parameter: ADVANCED_PROMETHEUS_MAX_SAMPLES
it's an advanced parameter to set max samples per a promql request.
by default it's 5000000
according to #411 and maybe #410

Copy link

Workflow Telemetry - QRYN CI / build (20)

Workflow telemetry for commit 7b13146fcbcf2e2be997c083d418a214919849fb
You can access workflow job details here

Step Trace

gantt
	title build (20)
	dateFormat x
	axisFormat %H:%M:%S
	Set up job : milestone, 1702652429000, 1702652431000
	Initialize containers : 1702652431000, 1702652441000
	Run actions/checkout@v4 : 1702652442000, 1702652442000
	Use Node.js 20 : 1702652443000, 1702652445000
	Run npm install : 1702652445000, 1702652454000
	Run npm run postinstall : 1702652454000, 1702652454000
	Run git submodule init : 1702652454000, 1702652454000
	Run git submodule update : 1702652454000, 1702652455000
	Workflow Telemetry : 1702652456000, 1702652456000

Loading

CPU Metrics

chart_stacked_area_time_d7bb8e50-22ca-4315-887b-5567485bd5fd

Memory Metrics

chart_stacked_area_time_8d216807-9768-4674-99fe-9214e0644dee

IO Metrics

Read Write
Network I/O chart_line_time_d25cc4b6-a16c-4ef8-961b-875a6a4a62c1 chart_line_time_b310bb83-eac1-485c-afc0-0490cfeaec24
Disk I/O chart_line_time_f3ed6354-9519-4883-984e-e58482e49088 chart_line_time_a7fc621c-dd2f-4b1e-8e25-d1c3cf975dac

Process Trace

Top 100 processes with highest duration

gantt
	title build (20)
	dateFormat x
	axisFormat %H:%M:%S
	jest : 1702652456469, 1702652484339
	node : 1702652456469, 1702652484339
	node : 1702652456636, 1702652456682
	find : 1702652456977, 1702652456978
	find : 1702652456984, 1702652457231
	node : 1702652457248, 1702652457357
	node : 1702652457253, 1702652457363
	node : 1702652457256, 1702652457359
	node : 1702652457378, 1702652484295
	node : 1702652457381, 1702652484292
	node : 1702652457384, 1702652484302
	node : 1702652457477, 1702652457508
	node : 1702652457478, 1702652457539
	node : 1702652457483, 1702652457536

Loading

Copy link

Workflow Telemetry - QRYN CI / build (20)

Workflow telemetry for commit 7b13146fcbcf2e2be997c083d418a214919849fb
You can access workflow job details here

Step Trace

gantt
	title build (20)
	dateFormat x
	axisFormat %H:%M:%S
	Set up job : milestone, 1702652430000, 1702652431000
	Run actions/checkout@v4 : 1702652431000, 1702652432000
	Use Node.js 20 : 1702652433000, 1702652435000
	Run npm install : 1702652435000, 1702652443000
	Run npm run postinstall : 1702652444000, 1702652444000
	Run git submodule init : 1702652444000, 1702652444000
	Run git submodule update : 1702652444000, 1702652445000
	Run docker-compose -f docker/e2e/docker-compose-cluster.yaml up -d : 1702652445000, 1702652457000
	Run sleep 5 : 1702652458000, 1702652462000
	Workflow Telemetry : 1702652463000, 1702652463000
	Run node qryn.mjs >/dev/stdout & : 1702652463000, 1702652468000
	Run npm run test --forceExit : 1702652468000, 1702652497000

Loading

CPU Metrics

chart_stacked_area_time_28ae3ef2-3271-40fc-863d-c9a7a94ff630

Memory Metrics

chart_stacked_area_time_87378576-3c87-417c-b916-88a729157957

IO Metrics

Read Write
Network I/O chart_line_time_f9671294-1e2b-4eec-88d6-040faadf6432 chart_line_time_90378415-7ee8-4a6b-8e9e-ee876a7b91ea
Disk I/O chart_line_time_8524c506-1d77-4aef-8803-3d988163a7f2 chart_line_time_538b994d-f2a1-4284-bb64-b6b4864227e2

Process Trace

Top 100 processes with highest duration

gantt
	title build (20)
	dateFormat x
	axisFormat %H:%M:%S
	bash : 1702652463127, 1702652463128
	bash : 1702652468146, 1702652497157
	npm : 1702652468148, 1702652497153
	node : 1702652468148, 1702652497153
	jest : 1702652468385, 1702652497149
	node : 1702652468385, 1702652497149
	node : 1702652468538, 1702652468571
	find : 1702652468765, 1702652468766
	find : 1702652468771, 1702652468942
	node : 1702652468961, 1702652469057
	node : 1702652468965, 1702652469056
	node : 1702652468968, 1702652469055
	node : 1702652469075, 1702652497095
	node : 1702652469078, 1702652497099
	node : 1702652469081, 1702652497106
	node : 1702652469162, 1702652469217
	node : 1702652469178, 1702652469216
	node : 1702652469183, 1702652469219

Loading

Copy link

Workflow Telemetry - QRYN CI / build (18)

Workflow telemetry for commit 7b13146fcbcf2e2be997c083d418a214919849fb
You can access workflow job details here

Step Trace

gantt
	title build (18)
	dateFormat x
	axisFormat %H:%M:%S
	Set up job : milestone, 1702652429000, 1702652431000
	Initialize containers : 1702652431000, 1702652443000
	Run actions/checkout@v4 : 1702652443000, 1702652444000
	Use Node.js 18 : 1702652444000, 1702652448000
	Run npm install : 1702652448000, 1702652460000
	Run npm run postinstall : 1702652460000, 1702652461000
	Run git submodule init : 1702652461000, 1702652461000
	Run git submodule update : 1702652461000, 1702652462000
	Workflow Telemetry : 1702652462000, 1702652462000

Loading

CPU Metrics

chart_stacked_area_time_1905ab4c-5ad1-4b1e-83c4-1576beb7268b

Memory Metrics

chart_stacked_area_time_0ddee27a-7f7e-45ca-a53c-ccbec48ea8df

IO Metrics

Read Write
Network I/O chart_line_time_0604377f-80ce-4da1-8121-0007fbed5a00 chart_line_time_ee72d10c-9f87-42cb-8842-255dcd450444
Disk I/O chart_line_time_e62f9de2-027a-4582-b901-96afd0b308d3 chart_line_time_4800a0e1-ea8b-41e2-89ea-98ea00a622a1

Process Trace

Top 100 processes with highest duration

gantt
	title build (18)
	dateFormat x
	axisFormat %H:%M:%S
	bash : 1702652462761, 1702652491816
	npm : 1702652462763, 1702652491811
	node : 1702652462763, 1702652491811
	jest : 1702652463125, 1702652491807
	node : 1702652463125, 1702652491807
	node : 1702652463300, 1702652463340
	find : 1702652463664, 1702652463665
	find : 1702652463670, 1702652463908
	node : 1702652463938, 1702652464062
	node : 1702652463943, 1702652464066
	node : 1702652463946, 1702652464062
	node : 1702652464093, 1702652491756
	node : 1702652464096, 1702652491759
	node : 1702652464099, 1702652491762
	node : 1702652464182, 1702652464223
	node : 1702652464201, 1702652464248
	node : 1702652464206, 1702652464237

Loading

Copy link

Workflow Telemetry - QRYN CI / build (16.x)

Workflow telemetry for commit 7b13146fcbcf2e2be997c083d418a214919849fb
You can access workflow job details here

Step Trace

gantt
	title build (16.x)
	dateFormat x
	axisFormat %H:%M:%S
	Set up job : milestone, 1702652430000, 1702652432000
	Initialize containers : 1702652432000, 1702652444000
	Run actions/checkout@v4 : 1702652444000, 1702652445000
	Use Node.js 16.x : 1702652445000, 1702652449000
	Run npm install : 1702652449000, 1702652459000
	Run npm run postinstall : 1702652459000, 1702652459000
	Run git submodule init : 1702652459000, 1702652459000
	Run git submodule update : 1702652460000, 1702652461000
	Workflow Telemetry : 1702652461000, 1702652461000

Loading

CPU Metrics

chart_stacked_area_time_7ed54664-e986-4664-9ebd-b34f7ce26872

Memory Metrics

chart_stacked_area_time_b2c1002f-3ea7-447d-9c20-79be7dc0255c

IO Metrics

Read Write
Network I/O chart_line_time_7d9be1ef-57aa-4607-9865-84ae74873a1a chart_line_time_6d0ac281-e74d-48f9-9964-af023fa14536
Disk I/O chart_line_time_0981dc6e-76c1-4e9d-8c2d-e4cd04d1e659 chart_line_time_fa342346-2997-49fa-aebb-198880a5502e

Process Trace

Top 100 processes with highest duration

gantt
	title build (16.x)
	dateFormat x
	axisFormat %H:%M:%S
	bash : 1702652461620, 1702652491647
	npm : 1702652461622, 1702652491642
	node : 1702652461622, 1702652491642
	jest : 1702652461960, 1702652491637
	node : 1702652461960, 1702652491637
	node : 1702652462129, 1702652462178
	find : 1702652462518, 1702652462519
	find : 1702652462529, 1702652462883
	node : 1702652462927, 1702652463152
	node : 1702652462936, 1702652463139
	node : 1702652462949, 1702652463140
	node : 1702652463212, 1702652491572
	node : 1702652463233, 1702652491578
	node : 1702652463249, 1702652491608
	node : 1702652463367, 1702652463420
	node : 1702652463500, 1702652463641
	node : 1702652463501, 1702652463625

Loading

Copy link

Workflow Telemetry - QRYN CI / build (16.x)

Workflow telemetry for commit 7b13146fcbcf2e2be997c083d418a214919849fb
You can access workflow job details here

Step Trace

gantt
	title build (16.x)
	dateFormat x
	axisFormat %H:%M:%S
	Set up job : milestone, 1702652430000, 1702652432000
	Run actions/checkout@v4 : 1702652432000, 1702652433000
	Use Node.js 16.x : 1702652433000, 1702652435000
	Run npm install : 1702652435000, 1702652445000
	Run npm run postinstall : 1702652445000, 1702652445000
	Run git submodule init : 1702652445000, 1702652445000
	Run git submodule update : 1702652446000, 1702652446000
	Run docker-compose -f docker/e2e/docker-compose-cluster.yaml up -d : 1702652447000, 1702652459000
	Run sleep 5 : 1702652459000, 1702652464000
	Workflow Telemetry : 1702652464000, 1702652464000
	Run node qryn.mjs >/dev/stdout & : 1702652465000, 1702652469000
	Run npm run test --forceExit : 1702652470000, 1702652499000

Loading

CPU Metrics

chart_stacked_area_time_5b0b1e3c-bf91-48dc-be5d-97f417e48292

Memory Metrics

chart_stacked_area_time_6293c23d-185e-4bfc-b5da-d6b20a211363

IO Metrics

Read Write
Network I/O chart_line_time_f27c642f-f0c5-4d8d-8148-7dbccabe539b chart_line_time_bcb257e7-5ec5-44ef-853e-eff74df8620e
Disk I/O chart_line_time_717029ac-90b0-4ab9-a1f9-bd08ab1087b8 chart_line_time_d8d42af4-d76a-4357-b75e-6ddd98586619

Process Trace

Top 100 processes with highest duration

gantt
	title build (16.x)
	dateFormat x
	axisFormat %H:%M:%S
	bash : 1702652464887, 1702652464888
	bash : 1702652469907, 1702652499931
	npm : 1702652469909, 1702652499927
	node : 1702652469909, 1702652499927
	jest : 1702652470194, 1702652499924
	node : 1702652470194, 1702652499924
	node : 1702652470367, 1702652470404
	find : 1702652470640, 1702652470641
	find : 1702652470648, 1702652470820
	node : 1702652470842, 1702652470934
	node : 1702652470848, 1702652470935
	node : 1702652470854, 1702652470934
	node : 1702652470959, 1702652499879
	node : 1702652470965, 1702652499878
	node : 1702652470971, 1702652499896
	node : 1702652471044, 1702652471088
	node : 1702652471073, 1702652471117
	node : 1702652471077, 1702652471123

Loading

Copy link

Workflow Telemetry - QRYN CI / build (18)

Workflow telemetry for commit 7b13146fcbcf2e2be997c083d418a214919849fb
You can access workflow job details here

Step Trace

gantt
	title build (18)
	dateFormat x
	axisFormat %H:%M:%S
	Set up job : milestone, 1702652431000, 1702652432000
	Run actions/checkout@v4 : 1702652432000, 1702652433000
	Use Node.js 18 : 1702652433000, 1702652435000
	Run npm install : 1702652436000, 1702652448000
	Run npm run postinstall : 1702652449000, 1702652449000
	Run git submodule init : 1702652449000, 1702652449000
	Run git submodule update : 1702652449000, 1702652450000
	Run docker-compose -f docker/e2e/docker-compose-cluster.yaml up -d : 1702652450000, 1702652462000
	Run sleep 5 : 1702652462000, 1702652467000
	Workflow Telemetry : 1702652467000, 1702652467000
	Run node qryn.mjs >/dev/stdout & : 1702652468000, 1702652472000

Loading

CPU Metrics

chart_stacked_area_time_9bccf840-a0cc-4717-9701-61758eb591e7

Memory Metrics

chart_stacked_area_time_74effa52-930d-4f3f-8b64-e7a42881c85b

IO Metrics

Read Write
Network I/O chart_line_time_6f50d203-4ecb-499f-87bc-cf71aadbeb5e chart_line_time_8d690cb7-3613-4ff0-bb1f-9df4399334d2
Disk I/O chart_line_time_c7dc39c5-156b-49ff-9d5d-194fb277be7f chart_line_time_091924fb-f08d-47c4-baad-18810a6e1c21

Process Trace

Top 100 processes with highest duration

gantt
	title build (18)
	dateFormat x
	axisFormat %H:%M:%S
	bash : 1702652472842, 1702652503056
	npm : 1702652472843, 1702652503052
	node : 1702652472843, 1702652503052
	jest : 1702652473141, 1702652503047
	node : 1702652473141, 1702652503047
	node : 1702652473342, 1702652473378
	find : 1702652473587, 1702652473588
	find : 1702652473593, 1702652473763
	node : 1702652473782, 1702652473868
	node : 1702652473786, 1702652473867
	node : 1702652473789, 1702652473869
	node : 1702652473889, 1702652502993
	node : 1702652473892, 1702652503004
	node : 1702652473895, 1702652503004
	node : 1702652473980, 1702652474024
	node : 1702652474005, 1702652474049
	node : 1702652474006, 1702652474037

Loading

@akvlad akvlad merged commit dad17e0 into master Dec 15, 2023
10 checks passed
@akvlad akvlad deleted the max_prometheus_samples branch December 15, 2023 15:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant