Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](mtmv)Fix cancelled tasks with running status #39424

Merged
merged 1 commit into from
Aug 16, 2024

Conversation

zddr
Copy link
Contributor

@zddr zddr commented Aug 15, 2024

The state of writing the log first and changing it later resulted in the memory state being cancelled and the state after restarting being running

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zddr
Copy link
Contributor Author

zddr commented Aug 15, 2024

run buildall

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 15, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 38450 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 10980b55c3b0a465b7060c4ba205e8151af6e9d0, data reload: false

------ Round 1 ----------------------------------
q1	17878	4499	4335	4335
q2	2054	223	234	223
q3	11623	1143	1091	1091
q4	10523	719	833	719
q5	7825	2862	2830	2830
q6	272	158	160	158
q7	1014	650	641	641
q8	9408	2089	2107	2089
q9	7122	6539	6581	6539
q10	7082	2250	2201	2201
q11	487	272	282	272
q12	429	258	253	253
q13	18816	2993	2995	2993
q14	313	259	260	259
q15	570	531	520	520
q16	531	415	414	414
q17	993	733	773	733
q18	7302	6953	6827	6827
q19	6089	1036	1034	1034
q20	770	366	378	366
q21	3802	3034	2906	2906
q22	1149	1047	1068	1047
Total cold run time: 116052 ms
Total hot run time: 38450 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4666	4420	4416	4416
q2	417	319	314	314
q3	2887	2659	2711	2659
q4	2039	1720	1733	1720
q5	5733	5734	5671	5671
q6	253	154	159	154
q7	2206	1829	1792	1792
q8	3333	3552	3476	3476
q9	8837	8804	8807	8804
q10	3617	3393	3330	3330
q11	663	538	528	528
q12	866	738	728	728
q13	17317	3402	3318	3318
q14	332	329	302	302
q15	571	528	526	526
q16	538	489	500	489
q17	1942	1593	1575	1575
q18	8936	8229	7734	7734
q19	11516	1822	1744	1744
q20	3331	1911	1955	1911
q21	12112	5378	5273	5273
q22	1362	1066	1042	1042
Total cold run time: 93474 ms
Total hot run time: 57506 ms

@morrySnow
Copy link
Contributor

run performance

@doris-robot
Copy link

TPC-H: Total hot run time: 38208 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 10980b55c3b0a465b7060c4ba205e8151af6e9d0, data reload: false

------ Round 1 ----------------------------------
q1	17914	4490	4381	4381
q2	2068	212	215	212
q3	11865	1060	1084	1060
q4	10543	737	680	680
q5	7821	2867	2863	2863
q6	258	149	150	149
q7	981	626	639	626
q8	9362	2097	2092	2092
q9	7272	6561	6561	6561
q10	7069	2300	2239	2239
q11	475	270	262	262
q12	426	248	245	245
q13	18993	3021	3014	3014
q14	292	256	246	246
q15	550	500	493	493
q16	519	419	403	403
q17	985	719	767	719
q18	7535	6787	6848	6787
q19	7178	1002	1077	1002
q20	840	366	353	353
q21	4585	2836	2787	2787
q22	1138	1044	1034	1034
Total cold run time: 118669 ms
Total hot run time: 38208 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4564	4305	4278	4278
q2	408	295	295	295
q3	2853	2631	2774	2631
q4	2002	1696	1724	1696
q5	5674	5698	5661	5661
q6	266	158	158	158
q7	2204	1825	1818	1818
q8	3347	3593	3505	3505
q9	8848	8859	8805	8805
q10	3603	3408	3317	3317
q11	617	544	524	524
q12	831	691	673	673
q13	16379	3275	3241	3241
q14	316	301	295	295
q15	560	513	517	513
q16	510	444	455	444
q17	1844	1557	1533	1533
q18	8415	8000	7734	7734
q19	8158	1723	1737	1723
q20	2171	1899	1910	1899
q21	13446	5417	5403	5403
q22	1185	1098	1103	1098
Total cold run time: 88201 ms
Total hot run time: 57244 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195519 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 10980b55c3b0a465b7060c4ba205e8151af6e9d0, data reload: false

query1	1308	913	888	888
query2	6591	2035	1961	1961
query3	10747	4065	3882	3882
query4	58664	26597	23426	23426
query5	5953	633	623	623
query6	514	190	206	190
query7	6320	316	312	312
query8	459	364	360	360
query9	9131	2508	2497	2497
query10	565	313	334	313
query11	16049	15159	15412	15159
query12	182	128	123	123
query13	1619	425	444	425
query14	11864	7534	6567	6567
query15	267	196	207	196
query16	7499	503	552	503
query17	1189	622	616	616
query18	2144	346	345	345
query19	302	169	170	169
query20	153	133	132	132
query21	248	144	140	140
query22	4475	4232	4306	4232
query23	34555	33715	33850	33715
query24	5758	3098	3000	3000
query25	588	453	434	434
query26	716	188	184	184
query27	1845	300	311	300
query28	3808	2200	2203	2200
query29	755	459	484	459
query30	232	181	182	181
query31	997	886	851	851
query32	109	80	82	80
query33	554	351	356	351
query34	960	515	517	515
query35	906	786	794	786
query36	1105	1019	987	987
query37	162	103	108	103
query38	3939	3867	3801	3801
query39	1533	1478	1465	1465
query40	238	156	152	152
query41	138	137	137	137
query42	137	116	117	116
query43	542	507	524	507
query44	1144	788	798	788
query45	226	197	192	192
query46	1115	773	760	760
query47	1903	1840	1825	1825
query48	408	348	340	340
query49	937	590	584	584
query50	883	465	469	465
query51	6881	6734	6810	6734
query52	120	112	113	112
query53	297	227	226	226
query54	644	509	508	508
query55	90	91	87	87
query56	323	304	327	304
query57	1211	1138	1107	1107
query58	303	303	296	296
query59	3123	2677	2869	2677
query60	359	324	322	322
query61	153	143	143	143
query62	798	705	702	702
query63	262	230	231	230
query64	3299	1886	1880	1880
query65	3284	3160	3215	3160
query66	1042	676	676	676
query67	15294	14867	14916	14867
query68	5892	591	583	583
query69	583	319	317	317
query70	1272	1225	1207	1207
query71	513	332	332	332
query72	6823	2324	2084	2084
query73	893	362	359	359
query74	9337	8792	8837	8792
query75	3693	2766	2743	2743
query76	3326	1014	1043	1014
query77	843	443	456	443
query78	9990	9206	9076	9076
query79	6892	562	560	560
query80	2710	626	623	623
query81	619	260	257	257
query82	1102	164	158	158
query83	380	213	211	211
query84	291	95	97	95
query85	1296	363	394	363
query86	458	332	332	332
query87	4465	4312	4267	4267
query88	5091	2542	2551	2542
query89	451	345	333	333
query90	2045	232	237	232
query91	157	126	128	126
query92	85	73	75	73
query93	5576	560	561	560
query94	931	320	331	320
query95	396	305	305	305
query96	637	291	289	289
query97	3248	3121	3043	3043
query98	260	229	226	226
query99	1664	1286	1292	1286
Total cold run time: 331838 ms
Total hot run time: 195519 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.48 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 10980b55c3b0a465b7060c4ba205e8151af6e9d0, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.06	0.04
query4	1.67	0.08	0.08
query5	0.50	0.49	0.50
query6	1.12	0.72	0.72
query7	0.03	0.02	0.02
query8	0.05	0.05	0.05
query9	0.55	0.50	0.49
query10	0.56	0.55	0.56
query11	0.16	0.13	0.12
query12	0.16	0.13	0.12
query13	0.59	0.59	0.59
query14	0.78	0.81	0.78
query15	0.90	0.82	0.82
query16	0.37	0.37	0.39
query17	1.05	1.04	0.98
query18	0.24	0.22	0.22
query19	1.92	1.88	1.74
query20	0.01	0.01	0.02
query21	15.39	0.85	0.68
query22	4.43	6.79	2.28
query23	18.25	1.35	1.22
query24	2.22	0.22	0.22
query25	0.18	0.09	0.09
query26	0.31	0.21	0.21
query27	0.45	0.24	0.23
query28	13.23	1.04	1.02
query29	12.59	3.31	3.31
query30	0.37	0.18	0.18
query31	2.80	0.39	0.39
query32	3.27	0.49	0.50
query33	2.97	2.95	2.93
query34	17.06	4.42	4.36
query35	4.51	4.48	4.40
query36	0.67	0.48	0.49
query37	0.20	0.17	0.18
query38	0.18	0.17	0.17
query39	0.06	0.05	0.05
query40	0.17	0.15	0.14
query41	0.12	0.07	0.07
query42	0.07	0.07	0.06
query43	0.06	0.06	0.06
Total cold run time: 110.58 s
Total hot run time: 31.48 s

@morrySnow morrySnow merged commit ada5215 into apache:master Aug 16, 2024
29 of 31 checks passed
zddr added a commit to zddr/incubator-doris that referenced this pull request Aug 16, 2024
The state of writing the log first and changing it later resulted in the
memory state being cancelled and the state after restarting being
running
morrySnow pushed a commit that referenced this pull request Aug 16, 2024
dataroaring pushed a commit that referenced this pull request Aug 17, 2024
The state of writing the log first and changing it later resulted in the
memory state being cancelled and the state after restarting being
running
@yiguolei yiguolei mentioned this pull request Sep 5, 2024
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.2-merged reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants