Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[opt](paimon)Add suppressed information display #48947

Merged
merged 2 commits into from
Mar 13, 2025

Conversation

wuwenchi
Copy link
Contributor

What problem does this PR solve?

Problem Summary:

Some important error messages may be suppressed after caused. If you only look at the caused information, it may be misleading, so the suppressed information is also displayed so that you can have more error information to locate the problem.

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Mar 12, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@wuwenchi
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32135 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit edc342dd72fc546e35f598aa5dd7946991b0e57d, data reload: false

------ Round 1 ----------------------------------
q1	17679	5337	5037	5037
q2	2046	282	165	165
q3	10506	1295	725	725
q4	10236	1045	515	515
q5	7577	2386	2359	2359
q6	195	166	135	135
q7	903	749	610	610
q8	9293	1280	1078	1078
q9	4967	4851	4521	4521
q10	6828	2331	1882	1882
q11	462	281	257	257
q12	345	354	217	217
q13	17809	3688	3047	3047
q14	242	218	212	212
q15	536	478	481	478
q16	616	617	595	595
q17	554	868	342	342
q18	6867	6381	6344	6344
q19	1265	948	543	543
q20	308	325	192	192
q21	2808	2176	1903	1903
q22	1080	1009	978	978
Total cold run time: 103122 ms
Total hot run time: 32135 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5126	5096	5096	5096
q2	242	326	227	227
q3	2203	2671	2290	2290
q4	1453	1834	1370	1370
q5	4223	4130	4193	4130
q6	208	165	124	124
q7	1911	1940	1806	1806
q8	2653	2699	2585	2585
q9	7301	7143	7202	7143
q10	3003	3246	2791	2791
q11	578	506	481	481
q12	660	769	607	607
q13	3509	3848	3350	3350
q14	287	289	276	276
q15	541	488	481	481
q16	636	688	639	639
q17	1136	1594	1352	1352
q18	7740	7546	7486	7486
q19	804	892	898	892
q20	1960	1995	1936	1936
q21	5410	4969	4949	4949
q22	1116	1106	1016	1016
Total cold run time: 52700 ms
Total hot run time: 51027 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185047 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit edc342dd72fc546e35f598aa5dd7946991b0e57d, data reload: false

query1	1028	386	379	379
query2	6532	1884	1888	1884
query3	6797	215	216	215
query4	26194	23518	23296	23296
query5	4380	669	474	474
query6	308	203	182	182
query7	4598	496	306	306
query8	296	238	239	238
query9	8628	2638	2627	2627
query10	489	318	245	245
query11	15329	15161	14902	14902
query12	148	106	107	106
query13	1657	515	409	409
query14	8717	6410	6449	6410
query15	213	191	173	173
query16	7252	640	459	459
query17	1219	705	567	567
query18	1944	421	310	310
query19	197	191	162	162
query20	121	119	114	114
query21	215	123	101	101
query22	4177	4158	4055	4055
query23	33773	33091	32833	32833
query24	7957	2356	2328	2328
query25	524	446	384	384
query26	1057	269	150	150
query27	2561	484	321	321
query28	4254	2445	2385	2385
query29	682	548	425	425
query30	282	222	187	187
query31	934	855	768	768
query32	72	65	64	64
query33	541	355	301	301
query34	788	836	503	503
query35	808	810	730	730
query36	959	969	887	887
query37	119	96	77	77
query38	4117	4189	4123	4123
query39	1428	1419	1403	1403
query40	208	113	99	99
query41	66	62	55	55
query42	122	98	100	98
query43	478	504	466	466
query44	1263	786	783	783
query45	178	167	160	160
query46	824	1017	616	616
query47	1779	1808	1722	1722
query48	375	408	294	294
query49	760	517	414	414
query50	685	744	403	403
query51	4149	4188	4130	4130
query52	106	104	95	95
query53	242	251	183	183
query54	508	493	416	416
query55	84	83	78	78
query56	253	254	241	241
query57	1109	1150	1076	1076
query58	236	236	234	234
query59	2687	2817	2469	2469
query60	276	286	254	254
query61	121	119	120	119
query62	811	715	668	668
query63	236	186	188	186
query64	3859	989	665	665
query65	4424	4331	4369	4331
query66	1063	418	300	300
query67	15811	15550	15314	15314
query68	8216	866	501	501
query69	478	288	267	267
query70	1187	1036	1100	1036
query71	447	290	261	261
query72	5941	3638	3788	3638
query73	796	739	352	352
query74	9052	9105	9056	9056
query75	3784	3217	2694	2694
query76	3609	1177	738	738
query77	780	353	278	278
query78	9901	10196	9359	9359
query79	2859	821	576	576
query80	685	523	432	432
query81	466	257	221	221
query82	585	126	97	97
query83	205	170	152	152
query84	334	96	76	76
query85	779	355	307	307
query86	334	320	317	317
query87	4343	4654	4319	4319
query88	2937	2251	2239	2239
query89	398	318	279	279
query90	1940	210	209	209
query91	138	137	107	107
query92	76	63	56	56
query93	1243	1046	580	580
query94	687	408	311	311
query95	393	267	256	256
query96	478	554	278	278
query97	3381	3374	3250	3250
query98	214	209	201	201
query99	1469	1376	1252	1252
Total cold run time: 272143 ms
Total hot run time: 185047 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.24 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit edc342dd72fc546e35f598aa5dd7946991b0e57d, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.04
query3	0.23	0.06	0.06
query4	1.63	0.10	0.10
query5	0.56	0.55	0.54
query6	1.19	0.72	0.71
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.52	0.52
query10	0.57	0.62	0.59
query11	0.15	0.11	0.11
query12	0.14	0.12	0.11
query13	0.61	0.61	0.60
query14	2.78	2.84	2.70
query15	0.92	0.86	0.86
query16	0.38	0.38	0.37
query17	1.04	1.07	1.02
query18	0.21	0.19	0.20
query19	1.95	1.89	2.00
query20	0.02	0.00	0.02
query21	15.39	0.92	0.54
query22	0.77	1.09	0.65
query23	15.04	1.40	0.63
query24	6.85	1.14	1.95
query25	0.55	0.30	0.15
query26	0.49	0.15	0.13
query27	0.05	0.05	0.04
query28	10.51	0.85	0.42
query29	12.58	3.99	3.28
query30	0.26	0.08	0.06
query31	2.82	0.59	0.39
query32	3.23	0.55	0.47
query33	3.03	3.10	3.01
query34	15.61	5.11	4.54
query35	4.60	4.58	4.52
query36	0.67	0.49	0.49
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.04	0.03	0.02
query40	0.16	0.13	0.12
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.02
Total cold run time: 106.07 s
Total hot run time: 31.24 s

@wuwenchi
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32790 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 519cd6736a649703f78d810a7b8247cd3f00551c, data reload: false

------ Round 1 ----------------------------------
q1	17587	5196	5030	5030
q2	2056	292	173	173
q3	10419	1255	773	773
q4	10213	1019	554	554
q5	7532	2398	2392	2392
q6	189	160	132	132
q7	914	759	617	617
q8	9330	1295	1143	1143
q9	4880	4798	4855	4798
q10	6835	2306	1895	1895
q11	472	279	297	279
q12	346	352	220	220
q13	17780	3722	3096	3096
q14	233	251	215	215
q15	548	490	477	477
q16	631	640	586	586
q17	593	876	357	357
q18	6771	6505	6358	6358
q19	1996	983	577	577
q20	327	332	201	201
q21	2941	2154	1942	1942
q22	1029	1035	975	975
Total cold run time: 103622 ms
Total hot run time: 32790 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5254	5210	5144	5144
q2	243	329	226	226
q3	2177	2690	2317	2317
q4	1467	1856	1333	1333
q5	4246	4150	4230	4150
q6	205	161	121	121
q7	1964	1925	1769	1769
q8	2607	2634	2628	2628
q9	7283	7177	7220	7177
q10	3100	3234	2779	2779
q11	578	507	479	479
q12	641	711	585	585
q13	3502	4087	3373	3373
q14	278	293	278	278
q15	533	505	506	505
q16	680	707	660	660
q17	1159	1617	1342	1342
q18	7751	7675	7522	7522
q19	807	840	988	840
q20	1993	2048	1930	1930
q21	5527	4884	4802	4802
q22	1102	1112	1006	1006
Total cold run time: 53097 ms
Total hot run time: 50966 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191845 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 519cd6736a649703f78d810a7b8247cd3f00551c, data reload: false

query1	1396	1003	1003	1003
query2	6203	1889	1910	1889
query3	11004	4500	4438	4438
query4	26529	23667	23358	23358
query5	4877	668	478	478
query6	296	201	188	188
query7	3986	526	295	295
query8	306	262	241	241
query9	8537	2635	2599	2599
query10	494	310	262	262
query11	15472	15075	14971	14971
query12	173	115	105	105
query13	1573	518	408	408
query14	9237	6277	6730	6277
query15	218	193	171	171
query16	7576	655	501	501
query17	1195	728	573	573
query18	2007	417	311	311
query19	191	204	159	159
query20	127	144	121	121
query21	207	118	112	112
query22	4437	4563	4308	4308
query23	34192	33589	33324	33324
query24	7240	2426	2423	2423
query25	544	472	418	418
query26	815	273	159	159
query27	2553	487	331	331
query28	4077	2457	2442	2442
query29	641	561	452	452
query30	279	223	197	197
query31	922	913	803	803
query32	80	68	62	62
query33	578	349	299	299
query34	803	879	521	521
query35	804	850	785	785
query36	972	1014	901	901
query37	118	99	76	76
query38	4280	4238	4294	4238
query39	1480	1437	1420	1420
query40	206	117	105	105
query41	51	52	50	50
query42	125	106	108	106
query43	557	515	480	480
query44	1318	815	794	794
query45	192	177	170	170
query46	864	1028	640	640
query47	1834	1840	1807	1807
query48	414	419	325	325
query49	748	505	429	429
query50	702	740	424	424
query51	4378	4371	4376	4371
query52	106	107	95	95
query53	233	267	198	198
query54	500	507	412	412
query55	84	80	85	80
query56	268	271	244	244
query57	1180	1163	1099	1099
query58	247	249	271	249
query59	2663	2811	2644	2644
query60	300	285	271	271
query61	123	116	118	116
query62	796	728	671	671
query63	226	188	192	188
query64	3429	1037	691	691
query65	4511	4470	4444	4444
query66	782	406	301	301
query67	16620	15505	15127	15127
query68	8184	879	514	514
query69	486	287	261	261
query70	1180	1140	1129	1129
query71	441	300	328	300
query72	5129	3571	3707	3571
query73	718	732	355	355
query74	8984	9086	9007	9007
query75	3752	3219	2656	2656
query76	3516	1176	743	743
query77	788	363	362	362
query78	9875	10101	9222	9222
query79	2803	827	586	586
query80	591	509	449	449
query81	470	259	216	216
query82	653	122	95	95
query83	163	171	156	156
query84	241	96	74	74
query85	795	356	381	356
query86	327	301	265	265
query87	4592	4470	4364	4364
query88	3624	2276	2273	2273
query89	421	318	286	286
query90	1878	209	212	209
query91	149	138	108	108
query92	69	56	58	56
query93	1499	1060	574	574
query94	668	408	304	304
query95	353	271	259	259
query96	483	564	278	278
query97	3342	3423	3226	3226
query98	223	204	197	197
query99	1307	1413	1244	1244
Total cold run time: 277580 ms
Total hot run time: 191845 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.29 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 519cd6736a649703f78d810a7b8247cd3f00551c, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.04
query3	0.23	0.07	0.07
query4	1.62	0.10	0.11
query5	0.57	0.57	0.57
query6	1.19	0.72	0.73
query7	0.03	0.02	0.02
query8	0.04	0.03	0.04
query9	0.60	0.51	0.51
query10	0.60	0.60	0.58
query11	0.15	0.11	0.10
query12	0.14	0.11	0.12
query13	0.61	0.60	0.61
query14	2.79	2.68	2.72
query15	0.93	0.87	0.84
query16	0.37	0.39	0.38
query17	1.02	1.04	1.03
query18	0.21	0.19	0.20
query19	1.91	1.82	1.99
query20	0.02	0.01	0.01
query21	15.36	0.90	0.56
query22	0.75	1.19	0.61
query23	14.98	1.40	0.62
query24	6.73	2.10	1.21
query25	0.47	0.15	0.12
query26	0.54	0.17	0.13
query27	0.05	0.06	0.05
query28	9.91	0.87	0.43
query29	12.53	4.01	3.31
query30	0.26	0.09	0.06
query31	2.81	0.61	0.39
query32	3.23	0.55	0.46
query33	3.01	3.04	3.06
query34	15.76	5.18	4.53
query35	4.54	4.59	4.53
query36	0.66	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.14	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.22 s
Total hot run time: 31.29 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 12, 2025
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

@morningman morningman merged commit 30a10e6 into apache:master Mar 13, 2025
28 of 30 checks passed
github-actions bot pushed a commit that referenced this pull request Mar 13, 2025
### What problem does this PR solve?

Problem Summary:

Some important error messages may be suppressed after caused. If you
only look at the caused information, it may be misleading, so the
suppressed information is also displayed so that you can have more error
information to locate the problem.
github-actions bot pushed a commit that referenced this pull request Mar 13, 2025
### What problem does this PR solve?

Problem Summary:

Some important error messages may be suppressed after caused. If you
only look at the caused information, it may be misleading, so the
suppressed information is also displayed so that you can have more error
information to locate the problem.
morningman pushed a commit that referenced this pull request Mar 21, 2025
### What problem does this PR solve?

Problem Summary:

Some important error messages may be suppressed after caused. If you
only look at the caused information, it may be misleading, so the
suppressed information is also displayed so that you can have more error
information to locate the problem.
yiguolei pushed a commit that referenced this pull request Mar 21, 2025
dataroaring pushed a commit that referenced this pull request Mar 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.9-merged dev/3.0.5-merged reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants