Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feat](nereids) add max/min filter push down rewrite rule #39252

Merged
merged 9 commits into from
Sep 4, 2024
Merged

[Feat](nereids) add max/min filter push down rewrite rule #39252

merged 9 commits into from
Sep 4, 2024

Conversation

feiniaofeiafei
Copy link
Contributor

@feiniaofeiafei feiniaofeiafei commented Aug 12, 2024 •
edited
Loading

add rewrite rule:
select id, max(a) from t group by id having max(a)>10;
->
select id, max(a) from t where a>10 group by id;
select id, min(a) from t group by id having min(a)<10;
->
select id, min(a) from t where a<10 group by id;

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@github-actions github-actions bot added the doing label Aug 12, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 39325 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3ee27dc543cb55dad17896ffae08d4522f74dea1, data reload: false

------ Round 1 ----------------------------------
q1	17620	4377	4280	4280
q2	2024	179	188	179
q3	10517	1190	1193	1190
q4	10312	786	692	692
q5	7556	2579	2581	2579
q6	227	141	142	141
q7	985	603	606	603
q8	9263	1903	1919	1903
q9	8984	6502	6532	6502
q10	7038	2226	2136	2136
q11	486	243	252	243
q12	400	225	213	213
q13	17756	2977	2992	2977
q14	274	246	227	227
q15	516	481	488	481
q16	500	399	383	383
q17	947	729	734	729
q18	7992	7464	7426	7426
q19	6735	1020	965	965
q20	666	334	336	334
q21	5453	4128	4336	4128
q22	1114	1017	1014	1014
Total cold run time: 117365 ms
Total hot run time: 39325 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4477	4227	4253	4227
q2	369	277	255	255
q3	2878	2658	2656	2656
q4	1895	1581	1606	1581
q5	5296	5280	5278	5278
q6	212	128	130	128
q7	2028	1682	1705	1682
q8	3140	3310	3299	3299
q9	8324	8332	8352	8332
q10	3405	3135	3132	3132
q11	577	487	491	487
q12	764	630	591	591
q13	17473	2962	2970	2962
q14	305	277	279	277
q15	510	477	482	477
q16	462	415	414	414
q17	1777	1482	1466	1466
q18	7608	7533	7313	7313
q19	1650	1595	1555	1555
q20	1977	1790	1784	1784
q21	5294	5083	5002	5002
q22	1111	1004	1035	1004
Total cold run time: 71532 ms
Total hot run time: 53902 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 200590 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3ee27dc543cb55dad17896ffae08d4522f74dea1, data reload: false

query1	920	369	354	354
query2	6449	1914	1824	1824
query3	6646	213	225	213
query4	28434	23146	23085	23085
query5	4184	484	499	484
query6	276	176	166	166
query7	4574	303	290	290
query8	253	190	187	187
query9	8468	2525	2506	2506
query10	636	472	474	472
query11	16322	15004	15012	15004
query12	145	100	95	95
query13	1652	386	365	365
query14	10251	6975	7652	6975
query15	269	218	206	206
query16	7680	506	521	506
query17	1773	582	559	559
query18	1793	293	284	284
query19	191	151	148	148
query20	112	108	105	105
query21	203	100	102	100
query22	4269	4036	4025	4025
query23	33895	33446	33248	33248
query24	11884	2679	2610	2610
query25	671	388	393	388
query26	1772	159	159	159
query27	2908	282	282	282
query28	7622	2064	2041	2041
query29	1112	432	427	427
query30	305	148	152	148
query31	965	766	734	734
query32	97	56	59	56
query33	743	303	290	290
query34	948	458	468	458
query35	971	806	841	806
query36	1078	874	960	874
query37	281	81	81	81
query38	4336	4219	4128	4128
query39	1483	1403	1396	1396
query40	273	123	120	120
query41	49	47	49	47
query42	119	99	99	99
query43	509	438	473	438
query44	1182	728	744	728
query45	241	214	210	210
query46	1085	734	764	734
query47	1826	1761	1776	1761
query48	380	305	300	300
query49	1197	442	435	435
query50	788	417	414	414
query51	6824	6740	6673	6673
query52	109	90	94	90
query53	252	187	179	179
query54	969	460	457	457
query55	81	78	75	75
query56	281	262	265	262
query57	1149	1065	1068	1065
query58	242	230	245	230
query59	2941	2676	2886	2676
query60	298	285	274	274
query61	123	119	115	115
query62	813	754	648	648
query63	221	182	178	178
query64	10499	2251	1723	1723
query65	3245	3120	3155	3120
query66	1327	342	334	334
query67	15554	14782	14846	14782
query68	8793	559	567	559
query69	472	418	437	418
query70	1408	1063	1030	1030
query71	568	271	280	271
query72	19754	16427	16368	16368
query73	2176	330	331	330
query74	9021	8667	8822	8667
query75	5363	2624	2661	2624
query76	5320	997	1041	997
query77	764	312	316	312
query78	9895	9106	9007	9007
query79	8863	517	527	517
query80	1339	496	533	496
query81	615	226	223	223
query82	761	139	134	134
query83	329	145	149	145
query84	277	80	76	76
query85	1365	275	273	273
query86	381	310	281	281
query87	4728	4607	4657	4607
query88	4697	2480	2507	2480
query89	528	280	290	280
query90	2011	194	197	194
query91	128	96	96	96
query92	65	50	49	49
query93	6630	537	531	531
query94	933	342	302	302
query95	350	265	262	262
query96	608	290	282	282
query97	3231	3083	3102	3083
query98	216	203	197	197
query99	1574	1253	1261	1253
Total cold run time: 332311 ms
Total hot run time: 200590 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.9 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3ee27dc543cb55dad17896ffae08d4522f74dea1, data reload: false

query1	0.05	0.04	0.04
query2	0.07	0.04	0.05
query3	0.23	0.05	0.06
query4	1.68	0.08	0.07
query5	0.53	0.51	0.50
query6	1.14	0.73	0.72
query7	0.02	0.01	0.01
query8	0.05	0.05	0.04
query9	0.55	0.50	0.49
query10	0.54	0.55	0.57
query11	0.16	0.12	0.12
query12	0.15	0.12	0.13
query13	0.59	0.59	0.58
query14	0.75	0.78	0.78
query15	0.86	0.81	0.81
query16	0.36	0.37	0.37
query17	1.06	1.01	1.03
query18	0.23	0.21	0.21
query19	1.83	1.67	1.69
query20	0.02	0.01	0.00
query21	15.41	0.72	0.65
query22	4.05	6.49	2.14
query23	18.67	1.37	1.30
query24	2.05	0.23	0.21
query25	0.15	0.09	0.07
query26	0.30	0.21	0.20
query27	0.46	0.23	0.22
query28	13.29	1.02	1.00
query29	12.56	3.31	3.31
query30	0.24	0.05	0.05
query31	2.88	0.40	0.38
query32	3.28	0.48	0.46
query33	2.90	2.92	2.86
query34	17.08	4.40	4.42
query35	4.45	4.48	4.41
query36	0.66	0.47	0.51
query37	0.20	0.16	0.15
query38	0.15	0.15	0.16
query39	0.04	0.03	0.04
query40	0.16	0.12	0.13
query41	0.09	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 110.05 s
Total hot run time: 30.9 s

@feiniaofeiafei
Copy link
Contributor Author

run buildall

1 similar comment
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39941 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b0a1a8ef9ada2f9ab07a8c4510cf653b37977ca3, data reload: false

------ Round 1 ----------------------------------
q1	17615	4399	4452	4399
q2	2017	177	178	177
q3	11788	1042	1124	1042
q4	10524	720	699	699
q5	7763	2821	2826	2821
q6	226	136	136	136
q7	939	591	606	591
q8	9513	2029	2042	2029
q9	10201	6524	6551	6524
q10	7029	2165	2188	2165
q11	459	243	246	243
q12	389	223	218	218
q13	17771	2981	2958	2958
q14	271	247	246	246
q15	520	478	484	478
q16	509	391	380	380
q17	954	724	672	672
q18	8038	7372	7368	7368
q19	7348	1038	1003	1003
q20	659	340	328	328
q21	5345	4440	4640	4440
q22	1125	1024	1030	1024
Total cold run time: 121003 ms
Total hot run time: 39941 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4575	4309	4283	4283
q2	372	278	265	265
q3	3025	2840	2779	2779
q4	2010	1737	1763	1737
q5	5596	5528	5593	5528
q6	232	135	141	135
q7	2131	1756	1767	1756
q8	3270	3441	3389	3389
q9	8689	8901	8729	8729
q10	3375	3213	3321	3213
q11	595	500	502	500
q12	820	613	626	613
q13	16306	3151	3181	3151
q14	310	313	285	285
q15	536	489	501	489
q16	510	443	443	443
q17	1801	1514	1530	1514
q18	8147	7982	7849	7849
q19	1883	1670	1567	1567
q20	2361	1901	1885	1885
q21	5491	5189	5487	5189
q22	1165	1026	1031	1026
Total cold run time: 73200 ms
Total hot run time: 56325 ms

@feiniaofeiafei feiniaofeiafei force-pushed the min_max_filter_rewrite branch from b0a1a8e to 5aa3d54 Compare August 14, 2024 13:29
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37433 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5aa3d5424bf54773d1f8d6c60a4aa9d978f8f368, data reload: false

------ Round 1 ----------------------------------
q1	17604	4865	4264	4264
q2	2016	178	177	177
q3	11779	997	1063	997
q4	10521	746	675	675
q5	7767	2801	2789	2789
q6	228	138	135	135
q7	961	596	601	596
q8	9531	2052	2072	2052
q9	8445	6530	6556	6530
q10	7016	2173	2250	2173
q11	456	237	245	237
q12	394	225	219	219
q13	17921	2968	2965	2965
q14	278	230	236	230
q15	530	487	482	482
q16	499	392	383	383
q17	961	689	735	689
q18	7397	6867	6745	6745
q19	7356	1085	1004	1004
q20	675	338	322	322
q21	3890	2803	2864	2803
q22	1093	1006	966	966
Total cold run time: 117318 ms
Total hot run time: 37433 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4599	4326	4304	4304
q2	389	283	268	268
q3	2828	2539	2556	2539
q4	1963	1651	1655	1651
q5	5672	5691	5537	5537
q6	235	134	134	134
q7	2147	1716	1762	1716
q8	3338	3517	3444	3444
q9	8773	8705	8771	8705
q10	3598	3293	3269	3269
q11	613	523	526	523
q12	825	615	587	587
q13	15859	3141	3201	3141
q14	330	288	304	288
q15	532	496	485	485
q16	502	442	437	437
q17	1833	1552	1524	1524
q18	8171	7954	8093	7954
q19	1820	1722	1658	1658
q20	2167	1904	1928	1904
q21	9853	5296	5383	5296
q22	1105	990	1041	990
Total cold run time: 77152 ms
Total hot run time: 56354 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189978 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5aa3d5424bf54773d1f8d6c60a4aa9d978f8f368, data reload: false

query1	1254	886	859	859
query2	6432	2062	2031	2031
query3	10642	3966	3661	3661
query4	59289	27151	23405	23405
query5	5977	476	473	473
query6	524	163	159	159
query7	6491	289	294	289
query8	307	209	228	209
query9	8893	2447	2432	2432
query10	524	282	275	275
query11	18028	15018	15379	15018
query12	163	100	100	100
query13	1623	391	379	379
query14	12031	7256	6780	6780
query15	234	177	176	176
query16	7733	494	489	489
query17	1158	577	576	576
query18	2143	315	314	314
query19	300	158	148	148
query20	121	110	110	110
query21	225	105	108	105
query22	4438	4207	4299	4207
query23	34168	33300	33191	33191
query24	5609	2856	2903	2856
query25	554	402	399	399
query26	700	159	157	157
query27	1827	276	279	276
query28	3760	2042	2041	2041
query29	724	422	432	422
query30	240	157	151	151
query31	917	762	730	730
query32	86	54	55	54
query33	480	296	286	286
query34	877	444	476	444
query35	829	720	719	719
query36	1070	927	918	918
query37	135	85	81	81
query38	3940	3801	3813	3801
query39	1452	1385	1399	1385
query40	209	121	116	116
query41	48	46	50	46
query42	120	97	96	96
query43	518	483	495	483
query44	1081	741	733	733
query45	203	168	166	166
query46	1088	727	729	727
query47	1838	1784	1751	1751
query48	363	291	290	290
query49	763	425	433	425
query50	808	412	419	412
query51	6773	6749	6603	6603
query52	98	95	87	87
query53	255	188	183	183
query54	576	452	545	452
query55	77	76	77	76
query56	257	243	240	240
query57	1141	1058	1059	1058
query58	218	223	237	223
query59	3084	2843	2876	2843
query60	295	261	259	259
query61	99	96	94	94
query62	737	638	633	633
query63	215	190	181	181
query64	4084	2197	3750	2197
query65	3231	3127	3131	3127
query66	710	334	339	334
query67	15327	15098	14785	14785
query68	8507	566	562	562
query69	691	379	317	317
query70	1442	1066	1145	1066
query71	536	294	271	271
query72	7060	2269	2021	2021
query73	1942	326	322	322
query74	9483	8695	8738	8695
query75	4862	2614	2663	2614
query76	4955	994	998	994
query77	792	311	303	303
query78	9955	9058	8999	8999
query79	11682	538	545	538
query80	1131	494	499	494
query81	594	224	231	224
query82	742	140	133	133
query83	377	145	144	144
query84	264	70	74	70
query85	922	263	269	263
query86	339	279	284	279
query87	4302	4245	4192	4192
query88	4697	2329	2321	2321
query89	524	283	292	283
query90	2285	201	195	195
query91	125	102	95	95
query92	63	50	56	50
query93	5608	542	529	529
query94	1144	277	295	277
query95	349	260	267	260
query96	604	270	274	270
query97	3214	3014	3069	3014
query98	238	202	200	200
query99	1535	1288	1257	1257
Total cold run time: 341078 ms
Total hot run time: 189978 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.12 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5aa3d5424bf54773d1f8d6c60a4aa9d978f8f368, data reload: false

query1	0.05	0.04	0.04
query2	0.07	0.04	0.03
query3	0.23	0.06	0.05
query4	1.66	0.08	0.07
query5	0.50	0.48	0.48
query6	1.14	0.73	0.72
query7	0.02	0.01	0.02
query8	0.04	0.04	0.05
query9	0.55	0.50	0.48
query10	0.54	0.55	0.52
query11	0.15	0.12	0.12
query12	0.16	0.12	0.12
query13	0.61	0.59	0.58
query14	0.78	0.79	0.77
query15	0.86	0.82	0.81
query16	0.35	0.36	0.38
query17	0.98	1.04	0.98
query18	0.22	0.22	0.21
query19	1.82	1.74	1.67
query20	0.03	0.02	0.01
query21	15.42	0.77	0.67
query22	4.03	6.78	2.33
query23	18.27	1.44	1.26
query24	2.12	0.23	0.22
query25	0.15	0.09	0.09
query26	0.30	0.22	0.22
query27	0.45	0.23	0.23
query28	13.26	1.03	1.00
query29	12.64	3.45	3.39
query30	0.24	0.05	0.04
query31	2.90	0.39	0.39
query32	3.26	0.50	0.48
query33	2.95	2.93	2.96
query34	16.95	4.32	4.33
query35	4.42	4.42	4.47
query36	0.65	0.47	0.47
query37	0.19	0.17	0.17
query38	0.16	0.15	0.14
query39	0.04	0.04	0.04
query40	0.15	0.12	0.12
query41	0.09	0.04	0.04
query42	0.07	0.05	0.05
query43	0.04	0.04	0.03
Total cold run time: 109.51 s
Total hot run time: 31.12 s

@feiniaofeiafei feiniaofeiafei force-pushed the min_max_filter_rewrite branch from 45435a6 to 2dcaaee Compare August 15, 2024 02:56
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37800 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2dcaaee44c91ecb251337135cba98a674fb29a5a, data reload: false

------ Round 1 ----------------------------------
q1	17616	4366	4343	4343
q2	2018	189	173	173
q3	10459	1187	1164	1164
q4	10139	728	758	728
q5	7753	2801	2744	2744
q6	226	137	137	137
q7	954	603	597	597
q8	9314	2002	2045	2002
q9	7220	6492	6540	6492
q10	7061	2255	2158	2158
q11	471	249	244	244
q12	394	219	219	219
q13	17777	2998	2972	2972
q14	282	238	239	238
q15	531	513	491	491
q16	503	385	390	385
q17	975	659	660	659
q18	7476	6783	6785	6783
q19	3172	1097	1050	1050
q20	695	316	338	316
q21	3776	3009	2906	2906
q22	1095	999	1000	999
Total cold run time: 109907 ms
Total hot run time: 37800 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4388	4238	4278	4238
q2	381	270	268	268
q3	2849	2682	2584	2584
q4	1903	1625	1597	1597
q5	5407	5462	5563	5462
q6	238	137	138	137
q7	2151	1794	1760	1760
q8	3299	3396	3455	3396
q9	8745	8719	8860	8719
q10	3574	3305	3239	3239
q11	595	516	520	516
q12	845	632	661	632
q13	17558	3016	3184	3016
q14	314	284	304	284
q15	527	512	480	480
q16	510	438	447	438
q17	1813	1529	1508	1508
q18	8189	7977	7300	7300
q19	5669	1494	1494	1494
q20	2104	1810	1807	1807
q21	5178	5134	5094	5094
q22	1108	1031	972	972
Total cold run time: 77345 ms
Total hot run time: 54941 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183901 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2dcaaee44c91ecb251337135cba98a674fb29a5a, data reload: false

query1	877	362	379	362
query2	6440	1862	1848	1848
query3	6656	205	216	205
query4	30204	23196	23174	23174
query5	4218	489	499	489
query6	280	166	166	166
query7	4555	296	285	285
query8	251	201	192	192
query9	8474	2445	2419	2419
query10	431	277	268	268
query11	16859	14988	15011	14988
query12	172	98	99	98
query13	1606	353	344	344
query14	9542	6128	7005	6128
query15	229	167	166	166
query16	7631	484	509	484
query17	1487	555	524	524
query18	1937	300	276	276
query19	191	140	140	140
query20	116	103	104	103
query21	212	101	96	96
query22	4172	4079	4058	4058
query23	33915	33245	33118	33118
query24	11521	2892	2812	2812
query25	651	388	381	381
query26	1656	159	150	150
query27	2898	278	269	269
query28	7654	2055	2042	2042
query29	1011	401	416	401
query30	295	154	149	149
query31	968	760	756	756
query32	96	53	58	53
query33	739	294	283	283
query34	934	462	457	457
query35	826	725	717	717
query36	1073	898	922	898
query37	160	82	79	79
query38	4030	3801	3758	3758
query39	1436	1413	1393	1393
query40	267	113	111	111
query41	48	44	44	44
query42	117	95	96	95
query43	492	460	465	460
query44	1176	759	724	724
query45	192	165	164	164
query46	1115	765	737	737
query47	1843	1762	1770	1762
query48	364	285	290	285
query49	1150	421	411	411
query50	798	399	401	399
query51	6752	6715	6626	6626
query52	103	91	90	90
query53	261	187	184	184
query54	919	469	436	436
query55	78	75	75	75
query56	275	251	245	245
query57	1141	1056	1065	1056
query58	238	219	221	219
query59	2888	2644	2637	2637
query60	281	263	270	263
query61	99	97	134	97
query62	803	658	669	658
query63	220	183	174	174
query64	6388	2269	1736	1736
query65	3199	3128	3108	3108
query66	1374	334	329	329
query67	15306	14916	14951	14916
query68	4548	544	539	539
query69	439	309	318	309
query70	1195	1131	1098	1098
query71	399	275	268	268
query72	6424	2223	2065	2065
query73	767	320	314	314
query74	9141	8761	8890	8761
query75	3433	2666	2682	2666
query76	2530	968	951	951
query77	511	325	303	303
query78	9770	8988	9031	8988
query79	2474	528	528	528
query80	1112	486	492	486
query81	587	221	216	216
query82	836	134	132	132
query83	246	147	145	145
query84	251	80	73	73
query85	1595	283	365	283
query86	455	294	288	288
query87	4296	4320	4206	4206
query88	3891	2310	2297	2297
query89	390	303	294	294
query90	1841	187	193	187
query91	121	96	95	95
query92	64	49	47	47
query93	1815	532	531	531
query94	903	297	277	277
query95	343	252	254	252
query96	594	267	275	267
query97	3228	3031	3018	3018
query98	224	204	199	199
query99	1479	1248	1257	1248
Total cold run time: 290192 ms
Total hot run time: 183901 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.93 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2dcaaee44c91ecb251337135cba98a674fb29a5a, data reload: false

query1	0.05	0.04	0.04
query2	0.09	0.05	0.04
query3	0.23	0.05	0.06
query4	1.67	0.10	0.09
query5	0.50	0.48	0.49
query6	1.13	0.74	0.73
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.54	0.48	0.49
query10	0.53	0.54	0.55
query11	0.15	0.12	0.11
query12	0.15	0.12	0.12
query13	0.59	0.59	0.58
query14	0.76	0.79	0.79
query15	0.88	0.81	0.81
query16	0.36	0.38	0.36
query17	1.00	1.05	1.00
query18	0.23	0.22	0.22
query19	1.79	1.68	1.67
query20	0.02	0.01	0.01
query21	15.39	0.77	0.65
query22	4.07	7.27	2.02
query23	18.29	1.31	1.28
query24	2.11	0.24	0.21
query25	0.15	0.08	0.08
query26	0.31	0.22	0.22
query27	0.45	0.23	0.23
query28	13.29	1.01	0.99
query29	12.59	3.38	3.28
query30	0.24	0.06	0.05
query31	2.87	0.40	0.40
query32	3.27	0.48	0.48
query33	2.95	2.99	2.98
query34	17.25	4.36	4.39
query35	4.48	4.49	4.46
query36	0.65	0.48	0.47
query37	0.19	0.16	0.15
query38	0.16	0.15	0.15
query39	0.04	0.04	0.04
query40	0.15	0.13	0.13
query41	0.09	0.04	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.84 s
Total hot run time: 30.93 s

@feiniaofeiafei feiniaofeiafei force-pushed the min_max_filter_rewrite branch from 2dcaaee to 3f961c4 Compare August 16, 2024 10:03
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38674 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3f961c48a209a99b950615bd45ea1d0d41b9f50c, data reload: false

------ Round 1 ----------------------------------
q1	17878	4484	4366	4366
q2	2044	219	211	211
q3	10463	1293	1141	1141
q4	10674	790	784	784
q5	7929	2914	2893	2893
q6	269	157	156	156
q7	1023	670	644	644
q8	9457	2163	2115	2115
q9	7258	6590	6605	6590
q10	7106	2226	2250	2226
q11	497	286	277	277
q12	445	260	258	258
q13	17798	3018	3056	3018
q14	302	261	261	261
q15	571	528	550	528
q16	542	417	425	417
q17	1000	665	775	665
q18	7450	6913	6877	6877
q19	5460	1088	985	985
q20	710	368	364	364
q21	3967	2863	3032	2863
q22	1146	1055	1035	1035
Total cold run time: 113989 ms
Total hot run time: 38674 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4512	4424	4316	4316
q2	425	325	311	311
q3	2926	2634	2666	2634
q4	1972	1679	1638	1638
q5	5412	5376	5431	5376
q6	243	154	154	154
q7	2124	1690	1718	1690
q8	3242	3387	3371	3371
q9	8457	8383	8398	8383
q10	3439	3193	3205	3193
q11	654	541	541	541
q12	825	642	640	640
q13	16684	3064	3038	3038
q14	335	295	290	290
q15	573	540	531	531
q16	501	446	449	446
q17	1808	1500	1487	1487
q18	7992	7646	7648	7646
q19	1702	1595	1596	1595
q20	2098	1817	1837	1817
q21	11700	4916	5171	4916
q22	1120	1034	1033	1033
Total cold run time: 78744 ms
Total hot run time: 55046 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191361 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3f961c48a209a99b950615bd45ea1d0d41b9f50c, data reload: false

query1	1000	400	398	398
query2	6753	2074	1945	1945
query3	6664	227	239	227
query4	34250	23178	23196	23178
query5	4396	717	718	717
query6	320	216	211	211
query7	4621	336	331	331
query8	497	440	423	423
query9	8708	2560	2537	2537
query10	513	359	345	345
query11	16789	15059	15023	15023
query12	196	143	137	137
query13	1715	451	457	451
query14	10252	6787	6839	6787
query15	275	197	186	186
query16	7935	506	513	506
query17	1613	597	588	588
query18	2241	342	361	342
query19	225	164	167	164
query20	143	144	138	138
query21	255	142	143	142
query22	4320	4080	3956	3956
query23	34093	33509	33360	33360
query24	11243	2943	2893	2893
query25	662	447	418	418
query26	1198	184	200	184
query27	2308	308	307	307
query28	6950	2162	2148	2148
query29	873	462	450	450
query30	338	186	184	184
query31	1055	835	835	835
query32	120	79	79	79
query33	824	342	343	342
query34	912	514	521	514
query35	909	760	796	760
query36	1131	956	955	955
query37	178	104	106	104
query38	3965	3799	3936	3799
query39	1524	1478	1460	1460
query40	246	160	156	156
query41	143	139	139	139
query42	137	116	117	116
query43	541	525	542	525
query44	1266	784	811	784
query45	226	195	198	195
query46	1131	808	772	772
query47	1913	1830	1823	1823
query48	417	338	342	338
query49	1259	595	590	590
query50	869	487	474	474
query51	6945	6735	6733	6733
query52	118	110	115	110
query53	302	235	226	226
query54	965	505	509	505
query55	94	90	93	90
query56	343	329	313	313
query57	1219	1125	1127	1125
query58	322	332	322	322
query59	3122	2938	2967	2938
query60	347	328	335	328
query61	153	143	154	143
query62	885	722	698	698
query63	260	228	233	228
query64	5388	2400	3894	2400
query65	3269	3215	3187	3187
query66	1170	747	685	685
query67	15435	14945	14867	14867
query68	8520	603	614	603
query69	760	434	346	346
query70	1446	1117	1152	1117
query71	578	317	318	317
query72	7699	2310	2069	2069
query73	1795	374	369	369
query74	9145	8715	8712	8712
query75	5012	2734	2765	2734
query76	5279	1090	1027	1027
query77	920	484	442	442
query78	9760	9216	9170	9170
query79	7341	565	558	558
query80	965	611	608	608
query81	629	270	261	261
query82	317	160	159	159
query83	351	218	219	218
query84	307	99	96	96
query85	1067	368	352	352
query86	356	337	323	323
query87	4353	4325	4181	4181
query88	4858	2548	2538	2538
query89	534	344	323	323
query90	2052	243	271	243
query91	157	131	131	131
query92	96	76	79	76
query93	5310	556	549	549
query94	1055	318	307	307
query95	399	288	292	288
query96	633	288	283	283
query97	3213	3101	3104	3101
query98	237	226	229	226
query99	1537	1320	1300	1300
Total cold run time: 317130 ms
Total hot run time: 191361 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.6 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3f961c48a209a99b950615bd45ea1d0d41b9f50c, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.06	0.04
query4	1.67	0.09	0.08
query5	0.49	0.49	0.50
query6	1.13	0.75	0.74
query7	0.02	0.02	0.02
query8	0.05	0.05	0.05
query9	0.55	0.50	0.49
query10	0.55	0.54	0.55
query11	0.17	0.12	0.12
query12	0.16	0.13	0.12
query13	0.61	0.59	0.59
query14	0.77	0.76	0.78
query15	0.85	0.83	0.83
query16	0.36	0.38	0.38
query17	1.04	1.03	0.99
query18	0.23	0.21	0.22
query19	1.78	1.75	1.72
query20	0.01	0.02	0.01
query21	15.43	0.67	0.66
query22	4.51	6.58	2.33
query23	18.31	1.41	1.29
query24	2.05	0.24	0.23
query25	0.15	0.10	0.08
query26	0.31	0.22	0.23
query27	0.46	0.24	0.23
query28	13.29	1.02	1.01
query29	12.69	3.38	3.40
query30	0.44	0.26	0.24
query31	2.80	0.41	0.39
query32	3.24	0.49	0.48
query33	2.93	3.00	2.94
query34	17.08	4.33	4.38
query35	4.44	4.41	4.37
query36	0.65	0.48	0.50
query37	0.20	0.17	0.16
query38	0.17	0.17	0.16
query39	0.06	0.04	0.05
query40	0.18	0.14	0.15
query41	0.12	0.06	0.07
query42	0.07	0.06	0.06
query43	0.06	0.06	0.07
Total cold run time: 110.43 s
Total hot run time: 31.6 s

@feiniaofeiafei
Copy link
Contributor Author

run cloud_p1

@feiniaofeiafei feiniaofeiafei force-pushed the min_max_filter_rewrite branch from 4f69ba3 to 3b81ab7 Compare August 21, 2024 03:27
@feiniaofeiafei
Copy link
Contributor Author

run buildall

1 similar comment
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37943 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 65a990aa0d213145f6a3bf4e2b56a80b5d917026, data reload: false

------ Round 1 ----------------------------------
q1	17873	4406	4297	4297
q2	2065	210	207	207
q3	10394	1174	1101	1101
q4	10170	747	775	747
q5	7762	2818	2740	2740
q6	267	163	160	160
q7	1015	666	647	647
q8	9380	2062	2078	2062
q9	6945	6547	6493	6493
q10	7069	2248	2190	2190
q11	499	283	274	274
q12	441	269	263	263
q13	18869	3030	3028	3028
q14	312	260	272	260
q15	572	539	561	539
q16	534	407	404	404
q17	988	622	786	622
q18	7428	6982	6642	6642
q19	6598	1068	1031	1031
q20	711	361	351	351
q21	3859	2947	2851	2851
q22	1135	1034	1044	1034
Total cold run time: 114886 ms
Total hot run time: 37943 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4606	4287	4284	4284
q2	403	296	293	293
q3	2885	2612	2590	2590
q4	1971	1777	1750	1750
q5	5662	5651	5654	5651
q6	247	157	168	157
q7	2185	1814	1821	1814
q8	3323	3461	3374	3374
q9	8802	8724	8797	8724
q10	3595	3304	3235	3235
q11	654	528	527	527
q12	817	622	647	622
q13	16584	3164	3187	3164
q14	330	300	297	297
q15	578	533	522	522
q16	537	470	455	455
q17	1855	1556	1556	1556
q18	8351	7786	7421	7421
q19	6693	1511	1665	1511
q20	3269	1940	1896	1896
q21	13954	5334	5287	5287
q22	1184	1049	1032	1032
Total cold run time: 88485 ms
Total hot run time: 56162 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187984 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bde263e51a7fe1d7848eae946a8a063afce7a203, data reload: false

query1	910	375	375	375
query2	6449	1968	1950	1950
query3	6658	209	214	209
query4	34266	23166	23193	23166
query5	4159	497	495	495
query6	264	171	182	171
query7	4599	312	288	288
query8	252	205	214	205
query9	8463	2498	2505	2498
query10	441	278	289	278
query11	18072	15042	15112	15042
query12	155	103	101	101
query13	1633	395	366	366
query14	9948	7209	6707	6707
query15	279	168	180	168
query16	8069	486	460	460
query17	1611	564	562	562
query18	2084	294	288	288
query19	333	145	146	145
query20	118	110	114	110
query21	212	106	106	106
query22	4456	4139	4075	4075
query23	33969	33206	33383	33206
query24	11118	2867	2956	2867
query25	622	383	377	377
query26	1122	163	157	157
query27	2301	282	280	280
query28	6905	2083	2054	2054
query29	805	421	405	405
query30	305	155	153	153
query31	983	773	790	773
query32	101	60	59	59
query33	756	279	292	279
query34	979	469	495	469
query35	848	744	705	705
query36	1084	966	918	918
query37	171	100	92	92
query38	3980	3977	3905	3905
query39	1460	1531	1577	1531
query40	215	157	125	125
query41	47	46	44	44
query42	123	97	93	93
query43	519	470	466	466
query44	1242	758	748	748
query45	200	169	170	169
query46	1080	726	760	726
query47	1860	1811	1793	1793
query48	381	293	296	293
query49	1062	429	444	429
query50	803	420	402	402
query51	7261	7129	7165	7129
query52	102	87	86	86
query53	253	189	175	175
query54	933	456	449	449
query55	77	76	75	75
query56	276	266	257	257
query57	1182	1060	1080	1060
query58	237	252	250	250
query59	2980	2881	2696	2696
query60	311	263	266	263
query61	104	102	102	102
query62	817	659	663	659
query63	216	188	183	183
query64	4239	718	667	667
query65	3235	3145	3133	3133
query66	1399	334	335	334
query67	15547	15257	15264	15257
query68	3128	593	584	584
query69	396	286	280	280
query70	1194	1120	1107	1107
query71	329	273	275	273
query72	6299	4036	3972	3972
query73	743	335	333	333
query74	9207	8963	8952	8952
query75	3407	2683	2704	2683
query76	1899	994	997	994
query77	471	325	374	325
query78	9649	9058	8993	8993
query79	1034	557	551	551
query80	695	514	512	512
query81	454	242	233	233
query82	250	143	145	143
query83	171	150	154	150
query84	226	81	73	73
query85	703	289	284	284
query86	300	307	281	281
query87	4390	4334	4308	4308
query88	3268	2329	2348	2329
query89	382	292	292	292
query90	1828	188	194	188
query91	131	106	110	106
query92	62	51	54	51
query93	1027	545	544	544
query94	858	297	300	297
query95	357	262	262	262
query96	581	264	263	263
query97	3212	3105	3108	3105
query98	212	212	206	206
query99	1483	1303	1252	1252
Total cold run time: 285987 ms
Total hot run time: 187984 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.13 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bde263e51a7fe1d7848eae946a8a063afce7a203, data reload: false

query1	0.05	0.05	0.04
query2	0.07	0.04	0.04
query3	0.22	0.05	0.05
query4	1.66	0.08	0.08
query5	0.50	0.49	0.48
query6	1.12	0.72	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.54	0.48	0.48
query10	0.54	0.54	0.54
query11	0.15	0.11	0.12
query12	0.15	0.12	0.13
query13	0.61	0.59	0.58
query14	2.06	2.07	2.07
query15	0.90	0.83	0.83
query16	0.37	0.39	0.37
query17	0.97	1.02	1.01
query18	0.21	0.19	0.20
query19	1.89	1.81	1.86
query20	0.01	0.01	0.01
query21	15.42	0.67	0.67
query22	4.28	7.49	2.00
query23	18.24	1.28	1.26
query24	2.15	0.23	0.22
query25	0.15	0.09	0.08
query26	0.27	0.17	0.17
query27	0.08	0.08	0.07
query28	13.25	1.03	1.01
query29	12.64	3.34	3.32
query30	0.24	0.06	0.06
query31	2.88	0.41	0.38
query32	3.23	0.50	0.48
query33	2.96	2.97	2.99
query34	17.07	4.45	4.36
query35	4.44	4.47	4.44
query36	0.66	0.49	0.48
query37	0.18	0.16	0.15
query38	0.16	0.15	0.15
query39	0.05	0.03	0.05
query40	0.15	0.12	0.13
query41	0.09	0.05	0.05
query42	0.06	0.04	0.04
query43	0.05	0.04	0.04
Total cold run time: 110.79 s
Total hot run time: 32.13 s

@morrySnow morrySnow force-pushed the min_max_filter_rewrite branch from bde263e to 879f12f Compare September 3, 2024 07:56
@morrySnow
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38017 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 879f12fe67643b77540f716f50d21347f3fba234, data reload: false

------ Round 1 ----------------------------------
q1	17724	4424	4314	4314
q2	2017	181	180	180
q3	11857	968	1048	968
q4	10527	752	740	740
q5	7764	2824	2813	2813
q6	231	138	134	134
q7	964	621	606	606
q8	9321	2053	2075	2053
q9	7228	6575	6559	6559
q10	6994	2238	2282	2238
q11	444	238	236	236
q12	394	222	223	222
q13	18847	3060	3068	3060
q14	286	232	245	232
q15	505	496	496	496
q16	577	498	506	498
q17	987	653	668	653
q18	7247	6919	6891	6891
q19	1401	910	939	910
q20	666	331	334	331
q21	3883	3069	2882	2882
q22	1117	1001	1046	1001
Total cold run time: 110981 ms
Total hot run time: 38017 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4340	4318	4297	4297
q2	361	277	267	267
q3	2865	2638	2647	2638
q4	1920	1643	1639	1639
q5	5658	5700	5750	5700
q6	230	136	138	136
q7	2246	1870	1822	1822
q8	3334	3439	3447	3439
q9	8819	8876	8793	8793
q10	3587	3400	3345	3345
q11	595	510	512	510
q12	829	686	686	686
q13	13255	3167	3262	3167
q14	328	294	291	291
q15	522	547	489	489
q16	638	580	580	580
q17	1828	1561	1512	1512
q18	8065	7842	7874	7842
q19	1717	1574	1633	1574
q20	2182	1921	1895	1895
q21	5772	5487	5498	5487
q22	1132	1028	1024	1024
Total cold run time: 70223 ms
Total hot run time: 57133 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192463 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 879f12fe67643b77540f716f50d21347f3fba234, data reload: false

query1	1250	888	866	866
query2	6295	2043	2005	2005
query3	10625	3952	3889	3889
query4	59756	24462	23337	23337
query5	5562	523	508	508
query6	457	165	170	165
query7	6267	284	300	284
query8	312	209	210	209
query9	8803	2456	2455	2455
query10	504	281	267	267
query11	17088	14968	15198	14968
query12	160	114	105	105
query13	1593	412	394	394
query14	11788	7561	7282	7282
query15	229	200	188	188
query16	7667	432	487	432
query17	1125	555	576	555
query18	2177	301	299	299
query19	304	145	142	142
query20	122	113	107	107
query21	213	106	100	100
query22	4696	4407	4649	4407
query23	34717	33291	33425	33291
query24	5728	2848	2869	2848
query25	510	374	385	374
query26	678	148	147	147
query27	1804	280	277	277
query28	3755	2055	2035	2035
query29	655	398	398	398
query30	232	156	154	154
query31	905	751	759	751
query32	84	51	53	51
query33	449	271	279	271
query34	853	476	464	464
query35	841	743	730	730
query36	1065	954	946	946
query37	141	86	87	86
query38	3930	3888	3873	3873
query39	1495	1367	1357	1357
query40	196	112	111	111
query41	49	46	45	45
query42	118	93	94	93
query43	526	494	472	472
query44	1071	722	739	722
query45	197	166	168	166
query46	1083	766	764	764
query47	1927	1764	1808	1764
query48	368	286	290	286
query49	770	420	419	419
query50	811	419	414	414
query51	6964	6881	6748	6748
query52	101	87	88	87
query53	247	173	176	173
query54	574	478	458	458
query55	77	76	74	74
query56	281	268	273	268
query57	1196	1089	1081	1081
query58	221	236	229	229
query59	3240	2980	2798	2798
query60	303	269	282	269
query61	124	117	119	117
query62	736	662	655	655
query63	221	191	188	188
query64	2904	744	734	734
query65	3210	3122	3146	3122
query66	709	352	356	352
query67	15421	15322	15244	15244
query68	2994	577	585	577
query69	410	294	293	293
query70	1206	1160	1048	1048
query71	389	366	279	279
query72	6059	4063	3998	3998
query73	754	330	329	329
query74	9250	8915	8879	8879
query75	3367	2668	2726	2668
query76	1572	980	972	972
query77	530	318	318	318
query78	9759	9140	9010	9010
query79	1045	528	526	526
query80	715	493	508	493
query81	551	240	232	232
query82	246	144	142	142
query83	164	143	143	143
query84	252	78	77	77
query85	677	307	275	275
query86	311	292	301	292
query87	4416	4365	4286	4286
query88	2957	2326	2324	2324
query89	373	323	287	287
query90	1962	186	186	186
query91	124	96	100	96
query92	63	55	50	50
query93	1036	523	529	523
query94	747	280	284	280
query95	342	256	255	255
query96	583	259	259	259
query97	3236	3048	3117	3048
query98	212	202	196	196
query99	1535	1292	1252	1252
Total cold run time: 306317 ms
Total hot run time: 192463 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.53 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 879f12fe67643b77540f716f50d21347f3fba234, data reload: false

query1	0.04	0.04	0.05
query2	0.09	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.07	0.07
query5	0.50	0.49	0.50
query6	1.14	0.72	0.74
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.55	0.49	0.50
query10	0.55	0.55	0.54
query11	0.16	0.12	0.11
query12	0.15	0.12	0.12
query13	0.60	0.58	0.58
query14	2.03	2.02	2.11
query15	0.91	0.81	0.83
query16	0.37	0.39	0.37
query17	1.05	1.02	1.04
query18	0.21	0.20	0.20
query19	1.92	1.80	1.83
query20	0.01	0.01	0.01
query21	15.39	0.67	0.66
query22	4.14	7.09	2.47
query23	18.30	1.38	1.21
query24	2.12	0.23	0.22
query25	0.15	0.09	0.08
query26	0.26	0.18	0.18
query27	0.08	0.07	0.08
query28	13.22	1.03	1.00
query29	12.58	3.32	3.33
query30	0.23	0.06	0.07
query31	2.84	0.40	0.39
query32	3.27	0.48	0.47
query33	3.00	3.05	3.04
query34	17.17	4.40	4.36
query35	4.40	4.41	4.48
query36	0.67	0.49	0.48
query37	0.19	0.16	0.15
query38	0.15	0.14	0.14
query39	0.05	0.04	0.04
query40	0.17	0.12	0.13
query41	0.09	0.05	0.05
query42	0.05	0.04	0.05
query43	0.04	0.04	0.04
Total cold run time: 110.81 s
Total hot run time: 32.53 s

@morrySnow morrySnow merged commit bfbb065 into apache:master Sep 4, 2024
25 of 26 checks passed
@morrySnow morrySnow added dev/3.0.x and removed doing labels Oct 10, 2024
feiniaofeiafei added a commit to feiniaofeiafei/doris that referenced this pull request Oct 15, 2024
@feiniaofeiafei
[Feat](nereids) add max/min filter push down rewrite rule (apache#39252)
45d8ef6 
add rewrite rule:
select id, max(a) from t group by id having max(a)>10;
 ->
 select id, max(a) from t where a>10 group by id;
select id, min(a) from t group by id having min(a)<10;
->
 select id, min(a) from t where a<10 group by id;
@feiniaofeiafei feiniaofeiafei mentioned this pull request Oct 15, 2024
Merged
924060929 pushed a commit that referenced this pull request Oct 24, 2024
@feiniaofeiafei
[Feat](nereids) add max/min filter push down rewrite rule (#39252) (#…
54d730c 
…41907)

add rewrite rule:
select id, max(a) from t group by id having max(a)>10;
 ->
 select id, max(a) from t where a>10 group by id;
select id, min(a) from t group by id having min(a)<10;
->
 select id, min(a) from t where a<10 group by id;
feiniaofeiafei added a commit to feiniaofeiafei/doris that referenced this pull request Nov 12, 2024
@feiniaofeiafei
[Feat](nereids) add max/min filter push down rewrite rule (apache#39252)
78467bd 
add rewrite rule:
select id, max(a) from t group by id having max(a)>10;
 ->
 select id, max(a) from t where a>10 group by id;
select id, min(a) from t group by id having min(a)<10;
->
 select id, min(a) from t where a<10 group by id;
@feiniaofeiafei feiniaofeiafei mentioned this pull request Nov 12, 2024
Merged
yiguolei pushed a commit that referenced this pull request Nov 13, 2024
@feiniaofeiafei
[Feat](nereids) add max/min filter push down rewrite rule (#39252) (#…
40d755a 
…43671)

cherry-pick #39252 to branch-2.1
@yiguolei yiguolei mentioned this pull request Jan 19, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@englefly englefly englefly approved these changes

@morrySnow morrySnow morrySnow approved these changes

@xzj7019 xzj7019 xzj7019 approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.8-merged dev/3.0.3-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
7 participants
@feiniaofeiafei @doris-robot @morrySnow @englefly @xzj7019 @924060929 @yiguolei