Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](mv) Fix sync mv add default select limit wrongly #47717

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

seawinde
Copy link
Contributor

What problem does this PR solve?

mv def is as follwoing:

create materialize view sql_default_limit_table;
as
select id1, sum(sale_amt) from sql_default_limit_table group by id1;

if we set sql_select_limit = 1;
the query as following should rewrite successfully, but now fail, the pr fix this

select id1, sum(sale_amt) from sql_default_limit_table group by id1;

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

Fix sync mv add default select limit wrongly

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@seawinde
Copy link
Contributor Author

run buildall

@seawinde
Copy link
Contributor Author

run buildall

morrySnow
morrySnow previously approved these changes Feb 11, 2025
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Feb 11, 2025
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 31303 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3a0b2090465f0802930f27a5cf37099543511748, data reload: false

------ Round 1 ----------------------------------
q1	17608	5176	5036	5036
q2	2047	306	167	167
q3	10416	1276	749	749
q4	10478	1013	522	522
q5	7669	2402	2315	2315
q6	184	168	132	132
q7	892	744	591	591
q8	9418	1290	1074	1074
q9	4929	4562	4726	4562
q10	6875	2314	1905	1905
q11	498	283	257	257
q12	346	349	217	217
q13	17764	3656	3062	3062
q14	221	236	207	207
q15	515	473	461	461
q16	620	610	585	585
q17	560	862	327	327
q18	6739	6229	6224	6224
q19	1339	948	533	533
q20	310	326	189	189
q21	2850	2140	1885	1885
q22	364	330	303	303
Total cold run time: 102642 ms
Total hot run time: 31303 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5137	5123	5113	5113
q2	249	324	235	235
q3	2173	2700	2286	2286
q4	1427	1800	1364	1364
q5	4254	4122	4139	4122
q6	210	165	125	125
q7	1870	1828	1648	1648
q8	2591	2638	2667	2638
q9	7147	7205	7152	7152
q10	3022	3229	2796	2796
q11	580	511	504	504
q12	686	784	670	670
q13	3432	3880	3295	3295
q14	290	292	273	273
q15	515	468	457	457
q16	651	695	632	632
q17	1170	1648	1332	1332
q18	7611	7362	7268	7268
q19	803	847	864	847
q20	1958	2070	1880	1880
q21	5356	4969	4799	4799
q22	637	631	529	529
Total cold run time: 51769 ms
Total hot run time: 49965 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191211 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3a0b2090465f0802930f27a5cf37099543511748, data reload: false

query1	1284	955	943	943
query2	6364	1801	1809	1801
query3	11051	4672	4683	4672
query4	54244	25985	22984	22984
query5	5182	552	475	475
query6	329	199	192	192
query7	4874	535	296	296
query8	323	257	250	250
query9	5449	2499	2527	2499
query10	419	335	262	262
query11	15319	15025	15160	15025
query12	166	112	107	107
query13	1047	518	402	402
query14	10282	6998	7052	6998
query15	212	210	204	204
query16	7084	673	489	489
query17	1112	761	604	604
query18	1581	421	331	331
query19	207	201	177	177
query20	129	137	125	125
query21	217	126	107	107
query22	4332	4406	4338	4338
query23	34085	33632	33484	33484
query24	5629	2528	2510	2510
query25	477	463	388	388
query26	709	290	167	167
query27	1967	517	334	334
query28	2744	2427	2395	2395
query29	588	564	426	426
query30	217	190	167	167
query31	962	890	826	826
query32	75	77	61	61
query33	436	363	318	318
query34	795	878	513	513
query35	808	850	823	823
query36	960	1033	918	918
query37	127	107	81	81
query38	4270	4359	4330	4330
query39	1516	1599	1607	1599
query40	213	119	115	115
query41	51	53	51	51
query42	128	110	109	109
query43	498	511	481	481
query44	1353	818	812	812
query45	192	174	168	168
query46	939	1137	677	677
query47	1870	1832	1790	1790
query48	392	427	309	309
query49	701	520	417	417
query50	750	790	440	440
query51	4303	4255	4255	4255
query52	103	108	101	101
query53	242	264	194	194
query54	496	500	415	415
query55	80	79	81	79
query56	280	272	263	263
query57	1183	1173	1131	1131
query58	251	252	248	248
query59	2677	2742	2675	2675
query60	292	272	269	269
query61	122	119	150	119
query62	764	747	659	659
query63	240	192	189	189
query64	1757	1029	741	741
query65	3286	3211	3139	3139
query66	716	393	301	301
query67	15873	15449	15190	15190
query68	5632	788	520	520
query69	531	301	275	275
query70	1226	1084	1115	1084
query71	442	310	260	260
query72	5998	3717	3824	3717
query73	1387	788	355	355
query74	9487	9168	8848	8848
query75	3272	3149	2719	2719
query76	3944	1233	784	784
query77	530	376	290	290
query78	9907	10097	9293	9293
query79	2637	833	613	613
query80	632	546	464	464
query81	501	287	240	240
query82	652	160	122	122
query83	190	178	154	154
query84	296	100	73	73
query85	774	352	297	297
query86	375	298	262	262
query87	4416	4458	4459	4458
query88	3564	2276	2178	2178
query89	417	311	285	285
query90	1740	195	194	194
query91	133	141	104	104
query92	73	63	56	56
query93	1943	1052	582	582
query94	710	407	303	303
query95	340	273	254	254
query96	483	583	265	265
query97	2823	2889	2769	2769
query98	249	206	199	199
query99	1342	1399	1236	1236
Total cold run time: 293970 ms
Total hot run time: 191211 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.19 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3a0b2090465f0802930f27a5cf37099543511748, data reload: false

query1	0.03	0.04	0.03
query2	0.06	0.04	0.03
query3	0.23	0.07	0.06
query4	1.65	0.10	0.10
query5	0.42	0.41	0.41
query6	1.17	0.67	0.66
query7	0.02	0.02	0.02
query8	0.04	0.04	0.04
query9	0.60	0.52	0.51
query10	0.59	0.58	0.56
query11	0.15	0.10	0.10
query12	0.14	0.10	0.11
query13	0.62	0.60	0.59
query14	2.80	2.67	2.81
query15	0.92	0.85	0.85
query16	0.37	0.38	0.38
query17	1.04	1.04	1.03
query18	0.22	0.19	0.19
query19	1.93	1.82	2.03
query20	0.02	0.01	0.01
query21	15.36	0.92	0.55
query22	0.76	1.18	0.73
query23	14.85	1.40	0.62
query24	6.88	1.32	1.50
query25	0.46	0.14	0.13
query26	0.67	0.16	0.15
query27	0.05	0.05	0.05
query28	9.83	0.81	0.44
query29	12.56	3.89	3.26
query30	0.24	0.09	0.06
query31	2.84	0.57	0.39
query32	3.23	0.55	0.46
query33	3.00	3.13	3.00
query34	15.77	5.20	4.52
query35	4.58	4.54	4.59
query36	0.66	0.49	0.49
query37	0.10	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.17	0.14	0.14
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.26 s
Total hot run time: 31.19 s

@seawinde
Copy link
Contributor Author

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Feb 12, 2025
@doris-robot
Copy link

TPC-H: Total hot run time: 31412 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e4cc63607c46e23b50d8a99236b6b66803480d23, data reload: false

------ Round 1 ----------------------------------
q1	17569	5170	5044	5044
q2	2047	282	166	166
q3	10422	1209	728	728
q4	10210	980	523	523
q5	7521	2333	2354	2333
q6	182	167	137	137
q7	900	745	593	593
q8	9526	1300	1104	1104
q9	4928	4856	4664	4664
q10	6827	2311	1918	1918
q11	483	279	246	246
q12	351	354	227	227
q13	18375	3662	3040	3040
q14	219	220	211	211
q15	505	466	461	461
q16	609	641	590	590
q17	573	841	327	327
q18	6527	6267	6211	6211
q19	1604	932	541	541
q20	307	315	181	181
q21	2716	2123	1875	1875
q22	360	323	292	292
Total cold run time: 102761 ms
Total hot run time: 31412 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5111	5038	5064	5038
q2	233	319	225	225
q3	2178	2667	2284	2284
q4	1396	1829	1353	1353
q5	4190	4101	4134	4101
q6	205	163	124	124
q7	1839	1819	1633	1633
q8	2584	2619	2509	2509
q9	7201	7134	7094	7094
q10	2970	3193	2771	2771
q11	575	515	489	489
q12	679	781	656	656
q13	3399	3786	3307	3307
q14	271	314	278	278
q15	503	459	459	459
q16	662	677	635	635
q17	1129	1596	1319	1319
q18	7538	7351	7412	7351
q19	779	826	824	824
q20	1992	2016	1918	1918
q21	5333	4931	4661	4661
q22	624	578	549	549
Total cold run time: 51391 ms
Total hot run time: 49578 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189738 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e4cc63607c46e23b50d8a99236b6b66803480d23, data reload: false

query1	1322	943	935	935
query2	6184	1866	1811	1811
query3	10918	4648	4468	4468
query4	53146	25005	23396	23396
query5	5221	591	479	479
query6	310	187	180	180
query7	4899	497	290	290
query8	304	231	220	220
query9	5607	2496	2465	2465
query10	419	318	253	253
query11	15158	15073	14818	14818
query12	155	105	109	105
query13	1034	509	400	400
query14	10515	6868	6425	6425
query15	194	203	177	177
query16	6963	630	483	483
query17	1047	711	590	590
query18	1539	415	317	317
query19	199	193	163	163
query20	126	128	126	126
query21	206	124	110	110
query22	4440	4498	4383	4383
query23	34032	33327	33361	33327
query24	5691	2465	2467	2465
query25	510	489	427	427
query26	643	283	169	169
query27	1671	482	343	343
query28	2869	2428	2419	2419
query29	588	576	446	446
query30	216	189	155	155
query31	915	898	819	819
query32	79	65	61	61
query33	475	369	311	311
query34	795	882	501	501
query35	820	830	758	758
query36	950	991	924	924
query37	123	136	80	80
query38	4317	4311	4183	4183
query39	1507	1424	1432	1424
query40	204	119	101	101
query41	52	49	52	49
query42	121	109	109	109
query43	505	511	486	486
query44	1306	799	818	799
query45	177	188	170	170
query46	870	1058	675	675
query47	1830	1901	1802	1802
query48	395	419	306	306
query49	688	539	424	424
query50	731	744	412	412
query51	4215	4283	4235	4235
query52	106	100	91	91
query53	239	262	185	185
query54	479	506	422	422
query55	88	78	85	78
query56	293	280	270	270
query57	1186	1168	1111	1111
query58	245	248	247	247
query59	2835	2833	2592	2592
query60	284	276	274	274
query61	119	121	121	121
query62	724	753	694	694
query63	236	194	189	189
query64	1386	1087	681	681
query65	3321	3189	3140	3140
query66	784	428	294	294
query67	15918	15588	15366	15366
query68	5378	768	510	510
query69	515	292	271	271
query70	1160	1129	1140	1129
query71	440	300	265	265
query72	6333	3594	3722	3594
query73	1266	764	352	352
query74	8943	9206	8983	8983
query75	3179	3135	2715	2715
query76	3925	1151	741	741
query77	552	363	278	278
query78	10030	10098	9257	9257
query79	1986	812	577	577
query80	666	528	432	432
query81	506	278	228	228
query82	380	125	93	93
query83	239	173	156	156
query84	282	85	74	74
query85	734	341	297	297
query86	357	311	280	280
query87	4426	4491	4352	4352
query88	3200	2284	2205	2205
query89	383	316	283	283
query90	1712	188	192	188
query91	152	149	108	108
query92	73	65	54	54
query93	2681	999	575	575
query94	680	405	298	298
query95	335	271	253	253
query96	478	551	267	267
query97	2805	2828	2729	2729
query98	230	208	196	196
query99	1307	1384	1269	1269
Total cold run time: 290777 ms
Total hot run time: 189738 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.4 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e4cc63607c46e23b50d8a99236b6b66803480d23, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.25	0.06	0.06
query4	1.62	0.10	0.11
query5	0.42	0.42	0.42
query6	1.17	0.65	0.67
query7	0.02	0.02	0.01
query8	0.03	0.03	0.03
query9	0.57	0.52	0.53
query10	0.59	0.57	0.57
query11	0.15	0.10	0.10
query12	0.14	0.10	0.11
query13	0.62	0.59	0.60
query14	2.68	2.82	2.72
query15	0.91	0.82	0.84
query16	0.38	0.36	0.37
query17	1.03	1.05	1.03
query18	0.21	0.20	0.19
query19	1.89	1.81	2.07
query20	0.01	0.01	0.01
query21	15.36	0.91	0.55
query22	0.74	1.11	0.71
query23	14.94	1.39	0.59
query24	6.96	1.65	0.72
query25	0.54	0.30	0.08
query26	0.59	0.16	0.14
query27	0.06	0.05	0.05
query28	9.03	0.91	0.44
query29	12.56	3.89	3.29
query30	0.25	0.09	0.06
query31	2.83	0.58	0.38
query32	3.22	0.54	0.46
query33	3.01	3.04	3.03
query34	15.90	5.13	4.48
query35	4.51	4.49	4.55
query36	0.68	0.50	0.48
query37	0.09	0.06	0.06
query38	0.06	0.04	0.04
query39	0.02	0.02	0.02
query40	0.16	0.12	0.11
query41	0.08	0.02	0.02
query42	0.04	0.02	0.03
query43	0.03	0.04	0.03
Total cold run time: 104.46 s
Total hot run time: 30.4 s

@seawinde
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31544 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5838ad5335c173cdcbfd372bade63c5c7fb17d66, data reload: false

------ Round 1 ----------------------------------
q1	17674	5202	5208	5202
q2	2050	302	164	164
q3	10400	1281	691	691
q4	10207	999	521	521
q5	7494	2302	2334	2302
q6	184	165	135	135
q7	893	748	597	597
q8	9300	1286	1059	1059
q9	4752	4744	4650	4650
q10	6806	2267	1900	1900
q11	492	272	253	253
q12	336	350	216	216
q13	17748	3636	3070	3070
q14	240	218	210	210
q15	505	463	461	461
q16	613	617	586	586
q17	573	856	338	338
q18	6749	6294	6228	6228
q19	1856	953	532	532
q20	298	318	190	190
q21	2753	2205	1924	1924
q22	365	331	315	315
Total cold run time: 102288 ms
Total hot run time: 31544 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5207	5105	5190	5105
q2	240	323	244	244
q3	2138	2647	2285	2285
q4	1445	1799	1426	1426
q5	4200	4141	4159	4141
q6	208	164	125	125
q7	1868	1805	1620	1620
q8	2610	2659	2522	2522
q9	7252	7076	7180	7076
q10	2965	3151	2778	2778
q11	571	505	499	499
q12	658	756	606	606
q13	3409	3957	3217	3217
q14	277	306	268	268
q15	510	478	467	467
q16	637	693	620	620
q17	1104	1512	1391	1391
q18	7550	7358	7349	7349
q19	759	783	1004	783
q20	1941	2063	1869	1869
q21	5362	4905	4803	4803
q22	662	562	576	562
Total cold run time: 51573 ms
Total hot run time: 49756 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184043 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5838ad5335c173cdcbfd372bade63c5c7fb17d66, data reload: false

query1	987	371	364	364
query2	6554	1899	1832	1832
query3	6790	212	209	209
query4	27059	23316	23362	23316
query5	4396	705	469	469
query6	294	215	190	190
query7	4622	504	311	311
query8	313	250	235	235
query9	8569	2586	2574	2574
query10	473	302	261	261
query11	15586	15015	14869	14869
query12	184	115	105	105
query13	1662	514	402	402
query14	10223	6569	6688	6569
query15	219	190	175	175
query16	7061	618	450	450
query17	1164	688	548	548
query18	1547	373	294	294
query19	187	187	165	165
query20	119	122	112	112
query21	205	128	99	99
query22	4159	4505	4504	4504
query23	34333	33399	33071	33071
query24	7707	2354	2367	2354
query25	538	442	381	381
query26	1226	273	150	150
query27	2121	494	332	332
query28	3929	2386	2377	2377
query29	706	534	416	416
query30	229	186	156	156
query31	944	846	773	773
query32	74	66	61	61
query33	547	349	312	312
query34	793	837	498	498
query35	795	820	734	734
query36	974	969	901	901
query37	109	99	73	73
query38	4179	4335	4041	4041
query39	1451	1423	1427	1423
query40	210	111	98	98
query41	52	56	51	51
query42	116	103	105	103
query43	484	519	480	480
query44	1293	803	802	802
query45	178	170	159	159
query46	851	1043	647	647
query47	1732	1796	1727	1727
query48	375	403	310	310
query49	769	520	415	415
query50	687	721	426	426
query51	4154	4187	4097	4097
query52	112	108	92	92
query53	231	252	181	181
query54	499	497	411	411
query55	86	79	79	79
query56	279	273	258	258
query57	1110	1124	1075	1075
query58	245	236	233	233
query59	2559	2873	2594	2594
query60	272	268	261	261
query61	123	124	116	116
query62	809	733	662	662
query63	216	190	190	190
query64	4514	995	641	641
query65	3237	3114	3170	3114
query66	1124	403	300	300
query67	15438	15449	15265	15265
query68	4309	795	519	519
query69	469	298	284	284
query70	1234	1140	1097	1097
query71	408	296	280	280
query72	5159	3494	3771	3494
query73	729	723	351	351
query74	9145	8919	8943	8919
query75	3145	3166	2770	2770
query76	3238	1154	740	740
query77	473	377	284	284
query78	9969	10061	9308	9308
query79	957	853	593	593
query80	582	554	483	483
query81	486	282	237	237
query82	360	127	152	127
query83	165	174	153	153
query84	236	97	70	70
query85	745	351	301	301
query86	315	295	288	288
query87	4508	4504	4354	4354
query88	2908	2222	2203	2203
query89	382	317	282	282
query90	1743	198	196	196
query91	136	139	106	106
query92	62	60	55	55
query93	1081	1006	581	581
query94	652	406	303	303
query95	355	270	258	258
query96	492	555	266	266
query97	2761	2835	2715	2715
query98	226	201	198	198
query99	1339	1412	1335	1335
Total cold run time: 263552 ms
Total hot run time: 184043 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.92 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5838ad5335c173cdcbfd372bade63c5c7fb17d66, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.04
query3	0.23	0.07	0.06
query4	1.62	0.10	0.10
query5	0.43	0.42	0.40
query6	1.15	0.67	0.64
query7	0.02	0.01	0.02
query8	0.04	0.03	0.04
query9	0.60	0.52	0.52
query10	0.58	0.57	0.56
query11	0.14	0.10	0.11
query12	0.14	0.12	0.11
query13	0.62	0.59	0.60
query14	2.73	2.71	2.85
query15	0.92	0.85	0.84
query16	0.38	0.37	0.38
query17	1.02	1.04	1.02
query18	0.22	0.20	0.19
query19	1.91	1.84	1.98
query20	0.02	0.01	0.02
query21	15.36	0.87	0.54
query22	0.74	1.12	0.63
query23	15.07	1.40	0.63
query24	6.71	1.81	1.19
query25	0.51	0.20	0.21
query26	0.73	0.16	0.14
query27	0.06	0.05	0.04
query28	9.92	0.84	0.42
query29	12.61	3.88	3.21
query30	0.25	0.08	0.06
query31	2.84	0.58	0.38
query32	3.22	0.54	0.45
query33	2.99	3.10	3.01
query34	15.85	5.14	4.52
query35	4.50	4.54	4.55
query36	0.66	0.49	0.48
query37	0.09	0.06	0.06
query38	0.06	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.13	0.12
query41	0.08	0.03	0.03
query42	0.04	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 105.4 s
Total hot run time: 30.92 s

@seawinde
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31441 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 78091bb9a2fd310fa7c6dc31cb437b7e34f8db4e, data reload: false

------ Round 1 ----------------------------------
q1	17569	5103	5038	5038
q2	2045	295	168	168
q3	10431	1223	771	771
q4	10252	1013	519	519
q5	7772	2375	2346	2346
q6	183	168	131	131
q7	902	727	599	599
q8	9286	1295	1005	1005
q9	4867	4732	4777	4732
q10	6814	2299	1890	1890
q11	465	282	248	248
q12	340	346	220	220
q13	17781	3735	3067	3067
q14	241	223	211	211
q15	514	467	470	467
q16	626	610	589	589
q17	558	862	329	329
q18	6586	6335	6146	6146
q19	1403	961	552	552
q20	309	318	186	186
q21	2716	2121	1933	1933
q22	361	332	294	294
Total cold run time: 102021 ms
Total hot run time: 31441 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5117	5064	5092	5064
q2	225	323	233	233
q3	2144	2669	2319	2319
q4	1430	1818	1373	1373
q5	4265	4120	4107	4107
q6	210	163	125	125
q7	1880	1804	1648	1648
q8	2604	2567	2527	2527
q9	7233	7163	7102	7102
q10	3025	3193	2777	2777
q11	565	514	493	493
q12	689	783	618	618
q13	3531	3727	3326	3326
q14	282	303	279	279
q15	509	468	445	445
q16	649	681	647	647
q17	1132	1607	1354	1354
q18	7676	7383	7201	7201
q19	775	828	1044	828
q20	1954	2051	1858	1858
q21	5545	4901	4964	4901
q22	643	625	558	558
Total cold run time: 52083 ms
Total hot run time: 49783 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190693 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 78091bb9a2fd310fa7c6dc31cb437b7e34f8db4e, data reload: false

query1	1323	967	954	954
query2	6221	1817	1863	1817
query3	11016	4402	4609	4402
query4	53623	25277	23691	23691
query5	5211	597	505	505
query6	361	193	188	188
query7	4950	527	298	298
query8	313	250	235	235
query9	6150	2598	2593	2593
query10	426	326	254	254
query11	15130	15222	14956	14956
query12	163	107	108	107
query13	1095	524	393	393
query14	11094	7053	6575	6575
query15	203	193	193	193
query16	7114	667	485	485
query17	1082	733	580	580
query18	1537	421	321	321
query19	220	209	177	177
query20	134	122	122	122
query21	216	127	115	115
query22	4276	4493	4515	4493
query23	33924	33266	33074	33074
query24	5627	2466	2380	2380
query25	459	471	399	399
query26	718	276	159	159
query27	1860	492	338	338
query28	2902	2475	2470	2470
query29	596	562	436	436
query30	222	194	156	156
query31	893	860	842	842
query32	71	64	63	63
query33	450	380	309	309
query34	776	832	504	504
query35	818	817	742	742
query36	994	1005	923	923
query37	151	97	68	68
query38	4261	4463	4216	4216
query39	1491	1435	1425	1425
query40	202	119	104	104
query41	50	51	51	51
query42	118	111	108	108
query43	507	513	477	477
query44	1343	810	815	810
query45	177	173	175	173
query46	863	1058	673	673
query47	1857	1840	1789	1789
query48	388	449	322	322
query49	695	537	466	466
query50	727	783	443	443
query51	4305	4288	4223	4223
query52	106	108	97	97
query53	232	260	192	192
query54	496	484	412	412
query55	85	80	80	80
query56	280	272	270	270
query57	1183	1199	1109	1109
query58	251	240	254	240
query59	2581	2832	2652	2652
query60	287	286	263	263
query61	124	158	123	123
query62	714	736	688	688
query63	243	188	201	188
query64	1948	1036	711	711
query65	3260	3147	3125	3125
query66	720	412	301	301
query67	15864	15604	15452	15452
query68	4613	785	525	525
query69	509	306	272	272
query70	1202	1129	1141	1129
query71	440	292	264	264
query72	6465	3611	3750	3611
query73	813	753	346	346
query74	8943	9144	8866	8866
query75	3177	3144	2706	2706
query76	3627	1174	769	769
query77	542	376	285	285
query78	10103	10088	9284	9284
query79	2119	798	605	605
query80	882	532	440	440
query81	534	283	234	234
query82	405	128	100	100
query83	200	172	158	158
query84	283	90	82	82
query85	764	358	303	303
query86	416	305	298	298
query87	4456	4548	4394	4394
query88	2926	2212	2193	2193
query89	397	318	297	297
query90	1620	190	193	190
query91	135	137	117	117
query92	61	62	56	56
query93	1941	1019	574	574
query94	684	416	309	309
query95	339	264	255	255
query96	486	571	270	270
query97	2774	2868	2759	2759
query98	227	207	206	206
query99	1308	1409	1296	1296
Total cold run time: 291068 ms
Total hot run time: 190693 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.25 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 78091bb9a2fd310fa7c6dc31cb437b7e34f8db4e, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.03	0.03
query3	0.24	0.06	0.06
query4	1.62	0.11	0.10
query5	0.41	0.42	0.39
query6	1.17	0.66	0.66
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.58	0.51	0.51
query10	0.59	0.58	0.57
query11	0.15	0.10	0.10
query12	0.15	0.11	0.12
query13	0.61	0.60	0.60
query14	2.80	2.79	2.73
query15	0.91	0.84	0.85
query16	0.38	0.38	0.37
query17	1.01	1.03	1.02
query18	0.22	0.19	0.20
query19	1.94	1.84	1.96
query20	0.01	0.01	0.01
query21	15.39	0.96	0.58
query22	0.75	1.10	0.66
query23	15.04	1.40	0.62
query24	9.49	2.53	0.48
query25	0.48	0.28	0.09
query26	0.83	0.17	0.14
query27	0.04	0.04	0.06
query28	7.40	0.75	0.43
query29	12.53	3.89	3.26
query30	0.25	0.09	0.08
query31	2.83	0.59	0.38
query32	3.23	0.54	0.46
query33	3.05	3.03	3.12
query34	15.80	5.15	4.51
query35	4.52	4.49	4.58
query36	0.66	0.51	0.47
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.73 s
Total hot run time: 30.25 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants