Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[test](scanner) Scanner scheduler unit test #47783

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

[test](scanner) Scanner scheduler unit test #47783

wants to merge 4 commits into from
+731 −37

Conversation

zhiqiang-hhhh
Copy link
Contributor

@zhiqiang-hhhh zhiqiang-hhhh commented Feb 11, 2025 •
edited
Loading

What problem does this PR solve?

Unit test for scanner schedule. Adaptive scan schedule is introduced by #44690

  • ScannerContext::init
  • ScannerContext::_push_back_scan_task
  • ScannerContext::_get_margin
  • ScannerContext::_pull_next_scan_task
  • ScannerContext::_schedule_scan_task

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31690 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 377d439b87fd288c1b203b158ea263f577675941, data reload: false

------ Round 1 ----------------------------------
q1	17580	5120	5022	5022
q2	2050	288	177	177
q3	10412	1363	690	690
q4	10212	997	537	537
q5	7530	2416	2366	2366
q6	190	167	131	131
q7	906	751	593	593
q8	9295	1265	1091	1091
q9	4929	4932	4832	4832
q10	6816	2299	1883	1883
q11	487	273	269	269
q12	351	363	215	215
q13	17784	3636	3122	3122
q14	244	223	210	210
q15	509	470	454	454
q16	628	620	578	578
q17	582	873	364	364
q18	6762	6260	6148	6148
q19	1256	964	541	541
q20	323	329	191	191
q21	2830	2203	1965	1965
q22	365	323	311	311
Total cold run time: 102041 ms
Total hot run time: 31690 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5083	5060	5071	5060
q2	240	332	229	229
q3	2175	2628	2278	2278
q4	1464	1870	1382	1382
q5	4240	4178	4177	4177
q6	204	166	126	126
q7	1896	1811	1653	1653
q8	2614	2650	2583	2583
q9	7369	7193	7161	7161
q10	3032	3190	2768	2768
q11	570	512	489	489
q12	691	763	627	627
q13	3476	3910	3250	3250
q14	291	291	274	274
q15	509	461	445	445
q16	628	677	637	637
q17	1148	1583	1355	1355
q18	7686	7379	7385	7379
q19	790	766	827	766
q20	1954	2016	1864	1864
q21	5454	4874	4934	4874
q22	634	609	535	535
Total cold run time: 52148 ms
Total hot run time: 49912 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183783 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 377d439b87fd288c1b203b158ea263f577675941, data reload: false

query1	967	384	382	382
query2	6526	1844	1833	1833
query3	6794	224	204	204
query4	26163	23579	23059	23059
query5	4334	667	468	468
query6	301	210	208	208
query7	4611	501	307	307
query8	300	255	237	237
query9	8576	2469	2477	2469
query10	429	321	245	245
query11	15747	15097	14962	14962
query12	159	104	108	104
query13	1805	517	394	394
query14	8803	6587	6563	6563
query15	219	192	166	166
query16	7124	641	442	442
query17	1061	685	541	541
query18	1951	396	291	291
query19	196	186	145	145
query20	127	112	114	112
query21	205	119	99	99
query22	4296	4361	4248	4248
query23	33859	32907	32908	32907
query24	7695	2406	2407	2406
query25	592	451	388	388
query26	1232	269	151	151
query27	2122	491	330	330
query28	3915	2421	2374	2374
query29	748	538	421	421
query30	232	185	157	157
query31	925	843	792	792
query32	73	60	61	60
query33	548	345	297	297
query34	792	858	510	510
query35	806	822	731	731
query36	976	974	901	901
query37	124	105	81	81
query38	4153	4277	4168	4168
query39	1446	1410	1420	1410
query40	214	122	109	109
query41	61	63	63	63
query42	126	107	106	106
query43	503	509	471	471
query44	1329	821	820	820
query45	174	173	168	168
query46	845	1047	650	650
query47	1762	1804	1738	1738
query48	382	427	298	298
query49	797	533	438	438
query50	669	757	419	419
query51	4140	4190	4128	4128
query52	115	111	99	99
query53	233	257	199	199
query54	499	497	419	419
query55	83	84	82	82
query56	275	287	270	270
query57	1103	1126	1083	1083
query58	269	289	240	240
query59	2814	2844	2642	2642
query60	293	281	247	247
query61	123	123	118	118
query62	797	729	653	653
query63	226	186	188	186
query64	4394	1023	662	662
query65	3255	3122	3152	3122
query66	1144	400	306	306
query67	16011	15640	15557	15557
query68	7967	771	517	517
query69	481	294	262	262
query70	1230	1168	1089	1089
query71	399	283	268	268
query72	5799	3660	3839	3660
query73	746	739	350	350
query74	8897	9529	8683	8683
query75	3165	3189	2681	2681
query76	3181	1192	727	727
query77	482	372	281	281
query78	10013	9968	9335	9335
query79	2535	809	601	601
query80	634	540	443	443
query81	509	287	240	240
query82	667	152	120	120
query83	174	176	150	150
query84	259	94	73	73
query85	784	350	300	300
query86	341	303	301	301
query87	4436	4467	4481	4467
query88	3675	2207	2238	2207
query89	392	308	274	274
query90	1934	194	191	191
query91	141	136	107	107
query92	78	64	56	56
query93	1505	1028	578	578
query94	721	408	280	280
query95	344	264	254	254
query96	482	557	268	268
query97	2837	2846	2690	2690
query98	234	210	200	200
query99	1568	1396	1274	1274
Total cold run time: 270178 ms
Total hot run time: 183783 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.64 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 377d439b87fd288c1b203b158ea263f577675941, data reload: false

query1	0.04	0.04	0.03
query2	0.09	0.04	0.03
query3	0.24	0.07	0.06
query4	1.61	0.10	0.10
query5	0.42	0.40	0.40
query6	1.19	0.66	0.67
query7	0.02	0.01	0.01
query8	0.04	0.04	0.03
query9	0.60	0.51	0.50
query10	0.59	0.58	0.57
query11	0.16	0.11	0.11
query12	0.15	0.11	0.11
query13	0.60	0.59	0.61
query14	2.69	2.70	2.70
query15	0.90	0.85	0.87
query16	0.36	0.37	0.39
query17	1.06	1.03	1.01
query18	0.21	0.20	0.20
query19	1.88	1.82	1.99
query20	0.01	0.01	0.01
query21	15.38	0.90	0.52
query22	0.74	1.39	0.77
query23	14.75	1.36	0.62
query24	7.35	1.18	0.88
query25	0.53	0.24	0.09
query26	0.54	0.16	0.15
query27	0.06	0.05	0.04
query28	9.80	0.83	0.43
query29	12.56	3.92	3.26
query30	0.24	0.08	0.06
query31	2.84	0.58	0.40
query32	3.23	0.56	0.46
query33	3.01	2.96	3.01
query34	15.86	5.04	4.50
query35	4.52	4.52	4.52
query36	0.66	0.49	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.02	0.02	0.02
query40	0.18	0.14	0.14
query41	0.09	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.43 s
Total hot run time: 30.64 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 42.89% (11284/26311)
Line Coverage: 32.83% (94746/288562)
Region Coverage: 31.99% (48573/151817)
Branch Coverage: 27.85% (24488/87936)
Coverage Report: http://coverage.selectdb-in.cc/coverage/377d439b87fd288c1b203b158ea263f577675941_377d439b87fd288c1b203b158ea263f577675941/report/index.html

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

1 similar comment
@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31399 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1bd40fe769bddd320cfaefbde4d630866002c042, data reload: false

------ Round 1 ----------------------------------
q1	17619	5269	5080	5080
q2	2044	312	177	177
q3	10397	1246	758	758
q4	10214	1001	539	539
q5	7515	2450	2263	2263
q6	183	172	132	132
q7	888	736	592	592
q8	9286	1315	1172	1172
q9	4821	4500	4449	4449
q10	6819	2289	1794	1794
q11	467	278	251	251
q12	336	349	215	215
q13	17622	3679	3306	3306
q14	231	239	214	214
q15	539	482	468	468
q16	598	624	585	585
q17	599	861	344	344
q18	7126	6362	6172	6172
q19	1207	953	524	524
q20	305	319	189	189
q21	2849	2122	1869	1869
q22	372	334	306	306
Total cold run time: 102037 ms
Total hot run time: 31399 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5070	5097	5065	5065
q2	234	329	226	226
q3	2148	2694	2318	2318
q4	1420	1836	1390	1390
q5	4181	4147	4136	4136
q6	205	164	126	126
q7	1862	1843	1663	1663
q8	2581	2551	2498	2498
q9	7150	7133	7142	7133
q10	2991	3184	2758	2758
q11	567	517	526	517
q12	671	788	589	589
q13	3528	3795	3225	3225
q14	272	292	290	290
q15	519	470	453	453
q16	635	675	619	619
q17	1116	1611	1322	1322
q18	7622	7329	7422	7329
q19	777	851	998	851
q20	1946	2003	1850	1850
q21	5336	5001	4908	4908
q22	633	565	556	556
Total cold run time: 51464 ms
Total hot run time: 49822 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189230 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1bd40fe769bddd320cfaefbde4d630866002c042, data reload: false

query1	1299	932	929	929
query2	6235	1813	1793	1793
query3	10960	4506	4357	4357
query4	56426	25365	23159	23159
query5	5173	504	491	491
query6	391	192	203	192
query7	5227	520	287	287
query8	349	254	240	240
query9	6784	2539	2540	2539
query10	413	310	251	251
query11	15263	15088	14871	14871
query12	164	110	106	106
query13	1225	530	417	417
query14	10093	6248	7314	6248
query15	218	216	185	185
query16	7097	667	493	493
query17	1088	730	585	585
query18	1502	408	309	309
query19	192	185	175	175
query20	120	123	122	122
query21	200	129	105	105
query22	4577	4545	4243	4243
query23	34070	33383	33272	33272
query24	5595	2428	2425	2425
query25	447	466	389	389
query26	674	276	155	155
query27	1686	497	340	340
query28	2831	2503	2488	2488
query29	563	564	433	433
query30	228	201	162	162
query31	950	868	835	835
query32	80	74	59	59
query33	464	367	302	302
query34	759	846	518	518
query35	814	817	783	783
query36	972	1020	925	925
query37	124	97	77	77
query38	4235	4293	4252	4252
query39	1484	1435	1424	1424
query40	204	110	96	96
query41	51	50	48	48
query42	116	103	107	103
query43	481	503	471	471
query44	1267	783	788	783
query45	177	171	162	162
query46	884	1054	665	665
query47	1841	1852	1775	1775
query48	406	420	324	324
query49	698	512	411	411
query50	709	753	427	427
query51	4243	4515	4261	4261
query52	108	101	95	95
query53	246	280	199	199
query54	478	484	421	421
query55	83	88	82	82
query56	269	278	247	247
query57	1164	1154	1119	1119
query58	252	243	241	241
query59	2735	2697	2623	2623
query60	291	271	273	271
query61	114	115	118	115
query62	746	741	681	681
query63	242	197	203	197
query64	1479	1002	663	663
query65	3344	3236	3182	3182
query66	760	397	291	291
query67	15867	15571	15262	15262
query68	5377	785	516	516
query69	528	304	266	266
query70	1173	1118	1135	1118
query71	436	283	256	256
query72	5939	3625	3758	3625
query73	1065	747	356	356
query74	9168	9082	8964	8964
query75	3449	3165	2712	2712
query76	3768	1167	750	750
query77	551	355	280	280
query78	9915	9965	9307	9307
query79	2447	835	615	615
query80	667	526	446	446
query81	521	286	245	245
query82	687	125	92	92
query83	183	175	150	150
query84	288	93	75	75
query85	794	357	303	303
query86	434	297	292	292
query87	4524	4658	4301	4301
query88	3779	2218	2174	2174
query89	421	322	288	288
query90	1904	197	194	194
query91	134	150	110	110
query92	74	56	55	55
query93	1954	999	581	581
query94	651	416	299	299
query95	355	275	261	261
query96	494	543	277	277
query97	2835	2767	2663	2663
query98	214	210	193	193
query99	1601	1389	1315	1315
Total cold run time: 296557 ms
Total hot run time: 189230 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 43.07% (11334/26314)
Line Coverage: 32.98% (95163/288574)
Region Coverage: 32.15% (48816/151828)
Branch Coverage: 28.01% (24630/87946)
Coverage Report: http://coverage.selectdb-in.cc/coverage/1bd40fe769bddd320cfaefbde4d630866002c042_1bd40fe769bddd320cfaefbde4d630866002c042/report/index.html

@doris-robot
Copy link

ClickBench: Total hot run time: 30.4 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1bd40fe769bddd320cfaefbde4d630866002c042, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.07
query4	1.62	0.10	0.10
query5	0.40	0.41	0.41
query6	1.18	0.65	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.60	0.51	0.52
query10	0.57	0.58	0.58
query11	0.16	0.11	0.10
query12	0.15	0.11	0.10
query13	0.62	0.59	0.60
query14	2.66	2.82	2.71
query15	0.93	0.83	0.84
query16	0.38	0.38	0.37
query17	1.01	1.05	1.01
query18	0.22	0.19	0.19
query19	1.97	1.84	2.04
query20	0.01	0.02	0.02
query21	15.35	0.90	0.54
query22	0.75	1.20	0.66
query23	14.98	1.36	0.64
query24	6.60	1.48	0.76
query25	0.50	0.32	0.10
query26	0.62	0.17	0.14
query27	0.05	0.05	0.05
query28	9.59	0.92	0.42
query29	12.54	3.93	3.26
query30	0.25	0.09	0.06
query31	2.83	0.58	0.38
query32	3.23	0.54	0.47
query33	2.98	2.97	3.02
query34	15.65	5.15	4.48
query35	4.52	4.48	4.56
query36	0.65	0.49	0.49
query37	0.09	0.06	0.07
query38	0.06	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.02	0.03
query42	0.03	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 104.46 s
Total hot run time: 30.4 s

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@zhiqiang-hhhh zhiqiang-hhhh marked this pull request as ready for review February 13, 2025 01:49
@zhiqiang-hhhh zhiqiang-hhhh changed the title [WIP](test) Scanner scheduler test [test](scanner) Scanner scheduler unit test Feb 13, 2025
@doris-robot
Copy link

TPC-H: Total hot run time: 31109 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2ba0da519241e782245e823f9384441db4baf9e3, data reload: false

------ Round 1 ----------------------------------
q1	17585	5309	5063	5063
q2	2046	303	170	170
q3	10513	1242	760	760
q4	10227	1018	537	537
q5	7564	2424	2332	2332
q6	187	162	133	133
q7	906	747	602	602
q8	9304	1378	1160	1160
q9	4794	4404	4575	4404
q10	6864	2331	1879	1879
q11	496	278	245	245
q12	356	349	215	215
q13	17770	3701	3038	3038
q14	221	220	210	210
q15	507	462	464	462
q16	629	621	584	584
q17	572	854	342	342
q18	7157	6075	6189	6075
q19	1356	957	523	523
q20	296	319	186	186
q21	2808	2182	1900	1900
q22	356	334	289	289
Total cold run time: 102514 ms
Total hot run time: 31109 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5096	5033	5041	5033
q2	233	321	235	235
q3	2169	2673	2299	2299
q4	1406	1813	1366	1366
q5	4199	4105	4109	4105
q6	248	169	126	126
q7	1864	1861	1645	1645
q8	2584	2696	2533	2533
q9	7146	7136	7146	7136
q10	3023	3175	2798	2798
q11	563	502	504	502
q12	690	767	645	645
q13	3570	3813	3301	3301
q14	283	300	282	282
q15	508	469	467	467
q16	661	715	644	644
q17	1102	1590	1347	1347
q18	7528	7333	7248	7248
q19	780	796	964	796
q20	2004	2048	1873	1873
q21	5326	4955	4823	4823
q22	676	578	528	528
Total cold run time: 51659 ms
Total hot run time: 49732 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189880 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2ba0da519241e782245e823f9384441db4baf9e3, data reload: false

query1	1291	932	956	932
query2	6229	1794	1791	1791
query3	10947	4426	4488	4426
query4	56359	24811	23302	23302
query5	5174	498	503	498
query6	390	203	190	190
query7	5255	512	292	292
query8	325	255	234	234
query9	6703	2536	2554	2536
query10	420	302	241	241
query11	15097	15214	14889	14889
query12	155	108	105	105
query13	1222	491	371	371
query14	10858	6924	6562	6562
query15	199	196	183	183
query16	7035	629	489	489
query17	1059	692	551	551
query18	1516	403	310	310
query19	201	191	166	166
query20	129	127	124	124
query21	207	125	105	105
query22	4582	4644	4409	4409
query23	33877	33323	33311	33311
query24	5622	2426	2448	2426
query25	469	467	417	417
query26	681	287	166	166
query27	1829	492	344	344
query28	2875	2496	2465	2465
query29	604	581	453	453
query30	220	193	154	154
query31	885	845	800	800
query32	83	64	68	64
query33	451	375	314	314
query34	730	850	521	521
query35	803	849	754	754
query36	965	1008	892	892
query37	120	96	78	78
query38	4256	4412	4283	4283
query39	1457	1438	1483	1438
query40	213	119	103	103
query41	54	57	52	52
query42	119	111	110	110
query43	488	519	471	471
query44	1275	798	818	798
query45	176	182	165	165
query46	878	1062	645	645
query47	1891	1905	1786	1786
query48	396	416	323	323
query49	688	491	418	418
query50	709	751	435	435
query51	4266	4227	4234	4227
query52	110	104	95	95
query53	234	252	188	188
query54	479	495	412	412
query55	84	79	85	79
query56	266	269	240	240
query57	1157	1178	1081	1081
query58	233	244	236	236
query59	2620	2842	2624	2624
query60	297	276	260	260
query61	121	123	119	119
query62	762	736	660	660
query63	235	190	185	185
query64	1420	1062	677	677
query65	3298	3157	3113	3113
query66	708	393	301	301
query67	15926	15787	15288	15288
query68	5339	776	565	565
query69	527	315	260	260
query70	1204	1080	1088	1080
query71	456	284	273	273
query72	5543	3537	3445	3445
query73	1068	723	356	356
query74	9054	9123	9159	9123
query75	3438	3139	2775	2775
query76	3802	1167	732	732
query77	545	393	314	314
query78	10153	10192	9264	9264
query79	1522	909	596	596
query80	781	555	449	449
query81	518	273	241	241
query82	414	125	97	97
query83	177	173	152	152
query84	356	99	72	72
query85	720	369	300	300
query86	315	308	283	283
query87	4526	4450	4514	4450
query88	2881	2180	2159	2159
query89	400	321	273	273
query90	1710	194	188	188
query91	136	140	108	108
query92	63	58	57	57
query93	1513	1012	574	574
query94	588	382	303	303
query95	346	258	252	252
query96	504	550	280	280
query97	2766	2859	2713	2713
query98	220	204	200	200
query99	1309	1391	1269	1269
Total cold run time: 293277 ms
Total hot run time: 189880 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.4 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2ba0da519241e782245e823f9384441db4baf9e3, data reload: false

query1	0.04	0.03	0.03
query2	0.10	0.03	0.03
query3	0.24	0.06	0.07
query4	1.63	0.10	0.11
query5	0.42	0.40	0.39
query6	1.17	0.65	0.66
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.60	0.53	0.53
query10	0.57	0.56	0.57
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.62	0.60	0.62
query14	2.72	2.71	2.71
query15	0.92	0.85	0.86
query16	0.36	0.38	0.37
query17	1.05	0.99	1.02
query18	0.21	0.20	0.20
query19	1.87	1.86	2.01
query20	0.01	0.01	0.01
query21	15.35	0.91	0.54
query22	0.74	1.18	0.70
query23	14.90	1.35	0.65
query24	7.04	1.31	0.64
query25	0.52	0.30	0.07
query26	0.53	0.16	0.14
query27	0.05	0.05	0.04
query28	8.90	0.90	0.44
query29	12.55	4.00	3.30
query30	0.25	0.09	0.06
query31	2.82	0.58	0.38
query32	3.23	0.53	0.46
query33	3.03	3.03	3.00
query34	15.89	5.08	4.49
query35	4.55	4.50	4.56
query36	0.69	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.18	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 104.43 s
Total hot run time: 30.4 s

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31180 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4432f1cc6cb6cad559db5f2c5f8435832592aa34, data reload: false

------ Round 1 ----------------------------------
q1	17710	5262	5029	5029
q2	2046	296	167	167
q3	10444	1205	739	739
q4	10215	1042	525	525
q5	7514	2431	2255	2255
q6	190	168	134	134
q7	897	749	598	598
q8	9304	1333	1194	1194
q9	4894	4462	4439	4439
q10	6809	2315	1896	1896
q11	450	272	253	253
q12	346	359	220	220
q13	17767	3635	3126	3126
q14	232	245	205	205
q15	518	455	457	455
q16	644	621	588	588
q17	574	860	327	327
q18	6565	6073	6088	6073
q19	1202	941	532	532
q20	292	321	190	190
q21	2806	2242	1914	1914
q22	361	335	321	321
Total cold run time: 101780 ms
Total hot run time: 31180 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5114	5114	5119	5114
q2	234	331	231	231
q3	2146	2663	2343	2343
q4	1444	1872	1423	1423
q5	4199	4119	4195	4119
q6	206	166	124	124
q7	1881	1809	1629	1629
q8	2534	2542	2485	2485
q9	7231	7204	7246	7204
q10	3024	3186	2775	2775
q11	549	517	511	511
q12	714	780	632	632
q13	3549	3878	3300	3300
q14	289	299	265	265
q15	525	471	482	471
q16	633	693	637	637
q17	1121	1595	1343	1343
q18	7473	7286	7239	7239
q19	777	752	833	752
q20	1944	1998	1976	1976
q21	5380	5002	4885	4885
q22	603	568	547	547
Total cold run time: 51570 ms
Total hot run time: 50005 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190875 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4432f1cc6cb6cad559db5f2c5f8435832592aa34, data reload: false

query1	1288	929	918	918
query2	6215	1859	1901	1859
query3	11073	4785	4428	4428
query4	57271	24671	23388	23388
query5	5137	525	461	461
query6	362	194	190	190
query7	5222	515	299	299
query8	329	246	228	228
query9	6672	2605	2594	2594
query10	411	306	243	243
query11	15125	15026	15075	15026
query12	164	108	107	107
query13	1209	532	394	394
query14	10070	6992	6798	6798
query15	207	195	197	195
query16	7058	682	495	495
query17	1086	750	571	571
query18	1532	411	314	314
query19	209	192	168	168
query20	130	123	128	123
query21	209	139	108	108
query22	4449	4603	4559	4559
query23	33988	33128	33545	33128
query24	5740	2455	2399	2399
query25	457	456	387	387
query26	702	286	152	152
query27	1762	491	354	354
query28	2854	2480	2453	2453
query29	569	556	418	418
query30	228	187	155	155
query31	934	889	844	844
query32	72	58	56	56
query33	441	372	305	305
query34	738	847	499	499
query35	816	834	766	766
query36	977	1017	927	927
query37	121	101	77	77
query38	4263	4253	4306	4253
query39	1465	1417	1616	1417
query40	215	116	105	105
query41	52	47	54	47
query42	128	105	109	105
query43	506	514	488	488
query44	1338	794	823	794
query45	178	168	163	163
query46	863	1053	667	667
query47	1848	1850	1779	1779
query48	387	417	311	311
query49	688	493	413	413
query50	706	781	438	438
query51	4318	4268	4194	4194
query52	104	103	102	102
query53	235	265	189	189
query54	482	501	421	421
query55	79	81	80	80
query56	283	280	254	254
query57	1139	1205	1132	1132
query58	256	241	251	241
query59	2736	2841	2731	2731
query60	282	293	259	259
query61	126	126	117	117
query62	765	749	701	701
query63	228	191	189	189
query64	1460	1072	681	681
query65	3245	3156	3128	3128
query66	720	397	295	295
query67	15672	15957	15485	15485
query68	5292	773	545	545
query69	519	309	264	264
query70	1252	1083	1130	1083
query71	431	297	256	256
query72	6334	3641	3768	3641
query73	1042	742	354	354
query74	8913	9324	8919	8919
query75	3293	3151	2717	2717
query76	3844	1179	732	732
query77	548	374	276	276
query78	10242	10221	9384	9384
query79	2689	829	608	608
query80	823	525	462	462
query81	531	270	240	240
query82	503	122	98	98
query83	175	167	150	150
query84	284	94	73	73
query85	795	340	307	307
query86	450	279	278	278
query87	4522	4530	4439	4439
query88	3934	2200	2194	2194
query89	416	313	293	293
query90	1810	193	197	193
query91	136	139	105	105
query92	72	55	57	55
query93	2697	996	583	583
query94	686	418	304	304
query95	340	270	269	269
query96	499	561	278	278
query97	2838	2874	2771	2771
query98	224	203	198	198
query99	1320	1364	1241	1241
Total cold run time: 298048 ms
Total hot run time: 190875 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.59 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4432f1cc6cb6cad559db5f2c5f8435832592aa34, data reload: false

query1	0.04	0.05	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.62	0.10	0.10
query5	0.42	0.40	0.39
query6	1.16	0.67	0.66
query7	0.03	0.02	0.01
query8	0.04	0.03	0.04
query9	0.61	0.52	0.51
query10	0.58	0.59	0.57
query11	0.15	0.10	0.11
query12	0.15	0.11	0.11
query13	0.62	0.60	0.61
query14	2.78	2.72	2.79
query15	0.92	0.86	0.85
query16	0.37	0.36	0.37
query17	1.04	1.02	1.05
query18	0.22	0.19	0.19
query19	1.85	1.85	2.02
query20	0.01	0.01	0.01
query21	15.39	0.90	0.57
query22	0.74	1.31	0.93
query23	14.69	1.37	0.66
query24	7.21	1.32	1.34
query25	0.47	0.20	0.24
query26	0.60	0.16	0.15
query27	0.05	0.05	0.05
query28	9.92	0.84	0.44
query29	12.59	3.93	3.26
query30	0.26	0.09	0.06
query31	2.82	0.58	0.39
query32	3.22	0.54	0.47
query33	2.96	2.96	3.10
query34	15.78	5.16	4.56
query35	4.57	4.58	4.57
query36	0.69	0.50	0.49
query37	0.10	0.06	0.07
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.07	0.02	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 105.37 s
Total hot run time: 31.59 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 43.07% (11334/26314)
Line Coverage: 32.97% (95153/288574)
Region Coverage: 32.15% (48811/151828)
Branch Coverage: 27.99% (24615/87946)
Coverage Report: http://coverage.selectdb-in.cc/coverage/4432f1cc6cb6cad559db5f2c5f8435832592aa34_4432f1cc6cb6cad559db5f2c5f8435832592aa34/report/index.html

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31605 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bb43252e710220da1bade019ea2fde76b3638fb4, data reload: false

------ Round 1 ----------------------------------
q1	17573	5369	5140	5140
q2	2051	289	172	172
q3	10418	1301	752	752
q4	10208	1031	536	536
q5	7525	2496	2287	2287
q6	189	170	133	133
q7	913	759	598	598
q8	9295	1366	1133	1133
q9	4830	4627	4611	4611
q10	6834	2336	1902	1902
q11	488	283	263	263
q12	356	360	220	220
q13	17772	3681	3108	3108
q14	231	233	209	209
q15	516	471	459	459
q16	626	607	575	575
q17	590	868	353	353
q18	6829	6214	6168	6168
q19	1204	948	580	580
q20	311	318	186	186
q21	2872	2121	1926	1926
q22	366	331	294	294
Total cold run time: 101997 ms
Total hot run time: 31605 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5164	5187	5200	5187
q2	232	326	229	229
q3	2136	2712	2300	2300
q4	1414	1835	1364	1364
q5	4239	4115	4143	4115
q6	211	168	125	125
q7	1869	1833	1657	1657
q8	2667	2626	2583	2583
q9	7165	7265	7190	7190
q10	3026	3213	2790	2790
q11	566	517	494	494
q12	686	740	617	617
q13	3448	3989	3267	3267
q14	272	297	273	273
q15	494	466	461	461
q16	651	681	630	630
q17	1155	1629	1325	1325
q18	7720	7467	7347	7347
q19	829	883	1043	883
q20	1951	2084	1888	1888
q21	5447	5078	4731	4731
q22	609	551	533	533
Total cold run time: 51951 ms
Total hot run time: 49989 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190802 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bb43252e710220da1bade019ea2fde76b3638fb4, data reload: false

query1	1299	966	929	929
query2	6231	1868	1846	1846
query3	11011	4320	4433	4320
query4	56789	25506	23776	23776
query5	5196	509	486	486
query6	390	196	201	196
query7	5323	526	304	304
query8	330	241	235	235
query9	7113	2583	2590	2583
query10	419	308	254	254
query11	15151	15030	14962	14962
query12	155	103	103	103
query13	1263	509	381	381
query14	10938	6265	6940	6265
query15	209	193	186	186
query16	7085	664	481	481
query17	1034	706	565	565
query18	1548	436	316	316
query19	202	209	164	164
query20	133	124	129	124
query21	207	132	108	108
query22	4384	4582	4276	4276
query23	34236	33477	33494	33477
query24	5868	2404	2459	2404
query25	458	483	404	404
query26	692	287	155	155
query27	1792	527	353	353
query28	2833	2494	2446	2446
query29	568	560	427	427
query30	217	184	153	153
query31	858	871	821	821
query32	76	62	64	62
query33	433	362	295	295
query34	740	877	552	552
query35	820	895	774	774
query36	979	1006	925	925
query37	121	95	71	71
query38	4295	4455	4268	4268
query39	1490	1426	1407	1407
query40	209	113	106	106
query41	52	49	49	49
query42	124	109	103	103
query43	497	522	499	499
query44	1371	857	836	836
query45	184	173	170	170
query46	894	1043	658	658
query47	1788	1878	1803	1803
query48	409	436	320	320
query49	701	533	407	407
query50	727	758	424	424
query51	4264	4279	4262	4262
query52	110	117	96	96
query53	236	269	197	197
query54	481	501	435	435
query55	82	85	80	80
query56	274	303	263	263
query57	1179	1195	1105	1105
query58	261	264	257	257
query59	2823	2867	2653	2653
query60	304	304	282	282
query61	146	141	141	141
query62	746	719	677	677
query63	238	200	196	196
query64	1528	1094	764	764
query65	3212	3111	3137	3111
query66	706	391	308	308
query67	15975	15612	15326	15326
query68	5121	788	537	537
query69	510	293	256	256
query70	1172	1149	1020	1020
query71	440	291	265	265
query72	6275	3657	3744	3657
query73	921	745	352	352
query74	9173	9250	9130	9130
query75	3457	3183	2711	2711
query76	3658	1168	734	734
query77	530	357	278	278
query78	10020	10031	9361	9361
query79	2069	808	638	638
query80	814	515	494	494
query81	533	276	238	238
query82	388	122	101	101
query83	175	169	153	153
query84	280	88	73	73
query85	731	354	300	300
query86	379	305	288	288
query87	4468	4521	4340	4340
query88	3495	2203	2216	2203
query89	385	332	293	293
query90	1913	194	192	192
query91	133	138	108	108
query92	69	65	53	53
query93	2768	994	583	583
query94	659	406	291	291
query95	343	268	257	257
query96	493	564	280	280
query97	2763	2912	2768	2768
query98	233	204	205	204
query99	1326	1380	1262	1262
Total cold run time: 298101 ms
Total hot run time: 190802 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.11 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bb43252e710220da1bade019ea2fde76b3638fb4, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.03	0.03
query3	0.23	0.08	0.07
query4	1.61	0.10	0.10
query5	0.42	0.40	0.39
query6	1.13	0.68	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.60	0.51	0.52
query10	0.58	0.57	0.57
query11	0.15	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.60
query14	2.66	2.80	2.67
query15	0.92	0.84	0.84
query16	0.37	0.37	0.37
query17	1.02	1.06	1.04
query18	0.21	0.20	0.19
query19	1.86	1.81	2.03
query20	0.01	0.02	0.01
query21	15.39	0.90	0.55
query22	0.76	1.22	0.76
query23	14.81	1.36	0.66
query24	12.53	0.98	0.38
query25	0.31	0.11	0.10
query26	0.57	0.20	0.12
query27	0.06	0.04	0.04
query28	5.99	0.81	0.43
query29	12.57	3.92	3.24
query30	0.26	0.09	0.06
query31	2.80	0.59	0.39
query32	3.24	0.55	0.47
query33	3.09	2.98	3.03
query34	15.94	5.08	4.47
query35	4.53	4.52	4.51
query36	0.66	0.49	0.50
query37	0.09	0.06	0.07
query38	0.05	0.05	0.03
query39	0.03	0.03	0.02
query40	0.16	0.13	0.14
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.67 s
Total hot run time: 30.11 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 43.10% (11342/26314)
Line Coverage: 32.99% (95185/288540)
Region Coverage: 32.15% (48811/151832)
Branch Coverage: 27.99% (24621/87952)
Coverage Report: http://coverage.selectdb-in.cc/coverage/bb43252e710220da1bade019ea2fde76b3638fb4_bb43252e710220da1bade019ea2fde76b3638fb4/report/index.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@zhiqiang-hhhh @hello-stephen @doris-robot