Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](snapshot) Restore convert rowset meta tablet id #29478

Merged

Conversation

w41ter
Copy link
Contributor

@w41ter w41ter commented Jan 3, 2024

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

@w41ter
Copy link
Contributor Author

w41ter commented Jan 3, 2024

run buildall

Copy link
Contributor

github-actions bot commented Jan 3, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.62% (8615/23524)
Line Coverage: 28.67% (70013/244171)
Region Coverage: 27.66% (36241/131041)
Branch Coverage: 24.36% (18515/76020)
Coverage Report: http://coverage.selectdb-in.cc/coverage/46760bc22ca7879dd549bc48a401d8687ab1a83c_46760bc22ca7879dd549bc48a401d8687ab1a83c/report/index.html

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit 46760bc22ca7879dd549bc48a401d8687ab1a83c, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5462	5131	5078	5078
q2	386	169	157	157
q3	1458	1162	1181	1162
q4	1088	822	776	776
q5	3112	3119	3099	3099
q6	236	131	128	128
q7	963	545	528	528
q8	2154	2233	2283	2233
q9	6691	6660	6645	6645
q10	3137	3095	3110	3095
q11	356	227	213	213
q12	379	232	235	232
q13	4392	3684	3645	3645
q14	246	230	212	212
q15	606	556	550	550
q16	459	396	403	396
q17	1039	601	562	562
q18	7066	6825	6812	6812
q19	1636	1519	1548	1519
q20	602	333	333	333
q21	2892	2491	2497	2491
q22	398	319	331	319
Total cold run time: 44758 ms
Total hot run time: 40185 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	5155	5001	5043	5001
q2	335	233	248	233
q3	3407	3322	3336	3322
q4	2118	1989	1995	1989
q5	5958	5933	5955	5933
q6	226	124	129	124
q7	2394	1921	1921	1921
q8	3576	3657	3687	3657
q9	9090	8965	8998	8965
q10	3883	3913	3910	3910
q11	593	488	482	482
q12	812	628	643	628
q13	3864	3225	3173	3173
q14	299	276	276	276
q15	616	541	545	541
q16	556	531	542	531
q17	2034	1838	1818	1818
q18	8790	8365	8389	8365
q19	1744	1649	1671	1649
q20	2277	1981	1990	1981
q21	5742	5317	5354	5317
q22	572	511	485	485
Total cold run time: 64041 ms
Total hot run time: 60301 ms

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit 46760bc22ca7879dd549bc48a401d8687ab1a83c, data reload: false

------ Round 1 ----------------------------------
q1	17657	5065	5128	5065
q2	2023	156	144	144
q3	10535	1079	1140	1079
q4	10172	762	802	762
q5	7776	2946	2871	2871
q6	219	135	132	132
q7	933	530	516	516
q8	9258	2003	2004	2003
q9	6812	6387	6367	6367
q10	8265	3054	3042	3042
q11	435	224	209	209
q12	387	232	232	232
q13	17977	3594	3584	3584
q14	246	204	212	204
q15	583	549	529	529
q16	448	384	390	384
q17	948	546	516	516
q18	7244	6621	6628	6621
q19	1571	1402	1293	1293
q20	699	321	335	321
q21	2762	2315	2363	2315
q22	367	333	328	328
Total cold run time: 107317 ms
Total hot run time: 38517 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5081	5038	5078	5038
q2	342	244	252	244
q3	3303	3281	3274	3274
q4	2116	1996	1998	1996
q5	5805	5790	5809	5790
q6	218	124	122	122
q7	2314	1885	1898	1885
q8	3368	3422	3470	3422
q9	8796	8752	8804	8752
q10	3798	3868	3824	3824
q11	590	479	476	476
q12	811	637	668	637
q13	6980	3156	3171	3156
q14	291	285	266	266
q15	594	542	535	535
q16	542	512	494	494
q17	1910	1775	1753	1753
q18	8693	8364	8244	8244
q19	1607	1558	1535	1535
q20	2245	2004	1981	1981
q21	5749	5387	5332	5332
q22	507	449	473	449
Total cold run time: 65660 ms
Total hot run time: 59205 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.13 seconds
stream load tsv: 565 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.2 seconds inserted 10000000 Rows, about 354K ops/s
storage size: 17183829830 Bytes

@doris-robot
Copy link

TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools

TPC-DS sf100 test result on commit 46760bc22ca7879dd549bc48a401d8687ab1a83c, data reload: false

run tpcds-sf100 query with default conf and session variables
query1	915	349	335	335
query2	6424	1970	1920	1920
query3	6656	206	201	201
query4	27157	22346	22290	22290
query5	4813	509	496	496
query6	282	196	190	190
query7	4578	282	267	267
query8	235	201	195	195
query9	8199	2674	2605	2605
query10	444	253	242	242
query11	16129	15588	15466	15466
query12	136	78	74	74
query13	1627	323	330	323
query14	11616	7237	7171	7171
query15	227	181	196	181
query16	6492	272	267	267
query17	1834	510	504	504
query18	1931	282	263	263
query19	234	146	145	145
query20	81	79	80	79
query21	185	101	98	98
query22	5299	4889	4790	4790
query23	32069	31273	31208	31208
query24	11007	2857	2792	2792
query25	591	353	343	343
query26	1493	147	152	147
query27	2877	279	279	279
query28	6990	1945	1946	1945
query29	1321	388	394	388
query30	281	140	140	140
query31	978	782	782	782
query32	92	62	58	58
query33	724	279	274	274
query34	836	440	448	440
query35	859	775	738	738
query36	1383	1232	1236	1232
query37	100	72	73	72
query38	3410	3293	3277	3277
query39	1315	1282	1268	1268
query40	193	97	89	89
query41	39	38	36	36
query42	98	89	95	89
query43	555	527	487	487
query44	1126	717	733	717
query45	195	188	180	180
query46	1069	647	650	647
query47	1713	1605	1635	1605
query48	330	264	264	264
query49	1094	325	316	316
query50	740	380	329	329
query51	5384	5324	5221	5221
query52	94	83	90	83
query53	220	157	157	157
query54	1368	573	571	571
query55	95	85	95	85
query56	213	207	210	207
query57	1029	946	966	946
query58	218	200	197	197
query59	2883	2731	2709	2709
query60	255	244	252	244
query61	89	87	88	87
query62	694	456	464	456
query63	169	156	156	156
query64	5005	1792	1723	1723
query65	3330	3256	3278	3256
query66	1173	350	327	327
query67	15599	15627	15186	15186
query68	11412	533	552	533
query69	526	255	258	255
query70	1729	1529	1532	1529
query71	491	224	223	223
query72	5740	3665	3612	3612
query73	2341	312	318	312
query74	7026	6433	6530	6433
query75	4921	2249	2262	2249
query76	6286	1087	1130	1087
query77	687	290	268	268
query78	9173	8688	8676	8676
query79	1053	506	507	506
query80	587	380	372	372
query81	471	205	214	205
query82	208	103	102	102
query83	169	138	138	138
query84	249	54	53	53
query85	927	312	290	290
query86	396	391	371	371
query87	3592	3438	3397	3397
query88	2908	2307	2295	2295
query89	350	256	277	256
query90	1872	198	227	198
query91	119	92	92	92
query92	60	52	54	52
query93	2176	509	442	442
query94	781	190	189	189
query95	461	409	409	409
query96	639	320	315	315
query97	4280	4131	4191	4131
query98	207	199	186	186
query99	1124	855	854	854
Total cold run time: 289751 ms
Total hot run time: 179885 ms

@w41ter
Copy link
Contributor Author

w41ter commented Jan 4, 2024

run buildall

@w41ter w41ter force-pushed the fix/restore_rowset_meta_set_tablet_id branch from 423739b to 58ffef2 Compare January 4, 2024 02:03
@w41ter
Copy link
Contributor Author

w41ter commented Jan 4, 2024

run buildall

Copy link
Contributor

github-actions bot commented Jan 4, 2024

clang-tidy review says "All clean, LGTM! 👍"

1 similar comment
Copy link
Contributor

github-actions bot commented Jan 4, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit 58ffef2a3574a85750211809bdeeccd9a241c4b6, data reload: false

------ Round 1 ----------------------------------
q1	18130	5237	5103	5103
q2	2024	159	139	139
q3	10619	1075	1100	1075
q4	10253	828	816	816
q5	7796	2941	2857	2857
q6	213	136	135	135
q7	910	536	506	506
q8	9258	2002	2004	2002
q9	6845	6365	6354	6354
q10	8206	3052	3030	3030
q11	430	212	202	202
q12	393	232	236	232
q13	18010	3663	3659	3659
q14	235	222	208	208
q15	562	517	508	508
q16	446	403	392	392
q17	946	479	528	479
q18	7296	6679	6632	6632
q19	1566	1401	1282	1282
q20	681	334	338	334
q21	2786	2341	2435	2341
q22	361	308	324	308
Total cold run time: 107966 ms
Total hot run time: 38594 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5117	5075	5017	5017
q2	327	231	233	231
q3	3299	3300	3335	3300
q4	2120	2017	2003	2003
q5	5779	5783	5777	5777
q6	215	125	128	125
q7	2283	1907	1928	1907
q8	3366	3436	3429	3429
q9	8784	8731	8693	8693
q10	3786	3845	3833	3833
q11	590	461	475	461
q12	812	628	649	628
q13	7994	3240	3185	3185
q14	281	272	268	268
q15	576	518	519	518
q16	541	484	493	484
q17	1967	1783	1758	1758
q18	8581	8347	8269	8269
q19	1612	1586	1569	1569
q20	2197	1944	1938	1938
q21	5521	5294	5350	5294
q22	518	510	482	482
Total cold run time: 66266 ms
Total hot run time: 59169 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.65% (8618/23517)
Line Coverage: 28.68% (70033/244157)
Region Coverage: 27.65% (36242/131051)
Branch Coverage: 24.35% (18512/76022)
Coverage Report: http://coverage.selectdb-in.cc/coverage/58ffef2a3574a85750211809bdeeccd9a241c4b6_58ffef2a3574a85750211809bdeeccd9a241c4b6/report/index.html

@doris-robot
Copy link

TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools

TPC-DS sf100 test result on commit 58ffef2a3574a85750211809bdeeccd9a241c4b6, data reload: false

run tpcds-sf100 query with default conf and session variables
query1	911	348	335	335
query2	6429	1902	1866	1866
query3	6654	215	206	206
query4	26627	22524	22436	22436
query5	3894	541	592	541
query6	265	188	192	188
query7	4602	298	269	269
query8	232	218	199	199
query9	8284	2601	2493	2493
query10	482	252	256	252
query11	16234	15327	15503	15327
query12	129	79	76	76
query13	1642	324	326	324
query14	11200	7118	7091	7091
query15	224	193	207	193
query16	6402	285	275	275
query17	1864	524	513	513
query18	1971	275	275	275
query19	184	142	140	140
query20	79	75	77	75
query21	186	98	99	98
query22	4923	4716	4774	4716
query23	32111	31322	31224	31224
query24	12241	2854	2848	2848
query25	614	378	353	353
query26	1761	146	150	146
query27	2890	280	276	276
query28	6837	1905	1907	1905
query29	2113	395	393	393
query30	296	150	149	149
query31	999	759	767	759
query32	95	59	56	56
query33	734	265	262	262
query34	904	458	453	453
query35	900	810	787	787
query36	1244	1205	1201	1201
query37	183	68	70	68
query38	3394	3279	3272	3272
query39	1322	1305	1276	1276
query40	302	95	92	92
query41	39	37	35	35
query42	93	88	87	87
query43	530	483	502	483
query44	1083	713	727	713
query45	202	193	179	179
query46	1080	661	666	661
query47	1578	1526	1526	1526
query48	343	272	267	267
query49	1213	322	332	322
query50	792	389	401	389
query51	5345	5284	5213	5213
query52	98	90	93	90
query53	226	153	159	153
query54	1477	582	582	582
query55	99	81	89	81
query56	183	191	195	191
query57	1014	922	952	922
query58	220	208	203	203
query59	2766	2603	2582	2582
query60	229	218	214	214
query61	90	90	88	88
query62	654	446	455	446
query63	175	148	151	148
query64	5937	1756	1717	1717
query65	3330	3255	3271	3255
query66	1407	353	333	333
query67	15806	15462	15204	15204
query68	10857	536	532	532
query69	499	256	260	256
query70	1704	1456	1523	1456
query71	492	225	219	219
query72	5704	3650	3654	3650
query73	2104	317	314	314
query74	7010	6387	6445	6387
query75	4774	2276	2263	2263
query76	6255	1125	1130	1125
query77	667	245	252	245
query78	9162	8568	8578	8568
query79	1973	495	492	492
query80	682	371	344	344
query81	465	207	211	207
query82	208	97	90	90
query83	164	137	142	137
query84	243	58	54	54
query85	1027	301	286	286
query86	381	391	387	387
query87	3578	3368	3346	3346
query88	3241	2269	2265	2265
query89	357	262	264	262
query90	1923	198	199	198
query91	122	90	102	90
query92	58	53	52	52
query93	3377	517	450	450
query94	824	184	179	179
query95	450	414	401	401
query96	639	317	321	317
query97	4256	4148	4209	4148
query98	208	192	192	192
query99	1091	807	839	807
Total cold run time: 292862 ms
Total hot run time: 179211 ms

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit 58ffef2a3574a85750211809bdeeccd9a241c4b6, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5473	5053	5072	5053
q2	390	164	197	164
q3	1464	1085	1096	1085
q4	1079	793	805	793
q5	3126	3151	3124	3124
q6	233	141	138	138
q7	979	568	523	523
q8	2152	2274	2295	2274
q9	6748	6679	6690	6679
q10	3163	3108	3075	3075
q11	355	226	205	205
q12	384	237	231	231
q13	4389	3653	3641	3641
q14	251	221	226	221
q15	587	539	528	528
q16	448	425	417	417
q17	1039	584	549	549
q18	7085	6802	6799	6799
q19	1642	1485	1418	1418
q20	560	365	326	326
q21	2865	2509	2551	2509
q22	399	327	331	327
Total cold run time: 44811 ms
Total hot run time: 40079 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	5084	5093	5051	5051
q2	342	239	236	236
q3	3348	3347	3321	3321
q4	2178	2025	2033	2025
q5	5952	5948	5940	5940
q6	224	128	128	128
q7	2401	1912	1890	1890
q8	3609	3659	3663	3659
q9	9078	8951	8993	8951
q10	3899	3930	3908	3908
q11	590	484	477	477
q12	814	649	625	625
q13	3876	3227	3203	3203
q14	300	262	267	262
q15	593	541	532	532
q16	578	516	487	487
q17	2035	1815	1805	1805
q18	8806	8348	8327	8327
q19	1745	1649	1684	1649
q20	2275	1991	1973	1973
q21	5661	5264	5349	5264
q22	568	491	460	460
Total cold run time: 63956 ms
Total hot run time: 60173 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.79 seconds
stream load tsv: 576 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.2 seconds inserted 10000000 Rows, about 354K ops/s
storage size: 17184349649 Bytes

@xiaokang xiaokang added the usercase Important user case type label label Jan 4, 2024
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring force-pushed the fix/restore_rowset_meta_set_tablet_id branch from 58ffef2 to 9c8087c Compare January 4, 2024 12:44
@dataroaring
Copy link
Contributor

run buildall

Copy link
Contributor

github-actions bot commented Jan 4, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit 9c8087c850b1b63a466fa509c24ea8c326c5d38b, data reload: false

------ Round 1 ----------------------------------
q1	17697	5321	5125	5125
q2	2028	156	148	148
q3	10607	1116	1135	1116
q4	10443	778	807	778
q5	7813	2922	2914	2914
q6	217	131	130	130
q7	910	517	543	517
q8	9267	1999	1992	1992
q9	6812	6427	6379	6379
q10	8220	3049	3013	3013
q11	436	225	207	207
q12	386	234	239	234
q13	17991	3623	3620	3620
q14	235	218	216	216
q15	561	524	515	515
q16	451	409	383	383
q17	954	522	448	448
q18	7467	6717	6673	6673
q19	1597	1373	1391	1373
q20	716	331	355	331
q21	2797	2398	2415	2398
q22	395	332	330	330
Total cold run time: 108000 ms
Total hot run time: 38840 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5088	5046	5061	5046
q2	338	239	243	239
q3	3317	3276	3282	3276
q4	2114	2035	1996	1996
q5	5835	5783	5787	5783
q6	210	123	124	123
q7	2336	1891	1963	1891
q8	3392	3455	3475	3455
q9	8796	8731	8711	8711
q10	3748	3842	3831	3831
q11	583	490	468	468
q12	789	618	629	618
q13	6436	3192	3190	3190
q14	301	259	270	259
q15	570	518	516	516
q16	564	496	498	496
q17	1926	1757	1735	1735
q18	8672	8604	8272	8272
q19	1624	1565	1586	1565
q20	2170	1960	1944	1944
q21	5593	5322	5203	5203
q22	533	521	530	521
Total cold run time: 64935 ms
Total hot run time: 59138 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.65% (8618/23517)
Line Coverage: 28.68% (70036/244188)
Region Coverage: 27.65% (36242/131074)
Branch Coverage: 24.35% (18518/76042)
Coverage Report: http://coverage.selectdb-in.cc/coverage/9c8087c850b1b63a466fa509c24ea8c326c5d38b_9c8087c850b1b63a466fa509c24ea8c326c5d38b/report/index.html

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit 9c8087c850b1b63a466fa509c24ea8c326c5d38b, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5478	5210	5206	5206
q2	390	165	159	159
q3	1480	1243	1241	1241
q4	1100	938	794	794
q5	3105	3143	3184	3143
q6	225	137	136	136
q7	990	550	507	507
q8	2184	2229	2267	2229
q9	6742	6719	6723	6719
q10	3178	3153	3151	3151
q11	364	213	211	211
q12	393	232	239	232
q13	4438	3670	3688	3670
q14	255	222	213	213
q15	582	533	525	525
q16	466	419	431	419
q17	1053	545	567	545
q18	7085	6785	6785	6785
q19	1672	1539	1622	1539
q20	566	315	314	314
q21	2870	2505	2549	2505
q22	411	340	335	335
Total cold run time: 45027 ms
Total hot run time: 40578 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	5177	5117	5101	5101
q2	344	237	235	235
q3	3380	3367	3321	3321
q4	2191	2093	2091	2091
q5	5986	5932	5941	5932
q6	229	128	131	128
q7	2366	1915	1937	1915
q8	3587	3716	3698	3698
q9	9091	9017	9027	9017
q10	3890	3910	3921	3910
q11	584	483	484	483
q12	806	635	647	635
q13	3887	3220	3191	3191
q14	290	283	268	268
q15	599	544	521	521
q16	563	521	500	500
q17	2105	1812	1823	1812
q18	8778	8393	8401	8393
q19	1776	1707	1716	1707
q20	2297	2006	1980	1980
q21	5777	5384	5308	5308
q22	561	493	505	493
Total cold run time: 64264 ms
Total hot run time: 60639 ms

@doris-robot
Copy link

TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools

TPC-DS sf100 test result on commit 9c8087c850b1b63a466fa509c24ea8c326c5d38b, data reload: false

run tpcds-sf100 query with default conf and session variables
query1	929	341	335	335
query2	6425	2013	1894	1894
query3	6658	213	201	201
query4	28313	22443	22503	22443
query5	3901	507	490	490
query6	266	177	176	176
query7	4587	277	260	260
query8	231	204	192	192
query9	8215	2541	2512	2512
query10	420	237	219	219
query11	16130	15574	15451	15451
query12	129	77	73	73
query13	1632	317	330	317
query14	11387	7069	7055	7055
query15	212	176	182	176
query16	6144	264	262	262
query17	1825	488	488	488
query18	1812	261	251	251
query19	179	130	134	130
query20	82	72	77	72
query21	182	97	94	94
query22	5232	4688	4577	4577
query23	31905	31265	31134	31134
query24	12049	2816	2786	2786
query25	596	341	330	330
query26	1854	142	136	136
query27	2919	269	278	269
query28	7030	1881	1884	1881
query29	2220	394	370	370
query30	297	141	152	141
query31	980	763	780	763
query32	95	56	51	51
query33	724	244	245	244
query34	927	439	436	436
query35	886	757	748	748
query36	1352	1266	1228	1228
query37	187	67	66	66
query38	3414	3313	3283	3283
query39	1334	1293	1270	1270
query40	297	87	85	85
query41	37	35	34	34
query42	92	85	77	77
query43	513	511	511	511
query44	1061	697	690	690
query45	194	187	186	186
query46	1065	613	630	613
query47	1568	1578	1594	1578
query48	324	257	252	252
query49	1215	302	310	302
query50	733	365	358	358
query51	5436	5340	5221	5221
query52	94	90	89	89
query53	206	146	144	144
query54	1351	547	551	547
query55	107	86	84	84
query56	204	189	196	189
query57	1050	955	980	955
query58	213	201	196	196
query59	2753	2507	2572	2507
query60	225	209	225	209
query61	86	84	83	83
query62	640	446	442	442
query63	165	143	148	143
query64	5902	1715	1625	1625
query65	3310	3256	3243	3243
query66	1400	331	341	331
query67	15579	15389	15323	15323
query68	11120	509	504	504
query69	503	249	247	247
query70	1747	1518	1551	1518
query71	495	217	208	208
query72	5618	3575	3549	3549
query73	2210	311	312	311
query74	7114	6445	6524	6445
query75	4842	2271	2264	2264
query76	6248	1077	1109	1077
query77	671	241	258	241
query78	9195	8771	8724	8724
query79	1018	498	489	489
query80	552	350	336	336
query81	455	211	206	206
query82	200	92	89	89
query83	161	137	136	136
query84	246	53	51	51
query85	952	276	265	265
query86	385	403	403	403
query87	3561	3348	3353	3348
query88	2789	2233	2235	2233
query89	341	262	250	250
query90	1920	191	191	191
query91	118	90	94	90
query92	56	51	50	50
query93	1794	481	421	421
query94	845	175	174	174
query95	453	407	397	397
query96	625	315	317	315
query97	4303	4130	4174	4130
query98	209	189	195	189
query99	1099	826	759	759
Total cold run time: 291325 ms
Total hot run time: 178431 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.62 seconds
stream load tsv: 564 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.1 seconds inserted 10000000 Rows, about 355K ops/s
storage size: 17183657883 Bytes

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 4, 2024
Copy link
Contributor

github-actions bot commented Jan 4, 2024

PR approved by at least one committer and no changes requested.

Copy link
Contributor

github-actions bot commented Jan 4, 2024

PR approved by anyone and no changes requested.

@yiguolei yiguolei merged commit e625734 into apache:master Jan 6, 2024
26 checks passed
@xiaokang
Copy link
Contributor

xiaokang commented Jan 9, 2024

run buildall

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.0.4-merged dev/3.0.0-merged reviewed usercase Important user case type label
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants