Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [fix](hive) fix block decompressor bug #45289 #45377

Open
wants to merge 1 commit into
base: branch-3.0
Choose a base branch
from

Conversation

github-actions[bot]
Copy link
Contributor

Cherry-picked from #45289

### What problem does this PR solve?

Problem Summary:
In the block decompressor, when it is found that the input data is less
than 4 bytes (the header size of the large block), should set
more_input_bytes instead of reporting an error.
@dataroaring dataroaring reopened this Dec 13, 2024
@dataroaring
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40464 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0f23d3ef78c04841272bc469107cec9b42287adb, data reload: false

------ Round 1 ----------------------------------
q1	17578	7390	7426	7390
q2	2067	170	176	170
q3	10855	1441	1145	1145
q4	10561	775	741	741
q5	7728	2781	2759	2759
q6	235	152	147	147
q7	965	611	601	601
q8	9584	1930	1896	1896
q9	8133	6368	6421	6368
q10	7010	2222	2315	2222
q11	456	251	251	251
q12	394	215	206	206
q13	17796	2981	2979	2979
q14	244	201	208	201
q15	557	525	531	525
q16	698	604	613	604
q17	946	595	560	560
q18	7124	6523	6515	6515
q19	1698	1061	1003	1003
q20	467	195	189	189
q21	3881	3178	3002	3002
q22	1102	990	1002	990
Total cold run time: 110079 ms
Total hot run time: 40464 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7366	7201	7216	7201
q2	320	233	229	229
q3	2911	2840	2845	2840
q4	2042	1767	1772	1767
q5	5654	5665	5688	5665
q6	226	146	145	145
q7	2210	1770	1759	1759
q8	3276	3467	3435	3435
q9	8859	8787	8762	8762
q10	3515	3542	3496	3496
q11	581	503	519	503
q12	810	611	606	606
q13	16494	3157	3142	3142
q14	314	282	274	274
q15	568	529	533	529
q16	710	658	682	658
q17	1832	1595	1572	1572
q18	8183	7694	7555	7555
q19	2149	1567	1520	1520
q20	2008	1855	1819	1819
q21	5475	5371	5224	5224
q22	1141	1034	1005	1005
Total cold run time: 76644 ms
Total hot run time: 59706 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195864 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0f23d3ef78c04841272bc469107cec9b42287adb, data reload: false

query1	1233	931	907	907
query2	6232	2050	2001	2001
query3	10893	4229	4223	4223
query4	66493	30268	23436	23436
query5	5325	456	458	456
query6	500	175	170	170
query7	6006	307	311	307
query8	329	229	235	229
query9	9045	2680	2654	2654
query10	475	269	243	243
query11	17614	15284	15828	15284
query12	179	99	102	99
query13	1589	424	438	424
query14	10819	6907	7257	6907
query15	210	171	166	166
query16	7256	466	501	466
query17	1266	568	561	561
query18	1782	341	300	300
query19	189	149	151	149
query20	113	111	106	106
query21	64	42	42	42
query22	4735	4779	4486	4486
query23	34570	34104	34708	34104
query24	5887	2887	2946	2887
query25	517	393	386	386
query26	659	172	164	164
query27	1933	303	297	297
query28	4206	2515	2475	2475
query29	656	450	435	435
query30	247	163	159	159
query31	986	839	833	833
query32	69	57	54	54
query33	414	287	289	287
query34	901	505	491	491
query35	858	739	748	739
query36	1059	955	951	951
query37	112	72	68	68
query38	4118	4013	4025	4013
query39	1523	1482	1452	1452
query40	138	80	78	78
query41	49	45	45	45
query42	111	97	100	97
query43	531	491	500	491
query44	1146	798	804	798
query45	183	167	167	167
query46	1136	706	739	706
query47	2011	1869	1915	1869
query48	468	372	371	371
query49	723	382	371	371
query50	836	400	409	400
query51	7474	7193	7035	7035
query52	99	89	92	89
query53	252	183	184	183
query54	552	448	441	441
query55	78	73	71	71
query56	248	236	234	234
query57	1210	1090	1089	1089
query58	218	200	206	200
query59	3292	2854	2995	2854
query60	290	249	250	249
query61	108	107	104	104
query62	775	655	676	655
query63	215	187	192	187
query64	1420	653	624	624
query65	3288	3194	3162	3162
query66	722	297	297	297
query67	15692	15538	15299	15299
query68	4542	547	551	547
query69	405	273	260	260
query70	1081	1079	1134	1079
query71	347	249	251	249
query72	6298	4076	4124	4076
query73	752	339	339	339
query74	9998	8959	8898	8898
query75	3330	2635	2638	2635
query76	1878	1037	1002	1002
query77	487	261	265	261
query78	10618	9802	9513	9513
query79	3049	595	603	595
query80	1866	437	434	434
query81	551	243	239	239
query82	850	123	121	121
query83	257	146	150	146
query84	302	90	79	79
query85	1262	373	398	373
query86	457	302	296	296
query87	4348	4191	4320	4191
query88	5093	2392	2381	2381
query89	422	296	287	287
query90	2054	183	183	183
query91	177	141	142	141
query92	58	48	50	48
query93	5421	538	529	529
query94	901	274	284	274
query95	343	241	244	241
query96	623	280	277	277
query97	3318	3111	3213	3111
query98	224	204	188	188
query99	1734	1294	1331	1294
Total cold run time: 327373 ms
Total hot run time: 195864 ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants