validate all benchmark runs

[joseph-isaacs]

Summary

Closes: #000

Testing

[github-actions]

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	70c2e75		1	Explore Profiling Data

Previous Runs (1)

Status	Commit	Job	Attempt	Link
🟢 Done	6400ff9		1	Explore Profiling Data

---

Powered by Polar Signals Cloud

[codspeed-hq]

Merging this PR will not alter performance

✅ 1016 untouched benchmarks
⏩ 1522 skipped benchmarks¹

---

_{Comparing ji/validate-sql-bench (5e93998) with develop (062f36c)}

Footnotes

1. 1522 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

[github-actions]

Benchmarks: TPC-H SF=1 on S3

Summary

• Overall: 1.049x ➖
• Vortex: 1.072x ➖
• Parquet: 1.003x ➖

Verdict

No clear signal

• Attributed Vortex impact: +6.9%
• Confidence: environment too noisy
• Environment shift: +0.3%

Statistical Summary

• Systemic shift (parquet controls): +0.3%
• Control sigma: +9.6%
• Residual noise: +10.5%
• Median polish overall: +2.9%

datafusion / vortex-file-compressed (1.161x ➖, 0↑ 4↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	188160090	181234068	1.04
tpch_q02/datafusion:vortex-file-compressed	484251974	454163453	1.07
tpch_q03/datafusion:vortex-file-compressed	294869003	369103860	0.80
tpch_q04/datafusion:vortex-file-compressed	272804104	236229371	1.15
tpch_q05/datafusion:vortex-file-compressed 🚨	545577660	403833084	1.35
tpch_q06/datafusion:vortex-file-compressed 🚨	384153076	259703027	1.48
tpch_q07/datafusion:vortex-file-compressed	383257129	386604746	0.99
tpch_q08/datafusion:vortex-file-compressed	685698869	662992164	1.03
tpch_q09/datafusion:vortex-file-compressed	581939653	592842927	0.98
tpch_q10/datafusion:vortex-file-compressed	553147133	477184452	1.16
tpch_q11/datafusion:vortex-file-compressed 🚨	384409596	271910635	1.41
tpch_q12/datafusion:vortex-file-compressed	421944921	342982778	1.23
tpch_q13/datafusion:vortex-file-compressed	223715561	226602628	0.99
tpch_q14/datafusion:vortex-file-compressed	226395715	179583538	1.26
tpch_q15/datafusion:vortex-file-compressed	358766426	299299253	1.20
tpch_q16/datafusion:vortex-file-compressed	196826449	195834940	1.01
tpch_q17/datafusion:vortex-file-compressed	348174136	317150789	1.10
tpch_q18/datafusion:vortex-file-compressed	400811414	314296851	1.28
tpch_q19/datafusion:vortex-file-compressed	421027089	326974427	1.29
tpch_q20/datafusion:vortex-file-compressed	487969171	377082547	1.29
tpch_q21/datafusion:vortex-file-compressed	678590596	549723582	1.23
tpch_q22/datafusion:vortex-file-compressed 🚨	300578374	201184961	1.49

datafusion / vortex-compact (1.083x ➖, 0↑ 4↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	278034523	238859609	1.16
tpch_q02/datafusion:vortex-compact	483554964	459137827	1.05
tpch_q03/datafusion:vortex-compact 🚨	417658380	299081323	1.40
tpch_q04/datafusion:vortex-compact 🚨	299866101	209009060	1.43
tpch_q05/datafusion:vortex-compact	499171717	508466598	0.98
tpch_q06/datafusion:vortex-compact	438055925	443274434	0.99
tpch_q07/datafusion:vortex-compact	522458124	499024015	1.05
tpch_q08/datafusion:vortex-compact	588539036	573504595	1.03
tpch_q09/datafusion:vortex-compact	536781759	490902497	1.09
tpch_q10/datafusion:vortex-compact 🚨	612229808	468925453	1.31
tpch_q11/datafusion:vortex-compact	340820623	281429117	1.21
tpch_q12/datafusion:vortex-compact	585894207	517311553	1.13
tpch_q13/datafusion:vortex-compact	258476141	224678517	1.15
tpch_q14/datafusion:vortex-compact	301867910	311170520	0.97
tpch_q15/datafusion:vortex-compact 🚨	654312306	445494490	1.47
tpch_q16/datafusion:vortex-compact	176953275	223503743	0.79
tpch_q17/datafusion:vortex-compact	320504736	350452113	0.91
tpch_q18/datafusion:vortex-compact	320209088	308293296	1.04
tpch_q19/datafusion:vortex-compact	404373441	410538729	0.98
tpch_q20/datafusion:vortex-compact	447132710	447795329	1.00
tpch_q21/datafusion:vortex-compact	559442535	584630362	0.96
tpch_q22/datafusion:vortex-compact	116885439	117925749	0.99

datafusion / parquet (1.015x ➖, 0↑ 2↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	254972321	247787066	1.03
tpch_q02/datafusion:parquet	448386075	461744364	0.97
tpch_q03/datafusion:parquet	308678565	314120406	0.98
tpch_q04/datafusion:parquet	138800998	188302404	0.74
tpch_q05/datafusion:parquet	500344012	535684804	0.93
tpch_q06/datafusion:parquet	145341068	137888982	1.05
tpch_q07/datafusion:parquet	529150502	591698253	0.89
tpch_q08/datafusion:parquet	628113845	629253664	1.00
tpch_q09/datafusion:parquet	545903031	538557010	1.01
tpch_q10/datafusion:parquet	574776476	592715244	0.97
tpch_q11/datafusion:parquet	345700101	341338539	1.01
tpch_q12/datafusion:parquet	284880332	262152503	1.09
tpch_q13/datafusion:parquet	444340895	430870784	1.03
tpch_q14/datafusion:parquet	221128366	194044008	1.14
tpch_q15/datafusion:parquet	289876283	303418055	0.96
tpch_q16/datafusion:parquet	182910215	175983953	1.04
tpch_q17/datafusion:parquet	419023798	494909756	0.85
tpch_q18/datafusion:parquet	544611062	517690828	1.05
tpch_q19/datafusion:parquet	350994997	346172248	1.01
tpch_q20/datafusion:parquet	406921000	391328731	1.04
tpch_q21/datafusion:parquet 🚨	753210256	558543474	1.35
tpch_q22/datafusion:parquet 🚨	179083080	131610288	1.36

duckdb / vortex-file-compressed (1.073x ➖, 0↑ 2↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	224046153	217197049	1.03
tpch_q02/duckdb:vortex-file-compressed	820535245	874905419	0.94
tpch_q03/duckdb:vortex-file-compressed	509463021	593712652	0.86
tpch_q04/duckdb:vortex-file-compressed	456923484	354693273	1.29
tpch_q05/duckdb:vortex-file-compressed	1109346339	887503315	1.25
tpch_q06/duckdb:vortex-file-compressed	378892560	358635271	1.06
tpch_q07/duckdb:vortex-file-compressed	720166098	755537736	0.95
tpch_q08/duckdb:vortex-file-compressed	994610327	951703049	1.05
tpch_q09/duckdb:vortex-file-compressed	877690791	864844534	1.01
tpch_q10/duckdb:vortex-file-compressed	725833857	668514281	1.09
tpch_q11/duckdb:vortex-file-compressed	518000189	498177533	1.04
tpch_q12/duckdb:vortex-file-compressed 🚨	633547064	485834486	1.30
tpch_q13/duckdb:vortex-file-compressed	570528791	457421914	1.25
tpch_q14/duckdb:vortex-file-compressed	480519870	488488920	0.98
tpch_q15/duckdb:vortex-file-compressed 🚨	323034405	239109262	1.35
tpch_q16/duckdb:vortex-file-compressed	352990830	330764333	1.07
tpch_q17/duckdb:vortex-file-compressed	680112705	562349047	1.21
tpch_q18/duckdb:vortex-file-compressed	566922019	538129225	1.05
tpch_q19/duckdb:vortex-file-compressed	492823545	510040939	0.97
tpch_q20/duckdb:vortex-file-compressed	975347710	828746227	1.18
tpch_q21/duckdb:vortex-file-compressed	1045702895	1037473295	1.01
tpch_q22/duckdb:vortex-file-compressed	308812320	357967306	0.86

duckdb / vortex-compact (0.979x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	291406464	266806052	1.09
tpch_q02/duckdb:vortex-compact	870578976	839833588	1.04
tpch_q03/duckdb:vortex-compact	535047920	532025016	1.01
tpch_q04/duckdb:vortex-compact	318445184	333714845	0.95
tpch_q05/duckdb:vortex-compact	861771841	848360636	1.02
tpch_q06/duckdb:vortex-compact	401324603	459828120	0.87
tpch_q07/duckdb:vortex-compact	750429963	633025872	1.19
tpch_q08/duckdb:vortex-compact	869657707	912123339	0.95
tpch_q09/duckdb:vortex-compact	798812316	919227950	0.87
tpch_q10/duckdb:vortex-compact	631674895	795694258	0.79
tpch_q11/duckdb:vortex-compact	449426667	482575291	0.93
tpch_q12/duckdb:vortex-compact	421041233	381919739	1.10
tpch_q13/duckdb:vortex-compact	436982059	450185285	0.97
tpch_q14/duckdb:vortex-compact	467873497	452173261	1.03
tpch_q15/duckdb:vortex-compact	254477768	270091303	0.94
tpch_q16/duckdb:vortex-compact	367637724	331888622	1.11
tpch_q17/duckdb:vortex-compact	565313671	584142002	0.97
tpch_q18/duckdb:vortex-compact	462848139	484358065	0.96
tpch_q19/duckdb:vortex-compact	418889714	513775511	0.82
tpch_q20/duckdb:vortex-compact	687240653	774651432	0.89
tpch_q21/duckdb:vortex-compact	1037423966	971723903	1.07
tpch_q22/duckdb:vortex-compact	348368060	319140898	1.09

duckdb / parquet (0.991x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	503576168	470970935	1.07
tpch_q02/duckdb:parquet	1240769872	1292414694	0.96
tpch_q03/duckdb:parquet	1046038046	1014786211	1.03
tpch_q04/duckdb:parquet	555446619	613775321	0.90
tpch_q05/duckdb:parquet	1422029446	1463951736	0.97
tpch_q06/duckdb:parquet	445158649	368294571	1.21
tpch_q07/duckdb:parquet	1180718169	1320608645	0.89
tpch_q08/duckdb:parquet	1446239228	1591299651	0.91
tpch_q09/duckdb:parquet	1331397025	1378242295	0.97
tpch_q10/duckdb:parquet	1436290117	1350636374	1.06
tpch_q11/duckdb:parquet	742220818	846843789	0.88
tpch_q12/duckdb:parquet	642158687	551342389	1.16
tpch_q13/duckdb:parquet	925754301	873131573	1.06
tpch_q14/duckdb:parquet	594049297	610484081	0.97
tpch_q15/duckdb:parquet	443986566	512989969	0.87
tpch_q16/duckdb:parquet	498309876	588070475	0.85
tpch_q17/duckdb:parquet	777170228	712988275	1.09
tpch_q18/duckdb:parquet	940344052	839496771	1.12
tpch_q19/duckdb:parquet	821562823	867593624	0.95
tpch_q20/duckdb:parquet	936929029	971898548	0.96
tpch_q21/duckdb:parquet	1116196756	1204471654	0.93
tpch_q22/duckdb:parquet	504814348	456382342	1.11

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	+16.4%	+4.9%	+11.0%	+180.7%	➖ noise
1	datafusion:vortex-file-compressed	+3.8%	+4.9%	-1.0%	+145.2%	➖ noise
1	duckdb:vortex-compact	+9.2%	+4.9%	+4.1%	+55.1%	➖ noise
1	duckdb:vortex-file-compressed	+3.2%	+4.9%	-1.7%	+50.3%	➖ noise
2	datafusion:vortex-compact	+5.3%	-3.4%	+9.1%	+39.2%	➖ noise
2	datafusion:vortex-file-compressed	+6.6%	-3.4%	+10.4%	+34.3%	➖ noise
2	duckdb:vortex-compact	+3.7%	-3.4%	+7.4%	+30.0%	➖ noise
2	duckdb:vortex-file-compressed	-6.2%	-3.4%	-2.9%	+30.0%	➖ noise
3	datafusion:vortex-compact	+39.6%	+0.6%	+38.8%	+65.3%	➖ noise
3	datafusion:vortex-file-compressed	-20.1%	+0.6%	-20.6%	+118.8%	➖ noise
3	duckdb:vortex-compact	+0.6%	+0.6%	-0.1%	+30.1%	➖ noise
3	duckdb:vortex-file-compressed	-14.2%	+0.6%	-14.7%	+36.6%	➖ noise
4	datafusion:vortex-compact	+43.5%	-18.3%	+75.7%	+59.5%	🚨 regression
4	datafusion:vortex-file-compressed	+15.5%	-18.3%	+41.4%	+49.1%	➖ noise
4	duckdb:vortex-compact	-4.6%	-18.3%	+16.8%	+30.0%	➖ noise
4	duckdb:vortex-file-compressed	+28.8%	-18.3%	+57.7%	+36.9%	🚨 regression
5	datafusion:vortex-compact	-1.8%	-4.7%	+3.1%	+40.5%	➖ noise
5	datafusion:vortex-file-compressed	+35.1%	-4.7%	+41.8%	+44.8%	➖ noise
5	duckdb:vortex-compact	+1.6%	-4.7%	+6.6%	+30.0%	➖ noise
5	duckdb:vortex-file-compressed	+25.0%	-4.7%	+31.2%	+30.0%	🚨 regression
6	datafusion:vortex-compact	-1.2%	+12.9%	-12.4%	+45.3%	➖ noise
6	datafusion:vortex-file-compressed	+47.9%	+12.9%	+31.1%	+46.4%	➖ noise
6	duckdb:vortex-compact	-12.7%	+12.9%	-22.7%	+30.0%	➖ noise
6	duckdb:vortex-file-compressed	+5.6%	+12.9%	-6.4%	+57.3%	➖ noise
7	datafusion:vortex-compact	+4.7%	-10.6%	+17.1%	+30.0%	➖ noise
7	datafusion:vortex-file-compressed	-0.9%	-10.6%	+10.9%	+30.0%	➖ noise
7	duckdb:vortex-compact	+18.5%	-10.6%	+32.6%	+30.0%	🚨 regression
7	duckdb:vortex-file-compressed	-4.7%	-10.6%	+6.6%	+35.4%	➖ noise
8	datafusion:vortex-compact	+2.6%	-4.8%	+7.7%	+30.0%	➖ noise
8	datafusion:vortex-file-compressed	+3.4%	-4.8%	+8.6%	+30.0%	➖ noise
8	duckdb:vortex-compact	-4.7%	-4.8%	+0.1%	+30.0%	➖ noise
8	duckdb:vortex-file-compressed	+4.5%	-4.8%	+9.7%	+30.0%	➖ noise
9	datafusion:vortex-compact	+9.3%	-1.0%	+10.5%	+34.2%	➖ noise
9	datafusion:vortex-file-compressed	-1.8%	-1.0%	-0.8%	+46.1%	➖ noise
9	duckdb:vortex-compact	-13.1%	-1.0%	-12.2%	+30.0%	➖ noise
9	duckdb:vortex-file-compressed	+1.5%	-1.0%	+2.6%	+30.0%	➖ noise
10	datafusion:vortex-compact	+30.6%	+1.5%	+28.6%	+30.0%	➖ noise
10	datafusion:vortex-file-compressed	+15.9%	+1.5%	+14.2%	+30.5%	➖ noise
10	duckdb:vortex-compact	-20.6%	+1.5%	-21.8%	+30.0%	➖ noise
10	duckdb:vortex-file-compressed	+8.6%	+1.5%	+6.9%	+30.0%	➖ noise
11	datafusion:vortex-compact	+21.1%	-5.8%	+28.5%	+30.0%	➖ noise
11	datafusion:vortex-file-compressed	+41.4%	-5.8%	+50.1%	+30.0%	🚨 regression
11	duckdb:vortex-compact	-6.9%	-5.8%	-1.2%	+30.0%	➖ noise
11	duckdb:vortex-file-compressed	+4.0%	-5.8%	+10.4%	+38.3%	➖ noise
12	datafusion:vortex-compact	+13.3%	+12.5%	+0.7%	+37.4%	➖ noise
12	datafusion:vortex-file-compressed	+23.0%	+12.5%	+9.3%	+30.0%	➖ noise
12	duckdb:vortex-compact	+10.2%	+12.5%	-2.0%	+30.0%	➖ noise
12	duckdb:vortex-file-compressed	+30.4%	+12.5%	+15.9%	+37.0%	➖ noise
13	datafusion:vortex-compact	+15.0%	+4.6%	+10.0%	+53.5%	➖ noise
13	datafusion:vortex-file-compressed	-1.3%	+4.6%	-5.6%	+31.0%	➖ noise
13	duckdb:vortex-compact	-2.9%	+4.6%	-7.2%	+30.0%	➖ noise
13	duckdb:vortex-file-compressed	+24.7%	+4.6%	+19.3%	+30.0%	➖ noise
14	datafusion:vortex-compact	-3.0%	+5.3%	-7.9%	+41.0%	➖ noise
14	datafusion:vortex-file-compressed	+26.1%	+5.3%	+19.7%	+63.1%	➖ noise
14	duckdb:vortex-compact	+3.5%	+5.3%	-1.7%	+30.0%	➖ noise
14	duckdb:vortex-file-compressed	-1.6%	+5.3%	-6.6%	+37.9%	➖ noise
15	datafusion:vortex-compact	+46.9%	-9.1%	+61.5%	+55.3%	🚨 regression
15	datafusion:vortex-file-compressed	+19.9%	-9.1%	+31.8%	+30.0%	🚨 regression
15	duckdb:vortex-compact	-5.8%	-9.1%	+3.6%	+42.6%	➖ noise
15	duckdb:vortex-file-compressed	+35.1%	-9.1%	+48.6%	+35.7%	🚨 regression
16	datafusion:vortex-compact	-20.8%	-6.2%	-15.6%	+56.9%	➖ noise
16	datafusion:vortex-file-compressed	+0.5%	-6.2%	+7.1%	+30.0%	➖ noise
16	duckdb:vortex-compact	+10.8%	-6.2%	+18.0%	+30.0%	➖ noise
16	duckdb:vortex-file-compressed	+6.7%	-6.2%	+13.7%	+30.0%	➖ noise
17	datafusion:vortex-compact	-8.5%	-3.9%	-4.8%	+30.0%	➖ noise
17	datafusion:vortex-file-compressed	+9.8%	-3.9%	+14.3%	+30.0%	➖ noise
17	duckdb:vortex-compact	-3.2%	-3.9%	+0.7%	+30.0%	➖ noise
17	duckdb:vortex-file-compressed	+20.9%	-3.9%	+25.9%	+30.0%	➖ noise
18	datafusion:vortex-compact	+3.9%	+8.6%	-4.3%	+30.0%	➖ noise
18	datafusion:vortex-file-compressed	+27.5%	+8.6%	+17.5%	+30.0%	➖ noise
18	duckdb:vortex-compact	-4.4%	+8.6%	-12.0%	+30.0%	➖ noise
18	duckdb:vortex-file-compressed	+5.4%	+8.6%	-3.0%	+30.0%	➖ noise
19	datafusion:vortex-compact	-1.5%	-2.0%	+0.5%	+30.0%	➖ noise
19	datafusion:vortex-file-compressed	+28.8%	-2.0%	+31.4%	+32.5%	➖ noise
19	duckdb:vortex-compact	-18.5%	-2.0%	-16.8%	+30.0%	➖ noise
19	duckdb:vortex-file-compressed	-3.4%	-2.0%	-1.4%	+30.0%	➖ noise
20	datafusion:vortex-compact	-0.1%	+0.1%	-0.3%	+30.0%	➖ noise
20	datafusion:vortex-file-compressed	+29.4%	+0.1%	+29.2%	+42.5%	➖ noise
20	duckdb:vortex-compact	-11.3%	+0.1%	-11.4%	+30.0%	➖ noise
20	duckdb:vortex-file-compressed	+17.7%	+0.1%	+17.5%	+30.0%	➖ noise
21	datafusion:vortex-compact	-4.3%	+11.8%	-14.4%	+30.0%	➖ noise
21	datafusion:vortex-file-compressed	+23.4%	+11.8%	+10.4%	+30.0%	➖ noise
21	duckdb:vortex-compact	+6.8%	+11.8%	-4.5%	+30.0%	➖ noise
21	duckdb:vortex-file-compressed	+0.8%	+11.8%	-9.8%	+30.0%	➖ noise
22	datafusion:vortex-compact	-0.9%	+22.7%	-19.2%	+42.3%	➖ noise
22	datafusion:vortex-file-compressed	+49.4%	+22.7%	+21.8%	+49.2%	➖ noise
22	duckdb:vortex-compact	+9.2%	+22.7%	-11.0%	+32.0%	➖ noise
22	duckdb:vortex-file-compressed	-13.7%	+22.7%	-29.7%	+30.5%	✅ faster

[github-actions]

Benchmarks: TPC-H SF=1 on NVME

Summary

• Overall: 1.012x ➖
• Vortex: 1.029x ➖
• Parquet: 0.993x ➖

Verdict

No clear signal

• Attributed Vortex impact: +2.6%
• Confidence: low
• Environment shift: -0.7%

Statistical Summary

• Systemic shift (parquet controls): -0.7%
• Control sigma: +4.9%
• Residual noise: +3.0%
• Median polish overall: +0.0%

datafusion / vortex-file-compressed (1.071x ➖, 0↑ 7↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	52798870	50454042	1.05
tpch_q02/datafusion:vortex-file-compressed	52060257	49354556	1.05
tpch_q03/datafusion:vortex-file-compressed	28483893	27672188	1.03
tpch_q04/datafusion:vortex-file-compressed 🚨	20033532	18194870	1.10
tpch_q05/datafusion:vortex-file-compressed	77553894	77001674	1.01
tpch_q06/datafusion:vortex-file-compressed 🚨	12026568	10612039	1.13
tpch_q07/datafusion:vortex-file-compressed 🚨	101971401	88016153	1.16
tpch_q08/datafusion:vortex-file-compressed	68150819	64913795	1.05
tpch_q09/datafusion:vortex-file-compressed	85905476	86884033	0.99
tpch_q10/datafusion:vortex-file-compressed	79892888	77076682	1.04
tpch_q11/datafusion:vortex-file-compressed 🚨	21599990	18535460	1.17
tpch_q12/datafusion:vortex-file-compressed 🚨	36161890	32855723	1.10
tpch_q13/datafusion:vortex-file-compressed	29430450	27125464	1.08
tpch_q14/datafusion:vortex-file-compressed	29293193	27541436	1.06
tpch_q15/datafusion:vortex-file-compressed	25462322	25931983	0.98
tpch_q16/datafusion:vortex-file-compressed	37515230	34742206	1.08
tpch_q17/datafusion:vortex-file-compressed 🚨	84980288	71952433	1.18
tpch_q18/datafusion:vortex-file-compressed	104604061	100498872	1.04
tpch_q19/datafusion:vortex-file-compressed	37768285	34985614	1.08
tpch_q20/datafusion:vortex-file-compressed	50613266	48419814	1.05
tpch_q21/datafusion:vortex-file-compressed	98750293	94064892	1.05
tpch_q22/datafusion:vortex-file-compressed 🚨	16166166	14425822	1.12

datafusion / vortex-compact (1.050x ➖, 0↑ 5↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨	68718374	61420502	1.12
tpch_q02/datafusion:vortex-compact 🚨	59124382	50640955	1.17
tpch_q03/datafusion:vortex-compact 🚨	35077460	31522867	1.11
tpch_q04/datafusion:vortex-compact	25096072	23265410	1.08
tpch_q05/datafusion:vortex-compact	84294853	82021875	1.03
tpch_q06/datafusion:vortex-compact	14503611	14340617	1.01
tpch_q07/datafusion:vortex-compact	97675388	93699695	1.04
tpch_q08/datafusion:vortex-compact 🚨	80886607	72024274	1.12
tpch_q09/datafusion:vortex-compact	105121980	96913656	1.08
tpch_q10/datafusion:vortex-compact	78481301	78679914	1.00
tpch_q11/datafusion:vortex-compact	21393588	20651500	1.04
tpch_q12/datafusion:vortex-compact	45067807	43265504	1.04
tpch_q13/datafusion:vortex-compact	37064657	36432774	1.02
tpch_q14/datafusion:vortex-compact 🚨	34717685	31008378	1.12
tpch_q15/datafusion:vortex-compact	35592045	33832702	1.05
tpch_q16/datafusion:vortex-compact	40806071	39706893	1.03
tpch_q17/datafusion:vortex-compact	83706083	82575518	1.01
tpch_q18/datafusion:vortex-compact	111443402	108632159	1.03
tpch_q19/datafusion:vortex-compact	46211874	44728986	1.03
tpch_q20/datafusion:vortex-compact	55659218	54737329	1.02
tpch_q21/datafusion:vortex-compact	107852043	108166754	1.00
tpch_q22/datafusion:vortex-compact	16379903	16755130	0.98

datafusion / parquet (1.003x ➖, 2↑ 3↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet 🚀	110157114	145891135	0.76
tpch_q02/datafusion:parquet	80392879	80104188	1.00
tpch_q03/datafusion:parquet	85763503	85815692	1.00
tpch_q04/datafusion:parquet	53046524	55536333	0.96
tpch_q05/datafusion:parquet	159880834	161201352	0.99
tpch_q06/datafusion:parquet 🚀	38076809	48029224	0.79
tpch_q07/datafusion:parquet	180660242	179101027	1.01
tpch_q08/datafusion:parquet	163238353	162495701	1.00
tpch_q09/datafusion:parquet	209941856	209256592	1.00
tpch_q10/datafusion:parquet	184828746	187327916	0.99
tpch_q11/datafusion:parquet	60261920	58965582	1.02
tpch_q12/datafusion:parquet 🚨	123539125	106529045	1.16
tpch_q13/datafusion:parquet	203059642	202063361	1.00
tpch_q14/datafusion:parquet	82093125	83187082	0.99
tpch_q15/datafusion:parquet 🚨	75457450	64243421	1.17
tpch_q16/datafusion:parquet	55032113	54719821	1.01
tpch_q17/datafusion:parquet	170768289	173194574	0.99
tpch_q18/datafusion:parquet	228324527	229321451	1.00
tpch_q19/datafusion:parquet	97628362	93479233	1.04
tpch_q20/datafusion:parquet	126495417	115183893	1.10
tpch_q21/datafusion:parquet	187525892	178178151	1.05
tpch_q22/datafusion:parquet 🚨	43945383	38921209	1.13

datafusion / arrow (0.986x ➖, 2↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:arrow 🚀	58614511	68635337	0.85
tpch_q02/datafusion:arrow	22578208	23034041	0.98
tpch_q03/datafusion:arrow	37029428	36986948	1.00
tpch_q04/datafusion:arrow	30406604	29894861	1.02
tpch_q05/datafusion:arrow	93169601	90302802	1.03
tpch_q06/datafusion:arrow	22767776	21421763	1.06
tpch_q07/datafusion:arrow	179352104	176625732	1.02
tpch_q08/datafusion:arrow	47237339	48351760	0.98
tpch_q09/datafusion:arrow	76674980	77823832	0.99
tpch_q10/datafusion:arrow	57973163	57164844	1.01
tpch_q11/datafusion:arrow	12394246	11998482	1.03
tpch_q12/datafusion:arrow	57644186	57817611	1.00
tpch_q13/datafusion:arrow	52339953	50099859	1.04
tpch_q14/datafusion:arrow	25470701	26801301	0.95
tpch_q15/datafusion:arrow	51031281	52329191	0.98
tpch_q16/datafusion:arrow	24623420	25193745	0.98
tpch_q17/datafusion:arrow 🚀	78980984	88830335	0.89
tpch_q18/datafusion:arrow	158581863	157094234	1.01
tpch_q19/datafusion:arrow	39368577	40398068	0.97
tpch_q20/datafusion:arrow	39238958	41066802	0.96
tpch_q21/datafusion:arrow	229434094	236763126	0.97
tpch_q22/datafusion:arrow	21215823	21115363	1.00

duckdb / vortex-file-compressed (0.998x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	32013983	33751083	0.95
tpch_q02/duckdb:vortex-file-compressed	25734288	27322553	0.94
tpch_q03/duckdb:vortex-file-compressed	28652784	30329412	0.94
tpch_q04/duckdb:vortex-file-compressed	29634962	29957015	0.99
tpch_q05/duckdb:vortex-file-compressed	33060284	34042557	0.97
tpch_q06/duckdb:vortex-file-compressed	10589528	10676568	0.99
tpch_q07/duckdb:vortex-file-compressed	36457298	36414189	1.00
tpch_q08/duckdb:vortex-file-compressed	42663383	39881358	1.07
tpch_q09/duckdb:vortex-file-compressed	85607274	78343756	1.09
tpch_q10/duckdb:vortex-file-compressed	36991312	36969455	1.00
tpch_q11/duckdb:vortex-file-compressed	16078571	15553393	1.03
tpch_q12/duckdb:vortex-file-compressed	23028029	23138018	1.00
tpch_q13/duckdb:vortex-file-compressed	37754454	37825660	1.00
tpch_q14/duckdb:vortex-file-compressed	20613074	21139348	0.98
tpch_q15/duckdb:vortex-file-compressed	16546416	16416172	1.01
tpch_q16/duckdb:vortex-file-compressed	30117944	29273668	1.03
tpch_q17/duckdb:vortex-file-compressed	24675625	24923242	0.99
tpch_q18/duckdb:vortex-file-compressed	48423149	48444190	1.00
tpch_q19/duckdb:vortex-file-compressed	32502247	32307040	1.01
tpch_q20/duckdb:vortex-file-compressed	33424885	34440164	0.97
tpch_q21/duckdb:vortex-file-compressed	103306273	102234531	1.01
tpch_q22/duckdb:vortex-file-compressed	17970530	17756619	1.01

duckdb / vortex-compact (0.999x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	39599361	39488003	1.00
tpch_q02/duckdb:vortex-compact	37309021	37680125	0.99
tpch_q03/duckdb:vortex-compact	32802907	31821107	1.03
tpch_q04/duckdb:vortex-compact	35324936	34678720	1.02
tpch_q05/duckdb:vortex-compact	38200797	37477095	1.02
tpch_q06/duckdb:vortex-compact	14487657	14276328	1.01
tpch_q07/duckdb:vortex-compact	42143593	43345998	0.97
tpch_q08/duckdb:vortex-compact	44726803	47105772	0.95
tpch_q09/duckdb:vortex-compact	88750521	91315665	0.97
tpch_q10/duckdb:vortex-compact	40676281	41445680	0.98
tpch_q11/duckdb:vortex-compact	21009783	20403702	1.03
tpch_q12/duckdb:vortex-compact	37813459	35957784	1.05
tpch_q13/duckdb:vortex-compact	46416881	47119116	0.99
tpch_q14/duckdb:vortex-compact	29068218	31348151	0.93
tpch_q15/duckdb:vortex-compact	19017974	19719940	0.96
tpch_q16/duckdb:vortex-compact	37969703	35870025	1.06
tpch_q17/duckdb:vortex-compact	30304382	30559276	0.99
tpch_q18/duckdb:vortex-compact	49990104	51998941	0.96
tpch_q19/duckdb:vortex-compact	37835164	36433553	1.04
tpch_q20/duckdb:vortex-compact	45219281	43547447	1.04
tpch_q21/duckdb:vortex-compact	112052574	113318404	0.99
tpch_q22/duckdb:vortex-compact	20716643	20487013	1.01

duckdb / parquet (0.983x ➖, 4↑ 1↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet 🚨	120250766	91629048	1.31
tpch_q02/duckdb:parquet	40797379	39388645	1.04
tpch_q03/duckdb:parquet	83933214	79311685	1.06
tpch_q04/duckdb:parquet	47852809	46746251	1.02
tpch_q05/duckdb:parquet	67633214	67271089	1.01
tpch_q06/duckdb:parquet	20447668	20305443	1.01
tpch_q07/duckdb:parquet	70244946	66696013	1.05
tpch_q08/duckdb:parquet	81430762	82359111	0.99
tpch_q09/duckdb:parquet 🚀	133563255	156380037	0.85
tpch_q10/duckdb:parquet	138478618	127049443	1.09
tpch_q11/duckdb:parquet	21999665	22426073	0.98
tpch_q12/duckdb:parquet	45111222	46717804	0.97
tpch_q13/duckdb:parquet	259826765	260694190	1.00
tpch_q14/duckdb:parquet	47845695	48613300	0.98
tpch_q15/duckdb:parquet 🚀	24522638	32948318	0.74
tpch_q16/duckdb:parquet	56098097	56168028	1.00
tpch_q17/duckdb:parquet	52280565	50885873	1.03
tpch_q18/duckdb:parquet 🚀	120383564	136522321	0.88
tpch_q19/duckdb:parquet 🚀	69632810	88161812	0.79
tpch_q20/duckdb:parquet	64416789	64612998	1.00
tpch_q21/duckdb:parquet	172113203	175971713	0.98
tpch_q22/duckdb:parquet	52019391	52700481	0.99

duckdb / duckdb (1.007x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:duckdb	15918642	16330316	0.97
tpch_q02/duckdb:duckdb	12209646	13090632	0.93
tpch_q03/duckdb:duckdb	19640397	18636992	1.05
tpch_q04/duckdb:duckdb	19581649	19774732	0.99
tpch_q05/duckdb:duckdb	20387514	20742790	0.98
tpch_q06/duckdb:duckdb	5329275	5384459	0.99
tpch_q07/duckdb:duckdb	23123491	22559297	1.03
tpch_q08/duckdb:duckdb	21022814	20790400	1.01
tpch_q09/duckdb:duckdb	55035125	54636109	1.01
tpch_q10/duckdb:duckdb	46053241	44003489	1.05
tpch_q11/duckdb:duckdb	5654400	5649950	1.00
tpch_q12/duckdb:duckdb	13590051	13803947	0.98
tpch_q13/duckdb:duckdb	38739500	36708518	1.06
tpch_q14/duckdb:duckdb	15808880	15477516	1.02
tpch_q15/duckdb:duckdb	11839716	11649870	1.02
tpch_q16/duckdb:duckdb	24616569	23171712	1.06
tpch_q17/duckdb:duckdb	13544612	13614295	0.99
tpch_q18/duckdb:duckdb	38702382	38068513	1.02
tpch_q19/duckdb:duckdb	25707194	26280146	0.98
tpch_q20/duckdb:duckdb	22077292	22445458	0.98
tpch_q21/duckdb:duckdb	56205974	54520809	1.03
tpch_q22/duckdb:duckdb	24187644	24195014	1.00

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:arrow	-14.6%	-0.5%	-14.2%	+26.4%	➖ noise
1	datafusion:vortex-compact	+11.9%	-0.5%	+12.4%	+28.6%	➖ noise
1	datafusion:vortex-file-compressed	+4.6%	-0.5%	+5.1%	+27.7%	➖ noise
1	duckdb:duckdb	-2.5%	-0.5%	-2.1%	+26.0%	➖ noise
1	duckdb:vortex-compact	+0.3%	-0.5%	+0.7%	+26.5%	➖ noise
1	duckdb:vortex-file-compressed	-5.1%	-0.5%	-4.7%	+26.3%	➖ noise
2	datafusion:arrow	-2.0%	+2.0%	-3.9%	+13.1%	➖ noise
2	datafusion:vortex-compact	+16.8%	+2.0%	+14.5%	+13.1%	🚨 regression
2	datafusion:vortex-file-compressed	+5.5%	+2.0%	+3.5%	+13.1%	➖ noise
2	duckdb:duckdb	-6.7%	+2.0%	-8.5%	+19.2%	➖ noise
2	duckdb:vortex-compact	-1.0%	+2.0%	-2.9%	+13.1%	➖ noise
2	duckdb:vortex-file-compressed	-5.8%	+2.0%	-7.6%	+13.5%	➖ noise
3	datafusion:arrow	+0.1%	+2.8%	-2.7%	+13.1%	➖ noise
3	datafusion:vortex-compact	+11.3%	+2.8%	+8.2%	+13.1%	➖ noise
3	datafusion:vortex-file-compressed	+2.9%	+2.8%	+0.1%	+14.9%	➖ noise
3	duckdb:duckdb	+5.4%	+2.8%	+2.5%	+16.2%	➖ noise
3	duckdb:vortex-compact	+3.1%	+2.8%	+0.2%	+14.9%	➖ noise
3	duckdb:vortex-file-compressed	-5.5%	+2.8%	-8.1%	+16.3%	➖ noise
4	datafusion:arrow	+1.7%	-1.1%	+2.9%	+13.1%	➖ noise
4	datafusion:vortex-compact	+7.9%	-1.1%	+9.1%	+13.1%	➖ noise
4	datafusion:vortex-file-compressed	+10.1%	-1.1%	+11.3%	+13.1%	➖ noise
4	duckdb:duckdb	-1.0%	-1.1%	+0.1%	+13.4%	➖ noise
4	duckdb:vortex-compact	+1.9%	-1.1%	+3.0%	+13.1%	➖ noise
4	duckdb:vortex-file-compressed	-1.1%	-1.1%	+0.0%	+13.1%	➖ noise
5	datafusion:arrow	+3.2%	-0.1%	+3.3%	+13.1%	➖ noise
5	datafusion:vortex-compact	+2.8%	-0.1%	+2.9%	+13.1%	➖ noise
5	datafusion:vortex-file-compressed	+0.7%	-0.1%	+0.9%	+13.1%	➖ noise
5	duckdb:duckdb	-1.7%	-0.1%	-1.6%	+14.1%	➖ noise
5	duckdb:vortex-compact	+1.9%	-0.1%	+2.1%	+13.1%	➖ noise
5	duckdb:vortex-file-compressed	-2.9%	-0.1%	-2.7%	+13.1%	➖ noise
6	datafusion:arrow	+6.3%	-10.7%	+19.0%	+22.7%	➖ noise
6	datafusion:vortex-compact	+1.1%	-10.7%	+13.2%	+23.9%	➖ noise
6	datafusion:vortex-file-compressed	+13.3%	-10.7%	+26.8%	+25.3%	🚨 regression
6	duckdb:duckdb	-1.0%	-10.7%	+10.8%	+24.9%	➖ noise
6	duckdb:vortex-compact	+1.5%	-10.7%	+13.6%	+22.3%	➖ noise
6	duckdb:vortex-file-compressed	-0.8%	-10.7%	+11.0%	+22.8%	➖ noise
7	datafusion:arrow	+1.5%	+3.1%	-1.5%	+13.1%	➖ noise
7	datafusion:vortex-compact	+4.2%	+3.1%	+1.1%	+13.1%	➖ noise
7	datafusion:vortex-file-compressed	+15.9%	+3.1%	+12.4%	+13.1%	➖ noise
7	duckdb:duckdb	+2.5%	+3.1%	-0.6%	+13.1%	➖ noise
7	duckdb:vortex-compact	-2.8%	+3.1%	-5.7%	+13.1%	➖ noise
7	duckdb:vortex-file-compressed	+0.1%	+3.1%	-2.9%	+13.1%	➖ noise
8	datafusion:arrow	-2.3%	-0.3%	-2.0%	+15.9%	➖ noise
8	datafusion:vortex-compact	+12.3%	-0.3%	+12.7%	+13.1%	➖ noise
8	datafusion:vortex-file-compressed	+5.0%	-0.3%	+5.3%	+13.1%	➖ noise
8	duckdb:duckdb	+1.1%	-0.3%	+1.5%	+13.1%	➖ noise
8	duckdb:vortex-compact	-5.1%	-0.3%	-4.7%	+13.1%	➖ noise
8	duckdb:vortex-file-compressed	+7.0%	-0.3%	+7.3%	+14.3%	➖ noise
9	datafusion:arrow	-1.5%	-7.4%	+6.4%	+13.1%	➖ noise
9	datafusion:vortex-compact	+8.5%	-7.4%	+17.2%	+13.1%	🚨 regression
9	datafusion:vortex-file-compressed	-1.1%	-7.4%	+6.8%	+13.1%	➖ noise
9	duckdb:duckdb	+0.7%	-7.4%	+8.8%	+13.1%	➖ noise
9	duckdb:vortex-compact	-2.8%	-7.4%	+5.0%	+13.1%	➖ noise
9	duckdb:vortex-file-compressed	+9.3%	-7.4%	+18.0%	+13.1%	🚨 regression
10	datafusion:arrow	+1.4%	+3.7%	-2.2%	+13.1%	➖ noise
10	datafusion:vortex-compact	-0.3%	+3.7%	-3.8%	+13.1%	➖ noise
10	datafusion:vortex-file-compressed	+3.7%	+3.7%	-0.0%	+13.1%	➖ noise
10	duckdb:duckdb	+4.7%	+3.7%	+0.9%	+15.7%	➖ noise
10	duckdb:vortex-compact	-1.9%	+3.7%	-5.4%	+13.1%	➖ noise
10	duckdb:vortex-file-compressed	+0.1%	+3.7%	-3.5%	+13.1%	➖ noise
11	datafusion:arrow	+3.3%	+0.1%	+3.2%	+13.1%	➖ noise
11	datafusion:vortex-compact	+3.6%	+0.1%	+3.5%	+13.1%	➖ noise
11	datafusion:vortex-file-compressed	+16.5%	+0.1%	+16.4%	+13.1%	🚨 regression
11	duckdb:duckdb	+0.1%	+0.1%	-0.0%	+14.4%	➖ noise
11	duckdb:vortex-compact	+3.0%	+0.1%	+2.8%	+15.8%	➖ noise
11	duckdb:vortex-file-compressed	+3.4%	+0.1%	+3.2%	+13.1%	➖ noise
12	datafusion:arrow	-0.3%	+5.8%	-5.8%	+14.9%	➖ noise
12	datafusion:vortex-compact	+4.2%	+5.8%	-1.6%	+15.1%	➖ noise
12	datafusion:vortex-file-compressed	+10.1%	+5.8%	+4.0%	+15.2%	➖ noise
12	duckdb:duckdb	-1.5%	+5.8%	-7.0%	+16.2%	➖ noise
12	duckdb:vortex-compact	+5.2%	+5.8%	-0.6%	+14.3%	➖ noise
12	duckdb:vortex-file-compressed	-0.5%	+5.8%	-5.9%	+15.5%	➖ noise
13	datafusion:arrow	+4.5%	+0.1%	+4.4%	+13.1%	➖ noise
13	datafusion:vortex-compact	+1.7%	+0.1%	+1.7%	+13.1%	➖ noise
13	datafusion:vortex-file-compressed	+8.5%	+0.1%	+8.4%	+13.1%	➖ noise
13	duckdb:duckdb	+5.5%	+0.1%	+5.4%	+21.4%	➖ noise
13	duckdb:vortex-compact	-1.5%	+0.1%	-1.6%	+13.1%	➖ noise
13	duckdb:vortex-file-compressed	-0.2%	+0.1%	-0.3%	+13.1%	➖ noise
14	datafusion:arrow	-5.0%	-1.4%	-3.6%	+13.1%	➖ noise
14	datafusion:vortex-compact	+12.0%	-1.4%	+13.6%	+13.1%	🚨 regression
14	datafusion:vortex-file-compressed	+6.4%	-1.4%	+7.9%	+13.1%	➖ noise
14	duckdb:duckdb	+2.1%	-1.4%	+3.6%	+23.6%	➖ noise
14	duckdb:vortex-compact	-7.3%	-1.4%	-5.9%	+13.1%	➖ noise
14	duckdb:vortex-file-compressed	-2.5%	-1.4%	-1.1%	+13.1%	➖ noise
15	datafusion:arrow	-2.5%	-6.5%	+4.3%	+14.5%	➖ noise
15	datafusion:vortex-compact	+5.2%	-6.5%	+12.5%	+15.3%	➖ noise
15	datafusion:vortex-file-compressed	-1.8%	-6.5%	+5.0%	+16.1%	➖ noise
15	duckdb:duckdb	+1.6%	-6.5%	+8.7%	+18.7%	➖ noise
15	duckdb:vortex-compact	-3.6%	-6.5%	+3.1%	+14.5%	➖ noise
15	duckdb:vortex-file-compressed	+0.8%	-6.5%	+7.8%	+14.3%	➖ noise
16	datafusion:arrow	-2.3%	+0.2%	-2.5%	+13.1%	➖ noise
16	datafusion:vortex-compact	+2.8%	+0.2%	+2.5%	+13.1%	➖ noise
16	datafusion:vortex-file-compressed	+8.0%	+0.2%	+7.7%	+13.1%	➖ noise
16	duckdb:duckdb	+6.2%	+0.2%	+6.0%	+14.1%	➖ noise
16	duckdb:vortex-compact	+5.9%	+0.2%	+5.6%	+13.1%	➖ noise
16	duckdb:vortex-file-compressed	+2.9%	+0.2%	+2.7%	+13.1%	➖ noise
17	datafusion:arrow	-11.1%	+0.6%	-11.7%	+15.4%	➖ noise
17	datafusion:vortex-compact	+1.4%	+0.6%	+0.7%	+15.9%	➖ noise
17	datafusion:vortex-file-compressed	+18.1%	+0.6%	+17.3%	+16.2%	🚨 regression
17	duckdb:duckdb	-0.5%	+0.6%	-1.2%	+16.8%	➖ noise
17	duckdb:vortex-compact	-0.8%	+0.6%	-1.5%	+15.8%	➖ noise
17	duckdb:vortex-file-compressed	-1.0%	+0.6%	-1.6%	+21.9%	➖ noise
18	datafusion:arrow	+0.9%	-6.3%	+7.7%	+13.1%	➖ noise
18	datafusion:vortex-compact	+2.6%	-6.3%	+9.5%	+13.1%	➖ noise
18	datafusion:vortex-file-compressed	+4.1%	-6.3%	+11.1%	+13.1%	➖ noise
18	duckdb:duckdb	+1.7%	-6.3%	+8.5%	+13.1%	➖ noise
18	duckdb:vortex-compact	-3.9%	-6.3%	+2.6%	+13.1%	➖ noise
18	duckdb:vortex-file-compressed	-0.0%	-6.3%	+6.7%	+13.1%	➖ noise
19	datafusion:arrow	-2.5%	-9.2%	+7.3%	+17.5%	➖ noise
19	datafusion:vortex-compact	+3.3%	-9.2%	+13.8%	+19.8%	➖ noise
19	datafusion:vortex-file-compressed	+8.0%	-9.2%	+18.9%	+21.0%	➖ noise
19	duckdb:duckdb	-2.2%	-9.2%	+7.7%	+25.3%	➖ noise
19	duckdb:vortex-compact	+3.8%	-9.2%	+14.3%	+19.7%	➖ noise
19	duckdb:vortex-file-compressed	+0.6%	-9.2%	+10.8%	+17.1%	➖ noise
20	datafusion:arrow	-4.5%	+4.6%	-8.7%	+14.6%	➖ noise
20	datafusion:vortex-compact	+1.7%	+4.6%	-2.8%	+14.4%	➖ noise
20	datafusion:vortex-file-compressed	+4.5%	+4.6%	-0.1%	+15.1%	➖ noise
20	duckdb:duckdb	-1.6%	+4.6%	-6.0%	+17.0%	➖ noise
20	duckdb:vortex-compact	+3.8%	+4.6%	-0.8%	+17.2%	➖ noise
20	duckdb:vortex-file-compressed	-2.9%	+4.6%	-7.2%	+21.9%	➖ noise
21	datafusion:arrow	-3.1%	+1.5%	-4.5%	+13.1%	➖ noise
21	datafusion:vortex-compact	-0.3%	+1.5%	-1.7%	+13.1%	➖ noise
21	datafusion:vortex-file-compressed	+5.0%	+1.5%	+3.5%	+13.1%	➖ noise
21	duckdb:duckdb	+3.1%	+1.5%	+1.6%	+13.1%	➖ noise
21	duckdb:vortex-compact	-1.1%	+1.5%	-2.5%	+13.1%	➖ noise
21	duckdb:vortex-file-compressed	+1.0%	+1.5%	-0.4%	+13.1%	➖ noise
22	datafusion:arrow	+0.5%	+5.6%	-4.8%	+19.8%	➖ noise
22	datafusion:vortex-compact	-2.2%	+5.6%	-7.4%	+13.1%	➖ noise
22	datafusion:vortex-file-compressed	+12.1%	+5.6%	+6.2%	+13.1%	➖ noise
22	duckdb:duckdb	-0.0%	+5.6%	-5.3%	+13.1%	➖ noise
22	duckdb:vortex-compact	+1.1%	+5.6%	-4.2%	+13.1%	➖ noise
22	duckdb:vortex-file-compressed	+1.2%	+5.6%	-4.1%	+13.1%	➖ noise

[github-actions]

Benchmarks: FineWeb NVMe

Summary

• Overall: 0.988x ➖
• Vortex: 1.002x ➖
• Parquet: 0.962x ➖

Verdict

No clear signal

• Attributed Vortex impact: +4.2%
• Confidence: low
• Environment shift: -3.8%

Statistical Summary

• Systemic shift (parquet controls): -3.8%
• Control sigma: +2.3%
• Residual noise: +1.8%
• Median polish overall: -1.7%

datafusion / vortex-file-compressed (0.995x ➖, 1↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed	5134033	5253096	0.98
fineweb_q01/datafusion:vortex-file-compressed	26713012	26518669	1.01
fineweb_q02/datafusion:vortex-file-compressed	28447132	27624430	1.03
fineweb_q03/datafusion:vortex-file-compressed	86989815	83033981	1.05
fineweb_q04/datafusion:vortex-file-compressed	226469759	227877723	0.99
fineweb_q05/datafusion:vortex-file-compressed	205451662	205051350	1.00
fineweb_q06/datafusion:vortex-file-compressed	69054838	71427908	0.97
fineweb_q07/datafusion:vortex-file-compressed	71917031	66328168	1.08
fineweb_q08/datafusion:vortex-file-compressed 🚀	23263910	27030628	0.86

datafusion / vortex-compact (0.976x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-compact	4163950	4553186	0.91
fineweb_q01/datafusion:vortex-compact	161178504	166450502	0.97
fineweb_q02/datafusion:vortex-compact	164175759	167086729	0.98
fineweb_q03/datafusion:vortex-compact	1441326854	1475630158	0.98
fineweb_q04/datafusion:vortex-compact	1567667529	1581301562	0.99
fineweb_q05/datafusion:vortex-compact	1245948902	1268587112	0.98
fineweb_q06/datafusion:vortex-compact	680629026	705657951	0.96
fineweb_q07/datafusion:vortex-compact	726568493	734989955	0.99
fineweb_q08/datafusion:vortex-compact	24315200	23870222	1.02

datafusion / parquet (0.934x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet	5921119	6430208	0.92
fineweb_q01/datafusion:parquet	270285531	300086561	0.90
fineweb_q02/datafusion:parquet	274158871	289578203	0.95
fineweb_q03/datafusion:parquet	272511974	292602685	0.93
fineweb_q04/datafusion:parquet	292533244	313530314	0.93
fineweb_q05/datafusion:parquet	284931017	298951478	0.95
fineweb_q06/datafusion:parquet	274214809	296045167	0.93
fineweb_q07/datafusion:parquet	272690468	295219822	0.92
fineweb_q08/datafusion:parquet	266900329	274211770	0.97

duckdb / vortex-file-compressed (1.080x ➖, 0↑ 4↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed	3612133	3357410	1.08
fineweb_q01/duckdb:vortex-file-compressed 🚨	33007557	28469731	1.16
fineweb_q02/duckdb:vortex-file-compressed 🚨	32600702	27880574	1.17
fineweb_q03/duckdb:vortex-file-compressed	130872374	132487010	0.99
fineweb_q04/duckdb:vortex-file-compressed	236863195	216787214	1.09
fineweb_q05/duckdb:vortex-file-compressed	194060441	178856421	1.09
fineweb_q06/duckdb:vortex-file-compressed 🚨	75670204	68323953	1.11
fineweb_q07/duckdb:vortex-file-compressed 🚨	77492560	70404127	1.10
fineweb_q08/duckdb:vortex-file-compressed	26497223	27661036	0.96

duckdb / vortex-compact (0.960x ➖, 2↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀	4097684	4610981	0.89
fineweb_q01/duckdb:vortex-compact 🚀	95340370	113497946	0.84
fineweb_q02/duckdb:vortex-compact	115958288	119703668	0.97
fineweb_q03/duckdb:vortex-compact	854471848	878109910	0.97
fineweb_q04/duckdb:vortex-compact	927938055	923281308	1.01
fineweb_q05/duckdb:vortex-compact	832337938	830326318	1.00
fineweb_q06/duckdb:vortex-compact	467816664	466054981	1.00
fineweb_q07/duckdb:vortex-compact	474875619	480324910	0.99
fineweb_q08/duckdb:vortex-compact	22876327	23272169	0.98

duckdb / parquet (0.990x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet	36462598	37236527	0.98
fineweb_q01/duckdb:parquet	93964373	96120883	0.98
fineweb_q02/duckdb:parquet	97078353	99292199	0.98
fineweb_q03/duckdb:parquet	306922470	308856692	0.99
fineweb_q04/duckdb:parquet	439523887	445034788	0.99
fineweb_q05/duckdb:parquet	413857921	417173378	0.99
fineweb_q06/duckdb:parquet	200938492	208245629	0.96
fineweb_q07/duckdb:parquet	210997415	214737853	0.98
fineweb_q08/duckdb:parquet	60660187	57439719	1.06

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-compact	-8.5%	-5.0%	-3.7%	+44.4%	➖ noise
0	datafusion:vortex-file-compressed	-2.3%	-5.0%	+2.9%	+75.9%	➖ noise
0	duckdb:vortex-compact	-11.1%	-5.0%	-6.4%	+40.1%	➖ noise
0	duckdb:vortex-file-compressed	+7.6%	-5.0%	+13.3%	+50.8%	➖ noise
1	datafusion:vortex-compact	-3.2%	-6.2%	+3.2%	+10.0%	➖ noise
1	datafusion:vortex-file-compressed	+0.7%	-6.2%	+7.4%	+23.0%	➖ noise
1	duckdb:vortex-compact	-16.0%	-6.2%	-10.5%	+22.2%	➖ noise
1	duckdb:vortex-file-compressed	+15.9%	-6.2%	+23.6%	+35.6%	➖ noise
2	datafusion:vortex-compact	-1.7%	-3.8%	+2.1%	+10.0%	➖ noise
2	datafusion:vortex-file-compressed	+3.0%	-3.8%	+7.0%	+17.9%	➖ noise
2	duckdb:vortex-compact	-3.1%	-3.8%	+0.7%	+10.0%	➖ noise
2	duckdb:vortex-file-compressed	+16.9%	-3.8%	+21.5%	+13.9%	🚨 regression
3	datafusion:vortex-compact	-2.3%	-3.8%	+1.5%	+10.0%	➖ noise
3	datafusion:vortex-file-compressed	+4.8%	-3.8%	+8.9%	+31.2%	➖ noise
3	duckdb:vortex-compact	-2.7%	-3.8%	+1.1%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	-1.2%	-3.8%	+2.7%	+36.8%	➖ noise
4	datafusion:vortex-compact	-0.9%	-4.0%	+3.3%	+10.0%	➖ noise
4	datafusion:vortex-file-compressed	-0.6%	-4.0%	+3.5%	+10.0%	➖ noise
4	duckdb:vortex-compact	+0.5%	-4.0%	+4.7%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	+9.3%	-4.0%	+13.8%	+12.0%	🚨 regression
5	datafusion:vortex-compact	-1.8%	-2.8%	+1.0%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	+0.2%	-2.8%	+3.0%	+10.0%	➖ noise
5	duckdb:vortex-compact	+0.2%	-2.8%	+3.1%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	+8.5%	-2.8%	+11.6%	+10.0%	🚨 regression
6	datafusion:vortex-compact	-3.5%	-5.5%	+2.0%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	-3.3%	-5.5%	+2.3%	+11.2%	➖ noise
6	duckdb:vortex-compact	+0.4%	-5.5%	+6.2%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	+10.8%	-5.5%	+17.1%	+17.8%	➖ noise
7	datafusion:vortex-compact	-1.1%	-4.7%	+3.8%	+10.0%	➖ noise
7	datafusion:vortex-file-compressed	+8.4%	-4.7%	+13.8%	+14.1%	➖ noise
7	duckdb:vortex-compact	-1.1%	-4.7%	+3.8%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	+10.1%	-4.7%	+15.5%	+10.0%	🚨 regression
8	datafusion:vortex-compact	+1.9%	+1.4%	+0.5%	+21.8%	➖ noise
8	datafusion:vortex-file-compressed	-13.9%	+1.4%	-15.1%	+17.2%	✅ faster
8	duckdb:vortex-compact	-1.7%	+1.4%	-3.0%	+23.0%	➖ noise
8	duckdb:vortex-file-compressed	-4.2%	+1.4%	-5.5%	+23.8%	➖ noise

[github-actions]

Benchmarks: TPC-DS SF=1 on NVME

Summary

• Overall: 0.946x ➖
• Vortex: 0.938x ➖
• Parquet: 0.968x ➖

Verdict

No clear signal

• Attributed Vortex impact: -3.2%
• Confidence: low
• Environment shift: -3.2%

Statistical Summary

• Systemic shift (parquet controls): -3.2%
• Control sigma: +3.2%
• Residual noise: +3.3%
• Median polish overall: -6.0%

datafusion / vortex-file-compressed (1.017x ➖, 0↑ 1↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed	29055663	28107365	1.03
tpcds_q02/datafusion:vortex-file-compressed	76050368	76156743	1.00
tpcds_q03/datafusion:vortex-file-compressed	27505245	27314941	1.01
tpcds_q04/datafusion:vortex-file-compressed	391436040	394659980	0.99
tpcds_q05/datafusion:vortex-file-compressed	74291495	74575533	1.00
tpcds_q06/datafusion:vortex-file-compressed	77557780	75310552	1.03
tpcds_q07/datafusion:vortex-file-compressed	77138441	76792294	1.00
tpcds_q08/datafusion:vortex-file-compressed	41516136	39198797	1.06
tpcds_q09/datafusion:vortex-file-compressed	47622148	46188884	1.03
tpcds_q10/datafusion:vortex-file-compressed	51563530	47851330	1.08
tpcds_q11/datafusion:vortex-file-compressed	230756374	226642236	1.02
tpcds_q12/datafusion:vortex-file-compressed	34541574	35183354	0.98
tpcds_q13/datafusion:vortex-file-compressed	77151349	76390516	1.01
tpcds_q14/datafusion:vortex-file-compressed	212766865	211240942	1.01
tpcds_q15/datafusion:vortex-file-compressed	50711673	49908853	1.02
tpcds_q16/datafusion:vortex-file-compressed	29980070	28838919	1.04
tpcds_q17/datafusion:vortex-file-compressed	111793993	115354789	0.97
tpcds_q18/datafusion:vortex-file-compressed	99386717	100464151	0.99
tpcds_q19/datafusion:vortex-file-compressed	47085879	47366612	0.99
tpcds_q20/datafusion:vortex-file-compressed	39965210	39176102	1.02
tpcds_q21/datafusion:vortex-file-compressed	172769855	178576420	0.97
tpcds_q22/datafusion:vortex-file-compressed	68608702	70720602	0.97
tpcds_q23/datafusion:vortex-file-compressed	189157609	187003906	1.01
tpcds_q24/datafusion:vortex-file-compressed	177797404	181994746	0.98
tpcds_q25/datafusion:vortex-file-compressed	113953787	111341309	1.02
tpcds_q26/datafusion:vortex-file-compressed	61644481	62927597	0.98
tpcds_q27/datafusion:vortex-file-compressed	165842268	161879765	1.02
tpcds_q28/datafusion:vortex-file-compressed	48834824	48821153	1.00
tpcds_q29/datafusion:vortex-file-compressed	114592798	110239643	1.04
tpcds_q30/datafusion:vortex-file-compressed	30062848	31312427	0.96
tpcds_q31/datafusion:vortex-file-compressed	180596148	177997210	1.01
tpcds_q32/datafusion:vortex-file-compressed	24073175	23291811	1.03
tpcds_q33/datafusion:vortex-file-compressed	38212123	36654648	1.04
tpcds_q34/datafusion:vortex-file-compressed	36763707	36741129	1.00
tpcds_q35/datafusion:vortex-file-compressed	61942816	58547981	1.06
tpcds_q36/datafusion:vortex-file-compressed	105221907	103719070	1.01
tpcds_q37/datafusion:vortex-file-compressed	39205383	38755368	1.01
tpcds_q38/datafusion:vortex-file-compressed	86778094	86591562	1.00
tpcds_q39/datafusion:vortex-file-compressed	211311587	194030086	1.09
tpcds_q40/datafusion:vortex-file-compressed	54625871	55924272	0.98
tpcds_q41/datafusion:vortex-file-compressed	14118386	13529078	1.04
tpcds_q42/datafusion:vortex-file-compressed	31054323	30511998	1.02
tpcds_q43/datafusion:vortex-file-compressed	48352715	48300445	1.00
tpcds_q44/datafusion:vortex-file-compressed	42469615	41688196	1.02
tpcds_q45/datafusion:vortex-file-compressed	48640003	48444020	1.00
tpcds_q46/datafusion:vortex-file-compressed	68062585	64411655	1.06
tpcds_q47/datafusion:vortex-file-compressed	282536141	274188703	1.03
tpcds_q48/datafusion:vortex-file-compressed	69611910	67960415	1.02
tpcds_q49/datafusion:vortex-file-compressed	69909286	68735280	1.02
tpcds_q50/datafusion:vortex-file-compressed	76577509	73123295	1.05
tpcds_q51/datafusion:vortex-file-compressed	94845960	92172985	1.03
tpcds_q52/datafusion:vortex-file-compressed	30593623	28912194	1.06
tpcds_q53/datafusion:vortex-file-compressed	30987135	29037140	1.07
tpcds_q54/datafusion:vortex-file-compressed	49371286	47263421	1.04
tpcds_q55/datafusion:vortex-file-compressed	31633836	30666088	1.03
tpcds_q56/datafusion:vortex-file-compressed	46039319	45425520	1.01
tpcds_q57/datafusion:vortex-file-compressed	182593082	179850007	1.02
tpcds_q58/datafusion:vortex-file-compressed	115549878	109612165	1.05
tpcds_q59/datafusion:vortex-file-compressed	93287634	91419013	1.02
tpcds_q60/datafusion:vortex-file-compressed	46133430	47525051	0.97
tpcds_q61/datafusion:vortex-file-compressed	58244873	56652539	1.03
tpcds_q62/datafusion:vortex-file-compressed	45382394	43418589	1.05
tpcds_q63/datafusion:vortex-file-compressed	29000095	28653501	1.01
tpcds_q64/datafusion:vortex-file-compressed	717228018	714326482	1.00
tpcds_q65/datafusion:vortex-file-compressed	53410728	51803179	1.03
tpcds_q66/datafusion:vortex-file-compressed	102011913	107031027	0.95
tpcds_q67/datafusion:vortex-file-compressed	143986496	143028551	1.01
tpcds_q68/datafusion:vortex-file-compressed	63523017	66958987	0.95
tpcds_q69/datafusion:vortex-file-compressed	46340401	44873694	1.03
tpcds_q70/datafusion:vortex-file-compressed	126522947	132741680	0.95
tpcds_q71/datafusion:vortex-file-compressed	31052092	29287820	1.06
tpcds_q72/datafusion:vortex-file-compressed	3417968386	3388269580	1.01
tpcds_q73/datafusion:vortex-file-compressed	37240616	38358136	0.97
tpcds_q74/datafusion:vortex-file-compressed	165874376	165305321	1.00
tpcds_q75/datafusion:vortex-file-compressed	133557485	131400019	1.02
tpcds_q76/datafusion:vortex-file-compressed	65054597	68703408	0.95
tpcds_q77/datafusion:vortex-file-compressed	53089730	54028953	0.98
tpcds_q78/datafusion:vortex-file-compressed	178948088	177070644	1.01
tpcds_q79/datafusion:vortex-file-compressed	43343611	42624387	1.02
tpcds_q80/datafusion:vortex-file-compressed	119195835	115999490	1.03
tpcds_q81/datafusion:vortex-file-compressed	36434340	38052143	0.96
tpcds_q82/datafusion:vortex-file-compressed	40810794	39863349	1.02
tpcds_q83/datafusion:vortex-file-compressed	64933416	67154255	0.97
tpcds_q84/datafusion:vortex-file-compressed	15306714	15323089	1.00
tpcds_q85/datafusion:vortex-file-compressed	136529177	133753177	1.02
tpcds_q86/datafusion:vortex-file-compressed	32332269	30263809	1.07
tpcds_q87/datafusion:vortex-file-compressed	91884843	88660014	1.04
tpcds_q88/datafusion:vortex-file-compressed	81162026	79050387	1.03
tpcds_q89/datafusion:vortex-file-compressed	58496126	56697135	1.03
tpcds_q90/datafusion:vortex-file-compressed	17529104	16203441	1.08
tpcds_q91/datafusion:vortex-file-compressed	28059408	25996037	1.08
tpcds_q92/datafusion:vortex-file-compressed	19835182	19460677	1.02
tpcds_q93/datafusion:vortex-file-compressed 🚨	40358608	35633947	1.13
tpcds_q94/datafusion:vortex-file-compressed	27374759	25496908	1.07
tpcds_q95/datafusion:vortex-file-compressed	92248281	87944106	1.05
tpcds_q96/datafusion:vortex-file-compressed	16225766	14764369	1.10
tpcds_q97/datafusion:vortex-file-compressed	31256484	31763659	0.98
tpcds_q98/datafusion:vortex-file-compressed	49252402	50129284	0.98
tpcds_q99/datafusion:vortex-file-compressed	61705821	59640187	1.03

datafusion / vortex-compact (0.885x ✅, 73↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpcds_q01/datafusion:vortex-compact	35007499	36481055	0.96
tpcds_q02/datafusion:vortex-compact	81677590	80722905	1.01
tpcds_q03/datafusion:vortex-compact	33678991	32010641	1.05
tpcds_q04/datafusion:vortex-compact	437196278	444580398	0.98
tpcds_q05/datafusion:vortex-compact	82499001	83179076	0.99
tpcds_q06/datafusion:vortex-compact	84464529	80172989	1.05
tpcds_q07/datafusion:vortex-compact	94776133	92083203	1.03
tpcds_q08/datafusion:vortex-compact	49059107	48080352	1.02
tpcds_q09/datafusion:vortex-compact	99854933	99555174	1.00
tpcds_q10/datafusion:vortex-compact	67153568	67807628	0.99
tpcds_q11/datafusion:vortex-compact	261328459	257710295	1.01
tpcds_q12/datafusion:vortex-compact	39789171	41752627	0.95
tpcds_q13/datafusion:vortex-compact	139334609	149301398	0.93
tpcds_q14/datafusion:vortex-compact 🚀	268862111	311509068	0.86
tpcds_q15/datafusion:vortex-compact 🚀	54875696	62863019	0.87
tpcds_q16/datafusion:vortex-compact	41905626	44355903	0.94
tpcds_q17/datafusion:vortex-compact 🚀	126897205	144773128	0.88
tpcds_q18/datafusion:vortex-compact 🚀	114536208	133643528	0.86
tpcds_q19/datafusion:vortex-compact 🚀	61396025	69082919	0.89
tpcds_q20/datafusion:vortex-compact	46354959	50197082	0.92
tpcds_q21/datafusion:vortex-compact 🚀	178227687	208602908	0.85
tpcds_q22/datafusion:vortex-compact 🚀	75759863	88566866	0.86
tpcds_q23/datafusion:vortex-compact 🚀	237714130	276999041	0.86
tpcds_q24/datafusion:vortex-compact 🚀	206240855	245174546	0.84
tpcds_q25/datafusion:vortex-compact 🚀	128082874	149985070	0.85
tpcds_q26/datafusion:vortex-compact 🚀	71690302	85050468	0.84
tpcds_q27/datafusion:vortex-compact 🚀	208026918	247755697	0.84
tpcds_q28/datafusion:vortex-compact 🚀	100705344	114719461	0.88
tpcds_q29/datafusion:vortex-compact 🚀	127918242	147607660	0.87
tpcds_q30/datafusion:vortex-compact 🚀	35541457	42332516	0.84
tpcds_q31/datafusion:vortex-compact 🚀	212988186	238217156	0.89
tpcds_q32/datafusion:vortex-compact 🚀	29134686	35356417	0.82
tpcds_q33/datafusion:vortex-compact 🚀	51872827	61038966	0.85
tpcds_q34/datafusion:vortex-compact 🚀	58574826	66543851	0.88
tpcds_q35/datafusion:vortex-compact 🚀	75428083	89985424	0.84
tpcds_q36/datafusion:vortex-compact 🚀	127023615	145515805	0.87
tpcds_q37/datafusion:vortex-compact 🚀	49841531	57685354	0.86
tpcds_q38/datafusion:vortex-compact 🚀	100381123	113134833	0.89
tpcds_q39/datafusion:vortex-compact	224202767	230186897	0.97
tpcds_q40/datafusion:vortex-compact 🚀	63674013	75066433	0.85
tpcds_q41/datafusion:vortex-compact 🚀	15527923	20396756	0.76
tpcds_q42/datafusion:vortex-compact 🚀	35894057	42133763	0.85
tpcds_q43/datafusion:vortex-compact 🚀	54753527	63243018	0.87
tpcds_q44/datafusion:vortex-compact 🚀	69575444	79179684	0.88
tpcds_q45/datafusion:vortex-compact 🚀	51782089	60116704	0.86
tpcds_q46/datafusion:vortex-compact 🚀	91075179	106653404	0.85
tpcds_q47/datafusion:vortex-compact 🚀	301818109	372100680	0.81
tpcds_q48/datafusion:vortex-compact	113039010	122036296	0.93
tpcds_q49/datafusion:vortex-compact 🚀	100435210	113333917	0.89
tpcds_q50/datafusion:vortex-compact 🚀	94402755	109355148	0.86
tpcds_q51/datafusion:vortex-compact 🚀	100076207	120649240	0.83
tpcds_q52/datafusion:vortex-compact	36473864	39997048	0.91
tpcds_q53/datafusion:vortex-compact 🚀	39575672	45970091	0.86
tpcds_q54/datafusion:vortex-compact 🚀	62862605	72382278	0.87
tpcds_q55/datafusion:vortex-compact	35592304	39348157	0.90
tpcds_q56/datafusion:vortex-compact 🚀	59907718	67816864	0.88
tpcds_q57/datafusion:vortex-compact 🚀	194810128	225933181	0.86
tpcds_q58/datafusion:vortex-compact 🚀	119771516	134994767	0.89
tpcds_q59/datafusion:vortex-compact 🚀	110313994	131986037	0.84
tpcds_q60/datafusion:vortex-compact 🚀	60794499	67917430	0.90
tpcds_q61/datafusion:vortex-compact 🚀	83283466	94639906	0.88
tpcds_q62/datafusion:vortex-compact 🚀	45427771	52396904	0.87
tpcds_q63/datafusion:vortex-compact 🚀	41100322	46845228	0.88
tpcds_q64/datafusion:vortex-compact 🚀	799551718	914071185	0.87
tpcds_q65/datafusion:vortex-compact 🚀	71561469	84277063	0.85
tpcds_q66/datafusion:vortex-compact 🚀	110996696	131118125	0.85
tpcds_q67/datafusion:vortex-compact 🚀	148149972	176675126	0.84
tpcds_q68/datafusion:vortex-compact 🚀	89713106	105226025	0.85
tpcds_q69/datafusion:vortex-compact 🚀	64294258	72791273	0.88
tpcds_q70/datafusion:vortex-compact 🚀	145540933	162096615	0.90
tpcds_q71/datafusion:vortex-compact 🚀	46110992	53091123	0.87
tpcds_q72/datafusion:vortex-compact 🚀	3402438560	4398647669	0.77
tpcds_q73/datafusion:vortex-compact 🚀	57164278	66855190	0.86
tpcds_q74/datafusion:vortex-compact 🚀	188650184	211216836	0.89
tpcds_q75/datafusion:vortex-compact 🚀	186016090	211332087	0.88
tpcds_q76/datafusion:vortex-compact 🚀	81260440	91886064	0.88
tpcds_q77/datafusion:vortex-compact 🚀	70106906	78561413	0.89
tpcds_q78/datafusion:vortex-compact 🚀	205117647	247654569	0.83
tpcds_q79/datafusion:vortex-compact 🚀	67895470	78391066	0.87
tpcds_q80/datafusion:vortex-compact 🚀	138117428	159897772	0.86
tpcds_q81/datafusion:vortex-compact 🚀	43227882	51436115	0.84
tpcds_q82/datafusion:vortex-compact 🚀	50990534	60279666	0.85
tpcds_q83/datafusion:vortex-compact 🚀	66361329	75407872	0.88
tpcds_q84/datafusion:vortex-compact 🚀	19079037	21441978	0.89
tpcds_q85/datafusion:vortex-compact	156370353	172934493	0.90
tpcds_q86/datafusion:vortex-compact 🚀	32697453	37479477	0.87
tpcds_q87/datafusion:vortex-compact	103547654	113695558	0.91
tpcds_q88/datafusion:vortex-compact 🚀	130250950	147899519	0.88
tpcds_q89/datafusion:vortex-compact 🚀	64986031	74843745	0.87
tpcds_q90/datafusion:vortex-compact	22856138	24940443	0.92
tpcds_q91/datafusion:vortex-compact	42111357	46559511	0.90
tpcds_q92/datafusion:vortex-compact 🚀	22277911	26363498	0.85
tpcds_q93/datafusion:vortex-compact 🚀	51815665	60917301	0.85
tpcds_q94/datafusion:vortex-compact	32689826	35272713	0.93
tpcds_q95/datafusion:vortex-compact	97639662	107050535	0.91
tpcds_q96/datafusion:vortex-compact 🚀	24063935	27827281	0.86
tpcds_q97/datafusion:vortex-compact	45336206	50251123	0.90
tpcds_q98/datafusion:vortex-compact 🚀	54599249	65702429	0.83
tpcds_q99/datafusion:vortex-compact 🚀	65808649	77210115	0.85

datafusion / parquet (1.028x ➖, 0↑ 4↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpcds_q01/datafusion:parquet	38815609	37834882	1.03
tpcds_q02/datafusion:parquet	51707311	49936014	1.04
tpcds_q03/datafusion:parquet	15969929	17303673	0.92
tpcds_q04/datafusion:parquet	366973989	361921091	1.01
tpcds_q05/datafusion:parquet	88247587	90395113	0.98
tpcds_q06/datafusion:parquet	97291443	94872724	1.03
tpcds_q07/datafusion:parquet	135052096	130154081	1.04
tpcds_q08/datafusion:parquet	39684022	37800377	1.05
tpcds_q09/datafusion:parquet	55870014	53858353	1.04
tpcds_q10/datafusion:parquet	100855175	103973988	0.97
tpcds_q11/datafusion:parquet	224500575	228901283	0.98
tpcds_q12/datafusion:parquet	31120432	33218085	0.94
tpcds_q13/datafusion:parquet	140429853	140919053	1.00
tpcds_q14/datafusion:parquet	212463941	213568431	0.99
tpcds_q15/datafusion:parquet	54643444	55101905	0.99
tpcds_q16/datafusion:parquet	34529869	33157052	1.04
tpcds_q17/datafusion:parquet	174738494	173567524	1.01
tpcds_q18/datafusion:parquet	178763827	180361788	0.99
tpcds_q19/datafusion:parquet	36381503	35483946	1.03
tpcds_q20/datafusion:parquet	25008941	24935411	1.00
tpcds_q21/datafusion:parquet	29855945	27737924	1.08
tpcds_q22/datafusion:parquet	160052059	152383134	1.05
tpcds_q23/datafusion:parquet	187172583	179803002	1.04
tpcds_q24/datafusion:parquet	217123574	213993691	1.01
tpcds_q25/datafusion:parquet	181286640	176433036	1.03
tpcds_q26/datafusion:parquet	118873150	116220374	1.02
tpcds_q27/datafusion:parquet	264935380	259026647	1.02
tpcds_q28/datafusion:parquet	55576962	51844364	1.07
tpcds_q29/datafusion:parquet	183345994	181207563	1.01
tpcds_q30/datafusion:parquet	48184228	44696056	1.08
tpcds_q31/datafusion:parquet	112124795	104915841	1.07
tpcds_q32/datafusion:parquet	31332857	28646042	1.09
tpcds_q33/datafusion:parquet	39170166	35702266	1.10
tpcds_q34/datafusion:parquet	36713877	35950901	1.02
tpcds_q35/datafusion:parquet	103422287	96657317	1.07
tpcds_q36/datafusion:parquet	84812573	83258391	1.02
tpcds_q37/datafusion:parquet	27494094	25430472	1.08
tpcds_q38/datafusion:parquet	64507632	65243859	0.99
tpcds_q39/datafusion:parquet	101981487	98734128	1.03
tpcds_q40/datafusion:parquet	37613810	37146186	1.01
tpcds_q41/datafusion:parquet 🚨	13999820	12649473	1.11
tpcds_q42/datafusion:parquet 🚨	17198484	15110148	1.14
tpcds_q43/datafusion:parquet	28075769	26347446	1.07
tpcds_q44/datafusion:parquet	43560579	41427392	1.05
tpcds_q45/datafusion:parquet 🚨	71886656	65058031	1.10
tpcds_q46/datafusion:parquet	52872621	50593956	1.05
tpcds_q47/datafusion:parquet	197562725	184697751	1.07
tpcds_q48/datafusion:parquet	133945566	127362523	1.05
tpcds_q49/datafusion:parquet	75768470	74422680	1.02
tpcds_q50/datafusion:parquet	110300225	113511963	0.97
tpcds_q51/datafusion:parquet	102502392	98606060	1.04
tpcds_q52/datafusion:parquet	16097137	15789836	1.02
tpcds_q53/datafusion:parquet	31831904	31210978	1.02
tpcds_q54/datafusion:parquet	49933996	46552101	1.07
tpcds_q55/datafusion:parquet	16262782	15750936	1.03
tpcds_q56/datafusion:parquet	38985212	36013447	1.08
tpcds_q57/datafusion:parquet	137239303	133870560	1.03
tpcds_q58/datafusion:parquet	73388767	71425093	1.03
tpcds_q59/datafusion:parquet	69707889	65597640	1.06
tpcds_q60/datafusion:parquet	37697359	37091745	1.02
tpcds_q61/datafusion:parquet	65875883	65059317	1.01
tpcds_q62/datafusion:parquet	47349836	45307362	1.05
tpcds_q63/datafusion:parquet	32889020	30186876	1.09
tpcds_q64/datafusion:parquet	1010748407	999555379	1.01
tpcds_q65/datafusion:parquet	51615094	50771077	1.02
tpcds_q66/datafusion:parquet	91083191	90664431	1.00
tpcds_q67/datafusion:parquet	191172141	181001469	1.06
tpcds_q68/datafusion:parquet	52113443	50410663	1.03
tpcds_q69/datafusion:parquet	94875403	94279323	1.01
tpcds_q70/datafusion:parquet	108568038	110411342	0.98
tpcds_q71/datafusion:parquet	30222255	28749568	1.05
tpcds_q72/datafusion:parquet	882092776	864906831	1.02
tpcds_q73/datafusion:parquet	38128434	38158978	1.00
tpcds_q74/datafusion:parquet	130073670	133144108	0.98
tpcds_q75/datafusion:parquet	136393126	129541260	1.05
tpcds_q76/datafusion:parquet	96256101	87619880	1.10
tpcds_q77/datafusion:parquet	60025091	57662351	1.04
tpcds_q78/datafusion:parquet	182335845	180106821	1.01
tpcds_q79/datafusion:parquet	40518434	40464333	1.00
tpcds_q80/datafusion:parquet	111848159	111647271	1.00
tpcds_q81/datafusion:parquet	44990734	43957423	1.02
tpcds_q82/datafusion:parquet	29523680	28725053	1.03
tpcds_q83/datafusion:parquet	55789034	53228842	1.05
tpcds_q84/datafusion:parquet	49302735	48461148	1.02
tpcds_q85/datafusion:parquet	245105305	246750656	0.99
tpcds_q86/datafusion:parquet	22108446	20788799	1.06
tpcds_q87/datafusion:parquet	65310675	65252041	1.00
tpcds_q88/datafusion:parquet	79838598	79996366	1.00
tpcds_q89/datafusion:parquet	36926999	36874047	1.00
tpcds_q90/datafusion:parquet	19254672	18483610	1.04
tpcds_q91/datafusion:parquet	78395565	79051357	0.99
tpcds_q92/datafusion:parquet	25199237	25037531	1.01
tpcds_q93/datafusion:parquet	39012492	38680260	1.01
tpcds_q94/datafusion:parquet	27196983	27421892	0.99
tpcds_q95/datafusion:parquet	133910465	136374148	0.98
tpcds_q96/datafusion:parquet	14338905	15299326	0.94
tpcds_q97/datafusion:parquet	36539357	35047838	1.04
tpcds_q98/datafusion:parquet	37817331	37600613	1.01
tpcds_q99/datafusion:parquet 🚨	52826390	46640176	1.13

duckdb / vortex-file-compressed (0.918x ➖, 37↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed	28766921	29088524	0.99
tpcds_q02/duckdb:vortex-file-compressed	86286240	89750955	0.96
tpcds_q03/duckdb:vortex-file-compressed	22948221	24548387	0.93
tpcds_q04/duckdb:vortex-file-compressed 🚀	106935551	120931051	0.88
tpcds_q05/duckdb:vortex-file-compressed 🚀	99135374	114167861	0.87
tpcds_q06/duckdb:vortex-file-compressed 🚀	35760047	40051775	0.89
tpcds_q07/duckdb:vortex-file-compressed 🚀	23050670	26652419	0.86
tpcds_q08/duckdb:vortex-file-compressed 🚀	24161860	27388512	0.88
tpcds_q09/duckdb:vortex-file-compressed	41050033	45022664	0.91
tpcds_q10/duckdb:vortex-file-compressed 🚀	36527858	40772021	0.90
tpcds_q11/duckdb:vortex-file-compressed	64781936	67289197	0.96
tpcds_q12/duckdb:vortex-file-compressed 🚀	14287336	16734468	0.85
tpcds_q13/duckdb:vortex-file-compressed	34580549	37649011	0.92
tpcds_q14/duckdb:vortex-file-compressed	206753559	203417145	1.02
tpcds_q15/duckdb:vortex-file-compressed	41406758	45432321	0.91
tpcds_q16/duckdb:vortex-file-compressed	30450312	33601139	0.91
tpcds_q17/duckdb:vortex-file-compressed	38692515	42685868	0.91
tpcds_q18/duckdb:vortex-file-compressed	48585610	49707937	0.98
tpcds_q19/duckdb:vortex-file-compressed 🚀	32652194	36846841	0.89
tpcds_q20/duckdb:vortex-file-compressed 🚀	16273447	18239999	0.89
tpcds_q21/duckdb:vortex-file-compressed	21658085	21704698	1.00
tpcds_q22/duckdb:vortex-file-compressed 🚀	106328387	121134946	0.88
tpcds_q23/duckdb:vortex-file-compressed 🚀	123200532	143485710	0.86
tpcds_q24/duckdb:vortex-file-compressed	56480585	60246185	0.94
tpcds_q25/duckdb:vortex-file-compressed	38854385	40677882	0.96
tpcds_q26/duckdb:vortex-file-compressed	40955229	45418623	0.90
tpcds_q27/duckdb:vortex-file-compressed	89325709	94770437	0.94
tpcds_q28/duckdb:vortex-file-compressed	38185893	38916538	0.98
tpcds_q29/duckdb:vortex-file-compressed	39004531	40655985	0.96
tpcds_q30/duckdb:vortex-file-compressed 🚀	29087935	34031894	0.85
tpcds_q31/duckdb:vortex-file-compressed	26320600	27328160	0.96
tpcds_q32/duckdb:vortex-file-compressed 🚀	16379872	18304873	0.89
tpcds_q33/duckdb:vortex-file-compressed 🚀	66295875	73785533	0.90
tpcds_q34/duckdb:vortex-file-compressed 🚀	18454587	21510410	0.86
tpcds_q35/duckdb:vortex-file-compressed 🚀	64424896	75399058	0.85
tpcds_q36/duckdb:vortex-file-compressed 🚀	27416548	31418327	0.87
tpcds_q37/duckdb:vortex-file-compressed	23949358	25308676	0.95
tpcds_q38/duckdb:vortex-file-compressed	38871477	42176143	0.92
tpcds_q39/duckdb:vortex-file-compressed	46799934	46636600	1.00
tpcds_q40/duckdb:vortex-file-compressed	24032799	24813568	0.97
tpcds_q41/duckdb:vortex-file-compressed 🚀	12965401	15195861	0.85
tpcds_q42/duckdb:vortex-file-compressed	12735788	13272985	0.96
tpcds_q43/duckdb:vortex-file-compressed	20398915	21475406	0.95
tpcds_q44/duckdb:vortex-file-compressed	24668166	25920530	0.95
tpcds_q45/duckdb:vortex-file-compressed 🚀	26241801	31267292	0.84
tpcds_q46/duckdb:vortex-file-compressed	46975312	52145388	0.90
tpcds_q47/duckdb:vortex-file-compressed 🚀	50719965	56405377	0.90
tpcds_q48/duckdb:vortex-file-compressed	30451416	33567562	0.91
tpcds_q49/duckdb:vortex-file-compressed	32008254	34146514	0.94
tpcds_q50/duckdb:vortex-file-compressed 🚀	34297909	39252220	0.87
tpcds_q51/duckdb:vortex-file-compressed	102330671	106830198	0.96
tpcds_q52/duckdb:vortex-file-compressed 🚀	12533604	14654459	0.86
tpcds_q53/duckdb:vortex-file-compressed	17516916	19347808	0.91
tpcds_q54/duckdb:vortex-file-compressed	50475839	55881325	0.90
tpcds_q55/duckdb:vortex-file-compressed 🚀	11664279	13407811	0.87
tpcds_q56/duckdb:vortex-file-compressed 🚀	64395324	75433370	0.85
tpcds_q57/duckdb:vortex-file-compressed	44087691	48247766	0.91
tpcds_q58/duckdb:vortex-file-compressed	32673687	34985663	0.93
tpcds_q59/duckdb:vortex-file-compressed	56838880	60094483	0.95
tpcds_q60/duckdb:vortex-file-compressed 🚀	69472222	80430302	0.86
tpcds_q61/duckdb:vortex-file-compressed	39636963	40991572	0.97
tpcds_q62/duckdb:vortex-file-compressed 🚀	17721357	19697194	0.90
tpcds_q63/duckdb:vortex-file-compressed	17921876	19293741	0.93
tpcds_q64/duckdb:vortex-file-compressed	79170786	87700885	0.90
tpcds_q65/duckdb:vortex-file-compressed 🚀	24053901	27022701	0.89
tpcds_q66/duckdb:vortex-file-compressed	60488118	64309670	0.94
tpcds_q67/duckdb:vortex-file-compressed	145128902	159038446	0.91
tpcds_q68/duckdb:vortex-file-compressed	41445954	44301389	0.94
tpcds_q69/duckdb:vortex-file-compressed	38611648	42611651	0.91
tpcds_q70/duckdb:vortex-file-compressed	25554618	26586936	0.96
tpcds_q71/duckdb:vortex-file-compressed	21455381	21975452	0.98
tpcds_q72/duckdb:vortex-file-compressed	177941101	183525224	0.97
tpcds_q73/duckdb:vortex-file-compressed	19722937	21567648	0.91
tpcds_q74/duckdb:vortex-file-compressed 🚀	49976158	56008910	0.89
tpcds_q75/duckdb:vortex-file-compressed	61824566	65213519	0.95
tpcds_q76/duckdb:vortex-file-compressed 🚀	63748544	74002573	0.86
tpcds_q77/duckdb:vortex-file-compressed	66758876	67283248	0.99
tpcds_q78/duckdb:vortex-file-compressed	79405293	84100885	0.94
tpcds_q79/duckdb:vortex-file-compressed	35499485	37765419	0.94
tpcds_q80/duckdb:vortex-file-compressed 🚀	87835892	100275344	0.88
tpcds_q81/duckdb:vortex-file-compressed	34942429	38012589	0.92
tpcds_q82/duckdb:vortex-file-compressed 🚀	23185364	26476154	0.88
tpcds_q83/duckdb:vortex-file-compressed	29231056	29794021	0.98
tpcds_q84/duckdb:vortex-file-compressed	18211232	19769489	0.92
tpcds_q85/duckdb:vortex-file-compressed	47618550	50403111	0.94
tpcds_q86/duckdb:vortex-file-compressed 🚀	17376054	19851208	0.88
tpcds_q87/duckdb:vortex-file-compressed	40524184	42801003	0.95
tpcds_q88/duckdb:vortex-file-compressed	43040183	44513347	0.97
tpcds_q89/duckdb:vortex-file-compressed 🚀	18006117	20871074	0.86
tpcds_q90/duckdb:vortex-file-compressed	15227111	16480490	0.92
tpcds_q91/duckdb:vortex-file-compressed 🚀	27421574	31293620	0.88
tpcds_q92/duckdb:vortex-file-compressed 🚀	15010735	16989190	0.88
tpcds_q93/duckdb:vortex-file-compressed	31151610	33749622	0.92
tpcds_q94/duckdb:vortex-file-compressed 🚀	22999793	25796417	0.89
tpcds_q95/duckdb:vortex-file-compressed	155092420	147771532	1.05
tpcds_q96/duckdb:vortex-file-compressed 🚀	17588383	19851712	0.89
tpcds_q97/duckdb:vortex-file-compressed	38363075	41692369	0.92
tpcds_q98/duckdb:vortex-file-compressed	19260725	19332856	1.00
tpcds_q99/duckdb:vortex-file-compressed	32094564	34369353	0.93

duckdb / vortex-compact (0.935x ➖, 15↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpcds_q01/duckdb:vortex-compact	33750171	36474994	0.93
tpcds_q02/duckdb:vortex-compact	126595390	133356443	0.95
tpcds_q03/duckdb:vortex-compact	50257677	54328112	0.93
tpcds_q04/duckdb:vortex-compact	123313043	132712991	0.93
tpcds_q05/duckdb:vortex-compact	176419708	194097144	0.91
tpcds_q06/duckdb:vortex-compact	41622829	45010614	0.92
tpcds_q07/duckdb:vortex-compact	39090639	39289910	0.99
tpcds_q08/duckdb:vortex-compact	29250690	31421231	0.93
tpcds_q09/duckdb:vortex-compact	111954457	120068369	0.93
tpcds_q10/duckdb:vortex-compact	48845176	54023080	0.90
tpcds_q11/duckdb:vortex-compact	77986495	85052328	0.92
tpcds_q12/duckdb:vortex-compact	19572842	20816791	0.94
tpcds_q13/duckdb:vortex-compact	55572536	57378843	0.97
tpcds_q14/duckdb:vortex-compact	287908582	299300961	0.96
tpcds_q15/duckdb:vortex-compact	45585110	49701625	0.92
tpcds_q16/duckdb:vortex-compact 🚀	36748568	41035582	0.90
tpcds_q17/duckdb:vortex-compact 🚀	50843696	58128387	0.87
tpcds_q18/duckdb:vortex-compact 🚀	65706482	74921044	0.88
tpcds_q19/duckdb:vortex-compact	41818556	44641282	0.94
tpcds_q20/duckdb:vortex-compact	19885458	22064527	0.90
tpcds_q21/duckdb:vortex-compact	27609703	29246737	0.94
tpcds_q22/duckdb:vortex-compact	112035758	123521924	0.91
tpcds_q23/duckdb:vortex-compact	173430369	184145312	0.94
tpcds_q24/duckdb:vortex-compact	76796281	84801624	0.91
tpcds_q25/duckdb:vortex-compact	52573442	54427373	0.97
tpcds_q26/duckdb:vortex-compact	51804862	53154612	0.97
tpcds_q27/duckdb:vortex-compact	142757956	151797712	0.94
tpcds_q28/duckdb:vortex-compact	107762232	113001297	0.95
tpcds_q29/duckdb:vortex-compact	52664008	57188904	0.92
tpcds_q30/duckdb:vortex-compact	35933771	38581852	0.93
tpcds_q31/duckdb:vortex-compact	31313254	34357813	0.91
tpcds_q32/duckdb:vortex-compact	22738005	23823846	0.95
tpcds_q33/duckdb:vortex-compact	144889351	151663785	0.96
tpcds_q34/duckdb:vortex-compact	30841868	33245842	0.93
tpcds_q35/duckdb:vortex-compact	71946206	79336016	0.91
tpcds_q36/duckdb:vortex-compact	34633470	36806784	0.94
tpcds_q37/duckdb:vortex-compact	30884102	32990351	0.94
tpcds_q38/duckdb:vortex-compact	41662039	44007001	0.95
tpcds_q39/duckdb:vortex-compact	52896722	54781228	0.97
tpcds_q40/duckdb:vortex-compact 🚀	29999875	34343510	0.87
tpcds_q41/duckdb:vortex-compact 🚀	16535229	19618452	0.84
tpcds_q42/duckdb:vortex-compact 🚀	14992880	16777604	0.89
tpcds_q43/duckdb:vortex-compact	24443437	25297751	0.97
tpcds_q44/duckdb:vortex-compact	35402128	37689078	0.94
tpcds_q45/duckdb:vortex-compact	31502884	34721358	0.91
tpcds_q46/duckdb:vortex-compact	61255103	66911699	0.92
tpcds_q47/duckdb:vortex-compact	55940849	58673767	0.95
tpcds_q48/duckdb:vortex-compact	46817102	49118355	0.95
tpcds_q49/duckdb:vortex-compact	49489682	50920067	0.97
tpcds_q50/duckdb:vortex-compact	54354786	58946376	0.92
tpcds_q51/duckdb:vortex-compact	102983933	109412563	0.94
tpcds_q52/duckdb:vortex-compact	16084531	16612162	0.97
tpcds_q53/duckdb:vortex-compact	22863191	24545641	0.93
tpcds_q54/duckdb:vortex-compact	88243994	94317164	0.94
tpcds_q55/duckdb:vortex-compact	15665155	15866529	0.99
tpcds_q56/duckdb:vortex-compact	146983390	153903086	0.96
tpcds_q57/duckdb:vortex-compact	48113481	51712056	0.93
tpcds_q58/duckdb:vortex-compact	41185564	42437692	0.97
tpcds_q59/duckdb:vortex-compact	67589933	69413468	0.97
tpcds_q60/duckdb:vortex-compact	145970496	154284514	0.95
tpcds_q61/duckdb:vortex-compact	54692149	57080610	0.96
tpcds_q62/duckdb:vortex-compact	23839152	23709488	1.01
tpcds_q63/duckdb:vortex-compact	23044505	23502587	0.98
tpcds_q64/duckdb:vortex-compact	113802561	116175170	0.98
tpcds_q65/duckdb:vortex-compact	28120979	29822400	0.94
tpcds_q66/duckdb:vortex-compact	105266534	102477924	1.03
tpcds_q67/duckdb:vortex-compact 🚀	148714112	167062790	0.89
tpcds_q68/duckdb:vortex-compact	56657421	60313057	0.94
tpcds_q69/duckdb:vortex-compact	48904713	52764109	0.93
tpcds_q70/duckdb:vortex-compact	29530095	31187758	0.95
tpcds_q71/duckdb:vortex-compact	27850640	28905562	0.96
tpcds_q72/duckdb:vortex-compact	197710309	203047922	0.97
tpcds_q73/duckdb:vortex-compact	28691192	29656118	0.97
tpcds_q74/duckdb:vortex-compact 🚀	58242519	66215823	0.88
tpcds_q75/duckdb:vortex-compact	73337870	74791072	0.98
tpcds_q76/duckdb:vortex-compact	131550897	141508197	0.93
tpcds_q77/duckdb:vortex-compact	140829161	144735627	0.97
tpcds_q78/duckdb:vortex-compact	88105198	90053782	0.98
tpcds_q79/duckdb:vortex-compact	60612908	66945443	0.91
tpcds_q80/duckdb:vortex-compact	171421366	187439030	0.91
tpcds_q81/duckdb:vortex-compact 🚀	39660676	46763932	0.85
tpcds_q82/duckdb:vortex-compact	32668692	34965368	0.93
tpcds_q83/duckdb:vortex-compact 🚀	45245253	51061295	0.89
tpcds_q84/duckdb:vortex-compact	20988779	23168996	0.91
tpcds_q85/duckdb:vortex-compact	61431566	67950963	0.90
tpcds_q86/duckdb:vortex-compact	21681746	21288376	1.02
tpcds_q87/duckdb:vortex-compact	46111309	47635072	0.97
tpcds_q88/duckdb:vortex-compact 🚀	45072027	50382460	0.89
tpcds_q89/duckdb:vortex-compact	23239035	25782573	0.90
tpcds_q90/duckdb:vortex-compact	15985604	17096777	0.94
tpcds_q91/duckdb:vortex-compact 🚀	44674063	49678287	0.90
tpcds_q92/duckdb:vortex-compact	22137828	23495676	0.94
tpcds_q93/duckdb:vortex-compact	39349239	42243710	0.93
tpcds_q94/duckdb:vortex-compact 🚀	28208570	33518454	0.84
tpcds_q95/duckdb:vortex-compact	166877383	154780662	1.08
tpcds_q96/duckdb:vortex-compact 🚀	18579434	20957342	0.89
tpcds_q97/duckdb:vortex-compact	42040852	45096083	0.93
tpcds_q98/duckdb:vortex-compact	24867039	24396098	1.02
tpcds_q99/duckdb:vortex-compact 🚀	35373244	40815884	0.87

duckdb / parquet (0.912x ➖, 40↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpcds_q01/duckdb:parquet	44491694	48318528	0.92
tpcds_q02/duckdb:parquet	62462325	66256111	0.94
tpcds_q03/duckdb:parquet 🚀	11913493	13704915	0.87
tpcds_q04/duckdb:parquet 🚀	125427181	140929008	0.89
tpcds_q05/duckdb:parquet	72565536	78541360	0.92
tpcds_q06/duckdb:parquet 🚀	29199097	35756230	0.82
tpcds_q07/duckdb:parquet	23445376	25398830	0.92
tpcds_q08/duckdb:parquet	28901265	31442124	0.92
tpcds_q09/duckdb:parquet	39997660	42249195	0.95
tpcds_q10/duckdb:parquet 🚀	35053006	40295870	0.87
tpcds_q11/duckdb:parquet 🚀	87341643	98615015	0.89
tpcds_q12/duckdb:parquet	14955181	16245608	0.92
tpcds_q13/duckdb:parquet	35009756	37855089	0.92
tpcds_q14/duckdb:parquet 🚀	155479662	178024442	0.87
tpcds_q15/duckdb:parquet 🚀	30046931	35866560	0.84
tpcds_q16/duckdb:parquet 🚀	21955490	25386515	0.86
tpcds_q17/duckdb:parquet	39188916	43034489	0.91
tpcds_q18/duckdb:parquet 🚀	45514516	52320650	0.87
tpcds_q19/duckdb:parquet	30063006	33141678	0.91
tpcds_q20/duckdb:parquet 🚀	16084909	18516269	0.87
tpcds_q21/duckdb:parquet 🚀	11643620	13297007	0.88
tpcds_q22/duckdb:parquet 🚀	73194445	81383495	0.90
tpcds_q23/duckdb:parquet 🚀	115226727	129974769	0.89
tpcds_q24/duckdb:parquet 🚀	46879043	52102318	0.90
tpcds_q25/duckdb:parquet 🚀	32223302	36577972	0.88
tpcds_q26/duckdb:parquet 🚀	37506500	41883094	0.90
tpcds_q27/duckdb:parquet	88630821	97344761	0.91
tpcds_q28/duckdb:parquet	36874717	40208561	0.92
tpcds_q29/duckdb:parquet 🚀	35444739	41380827	0.86
tpcds_q30/duckdb:parquet	43143436	44735391	0.96
tpcds_q31/duckdb:parquet	24249757	25359813	0.96
tpcds_q32/duckdb:parquet 🚀	10784121	12953732	0.83
tpcds_q33/duckdb:parquet	71158191	73667651	0.97
tpcds_q34/duckdb:parquet	21373898	23333309	0.92
tpcds_q35/duckdb:parquet 🚀	61229221	69274015	0.88
tpcds_q36/duckdb:parquet 🚀	20109538	23788781	0.85
tpcds_q37/duckdb:parquet 🚀	13733319	15442931	0.89
tpcds_q38/duckdb:parquet 🚀	33735526	39193591	0.86
tpcds_q39/duckdb:parquet	33432037	36317483	0.92
tpcds_q40/duckdb:parquet 🚀	17795761	21104935	0.84
tpcds_q41/duckdb:parquet 🚀	7927551	9234149	0.86
tpcds_q42/duckdb:parquet 🚀	10242657	11636415	0.88
tpcds_q43/duckdb:parquet	16149134	17438859	0.93
tpcds_q44/duckdb:parquet 🚀	21477018	25262484	0.85
tpcds_q45/duckdb:parquet 🚀	26695211	32544645	0.82
tpcds_q46/duckdb:parquet 🚀	45498060	52299723	0.87
tpcds_q47/duckdb:parquet	46296977	51106185	0.91
tpcds_q48/duckdb:parquet	30474494	32864537	0.93
tpcds_q49/duckdb:parquet 🚀	25209376	28704766	0.88
tpcds_q50/duckdb:parquet 🚀	24417809	27305851	0.89
tpcds_q51/duckdb:parquet	94993969	103151892	0.92
tpcds_q52/duckdb:parquet 🚀	11076183	12674453	0.87
tpcds_q53/duckdb:parquet	16411148	17741085	0.93
tpcds_q54/duckdb:parquet	41661795	43429859	0.96
tpcds_q55/duckdb:parquet	10581440	11702930	0.90
tpcds_q56/duckdb:parquet	69353215	73127380	0.95
tpcds_q57/duckdb:parquet	35449131	38716941	0.92
tpcds_q58/duckdb:parquet	21960054	23731974	0.93
tpcds_q59/duckdb:parquet	37064004	38074507	0.97
tpcds_q60/duckdb:parquet 🚀	71875156	80204427	0.90
tpcds_q61/duckdb:parquet	31398071	33846205	0.93
tpcds_q62/duckdb:parquet 🚀	11460136	12903121	0.89
tpcds_q63/duckdb:parquet 🚀	15156696	16872738	0.90
tpcds_q64/duckdb:parquet	74943701	81120003	0.92
tpcds_q65/duckdb:parquet	21552161	21289731	1.01
tpcds_q66/duckdb:parquet	55585998	58788722	0.95
tpcds_q67/duckdb:parquet 🚀	136574204	153402994	0.89
tpcds_q68/duckdb:parquet	37607737	40498378	0.93
tpcds_q69/duckdb:parquet	38569292	39634103	0.97
tpcds_q70/duckdb:parquet	19920523	21767684	0.92
tpcds_q71/duckdb:parquet 🚀	18123760	20196883	0.90
tpcds_q72/duckdb:parquet	166452087	173390032	0.96
tpcds_q73/duckdb:parquet	19679915	19123990	1.03
tpcds_q74/duckdb:parquet	50264164	53944142	0.93
tpcds_q75/duckdb:parquet	54905199	58723627	0.93
tpcds_q76/duckdb:parquet	70287077	69784478	1.01
tpcds_q77/duckdb:parquet	61419254	66446740	0.92
tpcds_q78/duckdb:parquet	75457361	81222391	0.93
tpcds_q79/duckdb:parquet	27543344	30147414	0.91
tpcds_q80/duckdb:parquet	82669073	89668819	0.92
tpcds_q81/duckdb:parquet	47073789	49782340	0.95
tpcds_q82/duckdb:parquet 🚀	14824391	17884387	0.83
tpcds_q83/duckdb:parquet	16611389	16568861	1.00
tpcds_q84/duckdb:parquet	19212135	20276375	0.95
tpcds_q85/duckdb:parquet	39818807	42269621	0.94
tpcds_q86/duckdb:parquet	12513779	13724849	0.91
tpcds_q87/duckdb:parquet 🚀	37628367	42060267	0.89
tpcds_q88/duckdb:parquet	29361677	30236314	0.97
tpcds_q89/duckdb:parquet	17833913	18603270	0.96
tpcds_q90/duckdb:parquet	7420708	8228807	0.90
tpcds_q91/duckdb:parquet	23871004	24023626	0.99
tpcds_q92/duckdb:parquet 🚀	11445184	13544983	0.84
tpcds_q93/duckdb:parquet 🚀	30483618	34481453	0.88
tpcds_q94/duckdb:parquet	17145980	17452843	0.98
tpcds_q95/duckdb:parquet	132945435	137971005	0.96
tpcds_q96/duckdb:parquet	9509751	10486666	0.91
tpcds_q97/duckdb:parquet	35216177	38862600	0.91
tpcds_q98/duckdb:parquet	19542151	19044174	1.03
tpcds_q99/duckdb:parquet	20155710	20666753	0.98

duckdb / duckdb (0.934x ➖, 24↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpcds_q01/duckdb:duckdb	20761433	22325454	0.93
tpcds_q02/duckdb:duckdb	19552061	19340822	1.01
tpcds_q03/duckdb:duckdb	8563122	9102881	0.94
tpcds_q04/duckdb:duckdb	163743999	172157099	0.95
tpcds_q05/duckdb:duckdb	19374812	19687969	0.98
tpcds_q06/duckdb:duckdb	22951032	24220583	0.95
tpcds_q07/duckdb:duckdb	39067056	41433107	0.94
tpcds_q08/duckdb:duckdb	120348723	122882273	0.98
tpcds_q09/duckdb:duckdb	19868213	20740558	0.96
tpcds_q10/duckdb:duckdb	24351758	24853695	0.98
tpcds_q11/duckdb:duckdb	142087560	146681964	0.97
tpcds_q12/duckdb:duckdb	11508264	11362457	1.01
tpcds_q13/duckdb:duckdb	24252240	24984516	0.97
tpcds_q14/duckdb:duckdb	92653082	99164807	0.93
tpcds_q15/duckdb:duckdb	24541497	27228855	0.90
tpcds_q16/duckdb:duckdb	16685019	18391387	0.91
tpcds_q17/duckdb:duckdb	22018794	23221755	0.95
tpcds_q18/duckdb:duckdb 🚀	43125819	48025595	0.90
tpcds_q19/duckdb:duckdb 🚀	16153006	18482950	0.87
tpcds_q20/duckdb:duckdb	11958418	12808020	0.93
tpcds_q21/duckdb:duckdb 🚀	6699472	8181104	0.82
tpcds_q22/duckdb:duckdb 🚀	61533108	75130195	0.82
tpcds_q23/duckdb:duckdb	80390657	85969550	0.94
tpcds_q24/duckdb:duckdb 🚀	23864157	28151263	0.85
tpcds_q25/duckdb:duckdb 🚀	16381641	18643969	0.88
tpcds_q26/duckdb:duckdb 🚀	24393039	29072411	0.84
tpcds_q27/duckdb:duckdb	40547111	43018232	0.94
tpcds_q28/duckdb:duckdb	21041019	22564190	0.93
tpcds_q29/duckdb:duckdb	19949830	21373082	0.93
tpcds_q30/duckdb:duckdb 🚀	29126009	33001333	0.88
tpcds_q31/duckdb:duckdb	21540486	21940427	0.98
tpcds_q32/duckdb:duckdb	7735400	7917786	0.98
tpcds_q33/duckdb:duckdb	12602843	13261002	0.95
tpcds_q34/duckdb:duckdb 🚀	14639892	17397468	0.84
tpcds_q35/duckdb:duckdb 🚀	30977109	35035857	0.88
tpcds_q36/duckdb:duckdb	70834879	77310220	0.92
tpcds_q37/duckdb:duckdb	7330561	8108774	0.90
tpcds_q38/duckdb:duckdb	30940484	32190640	0.96
tpcds_q39/duckdb:duckdb	25328445	27703706	0.91
tpcds_q40/duckdb:duckdb	13646926	14274113	0.96
tpcds_q41/duckdb:duckdb 🚀	8056554	9179520	0.88
tpcds_q42/duckdb:duckdb 🚀	6048560	7470263	0.81
tpcds_q43/duckdb:duckdb	11504595	12258575	0.94
tpcds_q44/duckdb:duckdb	13251009	14353475	0.92
tpcds_q45/duckdb:duckdb 🚀	17496243	19699489	0.89
tpcds_q46/duckdb:duckdb 🚀	37162953	42851311	0.87
tpcds_q47/duckdb:duckdb	41331870	44286051	0.93
tpcds_q48/duckdb:duckdb	21534454	23071605	0.93
tpcds_q49/duckdb:duckdb	16029045	16296007	0.98
tpcds_q50/duckdb:duckdb	13658195	15010283	0.91
tpcds_q51/duckdb:duckdb	92430454	96272240	0.96
tpcds_q52/duckdb:duckdb	7375650	7829817	0.94
tpcds_q53/duckdb:duckdb 🚀	11482347	12831184	0.89
tpcds_q54/duckdb:duckdb	17309519	16687590	1.04
tpcds_q55/duckdb:duckdb	7021783	7221130	0.97
tpcds_q56/duckdb:duckdb	13155743	14250041	0.92
tpcds_q57/duckdb:duckdb	31282082	33228612	0.94
tpcds_q58/duckdb:duckdb	13013071	12898649	1.01
tpcds_q59/duckdb:duckdb	34157762	35754878	0.96
tpcds_q60/duckdb:duckdb	14858049	16157400	0.92
tpcds_q61/duckdb:duckdb	14733021	14923821	0.99
tpcds_q62/duckdb:duckdb	9226236	9682149	0.95
tpcds_q63/duckdb:duckdb	11292150	12138515	0.93
tpcds_q64/duckdb:duckdb	53955125	55015419	0.98
tpcds_q65/duckdb:duckdb 🚀	31419440	37472890	0.84
tpcds_q66/duckdb:duckdb	25375712	25072342	1.01
tpcds_q67/duckdb:duckdb 🚀	129766990	145385527	0.89
tpcds_q68/duckdb:duckdb 🚀	25306078	28839543	0.88
tpcds_q69/duckdb:duckdb	24486478	25979369	0.94
tpcds_q70/duckdb:duckdb	15086694	15224325	0.99
tpcds_q71/duckdb:duckdb	13182340	13595688	0.97
tpcds_q72/duckdb:duckdb	41534302	43653573	0.95
tpcds_q73/duckdb:duckdb	10873076	11548838	0.94
tpcds_q74/duckdb:duckdb	98669788	104035046	0.95
tpcds_q75/duckdb:duckdb	43662818	44888278	0.97
tpcds_q76/duckdb:duckdb	12030864	13307623	0.90
tpcds_q77/duckdb:duckdb	11902971	12767709	0.93
tpcds_q78/duckdb:duckdb	66831298	66092150	1.01
tpcds_q79/duckdb:duckdb 🚀	17775784	21581027	0.82
tpcds_q80/duckdb:duckdb 🚀	26896896	30938184	0.87
tpcds_q81/duckdb:duckdb	39862824	42606216	0.94
tpcds_q82/duckdb:duckdb	8170098	8363356	0.98
tpcds_q83/duckdb:duckdb	9947062	9619644	1.03
tpcds_q84/duckdb:duckdb	14217874	15480921	0.92
tpcds_q85/duckdb:duckdb	24121861	26295152	0.92
tpcds_q86/duckdb:duckdb 🚀	11072093	12340223	0.90
tpcds_q87/duckdb:duckdb 🚀	33380618	37545279	0.89
tpcds_q88/duckdb:duckdb	24177513	25191858	0.96
tpcds_q89/duckdb:duckdb	13098776	13852379	0.95
tpcds_q90/duckdb:duckdb	5594212	5994505	0.93
tpcds_q91/duckdb:duckdb	13584663	13050739	1.04
tpcds_q92/duckdb:duckdb	9077521	9237406	0.98
tpcds_q93/duckdb:duckdb	22608312	23075495	0.98
tpcds_q94/duckdb:duckdb	12580473	12850297	0.98
tpcds_q95/duckdb:duckdb 🚀	106814192	118782231	0.90
tpcds_q96/duckdb:duckdb 🚀	4501289	5192147	0.87
tpcds_q97/duckdb:duckdb	30763861	31485125	0.98
tpcds_q98/duckdb:duckdb	13919613	13648270	1.02
tpcds_q99/duckdb:duckdb	16905390	16129848	1.05

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	-4.0%	-2.8%	-1.3%	+11.8%	➖ noise
1	datafusion:vortex-file-compressed	+3.4%	-2.8%	+6.4%	+22.5%	➖ noise
1	duckdb:duckdb	-7.0%	-2.8%	-4.3%	+13.3%	➖ noise
1	duckdb:vortex-compact	-7.5%	-2.8%	-4.8%	+15.8%	➖ noise
1	duckdb:vortex-file-compressed	-1.1%	-2.8%	+1.7%	+12.3%	➖ noise
2	datafusion:vortex-compact	+1.2%	-1.2%	+2.4%	+10.0%	➖ noise
2	datafusion:vortex-file-compressed	-0.1%	-1.2%	+1.1%	+11.2%	➖ noise
2	duckdb:duckdb	+1.1%	-1.2%	+2.3%	+12.0%	➖ noise
2	duckdb:vortex-compact	-5.1%	-1.2%	-3.9%	+10.0%	➖ noise
2	duckdb:vortex-file-compressed	-3.9%	-1.2%	-2.7%	+10.0%	➖ noise
3	datafusion:vortex-compact	+5.2%	-10.4%	+17.5%	+10.6%	🚨 regression
3	datafusion:vortex-file-compressed	+0.7%	-10.4%	+12.4%	+10.7%	🚨 regression
3	duckdb:duckdb	-5.9%	-10.4%	+5.0%	+15.3%	➖ noise
3	duckdb:vortex-compact	-7.5%	-10.4%	+3.3%	+11.7%	➖ noise
3	duckdb:vortex-file-compressed	-6.5%	-10.4%	+4.4%	+11.1%	➖ noise
4	datafusion:vortex-compact	-1.7%	-5.0%	+3.5%	+10.0%	➖ noise
4	datafusion:vortex-file-compressed	-0.8%	-5.0%	+4.4%	+10.0%	➖ noise
4	duckdb:duckdb	-4.9%	-5.0%	+0.1%	+10.0%	➖ noise
4	duckdb:vortex-compact	-7.1%	-5.0%	-2.2%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-11.6%	-5.0%	-6.9%	+10.0%	➖ noise
5	datafusion:vortex-compact	-0.8%	-5.0%	+4.4%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	-0.4%	-5.0%	+4.9%	+10.0%	➖ noise
5	duckdb:duckdb	-1.6%	-5.0%	+3.6%	+12.0%	➖ noise
5	duckdb:vortex-compact	-9.1%	-5.0%	-4.3%	+13.0%	➖ noise
5	duckdb:vortex-file-compressed	-13.2%	-5.0%	-8.6%	+12.7%	➖ noise
6	datafusion:vortex-compact	+5.4%	-8.5%	+15.1%	+10.0%	🚨 regression
6	datafusion:vortex-file-compressed	+3.0%	-8.5%	+12.5%	+10.0%	🚨 regression
6	duckdb:duckdb	-5.2%	-8.5%	+3.5%	+14.6%	➖ noise
6	duckdb:vortex-compact	-7.5%	-8.5%	+1.1%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	-10.7%	-8.5%	-2.4%	+10.0%	➖ noise
7	datafusion:vortex-compact	+2.9%	-2.1%	+5.2%	+10.0%	➖ noise
7	datafusion:vortex-file-compressed	+0.5%	-2.1%	+2.6%	+10.0%	➖ noise
7	duckdb:duckdb	-5.7%	-2.1%	-3.7%	+11.8%	➖ noise
7	duckdb:vortex-compact	-0.5%	-2.1%	+1.7%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	-13.5%	-2.1%	-11.6%	+11.4%	✅ faster
8	datafusion:vortex-compact	+2.0%	-1.8%	+3.9%	+10.0%	➖ noise
8	datafusion:vortex-file-compressed	+5.9%	-1.8%	+7.8%	+10.0%	➖ noise
8	duckdb:duckdb	-2.1%	-1.8%	-0.3%	+10.0%	➖ noise
8	duckdb:vortex-compact	-6.9%	-1.8%	-5.2%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-11.8%	-1.8%	-10.2%	+10.0%	✅ faster
9	datafusion:vortex-compact	+0.3%	-0.9%	+1.2%	+10.0%	➖ noise
9	datafusion:vortex-file-compressed	+3.1%	-0.9%	+4.0%	+10.0%	➖ noise
9	duckdb:duckdb	-4.2%	-0.9%	-3.3%	+10.0%	➖ noise
9	duckdb:vortex-compact	-6.8%	-0.9%	-5.9%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	-8.8%	-0.9%	-8.0%	+10.0%	➖ noise
10	datafusion:vortex-compact	-1.0%	-8.1%	+7.8%	+10.0%	➖ noise
10	datafusion:vortex-file-compressed	+7.8%	-8.1%	+17.3%	+10.0%	🚨 regression
10	duckdb:duckdb	-2.0%	-8.1%	+6.7%	+10.0%	➖ noise
10	duckdb:vortex-compact	-9.6%	-8.1%	-1.6%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-10.4%	-8.1%	-2.5%	+10.0%	➖ noise
11	datafusion:vortex-compact	+1.4%	-6.8%	+8.8%	+10.0%	➖ noise
11	datafusion:vortex-file-compressed	+1.8%	-6.8%	+9.2%	+10.0%	➖ noise
11	duckdb:duckdb	-3.1%	-6.8%	+3.9%	+10.0%	➖ noise
11	duckdb:vortex-compact	-8.3%	-6.8%	-1.6%	+10.0%	➖ noise
11	duckdb:vortex-file-compressed	-3.7%	-6.8%	+3.3%	+10.0%	➖ noise
12	datafusion:vortex-compact	-4.7%	-7.1%	+2.6%	+11.7%	➖ noise
12	datafusion:vortex-file-compressed	-1.8%	-7.1%	+5.7%	+10.0%	➖ noise
12	duckdb:duckdb	+1.3%	-7.1%	+9.1%	+10.8%	➖ noise
12	duckdb:vortex-compact	-6.0%	-7.1%	+1.2%	+15.0%	➖ noise
12	duckdb:vortex-file-compressed	-14.6%	-7.1%	-8.1%	+13.4%	➖ noise
13	datafusion:vortex-compact	-6.7%	-4.0%	-2.8%	+10.0%	➖ noise
13	datafusion:vortex-file-compressed	+1.0%	-4.0%	+5.2%	+10.0%	➖ noise
13	duckdb:duckdb	-2.9%	-4.0%	+1.1%	+10.0%	➖ noise
13	duckdb:vortex-compact	-3.1%	-4.0%	+0.9%	+15.9%	➖ noise
13	duckdb:vortex-file-compressed	-8.2%	-4.0%	-4.3%	+13.5%	➖ noise
14	datafusion:vortex-compact	-13.7%	-6.8%	-7.4%	+10.0%	➖ noise
14	datafusion:vortex-file-compressed	+0.7%	-6.8%	+8.1%	+10.0%	➖ noise
14	duckdb:duckdb	-6.6%	-6.8%	+0.2%	+10.0%	➖ noise
14	duckdb:vortex-compact	-3.8%	-6.8%	+3.2%	+14.3%	➖ noise
14	duckdb:vortex-file-compressed	+1.6%	-6.8%	+9.0%	+13.4%	➖ noise
15	datafusion:vortex-compact	-12.7%	-8.9%	-4.2%	+10.0%	➖ noise
15	datafusion:vortex-file-compressed	+1.6%	-8.9%	+11.5%	+10.3%	🚨 regression
15	duckdb:duckdb	-9.9%	-8.9%	-1.1%	+15.6%	➖ noise
15	duckdb:vortex-compact	-8.3%	-8.9%	+0.6%	+10.7%	➖ noise
15	duckdb:vortex-file-compressed	-8.9%	-8.9%	-0.0%	+10.0%	➖ noise
16	datafusion:vortex-compact	-5.5%	-5.1%	-0.4%	+10.0%	➖ noise
16	datafusion:vortex-file-compressed	+4.0%	-5.1%	+9.5%	+10.0%	➖ noise
16	duckdb:duckdb	-9.3%	-5.1%	-4.4%	+16.3%	➖ noise
16	duckdb:vortex-compact	-10.4%	-5.1%	-5.6%	+12.7%	➖ noise
16	duckdb:vortex-file-compressed	-9.4%	-5.1%	-4.5%	+11.3%	➖ noise
17	datafusion:vortex-compact	-12.3%	-4.3%	-8.5%	+10.0%	➖ noise
17	datafusion:vortex-file-compressed	-3.1%	-4.3%	+1.2%	+10.0%	➖ noise
17	duckdb:duckdb	-5.2%	-4.3%	-1.0%	+11.4%	➖ noise
17	duckdb:vortex-compact	-12.5%	-4.3%	-8.6%	+10.0%	➖ noise
17	duckdb:vortex-file-compressed	-9.4%	-4.3%	-5.3%	+10.0%	➖ noise
18	datafusion:vortex-compact	-14.3%	-7.1%	-7.7%	+10.0%	➖ noise
18	datafusion:vortex-file-compressed	-1.1%	-7.1%	+6.5%	+10.0%	➖ noise
18	duckdb:duckdb	-10.2%	-7.1%	-3.3%	+10.5%	➖ noise
18	duckdb:vortex-compact	-12.3%	-7.1%	-5.6%	+10.0%	➖ noise
18	duckdb:vortex-file-compressed	-2.3%	-7.1%	+5.3%	+12.1%	➖ noise
19	datafusion:vortex-compact	-11.1%	-3.6%	-7.8%	+10.0%	➖ noise
19	datafusion:vortex-file-compressed	-0.6%	-3.6%	+3.1%	+10.0%	➖ noise
19	duckdb:duckdb	-12.6%	-3.6%	-9.4%	+22.4%	➖ noise
19	duckdb:vortex-compact	-6.3%	-3.6%	-2.9%	+10.0%	➖ noise
19	duckdb:vortex-file-compressed	-11.4%	-3.6%	-8.1%	+10.0%	➖ noise
20	datafusion:vortex-compact	-7.7%	-6.7%	-1.1%	+10.0%	➖ noise
20	datafusion:vortex-file-compressed	+2.0%	-6.7%	+9.3%	+10.0%	➖ noise
20	duckdb:duckdb	-6.6%	-6.7%	+0.0%	+11.6%	➖ noise
20	duckdb:vortex-compact	-9.9%	-6.7%	-3.4%	+17.8%	➖ noise
20	duckdb:vortex-file-compressed	-10.8%	-6.7%	-4.4%	+10.0%	➖ noise
21	datafusion:vortex-compact	-14.6%	-2.9%	-12.0%	+11.6%	✅ faster
21	datafusion:vortex-file-compressed	-3.3%	-2.9%	-0.3%	+10.0%	➖ noise
21	duckdb:duckdb	-18.1%	-2.9%	-15.7%	+19.3%	➖ noise
21	duckdb:vortex-compact	-5.6%	-2.9%	-2.8%	+10.6%	➖ noise
21	duckdb:vortex-file-compressed	-0.2%	-2.9%	+2.8%	+14.3%	➖ noise
22	datafusion:vortex-compact	-14.5%	-2.8%	-12.0%	+10.0%	✅ faster
22	datafusion:vortex-file-compressed	-3.0%	-2.8%	-0.2%	+10.0%	➖ noise
22	duckdb:duckdb	-18.1%	-2.8%	-15.7%	+10.5%	✅ faster
22	duckdb:vortex-compact	-9.3%	-2.8%	-6.7%	+10.0%	➖ noise
22	duckdb:vortex-file-compressed	-12.2%	-2.8%	-9.7%	+10.0%	✅ faster
23	datafusion:vortex-compact	-14.2%	-3.9%	-10.7%	+10.0%	✅ faster
23	datafusion:vortex-file-compressed	+1.2%	-3.9%	+5.3%	+11.1%	➖ noise
23	duckdb:duckdb	-6.5%	-3.9%	-2.7%	+10.0%	➖ noise
23	duckdb:vortex-compact	-5.8%	-3.9%	-2.0%	+10.0%	➖ noise
23	duckdb:vortex-file-compressed	-14.1%	-3.9%	-10.6%	+10.5%	✅ faster
24	datafusion:vortex-compact	-15.9%	-4.5%	-12.0%	+10.0%	✅ faster
24	datafusion:vortex-file-compressed	-2.3%	-4.5%	+2.2%	+10.0%	➖ noise
24	duckdb:duckdb	-15.2%	-4.5%	-11.3%	+11.3%	✅ faster
24	duckdb:vortex-compact	-9.4%	-4.5%	-5.2%	+10.9%	➖ noise
24	duckdb:vortex-file-compressed	-6.3%	-4.5%	-1.9%	+10.0%	➖ noise
25	datafusion:vortex-compact	-14.6%	-4.9%	-10.2%	+10.0%	✅ faster
25	datafusion:vortex-file-compressed	+2.3%	-4.9%	+7.6%	+10.0%	➖ noise
25	duckdb:duckdb	-12.1%	-4.9%	-7.6%	+13.2%	➖ noise
25	duckdb:vortex-compact	-3.4%	-4.9%	+1.5%	+10.1%	➖ noise
25	duckdb:vortex-file-compressed	-4.5%	-4.9%	+0.4%	+10.0%	➖ noise
26	datafusion:vortex-compact	-15.7%	-4.3%	-11.9%	+10.0%	✅ faster
26	datafusion:vortex-file-compressed	-2.0%	-4.3%	+2.4%	+10.0%	➖ noise
26	duckdb:duckdb	-16.1%	-4.3%	-12.3%	+18.0%	➖ noise
26	duckdb:vortex-compact	-2.5%	-4.3%	+1.8%	+15.8%	➖ noise
26	duckdb:vortex-file-compressed	-9.8%	-4.3%	-5.8%	+10.6%	➖ noise
27	datafusion:vortex-compact	-16.0%	-3.5%	-13.0%	+10.0%	✅ faster
27	datafusion:vortex-file-compressed	+2.4%	-3.5%	+6.2%	+10.0%	➖ noise
27	duckdb:duckdb	-5.7%	-3.5%	-2.3%	+17.0%	➖ noise
27	duckdb:vortex-compact	-6.0%	-3.5%	-2.5%	+10.0%	➖ noise
27	duckdb:vortex-file-compressed	-5.7%	-3.5%	-2.3%	+10.0%	➖ noise
28	datafusion:vortex-compact	-12.2%	-0.8%	-11.5%	+10.0%	✅ faster
28	datafusion:vortex-file-compressed	+0.0%	-0.8%	+0.9%	+10.0%	➖ noise
28	duckdb:duckdb	-6.8%	-0.8%	-6.0%	+10.0%	➖ noise
28	duckdb:vortex-compact	-4.6%	-0.8%	-3.8%	+10.0%	➖ noise
28	duckdb:vortex-file-compressed	-1.9%	-0.8%	-1.0%	+10.0%	➖ noise
29	datafusion:vortex-compact	-13.3%	-6.9%	-6.9%	+10.0%	➖ noise
29	datafusion:vortex-file-compressed	+3.9%	-6.9%	+11.7%	+10.0%	🚨 regression
29	duckdb:duckdb	-6.7%	-6.9%	+0.3%	+10.0%	➖ noise
29	duckdb:vortex-compact	-7.9%	-6.9%	-1.1%	+10.0%	➖ noise
29	duckdb:vortex-file-compressed	-4.1%	-6.9%	+3.1%	+12.7%	➖ noise
30	datafusion:vortex-compact	-16.0%	+2.0%	-17.7%	+10.0%	✅ faster
30	datafusion:vortex-file-compressed	-4.0%	+2.0%	-5.8%	+11.3%	➖ noise
30	duckdb:duckdb	-11.7%	+2.0%	-13.4%	+10.0%	✅ faster
30	duckdb:vortex-compact	-6.9%	+2.0%	-8.7%	+12.7%	➖ noise
30	duckdb:vortex-file-compressed	-14.5%	+2.0%	-16.2%	+10.0%	✅ faster
31	datafusion:vortex-compact	-10.6%	+1.1%	-11.6%	+10.0%	✅ faster
31	datafusion:vortex-file-compressed	+1.5%	+1.1%	+0.4%	+10.0%	➖ noise
31	duckdb:duckdb	-1.8%	+1.1%	-2.9%	+13.1%	➖ noise
31	duckdb:vortex-compact	-8.9%	+1.1%	-9.8%	+10.0%	✅ faster
31	duckdb:vortex-file-compressed	-3.7%	+1.1%	-4.7%	+11.4%	➖ noise
32	datafusion:vortex-compact	-17.6%	-4.6%	-13.6%	+10.5%	✅ faster
32	datafusion:vortex-file-compressed	+3.4%	-4.6%	+8.3%	+10.0%	➖ noise
32	duckdb:duckdb	-2.3%	-4.6%	+2.4%	+13.9%	➖ noise
32	duckdb:vortex-compact	-4.6%	-4.6%	+0.0%	+10.0%	➖ noise
32	duckdb:vortex-file-compressed	-10.5%	-4.6%	-6.2%	+10.0%	➖ noise
33	datafusion:vortex-compact	-15.0%	+2.9%	-17.4%	+10.0%	✅ faster
33	datafusion:vortex-file-compressed	+4.2%	+2.9%	+1.3%	+10.0%	➖ noise
33	duckdb:duckdb	-5.0%	+2.9%	-7.7%	+14.3%	➖ noise
33	duckdb:vortex-compact	-4.5%	+2.9%	-7.2%	+10.0%	➖ noise
33	duckdb:vortex-file-compressed	-10.2%	+2.9%	-12.7%	+15.5%	➖ noise
34	datafusion:vortex-compact	-12.0%	-3.3%	-9.0%	+10.0%	➖ noise
34	datafusion:vortex-file-compressed	+0.1%	-3.3%	+3.5%	+10.0%	➖ noise
34	duckdb:duckdb	-15.9%	-3.3%	-13.0%	+11.6%	✅ faster
34	duckdb:vortex-compact	-7.2%	-3.3%	-4.1%	+10.0%	➖ noise
34	duckdb:vortex-file-compressed	-14.2%	-3.3%	-11.3%	+10.0%	✅ faster
35	datafusion:vortex-compact	-16.2%	-2.8%	-13.8%	+10.0%	✅ faster
35	datafusion:vortex-file-compressed	+5.8%	-2.8%	+8.8%	+10.0%	➖ noise
35	duckdb:duckdb	-11.6%	-2.8%	-9.1%	+10.6%	➖ noise
35	duckdb:vortex-compact	-9.3%	-2.8%	-6.7%	+10.0%	➖ noise
35	duckdb:vortex-file-compressed	-14.6%	-2.8%	-12.1%	+10.0%	✅ faster
36	datafusion:vortex-compact	-12.7%	-7.2%	-5.9%	+10.0%	➖ noise
36	datafusion:vortex-file-compressed	+1.4%	-7.2%	+9.3%	+10.0%	➖ noise
36	duckdb:duckdb	-8.4%	-7.2%	-1.3%	+10.0%	➖ noise
36	duckdb:vortex-compact	-5.9%	-7.2%	+1.4%	+10.0%	➖ noise
36	duckdb:vortex-file-compressed	-12.7%	-7.2%	-6.0%	+10.0%	➖ noise
37	datafusion:vortex-compact	-13.6%	-1.9%	-11.9%	+12.4%	✅ faster
37	datafusion:vortex-file-compressed	+1.2%	-1.9%	+3.2%	+10.0%	➖ noise
37	duckdb:duckdb	-9.6%	-1.9%	-7.8%	+12.0%	➖ noise
37	duckdb:vortex-compact	-6.4%	-1.9%	-4.5%	+10.0%	➖ noise
37	duckdb:vortex-file-compressed	-5.4%	-1.9%	-3.5%	+10.3%	➖ noise
38	datafusion:vortex-compact	-11.3%	-7.7%	-3.8%	+10.0%	➖ noise
38	datafusion:vortex-file-compressed	+0.2%	-7.7%	+8.6%	+10.0%	➖ noise
38	duckdb:duckdb	-3.9%	-7.7%	+4.2%	+10.9%	➖ noise
38	duckdb:vortex-compact	-5.3%	-7.7%	+2.6%	+12.1%	➖ noise
38	duckdb:vortex-file-compressed	-7.8%	-7.7%	-0.1%	+11.3%	➖ noise
39	datafusion:vortex-compact	-2.6%	-2.5%	-0.1%	+13.8%	➖ noise
39	datafusion:vortex-file-compressed	+8.9%	-2.5%	+11.7%	+18.0%	➖ noise
39	duckdb:duckdb	-8.6%	-2.5%	-6.2%	+26.2%	➖ noise
39	duckdb:vortex-compact	-3.4%	-2.5%	-1.0%	+13.9%	➖ noise
39	duckdb:vortex-file-compressed	+0.4%	-2.5%	+2.9%	+16.3%	➖ noise
40	datafusion:vortex-compact	-15.2%	-7.6%	-8.2%	+11.6%	➖ noise
40	datafusion:vortex-file-compressed	-2.3%	-7.6%	+5.7%	+12.3%	➖ noise
40	duckdb:duckdb	-4.4%	-7.6%	+3.5%	+12.8%	➖ noise
40	duckdb:vortex-compact	-12.6%	-7.6%	-5.5%	+14.3%	➖ noise
40	duckdb:vortex-file-compressed	-3.1%	-7.6%	+4.8%	+13.4%	➖ noise
41	datafusion:vortex-compact	-23.9%	-2.5%	-21.9%	+10.0%	✅ faster
41	datafusion:vortex-file-compressed	+4.4%	-2.5%	+7.1%	+14.3%	➖ noise
41	duckdb:duckdb	-12.2%	-2.5%	-10.0%	+10.8%	✅ faster
41	duckdb:vortex-compact	-15.7%	-2.5%	-13.5%	+10.0%	✅ faster
41	duckdb:vortex-file-compressed	-14.7%	-2.5%	-12.5%	+10.0%	✅ faster
42	datafusion:vortex-compact	-14.8%	+0.1%	-14.9%	+12.7%	✅ faster
42	datafusion:vortex-file-compressed	+1.8%	+0.1%	+1.7%	+15.2%	➖ noise
42	duckdb:duckdb	-19.0%	+0.1%	-19.1%	+14.6%	✅ faster
42	duckdb:vortex-compact	-10.6%	+0.1%	-10.7%	+18.2%	➖ noise
42	duckdb:vortex-file-compressed	-4.0%	+0.1%	-4.1%	+13.3%	➖ noise
43	datafusion:vortex-compact	-13.4%	-0.7%	-12.8%	+10.0%	✅ faster
43	datafusion:vortex-file-compressed	+0.1%	-0.7%	+0.8%	+12.9%	➖ noise
43	duckdb:duckdb	-6.2%	-0.7%	-5.5%	+13.0%	➖ noise
43	duckdb:vortex-compact	-3.4%	-0.7%	-2.7%	+11.7%	➖ noise
43	duckdb:vortex-file-compressed	-5.0%	-0.7%	-4.4%	+10.0%	➖ noise
44	datafusion:vortex-compact	-12.1%	-5.5%	-7.1%	+10.0%	➖ noise
44	datafusion:vortex-file-compressed	+1.9%	-5.5%	+7.7%	+10.3%	➖ noise
44	duckdb:duckdb	-7.7%	-5.5%	-2.4%	+18.0%	➖ noise
44	duckdb:vortex-compact	-6.1%	-5.5%	-0.7%	+11.6%	➖ noise
44	duckdb:vortex-file-compressed	-4.8%	-5.5%	+0.7%	+11.6%	➖ noise
45	datafusion:vortex-compact	-13.9%	-4.8%	-9.5%	+10.0%	✅ faster
45	datafusion:vortex-file-compressed	+0.4%	-4.8%	+5.5%	+10.0%	➖ noise
45	duckdb:duckdb	-11.2%	-4.8%	-6.7%	+15.9%	➖ noise
45	duckdb:vortex-compact	-9.3%	-4.8%	-4.7%	+10.0%	➖ noise
45	duckdb:vortex-file-compressed	-16.1%	-4.8%	-11.8%	+10.6%	✅ faster
46	datafusion:vortex-compact	-14.6%	-4.7%	-10.4%	+10.0%	✅ faster
46	datafusion:vortex-file-compressed	+5.7%	-4.7%	+10.8%	+10.0%	🚨 regression
46	duckdb:duckdb	-13.3%	-4.7%	-9.0%	+10.0%	➖ noise
46	duckdb:vortex-compact	-8.5%	-4.7%	-4.0%	+10.0%	➖ noise
46	duckdb:vortex-file-compressed	-9.9%	-4.7%	-5.5%	+10.0%	➖ noise
47	datafusion:vortex-compact	-18.9%	-1.6%	-17.6%	+10.0%	✅ faster
47	datafusion:vortex-file-compressed	+3.0%	-1.6%	+4.7%	+10.0%	➖ noise
47	duckdb:duckdb	-6.7%	-1.6%	-5.2%	+10.0%	➖ noise
47	duckdb:vortex-compact	-4.7%	-1.6%	-3.1%	+10.0%	➖ noise
47	duckdb:vortex-file-compressed	-10.1%	-1.6%	-8.7%	+10.0%	➖ noise
48	datafusion:vortex-compact	-7.4%	-1.2%	-6.2%	+10.0%	➖ noise
48	datafusion:vortex-file-compressed	+2.4%	-1.2%	+3.7%	+10.0%	➖ noise
48	duckdb:duckdb	-6.7%	-1.2%	-5.5%	+10.0%	➖ noise
48	duckdb:vortex-compact	-4.7%	-1.2%	-3.5%	+14.7%	➖ noise
48	duckdb:vortex-file-compressed	-9.3%	-1.2%	-8.1%	+10.0%	➖ noise
49	datafusion:vortex-compact	-11.4%	-5.4%	-6.3%	+10.0%	➖ noise
49	datafusion:vortex-file-compressed	+1.7%	-5.4%	+7.6%	+10.0%	➖ noise
49	duckdb:duckdb	-1.6%	-5.4%	+4.0%	+12.9%	➖ noise
49	duckdb:vortex-compact	-2.8%	-5.4%	+2.8%	+11.5%	➖ noise
49	duckdb:vortex-file-compressed	-6.3%	-5.4%	-0.9%	+13.6%	➖ noise
50	datafusion:vortex-compact	-13.7%	-6.8%	-7.4%	+10.0%	➖ noise
50	datafusion:vortex-file-compressed	+4.7%	-6.8%	+12.3%	+10.0%	🚨 regression
50	duckdb:duckdb	-9.0%	-6.8%	-2.4%	+10.0%	➖ noise
50	duckdb:vortex-compact	-7.8%	-6.8%	-1.1%	+10.0%	➖ noise
50	duckdb:vortex-file-compressed	-12.6%	-6.8%	-6.3%	+10.0%	➖ noise
51	datafusion:vortex-compact	-17.1%	-2.2%	-15.2%	+10.0%	✅ faster
51	datafusion:vortex-file-compressed	+2.9%	-2.2%	+5.2%	+10.0%	➖ noise
51	duckdb:duckdb	-4.0%	-2.2%	-1.9%	+14.1%	➖ noise
51	duckdb:vortex-compact	-5.9%	-2.2%	-3.8%	+10.0%	➖ noise
51	duckdb:vortex-file-compressed	-4.2%	-2.2%	-2.1%	+18.3%	➖ noise
52	datafusion:vortex-compact	-8.8%	-5.6%	-3.4%	+12.4%	➖ noise
52	datafusion:vortex-file-compressed	+5.8%	-5.6%	+12.1%	+15.1%	➖ noise
52	duckdb:duckdb	-5.8%	-5.6%	-0.2%	+17.5%	➖ noise
52	duckdb:vortex-compact	-3.2%	-5.6%	+2.6%	+17.3%	➖ noise
52	duckdb:vortex-file-compressed	-14.5%	-5.6%	-9.4%	+16.5%	➖ noise
53	datafusion:vortex-compact	-13.9%	-2.9%	-11.4%	+10.7%	✅ faster
53	datafusion:vortex-file-compressed	+6.7%	-2.9%	+9.9%	+10.0%	➖ noise
53	duckdb:duckdb	-10.5%	-2.9%	-7.9%	+10.3%	➖ noise
53	duckdb:vortex-compact	-6.9%	-2.9%	-4.1%	+10.0%	➖ noise
53	duckdb:vortex-file-compressed	-9.5%	-2.9%	-6.8%	+10.0%	➖ noise
54	datafusion:vortex-compact	-13.2%	+1.4%	-14.4%	+10.0%	✅ faster
54	datafusion:vortex-file-compressed	+4.5%	+1.4%	+3.0%	+10.0%	➖ noise
54	duckdb:duckdb	+3.7%	+1.4%	+2.3%	+10.0%	➖ noise
54	duckdb:vortex-compact	-6.4%	+1.4%	-7.8%	+10.0%	➖ noise
54	duckdb:vortex-file-compressed	-9.7%	+1.4%	-11.0%	+10.0%	✅ faster
55	datafusion:vortex-compact	-9.5%	-3.4%	-6.4%	+13.8%	➖ noise
55	datafusion:vortex-file-compressed	+3.2%	-3.4%	+6.8%	+11.0%	➖ noise
55	duckdb:duckdb	-2.8%	-3.4%	+0.6%	+17.9%	➖ noise
55	duckdb:vortex-compact	-1.3%	-3.4%	+2.2%	+17.8%	➖ noise
55	duckdb:vortex-file-compressed	-13.0%	-3.4%	-10.0%	+10.8%	✅ faster
56	datafusion:vortex-compact	-11.7%	+1.3%	-12.8%	+10.0%	✅ faster
56	datafusion:vortex-file-compressed	+1.4%	+1.3%	+0.0%	+10.0%	➖ noise
56	duckdb:duckdb	-7.7%	+1.3%	-8.9%	+10.5%	➖ noise
56	duckdb:vortex-compact	-4.5%	+1.3%	-5.7%	+10.0%	➖ noise
56	duckdb:vortex-file-compressed	-14.6%	+1.3%	-15.7%	+10.0%	✅ faster
57	datafusion:vortex-compact	-13.8%	-3.1%	-11.0%	+10.0%	✅ faster
57	datafusion:vortex-file-compressed	+1.5%	-3.1%	+4.8%	+10.0%	➖ noise
57	duckdb:duckdb	-5.9%	-3.1%	-2.8%	+19.4%	➖ noise
57	duckdb:vortex-compact	-7.0%	-3.1%	-4.0%	+10.0%	➖ noise
57	duckdb:vortex-file-compressed	-8.6%	-3.1%	-5.7%	+10.0%	➖ noise
58	datafusion:vortex-compact	-11.3%	-2.5%	-9.0%	+10.0%	➖ noise
58	datafusion:vortex-file-compressed	+5.4%	-2.5%	+8.1%	+10.0%	➖ noise
58	duckdb:duckdb	+0.9%	-2.5%	+3.5%	+10.9%	➖ noise
58	duckdb:vortex-compact	-3.0%	-2.5%	-0.5%	+17.0%	➖ noise
58	duckdb:vortex-file-compressed	-6.6%	-2.5%	-4.2%	+12.2%	➖ noise
59	datafusion:vortex-compact	-16.4%	+1.7%	-17.8%	+10.0%	✅ faster
59	datafusion:vortex-file-compressed	+2.0%	+1.7%	+0.3%	+10.0%	➖ noise
59	duckdb:duckdb	-4.5%	+1.7%	-6.1%	+10.0%	➖ noise
59	duckdb:vortex-compact	-2.6%	+1.7%	-4.3%	+10.0%	➖ noise
59	duckdb:vortex-file-compressed	-5.4%	+1.7%	-7.0%	+10.2%	➖ noise
60	datafusion:vortex-compact	-10.5%	-4.6%	-6.2%	+10.8%	➖ noise
60	datafusion:vortex-file-compressed	-2.9%	-4.6%	+1.7%	+10.0%	➖ noise
60	duckdb:duckdb	-8.0%	-4.6%	-3.6%	+12.0%	➖ noise
60	duckdb:vortex-compact	-5.4%	-4.6%	-0.9%	+10.0%	➖ noise
60	duckdb:vortex-file-compressed	-13.6%	-4.6%	-9.5%	+14.0%	➖ noise
61	datafusion:vortex-compact	-12.0%	-3.1%	-9.2%	+10.0%	✅ faster
61	datafusion:vortex-file-compressed	+2.8%	-3.1%	+6.1%	+10.0%	➖ noise
61	duckdb:duckdb	-1.3%	-3.1%	+1.9%	+14.0%	➖ noise
61	duckdb:vortex-compact	-4.2%	-3.1%	-1.1%	+10.0%	➖ noise
61	duckdb:vortex-file-compressed	-3.3%	-3.1%	-0.2%	+10.0%	➖ noise
62	datafusion:vortex-compact	-13.3%	-3.7%	-10.0%	+11.2%	➖ noise
62	datafusion:vortex-file-compressed	+4.5%	-3.7%	+8.5%	+10.0%	➖ noise
62	duckdb:duckdb	-4.7%	-3.7%	-1.1%	+21.0%	➖ noise
62	duckdb:vortex-compact	+0.5%	-3.7%	+4.4%	+20.9%	➖ noise
62	duckdb:vortex-file-compressed	-10.0%	-3.7%	-6.6%	+18.1%	➖ noise
63	datafusion:vortex-compact	-12.3%	-1.1%	-11.3%	+10.7%	✅ faster
63	datafusion:vortex-file-compressed	+1.2%	-1.1%	+2.3%	+10.0%	➖ noise
63	duckdb:duckdb	-7.0%	-1.1%	-6.0%	+11.2%	➖ noise
63	duckdb:vortex-compact	-1.9%	-1.1%	-0.9%	+10.1%	➖ noise
63	duckdb:vortex-file-compressed	-7.1%	-1.1%	-6.1%	+13.3%	➖ noise
64	datafusion:vortex-compact	-12.5%	-3.3%	-9.5%	+10.0%	✅ faster
64	datafusion:vortex-file-compressed	+0.4%	-3.3%	+3.9%	+10.0%	➖ noise
64	duckdb:duckdb	-1.9%	-3.3%	+1.5%	+10.0%	➖ noise
64	duckdb:vortex-compact	-2.0%	-3.3%	+1.3%	+10.0%	➖ noise
64	duckdb:vortex-file-compressed	-9.7%	-3.3%	-6.6%	+10.0%	➖ noise
65	datafusion:vortex-compact	-15.1%	+1.4%	-16.3%	+10.8%	✅ faster
65	datafusion:vortex-file-compressed	+3.1%	+1.4%	+1.6%	+13.5%	➖ noise
65	duckdb:duckdb	-16.2%	+1.4%	-17.4%	+17.6%	✅ faster
65	duckdb:vortex-compact	-5.7%	+1.4%	-7.1%	+10.0%	➖ noise
65	duckdb:vortex-file-compressed	-11.0%	+1.4%	-12.3%	+10.0%	✅ faster
66	datafusion:vortex-compact	-15.3%	-2.5%	-13.1%	+11.3%	✅ faster
66	datafusion:vortex-file-compressed	-4.7%	-2.5%	-2.2%	+11.9%	➖ noise
66	duckdb:duckdb	+1.2%	-2.5%	+3.8%	+11.8%	➖ noise
66	duckdb:vortex-compact	+2.7%	-2.5%	+5.4%	+12.7%	➖ noise
66	duckdb:vortex-file-compressed	-5.9%	-2.5%	-3.5%	+14.9%	➖ noise
67	datafusion:vortex-compact	-16.1%	-3.0%	-13.5%	+10.0%	✅ faster
67	datafusion:vortex-file-compressed	+0.7%	-3.0%	+3.8%	+10.0%	➖ noise
67	duckdb:duckdb	-10.7%	-3.0%	-8.0%	+10.0%	➖ noise
67	duckdb:vortex-compact	-11.0%	-3.0%	-8.2%	+10.4%	➖ noise
67	duckdb:vortex-file-compressed	-8.7%	-3.0%	-5.9%	+10.0%	➖ noise
68	datafusion:vortex-compact	-14.7%	-2.0%	-13.0%	+10.0%	✅ faster
68	datafusion:vortex-file-compressed	-5.1%	-2.0%	-3.2%	+10.0%	➖ noise
68	duckdb:duckdb	-12.3%	-2.0%	-10.4%	+11.0%	✅ faster
68	duckdb:vortex-compact	-6.1%	-2.0%	-4.1%	+13.0%	➖ noise
68	duckdb:vortex-file-compressed	-6.4%	-2.0%	-4.5%	+10.0%	➖ noise
69	datafusion:vortex-compact	-11.7%	-1.0%	-10.7%	+10.0%	✅ faster
69	datafusion:vortex-file-compressed	+3.3%	-1.0%	+4.4%	+10.0%	➖ noise
69	duckdb:duckdb	-5.7%	-1.0%	-4.8%	+10.4%	➖ noise
69	duckdb:vortex-compact	-7.3%	-1.0%	-6.3%	+10.0%	➖ noise
69	duckdb:vortex-file-compressed	-9.4%	-1.0%	-8.4%	+10.0%	➖ noise
70	datafusion:vortex-compact	-10.2%	-5.1%	-5.3%	+10.0%	➖ noise
70	datafusion:vortex-file-compressed	-4.7%	-5.1%	+0.5%	+10.0%	➖ noise
70	duckdb:duckdb	-0.9%	-5.1%	+4.5%	+13.0%	➖ noise
70	duckdb:vortex-compact	-5.3%	-5.1%	-0.2%	+10.0%	➖ noise
70	duckdb:vortex-file-compressed	-3.9%	-5.1%	+1.3%	+10.0%	➖ noise
71	datafusion:vortex-compact	-13.1%	-2.9%	-10.6%	+10.0%	✅ faster
71	datafusion:vortex-file-compressed	+6.0%	-2.9%	+9.2%	+10.0%	➖ noise
71	duckdb:duckdb	-3.0%	-2.9%	-0.2%	+15.0%	➖ noise
71	duckdb:vortex-compact	-3.6%	-2.9%	-0.8%	+10.0%	➖ noise
71	duckdb:vortex-file-compressed	-2.4%	-2.9%	+0.5%	+14.1%	➖ noise
72	datafusion:vortex-compact	-22.6%	-1.1%	-21.8%	+10.0%	✅ faster
72	datafusion:vortex-file-compressed	+0.9%	-1.1%	+1.9%	+10.0%	➖ noise
72	duckdb:duckdb	-4.9%	-1.1%	-3.8%	+13.1%	➖ noise
72	duckdb:vortex-compact	-2.6%	-1.1%	-1.6%	+10.0%	➖ noise
72	duckdb:vortex-file-compressed	-3.0%	-1.1%	-2.0%	+10.0%	➖ noise
73	datafusion:vortex-compact	-14.5%	+1.4%	-15.7%	+16.3%	✅ faster
73	datafusion:vortex-file-compressed	-2.9%	+1.4%	-4.3%	+23.5%	➖ noise
73	duckdb:duckdb	-5.9%	+1.4%	-7.2%	+10.0%	➖ noise
73	duckdb:vortex-compact	-3.3%	+1.4%	-4.6%	+10.0%	➖ noise
73	duckdb:vortex-file-compressed	-8.6%	+1.4%	-9.8%	+11.3%	➖ noise
74	datafusion:vortex-compact	-10.7%	-4.6%	-6.4%	+10.0%	➖ noise
74	datafusion:vortex-file-compressed	+0.3%	-4.6%	+5.2%	+10.0%	➖ noise
74	duckdb:duckdb	-5.2%	-4.6%	-0.6%	+10.0%	➖ noise
74	duckdb:vortex-compact	-12.0%	-4.6%	-7.8%	+10.0%	➖ noise
74	duckdb:vortex-file-compressed	-10.8%	-4.6%	-6.5%	+10.0%	➖ noise
75	datafusion:vortex-compact	-12.0%	-0.8%	-11.3%	+10.0%	✅ faster
75	datafusion:vortex-file-compressed	+1.6%	-0.8%	+2.4%	+10.0%	➖ noise
75	duckdb:duckdb	-2.7%	-0.8%	-2.0%	+10.0%	➖ noise
75	duckdb:vortex-compact	-1.9%	-0.8%	-1.2%	+10.0%	➖ noise
75	duckdb:vortex-file-compressed	-5.2%	-0.8%	-4.4%	+12.0%	➖ noise
76	datafusion:vortex-compact	-11.6%	+5.2%	-15.9%	+11.1%	✅ faster
76	datafusion:vortex-file-compressed	-5.3%	+5.2%	-10.0%	+13.4%	➖ noise
76	duckdb:duckdb	-9.6%	+5.2%	-14.1%	+15.9%	✅ faster
76	duckdb:vortex-compact	-7.0%	+5.2%	-11.6%	+13.7%	➖ noise
76	duckdb:vortex-file-compressed	-13.9%	+5.2%	-18.1%	+22.0%	✅ faster
77	datafusion:vortex-compact	-10.8%	-1.9%	-9.0%	+10.0%	➖ noise
77	datafusion:vortex-file-compressed	-1.7%	-1.9%	+0.2%	+10.0%	➖ noise
77	duckdb:duckdb	-6.8%	-1.9%	-5.0%	+13.4%	➖ noise
77	duckdb:vortex-compact	-2.7%	-1.9%	-0.8%	+10.0%	➖ noise
77	duckdb:vortex-file-compressed	-0.8%	-1.9%	+1.2%	+10.0%	➖ noise
78	datafusion:vortex-compact	-17.2%	-3.0%	-14.6%	+10.0%	✅ faster
78	datafusion:vortex-file-compressed	+1.1%	-3.0%	+4.2%	+10.0%	➖ noise
78	duckdb:duckdb	+1.1%	-3.0%	+4.3%	+10.5%	➖ noise
78	duckdb:vortex-compact	-2.2%	-3.0%	+0.9%	+10.0%	➖ noise
78	duckdb:vortex-file-compressed	-5.6%	-3.0%	-2.6%	+10.0%	➖ noise
79	datafusion:vortex-compact	-13.4%	-4.4%	-9.4%	+10.0%	✅ faster
79	datafusion:vortex-file-compressed	+1.7%	-4.4%	+6.3%	+10.0%	➖ noise
79	duckdb:duckdb	-17.6%	-4.4%	-13.9%	+10.0%	✅ faster
79	duckdb:vortex-compact	-9.5%	-4.4%	-5.3%	+10.0%	➖ noise
79	duckdb:vortex-file-compressed	-6.0%	-4.4%	-1.7%	+11.0%	➖ noise
80	datafusion:vortex-compact	-13.6%	-3.9%	-10.1%	+10.0%	✅ faster
80	datafusion:vortex-file-compressed	+2.8%	-3.9%	+6.9%	+11.4%	➖ noise
80	duckdb:duckdb	-13.1%	-3.9%	-9.5%	+23.1%	➖ noise
80	duckdb:vortex-compact	-8.5%	-3.9%	-4.8%	+10.0%	➖ noise
80	duckdb:vortex-file-compressed	-12.4%	-3.9%	-8.9%	+12.5%	➖ noise
81	datafusion:vortex-compact	-16.0%	-1.6%	-14.6%	+13.3%	✅ faster
81	datafusion:vortex-file-compressed	-4.3%	-1.6%	-2.7%	+10.0%	➖ noise
81	duckdb:duckdb	-6.4%	-1.6%	-4.9%	+10.4%	➖ noise
81	duckdb:vortex-compact	-15.2%	-1.6%	-13.8%	+10.0%	✅ faster
81	duckdb:vortex-file-compressed	-8.1%	-1.6%	-6.6%	+10.0%	➖ noise
82	datafusion:vortex-compact	-15.4%	-7.7%	-8.4%	+11.2%	➖ noise
82	datafusion:vortex-file-compressed	+2.4%	-7.7%	+10.9%	+10.8%	🚨 regression
82	duckdb:duckdb	-2.3%	-7.7%	+5.8%	+13.2%	➖ noise
82	duckdb:vortex-compact	-6.6%	-7.7%	+1.2%	+12.0%	➖ noise
82	duckdb:vortex-file-compressed	-12.4%	-7.7%	-5.1%	+12.8%	➖ noise
83	datafusion:vortex-compact	-12.0%	+2.5%	-14.1%	+10.0%	✅ faster
83	datafusion:vortex-file-compressed	-3.3%	+2.5%	-5.7%	+10.0%	➖ noise
83	duckdb:duckdb	+3.4%	+2.5%	+0.9%	+11.6%	➖ noise
83	duckdb:vortex-compact	-11.4%	+2.5%	-13.6%	+10.0%	✅ faster
83	duckdb:vortex-file-compressed	-1.9%	+2.5%	-4.3%	+10.0%	➖ noise
84	datafusion:vortex-compact	-11.0%	-1.8%	-9.4%	+13.5%	➖ noise
84	datafusion:vortex-file-compressed	-0.1%	-1.8%	+1.7%	+12.4%	➖ noise
84	duckdb:duckdb	-8.2%	-1.8%	-6.5%	+10.0%	➖ noise
84	duckdb:vortex-compact	-9.4%	-1.8%	-7.7%	+10.0%	➖ noise
84	duckdb:vortex-file-compressed	-7.9%	-1.8%	-6.2%	+10.0%	➖ noise
85	datafusion:vortex-compact	-9.6%	-3.3%	-6.5%	+10.0%	➖ noise
85	datafusion:vortex-file-compressed	+2.1%	-3.3%	+5.5%	+10.0%	➖ noise
85	duckdb:duckdb	-8.3%	-3.3%	-5.2%	+10.1%	➖ noise
85	duckdb:vortex-compact	-9.6%	-3.3%	-6.5%	+10.0%	➖ noise
85	duckdb:vortex-file-compressed	-5.5%	-3.3%	-2.3%	+10.0%	➖ noise
86	datafusion:vortex-compact	-12.8%	-1.5%	-11.4%	+10.0%	✅ faster
86	datafusion:vortex-file-compressed	+6.8%	-1.5%	+8.5%	+10.7%	➖ noise
86	duckdb:duckdb	-10.3%	-1.5%	-8.9%	+12.4%	➖ noise
86	duckdb:vortex-compact	+1.8%	-1.5%	+3.4%	+17.0%	➖ noise
86	duckdb:vortex-file-compressed	-12.5%	-1.5%	-11.1%	+13.5%	➖ noise
87	datafusion:vortex-compact	-8.9%	-5.4%	-3.8%	+10.0%	➖ noise
87	datafusion:vortex-file-compressed	+3.6%	-5.4%	+9.5%	+10.0%	➖ noise
87	duckdb:duckdb	-11.1%	-5.4%	-6.0%	+10.0%	➖ noise
87	duckdb:vortex-compact	-3.2%	-5.4%	+2.3%	+13.4%	➖ noise
87	duckdb:vortex-file-compressed	-5.3%	-5.4%	+0.1%	+12.4%	➖ noise
88	datafusion:vortex-compact	-11.9%	-1.6%	-10.5%	+10.0%	✅ faster
88	datafusion:vortex-file-compressed	+2.7%	-1.6%	+4.3%	+10.0%	➖ noise
88	duckdb:duckdb	-4.0%	-1.6%	-2.5%	+10.0%	➖ noise
88	duckdb:vortex-compact	-10.5%	-1.6%	-9.1%	+10.0%	✅ faster
88	duckdb:vortex-file-compressed	-3.3%	-1.6%	-1.8%	+10.0%	➖ noise
89	datafusion:vortex-compact	-13.2%	-2.0%	-11.4%	+10.0%	✅ faster
89	datafusion:vortex-file-compressed	+3.2%	-2.0%	+5.3%	+10.0%	➖ noise
89	duckdb:duckdb	-5.4%	-2.0%	-3.5%	+11.0%	➖ noise
89	duckdb:vortex-compact	-9.9%	-2.0%	-8.0%	+10.2%	➖ noise
89	duckdb:vortex-file-compressed	-13.7%	-2.0%	-11.9%	+10.0%	✅ faster
90	datafusion:vortex-compact	-8.4%	-3.1%	-5.4%	+12.0%	➖ noise
90	datafusion:vortex-file-compressed	+8.2%	-3.1%	+11.6%	+10.0%	🚨 regression
90	duckdb:duckdb	-6.7%	-3.1%	-3.7%	+15.5%	➖ noise
90	duckdb:vortex-compact	-6.5%	-3.1%	-3.5%	+11.8%	➖ noise
90	duckdb:vortex-file-compressed	-7.6%	-3.1%	-4.7%	+10.5%	➖ noise
91	datafusion:vortex-compact	-9.6%	-0.7%	-8.9%	+10.0%	➖ noise
91	datafusion:vortex-file-compressed	+7.9%	-0.7%	+8.7%	+10.8%	➖ noise
91	duckdb:duckdb	+4.1%	-0.7%	+4.9%	+16.1%	➖ noise
91	duckdb:vortex-compact	-10.1%	-0.7%	-9.4%	+12.2%	➖ noise
91	duckdb:vortex-file-compressed	-12.4%	-0.7%	-11.7%	+10.0%	✅ faster
92	datafusion:vortex-compact	-15.5%	-7.8%	-8.4%	+10.0%	➖ noise
92	datafusion:vortex-file-compressed	+1.9%	-7.8%	+10.5%	+10.0%	🚨 regression
92	duckdb:duckdb	-1.7%	-7.8%	+6.6%	+10.5%	➖ noise
92	duckdb:vortex-compact	-5.8%	-7.8%	+2.2%	+13.3%	➖ noise
92	duckdb:vortex-file-compressed	-11.6%	-7.8%	-4.2%	+10.7%	➖ noise
93	datafusion:vortex-compact	-14.9%	-5.6%	-9.9%	+13.2%	➖ noise
93	datafusion:vortex-file-compressed	+13.3%	-5.6%	+19.9%	+12.4%	🚨 regression
93	duckdb:duckdb	-2.0%	-5.6%	+3.8%	+11.5%	➖ noise
93	duckdb:vortex-compact	-6.9%	-5.6%	-1.4%	+12.6%	➖ noise
93	duckdb:vortex-file-compressed	-7.7%	-5.6%	-2.3%	+14.0%	➖ noise
94	datafusion:vortex-compact	-7.3%	-1.3%	-6.1%	+10.0%	➖ noise
94	datafusion:vortex-file-compressed	+7.4%	-1.3%	+8.8%	+10.0%	➖ noise
94	duckdb:duckdb	-2.1%	-1.3%	-0.8%	+10.2%	➖ noise
94	duckdb:vortex-compact	-15.8%	-1.3%	-14.7%	+12.5%	✅ faster
94	duckdb:vortex-file-compressed	-10.8%	-1.3%	-9.7%	+10.0%	✅ faster
95	datafusion:vortex-compact	-8.8%	-2.7%	-6.2%	+10.0%	➖ noise
95	datafusion:vortex-file-compressed	+4.9%	-2.7%	+7.8%	+11.0%	➖ noise
95	duckdb:duckdb	-10.1%	-2.7%	-7.6%	+18.0%	➖ noise
95	duckdb:vortex-compact	+7.8%	-2.7%	+10.8%	+13.5%	➖ noise
95	duckdb:vortex-file-compressed	+5.0%	-2.7%	+7.9%	+14.6%	➖ noise
96	datafusion:vortex-compact	-13.5%	-7.8%	-6.2%	+11.4%	➖ noise
96	datafusion:vortex-file-compressed	+9.9%	-7.8%	+19.2%	+10.0%	🚨 regression
96	duckdb:duckdb	-13.3%	-7.8%	-6.0%	+14.8%	➖ noise
96	duckdb:vortex-compact	-11.3%	-7.8%	-3.8%	+27.4%	➖ noise
96	duckdb:vortex-file-compressed	-11.4%	-7.8%	-3.9%	+17.3%	➖ noise
97	datafusion:vortex-compact	-9.8%	-2.8%	-7.2%	+10.0%	➖ noise
97	datafusion:vortex-file-compressed	-1.6%	-2.8%	+1.2%	+10.0%	➖ noise
97	duckdb:duckdb	-2.3%	-2.8%	+0.5%	+13.5%	➖ noise
97	duckdb:vortex-compact	-6.8%	-2.8%	-4.1%	+11.5%	➖ noise
97	duckdb:vortex-file-compressed	-8.0%	-2.8%	-5.3%	+15.0%	➖ noise
98	datafusion:vortex-compact	-16.9%	+1.6%	-18.2%	+10.0%	✅ faster
98	datafusion:vortex-file-compressed	-1.7%	+1.6%	-3.3%	+10.0%	➖ noise
98	duckdb:duckdb	+2.0%	+1.6%	+0.4%	+12.0%	➖ noise
98	duckdb:vortex-compact	+1.9%	+1.6%	+0.3%	+11.8%	➖ noise
98	duckdb:vortex-file-compressed	-0.4%	+1.6%	-1.9%	+10.0%	➖ noise
99	datafusion:vortex-compact	-14.8%	+5.1%	-18.9%	+14.6%	✅ faster
99	datafusion:vortex-file-compressed	+3.5%	+5.1%	-1.6%	+18.9%	➖ noise
99	duckdb:duckdb	+4.8%	+5.1%	-0.3%	+26.8%	➖ noise
99	duckdb:vortex-compact	-13.3%	+5.1%	-17.5%	+16.4%	✅ faster
99	duckdb:vortex-file-compressed	-6.6%	+5.1%	-11.2%	+25.6%	➖ noise

[github-actions]

Benchmarks: PolarSignals Profiling

Summary

• Overall: 1.003x ➖
• Vortex: 1.003x ➖

datafusion / vortex-file-compressed (1.003x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed	114528140	113777969	1.01
polarsignals_q01/datafusion:vortex-file-compressed	340625122	347823686	0.98
polarsignals_q02/datafusion:vortex-file-compressed	20772013	20987293	0.99
polarsignals_q03/datafusion:vortex-file-compressed	347934238	347291394	1.00
polarsignals_q04/datafusion:vortex-file-compressed	12154040	11567780	1.05
polarsignals_q05/datafusion:vortex-file-compressed	16095270	16130606	1.00
polarsignals_q06/datafusion:vortex-file-compressed	19689033	20479258	0.96
polarsignals_q07/datafusion:vortex-file-compressed	12183222	12239904	1.00
polarsignals_q08/datafusion:vortex-file-compressed	429241497	427776674	1.00
polarsignals_q09/datafusion:vortex-file-compressed	10836827	10314245	1.05

[github-actions]

Benchmarks: TPC-H SF=10 on NVME

Summary

• Overall: 0.924x ➖
• Vortex: 0.916x ➖
• Parquet: 0.946x ➖

Verdict

No clear signal

• Attributed Vortex impact: -3.1%
• Confidence: low
• Environment shift: -5.4%

Statistical Summary

• Systemic shift (parquet controls): -5.4%
• Control sigma: +2.5%
• Residual noise: +2.0%
• Median polish overall: -7.9%

datafusion / vortex-file-compressed (0.899x ✅, 12↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀	417309629	488285500	0.85
tpch_q02/datafusion:vortex-file-compressed	159259927	175473460	0.91
tpch_q03/datafusion:vortex-file-compressed 🚀	250543349	281998528	0.89
tpch_q04/datafusion:vortex-file-compressed	108294811	116042878	0.93
tpch_q05/datafusion:vortex-file-compressed 🚀	454376996	513841339	0.88
tpch_q06/datafusion:vortex-file-compressed	40627490	44485486	0.91
tpch_q07/datafusion:vortex-file-compressed 🚀	641455395	757781463	0.85
tpch_q08/datafusion:vortex-file-compressed 🚀	469423880	526170356	0.89
tpch_q09/datafusion:vortex-file-compressed 🚀	802155787	903782106	0.89
tpch_q10/datafusion:vortex-file-compressed 🚀	290717692	328552457	0.88
tpch_q11/datafusion:vortex-file-compressed	116609528	129385002	0.90
tpch_q12/datafusion:vortex-file-compressed 🚀	123208699	137437387	0.90
tpch_q13/datafusion:vortex-file-compressed	229216376	246195819	0.93
tpch_q14/datafusion:vortex-file-compressed	73359422	78138628	0.94
tpch_q15/datafusion:vortex-file-compressed	108069910	118475752	0.91
tpch_q16/datafusion:vortex-file-compressed	92906618	100730627	0.92
tpch_q17/datafusion:vortex-file-compressed 🚀	738418106	828636212	0.89
tpch_q18/datafusion:vortex-file-compressed 🚀	962614432	1090943052	0.88
tpch_q19/datafusion:vortex-file-compressed	127457117	134800656	0.95
tpch_q20/datafusion:vortex-file-compressed 🚀	199083901	225142955	0.88
tpch_q21/datafusion:vortex-file-compressed 🚀	767955169	881154262	0.87
tpch_q22/datafusion:vortex-file-compressed	61077690	66116940	0.92

datafusion / vortex-compact (0.914x ➖, 5↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	493728423	505308312	0.98
tpch_q02/datafusion:vortex-compact	165605730	179052501	0.92
tpch_q03/datafusion:vortex-compact	267133687	295804468	0.90
tpch_q04/datafusion:vortex-compact 🚀	127661683	143136485	0.89
tpch_q05/datafusion:vortex-compact 🚀	468858843	532375362	0.88
tpch_q06/datafusion:vortex-compact	64270301	69414499	0.93
tpch_q07/datafusion:vortex-compact 🚀	674624081	752311806	0.90
tpch_q08/datafusion:vortex-compact	481826283	530276390	0.91
tpch_q09/datafusion:vortex-compact 🚀	817034658	920619356	0.89
tpch_q10/datafusion:vortex-compact	322746410	357349645	0.90
tpch_q11/datafusion:vortex-compact	121676050	133761326	0.91
tpch_q12/datafusion:vortex-compact	183761613	201753240	0.91
tpch_q13/datafusion:vortex-compact	277800208	296455319	0.94
tpch_q14/datafusion:vortex-compact	89804137	96152488	0.93
tpch_q15/datafusion:vortex-compact	168161355	185585587	0.91
tpch_q16/datafusion:vortex-compact	97954503	105058893	0.93
tpch_q17/datafusion:vortex-compact	746475467	825836062	0.90
tpch_q18/datafusion:vortex-compact 🚀	979844515	1107000406	0.89
tpch_q19/datafusion:vortex-compact	226886193	244662998	0.93
tpch_q20/datafusion:vortex-compact	228336201	248503458	0.92
tpch_q21/datafusion:vortex-compact	807393162	893588740	0.90
tpch_q22/datafusion:vortex-compact	72128163	76179859	0.95

datafusion / parquet (0.927x ➖, 4↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	464534939	496049299	0.94
tpch_q02/datafusion:parquet	257814541	273544939	0.94
tpch_q03/datafusion:parquet	389715627	424722183	0.92
tpch_q04/datafusion:parquet	148768295	155106114	0.96
tpch_q05/datafusion:parquet	578784864	633396261	0.91
tpch_q06/datafusion:parquet	124811581	132014908	0.95
tpch_q07/datafusion:parquet	788759211	868440918	0.91
tpch_q08/datafusion:parquet	641056196	697402841	0.92
tpch_q09/datafusion:parquet 🚀	957811380	1067351868	0.90
tpch_q10/datafusion:parquet	605715117	648308613	0.93
tpch_q11/datafusion:parquet	194422204	205293188	0.95
tpch_q12/datafusion:parquet	250324323	250519629	1.00
tpch_q13/datafusion:parquet	351400355	354165210	0.99
tpch_q14/datafusion:parquet	198026148	211652830	0.94
tpch_q15/datafusion:parquet 🚀	264343342	306743343	0.86
tpch_q16/datafusion:parquet	176925804	188932441	0.94
tpch_q17/datafusion:parquet 🚀	832630790	929998254	0.90
tpch_q18/datafusion:parquet	1022088336	1135025441	0.90
tpch_q19/datafusion:parquet 🚀	325949311	379536063	0.86
tpch_q20/datafusion:parquet	371445214	400463245	0.93
tpch_q21/datafusion:parquet	892297456	990716647	0.90
tpch_q22/datafusion:parquet	223752936	226128290	0.99

datafusion / arrow (0.878x ✅, 16↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:arrow 🚀	724170898	815031861	0.89
tpch_q02/datafusion:arrow	201695730	212158600	0.95
tpch_q03/datafusion:arrow 🚀	549283844	643680388	0.85
tpch_q04/datafusion:arrow 🚀	388024290	477750972	0.81
tpch_q05/datafusion:arrow 🚀	1058626154	1200549886	0.88
tpch_q06/datafusion:arrow 🚀	311541068	377490924	0.83
tpch_q07/datafusion:arrow 🚀	1346036859	1587353570	0.85
tpch_q08/datafusion:arrow 🚀	1292934766	1452381454	0.89
tpch_q09/datafusion:arrow 🚀	1559925751	1742180785	0.90
tpch_q10/datafusion:arrow 🚀	679935139	778056121	0.87
tpch_q11/datafusion:arrow	180858496	192980724	0.94
tpch_q12/datafusion:arrow 🚀	733717823	832646265	0.88
tpch_q13/datafusion:arrow	523386974	562298568	0.93
tpch_q14/datafusion:arrow 🚀	359500120	439236461	0.82
tpch_q15/datafusion:arrow 🚀	754358801	923179047	0.82
tpch_q16/datafusion:arrow	122048098	133840060	0.91
tpch_q17/datafusion:arrow 🚀	1572680397	1752383590	0.90
tpch_q18/datafusion:arrow	2161045014	2390053160	0.90
tpch_q19/datafusion:arrow 🚀	579509751	656268986	0.88
tpch_q20/datafusion:arrow 🚀	556261602	661098349	0.84
tpch_q21/datafusion:arrow 🚀	4130553580	4617867220	0.89
tpch_q22/datafusion:arrow	177054210	196524072	0.90

duckdb / vortex-file-compressed (0.917x ➖, 5↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	177053875	186767634	0.95
tpch_q02/duckdb:vortex-file-compressed	53890664	59599609	0.90
tpch_q03/duckdb:vortex-file-compressed	130235975	140605706	0.93
tpch_q04/duckdb:vortex-file-compressed	150745622	166885415	0.90
tpch_q05/duckdb:vortex-file-compressed	132261679	144263256	0.92
tpch_q06/duckdb:vortex-file-compressed 🚀	49633593	55215065	0.90
tpch_q07/duckdb:vortex-file-compressed	145762645	159754656	0.91
tpch_q08/duckdb:vortex-file-compressed 🚀	175920317	206206826	0.85
tpch_q09/duckdb:vortex-file-compressed	337328235	361636746	0.93
tpch_q10/duckdb:vortex-file-compressed	154021969	166933369	0.92
tpch_q11/duckdb:vortex-file-compressed	35994169	38969116	0.92
tpch_q12/duckdb:vortex-file-compressed	93568852	103680460	0.90
tpch_q13/duckdb:vortex-file-compressed	244853333	260026051	0.94
tpch_q14/duckdb:vortex-file-compressed	67936886	73564536	0.92
tpch_q15/duckdb:vortex-file-compressed 🚀	97191696	108210359	0.90
tpch_q16/duckdb:vortex-file-compressed	81380336	84917117	0.96
tpch_q17/duckdb:vortex-file-compressed	102787301	113890470	0.90
tpch_q18/duckdb:vortex-file-compressed 🚀	276173983	310600918	0.89
tpch_q19/duckdb:vortex-file-compressed	92051378	95525438	0.96
tpch_q20/duckdb:vortex-file-compressed 🚀	164789851	184647741	0.89
tpch_q21/duckdb:vortex-file-compressed	556585241	609329325	0.91
tpch_q22/duckdb:vortex-file-compressed	78762386	81898148	0.96

duckdb / vortex-compact (0.932x ➖, 3↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	231177275	236109871	0.98
tpch_q02/duckdb:vortex-compact	60453665	61668200	0.98
tpch_q03/duckdb:vortex-compact	140728741	151632342	0.93
tpch_q04/duckdb:vortex-compact	180059576	193906463	0.93
tpch_q05/duckdb:vortex-compact	149313472	165287220	0.90
tpch_q06/duckdb:vortex-compact	86876136	90703378	0.96
tpch_q07/duckdb:vortex-compact	208604914	220380063	0.95
tpch_q08/duckdb:vortex-compact 🚀	190091788	219464059	0.87
tpch_q09/duckdb:vortex-compact	363079949	390385777	0.93
tpch_q10/duckdb:vortex-compact	188705737	208476475	0.91
tpch_q11/duckdb:vortex-compact 🚀	41589279	46569198	0.89
tpch_q12/duckdb:vortex-compact	211592409	221597501	0.95
tpch_q13/duckdb:vortex-compact	291611671	312483563	0.93
tpch_q14/duckdb:vortex-compact	106244645	112673365	0.94
tpch_q15/duckdb:vortex-compact	121085253	129383288	0.94
tpch_q16/duckdb:vortex-compact	88338668	93114957	0.95
tpch_q17/duckdb:vortex-compact 🚀	116062247	129104146	0.90
tpch_q18/duckdb:vortex-compact	291761191	318585155	0.92
tpch_q19/duckdb:vortex-compact	115024877	118948743	0.97
tpch_q20/duckdb:vortex-compact	206862456	221535471	0.93
tpch_q21/duckdb:vortex-compact	631777447	688082228	0.92
tpch_q22/duckdb:vortex-compact	90002686	94566796	0.95

duckdb / parquet (0.965x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	262058298	257488989	1.02
tpch_q02/duckdb:parquet	100536512	109684663	0.92
tpch_q03/duckdb:parquet	213758924	223048588	0.96
tpch_q04/duckdb:parquet	135455334	140485527	0.96
tpch_q05/duckdb:parquet	219069689	230734435	0.95
tpch_q06/duckdb:parquet	66995195	69191599	0.97
tpch_q07/duckdb:parquet	184604338	188310312	0.98
tpch_q08/duckdb:parquet	257162882	273425288	0.94
tpch_q09/duckdb:parquet	465054044	479138792	0.97
tpch_q10/duckdb:parquet	610164441	630229692	0.97
tpch_q11/duckdb:parquet	46222614	44574015	1.04
tpch_q12/duckdb:parquet	125930034	133333908	0.94
tpch_q13/duckdb:parquet	442070153	469031305	0.94
tpch_q14/duckdb:parquet	172505125	173289894	1.00
tpch_q15/duckdb:parquet	98854325	103713775	0.95
tpch_q16/duckdb:parquet	156791129	169248016	0.93
tpch_q17/duckdb:parquet	174068163	184432150	0.94
tpch_q18/duckdb:parquet	353413296	362083853	0.98
tpch_q19/duckdb:parquet	280707458	289462837	0.97
tpch_q20/duckdb:parquet	230513302	234049435	0.98
tpch_q21/duckdb:parquet	576690117	606681416	0.95
tpch_q22/duckdb:parquet	289973388	296909571	0.98

duckdb / duckdb (0.960x ➖, 1↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:duckdb	116975135	118431716	0.99
tpch_q02/duckdb:duckdb	45076691	47863105	0.94
tpch_q03/duckdb:duckdb	96656991	101250817	0.95
tpch_q04/duckdb:duckdb	132823687	141622705	0.94
tpch_q05/duckdb:duckdb	110340302	117104506	0.94
tpch_q06/duckdb:duckdb	39907848	38449925	1.04
tpch_q07/duckdb:duckdb	86769471	89049897	0.97
tpch_q08/duckdb:duckdb	112081297	117070496	0.96
tpch_q09/duckdb:duckdb	278580201	289436123	0.96
tpch_q10/duckdb:duckdb	203293524	215301736	0.94
tpch_q11/duckdb:duckdb 🚀	15261541	18254757	0.84
tpch_q12/duckdb:duckdb	85300837	87767534	0.97
tpch_q13/duckdb:duckdb	253532104	265617192	0.95
tpch_q14/duckdb:duckdb	71313448	73961005	0.96
tpch_q15/duckdb:duckdb	78619175	81591735	0.96
tpch_q16/duckdb:duckdb	73437477	77149154	0.95
tpch_q17/duckdb:duckdb	84413164	85977001	0.98
tpch_q18/duckdb:duckdb	213659297	225093688	0.95
tpch_q19/duckdb:duckdb	118380937	120566286	0.98
tpch_q20/duckdb:duckdb	111879259	114572711	0.98
tpch_q21/duckdb:duckdb	309372996	320275415	0.97
tpch_q22/duckdb:duckdb	68291529	68393051	1.00

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:arrow	-11.1%	-2.4%	-9.0%	+10.0%	➖ noise
1	datafusion:vortex-compact	-2.3%	-2.4%	+0.1%	+13.0%	➖ noise
1	datafusion:vortex-file-compressed	-14.5%	-2.4%	-12.5%	+14.1%	✅ faster
1	duckdb:duckdb	-1.2%	-2.4%	+1.2%	+10.7%	➖ noise
1	duckdb:vortex-compact	-2.1%	-2.4%	+0.3%	+10.1%	➖ noise
1	duckdb:vortex-file-compressed	-5.2%	-2.4%	-2.9%	+11.2%	➖ noise
2	datafusion:arrow	-4.9%	-7.1%	+2.3%	+10.0%	➖ noise
2	datafusion:vortex-compact	-7.5%	-7.1%	-0.5%	+10.0%	➖ noise
2	datafusion:vortex-file-compressed	-9.2%	-7.1%	-2.4%	+10.0%	➖ noise
2	duckdb:duckdb	-5.8%	-7.1%	+1.3%	+10.6%	➖ noise
2	duckdb:vortex-compact	-2.0%	-7.1%	+5.5%	+10.0%	➖ noise
2	duckdb:vortex-file-compressed	-9.6%	-7.1%	-2.7%	+10.0%	➖ noise
3	datafusion:arrow	-14.7%	-6.2%	-9.0%	+10.0%	➖ noise
3	datafusion:vortex-compact	-9.7%	-6.2%	-3.7%	+10.0%	➖ noise
3	datafusion:vortex-file-compressed	-11.2%	-6.2%	-5.3%	+10.0%	➖ noise
3	duckdb:duckdb	-4.5%	-6.2%	+1.8%	+10.0%	➖ noise
3	duckdb:vortex-compact	-7.2%	-6.2%	-1.0%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	-7.4%	-6.2%	-1.2%	+10.0%	➖ noise
4	datafusion:arrow	-18.8%	-3.8%	-15.5%	+10.0%	✅ faster
4	datafusion:vortex-compact	-10.8%	-3.8%	-7.3%	+10.0%	➖ noise
4	datafusion:vortex-file-compressed	-6.7%	-3.8%	-3.0%	+10.0%	➖ noise
4	duckdb:duckdb	-6.2%	-3.8%	-2.5%	+10.0%	➖ noise
4	duckdb:vortex-compact	-7.1%	-3.8%	-3.4%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-9.7%	-3.8%	-6.1%	+10.0%	➖ noise
5	datafusion:arrow	-11.8%	-6.9%	-5.3%	+10.0%	➖ noise
5	datafusion:vortex-compact	-11.9%	-6.9%	-5.4%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	-11.6%	-6.9%	-5.1%	+10.0%	➖ noise
5	duckdb:duckdb	-5.8%	-6.9%	+1.2%	+10.0%	➖ noise
5	duckdb:vortex-compact	-9.7%	-6.9%	-3.0%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	-8.3%	-6.9%	-1.6%	+10.0%	➖ noise
6	datafusion:arrow	-17.5%	-4.3%	-13.7%	+10.0%	✅ faster
6	datafusion:vortex-compact	-7.4%	-4.3%	-3.2%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	-8.7%	-4.3%	-4.5%	+10.0%	➖ noise
6	duckdb:duckdb	+3.8%	-4.3%	+8.5%	+15.1%	➖ noise
6	duckdb:vortex-compact	-4.2%	-4.3%	+0.1%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	-10.1%	-4.3%	-6.0%	+12.7%	➖ noise
7	datafusion:arrow	-15.2%	-5.6%	-10.1%	+10.0%	✅ faster
7	datafusion:vortex-compact	-10.3%	-5.6%	-5.0%	+10.0%	➖ noise
7	datafusion:vortex-file-compressed	-15.4%	-5.6%	-10.3%	+10.0%	✅ faster
7	duckdb:duckdb	-2.6%	-5.6%	+3.3%	+10.0%	➖ noise
7	duckdb:vortex-compact	-5.3%	-5.6%	+0.3%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	-8.8%	-5.6%	-3.3%	+10.0%	➖ noise
8	datafusion:arrow	-11.0%	-7.0%	-4.3%	+10.0%	➖ noise
8	datafusion:vortex-compact	-9.1%	-7.0%	-2.3%	+10.0%	➖ noise
8	datafusion:vortex-file-compressed	-10.8%	-7.0%	-4.0%	+10.0%	➖ noise
8	duckdb:duckdb	-4.3%	-7.0%	+3.0%	+10.0%	➖ noise
8	duckdb:vortex-compact	-13.4%	-7.0%	-6.8%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-14.7%	-7.0%	-8.2%	+10.0%	➖ noise
9	datafusion:arrow	-10.5%	-6.7%	-4.1%	+10.0%	➖ noise
9	datafusion:vortex-compact	-11.3%	-6.7%	-4.9%	+10.0%	➖ noise
9	datafusion:vortex-file-compressed	-11.2%	-6.7%	-4.9%	+10.0%	➖ noise
9	duckdb:duckdb	-3.8%	-6.7%	+3.1%	+10.0%	➖ noise
9	duckdb:vortex-compact	-7.0%	-6.7%	-0.3%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	-6.7%	-6.7%	-0.1%	+10.0%	➖ noise
10	datafusion:arrow	-12.6%	-4.9%	-8.1%	+10.0%	➖ noise
10	datafusion:vortex-compact	-9.7%	-4.9%	-5.0%	+10.0%	➖ noise
10	datafusion:vortex-file-compressed	-11.5%	-4.9%	-7.0%	+10.0%	➖ noise
10	duckdb:duckdb	-5.6%	-4.9%	-0.7%	+10.0%	➖ noise
10	duckdb:vortex-compact	-9.5%	-4.9%	-4.8%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-7.7%	-4.9%	-3.0%	+10.0%	➖ noise
11	datafusion:arrow	-6.3%	-0.9%	-5.4%	+10.0%	➖ noise
11	datafusion:vortex-compact	-9.0%	-0.9%	-8.2%	+10.0%	➖ noise
11	datafusion:vortex-file-compressed	-9.9%	-0.9%	-9.1%	+10.0%	➖ noise
11	duckdb:duckdb	-16.4%	-0.9%	-15.6%	+19.6%	➖ noise
11	duckdb:vortex-compact	-10.7%	-0.9%	-9.9%	+14.4%	➖ noise
11	duckdb:vortex-file-compressed	-7.6%	-0.9%	-6.8%	+14.1%	➖ noise
12	datafusion:arrow	-11.9%	-2.9%	-9.3%	+41.1%	➖ noise
12	datafusion:vortex-compact	-8.9%	-2.9%	-6.2%	+10.0%	➖ noise
12	datafusion:vortex-file-compressed	-10.4%	-2.9%	-7.7%	+10.0%	➖ noise
12	duckdb:duckdb	-2.8%	-2.9%	+0.0%	+10.0%	➖ noise
12	duckdb:vortex-compact	-4.5%	-2.9%	-1.7%	+10.0%	➖ noise
12	duckdb:vortex-file-compressed	-9.8%	-2.9%	-7.1%	+10.0%	➖ noise
13	datafusion:arrow	-6.9%	-3.3%	-3.7%	+12.3%	➖ noise
13	datafusion:vortex-compact	-6.3%	-3.3%	-3.1%	+10.0%	➖ noise
13	datafusion:vortex-file-compressed	-6.9%	-3.3%	-3.7%	+10.0%	➖ noise
13	duckdb:duckdb	-4.5%	-3.3%	-1.3%	+10.0%	➖ noise
13	duckdb:vortex-compact	-6.7%	-3.3%	-3.5%	+10.0%	➖ noise
13	duckdb:vortex-file-compressed	-5.8%	-3.3%	-2.6%	+10.0%	➖ noise
14	datafusion:arrow	-18.2%	-3.5%	-15.2%	+10.0%	✅ faster
14	datafusion:vortex-compact	-6.6%	-3.5%	-3.2%	+10.0%	➖ noise
14	datafusion:vortex-file-compressed	-6.1%	-3.5%	-2.7%	+10.0%	➖ noise
14	duckdb:duckdb	-3.6%	-3.5%	-0.1%	+10.0%	➖ noise
14	duckdb:vortex-compact	-5.7%	-3.5%	-2.3%	+10.0%	➖ noise
14	duckdb:vortex-file-compressed	-7.6%	-3.5%	-4.3%	+11.4%	➖ noise
15	datafusion:arrow	-18.3%	-9.4%	-9.8%	+10.0%	✅ faster
15	datafusion:vortex-compact	-9.4%	-9.4%	-0.0%	+10.0%	➖ noise
15	datafusion:vortex-file-compressed	-8.8%	-9.4%	+0.6%	+10.0%	➖ noise
15	duckdb:duckdb	-3.6%	-9.4%	+6.3%	+10.0%	➖ noise
15	duckdb:vortex-compact	-6.4%	-9.4%	+3.3%	+10.0%	➖ noise
15	duckdb:vortex-file-compressed	-10.2%	-9.4%	-0.9%	+10.0%	➖ noise
16	datafusion:arrow	-8.8%	-6.9%	-2.1%	+10.0%	➖ noise
16	datafusion:vortex-compact	-6.8%	-6.9%	+0.1%	+10.0%	➖ noise
16	datafusion:vortex-file-compressed	-7.8%	-6.9%	-1.0%	+10.0%	➖ noise
16	duckdb:duckdb	-4.8%	-6.9%	+2.2%	+10.0%	➖ noise
16	duckdb:vortex-compact	-5.1%	-6.9%	+1.9%	+10.0%	➖ noise
16	duckdb:vortex-file-compressed	-4.2%	-6.9%	+2.9%	+10.0%	➖ noise
17	datafusion:arrow	-10.3%	-8.1%	-2.4%	+10.0%	➖ noise
17	datafusion:vortex-compact	-9.6%	-8.1%	-1.7%	+10.0%	➖ noise
17	datafusion:vortex-file-compressed	-10.9%	-8.1%	-3.1%	+10.0%	➖ noise
17	duckdb:duckdb	-1.8%	-8.1%	+6.8%	+10.0%	➖ noise
17	duckdb:vortex-compact	-10.1%	-8.1%	-2.2%	+10.0%	➖ noise
17	duckdb:vortex-file-compressed	-9.7%	-8.1%	-1.8%	+10.0%	➖ noise
18	datafusion:arrow	-9.6%	-6.2%	-3.6%	+12.0%	➖ noise
18	datafusion:vortex-compact	-11.5%	-6.2%	-5.6%	+10.0%	➖ noise
18	datafusion:vortex-file-compressed	-11.8%	-6.2%	-5.9%	+10.0%	➖ noise
18	duckdb:duckdb	-5.1%	-6.2%	+1.2%	+10.0%	➖ noise
18	duckdb:vortex-compact	-8.4%	-6.2%	-2.3%	+10.0%	➖ noise
18	duckdb:vortex-file-compressed	-11.1%	-6.2%	-5.2%	+10.0%	➖ noise
19	datafusion:arrow	-11.7%	-8.7%	-3.2%	+10.0%	➖ noise
19	datafusion:vortex-compact	-7.3%	-8.7%	+1.6%	+10.0%	➖ noise
19	datafusion:vortex-file-compressed	-5.4%	-8.7%	+3.6%	+10.0%	➖ noise
19	duckdb:duckdb	-1.8%	-8.7%	+7.6%	+10.0%	➖ noise
19	duckdb:vortex-compact	-3.3%	-8.7%	+6.0%	+10.0%	➖ noise
19	duckdb:vortex-file-compressed	-3.6%	-8.7%	+5.6%	+10.0%	➖ noise
20	datafusion:arrow	-15.9%	-4.4%	-12.0%	+10.0%	✅ faster
20	datafusion:vortex-compact	-8.1%	-4.4%	-3.9%	+10.0%	➖ noise
20	datafusion:vortex-file-compressed	-11.6%	-4.4%	-7.5%	+10.0%	➖ noise
20	duckdb:duckdb	-2.4%	-4.4%	+2.2%	+10.0%	➖ noise
20	duckdb:vortex-compact	-6.6%	-4.4%	-2.3%	+10.0%	➖ noise
20	duckdb:vortex-file-compressed	-10.8%	-4.4%	-6.6%	+10.0%	➖ noise
21	datafusion:arrow	-10.6%	-7.5%	-3.3%	+10.0%	➖ noise
21	datafusion:vortex-compact	-9.6%	-7.5%	-2.3%	+10.0%	➖ noise
21	datafusion:vortex-file-compressed	-12.8%	-7.5%	-5.8%	+10.0%	➖ noise
21	duckdb:duckdb	-3.4%	-7.5%	+4.4%	+10.0%	➖ noise
21	duckdb:vortex-compact	-8.2%	-7.5%	-0.8%	+10.0%	➖ noise
21	duckdb:vortex-file-compressed	-8.7%	-7.5%	-1.3%	+10.0%	➖ noise
22	datafusion:arrow	-9.9%	-1.7%	-8.4%	+10.0%	➖ noise
22	datafusion:vortex-compact	-5.3%	-1.7%	-3.7%	+10.0%	➖ noise
22	datafusion:vortex-file-compressed	-7.6%	-1.7%	-6.0%	+10.0%	➖ noise
22	duckdb:duckdb	-0.1%	-1.7%	+1.6%	+10.0%	➖ noise
22	duckdb:vortex-compact	-4.8%	-1.7%	-3.2%	+10.0%	➖ noise
22	duckdb:vortex-file-compressed	-3.8%	-1.7%	-2.2%	+10.0%	➖ noise

[github-actions]

Benchmarks: FineWeb S3

Summary

• Overall: 1.068x ➖
• Vortex: 1.055x ➖
• Parquet: 1.095x ➖

Verdict

No clear signal

• Attributed Vortex impact: -3.7%
• Confidence: low
• Environment shift: +9.5%

Statistical Summary

• Systemic shift (parquet controls): +9.5%
• Control sigma: +2.6%
• Residual noise: +3.3%
• Median polish overall: +2.0%

datafusion / vortex-file-compressed (1.035x ➖, 0↑ 1↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨	61338728	45893138	1.34
fineweb_q01/datafusion:vortex-file-compressed	551357895	519198149	1.06
fineweb_q02/datafusion:vortex-file-compressed	581152716	559246073	1.04
fineweb_q03/datafusion:vortex-file-compressed	1397998072	1376010684	1.02
fineweb_q04/datafusion:vortex-file-compressed	1383880809	1391516446	0.99
fineweb_q05/datafusion:vortex-file-compressed	1379127476	1387337544	0.99
fineweb_q06/datafusion:vortex-file-compressed	1494173543	1542046418	0.97
fineweb_q07/datafusion:vortex-file-compressed	1389148604	1432777630	0.97
fineweb_q08/datafusion:vortex-file-compressed	565823468	578807928	0.98

datafusion / vortex-compact (1.088x ➖, 0↑ 1↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨	57131533	32682119	1.75
fineweb_q01/datafusion:vortex-compact	625962003	509961075	1.23
fineweb_q02/datafusion:vortex-compact	693954305	669060665	1.04
fineweb_q03/datafusion:vortex-compact	1844192926	1845794145	1.00
fineweb_q04/datafusion:vortex-compact	2217686713	2199675662	1.01
fineweb_q05/datafusion:vortex-compact	1699750839	1700214299	1.00
fineweb_q06/datafusion:vortex-compact	1416736220	1402302986	1.01
fineweb_q07/datafusion:vortex-compact	1336405547	1372519991	0.97
fineweb_q08/datafusion:vortex-compact	388552586	402528552	0.97

datafusion / parquet (1.134x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet	1183164583	1127078620	1.05
fineweb_q01/datafusion:parquet	1964484496	1790803230	1.10
fineweb_q02/datafusion:parquet	2150217836	1744640081	1.23
fineweb_q03/datafusion:parquet	2021144236	1829639301	1.10
fineweb_q04/datafusion:parquet	2276421346	1895426883	1.20
fineweb_q05/datafusion:parquet	1861057429	1725748611	1.08
fineweb_q06/datafusion:parquet	2107617966	1739640626	1.21
fineweb_q07/datafusion:parquet	1937865181	1877858916	1.03
fineweb_q08/datafusion:parquet	2076272383	1701798524	1.22

duckdb / vortex-file-compressed (1.050x ➖, 0↑ 1↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed	98357717	95570143	1.03
fineweb_q01/duckdb:vortex-file-compressed	587728993	557248689	1.05
fineweb_q02/duckdb:vortex-file-compressed 🚨	556686377	416818790	1.34
fineweb_q03/duckdb:vortex-file-compressed	1544295899	1462318377	1.06
fineweb_q04/duckdb:vortex-file-compressed	1590849470	1509888549	1.05
fineweb_q05/duckdb:vortex-file-compressed	1567066100	1529709156	1.02
fineweb_q06/duckdb:vortex-file-compressed	1689241849	1671408718	1.01
fineweb_q07/duckdb:vortex-file-compressed	1466297582	1543812261	0.95
fineweb_q08/duckdb:vortex-file-compressed	637794229	650063573	0.98

duckdb / vortex-compact (1.047x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-compact	100897858	82195790	1.23
fineweb_q01/duckdb:vortex-compact	506639989	533669108	0.95
fineweb_q02/duckdb:vortex-compact	634016686	603065551	1.05
fineweb_q03/duckdb:vortex-compact	1690871130	1691834592	1.00
fineweb_q04/duckdb:vortex-compact	1805225102	1757139049	1.03
fineweb_q05/duckdb:vortex-compact	1572365663	1589463577	0.99
fineweb_q06/duckdb:vortex-compact	1565691865	1455455116	1.08
fineweb_q07/duckdb:vortex-compact	1382071439	1349633319	1.02
fineweb_q08/duckdb:vortex-compact	534344345	482646287	1.11

duckdb / parquet (1.058x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet	1212694762	1055501310	1.15
fineweb_q01/duckdb:parquet	1758488395	1585567832	1.11
fineweb_q02/duckdb:parquet	1608956035	1619045705	0.99
fineweb_q03/duckdb:parquet	4196802930	3928111691	1.07
fineweb_q04/duckdb:parquet	1965290356	1900870547	1.03
fineweb_q05/duckdb:parquet	2790435728	2658829234	1.05
fineweb_q06/duckdb:parquet	3462978926	3314290748	1.04
fineweb_q07/duckdb:parquet	4037330400	3855168854	1.05
fineweb_q08/duckdb:parquet	1120806715	1086052827	1.03

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-compact	+74.8%	+9.8%	+59.2%	+162.2%	➖ noise
0	datafusion:vortex-file-compressed	+33.7%	+9.8%	+21.7%	+173.0%	➖ noise
0	duckdb:vortex-compact	+22.8%	+9.8%	+11.8%	+42.7%	➖ noise
0	duckdb:vortex-file-compressed	+2.9%	+9.8%	-6.3%	+34.2%	➖ noise
1	datafusion:vortex-compact	+22.7%	+10.3%	+11.3%	+69.9%	➖ noise
1	datafusion:vortex-file-compressed	+6.2%	+10.3%	-3.7%	+62.0%	➖ noise
1	duckdb:vortex-compact	-5.1%	+10.3%	-13.9%	+30.0%	➖ noise
1	duckdb:vortex-file-compressed	+5.5%	+10.3%	-4.4%	+30.0%	➖ noise
2	datafusion:vortex-compact	+3.7%	+10.7%	-6.3%	+30.0%	➖ noise
2	datafusion:vortex-file-compressed	+3.9%	+10.7%	-6.1%	+30.0%	➖ noise
2	duckdb:vortex-compact	+5.1%	+10.7%	-5.0%	+30.0%	➖ noise
2	duckdb:vortex-file-compressed	+33.6%	+10.7%	+20.7%	+30.0%	➖ noise
3	datafusion:vortex-compact	-0.1%	+8.6%	-8.0%	+30.0%	➖ noise
3	datafusion:vortex-file-compressed	+1.6%	+8.6%	-6.5%	+30.0%	➖ noise
3	duckdb:vortex-compact	-0.1%	+8.6%	-8.0%	+30.0%	➖ noise
3	duckdb:vortex-file-compressed	+5.6%	+8.6%	-2.8%	+30.0%	➖ noise
4	datafusion:vortex-compact	+0.8%	+11.4%	-9.5%	+30.0%	➖ noise
4	datafusion:vortex-file-compressed	-0.5%	+11.4%	-10.8%	+30.0%	➖ noise
4	duckdb:vortex-compact	+2.7%	+11.4%	-7.8%	+30.0%	➖ noise
4	duckdb:vortex-file-compressed	+5.4%	+11.4%	-5.4%	+30.0%	➖ noise
5	datafusion:vortex-compact	-0.0%	+6.4%	-6.0%	+30.0%	➖ noise
5	datafusion:vortex-file-compressed	-0.6%	+6.4%	-6.6%	+30.0%	➖ noise
5	duckdb:vortex-compact	-1.1%	+6.4%	-7.0%	+30.0%	➖ noise
5	duckdb:vortex-file-compressed	+2.4%	+6.4%	-3.7%	+30.0%	➖ noise
6	datafusion:vortex-compact	+1.0%	+12.5%	-10.2%	+30.0%	➖ noise
6	datafusion:vortex-file-compressed	-3.1%	+12.5%	-13.9%	+30.0%	➖ noise
6	duckdb:vortex-compact	+7.6%	+12.5%	-4.4%	+30.0%	➖ noise
6	duckdb:vortex-file-compressed	+1.1%	+12.5%	-10.2%	+30.0%	➖ noise
7	datafusion:vortex-compact	-2.6%	+4.0%	-6.3%	+30.0%	➖ noise
7	datafusion:vortex-file-compressed	-3.0%	+4.0%	-6.7%	+30.0%	➖ noise
7	duckdb:vortex-compact	+2.4%	+4.0%	-1.5%	+30.0%	➖ noise
7	duckdb:vortex-file-compressed	-5.0%	+4.0%	-8.6%	+30.0%	➖ noise
8	datafusion:vortex-compact	-3.5%	+12.2%	-14.0%	+30.0%	➖ noise
8	datafusion:vortex-file-compressed	-2.2%	+12.2%	-12.9%	+30.0%	➖ noise
8	duckdb:vortex-compact	+10.7%	+12.2%	-1.3%	+30.0%	➖ noise
8	duckdb:vortex-file-compressed	-1.9%	+12.2%	-12.6%	+30.0%	➖ noise

[github-actions]

Benchmarks: TPC-H SF=10 on S3

Summary

• Overall: 1.014x ➖
• Vortex: 1.026x ➖
• Parquet: 0.990x ➖

Verdict

No clear signal

• Attributed Vortex impact: +3.7%
• Confidence: environment too noisy
• Environment shift: -1.0%

Statistical Summary

• Systemic shift (parquet controls): -1.0%
• Control sigma: +9.8%
• Residual noise: +6.9%
• Median polish overall: +0.5%

datafusion / vortex-file-compressed (0.980x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	724607435	767401722	0.94
tpch_q02/datafusion:vortex-file-compressed	885652530	799957368	1.11
tpch_q03/datafusion:vortex-file-compressed	812959913	797148740	1.02
tpch_q04/datafusion:vortex-file-compressed	594747472	628179876	0.95
tpch_q05/datafusion:vortex-file-compressed	1033002107	1109573823	0.93
tpch_q06/datafusion:vortex-file-compressed	590773990	620228424	0.95
tpch_q07/datafusion:vortex-file-compressed	1125414720	1140186680	0.99
tpch_q08/datafusion:vortex-file-compressed	1390049829	1201587652	1.16
tpch_q09/datafusion:vortex-file-compressed	1450708486	1478324879	0.98
tpch_q10/datafusion:vortex-file-compressed	995768246	1030496001	0.97
tpch_q11/datafusion:vortex-file-compressed	574096791	475997894	1.21
tpch_q12/datafusion:vortex-file-compressed	863802283	1059815791	0.82
tpch_q13/datafusion:vortex-file-compressed	446373698	539821999	0.83
tpch_q14/datafusion:vortex-file-compressed	613216581	607014576	1.01
tpch_q15/datafusion:vortex-file-compressed	1019237201	1128102964	0.90
tpch_q16/datafusion:vortex-file-compressed	294503867	279226710	1.05
tpch_q17/datafusion:vortex-file-compressed	1175696024	1244644378	0.94
tpch_q18/datafusion:vortex-file-compressed	1313529391	1317021495	1.00
tpch_q19/datafusion:vortex-file-compressed	693315314	730080520	0.95
tpch_q20/datafusion:vortex-file-compressed	1008758186	956498095	1.05
tpch_q21/datafusion:vortex-file-compressed	1832728222	1644035738	1.11
tpch_q22/datafusion:vortex-file-compressed	344313134	428038576	0.80

datafusion / vortex-compact (1.088x ➖, 1↑ 2↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	709164101	717395374	0.99
tpch_q02/datafusion:vortex-compact	604701173	638558707	0.95
tpch_q03/datafusion:vortex-compact	704230639	674477155	1.04
tpch_q04/datafusion:vortex-compact	586245632	549436420	1.07
tpch_q05/datafusion:vortex-compact	1002448283	982053562	1.02
tpch_q06/datafusion:vortex-compact	589035454	593125704	0.99
tpch_q07/datafusion:vortex-compact	1138338029	1240024449	0.92
tpch_q08/datafusion:vortex-compact 🚨	3756271244	1167247531	3.22
tpch_q09/datafusion:vortex-compact	1384889518	1315860510	1.05
tpch_q10/datafusion:vortex-compact 🚨	2475843047	932137907	2.66
tpch_q11/datafusion:vortex-compact	452692611	442937415	1.02
tpch_q12/datafusion:vortex-compact	921837831	810946333	1.14
tpch_q13/datafusion:vortex-compact	403129239	393075670	1.03
tpch_q14/datafusion:vortex-compact	613743668	579366170	1.06
tpch_q15/datafusion:vortex-compact	1008677072	1052025298	0.96
tpch_q16/datafusion:vortex-compact	339155666	334211129	1.01
tpch_q17/datafusion:vortex-compact	1195035016	1181389672	1.01
tpch_q18/datafusion:vortex-compact	1214453183	1196320724	1.02
tpch_q19/datafusion:vortex-compact	627810533	719319451	0.87
tpch_q20/datafusion:vortex-compact	880660391	847768250	1.04
tpch_q21/datafusion:vortex-compact	1485609610	1569044502	0.95
tpch_q22/datafusion:vortex-compact 🚀	352078608	520931060	0.68

datafusion / parquet (0.967x ➖, 2↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	937303257	875884329	1.07
tpch_q02/datafusion:parquet	844573164	683894374	1.23
tpch_q03/datafusion:parquet	984499112	1193439829	0.82
tpch_q04/datafusion:parquet 🚀	474142503	716761239	0.66
tpch_q05/datafusion:parquet	1223433085	1302653704	0.94
tpch_q06/datafusion:parquet	520457897	595179631	0.87
tpch_q07/datafusion:parquet	1427327826	1395323327	1.02
tpch_q08/datafusion:parquet	1669722210	1783612990	0.94
tpch_q09/datafusion:parquet	2002202988	1991121223	1.01
tpch_q10/datafusion:parquet	2154134643	2315453755	0.93
tpch_q11/datafusion:parquet	667894349	781174271	0.85
tpch_q12/datafusion:parquet	806742125	794766042	1.02
tpch_q13/datafusion:parquet	775398046	687648974	1.13
tpch_q14/datafusion:parquet	899131269	800859080	1.12
tpch_q15/datafusion:parquet	1451153747	1185759475	1.22
tpch_q16/datafusion:parquet	441841624	478094647	0.92
tpch_q17/datafusion:parquet	1519502814	1498933871	1.01
tpch_q18/datafusion:parquet	1650478669	1592184805	1.04
tpch_q19/datafusion:parquet	1029236645	947629579	1.09
tpch_q20/datafusion:parquet	1273712106	1185341918	1.07
tpch_q21/datafusion:parquet	1701488530	1789484493	0.95
tpch_q22/datafusion:parquet 🚀	668113309	1081492689	0.62

duckdb / vortex-file-compressed (1.034x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	615145214	602359691	1.02
tpch_q02/duckdb:vortex-file-compressed	1091033927	1073843756	1.02
tpch_q03/duckdb:vortex-file-compressed	866669886	961648500	0.90
tpch_q04/duckdb:vortex-file-compressed	644412874	604883426	1.07
tpch_q05/duckdb:vortex-file-compressed	1186297881	1066713541	1.11
tpch_q06/duckdb:vortex-file-compressed	870622040	763642882	1.14
tpch_q07/duckdb:vortex-file-compressed	1018132301	1016253362	1.00
tpch_q08/duckdb:vortex-file-compressed	1406187069	1314353540	1.07
tpch_q09/duckdb:vortex-file-compressed	1353929830	1407605285	0.96
tpch_q10/duckdb:vortex-file-compressed	1253115677	1129439084	1.11
tpch_q11/duckdb:vortex-file-compressed	675551703	721901390	0.94
tpch_q12/duckdb:vortex-file-compressed	834917875	681286626	1.23
tpch_q13/duckdb:vortex-file-compressed	1034642468	995512255	1.04
tpch_q14/duckdb:vortex-file-compressed	971211446	868304158	1.12
tpch_q15/duckdb:vortex-file-compressed	557456116	554974251	1.00
tpch_q16/duckdb:vortex-file-compressed	466275955	401865389	1.16
tpch_q17/duckdb:vortex-file-compressed	974878264	980660750	0.99
tpch_q18/duckdb:vortex-file-compressed	935791900	900670329	1.04
tpch_q19/duckdb:vortex-file-compressed	744454992	804554384	0.93
tpch_q20/duckdb:vortex-file-compressed	1125605534	1150773040	0.98
tpch_q21/duckdb:vortex-file-compressed	1846833867	1875191317	0.98
tpch_q22/duckdb:vortex-file-compressed	572221814	566769449	1.01

duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	596956850	625322971	0.95
tpch_q02/duckdb:vortex-compact	1059009489	1115916903	0.95
tpch_q03/duckdb:vortex-compact	810061555	825408218	0.98
tpch_q04/duckdb:vortex-compact	489890740	496821347	0.99
tpch_q05/duckdb:vortex-compact	967959140	1046816244	0.92
tpch_q06/duckdb:vortex-compact	695346440	681792961	1.02
tpch_q07/duckdb:vortex-compact	1086902549	1152704388	0.94
tpch_q08/duckdb:vortex-compact	1273331220	1365924125	0.93
tpch_q09/duckdb:vortex-compact	1261171546	1290473280	0.98
tpch_q10/duckdb:vortex-compact	1077218994	905963959	1.19
tpch_q11/duckdb:vortex-compact	774992079	709123615	1.09
tpch_q12/duckdb:vortex-compact	656952883	648785113	1.01
tpch_q13/duckdb:vortex-compact	1018164456	849261970	1.20
tpch_q14/duckdb:vortex-compact	860679102	864308225	1.00
tpch_q15/duckdb:vortex-compact	564189892	532548688	1.06
tpch_q16/duckdb:vortex-compact	391454748	432569620	0.90
tpch_q17/duckdb:vortex-compact	920627879	930642906	0.99
tpch_q18/duckdb:vortex-compact	766827583	656052640	1.17
tpch_q19/duckdb:vortex-compact	768105528	708010084	1.08
tpch_q20/duckdb:vortex-compact	1115686037	1165487890	0.96
tpch_q21/duckdb:vortex-compact	1586067560	1689573437	0.94
tpch_q22/duckdb:vortex-compact	579368962	629810140	0.92

duckdb / parquet (1.013x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	953398441	874751453	1.09
tpch_q02/duckdb:parquet	1539363042	1498957615	1.03
tpch_q03/duckdb:parquet	1467475410	1522257607	0.96
tpch_q04/duckdb:parquet	975632732	945328691	1.03
tpch_q05/duckdb:parquet	1964174543	2035023606	0.97
tpch_q06/duckdb:parquet	737711772	739007933	1.00
tpch_q07/duckdb:parquet	1722153837	1564355995	1.10
tpch_q08/duckdb:parquet	2327417199	2307279209	1.01
tpch_q09/duckdb:parquet	2156268313	2256829063	0.96
tpch_q10/duckdb:parquet	3118401259	3032822451	1.03
tpch_q11/duckdb:parquet	934713719	966942116	0.97
tpch_q12/duckdb:parquet	968069949	1013976574	0.95
tpch_q13/duckdb:parquet	1225306077	1158348427	1.06
tpch_q14/duckdb:parquet	1204252189	1238656360	0.97
tpch_q15/duckdb:parquet	893231591	835264920	1.07
tpch_q16/duckdb:parquet	719720063	719401710	1.00
tpch_q17/duckdb:parquet	1139284392	1173488775	0.97
tpch_q18/duckdb:parquet	1328840956	1405069428	0.95
tpch_q19/duckdb:parquet	1406734110	1395808383	1.01
tpch_q20/duckdb:parquet	1881614618	1589500068	1.18
tpch_q21/duckdb:parquet	1828811816	1887047691	0.97
tpch_q22/duckdb:parquet	1077239803	1026690970	1.05

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	-1.1%	+8.0%	-8.5%	+61.6%	➖ noise
1	datafusion:vortex-file-compressed	-5.6%	+8.0%	-12.6%	+86.3%	➖ noise
1	duckdb:vortex-compact	-4.5%	+8.0%	-11.6%	+40.1%	➖ noise
1	duckdb:vortex-file-compressed	+2.1%	+8.0%	-5.4%	+31.0%	➖ noise
2	datafusion:vortex-compact	-5.3%	+12.6%	-15.9%	+62.9%	➖ noise
2	datafusion:vortex-file-compressed	+10.7%	+12.6%	-1.7%	+37.5%	➖ noise
2	duckdb:vortex-compact	-5.1%	+12.6%	-15.7%	+44.9%	➖ noise
2	duckdb:vortex-file-compressed	+1.6%	+12.6%	-9.8%	+34.0%	➖ noise
3	datafusion:vortex-compact	+4.4%	-10.8%	+17.1%	+86.6%	➖ noise
3	datafusion:vortex-file-compressed	+2.0%	-10.8%	+14.4%	+92.0%	➖ noise
3	duckdb:vortex-compact	-1.9%	-10.8%	+10.1%	+56.0%	➖ noise
3	duckdb:vortex-file-compressed	-9.9%	-10.8%	+1.1%	+49.2%	➖ noise
4	datafusion:vortex-compact	+6.7%	-17.4%	+29.1%	+31.1%	➖ noise
4	datafusion:vortex-file-compressed	-5.3%	-17.4%	+14.6%	+35.7%	➖ noise
4	duckdb:vortex-compact	-1.4%	-17.4%	+19.3%	+32.3%	➖ noise
4	duckdb:vortex-file-compressed	+6.5%	-17.4%	+28.9%	+33.4%	➖ noise
5	datafusion:vortex-compact	+2.1%	-4.8%	+7.2%	+30.0%	➖ noise
5	datafusion:vortex-file-compressed	-6.9%	-4.8%	-2.2%	+30.0%	➖ noise
5	duckdb:vortex-compact	-7.5%	-4.8%	-2.9%	+30.0%	➖ noise
5	duckdb:vortex-file-compressed	+11.2%	-4.8%	+16.8%	+30.0%	➖ noise
6	datafusion:vortex-compact	-0.7%	-6.6%	+6.3%	+30.0%	➖ noise
6	datafusion:vortex-file-compressed	-4.7%	-6.6%	+1.9%	+30.0%	➖ noise
6	duckdb:vortex-compact	+2.0%	-6.6%	+9.2%	+30.0%	➖ noise
6	duckdb:vortex-file-compressed	+14.0%	-6.6%	+22.0%	+31.4%	➖ noise
7	datafusion:vortex-compact	-8.2%	+6.1%	-13.5%	+30.0%	➖ noise
7	datafusion:vortex-file-compressed	-1.3%	+6.1%	-7.0%	+30.0%	➖ noise
7	duckdb:vortex-compact	-5.7%	+6.1%	-11.1%	+30.0%	➖ noise
7	duckdb:vortex-file-compressed	+0.2%	+6.1%	-5.6%	+30.0%	➖ noise
8	datafusion:vortex-compact	+221.8%	-2.8%	+231.2%	+108.8%	🚨 regression
8	datafusion:vortex-file-compressed	+15.7%	-2.8%	+19.0%	+30.0%	➖ noise
8	duckdb:vortex-compact	-6.8%	-2.8%	-4.1%	+30.0%	➖ noise
8	duckdb:vortex-file-compressed	+7.0%	-2.8%	+10.1%	+30.0%	➖ noise
9	datafusion:vortex-compact	+5.2%	-2.0%	+7.4%	+39.1%	➖ noise
9	datafusion:vortex-file-compressed	-1.9%	-2.0%	+0.1%	+30.0%	➖ noise
9	duckdb:vortex-compact	-2.3%	-2.0%	-0.3%	+30.0%	➖ noise
9	duckdb:vortex-file-compressed	-3.8%	-2.0%	-1.9%	+30.0%	➖ noise
10	datafusion:vortex-compact	+165.6%	-2.2%	+171.6%	+49.0%	🚨 regression
10	datafusion:vortex-file-compressed	-3.4%	-2.2%	-1.2%	+30.0%	➖ noise
10	duckdb:vortex-compact	+18.9%	-2.2%	+21.6%	+42.6%	➖ noise
10	duckdb:vortex-file-compressed	+11.0%	-2.2%	+13.4%	+45.4%	➖ noise
11	datafusion:vortex-compact	+2.2%	-9.1%	+12.4%	+30.0%	➖ noise
11	datafusion:vortex-file-compressed	+20.6%	-9.1%	+32.7%	+43.4%	➖ noise
11	duckdb:vortex-compact	+9.3%	-9.1%	+20.2%	+30.0%	➖ noise
11	duckdb:vortex-file-compressed	-6.4%	-9.1%	+2.9%	+30.0%	➖ noise
12	datafusion:vortex-compact	+13.7%	-1.6%	+15.5%	+30.0%	➖ noise
12	datafusion:vortex-file-compressed	-18.5%	-1.6%	-17.2%	+36.3%	➖ noise
12	duckdb:vortex-compact	+1.3%	-1.6%	+2.9%	+69.8%	➖ noise
12	duckdb:vortex-file-compressed	+22.6%	-1.6%	+24.5%	+30.0%	➖ noise
13	datafusion:vortex-compact	+2.6%	+9.2%	-6.1%	+34.8%	➖ noise
13	datafusion:vortex-file-compressed	-17.3%	+9.2%	-24.3%	+50.6%	➖ noise
13	duckdb:vortex-compact	+19.9%	+9.2%	+9.8%	+51.7%	➖ noise
13	duckdb:vortex-file-compressed	+3.9%	+9.2%	-4.8%	+52.4%	➖ noise
14	datafusion:vortex-compact	+5.9%	+4.5%	+1.4%	+30.0%	➖ noise
14	datafusion:vortex-file-compressed	+1.0%	+4.5%	-3.3%	+30.0%	➖ noise
14	duckdb:vortex-compact	-0.4%	+4.5%	-4.7%	+30.0%	➖ noise
14	duckdb:vortex-file-compressed	+11.9%	+4.5%	+7.1%	+30.0%	➖ noise
15	datafusion:vortex-compact	-4.1%	+14.4%	-16.2%	+30.0%	➖ noise
15	datafusion:vortex-file-compressed	-9.7%	+14.4%	-21.0%	+30.0%	➖ noise
15	duckdb:vortex-compact	+5.9%	+14.4%	-7.4%	+30.0%	➖ noise
15	duckdb:vortex-file-compressed	+0.4%	+14.4%	-12.2%	+30.0%	➖ noise
16	datafusion:vortex-compact	+1.5%	-3.8%	+5.5%	+30.0%	➖ noise
16	datafusion:vortex-file-compressed	+5.5%	-3.8%	+9.7%	+51.4%	➖ noise
16	duckdb:vortex-compact	-9.5%	-3.8%	-5.9%	+30.7%	➖ noise
16	duckdb:vortex-file-compressed	+16.0%	-3.8%	+20.7%	+30.0%	➖ noise
17	datafusion:vortex-compact	+1.2%	-0.8%	+2.0%	+30.0%	➖ noise
17	datafusion:vortex-file-compressed	-5.5%	-0.8%	-4.8%	+30.0%	➖ noise
17	duckdb:vortex-compact	-1.1%	-0.8%	-0.3%	+30.0%	➖ noise
17	duckdb:vortex-file-compressed	-0.6%	-0.8%	+0.2%	+30.0%	➖ noise
18	datafusion:vortex-compact	+1.5%	-1.0%	+2.5%	+30.0%	➖ noise
18	datafusion:vortex-file-compressed	-0.3%	-1.0%	+0.7%	+30.0%	➖ noise
18	duckdb:vortex-compact	+16.9%	-1.0%	+18.0%	+30.0%	➖ noise
18	duckdb:vortex-file-compressed	+3.9%	-1.0%	+4.9%	+30.0%	➖ noise
19	datafusion:vortex-compact	-12.7%	+4.6%	-16.6%	+30.0%	➖ noise
19	datafusion:vortex-file-compressed	-5.0%	+4.6%	-9.2%	+30.0%	➖ noise
19	duckdb:vortex-compact	+8.5%	+4.6%	+3.7%	+30.0%	➖ noise
19	duckdb:vortex-file-compressed	-7.5%	+4.6%	-11.6%	+30.0%	➖ noise
20	datafusion:vortex-compact	+3.9%	+12.8%	-7.9%	+30.0%	➖ noise
20	datafusion:vortex-file-compressed	+5.5%	+12.8%	-6.5%	+30.0%	➖ noise
20	duckdb:vortex-compact	-4.3%	+12.8%	-15.1%	+30.0%	➖ noise
20	duckdb:vortex-file-compressed	-2.2%	+12.8%	-13.3%	+30.0%	➖ noise
21	datafusion:vortex-compact	-5.3%	-4.0%	-1.4%	+30.0%	➖ noise
21	datafusion:vortex-file-compressed	+11.5%	-4.0%	+16.1%	+30.0%	➖ noise
21	duckdb:vortex-compact	-6.1%	-4.0%	-2.2%	+30.0%	➖ noise
21	duckdb:vortex-file-compressed	-1.5%	-4.0%	+2.6%	+30.0%	➖ noise
22	datafusion:vortex-compact	-32.4%	-19.5%	-16.1%	+36.1%	➖ noise
22	datafusion:vortex-file-compressed	-19.6%	-19.5%	-0.1%	+70.9%	➖ noise
22	duckdb:vortex-compact	-8.0%	-19.5%	+14.3%	+30.0%	➖ noise
22	duckdb:vortex-file-compressed	+1.0%	-19.5%	+25.4%	+38.2%	➖ noise

[github-actions]

Benchmarks: Clickbench on NVME

Summary

• Overall: 1.035x ➖
• Vortex: 1.045x ➖
• Parquet: 1.029x ➖

Verdict

No clear signal

• Attributed Vortex impact: +1.0%
• Confidence: environment too noisy
• Environment shift: +2.9%

Statistical Summary

• Systemic shift (parquet controls): +2.9%
• Control sigma: +6.0%
• Residual noise: +2.5%
• Median polish overall: +0.5%

datafusion / vortex-file-compressed (1.103x ❌, 0↑ 17↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨	2461088	1721085	1.43
clickbench_q01/datafusion:vortex-file-compressed 🚨	16034851	13321860	1.20
clickbench_q02/datafusion:vortex-file-compressed 🚨	37868088	33302791	1.14
clickbench_q03/datafusion:vortex-file-compressed 🚨	45553011	35838964	1.27
clickbench_q04/datafusion:vortex-file-compressed 🚨	416495496	327913019	1.27
clickbench_q05/datafusion:vortex-file-compressed 🚨	437396512	316070566	1.38
clickbench_q06/datafusion:vortex-file-compressed 🚨	2637654	2346062	1.12
clickbench_q07/datafusion:vortex-file-compressed 🚨	24999107	19794170	1.26
clickbench_q08/datafusion:vortex-file-compressed 🚨	548972453	391210620	1.40
clickbench_q09/datafusion:vortex-file-compressed 🚨	829016235	583938734	1.42
clickbench_q10/datafusion:vortex-file-compressed 🚨	94845367	76448405	1.24
clickbench_q11/datafusion:vortex-file-compressed 🚨	106172580	83722522	1.27
clickbench_q12/datafusion:vortex-file-compressed 🚨	393240976	272370878	1.44
clickbench_q13/datafusion:vortex-file-compressed 🚨	592502517	415644879	1.43
clickbench_q14/datafusion:vortex-file-compressed 🚨	347261053	253231154	1.37
clickbench_q15/datafusion:vortex-file-compressed 🚨	449461402	379665958	1.18
clickbench_q16/datafusion:vortex-file-compressed 🚨	810203276	728491294	1.11
clickbench_q17/datafusion:vortex-file-compressed	767972922	732628199	1.05
clickbench_q18/datafusion:vortex-file-compressed	1569019859	1437218177	1.09
clickbench_q19/datafusion:vortex-file-compressed	23699921	25265899	0.94
clickbench_q20/datafusion:vortex-file-compressed	352815708	338934820	1.04
clickbench_q21/datafusion:vortex-file-compressed	413972887	395645021	1.05
clickbench_q22/datafusion:vortex-file-compressed	569515768	558190458	1.02
clickbench_q23/datafusion:vortex-file-compressed	656452281	635432983	1.03
clickbench_q24/datafusion:vortex-file-compressed	44049977	48032359	0.92
clickbench_q25/datafusion:vortex-file-compressed	70160488	69175874	1.01
clickbench_q26/datafusion:vortex-file-compressed	49617987	50525111	0.98
clickbench_q27/datafusion:vortex-file-compressed	821815350	796017890	1.03
clickbench_q28/datafusion:vortex-file-compressed	6759943449	6821241989	0.99
clickbench_q29/datafusion:vortex-file-compressed	235846328	245496686	0.96
clickbench_q30/datafusion:vortex-file-compressed	256424065	254567176	1.01
clickbench_q31/datafusion:vortex-file-compressed	291940301	292163071	1.00
clickbench_q32/datafusion:vortex-file-compressed	1229404824	1266288826	0.97
clickbench_q33/datafusion:vortex-file-compressed	1414848128	1433180193	0.99
clickbench_q34/datafusion:vortex-file-compressed	1407021930	1414755953	0.99
clickbench_q35/datafusion:vortex-file-compressed	523191827	532109030	0.98
clickbench_q36/datafusion:vortex-file-compressed	79646715	78996661	1.01
clickbench_q37/datafusion:vortex-file-compressed	38192011	38598754	0.99
clickbench_q38/datafusion:vortex-file-compressed	24061021	24294276	0.99
clickbench_q39/datafusion:vortex-file-compressed	152010709	153688343	0.99
clickbench_q40/datafusion:vortex-file-compressed	19553346	20644830	0.95
clickbench_q41/datafusion:vortex-file-compressed	18334135	18861964	0.97
clickbench_q42/datafusion:vortex-file-compressed	22753946	22389509	1.02

datafusion / parquet (1.065x ➖, 0↑ 12↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
clickbench_q00/datafusion:parquet	1747841	1930792	0.91
clickbench_q01/datafusion:parquet	21702017	21057243	1.03
clickbench_q02/datafusion:parquet	49011752	49933135	0.98
clickbench_q03/datafusion:parquet	40224862	43281315	0.93
clickbench_q04/datafusion:parquet	344756940	359383082	0.96
clickbench_q05/datafusion:parquet	388737036	378614000	1.03
clickbench_q06/datafusion:parquet	1645026	1601770	1.03
clickbench_q07/datafusion:parquet	27420676	27910768	0.98
clickbench_q08/datafusion:parquet	426866396	418949935	1.02
clickbench_q09/datafusion:parquet	660466085	666517656	0.99
clickbench_q10/datafusion:parquet	116472243	117668756	0.99
clickbench_q11/datafusion:parquet	148341862	145618707	1.02
clickbench_q12/datafusion:parquet	376207458	373322274	1.01
clickbench_q13/datafusion:parquet	524341585	528772571	0.99
clickbench_q14/datafusion:parquet	381495776	381392329	1.00
clickbench_q15/datafusion:parquet	402947585	402566687	1.00
clickbench_q16/datafusion:parquet	760387996	732189511	1.04
clickbench_q17/datafusion:parquet	742363713	727602679	1.02
clickbench_q18/datafusion:parquet	1544613056	1693478354	0.91
clickbench_q19/datafusion:parquet 🚨	42667267	35725939	1.19
clickbench_q20/datafusion:parquet	618186642	616125863	1.00
clickbench_q21/datafusion:parquet	685672265	676803723	1.01
clickbench_q22/datafusion:parquet	1007672499	980318715	1.03
clickbench_q23/datafusion:parquet	3795017177	3795432941	1.00
clickbench_q24/datafusion:parquet	101615727	95618630	1.06
clickbench_q25/datafusion:parquet	153726895	151526727	1.01
clickbench_q26/datafusion:parquet	99417864	94986590	1.05
clickbench_q27/datafusion:parquet	1071816025	1059707811	1.01
clickbench_q28/datafusion:parquet	6448496744	6623334451	0.97
clickbench_q29/datafusion:parquet	246974679	244129009	1.01
clickbench_q30/datafusion:parquet	382305055	384896783	0.99
clickbench_q31/datafusion:parquet	412960197	412394750	1.00
clickbench_q32/datafusion:parquet 🚨	1408394614	1277552026	1.10
clickbench_q33/datafusion:parquet 🚨	1796425849	1575658706	1.14
clickbench_q34/datafusion:parquet 🚨	2136059116	1551124301	1.38
clickbench_q35/datafusion:parquet 🚨	788319996	550395961	1.43
clickbench_q36/datafusion:parquet 🚨	204152206	146184997	1.40
clickbench_q37/datafusion:parquet 🚨	75998600	59672078	1.27
clickbench_q38/datafusion:parquet 🚨	117208938	99735353	1.18
clickbench_q39/datafusion:parquet 🚨	371341288	283396685	1.31
clickbench_q40/datafusion:parquet 🚨	45843147	35891007	1.28
clickbench_q41/datafusion:parquet 🚨	37895378	30667101	1.24
clickbench_q42/datafusion:parquet 🚨	39074207	32136473	1.22

duckdb / vortex-file-compressed (0.990x ➖, 6↑ 1↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed	5986404	6056617	0.99
clickbench_q01/duckdb:vortex-file-compressed	13481170	13726193	0.98
clickbench_q02/duckdb:vortex-file-compressed	24404463	23844711	1.02
clickbench_q03/duckdb:vortex-file-compressed	30745495	29983975	1.03
clickbench_q04/duckdb:vortex-file-compressed	170336073	174748096	0.97
clickbench_q05/duckdb:vortex-file-compressed	199164626	200281453	0.99
clickbench_q06/duckdb:vortex-file-compressed	19426387	19154948	1.01
clickbench_q07/duckdb:vortex-file-compressed	17450056	15939751	1.09
clickbench_q08/duckdb:vortex-file-compressed	262147289	265945358	0.99
clickbench_q09/duckdb:vortex-file-compressed	375740881	376764569	1.00
clickbench_q10/duckdb:vortex-file-compressed	72856790	75103927	0.97
clickbench_q11/duckdb:vortex-file-compressed	80421581	82322719	0.98
clickbench_q12/duckdb:vortex-file-compressed	217956595	215262328	1.01
clickbench_q13/duckdb:vortex-file-compressed	434563228	438319742	0.99
clickbench_q14/duckdb:vortex-file-compressed	239575767	240689505	1.00
clickbench_q15/duckdb:vortex-file-compressed	219689651	215780006	1.02
clickbench_q16/duckdb:vortex-file-compressed	680463836	659440107	1.03
clickbench_q17/duckdb:vortex-file-compressed	547119447	522723017	1.05
clickbench_q18/duckdb:vortex-file-compressed	1207368547	1169368246	1.03
clickbench_q19/duckdb:vortex-file-compressed	20656164	20951599	0.99
clickbench_q20/duckdb:vortex-file-compressed	349533855	355233556	0.98
clickbench_q21/duckdb:vortex-file-compressed	384900988	380717175	1.01
clickbench_q22/duckdb:vortex-file-compressed 🚀	610099024	705487735	0.86
clickbench_q23/duckdb:vortex-file-compressed 🚨	1033612173	671531817	1.54
clickbench_q24/duckdb:vortex-file-compressed	50810195	50530978	1.01
clickbench_q25/duckdb:vortex-file-compressed	72490056	67465710	1.07
clickbench_q26/duckdb:vortex-file-compressed	42357160	45685815	0.93
clickbench_q27/duckdb:vortex-file-compressed	510731191	519006640	0.98
clickbench_q28/duckdb:vortex-file-compressed	2977568258	2984033493	1.00
clickbench_q29/duckdb:vortex-file-compressed	27601248	28355637	0.97
clickbench_q30/duckdb:vortex-file-compressed	192122781	192809362	1.00
clickbench_q31/duckdb:vortex-file-compressed	269991633	271403886	0.99
clickbench_q32/duckdb:vortex-file-compressed	1279513269	1192210012	1.07
clickbench_q33/duckdb:vortex-file-compressed	1427655203	1405666088	1.02
clickbench_q34/duckdb:vortex-file-compressed	1488855450	1547296035	0.96
clickbench_q35/duckdb:vortex-file-compressed	367761716	371278273	0.99
clickbench_q36/duckdb:vortex-file-compressed 🚀	27903135	31672792	0.88
clickbench_q37/duckdb:vortex-file-compressed 🚀	19832781	23281327	0.85
clickbench_q38/duckdb:vortex-file-compressed 🚀	20734178	24485411	0.85
clickbench_q39/duckdb:vortex-file-compressed	44648276	44281804	1.01
clickbench_q40/duckdb:vortex-file-compressed 🚀	19295066	22087095	0.87
clickbench_q41/duckdb:vortex-file-compressed	19914630	21666184	0.92
clickbench_q42/duckdb:vortex-file-compressed 🚀	23001468	26858456	0.86

duckdb / parquet (0.994x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
clickbench_q00/duckdb:parquet	218837798	223131015	0.98
clickbench_q01/duckdb:parquet	50972079	51328354	0.99
clickbench_q02/duckdb:parquet	66055667	66331152	1.00
clickbench_q03/duckdb:parquet	62718232	64617441	0.97
clickbench_q04/duckdb:parquet	204103858	204572511	1.00
clickbench_q05/duckdb:parquet	278264889	282949699	0.98
clickbench_q06/duckdb:parquet	61125460	60513441	1.01
clickbench_q07/duckdb:parquet	52491506	51179788	1.03
clickbench_q08/duckdb:parquet	270603440	270898369	1.00
clickbench_q09/duckdb:parquet	398657791	396338400	1.01
clickbench_q10/duckdb:parquet	96346936	95914308	1.00
clickbench_q11/duckdb:parquet	109276838	107687456	1.01
clickbench_q12/duckdb:parquet	294887872	297257198	0.99
clickbench_q13/duckdb:parquet	517064439	511294993	1.01
clickbench_q14/duckdb:parquet	326817257	332126829	0.98
clickbench_q15/duckdb:parquet	240489287	241648398	1.00
clickbench_q16/duckdb:parquet	611867181	613735083	1.00
clickbench_q17/duckdb:parquet	512848526	511336416	1.00
clickbench_q18/duckdb:parquet	1057733016	1060721656	1.00
clickbench_q19/duckdb:parquet	49380879	49864379	0.99
clickbench_q20/duckdb:parquet	429872995	441217267	0.97
clickbench_q21/duckdb:parquet	554688810	558322278	0.99
clickbench_q22/duckdb:parquet	928161447	928744462	1.00
clickbench_q23/duckdb:parquet	314794842	320728034	0.98
clickbench_q24/duckdb:parquet	79311904	78869315	1.01
clickbench_q25/duckdb:parquet	140484229	141970696	0.99
clickbench_q26/duckdb:parquet	52491519	52077872	1.01
clickbench_q27/duckdb:parquet	644273022	642160849	1.00
clickbench_q28/duckdb:parquet	4833936428	4829385673	1.00
clickbench_q29/duckdb:parquet	60764253	62009420	0.98
clickbench_q30/duckdb:parquet	304298734	306502338	0.99
clickbench_q31/duckdb:parquet	351760589	347517613	1.01
clickbench_q32/duckdb:parquet	1165762173	1181545230	0.99
clickbench_q33/duckdb:parquet	1250044281	1308878346	0.96
clickbench_q34/duckdb:parquet	1302825330	1311368449	0.99
clickbench_q35/duckdb:parquet	354688097	354613228	1.00
clickbench_q36/duckdb:parquet	64376875	63788330	1.01
clickbench_q37/duckdb:parquet	52717489	53892505	0.98
clickbench_q38/duckdb:parquet	58385613	58525338	1.00
clickbench_q39/duckdb:parquet	97805691	98178621	1.00
clickbench_q40/duckdb:parquet	56301847	56432880	1.00
clickbench_q41/duckdb:parquet	59452400	59110856	1.01
clickbench_q42/duckdb:parquet	49685258	53172618	0.93

duckdb / duckdb (1.027x ➖, 0↑ 1↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
clickbench_q00/duckdb:duckdb	18980683	17654069	1.08
clickbench_q01/duckdb:duckdb	35117581	32989984	1.06
clickbench_q02/duckdb:duckdb	47836012	45364491	1.05
clickbench_q03/duckdb:duckdb	49593442	47009842	1.05
clickbench_q04/duckdb:duckdb	221709441	215379562	1.03
clickbench_q05/duckdb:duckdb	319746057	310684006	1.03
clickbench_q06/duckdb:duckdb	37546989	35457193	1.06
clickbench_q07/duckdb:duckdb	37396109	36024039	1.04
clickbench_q08/duckdb:duckdb	311695863	302242290	1.03
clickbench_q09/duckdb:duckdb	470057998	484304746	0.97
clickbench_q10/duckdb:duckdb	98464921	97054777	1.01
clickbench_q11/duckdb:duckdb	107662588	107442164	1.00
clickbench_q12/duckdb:duckdb	299405728	291078227	1.03
clickbench_q13/duckdb:duckdb	525525906	516136455	1.02
clickbench_q14/duckdb:duckdb	346193074	346967495	1.00
clickbench_q15/duckdb:duckdb	268182467	256508841	1.05
clickbench_q16/duckdb:duckdb	700733886	686264058	1.02
clickbench_q17/duckdb:duckdb	581283709	579654239	1.00
clickbench_q18/duckdb:duckdb	1259730440	1254415446	1.00
clickbench_q19/duckdb:duckdb	37168584	35315957	1.05
clickbench_q20/duckdb:duckdb 🚨	921087846	827103769	1.11
clickbench_q21/duckdb:duckdb	940363744	922796618	1.02
clickbench_q22/duckdb:duckdb	1042604406	1129489199	0.92
clickbench_q23/duckdb:duckdb	259794285	252556695	1.03
clickbench_q24/duckdb:duckdb	63129720	60796410	1.04
clickbench_q25/duckdb:duckdb	126172371	122623543	1.03
clickbench_q26/duckdb:duckdb	58752669	56442783	1.04
clickbench_q27/duckdb:duckdb	1056278788	1017936239	1.04
clickbench_q28/duckdb:duckdb	4679411742	4645688670	1.01
clickbench_q29/duckdb:duckdb	50831007	49139461	1.03
clickbench_q30/duckdb:duckdb	300772662	287210231	1.05
clickbench_q31/duckdb:duckdb	441342854	424668238	1.04
clickbench_q32/duckdb:duckdb	1435733301	1438366665	1.00
clickbench_q33/duckdb:duckdb	1873288188	1911631283	0.98
clickbench_q34/duckdb:duckdb	1973293522	2013783261	0.98
clickbench_q35/duckdb:duckdb	264742980	264349730	1.00
clickbench_q36/duckdb:duckdb	41272526	41522413	0.99
clickbench_q37/duckdb:duckdb	33426844	31349280	1.07
clickbench_q38/duckdb:duckdb	33582596	30898153	1.09
clickbench_q39/duckdb:duckdb	64340366	64978578	0.99
clickbench_q40/duckdb:duckdb	33225672	31493538	1.05
clickbench_q41/duckdb:duckdb	32120075	31027810	1.04
clickbench_q42/duckdb:duckdb	33528193	31596068	1.06

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-file-compressed	+43.0%	-5.8%	+51.8%	+693.2%	➖ noise
0	duckdb:duckdb	+7.5%	-5.8%	+14.1%	+298.9%	➖ noise
0	duckdb:vortex-file-compressed	-1.2%	-5.8%	+4.9%	+349.3%	➖ noise
1	datafusion:vortex-file-compressed	+20.4%	+1.2%	+19.0%	+34.5%	➖ noise
1	duckdb:duckdb	+6.4%	+1.2%	+5.2%	+59.4%	➖ noise
1	duckdb:vortex-file-compressed	-1.8%	+1.2%	-2.9%	+18.4%	➖ noise
2	datafusion:vortex-file-compressed	+13.7%	-1.1%	+15.0%	+29.5%	➖ noise
2	duckdb:duckdb	+5.4%	-1.1%	+6.7%	+23.7%	➖ noise
2	duckdb:vortex-file-compressed	+2.3%	-1.1%	+3.5%	+16.1%	➖ noise
3	datafusion:vortex-file-compressed	+27.1%	-5.0%	+33.8%	+165.1%	➖ noise
3	duckdb:duckdb	+5.5%	-5.0%	+11.1%	+54.3%	➖ noise
3	duckdb:vortex-file-compressed	+2.5%	-5.0%	+8.0%	+32.7%	➖ noise
4	datafusion:vortex-file-compressed	+27.0%	-2.2%	+29.8%	+16.1%	🚨 regression
4	duckdb:duckdb	+2.9%	-2.2%	+5.2%	+16.1%	➖ noise
4	duckdb:vortex-file-compressed	-2.5%	-2.2%	-0.4%	+16.1%	➖ noise
5	datafusion:vortex-file-compressed	+38.4%	+0.5%	+37.7%	+16.1%	🚨 regression
5	duckdb:duckdb	+2.9%	+0.5%	+2.4%	+16.1%	➖ noise
5	duckdb:vortex-file-compressed	-0.6%	+0.5%	-1.0%	+16.1%	➖ noise
6	datafusion:vortex-file-compressed	+12.4%	+1.9%	+10.4%	+28.2%	➖ noise
6	duckdb:duckdb	+5.9%	+1.9%	+4.0%	+30.1%	➖ noise
6	duckdb:vortex-file-compressed	+1.4%	+1.9%	-0.4%	+19.8%	➖ noise
7	datafusion:vortex-file-compressed	+26.3%	+0.4%	+25.8%	+16.1%	🚨 regression
7	duckdb:duckdb	+3.8%	+0.4%	+3.4%	+16.1%	➖ noise
7	duckdb:vortex-file-compressed	+9.5%	+0.4%	+9.1%	+16.1%	➖ noise
8	datafusion:vortex-file-compressed	+40.3%	+0.9%	+39.1%	+16.1%	🚨 regression
8	duckdb:duckdb	+3.1%	+0.9%	+2.2%	+16.1%	➖ noise
8	duckdb:vortex-file-compressed	-1.4%	+0.9%	-2.3%	+16.1%	➖ noise
9	datafusion:vortex-file-compressed	+42.0%	-0.2%	+42.2%	+16.1%	🚨 regression
9	duckdb:duckdb	-2.9%	-0.2%	-2.8%	+16.1%	➖ noise
9	duckdb:vortex-file-compressed	-0.3%	-0.2%	-0.1%	+16.1%	➖ noise
10	datafusion:vortex-file-compressed	+24.1%	-0.3%	+24.4%	+16.1%	🚨 regression
10	duckdb:duckdb	+1.5%	-0.3%	+1.7%	+16.1%	➖ noise
10	duckdb:vortex-file-compressed	-3.0%	-0.3%	-2.7%	+16.1%	➖ noise
11	datafusion:vortex-file-compressed	+26.8%	+1.7%	+24.7%	+16.1%	🚨 regression
11	duckdb:duckdb	+0.2%	+1.7%	-1.4%	+16.1%	➖ noise
11	duckdb:vortex-file-compressed	-2.3%	+1.7%	-3.9%	+16.1%	➖ noise
12	datafusion:vortex-file-compressed	+44.4%	-0.0%	+44.4%	+16.1%	🚨 regression
12	duckdb:duckdb	+2.9%	-0.0%	+2.9%	+16.1%	➖ noise
12	duckdb:vortex-file-compressed	+1.3%	-0.0%	+1.3%	+16.1%	➖ noise
13	datafusion:vortex-file-compressed	+42.6%	+0.1%	+42.4%	+16.1%	🚨 regression
13	duckdb:duckdb	+1.8%	+0.1%	+1.7%	+16.1%	➖ noise
13	duckdb:vortex-file-compressed	-0.9%	+0.1%	-1.0%	+16.1%	➖ noise
14	datafusion:vortex-file-compressed	+37.1%	-0.8%	+38.2%	+16.1%	🚨 regression
14	duckdb:duckdb	-0.2%	-0.8%	+0.6%	+16.1%	➖ noise
14	duckdb:vortex-file-compressed	-0.5%	-0.8%	+0.3%	+16.1%	➖ noise
15	datafusion:vortex-file-compressed	+18.4%	-0.2%	+18.6%	+16.1%	🚨 regression
15	duckdb:duckdb	+4.6%	-0.2%	+4.8%	+16.1%	➖ noise
15	duckdb:vortex-file-compressed	+1.8%	-0.2%	+2.0%	+16.1%	➖ noise
16	datafusion:vortex-file-compressed	+11.2%	+1.8%	+9.3%	+16.1%	➖ noise
16	duckdb:duckdb	+2.1%	+1.8%	+0.4%	+16.1%	➖ noise
16	duckdb:vortex-file-compressed	+3.2%	+1.8%	+1.4%	+16.1%	➖ noise
17	datafusion:vortex-file-compressed	+4.8%	+1.2%	+3.6%	+16.1%	➖ noise
17	duckdb:duckdb	+0.3%	+1.2%	-0.9%	+16.1%	➖ noise
17	duckdb:vortex-file-compressed	+4.7%	+1.2%	+3.5%	+16.1%	➖ noise
18	datafusion:vortex-file-compressed	+9.2%	-4.6%	+14.5%	+16.1%	➖ noise
18	duckdb:duckdb	+0.4%	-4.6%	+5.3%	+16.1%	➖ noise
18	duckdb:vortex-file-compressed	+3.2%	-4.6%	+8.3%	+16.1%	➖ noise
19	datafusion:vortex-file-compressed	-6.2%	+8.8%	-13.7%	+18.2%	➖ noise
19	duckdb:duckdb	+5.2%	+8.8%	-3.2%	+16.1%	➖ noise
19	duckdb:vortex-file-compressed	-1.4%	+8.8%	-9.3%	+40.1%	➖ noise
20	datafusion:vortex-file-compressed	+4.1%	-1.1%	+5.3%	+200.9%	➖ noise
20	duckdb:duckdb	+11.4%	-1.1%	+12.6%	+28.1%	➖ noise
20	duckdb:vortex-file-compressed	-1.6%	-1.1%	-0.5%	+16.1%	➖ noise
21	datafusion:vortex-file-compressed	+4.6%	+0.3%	+4.3%	+16.1%	➖ noise
21	duckdb:duckdb	+1.9%	+0.3%	+1.6%	+16.1%	➖ noise
21	duckdb:vortex-file-compressed	+1.1%	+0.3%	+0.8%	+16.1%	➖ noise
22	datafusion:vortex-file-compressed	+2.0%	+1.4%	+0.7%	+16.1%	➖ noise
22	duckdb:duckdb	-7.7%	+1.4%	-8.9%	+16.1%	➖ noise
22	duckdb:vortex-file-compressed	-13.5%	+1.4%	-14.7%	+19.6%	➖ noise
23	datafusion:vortex-file-compressed	+3.3%	-0.9%	+4.3%	+52.5%	➖ noise
23	duckdb:duckdb	+2.9%	-0.9%	+3.8%	+16.1%	➖ noise
23	duckdb:vortex-file-compressed	+53.9%	-0.9%	+55.4%	+18.6%	🚨 regression
24	datafusion:vortex-file-compressed	-8.3%	+3.4%	-11.3%	+16.1%	➖ noise
24	duckdb:duckdb	+3.8%	+3.4%	+0.4%	+16.1%	➖ noise
24	duckdb:vortex-file-compressed	+0.6%	+3.4%	-2.7%	+25.7%	➖ noise
25	datafusion:vortex-file-compressed	+1.4%	+0.2%	+1.2%	+16.1%	➖ noise
25	duckdb:duckdb	+2.9%	+0.2%	+2.7%	+16.1%	➖ noise
25	duckdb:vortex-file-compressed	+7.4%	+0.2%	+7.2%	+22.5%	➖ noise
26	datafusion:vortex-file-compressed	-1.8%	+2.7%	-4.4%	+16.1%	➖ noise
26	duckdb:duckdb	+4.1%	+2.7%	+1.3%	+16.1%	➖ noise
26	duckdb:vortex-file-compressed	-7.3%	+2.7%	-9.7%	+51.7%	➖ noise
27	datafusion:vortex-file-compressed	+3.2%	+0.7%	+2.5%	+16.1%	➖ noise
27	duckdb:duckdb	+3.8%	+0.7%	+3.0%	+16.1%	➖ noise
27	duckdb:vortex-file-compressed	-1.6%	+0.7%	-2.3%	+16.1%	➖ noise
28	datafusion:vortex-file-compressed	-0.9%	-1.3%	+0.4%	+16.1%	➖ noise
28	duckdb:duckdb	+0.7%	-1.3%	+2.0%	+16.1%	➖ noise
28	duckdb:vortex-file-compressed	-0.2%	-1.3%	+1.1%	+16.1%	➖ noise
29	datafusion:vortex-file-compressed	-3.9%	-0.4%	-3.5%	+16.1%	➖ noise
29	duckdb:duckdb	+3.4%	-0.4%	+3.9%	+16.1%	➖ noise
29	duckdb:vortex-file-compressed	-2.7%	-0.4%	-2.2%	+16.1%	➖ noise
30	datafusion:vortex-file-compressed	+0.7%	-0.7%	+1.4%	+16.1%	➖ noise
30	duckdb:duckdb	+4.7%	-0.7%	+5.5%	+16.1%	➖ noise
30	duckdb:vortex-file-compressed	-0.4%	-0.7%	+0.3%	+16.1%	➖ noise
31	datafusion:vortex-file-compressed	-0.1%	+0.7%	-0.7%	+16.1%	➖ noise
31	duckdb:duckdb	+3.9%	+0.7%	+3.2%	+16.1%	➖ noise
31	duckdb:vortex-file-compressed	-0.5%	+0.7%	-1.2%	+16.1%	➖ noise
32	datafusion:vortex-file-compressed	-2.9%	+4.3%	-6.9%	+17.1%	➖ noise
32	duckdb:duckdb	-0.2%	+4.3%	-4.3%	+16.1%	➖ noise
32	duckdb:vortex-file-compressed	+7.3%	+4.3%	+2.9%	+16.1%	➖ noise
33	datafusion:vortex-file-compressed	-1.3%	+4.3%	-5.4%	+16.1%	➖ noise
33	duckdb:duckdb	-2.0%	+4.3%	-6.1%	+16.1%	➖ noise
33	duckdb:vortex-file-compressed	+1.6%	+4.3%	-2.7%	+16.1%	➖ noise
34	datafusion:vortex-file-compressed	-0.5%	+17.0%	-15.0%	+16.1%	✅ faster
34	duckdb:duckdb	-2.0%	+17.0%	-16.2%	+16.1%	✅ faster
34	duckdb:vortex-file-compressed	-3.8%	+17.0%	-17.7%	+16.1%	✅ faster
35	datafusion:vortex-file-compressed	-1.7%	+19.7%	-17.9%	+16.1%	✅ faster
35	duckdb:duckdb	+0.1%	+19.7%	-16.3%	+16.1%	✅ faster
35	duckdb:vortex-file-compressed	-0.9%	+19.7%	-17.2%	+16.1%	✅ faster
36	datafusion:vortex-file-compressed	+0.8%	+18.7%	-15.1%	+16.1%	✅ faster
36	duckdb:duckdb	-0.6%	+18.7%	-16.3%	+16.1%	✅ faster
36	duckdb:vortex-file-compressed	-11.9%	+18.7%	-25.8%	+16.1%	✅ faster
37	datafusion:vortex-file-compressed	-1.1%	+11.6%	-11.4%	+16.1%	➖ noise
37	duckdb:duckdb	+6.6%	+11.6%	-4.5%	+16.1%	➖ noise
37	duckdb:vortex-file-compressed	-14.8%	+11.6%	-23.7%	+16.1%	✅ faster
38	datafusion:vortex-file-compressed	-1.0%	+8.3%	-8.5%	+16.1%	➖ noise
38	duckdb:duckdb	+8.7%	+8.3%	+0.4%	+16.1%	➖ noise
38	duckdb:vortex-file-compressed	-15.3%	+8.3%	-21.8%	+16.1%	✅ faster
39	datafusion:vortex-file-compressed	-1.1%	+14.3%	-13.4%	+16.1%	➖ noise
39	duckdb:duckdb	-1.0%	+14.3%	-13.3%	+20.2%	➖ noise
39	duckdb:vortex-file-compressed	+0.8%	+14.3%	-11.7%	+16.1%	➖ noise
40	datafusion:vortex-file-compressed	-5.3%	+12.9%	-16.1%	+16.1%	✅ faster
40	duckdb:duckdb	+5.5%	+12.9%	-6.5%	+16.1%	➖ noise
40	duckdb:vortex-file-compressed	-12.6%	+12.9%	-22.6%	+16.1%	✅ faster
41	datafusion:vortex-file-compressed	-2.8%	+11.5%	-12.8%	+16.1%	➖ noise
41	duckdb:duckdb	+3.5%	+11.5%	-7.1%	+16.1%	➖ noise
41	duckdb:vortex-file-compressed	-8.1%	+11.5%	-17.6%	+16.1%	✅ faster
42	datafusion:vortex-file-compressed	+1.6%	+6.6%	-4.7%	+16.1%	➖ noise
42	duckdb:duckdb	+6.1%	+6.6%	-0.4%	+16.1%	➖ noise
42	duckdb:vortex-file-compressed	-14.4%	+6.6%	-19.7%	+16.1%	✅ faster

[github-actions]

Benchmarks: Statistical and Population Genetics

Summary

• Overall: 1.017x ➖
• Vortex: 1.018x ➖
• Parquet: 1.016x ➖

Verdict

No clear signal

• Attributed Vortex impact: +0.2%
• Confidence: low
• Environment shift: +1.6%

Statistical Summary

• Systemic shift (parquet controls): +1.6%
• Control sigma: +2.4%
• Residual noise: +0.8%
• Median polish overall: +0.6%

duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 4b7207e (ns)	ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed	10906491	10764950	1.01
statpopgen_q01/duckdb:vortex-file-compressed	18565255	19139762	0.97
statpopgen_q02/duckdb:vortex-file-compressed	1286038298	1307596012	0.98
statpopgen_q03/duckdb:vortex-file-compressed	3043712431	3070616533	0.99
statpopgen_q04/duckdb:vortex-file-compressed	3067885533	3007614490	1.02
statpopgen_q05/duckdb:vortex-file-compressed	1392978959	1381134732	1.01
statpopgen_q06/duckdb:vortex-file-compressed	2057586456	2064769656	1.00
statpopgen_q07/duckdb:vortex-file-compressed	187924659	196887647	0.95
statpopgen_q08/duckdb:vortex-file-compressed	201508538	205435942	0.98
statpopgen_q09/duckdb:vortex-file-compressed	2862470554	2810564927	1.02
statpopgen_q10/duckdb:vortex-file-compressed	4599165174	4609921869	1.00

duckdb / vortex-compact (1.042x ➖, 0↑ 1↓)

name	PR 70c2e75 (ns)	base 4b7207e (ns)	ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact	10893529	10670906	1.02
statpopgen_q01/duckdb:vortex-compact 🚨	169017817	124124316	1.36
statpopgen_q02/duckdb:vortex-compact	1826302974	1795128598	1.02
statpopgen_q03/duckdb:vortex-compact	3491534345	3465036834	1.01
statpopgen_q04/duckdb:vortex-compact	3572070252	3497818474	1.02
statpopgen_q05/duckdb:vortex-compact	1869278000	1811742338	1.03
statpopgen_q06/duckdb:vortex-compact	2702154316	2666287198	1.01
statpopgen_q07/duckdb:vortex-compact	950748993	963189817	0.99
statpopgen_q08/duckdb:vortex-compact	994415636	1008317630	0.99
statpopgen_q09/duckdb:vortex-compact	3349543424	3244414949	1.03
statpopgen_q10/duckdb:vortex-compact	5502462509	5351644021	1.03

duckdb / parquet (1.016x ➖, 0↑ 0↓)

name	PR 70c2e75 (ns)	base 4b7207e (ns)	ratio (PR/base)
statpopgen_q00/duckdb:parquet	323330594	319505530	1.01
statpopgen_q01/duckdb:parquet	405774898	392564145	1.03
statpopgen_q02/duckdb:parquet	986528838	1001118000	0.99
statpopgen_q03/duckdb:parquet	1497331337	1489069824	1.01
statpopgen_q04/duckdb:parquet	1529736510	1524444852	1.00
statpopgen_q05/duckdb:parquet	1026643653	1023212337	1.00
statpopgen_q06/duckdb:parquet	1557321957	1478058360	1.05
statpopgen_q07/duckdb:parquet	1952851740	1858063850	1.05
statpopgen_q08/duckdb:parquet	1933244303	1866491830	1.04
statpopgen_q09/duckdb:parquet	1392533771	1377556755	1.01
statpopgen_q10/duckdb:parquet	2625952475	2674840167	0.98

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	duckdb:vortex-compact	+2.1%	+1.2%	+0.9%	+10.0%	➖ noise
0	duckdb:vortex-file-compressed	+1.3%	+1.2%	+0.1%	+10.0%	➖ noise
1	duckdb:vortex-compact	+36.2%	+3.4%	+31.7%	+26.3%	🚨 regression
1	duckdb:vortex-file-compressed	-3.0%	+3.4%	-6.2%	+198.5%	➖ noise
2	duckdb:vortex-compact	+1.7%	-1.5%	+3.2%	+10.0%	➖ noise
2	duckdb:vortex-file-compressed	-1.6%	-1.5%	-0.2%	+10.0%	➖ noise
3	duckdb:vortex-compact	+0.8%	+0.6%	+0.2%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	-0.9%	+0.6%	-1.4%	+10.0%	➖ noise
4	duckdb:vortex-compact	+2.1%	+0.3%	+1.8%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	+2.0%	+0.3%	+1.7%	+10.0%	➖ noise
5	duckdb:vortex-compact	+3.2%	+0.3%	+2.8%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	+0.9%	+0.3%	+0.5%	+10.0%	➖ noise
6	duckdb:vortex-compact	+1.3%	+5.4%	-3.8%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	-0.3%	+5.4%	-5.4%	+10.0%	➖ noise
7	duckdb:vortex-compact	-1.3%	+5.1%	-6.1%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	-4.6%	+5.1%	-9.2%	+10.0%	✅ faster
8	duckdb:vortex-compact	-1.4%	+3.6%	-4.8%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-1.9%	+3.6%	-5.3%	+10.0%	➖ noise
9	duckdb:vortex-compact	+3.2%	+1.1%	+2.1%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	+1.8%	+1.1%	+0.8%	+10.0%	➖ noise
10	duckdb:vortex-compact	+2.8%	-1.8%	+4.7%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-0.2%	-1.8%	+1.6%	+10.0%	➖ noise

[github-actions]

Benchmarks: Random Access

Summary

• Overall: 0.899x ✅
• Vortex: 0.839x ✅
• Parquet: 0.963x ➖

unknown / unknown (0.899x ✅, 10↑ 0↓)

name	PR 70c2e75 (ns)	base 0b981a8 (ns)	ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀	2459650	5285176	0.47
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer	1368274	1496149	0.91
random-access/feature-vectors/correlated/parquet-tokio-local-disk	13907250040	13862083151	1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer	13398782991	13717619543	0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk	7915348	7955517	0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer	6004114	6574520	0.91
random-access/feature-vectors/uniform/lance-tokio-local-disk	1572329	1715636	0.92
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚀	2482487	2776754	0.89
random-access/feature-vectors/uniform/parquet-tokio-local-disk	13395011416	13780783637	0.97
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer	13361185998	13701318913	0.98
random-access/feature-vectors/uniform/vortex-tokio-local-disk	12899704	14298781	0.90
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer	12856834	14230288	0.90
random-access/lance-tokio-local-disk	762733	783788	0.97
random-access/lance-tokio-local-disk-footer	1433235	1466246	0.98
random-access/nested-lists/correlated/lance-tokio-local-disk	274523	291673	0.94
random-access/nested-lists/correlated/lance-tokio-local-disk-footer	757653	832310	0.91
random-access/nested-lists/correlated/parquet-tokio-local-disk	161815138	169118219	0.96
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer	161003670	172998460	0.93
random-access/nested-lists/correlated/vortex-tokio-local-disk	723144	744352	0.97
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer	724588	744807	0.97
random-access/nested-lists/uniform/lance-tokio-local-disk	1191789	1284424	0.93
random-access/nested-lists/uniform/lance-tokio-local-disk-footer	1702320	1839590	0.93
random-access/nested-lists/uniform/parquet-tokio-local-disk	161399119	172409381	0.94
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer	162542550	171837738	0.95
random-access/nested-lists/uniform/vortex-tokio-local-disk	2401076	2626697	0.91
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀	2364583	2863427	0.83
random-access/nested-structs/correlated/lance-tokio-local-disk	435340	478005	0.91
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 🚀	651200	727066	0.90
random-access/nested-structs/correlated/parquet-tokio-local-disk	28265161	29155786	0.97
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer	28326843	28746324	0.99
random-access/nested-structs/correlated/vortex-tokio-local-disk	900640	951104	0.95
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer	902257	974809	0.93
random-access/nested-structs/uniform/lance-tokio-local-disk	2841923	3129623	0.91
random-access/nested-structs/uniform/lance-tokio-local-disk-footer	3117697	3347786	0.93
random-access/nested-structs/uniform/parquet-tokio-local-disk	28309539	30028748	0.94
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer	27945696	29544180	0.95
random-access/nested-structs/uniform/vortex-tokio-local-disk	1817574	1994376	0.91
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer	1811059	1959901	0.92
random-access/parquet-tokio-local-disk	186387896	193052192	0.97
random-access/parquet-tokio-local-disk-footer	185645726	194386169	0.96
random-access/taxi/correlated/lance-tokio-local-disk	984457	1032715	0.95
random-access/taxi/correlated/lance-tokio-local-disk-footer	1701831	1807275	0.94
random-access/taxi/correlated/parquet-tokio-local-disk	279850340	288497120	0.97
random-access/taxi/correlated/parquet-tokio-local-disk-footer	275909240	285111393	0.97
random-access/taxi/correlated/vortex-tokio-local-disk 🚀	1724187	2704935	0.64
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀	1755365	2651246	0.66
random-access/taxi/uniform/lance-tokio-local-disk	8818116	9132551	0.97
random-access/taxi/uniform/lance-tokio-local-disk-footer	9616549	9800523	0.98
random-access/taxi/uniform/parquet-tokio-local-disk	295506941	304002481	0.97
random-access/taxi/uniform/parquet-tokio-local-disk-footer	295530387	305630515	0.97
random-access/taxi/uniform/vortex-tokio-local-disk 🚀	4348271	5637993	0.77
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀	4385546	5665947	0.77
random-access/vortex-tokio-local-disk 🚀	1229333	1862968	0.66
random-access/vortex-tokio-local-disk-footer 🚀	1205965	1835928	0.66

[github-actions]

Benchmarks: Compression

Summary

• Overall: 1.008x ➖
• Vortex: 1.003x ➖
• Parquet: 1.006x ➖

unknown / unknown (1.008x ➖, 0↑ 7↓)

name	PR 70c2e75 (ns)	base 18bef2b (ns)	ratio (PR/base)
compress time/Arade	1156967544	1211412473	0.96
compress time/Bimbo	6826934655	7150180136	0.95
compress time/CMSprovider	2918740477	2961073538	0.99
compress time/Euro2016	467952808	434611974	1.08
compress time/Food	414256037	401805945	1.03
compress time/HashTags	973008702	938337363	1.04
compress time/TPC-H l_comment canonical	1319330468	1317235127	1.00
compress time/TPC-H l_comment chunked	1347271408	1323811543	1.02
compress time/taxi	737175562	746984561	0.99
compress time/wide table cols=100 chunks=1 rows=1000	16164515	16149218	1.00
compress time/wide table cols=100 chunks=50 rows=1000	15450120	15884856	0.97
compress time/wide table cols=1000 chunks=1 rows=1000	157574579	160466265	0.98
compress time/wide table cols=1000 chunks=50 rows=1000	157522427	159727836	0.99
compress time/wide table cols=10000 chunks=1 rows=1000	1531939592	1593235234	0.96
compress time/wide table cols=10000 chunks=50 rows=1000	1527158040	1556375383	0.98
decompress time/Arade	32902356	31709641	1.04
decompress time/Bimbo	100267331	98604034	1.02
decompress time/CMSprovider	86164498	82967039	1.04
decompress time/Euro2016 🚨	25871052	22427148	1.15
decompress time/Food 🚨	10758792	8036276	1.34
decompress time/HashTags	83199751	78295071	1.06
decompress time/TPC-H l_comment canonical	42352868	41290548	1.03
decompress time/TPC-H l_comment chunked	42929043	41542273	1.03
decompress time/taxi	20576448	20523798	1.00
decompress time/wide table cols=100 chunks=1 rows=1000	2620743	2570526	1.02
decompress time/wide table cols=100 chunks=50 rows=1000	2842773	2658135	1.07
decompress time/wide table cols=1000 chunks=1 rows=1000	23517132	23804840	0.99
decompress time/wide table cols=1000 chunks=50 rows=1000	23146601	23534656	0.98
decompress time/wide table cols=10000 chunks=1 rows=1000	232424175	240757660	0.97
decompress time/wide table cols=10000 chunks=50 rows=1000	235881186	242956976	0.97
parquet size/Arade	305282152	305282152	1.00
parquet size/Bimbo	388935055	388935055	1.00
parquet size/CMSprovider	384634824	384634824	1.00
parquet size/Euro2016	123042700	123042700	1.00
parquet size/Food	36177631	36177631	1.00
parquet size/HashTags	133854962	133854962	1.00
parquet size/TPC-H l_comment canonical	158411391	158411391	1.00
parquet size/TPC-H l_comment chunked	158411391	158411391	1.00
parquet size/taxi	55879185	55879185	1.00
parquet size/wide table cols=100 chunks=1 rows=1000	932204	932204	1.00
parquet size/wide table cols=100 chunks=50 rows=1000	932204	932204	1.00
parquet size/wide table cols=1000 chunks=1 rows=1000	9322004	9322004	1.00
parquet size/wide table cols=1000 chunks=50 rows=1000	9322004	9322004	1.00
parquet size/wide table cols=10000 chunks=1 rows=1000	93220004	93220004	1.00
parquet size/wide table cols=10000 chunks=50 rows=1000	93220004	93220004	1.00
parquet_rs-zstd compress time/Arade	2522477602	2587240518	0.97
parquet_rs-zstd compress time/Bimbo	15608383321	16351563416	0.95
parquet_rs-zstd compress time/CMSprovider	7804630051	7953081104	0.98
parquet_rs-zstd compress time/Euro2016	1595811296	1452777630	1.10
parquet_rs-zstd compress time/Food	1005518012	941159231	1.07
parquet_rs-zstd compress time/HashTags 🚨	2917464883	2555735474	1.14
parquet_rs-zstd compress time/TPC-H l_comment canonical	3177142841	3186953496	1.00
parquet_rs-zstd compress time/TPC-H l_comment chunked	3222328994	3210426412	1.00
parquet_rs-zstd compress time/taxi	1412944820	1402796696	1.01
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000	6273758	6681148	0.94
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000	6512799	6476511	1.01
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000	82833641	84529539	0.98
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000	84395986	84162070	1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000	901220484	897767101	1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000	878938730	909478570	0.97
parquet_rs-zstd decompress time/Arade	678974968	674327581	1.01
parquet_rs-zstd decompress time/Bimbo	2258153332	2331703751	0.97
parquet_rs-zstd decompress time/CMSprovider	2116618375	2121320128	1.00
parquet_rs-zstd decompress time/Euro2016 🚨	478894952	417619051	1.15
parquet_rs-zstd decompress time/Food 🚨	271968863	242537682	1.12
parquet_rs-zstd decompress time/HashTags 🚨	798825916	701533762	1.14
parquet_rs-zstd decompress time/TPC-H l_comment canonical	709944959	707340992	1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked	718329940	709949178	1.01
parquet_rs-zstd decompress time/taxi	300269691	289359561	1.04
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000	2535920	2565171	0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000	2522194	2532365	1.00
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000	29202841	29956458	0.97
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000	28854781	29831208	0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000	330738050	343101897	0.96
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000	335845810	342571235	0.98
vortex-file-compressed size/Arade	143320892	143320892	1.00
vortex-file-compressed size/Bimbo	526057964	526057964	1.00
vortex-file-compressed size/CMSprovider	448338524	448338524	1.00
vortex-file-compressed size/Euro2016	167858692	167856044	1.00
vortex-file-compressed size/Food	44162400	44162400	1.00
vortex-file-compressed size/HashTags	198700644	198700644	1.00
vortex-file-compressed size/TPC-H l_comment canonical	180408824	180408824	1.00
vortex-file-compressed size/TPC-H l_comment chunked	180408824	180408824	1.00
vortex-file-compressed size/taxi	51448740	51448740	1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000	884384	884384	1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000	884384	884384	1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000	8829584	8829584	1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000	8829584	8829584	1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000	88317584	88317584	1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000	88317584	88317584	1.00
vortex:parquet-zstd ratio compress time/Arade	0	0	0.98
vortex:parquet-zstd ratio compress time/Bimbo	0	0	1.00
vortex:parquet-zstd ratio compress time/CMSprovider	0	0	1.00
vortex:parquet-zstd ratio compress time/Euro2016	0	0	0.98
vortex:parquet-zstd ratio compress time/Food	0	0	0.96
vortex:parquet-zstd ratio compress time/HashTags	0	0	0.91
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical	0	0	1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked	0	0	1.01
vortex:parquet-zstd ratio compress time/taxi	0	0	0.98
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000	2	2	1.07
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000	2	2	0.97
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000	1	1	1.00
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000	1	1	0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000	1	1	0.96
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000	1	1	1.02
vortex:parquet-zstd ratio decompress time/Arade	0	0	1.03
vortex:parquet-zstd ratio decompress time/Bimbo	0	0	1.05
vortex:parquet-zstd ratio decompress time/CMSprovider	0	0	1.04
vortex:parquet-zstd ratio decompress time/Euro2016	0	0	1.01
vortex:parquet-zstd ratio decompress time/Food 🚨	0	0	1.19
vortex:parquet-zstd ratio decompress time/HashTags	0	0	0.93
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical	0	0	1.02
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked	0	0	1.02
vortex:parquet-zstd ratio decompress time/taxi	0	0	0.97
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000	1	1	1.03
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000	1	1	1.07
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000	0	0	1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000	0	0	1.02
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000	0	0	1.00
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000	0	0	0.99
vortex:parquet-zstd size/Arade	0	0	1.00
vortex:parquet-zstd size/Bimbo	1	1	1.00
vortex:parquet-zstd size/CMSprovider	1	1	1.00
vortex:parquet-zstd size/Euro2016	1	1	1.00
vortex:parquet-zstd size/Food	1	1	1.00
vortex:parquet-zstd size/HashTags	1	1	1.00
vortex:parquet-zstd size/TPC-H l_comment canonical	1	1	1.00
vortex:parquet-zstd size/TPC-H l_comment chunked	1	1	1.00
vortex:parquet-zstd size/taxi	0	0	1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000	0	0	1.00

[AdamGS]

I think this is at least somewhat handled in the SLT crate itself

[AdamGS]

Why do we need to do this on our own?