Faster true count using AVX2 and AVX512 instructions by robert3005 · Pull Request #6931 · vortex-data/vortex

robert3005 · 2026-03-13T02:19:19Z

Add faster true count using AVX2 and AVX512 intrinsics.

True count happens a lot in our codebase, it would definitely benefit from optimistaions

codspeed-hq · 2026-03-13T02:30:01Z

Merging this PR will degrade performance by 50.39%

⚡ 8 improved benchmarks
❌ 2 regressed benchmarks
✅ 999 untouched benchmarks
⏩ 1515 skipped benchmarks¹

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

	Mode	Benchmark	`BASE`	`HEAD`	Efficiency
⚡	Simulation	`null_count_run_end[(100000, 1024, 0.5)]`	65.1 µs	57.5 µs	+13.21%
⚡	Simulation	`null_count_run_end[(100000, 256, 0.01)]`	72 µs	64.3 µs	+12.03%
⚡	Simulation	`null_count_run_end[(100000, 1024, 0.1)]`	64.7 µs	57.1 µs	+13.3%
⚡	Simulation	`null_count_run_end[(100000, 256, 0.5)]`	74.4 µs	66.7 µs	+11.57%
⚡	Simulation	`null_count_run_end[(100000, 256, 0.1)]`	72.3 µs	64.6 µs	+11.98%
⚡	Simulation	`true_count_vortex_buffer[128]`	955.6 ns	597.5 ns	+59.93%
❌	Simulation	`true_count_vortex_buffer[2048]`	1.2 µs	1.4 µs	-12.92%
⚡	Simulation	`true_count_vortex_buffer[65536]`	11.7 µs	6.7 µs	+74.02%
❌	Simulation	`true_count_vortex_buffer[1024]`	1 µs	2.1 µs	-50.39%
⚡	Simulation	`true_count_vortex_buffer[16384]`	3.6 µs	2.6 µs	+39.45%

_{Comparing rk/truecount (8720068) with develop (b825593)}

1515 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

joseph-isaacs

Are these the only count bits we can have there are no other arch count_bits we could use?

how did you bench these, maybe we want wall clock AVX-512 ?

robert3005 · 2026-03-13T11:01:29Z

Zen 5
before

├─ true_count_arrow_buffer                      │               │               │               │         │
│  ├─ 128                         4.643 ns      │ 4.76 ns       │ 4.721 ns      │ 4.725 ns      │ 100     │ 25600
│  ├─ 1024                        7.26 ns       │ 23.9 ns       │ 7.339 ns      │ 7.524 ns      │ 100     │ 25600
│  ├─ 2048                        12.37 ns      │ 36.12 ns      │ 12.53 ns      │ 12.74 ns      │ 100     │ 12800
│  ├─ 16384                       96.05 ns      │ 97.3 ns       │ 96.67 ns      │ 96.73 ns      │ 100     │ 1600
│  ╰─ 65536                       387.3 ns      │ 392.5 ns      │ 389.8 ns      │ 390.2 ns      │ 100     │ 400
├─ true_count_vortex_buffer                     │               │               │               │         │
│  ├─ 128                         5.073 ns      │ 5.19 ns       │ 5.151 ns      │ 5.145 ns      │ 100     │ 25600
│  ├─ 1024                        7.69 ns       │ 40.89 ns      │ 7.768 ns      │ 8.091 ns      │ 100     │ 12800
│  ├─ 2048                        12.61 ns      │ 12.92 ns      │ 12.76 ns      │ 12.76 ns      │ 100     │ 12800
│  ├─ 16384                       96.05 ns      │ 97.92 ns      │ 96.67 ns      │ 96.81 ns      │ 100     │ 1600
│  ╰─ 65536                       389.8 ns      │ 395 ns        │ 392.3 ns      │ 392.1 ns      │ 100     │ 400

after

├─ true_count_arrow_buffer                      │               │               │               │         │
│  ├─ 128                         4.682 ns      │ 4.956 ns      │ 4.721 ns      │ 4.746 ns      │ 100     │ 25600
│  ├─ 1024                        7.3 ns        │ 7.378 ns      │ 7.339 ns      │ 7.346 ns      │ 100     │ 25600
│  ├─ 2048                        12.45 ns      │ 12.61 ns      │ 12.53 ns      │ 12.52 ns      │ 100     │ 12800
│  ├─ 16384                       96.05 ns      │ 356.6 ns      │ 96.67 ns      │ 99.35 ns      │ 100     │ 1600
│  ╰─ 65536                       387.3 ns      │ 394.8 ns      │ 389.8 ns      │ 389.7 ns      │ 100     │ 400
├─ true_count_vortex_buffer                     │               │               │               │         │
│  ├─ 128                         4.096 ns      │ 4.139 ns      │ 4.135 ns      │ 4.119 ns      │ 100     │ 25600
│  ├─ 1024                        19.8 ns       │ 5.779 µs      │ 19.8 ns       │ 78.9 ns       │ 100     │ 100
│  ├─ 2048                        3.491 ns      │ 3.53 ns       │ 3.51 ns       │ 3.509 ns      │ 100     │ 51200
│  ├─ 16384                       13.23 ns      │ 46.36 ns      │ 13.31 ns      │ 13.83 ns      │ 100     │ 12800
│  ╰─ 65536                       35.11 ns      │ 36.36 ns      │ 35.73 ns      │ 35.87 ns      │ 100     │ 3200

on Zen 3 (no avx512)
before

├─ true_count_arrow_buffer                      │               │               │               │         │
│  ├─ 128                         10.25 ns      │ 18.37 ns      │ 10.4 ns       │ 11.46 ns      │ 100     │ 12800
│  ├─ 1024                        15.17 ns      │ 30.09 ns      │ 15.17 ns      │ 16.19 ns      │ 100     │ 12800
│  ├─ 2048                        22.67 ns      │ 41.5 ns       │ 22.9 ns       │ 24.37 ns      │ 100     │ 12800
│  ├─ 16384                       139.7 ns      │ 207.2 ns      │ 140.9 ns      │ 143.3 ns      │ 100     │ 1600
│  ╰─ 65536                       544.7 ns      │ 569.7 ns      │ 549.7 ns      │ 550 ns        │ 100     │ 400
├─ true_count_vortex_buffer                     │               │               │               │         │
│  ├─ 128                         10.64 ns      │ 22.28 ns      │ 11.11 ns      │ 12.2 ns       │ 100     │ 12800
│  ├─ 1024                        16.26 ns      │ 110.2 ns      │ 16.34 ns      │ 18.57 ns      │ 100     │ 12800
│  ├─ 2048                        23.37 ns      │ 42.52 ns      │ 23.84 ns      │ 25.23 ns      │ 100     │ 12800
│  ├─ 16384                       140.9 ns      │ 206.5 ns      │ 141.5 ns      │ 145.8 ns      │ 100     │ 1600
│  ╰─ 65536                       546.9 ns      │ 779.7 ns      │ 549.7 ns      │ 554.3 ns      │ 100     │ 400

after

├─ true_count_arrow_buffer                      │               │               │               │         │
│  ├─ 128                         10.23 ns      │ 18.19 ns      │ 10.54 ns      │ 10.68 ns      │ 100     │ 12800
│  ├─ 1024                        15.22 ns      │ 29.69 ns      │ 15.23 ns      │ 15.42 ns      │ 100     │ 12800
│  ├─ 2048                        22.96 ns      │ 191.4 ns      │ 23.27 ns      │ 25.23 ns      │ 100     │ 6400
│  ├─ 16384                       140.3 ns      │ 147.1 ns      │ 141.5 ns      │ 141.4 ns      │ 100     │ 1600
│  ╰─ 65536                       549.6 ns      │ 572.1 ns      │ 552.1 ns      │ 553 ns        │ 100     │ 400
├─ true_count_vortex_buffer                     │               │               │               │         │
│  ├─ 128                         7.652 ns      │ 16.01 ns      │ 7.691 ns      │ 7.902 ns      │ 100     │ 12800
│  ├─ 1024                        29.68 ns      │ 11.79 µs      │ 39.68 ns      │ 160.7 ns      │ 100     │ 100
│  ├─ 2048                        11.24 ns      │ 22.88 ns      │ 11.32 ns      │ 11.56 ns      │ 100     │ 12800
│  ├─ 16384                       46.55 ns      │ 206.1 ns      │ 47.34 ns      │ 49.09 ns      │ 100     │ 6400
│  ╰─ 65536                       172.1 ns      │ 178.4 ns      │ 173.4 ns      │ 173.5 ns      │ 100     │ 1600

which made me realise there's discontinuity where the length threshold is reached due to feature detection. Need to figure out better structure

vortex-buffer/benches/vortex_bitbuffer.rs

robert3005 · 2026-03-13T13:02:10Z

before we merge this we need to figure out the slowdown due to feature detection

github-actions · 2026-03-13T13:22:01Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`970af97`		1	Explore Profiling Data

Previous Runs (2)

Status	Commit	Job	Attempt	Link
🟢 Done	`f9e3725`		2	Explore Profiling Data
🟢 Done	`f9e3725`		1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-03-13T13:22:03Z

Benchmarks: TPC-DS SF=1 on NVME

Summary

Overall: 0.985x ➖
Vortex: 0.990x ➖
Parquet: 0.998x ➖

Verdict

No clear signal

Attributed Vortex impact: -1.7%
Confidence: low
Environment shift: -0.2%

Statistical Summary

Systemic shift (parquet controls): -0.2%
Control sigma: +4.3%
Residual noise: +4.9%
Median polish overall: -2.2%

datafusion / vortex-file-compressed (1.081x ➖, 0↑ 45↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨	33108315	28107365	1.18
tpcds_q02/datafusion:vortex-file-compressed 🚨	84351072	76156743	1.11
tpcds_q03/datafusion:vortex-file-compressed 🚨	30629778	27314941	1.12
tpcds_q04/datafusion:vortex-file-compressed 🚨	451694156	394659980	1.14
tpcds_q05/datafusion:vortex-file-compressed 🚨	82407266	74575533	1.11
tpcds_q06/datafusion:vortex-file-compressed 🚨	88250522	75310552	1.17
tpcds_q07/datafusion:vortex-file-compressed 🚨	89520373	76792294	1.17
tpcds_q08/datafusion:vortex-file-compressed 🚨	44742834	39198797	1.14
tpcds_q09/datafusion:vortex-file-compressed 🚨	55760369	46188884	1.21
tpcds_q10/datafusion:vortex-file-compressed 🚨	59576049	47851330	1.25
tpcds_q11/datafusion:vortex-file-compressed 🚨	276179192	226642236	1.22
tpcds_q12/datafusion:vortex-file-compressed 🚨	40699384	35183354	1.16
tpcds_q13/datafusion:vortex-file-compressed 🚨	86068653	76390516	1.13
tpcds_q14/datafusion:vortex-file-compressed 🚨	259888036	211240942	1.23
tpcds_q15/datafusion:vortex-file-compressed 🚨	56782281	49908853	1.14
tpcds_q16/datafusion:vortex-file-compressed 🚨	34308231	28838919	1.19
tpcds_q17/datafusion:vortex-file-compressed	126084755	115354789	1.09
tpcds_q18/datafusion:vortex-file-compressed 🚨	114102066	100464151	1.14
tpcds_q19/datafusion:vortex-file-compressed 🚨	52597619	47366612	1.11
tpcds_q20/datafusion:vortex-file-compressed 🚨	44278589	39176102	1.13
tpcds_q21/datafusion:vortex-file-compressed	191578758	178576420	1.07
tpcds_q22/datafusion:vortex-file-compressed 🚨	77990856	70720602	1.10
tpcds_q23/datafusion:vortex-file-compressed 🚨	208078371	187003906	1.11
tpcds_q24/datafusion:vortex-file-compressed	176116817	181994746	0.97
tpcds_q25/datafusion:vortex-file-compressed	114045447	111341309	1.02
tpcds_q26/datafusion:vortex-file-compressed	59760612	62927597	0.95
tpcds_q27/datafusion:vortex-file-compressed	163830297	161879765	1.01
tpcds_q28/datafusion:vortex-file-compressed	49659204	48821153	1.02
tpcds_q29/datafusion:vortex-file-compressed	108945795	110239643	0.99
tpcds_q30/datafusion:vortex-file-compressed	29449338	31312427	0.94
tpcds_q31/datafusion:vortex-file-compressed	177134474	177997210	1.00
tpcds_q32/datafusion:vortex-file-compressed	23924098	23291811	1.03
tpcds_q33/datafusion:vortex-file-compressed	36680207	36654648	1.00
tpcds_q34/datafusion:vortex-file-compressed	39582898	36741129	1.08
tpcds_q35/datafusion:vortex-file-compressed	62281509	58547981	1.06
tpcds_q36/datafusion:vortex-file-compressed	104433668	103719070	1.01
tpcds_q37/datafusion:vortex-file-compressed	39017950	38755368	1.01
tpcds_q38/datafusion:vortex-file-compressed	86657752	86591562	1.00
tpcds_q39/datafusion:vortex-file-compressed	183979613	194030086	0.95
tpcds_q40/datafusion:vortex-file-compressed	55683788	55924272	1.00
tpcds_q41/datafusion:vortex-file-compressed	13414938	13529078	0.99
tpcds_q42/datafusion:vortex-file-compressed	30443194	30511998	1.00
tpcds_q43/datafusion:vortex-file-compressed	49421236	48300445	1.02
tpcds_q44/datafusion:vortex-file-compressed	43368924	41688196	1.04
tpcds_q45/datafusion:vortex-file-compressed	50936823	48444020	1.05
tpcds_q46/datafusion:vortex-file-compressed	65348765	64411655	1.01
tpcds_q47/datafusion:vortex-file-compressed	299312991	274188703	1.09
tpcds_q48/datafusion:vortex-file-compressed	73511566	67960415	1.08
tpcds_q49/datafusion:vortex-file-compressed 🚨	77063663	68735280	1.12
tpcds_q50/datafusion:vortex-file-compressed	78786595	73123295	1.08
tpcds_q51/datafusion:vortex-file-compressed	99630966	92172985	1.08
tpcds_q52/datafusion:vortex-file-compressed 🚨	32024470	28912194	1.11
tpcds_q53/datafusion:vortex-file-compressed 🚨	32340299	29037140	1.11
tpcds_q54/datafusion:vortex-file-compressed 🚨	52010353	47263421	1.10
tpcds_q55/datafusion:vortex-file-compressed 🚨	34171511	30666088	1.11
tpcds_q56/datafusion:vortex-file-compressed	49290001	45425520	1.09
tpcds_q57/datafusion:vortex-file-compressed	189688936	179850007	1.05
tpcds_q58/datafusion:vortex-file-compressed	117812969	109612165	1.07
tpcds_q59/datafusion:vortex-file-compressed	100192216	91419013	1.10
tpcds_q60/datafusion:vortex-file-compressed	48119197	47525051	1.01
tpcds_q61/datafusion:vortex-file-compressed 🚨	62646982	56652539	1.11
tpcds_q62/datafusion:vortex-file-compressed	46495615	43418589	1.07
tpcds_q63/datafusion:vortex-file-compressed	31244202	28653501	1.09
tpcds_q64/datafusion:vortex-file-compressed	724263225	714326482	1.01
tpcds_q65/datafusion:vortex-file-compressed	50682052	51803179	0.98
tpcds_q66/datafusion:vortex-file-compressed	101866032	107031027	0.95
tpcds_q67/datafusion:vortex-file-compressed	143654558	143028551	1.00
tpcds_q68/datafusion:vortex-file-compressed	64629939	66958987	0.97
tpcds_q69/datafusion:vortex-file-compressed	48473438	44873694	1.08
tpcds_q70/datafusion:vortex-file-compressed	127214197	132741680	0.96
tpcds_q71/datafusion:vortex-file-compressed	30100137	29287820	1.03
tpcds_q72/datafusion:vortex-file-compressed	3504451211	3388269580	1.03
tpcds_q73/datafusion:vortex-file-compressed 🚨	43003107	38358136	1.12
tpcds_q74/datafusion:vortex-file-compressed	179510979	165305321	1.09
tpcds_q75/datafusion:vortex-file-compressed 🚨	148380696	131400019	1.13
tpcds_q76/datafusion:vortex-file-compressed	69209202	68703408	1.01
tpcds_q77/datafusion:vortex-file-compressed	58793121	54028953	1.09
tpcds_q78/datafusion:vortex-file-compressed 🚨	198832944	177070644	1.12
tpcds_q79/datafusion:vortex-file-compressed 🚨	48038023	42624387	1.13
tpcds_q80/datafusion:vortex-file-compressed 🚨	129819009	115999490	1.12
tpcds_q81/datafusion:vortex-file-compressed	41818988	38052143	1.10
tpcds_q82/datafusion:vortex-file-compressed 🚨	45456412	39863349	1.14
tpcds_q83/datafusion:vortex-file-compressed 🚨	75035777	67154255	1.12
tpcds_q84/datafusion:vortex-file-compressed 🚨	17060894	15323089	1.11
tpcds_q85/datafusion:vortex-file-compressed 🚨	156288702	133753177	1.17
tpcds_q86/datafusion:vortex-file-compressed 🚨	34702985	30263809	1.15
tpcds_q87/datafusion:vortex-file-compressed 🚨	98657071	88660014	1.11
tpcds_q88/datafusion:vortex-file-compressed	85095353	79050387	1.08
tpcds_q89/datafusion:vortex-file-compressed	62120918	56697135	1.10
tpcds_q90/datafusion:vortex-file-compressed 🚨	18161237	16203441	1.12
tpcds_q91/datafusion:vortex-file-compressed 🚨	31127308	25996037	1.20
tpcds_q92/datafusion:vortex-file-compressed	21320072	19460677	1.10
tpcds_q93/datafusion:vortex-file-compressed 🚨	40466680	35633947	1.14
tpcds_q94/datafusion:vortex-file-compressed 🚨	29632503	25496908	1.16
tpcds_q95/datafusion:vortex-file-compressed	96322157	87944106	1.10
tpcds_q96/datafusion:vortex-file-compressed 🚨	16436441	14764369	1.11
tpcds_q97/datafusion:vortex-file-compressed 🚨	38436635	31763659	1.21
tpcds_q98/datafusion:vortex-file-compressed	53909124	50129284	1.08
tpcds_q99/datafusion:vortex-file-compressed 🚨	68664455	59640187	1.15

datafusion / vortex-compact (0.931x ➖, 36↑ 5↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpcds_q01/datafusion:vortex-compact	39796388	36481055	1.09
tpcds_q02/datafusion:vortex-compact 🚨	89495646	80722905	1.11
tpcds_q03/datafusion:vortex-compact 🚨	37130032	32010641	1.16
tpcds_q04/datafusion:vortex-compact	467233788	444580398	1.05
tpcds_q05/datafusion:vortex-compact 🚨	94451580	83179076	1.14
tpcds_q06/datafusion:vortex-compact 🚨	91522093	80172989	1.14
tpcds_q07/datafusion:vortex-compact	100469803	92083203	1.09
tpcds_q08/datafusion:vortex-compact 🚨	54552341	48080352	1.13
tpcds_q09/datafusion:vortex-compact	103608653	99555174	1.04
tpcds_q10/datafusion:vortex-compact	73981509	67807628	1.09
tpcds_q11/datafusion:vortex-compact	278449196	257710295	1.08
tpcds_q12/datafusion:vortex-compact	39085400	41752627	0.94
tpcds_q13/datafusion:vortex-compact	144253240	149301398	0.97
tpcds_q14/datafusion:vortex-compact	293577805	311509068	0.94
tpcds_q15/datafusion:vortex-compact	58434370	62863019	0.93
tpcds_q16/datafusion:vortex-compact	44381976	44355903	1.00
tpcds_q17/datafusion:vortex-compact	136963496	144773128	0.95
tpcds_q18/datafusion:vortex-compact	126511728	133643528	0.95
tpcds_q19/datafusion:vortex-compact	67973276	69082919	0.98
tpcds_q20/datafusion:vortex-compact	49193012	50197082	0.98
tpcds_q21/datafusion:vortex-compact	198298485	208602908	0.95
tpcds_q22/datafusion:vortex-compact	84402170	88566866	0.95
tpcds_q23/datafusion:vortex-compact	254311013	276999041	0.92
tpcds_q24/datafusion:vortex-compact	231099258	245174546	0.94
tpcds_q25/datafusion:vortex-compact	145888759	149985070	0.97
tpcds_q26/datafusion:vortex-compact	80181427	85050468	0.94
tpcds_q27/datafusion:vortex-compact	231745227	247755697	0.94
tpcds_q28/datafusion:vortex-compact	108006484	114719461	0.94
tpcds_q29/datafusion:vortex-compact	139550014	147607660	0.95
tpcds_q30/datafusion:vortex-compact 🚀	36164771	42332516	0.85
tpcds_q31/datafusion:vortex-compact 🚀	207512187	238217156	0.87
tpcds_q32/datafusion:vortex-compact 🚀	29242627	35356417	0.83
tpcds_q33/datafusion:vortex-compact 🚀	50485467	61038966	0.83
tpcds_q34/datafusion:vortex-compact 🚀	55755264	66543851	0.84
tpcds_q35/datafusion:vortex-compact 🚀	72811882	89985424	0.81
tpcds_q36/datafusion:vortex-compact	132421299	145515805	0.91
tpcds_q37/datafusion:vortex-compact	55164598	57685354	0.96
tpcds_q38/datafusion:vortex-compact 🚀	101621542	113134833	0.90
tpcds_q39/datafusion:vortex-compact 🚀	201864576	230186897	0.88
tpcds_q40/datafusion:vortex-compact 🚀	59234233	75066433	0.79
tpcds_q41/datafusion:vortex-compact 🚀	14940879	20396756	0.73
tpcds_q42/datafusion:vortex-compact 🚀	35588480	42133763	0.84
tpcds_q43/datafusion:vortex-compact 🚀	56799357	63243018	0.90
tpcds_q44/datafusion:vortex-compact	74448764	79179684	0.94
tpcds_q45/datafusion:vortex-compact	54493011	60116704	0.91
tpcds_q46/datafusion:vortex-compact 🚀	92087762	106653404	0.86
tpcds_q47/datafusion:vortex-compact 🚀	305463771	372100680	0.82
tpcds_q48/datafusion:vortex-compact	111092195	122036296	0.91
tpcds_q49/datafusion:vortex-compact	107006090	113333917	0.94
tpcds_q50/datafusion:vortex-compact 🚀	92691111	109355148	0.85
tpcds_q51/datafusion:vortex-compact	110045257	120649240	0.91
tpcds_q52/datafusion:vortex-compact	36613054	39997048	0.92
tpcds_q53/datafusion:vortex-compact 🚀	38790988	45970091	0.84
tpcds_q54/datafusion:vortex-compact 🚀	63404710	72382278	0.88
tpcds_q55/datafusion:vortex-compact	35593501	39348157	0.90
tpcds_q56/datafusion:vortex-compact 🚀	59521742	67816864	0.88
tpcds_q57/datafusion:vortex-compact 🚀	192494355	225933181	0.85
tpcds_q58/datafusion:vortex-compact 🚀	117525878	134994767	0.87
tpcds_q59/datafusion:vortex-compact 🚀	107609606	131986037	0.82
tpcds_q60/datafusion:vortex-compact 🚀	59267501	67917430	0.87
tpcds_q61/datafusion:vortex-compact 🚀	82556563	94639906	0.87
tpcds_q62/datafusion:vortex-compact 🚀	44704977	52396904	0.85
tpcds_q63/datafusion:vortex-compact 🚀	39572662	46845228	0.84
tpcds_q64/datafusion:vortex-compact 🚀	800351417	914071185	0.88
tpcds_q65/datafusion:vortex-compact 🚀	68774689	84277063	0.82
tpcds_q66/datafusion:vortex-compact 🚀	113226786	131118125	0.86
tpcds_q67/datafusion:vortex-compact 🚀	150343290	176675126	0.85
tpcds_q68/datafusion:vortex-compact 🚀	92141063	105226025	0.88
tpcds_q69/datafusion:vortex-compact 🚀	63689278	72791273	0.87
tpcds_q70/datafusion:vortex-compact 🚀	143358276	162096615	0.88
tpcds_q71/datafusion:vortex-compact 🚀	46321584	53091123	0.87
tpcds_q72/datafusion:vortex-compact	4379189381	4398647669	1.00
tpcds_q73/datafusion:vortex-compact	62955209	66855190	0.94
tpcds_q74/datafusion:vortex-compact	199099082	211216836	0.94
tpcds_q75/datafusion:vortex-compact	199792289	211332087	0.95
tpcds_q76/datafusion:vortex-compact	89038018	91886064	0.97
tpcds_q77/datafusion:vortex-compact	82016903	78561413	1.04
tpcds_q78/datafusion:vortex-compact	242851025	247654569	0.98
tpcds_q79/datafusion:vortex-compact	79140128	78391066	1.01
tpcds_q80/datafusion:vortex-compact	152110982	159897772	0.95
tpcds_q81/datafusion:vortex-compact	50369816	51436115	0.98
tpcds_q82/datafusion:vortex-compact	58919972	60279666	0.98
tpcds_q83/datafusion:vortex-compact	69708086	75407872	0.92
tpcds_q84/datafusion:vortex-compact	21121401	21441978	0.99
tpcds_q85/datafusion:vortex-compact	168454584	172934493	0.97
tpcds_q86/datafusion:vortex-compact 🚀	33195072	37479477	0.89
tpcds_q87/datafusion:vortex-compact	110888787	113695558	0.98
tpcds_q88/datafusion:vortex-compact	144411763	147899519	0.98
tpcds_q89/datafusion:vortex-compact	79285103	74843745	1.06
tpcds_q90/datafusion:vortex-compact	24378166	24940443	0.98
tpcds_q91/datafusion:vortex-compact	44196090	46559511	0.95
tpcds_q92/datafusion:vortex-compact	24553493	26363498	0.93
tpcds_q93/datafusion:vortex-compact	58325334	60917301	0.96
tpcds_q94/datafusion:vortex-compact	36402145	35272713	1.03
tpcds_q95/datafusion:vortex-compact	104396904	107050535	0.98
tpcds_q96/datafusion:vortex-compact	25981243	27827281	0.93
tpcds_q97/datafusion:vortex-compact	46791819	50251123	0.93
tpcds_q98/datafusion:vortex-compact 🚀	56714751	65702429	0.86
tpcds_q99/datafusion:vortex-compact 🚀	62170228	77210115	0.81

datafusion / parquet (1.065x ➖, 0↑ 20↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpcds_q01/datafusion:parquet	40638497	37834882	1.07
tpcds_q02/datafusion:parquet 🚨	55550262	49936014	1.11
tpcds_q03/datafusion:parquet	17675726	17303673	1.02
tpcds_q04/datafusion:parquet	378815791	361921091	1.05
tpcds_q05/datafusion:parquet	93194171	90395113	1.03
tpcds_q06/datafusion:parquet	92215627	94872724	0.97
tpcds_q07/datafusion:parquet	136461611	130154081	1.05
tpcds_q08/datafusion:parquet 🚨	41730327	37800377	1.10
tpcds_q09/datafusion:parquet	57513260	53858353	1.07
tpcds_q10/datafusion:parquet	111010519	103973988	1.07
tpcds_q11/datafusion:parquet	230590408	228901283	1.01
tpcds_q12/datafusion:parquet	30846894	33218085	0.93
tpcds_q13/datafusion:parquet	147754027	140919053	1.05
tpcds_q14/datafusion:parquet	215903378	213568431	1.01
tpcds_q15/datafusion:parquet	60129023	55101905	1.09
tpcds_q16/datafusion:parquet	33748438	33157052	1.02
tpcds_q17/datafusion:parquet	172427650	173567524	0.99
tpcds_q18/datafusion:parquet	180280353	180361788	1.00
tpcds_q19/datafusion:parquet	37175857	35483946	1.05
tpcds_q20/datafusion:parquet	26410343	24935411	1.06
tpcds_q21/datafusion:parquet	29236145	27737924	1.05
tpcds_q22/datafusion:parquet 🚨	178549482	152383134	1.17
tpcds_q23/datafusion:parquet	191258076	179803002	1.06
tpcds_q24/datafusion:parquet	216445336	213993691	1.01
tpcds_q25/datafusion:parquet	179179406	176433036	1.02
tpcds_q26/datafusion:parquet	119540935	116220374	1.03
tpcds_q27/datafusion:parquet	277272014	259026647	1.07
tpcds_q28/datafusion:parquet	55583985	51844364	1.07
tpcds_q29/datafusion:parquet	179958216	181207563	0.99
tpcds_q30/datafusion:parquet	47400035	44696056	1.06
tpcds_q31/datafusion:parquet	111522754	104915841	1.06
tpcds_q32/datafusion:parquet	30073973	28646042	1.05
tpcds_q33/datafusion:parquet	38932351	35702266	1.09
tpcds_q34/datafusion:parquet	37827112	35950901	1.05
tpcds_q35/datafusion:parquet	100697304	96657317	1.04
tpcds_q36/datafusion:parquet	87193674	83258391	1.05
tpcds_q37/datafusion:parquet	27059832	25430472	1.06
tpcds_q38/datafusion:parquet	67726265	65243859	1.04
tpcds_q39/datafusion:parquet	106969342	98734128	1.08
tpcds_q40/datafusion:parquet	37520547	37146186	1.01
tpcds_q41/datafusion:parquet	13363711	12649473	1.06
tpcds_q42/datafusion:parquet 🚨	17665871	15110148	1.17
tpcds_q43/datafusion:parquet 🚨	29970478	26347446	1.14
tpcds_q44/datafusion:parquet	44491017	41427392	1.07
tpcds_q45/datafusion:parquet	67734548	65058031	1.04
tpcds_q46/datafusion:parquet	53520298	50593956	1.06
tpcds_q47/datafusion:parquet	191769944	184697751	1.04
tpcds_q48/datafusion:parquet	136869043	127362523	1.07
tpcds_q49/datafusion:parquet	77695491	74422680	1.04
tpcds_q50/datafusion:parquet	113279083	113511963	1.00
tpcds_q51/datafusion:parquet	103699610	98606060	1.05
tpcds_q52/datafusion:parquet	16560228	15789836	1.05
tpcds_q53/datafusion:parquet	31758054	31210978	1.02
tpcds_q54/datafusion:parquet	48988694	46552101	1.05
tpcds_q55/datafusion:parquet	16510035	15750936	1.05
tpcds_q56/datafusion:parquet	35786057	36013447	0.99
tpcds_q57/datafusion:parquet	139192840	133870560	1.04
tpcds_q58/datafusion:parquet	77899729	71425093	1.09
tpcds_q59/datafusion:parquet	69322016	65597640	1.06
tpcds_q60/datafusion:parquet	40279802	37091745	1.09
tpcds_q61/datafusion:parquet	68570520	65059317	1.05
tpcds_q62/datafusion:parquet	47041454	45307362	1.04
tpcds_q63/datafusion:parquet 🚨	34100674	30186876	1.13
tpcds_q64/datafusion:parquet	1018336381	999555379	1.02
tpcds_q65/datafusion:parquet	51816021	50771077	1.02
tpcds_q66/datafusion:parquet	89006805	90664431	0.98
tpcds_q67/datafusion:parquet	183077217	181001469	1.01
tpcds_q68/datafusion:parquet	53241632	50410663	1.06
tpcds_q69/datafusion:parquet	97129494	94279323	1.03
tpcds_q70/datafusion:parquet	113225919	110411342	1.03
tpcds_q71/datafusion:parquet	30425837	28749568	1.06
tpcds_q72/datafusion:parquet	917585821	864906831	1.06
tpcds_q73/datafusion:parquet	38234452	38158978	1.00
tpcds_q74/datafusion:parquet	139535199	133144108	1.05
tpcds_q75/datafusion:parquet	137799838	129541260	1.06
tpcds_q76/datafusion:parquet	95962211	87619880	1.10
tpcds_q77/datafusion:parquet	60280614	57662351	1.05
tpcds_q78/datafusion:parquet	196215832	180106821	1.09
tpcds_q79/datafusion:parquet 🚨	46893762	40464333	1.16
tpcds_q80/datafusion:parquet 🚨	125013585	111647271	1.12
tpcds_q81/datafusion:parquet	47437476	43957423	1.08
tpcds_q82/datafusion:parquet 🚨	32154875	28725053	1.12
tpcds_q83/datafusion:parquet 🚨	62876624	53228842	1.18
tpcds_q84/datafusion:parquet 🚨	53710569	48461148	1.11
tpcds_q85/datafusion:parquet	264768295	246750656	1.07
tpcds_q86/datafusion:parquet	22364320	20788799	1.08
tpcds_q87/datafusion:parquet	71564431	65252041	1.10
tpcds_q88/datafusion:parquet 🚨	88777340	79996366	1.11
tpcds_q89/datafusion:parquet 🚨	41633576	36874047	1.13
tpcds_q90/datafusion:parquet 🚨	21544401	18483610	1.17
tpcds_q91/datafusion:parquet	85593394	79051357	1.08
tpcds_q92/datafusion:parquet 🚨	29751146	25037531	1.19
tpcds_q93/datafusion:parquet 🚨	48162039	38680260	1.25
tpcds_q94/datafusion:parquet 🚨	31463813	27421892	1.15
tpcds_q95/datafusion:parquet	145529990	136374148	1.07
tpcds_q96/datafusion:parquet 🚨	17257646	15299326	1.13
tpcds_q97/datafusion:parquet 🚨	41952844	35047838	1.20
tpcds_q98/datafusion:parquet	41058218	37600613	1.09
tpcds_q99/datafusion:parquet 🚨	54868845	46640176	1.18

duckdb / vortex-file-compressed (0.967x ➖, 19↑ 5↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚀	25885995	29088524	0.89
tpcds_q02/duckdb:vortex-file-compressed	83254981	89750955	0.93
tpcds_q03/duckdb:vortex-file-compressed	22288511	24548387	0.91
tpcds_q04/duckdb:vortex-file-compressed	108930488	120931051	0.90
tpcds_q05/duckdb:vortex-file-compressed 🚀	98683459	114167861	0.86
tpcds_q06/duckdb:vortex-file-compressed 🚀	35686010	40051775	0.89
tpcds_q07/duckdb:vortex-file-compressed	25009627	26652419	0.94
tpcds_q08/duckdb:vortex-file-compressed 🚀	23808874	27388512	0.87
tpcds_q09/duckdb:vortex-file-compressed 🚀	38128020	45022664	0.85
tpcds_q10/duckdb:vortex-file-compressed	36724057	40772021	0.90
tpcds_q11/duckdb:vortex-file-compressed	63474487	67289197	0.94
tpcds_q12/duckdb:vortex-file-compressed 🚀	14643314	16734468	0.88
tpcds_q13/duckdb:vortex-file-compressed 🚀	32757092	37649011	0.87
tpcds_q14/duckdb:vortex-file-compressed	198274555	203417145	0.97
tpcds_q15/duckdb:vortex-file-compressed	41047465	45432321	0.90
tpcds_q16/duckdb:vortex-file-compressed	30890536	33601139	0.92
tpcds_q17/duckdb:vortex-file-compressed	40507122	42685868	0.95
tpcds_q18/duckdb:vortex-file-compressed	49097182	49707937	0.99
tpcds_q19/duckdb:vortex-file-compressed	36607776	36846841	0.99
tpcds_q20/duckdb:vortex-file-compressed	18427706	18239999	1.01
tpcds_q21/duckdb:vortex-file-compressed 🚨	24316849	21704698	1.12
tpcds_q22/duckdb:vortex-file-compressed	123057026	121134946	1.02
tpcds_q23/duckdb:vortex-file-compressed	147112715	143485710	1.03
tpcds_q24/duckdb:vortex-file-compressed	61784550	60246185	1.03
tpcds_q25/duckdb:vortex-file-compressed	40818953	40677882	1.00
tpcds_q26/duckdb:vortex-file-compressed	44287818	45418623	0.98
tpcds_q27/duckdb:vortex-file-compressed	99429739	94770437	1.05
tpcds_q28/duckdb:vortex-file-compressed	40833628	38916538	1.05
tpcds_q29/duckdb:vortex-file-compressed	42001612	40655985	1.03
tpcds_q30/duckdb:vortex-file-compressed	32392357	34031894	0.95
tpcds_q31/duckdb:vortex-file-compressed	28512291	27328160	1.04
tpcds_q32/duckdb:vortex-file-compressed	19870885	18304873	1.09
tpcds_q33/duckdb:vortex-file-compressed	73716477	73785533	1.00
tpcds_q34/duckdb:vortex-file-compressed 🚀	19121082	21510410	0.89
tpcds_q35/duckdb:vortex-file-compressed 🚀	65199920	75399058	0.86
tpcds_q36/duckdb:vortex-file-compressed	28337304	31418327	0.90
tpcds_q37/duckdb:vortex-file-compressed	23791237	25308676	0.94
tpcds_q38/duckdb:vortex-file-compressed 🚀	36074339	42176143	0.86
tpcds_q39/duckdb:vortex-file-compressed	46981672	46636600	1.01
tpcds_q40/duckdb:vortex-file-compressed	23631875	24813568	0.95
tpcds_q41/duckdb:vortex-file-compressed 🚀	12921271	15195861	0.85
tpcds_q42/duckdb:vortex-file-compressed 🚀	11581177	13272985	0.87
tpcds_q43/duckdb:vortex-file-compressed	20591289	21475406	0.96
tpcds_q44/duckdb:vortex-file-compressed	24311658	25920530	0.94
tpcds_q45/duckdb:vortex-file-compressed 🚀	27201757	31267292	0.87
tpcds_q46/duckdb:vortex-file-compressed	46935090	52145388	0.90
tpcds_q47/duckdb:vortex-file-compressed 🚀	49930615	56405377	0.89
tpcds_q48/duckdb:vortex-file-compressed	30559866	33567562	0.91
tpcds_q49/duckdb:vortex-file-compressed 🚀	29874137	34146514	0.87
tpcds_q50/duckdb:vortex-file-compressed	35660223	39252220	0.91
tpcds_q51/duckdb:vortex-file-compressed	96798515	106830198	0.91
tpcds_q52/duckdb:vortex-file-compressed 🚀	12306580	14654459	0.84
tpcds_q53/duckdb:vortex-file-compressed 🚀	17299990	19347808	0.89
tpcds_q54/duckdb:vortex-file-compressed 🚀	49727781	55881325	0.89
tpcds_q55/duckdb:vortex-file-compressed	12780993	13407811	0.95
tpcds_q56/duckdb:vortex-file-compressed	70550189	75433370	0.94
tpcds_q57/duckdb:vortex-file-compressed	44308144	48247766	0.92
tpcds_q58/duckdb:vortex-file-compressed	31679524	34985663	0.91
tpcds_q59/duckdb:vortex-file-compressed	58705001	60094483	0.98
tpcds_q60/duckdb:vortex-file-compressed 🚀	71590190	80430302	0.89
tpcds_q61/duckdb:vortex-file-compressed	40571037	40991572	0.99
tpcds_q62/duckdb:vortex-file-compressed	18957877	19697194	0.96
tpcds_q63/duckdb:vortex-file-compressed	18627553	19293741	0.97
tpcds_q64/duckdb:vortex-file-compressed	89502799	87700885	1.02
tpcds_q65/duckdb:vortex-file-compressed	27903112	27022701	1.03
tpcds_q66/duckdb:vortex-file-compressed 🚨	71973377	64309670	1.12
tpcds_q67/duckdb:vortex-file-compressed	165887610	159038446	1.04
tpcds_q68/duckdb:vortex-file-compressed	43850889	44301389	0.99
tpcds_q69/duckdb:vortex-file-compressed	41087482	42611651	0.96
tpcds_q70/duckdb:vortex-file-compressed	26470784	26586936	1.00
tpcds_q71/duckdb:vortex-file-compressed	23096431	21975452	1.05
tpcds_q72/duckdb:vortex-file-compressed	186966409	183525224	1.02
tpcds_q73/duckdb:vortex-file-compressed	21569843	21567648	1.00
tpcds_q74/duckdb:vortex-file-compressed	57750127	56008910	1.03
tpcds_q75/duckdb:vortex-file-compressed	67798568	65213519	1.04
tpcds_q76/duckdb:vortex-file-compressed	67912367	74002573	0.92
tpcds_q77/duckdb:vortex-file-compressed 🚨	83502156	67283248	1.24
tpcds_q78/duckdb:vortex-file-compressed	79343431	84100885	0.94
tpcds_q79/duckdb:vortex-file-compressed	34780532	37765419	0.92
tpcds_q80/duckdb:vortex-file-compressed	99503912	100275344	0.99
tpcds_q81/duckdb:vortex-file-compressed	37328934	38012589	0.98
tpcds_q82/duckdb:vortex-file-compressed	25319811	26476154	0.96
tpcds_q83/duckdb:vortex-file-compressed	29817035	29794021	1.00
tpcds_q84/duckdb:vortex-file-compressed	18760081	19769489	0.95
tpcds_q85/duckdb:vortex-file-compressed	49815805	50403111	0.99
tpcds_q86/duckdb:vortex-file-compressed	18827778	19851208	0.95
tpcds_q87/duckdb:vortex-file-compressed	45558612	42801003	1.06
tpcds_q88/duckdb:vortex-file-compressed	45931208	44513347	1.03
tpcds_q89/duckdb:vortex-file-compressed	21560127	20871074	1.03
tpcds_q90/duckdb:vortex-file-compressed	17260684	16480490	1.05
tpcds_q91/duckdb:vortex-file-compressed	31483797	31293620	1.01
tpcds_q92/duckdb:vortex-file-compressed	17986975	16989190	1.06
tpcds_q93/duckdb:vortex-file-compressed	36900096	33749622	1.09
tpcds_q94/duckdb:vortex-file-compressed	26949553	25796417	1.04
tpcds_q95/duckdb:vortex-file-compressed 🚨	166207837	147771532	1.12
tpcds_q96/duckdb:vortex-file-compressed	19357791	19851712	0.98
tpcds_q97/duckdb:vortex-file-compressed	45025153	41692369	1.08
tpcds_q98/duckdb:vortex-file-compressed	20059444	19332856	1.04
tpcds_q99/duckdb:vortex-file-compressed 🚨	39402140	34369353	1.15

duckdb / vortex-compact (0.987x ➖, 4↑ 5↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpcds_q01/duckdb:vortex-compact	37818931	36474994	1.04
tpcds_q02/duckdb:vortex-compact	136173957	133356443	1.02
tpcds_q03/duckdb:vortex-compact	56263225	54328112	1.04
tpcds_q04/duckdb:vortex-compact	137918809	132712991	1.04
tpcds_q05/duckdb:vortex-compact	185674971	194097144	0.96
tpcds_q06/duckdb:vortex-compact	47402315	45010614	1.05
tpcds_q07/duckdb:vortex-compact 🚨	43627265	39289910	1.11
tpcds_q08/duckdb:vortex-compact	32196888	31421231	1.02
tpcds_q09/duckdb:vortex-compact	121953531	120068369	1.02
tpcds_q10/duckdb:vortex-compact	54015630	54023080	1.00
tpcds_q11/duckdb:vortex-compact	85267765	85052328	1.00
tpcds_q12/duckdb:vortex-compact 🚨	23401651	20816791	1.12
tpcds_q13/duckdb:vortex-compact	59913037	57378843	1.04
tpcds_q14/duckdb:vortex-compact	312810106	299300961	1.05
tpcds_q15/duckdb:vortex-compact	52674026	49701625	1.06
tpcds_q16/duckdb:vortex-compact	42147293	41035582	1.03
tpcds_q17/duckdb:vortex-compact	58379294	58128387	1.00
tpcds_q18/duckdb:vortex-compact	79686098	74921044	1.06
tpcds_q19/duckdb:vortex-compact	46502364	44641282	1.04
tpcds_q20/duckdb:vortex-compact	23778145	22064527	1.08
tpcds_q21/duckdb:vortex-compact 🚨	32841008	29246737	1.12
tpcds_q22/duckdb:vortex-compact	134723588	123521924	1.09
tpcds_q23/duckdb:vortex-compact	192566423	184145312	1.05
tpcds_q24/duckdb:vortex-compact	91845052	84801624	1.08
tpcds_q25/duckdb:vortex-compact	56478359	54427373	1.04
tpcds_q26/duckdb:vortex-compact 🚨	63937840	53154612	1.20
tpcds_q27/duckdb:vortex-compact	162190738	151797712	1.07
tpcds_q28/duckdb:vortex-compact	117228383	113001297	1.04
tpcds_q29/duckdb:vortex-compact	58548422	57188904	1.02
tpcds_q30/duckdb:vortex-compact 🚨	45435724	38581852	1.18
tpcds_q31/duckdb:vortex-compact	34122073	34357813	0.99
tpcds_q32/duckdb:vortex-compact	24189382	23823846	1.02
tpcds_q33/duckdb:vortex-compact	146562095	151663785	0.97
tpcds_q34/duckdb:vortex-compact	31514289	33245842	0.95
tpcds_q35/duckdb:vortex-compact	78283274	79336016	0.99
tpcds_q36/duckdb:vortex-compact	37328068	36806784	1.01
tpcds_q37/duckdb:vortex-compact	33217304	32990351	1.01
tpcds_q38/duckdb:vortex-compact	43825635	44007001	1.00
tpcds_q39/duckdb:vortex-compact	56104824	54781228	1.02
tpcds_q40/duckdb:vortex-compact	31816138	34343510	0.93
tpcds_q41/duckdb:vortex-compact	18917187	19618452	0.96
tpcds_q42/duckdb:vortex-compact	15817197	16777604	0.94
tpcds_q43/duckdb:vortex-compact	26079103	25297751	1.03
tpcds_q44/duckdb:vortex-compact	36948530	37689078	0.98
tpcds_q45/duckdb:vortex-compact	34685724	34721358	1.00
tpcds_q46/duckdb:vortex-compact	63308320	66911699	0.95
tpcds_q47/duckdb:vortex-compact	54958967	58673767	0.94
tpcds_q48/duckdb:vortex-compact	45284358	49118355	0.92
tpcds_q49/duckdb:vortex-compact	49404759	50920067	0.97
tpcds_q50/duckdb:vortex-compact	55787337	58946376	0.95
tpcds_q51/duckdb:vortex-compact	112132214	109412563	1.02
tpcds_q52/duckdb:vortex-compact	15687768	16612162	0.94
tpcds_q53/duckdb:vortex-compact	22622774	24545641	0.92
tpcds_q54/duckdb:vortex-compact	87847873	94317164	0.93
tpcds_q55/duckdb:vortex-compact	15997309	15866529	1.01
tpcds_q56/duckdb:vortex-compact	145192554	153903086	0.94
tpcds_q57/duckdb:vortex-compact	50677952	51712056	0.98
tpcds_q58/duckdb:vortex-compact	42268778	42437692	1.00
tpcds_q59/duckdb:vortex-compact	66474198	69413468	0.96
tpcds_q60/duckdb:vortex-compact	149400701	154284514	0.97
tpcds_q61/duckdb:vortex-compact	54930403	57080610	0.96
tpcds_q62/duckdb:vortex-compact	22037092	23709488	0.93
tpcds_q63/duckdb:vortex-compact	23151499	23502587	0.99
tpcds_q64/duckdb:vortex-compact	109626360	116175170	0.94
tpcds_q65/duckdb:vortex-compact	28846333	29822400	0.97
tpcds_q66/duckdb:vortex-compact	105894561	102477924	1.03
tpcds_q67/duckdb:vortex-compact	159280149	167062790	0.95
tpcds_q68/duckdb:vortex-compact	56620732	60313057	0.94
tpcds_q69/duckdb:vortex-compact	49349980	52764109	0.94
tpcds_q70/duckdb:vortex-compact	29041050	31187758	0.93
tpcds_q71/duckdb:vortex-compact	26640343	28905562	0.92
tpcds_q72/duckdb:vortex-compact	200373063	203047922	0.99
tpcds_q73/duckdb:vortex-compact	29193837	29656118	0.98
tpcds_q74/duckdb:vortex-compact	60954979	66215823	0.92
tpcds_q75/duckdb:vortex-compact	70322697	74791072	0.94
tpcds_q76/duckdb:vortex-compact	140690567	141508197	0.99
tpcds_q77/duckdb:vortex-compact	143643296	144735627	0.99
tpcds_q78/duckdb:vortex-compact	88151819	90053782	0.98
tpcds_q79/duckdb:vortex-compact	62557450	66945443	0.93
tpcds_q80/duckdb:vortex-compact	171675527	187439030	0.92
tpcds_q81/duckdb:vortex-compact 🚀	41410688	46763932	0.89
tpcds_q82/duckdb:vortex-compact	33726074	34965368	0.96
tpcds_q83/duckdb:vortex-compact	47270373	51061295	0.93
tpcds_q84/duckdb:vortex-compact 🚀	20600879	23168996	0.89
tpcds_q85/duckdb:vortex-compact	61849136	67950963	0.91
tpcds_q86/duckdb:vortex-compact	20446171	21288376	0.96
tpcds_q87/duckdb:vortex-compact	44768541	47635072	0.94
tpcds_q88/duckdb:vortex-compact 🚀	44863240	50382460	0.89
tpcds_q89/duckdb:vortex-compact	24229575	25782573	0.94
tpcds_q90/duckdb:vortex-compact	16785528	17096777	0.98
tpcds_q91/duckdb:vortex-compact	45716338	49678287	0.92
tpcds_q92/duckdb:vortex-compact	23475768	23495676	1.00
tpcds_q93/duckdb:vortex-compact	38741270	42243710	0.92
tpcds_q94/duckdb:vortex-compact 🚀	29025022	33518454	0.87
tpcds_q95/duckdb:vortex-compact	163060750	154780662	1.05
tpcds_q96/duckdb:vortex-compact	19956706	20957342	0.95
tpcds_q97/duckdb:vortex-compact	43393108	45096083	0.96
tpcds_q98/duckdb:vortex-compact	23516896	24396098	0.96
tpcds_q99/duckdb:vortex-compact	38507394	40815884	0.94

duckdb / parquet (0.935x ➖, 29↑ 1↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpcds_q01/duckdb:parquet	43559786	48318528	0.90
tpcds_q02/duckdb:parquet	60382802	66256111	0.91
tpcds_q03/duckdb:parquet 🚀	12069586	13704915	0.88
tpcds_q04/duckdb:parquet	127081679	140929008	0.90
tpcds_q05/duckdb:parquet 🚀	70034657	78541360	0.89
tpcds_q06/duckdb:parquet 🚀	28482398	35756230	0.80
tpcds_q07/duckdb:parquet	23393787	25398830	0.92
tpcds_q08/duckdb:parquet 🚀	27883131	31442124	0.89
tpcds_q09/duckdb:parquet	39502523	42249195	0.93
tpcds_q10/duckdb:parquet 🚀	36227714	40295870	0.90
tpcds_q11/duckdb:parquet 🚀	88654509	98615015	0.90
tpcds_q12/duckdb:parquet 🚀	14588977	16245608	0.90
tpcds_q13/duckdb:parquet	35345366	37855089	0.93
tpcds_q14/duckdb:parquet	162598234	178024442	0.91
tpcds_q15/duckdb:parquet 🚀	30781989	35866560	0.86
tpcds_q16/duckdb:parquet 🚀	21966919	25386515	0.87
tpcds_q17/duckdb:parquet 🚀	38184587	43034489	0.89
tpcds_q18/duckdb:parquet	47689104	52320650	0.91
tpcds_q19/duckdb:parquet 🚀	29555356	33141678	0.89
tpcds_q20/duckdb:parquet 🚀	16289844	18516269	0.88
tpcds_q21/duckdb:parquet 🚀	11759331	13297007	0.88
tpcds_q22/duckdb:parquet	74350646	81383495	0.91
tpcds_q23/duckdb:parquet	121585684	129974769	0.94
tpcds_q24/duckdb:parquet	50894718	52102318	0.98
tpcds_q25/duckdb:parquet	36343949	36577972	0.99
tpcds_q26/duckdb:parquet	42112061	41883094	1.01
tpcds_q27/duckdb:parquet	96062620	97344761	0.99
tpcds_q28/duckdb:parquet	39187192	40208561	0.97
tpcds_q29/duckdb:parquet 🚀	36268127	41380827	0.88
tpcds_q30/duckdb:parquet	42112481	44735391	0.94
tpcds_q31/duckdb:parquet	24015670	25359813	0.95
tpcds_q32/duckdb:parquet 🚀	11554395	12953732	0.89
tpcds_q33/duckdb:parquet	73732263	73667651	1.00
tpcds_q34/duckdb:parquet	21919526	23333309	0.94
tpcds_q35/duckdb:parquet	66627856	69274015	0.96
tpcds_q36/duckdb:parquet	21907743	23788781	0.92
tpcds_q37/duckdb:parquet	14223089	15442931	0.92
tpcds_q38/duckdb:parquet	38074159	39193591	0.97
tpcds_q39/duckdb:parquet	35024182	36317483	0.96
tpcds_q40/duckdb:parquet	20816666	21104935	0.99
tpcds_q41/duckdb:parquet	8329855	9234149	0.90
tpcds_q42/duckdb:parquet	11630234	11636415	1.00
tpcds_q43/duckdb:parquet	16539839	17438859	0.95
tpcds_q44/duckdb:parquet	22868900	25262484	0.91
tpcds_q45/duckdb:parquet 🚀	26241370	32544645	0.81
tpcds_q46/duckdb:parquet 🚀	45670940	52299723	0.87
tpcds_q47/duckdb:parquet 🚀	45271984	51106185	0.89
tpcds_q48/duckdb:parquet	30357118	32864537	0.92
tpcds_q49/duckdb:parquet 🚀	24477600	28704766	0.85
tpcds_q50/duckdb:parquet 🚀	24295078	27305851	0.89
tpcds_q51/duckdb:parquet	94936246	103151892	0.92
tpcds_q52/duckdb:parquet 🚀	11057424	12674453	0.87
tpcds_q53/duckdb:parquet	16182567	17741085	0.91
tpcds_q54/duckdb:parquet	42281487	43429859	0.97
tpcds_q55/duckdb:parquet	10607765	11702930	0.91
tpcds_q56/duckdb:parquet	67461212	73127380	0.92
tpcds_q57/duckdb:parquet	34881921	38716941	0.90
tpcds_q58/duckdb:parquet 🚀	21009690	23731974	0.89
tpcds_q59/duckdb:parquet	36409198	38074507	0.96
tpcds_q60/duckdb:parquet 🚀	71148655	80204427	0.89
tpcds_q61/duckdb:parquet	30642153	33846205	0.91
tpcds_q62/duckdb:parquet 🚀	11422552	12903121	0.89
tpcds_q63/duckdb:parquet	15211897	16872738	0.90
tpcds_q64/duckdb:parquet 🚀	72857698	81120003	0.90
tpcds_q65/duckdb:parquet	20394574	21289731	0.96
tpcds_q66/duckdb:parquet	55089734	58788722	0.94
tpcds_q67/duckdb:parquet 🚀	136792646	153402994	0.89
tpcds_q68/duckdb:parquet	38519488	40498378	0.95
tpcds_q69/duckdb:parquet	38794403	39634103	0.98
tpcds_q70/duckdb:parquet	19976579	21767684	0.92
tpcds_q71/duckdb:parquet	20640489	20196883	1.02
tpcds_q72/duckdb:parquet	168419457	173390032	0.97
tpcds_q73/duckdb:parquet	19400282	19123990	1.01
tpcds_q74/duckdb:parquet	53302604	53944142	0.99
tpcds_q75/duckdb:parquet	58224065	58723627	0.99
tpcds_q76/duckdb:parquet	76517365	69784478	1.10
tpcds_q77/duckdb:parquet	68350338	66446740	1.03
tpcds_q78/duckdb:parquet	81234003	81222391	1.00
tpcds_q79/duckdb:parquet	29685985	30147414	0.98
tpcds_q80/duckdb:parquet	86691351	89668819	0.97
tpcds_q81/duckdb:parquet	50082040	49782340	1.01
tpcds_q82/duckdb:parquet	17313979	17884387	0.97
tpcds_q83/duckdb:parquet	17123142	16568861	1.03
tpcds_q84/duckdb:parquet	21838318	20276375	1.08
tpcds_q85/duckdb:parquet 🚨	46921843	42269621	1.11
tpcds_q86/duckdb:parquet	13021645	13724849	0.95
tpcds_q87/duckdb:parquet	40082617	42060267	0.95
tpcds_q88/duckdb:parquet	30155162	30236314	1.00
tpcds_q89/duckdb:parquet	17849497	18603270	0.96
tpcds_q90/duckdb:parquet	7652057	8228807	0.93
tpcds_q91/duckdb:parquet	23357534	24023626	0.97
tpcds_q92/duckdb:parquet 🚀	11684652	13544983	0.86
tpcds_q93/duckdb:parquet 🚀	30551718	34481453	0.89
tpcds_q94/duckdb:parquet	16419270	17452843	0.94
tpcds_q95/duckdb:parquet	141485066	137971005	1.03
tpcds_q96/duckdb:parquet 🚀	9307524	10486666	0.89
tpcds_q97/duckdb:parquet	36619423	38862600	0.94
tpcds_q98/duckdb:parquet	18093291	19044174	0.95
tpcds_q99/duckdb:parquet	20036470	20666753	0.97

duckdb / duckdb (0.943x ➖, 15↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpcds_q01/duckdb:duckdb	20517017	22325454	0.92
tpcds_q02/duckdb:duckdb	19171281	19340822	0.99
tpcds_q03/duckdb:duckdb	8631115	9102881	0.95
tpcds_q04/duckdb:duckdb	166386732	172157099	0.97
tpcds_q05/duckdb:duckdb	19772073	19687969	1.00
tpcds_q06/duckdb:duckdb	22699092	24220583	0.94
tpcds_q07/duckdb:duckdb	40075490	41433107	0.97
tpcds_q08/duckdb:duckdb	120676735	122882273	0.98
tpcds_q09/duckdb:duckdb	19610083	20740558	0.95
tpcds_q10/duckdb:duckdb	23764142	24853695	0.96
tpcds_q11/duckdb:duckdb	143244204	146681964	0.98
tpcds_q12/duckdb:duckdb	12123251	11362457	1.07
tpcds_q13/duckdb:duckdb	23514038	24984516	0.94
tpcds_q14/duckdb:duckdb	93724606	99164807	0.95
tpcds_q15/duckdb:duckdb	25036568	27228855	0.92
tpcds_q16/duckdb:duckdb	16988467	18391387	0.92
tpcds_q17/duckdb:duckdb	21955305	23221755	0.95
tpcds_q18/duckdb:duckdb	44672712	48025595	0.93
tpcds_q19/duckdb:duckdb	16977401	18482950	0.92
tpcds_q20/duckdb:duckdb	12284590	12808020	0.96
tpcds_q21/duckdb:duckdb 🚀	6829688	8181104	0.83
tpcds_q22/duckdb:duckdb 🚀	63203674	75130195	0.84
tpcds_q23/duckdb:duckdb	81518283	85969550	0.95
tpcds_q24/duckdb:duckdb 🚀	24014850	28151263	0.85
tpcds_q25/duckdb:duckdb 🚀	16526333	18643969	0.89
tpcds_q26/duckdb:duckdb	26915227	29072411	0.93
tpcds_q27/duckdb:duckdb	41100428	43018232	0.96
tpcds_q28/duckdb:duckdb	21137184	22564190	0.94
tpcds_q29/duckdb:duckdb	20383618	21373082	0.95
tpcds_q30/duckdb:duckdb 🚀	28388156	33001333	0.86
tpcds_q31/duckdb:duckdb	20130692	21940427	0.92
tpcds_q32/duckdb:duckdb	7150811	7917786	0.90
tpcds_q33/duckdb:duckdb	13027656	13261002	0.98
tpcds_q34/duckdb:duckdb 🚀	14693874	17397468	0.84
tpcds_q35/duckdb:duckdb	33873117	35035857	0.97
tpcds_q36/duckdb:duckdb	73098778	77310220	0.95
tpcds_q37/duckdb:duckdb	7646211	8108774	0.94
tpcds_q38/duckdb:duckdb	30859168	32190640	0.96
tpcds_q39/duckdb:duckdb	28159445	27703706	1.02
tpcds_q40/duckdb:duckdb	13945617	14274113	0.98
tpcds_q41/duckdb:duckdb	8410486	9179520	0.92
tpcds_q42/duckdb:duckdb 🚀	6443272	7470263	0.86
tpcds_q43/duckdb:duckdb	11039011	12258575	0.90
tpcds_q44/duckdb:duckdb	14142478	14353475	0.99
tpcds_q45/duckdb:duckdb	18077764	19699489	0.92
tpcds_q46/duckdb:duckdb 🚀	37079597	42851311	0.87
tpcds_q47/duckdb:duckdb	40427333	44286051	0.91
tpcds_q48/duckdb:duckdb	23397271	23071605	1.01
tpcds_q49/duckdb:duckdb	16899436	16296007	1.04
tpcds_q50/duckdb:duckdb	14720237	15010283	0.98
tpcds_q51/duckdb:duckdb	92049832	96272240	0.96
tpcds_q52/duckdb:duckdb	7238182	7829817	0.92
tpcds_q53/duckdb:duckdb	11946104	12831184	0.93
tpcds_q54/duckdb:duckdb	17240501	16687590	1.03
tpcds_q55/duckdb:duckdb	6955660	7221130	0.96
tpcds_q56/duckdb:duckdb	13769766	14250041	0.97
tpcds_q57/duckdb:duckdb	31625297	33228612	0.95
tpcds_q58/duckdb:duckdb	12583045	12898649	0.98
tpcds_q59/duckdb:duckdb	34754799	35754878	0.97
tpcds_q60/duckdb:duckdb	15494713	16157400	0.96
tpcds_q61/duckdb:duckdb	14362041	14923821	0.96
tpcds_q62/duckdb:duckdb	9157561	9682149	0.95
tpcds_q63/duckdb:duckdb	11020337	12138515	0.91
tpcds_q64/duckdb:duckdb	54890612	55015419	1.00
tpcds_q65/duckdb:duckdb 🚀	33176017	37472890	0.89
tpcds_q66/duckdb:duckdb	25150590	25072342	1.00
tpcds_q67/duckdb:duckdb	132060874	145385527	0.91
tpcds_q68/duckdb:duckdb 🚀	25387319	28839543	0.88
tpcds_q69/duckdb:duckdb	23862885	25979369	0.92
tpcds_q70/duckdb:duckdb	14019414	15224325	0.92
tpcds_q71/duckdb:duckdb	13625713	13595688	1.00
tpcds_q72/duckdb:duckdb	44058098	43653573	1.01
tpcds_q73/duckdb:duckdb	11375600	11548838	0.98
tpcds_q74/duckdb:duckdb	100881824	104035046	0.97
tpcds_q75/duckdb:duckdb	42885419	44888278	0.96
tpcds_q76/duckdb:duckdb	12197997	13307623	0.92
tpcds_q77/duckdb:duckdb	11868588	12767709	0.93
tpcds_q78/duckdb:duckdb	64070610	66092150	0.97
tpcds_q79/duckdb:duckdb 🚀	17508940	21581027	0.81
tpcds_q80/duckdb:duckdb	30714558	30938184	0.99
tpcds_q81/duckdb:duckdb 🚀	36661321	42606216	0.86
tpcds_q82/duckdb:duckdb	8281679	8363356	0.99
tpcds_q83/duckdb:duckdb	9098293	9619644	0.95
tpcds_q84/duckdb:duckdb 🚀	13238001	15480921	0.86
tpcds_q85/duckdb:duckdb	24178859	26295152	0.92
tpcds_q86/duckdb:duckdb 🚀	10884081	12340223	0.88
tpcds_q87/duckdb:duckdb	35123174	37545279	0.94
tpcds_q88/duckdb:duckdb	24217532	25191858	0.96
tpcds_q89/duckdb:duckdb	13090983	13852379	0.95
tpcds_q90/duckdb:duckdb	5606073	5994505	0.94
tpcds_q91/duckdb:duckdb	12983676	13050739	0.99
tpcds_q92/duckdb:duckdb	8836300	9237406	0.96
tpcds_q93/duckdb:duckdb	23344956	23075495	1.01
tpcds_q94/duckdb:duckdb	12408411	12850297	0.97
tpcds_q95/duckdb:duckdb	111080797	118782231	0.94
tpcds_q96/duckdb:duckdb 🚀	4531460	5192147	0.87
tpcds_q97/duckdb:duckdb	31086589	31485125	0.99
tpcds_q98/duckdb:duckdb	13595367	13648270	1.00
tpcds_q99/duckdb:duckdb	16425297	16129848	1.02

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	+9.1%	-1.6%	+10.9%	+12.8%	➖ noise
1	datafusion:vortex-file-compressed	+17.8%	-1.6%	+19.7%	+23.1%	➖ noise
1	duckdb:duckdb	-8.1%	-1.6%	-6.6%	+13.4%	➖ noise
1	duckdb:vortex-compact	+3.7%	-1.6%	+5.4%	+15.4%	➖ noise
1	duckdb:vortex-file-compressed	-11.0%	-1.6%	-9.6%	+11.8%	➖ noise
2	datafusion:vortex-compact	+10.9%	+0.7%	+10.1%	+11.5%	➖ noise
2	datafusion:vortex-file-compressed	+10.8%	+0.7%	+10.0%	+11.9%	➖ noise
2	duckdb:duckdb	-0.9%	+0.7%	-1.6%	+11.5%	➖ noise
2	duckdb:vortex-compact	+2.1%	+0.7%	+1.4%	+11.5%	➖ noise
2	duckdb:vortex-file-compressed	-7.2%	+0.7%	-7.9%	+11.5%	➖ noise
3	datafusion:vortex-compact	+16.0%	-5.2%	+22.3%	+12.2%	🚨 regression
3	datafusion:vortex-file-compressed	+12.1%	-5.2%	+18.2%	+11.7%	🚨 regression
3	duckdb:duckdb	-5.2%	-5.2%	-0.0%	+16.6%	➖ noise
3	duckdb:vortex-compact	+3.6%	-5.2%	+9.2%	+12.7%	➖ noise
3	duckdb:vortex-file-compressed	-9.2%	-5.2%	-4.3%	+11.5%	➖ noise
4	datafusion:vortex-compact	+5.1%	-2.8%	+8.2%	+11.5%	➖ noise
4	datafusion:vortex-file-compressed	+14.5%	-2.8%	+17.8%	+11.5%	🚨 regression
4	duckdb:duckdb	-3.4%	-2.8%	-0.5%	+11.5%	➖ noise
4	duckdb:vortex-compact	+3.9%	-2.8%	+7.0%	+11.5%	➖ noise
4	duckdb:vortex-file-compressed	-9.9%	-2.8%	-7.3%	+11.5%	➖ noise
5	datafusion:vortex-compact	+13.6%	-4.1%	+18.4%	+11.5%	🚨 regression
5	datafusion:vortex-file-compressed	+10.5%	-4.1%	+15.2%	+11.5%	🚨 regression
5	duckdb:duckdb	+0.4%	-4.1%	+4.7%	+12.4%	➖ noise
5	duckdb:vortex-compact	-4.3%	-4.1%	-0.2%	+14.8%	➖ noise
5	duckdb:vortex-file-compressed	-13.6%	-4.1%	-9.8%	+15.4%	➖ noise
6	datafusion:vortex-compact	+14.2%	-12.0%	+29.7%	+11.5%	🚨 regression
6	datafusion:vortex-file-compressed	+17.2%	-12.0%	+33.2%	+11.5%	🚨 regression
6	duckdb:duckdb	-6.3%	-12.0%	+6.5%	+14.6%	➖ noise
6	duckdb:vortex-compact	+5.3%	-12.0%	+19.7%	+11.5%	🚨 regression
6	duckdb:vortex-file-compressed	-10.9%	-12.0%	+1.3%	+11.5%	➖ noise
7	datafusion:vortex-compact	+9.1%	-1.7%	+11.0%	+11.5%	➖ noise
7	datafusion:vortex-file-compressed	+16.6%	-1.7%	+18.6%	+11.5%	🚨 regression
7	duckdb:duckdb	-3.3%	-1.7%	-1.6%	+13.7%	➖ noise
7	duckdb:vortex-compact	+11.0%	-1.7%	+13.0%	+11.5%	🚨 regression
7	duckdb:vortex-file-compressed	-6.2%	-1.7%	-4.5%	+11.5%	➖ noise
8	datafusion:vortex-compact	+13.5%	-1.1%	+14.7%	+11.5%	🚨 regression
8	datafusion:vortex-file-compressed	+14.1%	-1.1%	+15.4%	+12.5%	🚨 regression
8	duckdb:duckdb	-1.8%	-1.1%	-0.7%	+11.5%	➖ noise
8	duckdb:vortex-compact	+2.5%	-1.1%	+3.6%	+11.5%	➖ noise
8	duckdb:vortex-file-compressed	-13.1%	-1.1%	-12.1%	+11.7%	✅ faster
9	datafusion:vortex-compact	+4.1%	-0.1%	+4.2%	+11.5%	➖ noise
9	datafusion:vortex-file-compressed	+20.7%	-0.1%	+20.8%	+11.5%	🚨 regression
9	duckdb:duckdb	-5.5%	-0.1%	-5.4%	+11.5%	➖ noise
9	duckdb:vortex-compact	+1.6%	-0.1%	+1.6%	+11.5%	➖ noise
9	duckdb:vortex-file-compressed	-15.3%	-0.1%	-15.2%	+11.5%	✅ faster
10	datafusion:vortex-compact	+9.1%	-2.0%	+11.4%	+11.5%	➖ noise
10	datafusion:vortex-file-compressed	+24.5%	-2.0%	+27.1%	+15.3%	🚨 regression
10	duckdb:duckdb	-4.4%	-2.0%	-2.4%	+11.5%	➖ noise
10	duckdb:vortex-compact	-0.0%	-2.0%	+2.1%	+11.5%	➖ noise
10	duckdb:vortex-file-compressed	-9.9%	-2.0%	-8.1%	+11.5%	➖ noise
11	datafusion:vortex-compact	+8.0%	-4.8%	+13.5%	+11.5%	🚨 regression
11	datafusion:vortex-file-compressed	+21.9%	-4.8%	+28.0%	+11.5%	🚨 regression
11	duckdb:duckdb	-2.3%	-4.8%	+2.6%	+11.5%	➖ noise
11	duckdb:vortex-compact	+0.3%	-4.8%	+5.3%	+11.5%	➖ noise
11	duckdb:vortex-file-compressed	-5.7%	-4.8%	-0.9%	+11.5%	➖ noise
12	datafusion:vortex-compact	-6.4%	-8.7%	+2.5%	+11.5%	➖ noise
12	datafusion:vortex-file-compressed	+15.7%	-8.7%	+26.7%	+11.5%	🚨 regression
12	duckdb:duckdb	+6.7%	-8.7%	+16.8%	+11.5%	🚨 regression
12	duckdb:vortex-compact	+12.4%	-8.7%	+23.1%	+13.4%	🚨 regression
12	duckdb:vortex-file-compressed	-12.5%	-8.7%	-4.2%	+11.5%	➖ noise
13	datafusion:vortex-compact	-3.4%	-1.1%	-2.3%	+11.5%	➖ noise
13	datafusion:vortex-file-compressed	+12.7%	-1.1%	+13.9%	+11.5%	🚨 regression
13	duckdb:duckdb	-5.9%	-1.1%	-4.9%	+11.5%	➖ noise
13	duckdb:vortex-compact	+4.4%	-1.1%	+5.5%	+16.5%	➖ noise
13	duckdb:vortex-file-compressed	-13.0%	-1.1%	-12.1%	+11.5%	✅ faster
14	datafusion:vortex-compact	-5.8%	-3.9%	-1.9%	+11.5%	➖ noise
14	datafusion:vortex-file-compressed	+23.0%	-3.9%	+28.0%	+11.5%	🚨 regression
14	duckdb:duckdb	-5.5%	-3.9%	-1.6%	+11.5%	➖ noise
14	duckdb:vortex-compact	+4.5%	-3.9%	+8.8%	+16.8%	➖ noise
14	duckdb:vortex-file-compressed	-2.5%	-3.9%	+1.4%	+11.5%	➖ noise
15	datafusion:vortex-compact	-7.0%	-3.2%	-3.9%	+11.5%	➖ noise
15	datafusion:vortex-file-compressed	+13.8%	-3.2%	+17.6%	+12.1%	🚨 regression
15	duckdb:duckdb	-8.1%	-3.2%	-5.0%	+16.4%	➖ noise
15	duckdb:vortex-compact	+6.0%	-3.2%	+9.5%	+11.5%	➖ noise
15	duckdb:vortex-file-compressed	-9.7%	-3.2%	-6.6%	+11.5%	➖ noise
16	datafusion:vortex-compact	+0.1%	-6.2%	+6.6%	+11.5%	➖ noise
16	datafusion:vortex-file-compressed	+19.0%	-6.2%	+26.8%	+11.5%	🚨 regression
16	duckdb:duckdb	-7.6%	-6.2%	-1.6%	+11.5%	➖ noise
16	duckdb:vortex-compact	+2.7%	-6.2%	+9.4%	+11.5%	➖ noise
16	duckdb:vortex-file-compressed	-8.1%	-6.2%	-2.0%	+11.5%	➖ noise
17	datafusion:vortex-compact	-5.4%	-6.1%	+0.8%	+11.5%	➖ noise
17	datafusion:vortex-file-compressed	+9.3%	-6.1%	+16.4%	+11.5%	🚨 regression
17	duckdb:duckdb	-5.5%	-6.1%	+0.7%	+11.5%	➖ noise
17	duckdb:vortex-compact	+0.4%	-6.1%	+7.0%	+11.5%	➖ noise
17	duckdb:vortex-file-compressed	-5.1%	-6.1%	+1.1%	+11.5%	➖ noise
18	datafusion:vortex-compact	-5.3%	-4.6%	-0.8%	+11.5%	➖ noise
18	datafusion:vortex-file-compressed	+13.6%	-4.6%	+19.0%	+11.5%	🚨 regression
18	duckdb:duckdb	-7.0%	-4.6%	-2.5%	+11.5%	➖ noise
18	duckdb:vortex-compact	+6.4%	-4.6%	+11.4%	+11.5%	➖ noise
18	duckdb:vortex-file-compressed	-1.2%	-4.6%	+3.5%	+13.2%	➖ noise
19	datafusion:vortex-compact	-1.6%	-3.3%	+1.8%	+11.5%	➖ noise
19	datafusion:vortex-file-compressed	+11.0%	-3.3%	+14.9%	+11.5%	🚨 regression
19	duckdb:duckdb	-8.1%	-3.3%	-5.0%	+21.8%	➖ noise
19	duckdb:vortex-compact	+4.2%	-3.3%	+7.8%	+11.5%	➖ noise
19	duckdb:vortex-file-compressed	-0.6%	-3.3%	+2.8%	+11.5%	➖ noise
20	datafusion:vortex-compact	-2.0%	-3.5%	+1.5%	+11.5%	➖ noise
20	datafusion:vortex-file-compressed	+13.0%	-3.5%	+17.1%	+11.7%	🚨 regression
20	duckdb:duckdb	-4.1%	-3.5%	-0.6%	+11.5%	➖ noise
20	duckdb:vortex-compact	+7.8%	-3.5%	+11.6%	+19.4%	➖ noise
20	duckdb:vortex-file-compressed	+1.0%	-3.5%	+4.7%	+11.5%	➖ noise
21	datafusion:vortex-compact	-4.9%	-3.5%	-1.5%	+11.5%	➖ noise
21	datafusion:vortex-file-compressed	+7.3%	-3.5%	+11.1%	+11.5%	➖ noise
21	duckdb:duckdb	-16.5%	-3.5%	-13.5%	+15.5%	✅ faster
21	duckdb:vortex-compact	+12.3%	-3.5%	+16.3%	+11.5%	🚨 regression
21	duckdb:vortex-file-compressed	+12.0%	-3.5%	+16.0%	+17.4%	➖ noise
22	datafusion:vortex-compact	-4.7%	+3.5%	-7.9%	+11.5%	➖ noise
22	datafusion:vortex-file-compressed	+10.3%	+3.5%	+6.6%	+11.5%	➖ noise
22	duckdb:duckdb	-15.9%	+3.5%	-18.7%	+11.5%	✅ faster
22	duckdb:vortex-compact	+9.1%	+3.5%	+5.4%	+11.5%	➖ noise
22	duckdb:vortex-file-compressed	+1.6%	+3.5%	-1.8%	+11.5%	➖ noise
23	datafusion:vortex-compact	-8.2%	-0.2%	-8.0%	+11.5%	➖ noise
23	datafusion:vortex-file-compressed	+11.3%	-0.2%	+11.5%	+11.5%	🚨 regression
23	duckdb:duckdb	-5.2%	-0.2%	-4.9%	+14.9%	➖ noise
23	duckdb:vortex-compact	+4.6%	-0.2%	+4.8%	+11.5%	➖ noise
23	duckdb:vortex-file-compressed	+2.5%	-0.2%	+2.8%	+11.5%	➖ noise
24	datafusion:vortex-compact	-5.7%	-0.6%	-5.2%	+11.5%	➖ noise
24	datafusion:vortex-file-compressed	-3.2%	-0.6%	-2.6%	+11.5%	➖ noise
24	duckdb:duckdb	-14.7%	-0.6%	-14.2%	+11.5%	✅ faster
24	duckdb:vortex-compact	+8.3%	-0.6%	+9.0%	+11.5%	➖ noise
24	duckdb:vortex-file-compressed	+2.6%	-0.6%	+3.2%	+11.5%	➖ noise
25	datafusion:vortex-compact	-2.7%	+0.5%	-3.2%	+11.5%	➖ noise
25	datafusion:vortex-file-compressed	+2.4%	+0.5%	+2.0%	+11.5%	➖ noise
25	duckdb:duckdb	-11.4%	+0.5%	-11.8%	+11.5%	✅ faster
25	duckdb:vortex-compact	+3.8%	+0.5%	+3.3%	+11.5%	➖ noise
25	duckdb:vortex-file-compressed	+0.3%	+0.5%	-0.1%	+11.5%	➖ noise
26	datafusion:vortex-compact	-5.7%	+1.7%	-7.3%	+11.5%	➖ noise
26	datafusion:vortex-file-compressed	-5.0%	+1.7%	-6.6%	+11.5%	➖ noise
26	duckdb:duckdb	-7.4%	+1.7%	-9.0%	+16.4%	➖ noise
26	duckdb:vortex-compact	+20.3%	+1.7%	+18.3%	+17.5%	🚨 regression
26	duckdb:vortex-file-compressed	-2.5%	+1.7%	-4.1%	+11.5%	➖ noise
27	datafusion:vortex-compact	-6.5%	+2.8%	-9.0%	+11.5%	➖ noise
27	datafusion:vortex-file-compressed	+1.2%	+2.8%	-1.5%	+11.5%	➖ noise
27	duckdb:duckdb	-4.5%	+2.8%	-7.0%	+15.7%	➖ noise
27	duckdb:vortex-compact	+6.8%	+2.8%	+4.0%	+11.5%	➖ noise
27	duckdb:vortex-file-compressed	+4.9%	+2.8%	+2.1%	+11.5%	➖ noise
28	datafusion:vortex-compact	-5.9%	+2.2%	-7.9%	+11.5%	➖ noise
28	datafusion:vortex-file-compressed	+1.7%	+2.2%	-0.5%	+11.5%	➖ noise
28	duckdb:duckdb	-6.3%	+2.2%	-8.4%	+11.5%	➖ noise
28	duckdb:vortex-compact	+3.7%	+2.2%	+1.5%	+11.5%	➖ noise
28	duckdb:vortex-file-compressed	+4.9%	+2.2%	+2.6%	+11.5%	➖ noise
29	datafusion:vortex-compact	-5.5%	-6.7%	+1.3%	+11.5%	➖ noise
29	datafusion:vortex-file-compressed	-1.2%	-6.7%	+5.9%	+11.5%	➖ noise
29	duckdb:duckdb	-4.6%	-6.7%	+2.2%	+11.5%	➖ noise
29	duckdb:vortex-compact	+2.4%	-6.7%	+9.7%	+12.0%	➖ noise
29	duckdb:vortex-file-compressed	+3.3%	-6.7%	+10.7%	+11.5%	➖ noise
30	datafusion:vortex-compact	-14.6%	-0.1%	-14.5%	+11.5%	✅ faster
30	datafusion:vortex-file-compressed	-5.9%	-0.1%	-5.9%	+11.5%	➖ noise
30	duckdb:duckdb	-14.0%	-0.1%	-13.9%	+11.5%	✅ faster
30	duckdb:vortex-compact	+17.8%	-0.1%	+17.9%	+19.2%	➖ noise
30	duckdb:vortex-file-compressed	-4.8%	-0.1%	-4.7%	+11.5%	➖ noise
31	datafusion:vortex-compact	-12.9%	+0.3%	-13.2%	+11.5%	✅ faster
31	datafusion:vortex-file-compressed	-0.5%	+0.3%	-0.8%	+11.5%	➖ noise
31	duckdb:duckdb	-8.2%	+0.3%	-8.6%	+13.0%	➖ noise
31	duckdb:vortex-compact	-0.7%	+0.3%	-1.0%	+13.5%	➖ noise
31	duckdb:vortex-file-compressed	+4.3%	+0.3%	+4.0%	+11.5%	➖ noise
32	datafusion:vortex-compact	-17.3%	-3.2%	-14.5%	+11.5%	✅ faster
32	datafusion:vortex-file-compressed	+2.7%	-3.2%	+6.1%	+11.5%	➖ noise
32	duckdb:duckdb	-9.7%	-3.2%	-6.7%	+13.4%	➖ noise
32	duckdb:vortex-compact	+1.5%	-3.2%	+4.9%	+11.5%	➖ noise
32	duckdb:vortex-file-compressed	+8.6%	-3.2%	+12.2%	+11.5%	🚨 regression
33	datafusion:vortex-compact	-17.3%	+4.5%	-20.8%	+11.5%	✅ faster
33	datafusion:vortex-file-compressed	+0.1%	+4.5%	-4.2%	+11.5%	➖ noise
33	duckdb:duckdb	-1.8%	+4.5%	-6.0%	+11.5%	➖ noise
33	duckdb:vortex-compact	-3.4%	+4.5%	-7.5%	+11.5%	➖ noise
33	duckdb:vortex-file-compressed	-0.1%	+4.5%	-4.4%	+15.9%	➖ noise
34	datafusion:vortex-compact	-16.2%	-0.6%	-15.7%	+11.5%	✅ faster
34	datafusion:vortex-file-compressed	+7.7%	-0.6%	+8.4%	+11.5%	➖ noise
34	duckdb:duckdb	-15.5%	-0.6%	-15.0%	+11.5%	✅ faster
34	duckdb:vortex-compact	-5.2%	-0.6%	-4.7%	+11.5%	➖ noise
34	duckdb:vortex-file-compressed	-11.1%	-0.6%	-10.6%	+11.5%	✅ faster
35	datafusion:vortex-compact	-19.1%	+0.1%	-19.2%	+11.5%	✅ faster
35	datafusion:vortex-file-compressed	+6.4%	+0.1%	+6.3%	+11.5%	➖ noise
35	duckdb:duckdb	-3.3%	+0.1%	-3.4%	+11.5%	➖ noise
35	duckdb:vortex-compact	-1.3%	+0.1%	-1.4%	+11.5%	➖ noise
35	duckdb:vortex-file-compressed	-13.5%	+0.1%	-13.6%	+11.5%	✅ faster
36	datafusion:vortex-compact	-9.0%	-1.8%	-7.3%	+11.5%	➖ noise
36	datafusion:vortex-file-compressed	+0.7%	-1.8%	+2.5%	+11.5%	➖ noise
36	duckdb:duckdb	-5.4%	-1.8%	-3.7%	+11.5%	➖ noise
36	duckdb:vortex-compact	+1.4%	-1.8%	+3.3%	+11.5%	➖ noise
36	duckdb:vortex-file-compressed	-9.8%	-1.8%	-8.2%	+16.9%	➖ noise
37	datafusion:vortex-compact	-4.4%	-1.0%	-3.4%	+12.1%	➖ noise
37	datafusion:vortex-file-compressed	+0.7%	-1.0%	+1.7%	+11.5%	➖ noise
37	duckdb:duckdb	-5.7%	-1.0%	-4.7%	+15.6%	➖ noise
37	duckdb:vortex-compact	+0.7%	-1.0%	+1.7%	+11.5%	➖ noise
37	duckdb:vortex-file-compressed	-6.0%	-1.0%	-5.0%	+15.9%	➖ noise
38	datafusion:vortex-compact	-10.2%	+0.4%	-10.6%	+11.5%	✅ faster
38	datafusion:vortex-file-compressed	+0.1%	+0.4%	-0.3%	+11.5%	➖ noise
38	duckdb:duckdb	-4.1%	+0.4%	-4.5%	+14.9%	➖ noise
38	duckdb:vortex-compact	-0.4%	+0.4%	-0.8%	+15.8%	➖ noise
38	duckdb:vortex-file-compressed	-14.5%	+0.4%	-14.8%	+11.7%	✅ faster
39	datafusion:vortex-compact	-12.3%	+2.2%	-14.2%	+17.7%	➖ noise
39	datafusion:vortex-file-compressed	-5.2%	+2.2%	-7.2%	+18.2%	➖ noise
39	duckdb:duckdb	+1.6%	+2.2%	-0.6%	+19.0%	➖ noise
39	duckdb:vortex-compact	+2.4%	+2.2%	+0.2%	+14.2%	➖ noise
39	duckdb:vortex-file-compressed	+0.7%	+2.2%	-1.4%	+18.6%	➖ noise
40	datafusion:vortex-compact	-21.1%	-0.2%	-20.9%	+13.3%	✅ faster
40	datafusion:vortex-file-compressed	-0.4%	-0.2%	-0.2%	+12.8%	➖ noise
40	duckdb:duckdb	-2.3%	-0.2%	-2.1%	+13.5%	➖ noise
40	duckdb:vortex-compact	-7.4%	-0.2%	-7.2%	+15.4%	➖ noise
40	duckdb:vortex-file-compressed	-4.8%	-0.2%	-4.6%	+13.2%	➖ noise
41	datafusion:vortex-compact	-26.7%	-2.4%	-25.0%	+13.7%	✅ faster
41	datafusion:vortex-file-compressed	-0.8%	-2.4%	+1.6%	+13.0%	➖ noise
41	duckdb:duckdb	-8.4%	-2.4%	-6.1%	+11.5%	➖ noise
41	duckdb:vortex-compact	-3.6%	-2.4%	-1.2%	+11.5%	➖ noise
41	duckdb:vortex-file-compressed	-15.0%	-2.4%	-12.9%	+11.5%	✅ faster
42	datafusion:vortex-compact	-15.5%	+8.1%	-21.9%	+13.2%	✅ faster
42	datafusion:vortex-file-compressed	-0.2%	+8.1%	-7.7%	+15.4%	➖ noise
42	duckdb:duckdb	-13.7%	+8.1%	-20.2%	+16.7%	✅ faster
42	duckdb:vortex-compact	-5.7%	+8.1%	-12.8%	+17.9%	➖ noise
42	duckdb:vortex-file-compressed	-12.7%	+8.1%	-19.3%	+13.0%	✅ faster
43	datafusion:vortex-compact	-10.2%	+3.9%	-13.5%	+11.5%	✅ faster
43	datafusion:vortex-file-compressed	+2.3%	+3.9%	-1.5%	+11.5%	➖ noise
43	duckdb:duckdb	-9.9%	+3.9%	-13.3%	+13.6%	✅ faster
43	duckdb:vortex-compact	+3.1%	+3.9%	-0.8%	+11.5%	➖ noise
43	duckdb:vortex-file-compressed	-4.1%	+3.9%	-7.7%	+11.5%	➖ noise
44	datafusion:vortex-compact	-6.0%	-1.4%	-4.6%	+11.5%	➖ noise
44	datafusion:vortex-file-compressed	+4.0%	-1.4%	+5.5%	+11.5%	➖ noise
44	duckdb:duckdb	-1.5%	-1.4%	-0.1%	+12.1%	➖ noise
44	duckdb:vortex-compact	-2.0%	-1.4%	-0.6%	+11.5%	➖ noise
44	duckdb:vortex-file-compressed	-6.2%	-1.4%	-4.9%	+11.5%	➖ noise
45	datafusion:vortex-compact	-9.4%	-8.4%	-1.1%	+11.5%	➖ noise
45	datafusion:vortex-file-compressed	+5.1%	-8.4%	+14.8%	+11.5%	🚨 regression
45	duckdb:duckdb	-8.2%	-8.4%	+0.2%	+18.1%	➖ noise
45	duckdb:vortex-compact	-0.1%	-8.4%	+9.0%	+11.5%	➖ noise
45	duckdb:vortex-file-compressed	-13.0%	-8.4%	-5.0%	+11.5%	➖ noise
46	datafusion:vortex-compact	-13.7%	-3.9%	-10.2%	+11.5%	➖ noise
46	datafusion:vortex-file-compressed	+1.5%	-3.9%	+5.6%	+11.5%	➖ noise
46	duckdb:duckdb	-13.5%	-3.9%	-10.0%	+11.5%	➖ noise
46	duckdb:vortex-compact	-5.4%	-3.9%	-1.6%	+11.5%	➖ noise
46	duckdb:vortex-file-compressed	-10.0%	-3.9%	-6.4%	+11.5%	➖ noise
47	datafusion:vortex-compact	-17.9%	-4.1%	-14.4%	+11.5%	✅ faster
47	datafusion:vortex-file-compressed	+9.2%	-4.1%	+13.8%	+11.5%	🚨 regression
47	duckdb:duckdb	-8.7%	-4.1%	-4.8%	+11.5%	➖ noise
47	duckdb:vortex-compact	-6.3%	-4.1%	-2.3%	+11.5%	➖ noise
47	duckdb:vortex-file-compressed	-11.5%	-4.1%	-7.7%	+11.5%	➖ noise
48	datafusion:vortex-compact	-9.0%	-0.4%	-8.6%	+11.5%	➖ noise
48	datafusion:vortex-file-compressed	+8.2%	-0.4%	+8.6%	+11.5%	➖ noise
48	duckdb:duckdb	+1.4%	-0.4%	+1.8%	+11.5%	➖ noise
48	duckdb:vortex-compact	-7.8%	-0.4%	-7.5%	+13.6%	➖ noise
48	duckdb:vortex-file-compressed	-9.0%	-0.4%	-8.6%	+11.5%	➖ noise
49	datafusion:vortex-compact	-5.6%	-5.6%	+0.1%	+11.6%	➖ noise
49	datafusion:vortex-file-compressed	+12.1%	-5.6%	+18.8%	+11.5%	🚨 regression
49	duckdb:duckdb	+3.7%	-5.6%	+9.9%	+14.4%	➖ noise
49	duckdb:vortex-compact	-3.0%	-5.6%	+2.8%	+11.5%	➖ noise
49	duckdb:vortex-file-compressed	-12.5%	-5.6%	-7.3%	+13.1%	➖ noise
50	datafusion:vortex-compact	-15.2%	-5.8%	-10.0%	+11.5%	➖ noise
50	datafusion:vortex-file-compressed	+7.7%	-5.8%	+14.3%	+11.5%	🚨 regression
50	duckdb:duckdb	-1.9%	-5.8%	+4.1%	+11.5%	➖ noise
50	duckdb:vortex-compact	-5.4%	-5.8%	+0.4%	+11.5%	➖ noise
50	duckdb:vortex-file-compressed	-9.2%	-5.8%	-3.6%	+11.5%	➖ noise
51	datafusion:vortex-compact	-8.8%	-1.6%	-7.3%	+14.7%	➖ noise
51	datafusion:vortex-file-compressed	+8.1%	-1.6%	+9.9%	+12.6%	➖ noise
51	duckdb:duckdb	-4.4%	-1.6%	-2.8%	+11.5%	➖ noise
51	duckdb:vortex-compact	+2.5%	-1.6%	+4.2%	+16.2%	➖ noise
51	duckdb:vortex-file-compressed	-9.4%	-1.6%	-7.9%	+11.5%	➖ noise
52	datafusion:vortex-compact	-8.5%	-4.3%	-4.3%	+12.0%	➖ noise
52	datafusion:vortex-file-compressed	+10.8%	-4.3%	+15.8%	+15.1%	🚨 regression
52	duckdb:duckdb	-7.6%	-4.3%	-3.4%	+17.6%	➖ noise
52	duckdb:vortex-compact	-5.6%	-4.3%	-1.3%	+16.4%	➖ noise
52	duckdb:vortex-file-compressed	-16.0%	-4.3%	-12.2%	+18.1%	➖ noise
53	datafusion:vortex-compact	-15.6%	-3.7%	-12.4%	+11.5%	✅ faster
53	datafusion:vortex-file-compressed	+11.4%	-3.7%	+15.6%	+11.5%	🚨 regression
53	duckdb:duckdb	-6.9%	-3.7%	-3.4%	+13.0%	➖ noise
53	duckdb:vortex-compact	-7.8%	-3.7%	-4.3%	+11.5%	➖ noise
53	duckdb:vortex-file-compressed	-10.6%	-3.7%	-7.2%	+11.5%	➖ noise
54	datafusion:vortex-compact	-12.4%	+1.2%	-13.5%	+11.5%	✅ faster
54	datafusion:vortex-file-compressed	+10.0%	+1.2%	+8.7%	+11.5%	➖ noise
54	duckdb:duckdb	+3.3%	+1.2%	+2.1%	+11.5%	➖ noise
54	duckdb:vortex-compact	-6.9%	+1.2%	-8.0%	+11.5%	➖ noise
54	duckdb:vortex-file-compressed	-11.0%	+1.2%	-12.1%	+11.5%	✅ faster
55	datafusion:vortex-compact	-9.5%	-2.5%	-7.2%	+14.2%	➖ noise
55	datafusion:vortex-file-compressed	+11.4%	-2.5%	+14.3%	+11.5%	🚨 regression
55	duckdb:duckdb	-3.7%	-2.5%	-1.2%	+17.2%	➖ noise
55	duckdb:vortex-compact	+0.8%	-2.5%	+3.4%	+12.3%	➖ noise
55	duckdb:vortex-file-compressed	-4.7%	-2.5%	-2.2%	+15.6%	➖ noise
56	datafusion:vortex-compact	-12.2%	-4.3%	-8.3%	+11.5%	➖ noise
56	datafusion:vortex-file-compressed	+8.5%	-4.3%	+13.3%	+11.5%	🚨 regression
56	duckdb:duckdb	-3.4%	-4.3%	+0.9%	+11.5%	➖ noise
56	duckdb:vortex-compact	-5.7%	-4.3%	-1.5%	+11.5%	➖ noise
56	duckdb:vortex-file-compressed	-6.5%	-4.3%	-2.3%	+11.5%	➖ noise
57	datafusion:vortex-compact	-14.8%	-3.2%	-12.0%	+11.5%	✅ faster
57	datafusion:vortex-file-compressed	+5.5%	-3.2%	+9.0%	+11.5%	➖ noise
57	duckdb:duckdb	-4.8%	-3.2%	-1.7%	+16.4%	➖ noise
57	duckdb:vortex-compact	-2.0%	-3.2%	+1.3%	+11.5%	➖ noise
57	duckdb:vortex-file-compressed	-8.2%	-3.2%	-5.1%	+18.7%	➖ noise
58	datafusion:vortex-compact	-12.9%	-1.7%	-11.4%	+11.5%	✅ faster
58	datafusion:vortex-file-compressed	+7.5%	-1.7%	+9.4%	+11.5%	➖ noise
58	duckdb:duckdb	-2.4%	-1.7%	-0.7%	+13.4%	➖ noise
58	duckdb:vortex-compact	-0.4%	-1.7%	+1.4%	+18.9%	➖ noise
58	duckdb:vortex-file-compressed	-9.4%	-1.7%	-7.8%	+13.8%	➖ noise
59	datafusion:vortex-compact	-18.5%	+0.5%	-18.9%	+11.5%	✅ faster
59	datafusion:vortex-file-compressed	+9.6%	+0.5%	+9.0%	+11.5%	➖ noise
59	duckdb:duckdb	-2.8%	+0.5%	-3.3%	+11.5%	➖ noise
59	duckdb:vortex-compact	-4.2%	+0.5%	-4.7%	+11.5%	➖ noise
59	duckdb:vortex-file-compressed	-2.3%	+0.5%	-2.8%	+11.5%	➖ noise
60	datafusion:vortex-compact	-12.7%	-1.9%	-11.1%	+11.5%	✅ faster
60	datafusion:vortex-file-compressed	+1.3%	-1.9%	+3.2%	+11.5%	➖ noise
60	duckdb:duckdb	-4.1%	-1.9%	-2.3%	+11.5%	➖ noise
60	duckdb:vortex-compact	-3.2%	-1.9%	-1.3%	+11.5%	➖ noise
60	duckdb:vortex-file-compressed	-11.0%	-1.9%	-9.3%	+11.5%	➖ noise
61	datafusion:vortex-compact	-12.8%	-2.3%	-10.7%	+11.5%	✅ faster
61	datafusion:vortex-file-compressed	+10.6%	-2.3%	+13.2%	+11.5%	🚨 regression
61	duckdb:duckdb	-3.8%	-2.3%	-1.5%	+11.5%	➖ noise
61	duckdb:vortex-compact	-3.8%	-2.3%	-1.5%	+11.5%	➖ noise
61	duckdb:vortex-file-compressed	-1.0%	-2.3%	+1.3%	+11.5%	➖ noise
62	datafusion:vortex-compact	-14.7%	-4.1%	-11.0%	+11.8%	✅ faster
62	datafusion:vortex-file-compressed	+7.1%	-4.1%	+11.7%	+11.5%	🚨 regression
62	duckdb:duckdb	-5.4%	-4.1%	-1.3%	+20.9%	➖ noise
62	duckdb:vortex-compact	-7.1%	-4.1%	-3.1%	+26.7%	➖ noise
62	duckdb:vortex-file-compressed	-3.8%	-4.1%	+0.4%	+18.7%	➖ noise
63	datafusion:vortex-compact	-15.5%	+0.9%	-16.3%	+12.0%	✅ faster
63	datafusion:vortex-file-compressed	+9.0%	+0.9%	+8.0%	+11.5%	➖ noise
63	duckdb:duckdb	-9.2%	+0.9%	-10.0%	+11.5%	➖ noise
63	duckdb:vortex-compact	-1.5%	+0.9%	-2.4%	+11.5%	➖ noise
63	duckdb:vortex-file-compressed	-3.5%	+0.9%	-4.3%	+13.1%	➖ noise
64	datafusion:vortex-compact	-12.4%	-4.3%	-8.5%	+11.5%	➖ noise
64	datafusion:vortex-file-compressed	+1.4%	-4.3%	+6.0%	+11.5%	➖ noise
64	duckdb:duckdb	-0.2%	-4.3%	+4.3%	+11.5%	➖ noise
64	duckdb:vortex-compact	-5.6%	-4.3%	-1.4%	+11.5%	➖ noise
64	duckdb:vortex-file-compressed	+2.1%	-4.3%	+6.7%	+11.5%	➖ noise
65	datafusion:vortex-compact	-18.4%	-1.1%	-17.5%	+12.7%	✅ faster
65	datafusion:vortex-file-compressed	-2.2%	-1.1%	-1.1%	+11.5%	➖ noise
65	duckdb:duckdb	-11.5%	-1.1%	-10.5%	+17.0%	➖ noise
65	duckdb:vortex-compact	-3.3%	-1.1%	-2.2%	+11.5%	➖ noise
65	duckdb:vortex-file-compressed	+3.3%	-1.1%	+4.4%	+11.5%	➖ noise
66	datafusion:vortex-compact	-13.6%	-4.1%	-10.0%	+11.5%	➖ noise
66	datafusion:vortex-file-compressed	-4.8%	-4.1%	-0.8%	+11.5%	➖ noise
66	duckdb:duckdb	+0.3%	-4.1%	+4.6%	+16.6%	➖ noise
66	duckdb:vortex-compact	+3.3%	-4.1%	+7.7%	+12.6%	➖ noise
66	duckdb:vortex-file-compressed	+11.9%	-4.1%	+16.7%	+13.1%	🚨 regression
67	datafusion:vortex-compact	-14.9%	-5.0%	-10.4%	+11.5%	✅ faster
67	datafusion:vortex-file-compressed	+0.4%	-5.0%	+5.8%	+11.5%	➖ noise
67	duckdb:duckdb	-9.2%	-5.0%	-4.4%	+11.5%	➖ noise
67	duckdb:vortex-compact	-4.7%	-5.0%	+0.4%	+11.5%	➖ noise
67	duckdb:vortex-file-compressed	+4.3%	-5.0%	+9.8%	+11.5%	➖ noise
68	datafusion:vortex-compact	-12.4%	+0.2%	-12.6%	+11.5%	✅ faster
68	datafusion:vortex-file-compressed	-3.5%	+0.2%	-3.7%	+11.5%	➖ noise
68	duckdb:duckdb	-12.0%	+0.2%	-12.2%	+11.5%	✅ faster
68	duckdb:vortex-compact	-6.1%	+0.2%	-6.3%	+11.5%	➖ noise
68	duckdb:vortex-file-compressed	-1.0%	+0.2%	-1.2%	+11.5%	➖ noise
69	datafusion:vortex-compact	-12.5%	+0.4%	-12.9%	+11.5%	✅ faster
69	datafusion:vortex-file-compressed	+8.0%	+0.4%	+7.6%	+11.5%	➖ noise
69	duckdb:duckdb	-8.1%	+0.4%	-8.5%	+11.5%	➖ noise
69	duckdb:vortex-compact	-6.5%	+0.4%	-6.9%	+11.5%	➖ noise
69	duckdb:vortex-file-compressed	-3.6%	+0.4%	-4.0%	+11.5%	➖ noise
70	datafusion:vortex-compact	-11.6%	-3.0%	-8.8%	+11.5%	➖ noise
70	datafusion:vortex-file-compressed	-4.2%	-3.0%	-1.2%	+11.6%	➖ noise
70	duckdb:duckdb	-7.9%	-3.0%	-5.1%	+15.8%	➖ noise
70	duckdb:vortex-compact	-6.9%	-3.0%	-4.0%	+11.5%	➖ noise
70	duckdb:vortex-file-compressed	-0.4%	-3.0%	+2.6%	+11.5%	➖ noise
71	datafusion:vortex-compact	-12.8%	+4.0%	-16.1%	+11.5%	✅ faster
71	datafusion:vortex-file-compressed	+2.8%	+4.0%	-1.2%	+11.5%	➖ noise
71	duckdb:duckdb	+0.2%	+4.0%	-3.6%	+14.9%	➖ noise
71	duckdb:vortex-compact	-7.8%	+4.0%	-11.4%	+12.2%	✅ faster
71	duckdb:vortex-file-compressed	+5.1%	+4.0%	+1.1%	+16.9%	➖ noise
72	datafusion:vortex-compact	-0.4%	+1.5%	-1.9%	+11.5%	➖ noise
72	datafusion:vortex-file-compressed	+3.4%	+1.5%	+1.9%	+11.5%	➖ noise
72	duckdb:duckdb	+0.9%	+1.5%	-0.6%	+12.1%	➖ noise
72	duckdb:vortex-compact	-1.3%	+1.5%	-2.8%	+11.5%	➖ noise
72	duckdb:vortex-file-compressed	+1.9%	+1.5%	+0.4%	+11.5%	➖ noise
73	datafusion:vortex-compact	-5.8%	+0.8%	-6.6%	+17.7%	➖ noise
73	datafusion:vortex-file-compressed	+12.1%	+0.8%	+11.2%	+20.2%	➖ noise
73	duckdb:duckdb	-1.5%	+0.8%	-2.3%	+11.5%	➖ noise
73	duckdb:vortex-compact	-1.6%	+0.8%	-2.4%	+11.5%	➖ noise
73	duckdb:vortex-file-compressed	+0.0%	+0.8%	-0.8%	+11.5%	➖ noise
74	datafusion:vortex-compact	-5.7%	+1.8%	-7.4%	+11.5%	➖ noise
74	datafusion:vortex-file-compressed	+8.6%	+1.8%	+6.7%	+11.5%	➖ noise
74	duckdb:duckdb	-3.0%	+1.8%	-4.7%	+11.5%	➖ noise
74	duckdb:vortex-compact	-7.9%	+1.8%	-9.5%	+11.5%	➖ noise
74	duckdb:vortex-file-compressed	+3.1%	+1.8%	+1.3%	+11.5%	➖ noise
75	datafusion:vortex-compact	-5.5%	+2.7%	-7.9%	+11.5%	➖ noise
75	datafusion:vortex-file-compressed	+12.9%	+2.7%	+10.0%	+11.5%	➖ noise
75	duckdb:duckdb	-4.5%	+2.7%	-7.0%	+11.5%	➖ noise
75	duckdb:vortex-compact	-6.0%	+2.7%	-8.4%	+11.7%	➖ noise
75	duckdb:vortex-file-compressed	+4.0%	+2.7%	+1.2%	+12.7%	➖ noise
76	datafusion:vortex-compact	-3.1%	+9.6%	-11.6%	+11.5%	✅ faster
76	datafusion:vortex-file-compressed	+0.7%	+9.6%	-8.1%	+13.7%	➖ noise
76	duckdb:duckdb	-8.3%	+9.6%	-16.4%	+12.9%	✅ faster
76	duckdb:vortex-compact	-0.6%	+9.6%	-9.3%	+13.6%	➖ noise
76	duckdb:vortex-file-compressed	-8.2%	+9.6%	-16.3%	+22.1%	➖ noise
77	datafusion:vortex-compact	+4.4%	+3.7%	+0.7%	+19.3%	➖ noise
77	datafusion:vortex-file-compressed	+8.8%	+3.7%	+4.9%	+11.5%	➖ noise
77	duckdb:duckdb	-7.0%	+3.7%	-10.4%	+11.8%	➖ noise
77	duckdb:vortex-compact	-0.8%	+3.7%	-4.3%	+11.5%	➖ noise
77	duckdb:vortex-file-compressed	+24.1%	+3.7%	+19.7%	+11.5%	🚨 regression
78	datafusion:vortex-compact	-1.9%	+4.4%	-6.1%	+23.1%	➖ noise
78	datafusion:vortex-file-compressed	+12.3%	+4.4%	+7.6%	+11.5%	➖ noise
78	duckdb:duckdb	-3.1%	+4.4%	-7.1%	+11.5%	➖ noise
78	duckdb:vortex-compact	-2.1%	+4.4%	-6.2%	+11.5%	➖ noise
78	duckdb:vortex-file-compressed	-5.7%	+4.4%	-9.6%	+11.5%	➖ noise
79	datafusion:vortex-compact	+1.0%	+6.8%	-5.5%	+13.5%	➖ noise
79	datafusion:vortex-file-compressed	+12.7%	+6.8%	+5.5%	+11.5%	➖ noise
79	duckdb:duckdb	-18.9%	+6.8%	-24.1%	+11.5%	✅ faster
79	duckdb:vortex-compact	-6.6%	+6.8%	-12.5%	+11.5%	✅ faster
79	duckdb:vortex-file-compressed	-7.9%	+6.8%	-13.8%	+11.5%	✅ faster
80	datafusion:vortex-compact	-4.9%	+4.0%	-8.6%	+16.7%	➖ noise
80	datafusion:vortex-file-compressed	+11.9%	+4.0%	+7.6%	+11.5%	➖ noise
80	duckdb:duckdb	-0.7%	+4.0%	-4.6%	+11.5%	➖ noise
80	duckdb:vortex-compact	-8.4%	+4.0%	-12.0%	+11.5%	✅ faster
80	duckdb:vortex-file-compressed	-0.8%	+4.0%	-4.6%	+13.4%	➖ noise
81	datafusion:vortex-compact	-2.1%	+4.2%	-6.0%	+17.6%	➖ noise
81	datafusion:vortex-file-compressed	+9.9%	+4.2%	+5.5%	+11.5%	➖ noise
81	duckdb:duckdb	-14.0%	+4.2%	-17.4%	+11.5%	✅ faster
81	duckdb:vortex-compact	-11.4%	+4.2%	-15.0%	+11.5%	✅ faster
81	duckdb:vortex-file-compressed	-1.8%	+4.2%	-5.8%	+11.5%	➖ noise
82	datafusion:vortex-compact	-2.3%	+4.1%	-6.1%	+11.5%	➖ noise
82	datafusion:vortex-file-compressed	+14.0%	+4.1%	+9.5%	+11.5%	➖ noise
82	duckdb:duckdb	-1.0%	+4.1%	-4.9%	+15.9%	➖ noise
82	duckdb:vortex-compact	-3.5%	+4.1%	-7.3%	+11.5%	➖ noise
82	duckdb:vortex-file-compressed	-4.4%	+4.1%	-8.1%	+15.7%	➖ noise
83	datafusion:vortex-compact	-7.6%	+10.5%	-16.3%	+11.5%	✅ faster
83	datafusion:vortex-file-compressed	+11.7%	+10.5%	+1.1%	+11.5%	➖ noise
83	duckdb:duckdb	-5.4%	+10.5%	-14.4%	+12.5%	✅ faster
83	duckdb:vortex-compact	-7.4%	+10.5%	-16.2%	+11.5%	✅ faster
83	duckdb:vortex-file-compressed	+0.1%	+10.5%	-9.4%	+11.5%	➖ noise
84	datafusion:vortex-compact	-1.5%	+9.3%	-9.8%	+11.5%	➖ noise
84	datafusion:vortex-file-compressed	+11.3%	+9.3%	+1.9%	+15.1%	➖ noise
84	duckdb:duckdb	-14.5%	+9.3%	-21.7%	+11.5%	✅ faster
84	duckdb:vortex-compact	-11.1%	+9.3%	-18.6%	+11.5%	✅ faster
84	duckdb:vortex-file-compressed	-5.1%	+9.3%	-13.1%	+11.5%	✅ faster
85	datafusion:vortex-compact	-2.6%	+9.1%	-10.7%	+11.5%	✅ faster
85	datafusion:vortex-file-compressed	+16.8%	+9.1%	+7.1%	+11.5%	➖ noise
85	duckdb:duckdb	-8.0%	+9.1%	-15.7%	+11.5%	✅ faster
85	duckdb:vortex-compact	-9.0%	+9.1%	-16.6%	+11.5%	✅ faster
85	duckdb:vortex-file-compressed	-1.2%	+9.1%	-9.4%	+11.5%	➖ noise
86	datafusion:vortex-compact	-11.4%	+1.0%	-12.3%	+11.5%	✅ faster
86	datafusion:vortex-file-compressed	+14.7%	+1.0%	+13.5%	+11.5%	🚨 regression
86	duckdb:duckdb	-11.8%	+1.0%	-12.7%	+12.5%	✅ faster
86	duckdb:vortex-compact	-4.0%	+1.0%	-4.9%	+14.9%	➖ noise
86	duckdb:vortex-file-compressed	-5.2%	+1.0%	-6.1%	+15.7%	➖ noise
87	datafusion:vortex-compact	-2.5%	+2.2%	-4.6%	+11.5%	➖ noise
87	datafusion:vortex-file-compressed	+11.3%	+2.2%	+8.8%	+11.5%	➖ noise
87	duckdb:duckdb	-6.5%	+2.2%	-8.5%	+13.1%	➖ noise
87	duckdb:vortex-compact	-6.0%	+2.2%	-8.1%	+12.1%	➖ noise
87	duckdb:vortex-file-compressed	+6.4%	+2.2%	+4.1%	+11.5%	➖ noise
88	datafusion:vortex-compact	-2.4%	+5.2%	-7.2%	+11.5%	➖ noise
88	datafusion:vortex-file-compressed	+7.6%	+5.2%	+2.3%	+11.5%	➖ noise
88	duckdb:duckdb	-3.9%	+5.2%	-8.6%	+11.5%	➖ noise
88	duckdb:vortex-compact	-11.0%	+5.2%	-15.4%	+11.5%	✅ faster
88	duckdb:vortex-file-compressed	+3.2%	+5.2%	-1.9%	+11.5%	➖ noise
89	datafusion:vortex-compact	+5.9%	+4.1%	+1.8%	+11.5%	➖ noise
89	datafusion:vortex-file-compressed	+9.6%	+4.1%	+5.3%	+11.5%	➖ noise
89	duckdb:duckdb	-5.5%	+4.1%	-9.2%	+11.5%	➖ noise
89	duckdb:vortex-compact	-6.0%	+4.1%	-9.7%	+11.6%	➖ noise
89	duckdb:vortex-file-compressed	+3.3%	+4.1%	-0.8%	+11.5%	➖ noise
90	datafusion:vortex-compact	-2.3%	+4.1%	-6.1%	+12.1%	➖ noise
90	datafusion:vortex-file-compressed	+12.1%	+4.1%	+7.7%	+11.5%	➖ noise
90	duckdb:duckdb	-6.5%	+4.1%	-10.2%	+13.5%	➖ noise
90	duckdb:vortex-compact	-1.8%	+4.1%	-5.7%	+11.5%	➖ noise
90	duckdb:vortex-file-compressed	+4.7%	+4.1%	+0.6%	+11.5%	➖ noise
91	datafusion:vortex-compact	-5.1%	+2.6%	-7.5%	+11.5%	➖ noise
91	datafusion:vortex-file-compressed	+19.7%	+2.6%	+16.7%	+11.5%	🚨 regression
91	duckdb:duckdb	-0.5%	+2.6%	-3.0%	+13.5%	➖ noise
91	duckdb:vortex-compact	-8.0%	+2.6%	-10.3%	+11.7%	➖ noise
91	duckdb:vortex-file-compressed	+0.6%	+2.6%	-1.9%	+11.5%	➖ noise
92	datafusion:vortex-compact	-6.9%	+1.2%	-8.0%	+11.5%	➖ noise
92	datafusion:vortex-file-compressed	+9.6%	+1.2%	+8.2%	+11.5%	➖ noise
92	duckdb:duckdb	-4.3%	+1.2%	-5.5%	+11.5%	➖ noise
92	duckdb:vortex-compact	-0.1%	+1.2%	-1.3%	+16.6%	➖ noise
92	duckdb:vortex-file-compressed	+5.9%	+1.2%	+4.6%	+12.8%	➖ noise
93	datafusion:vortex-compact	-4.3%	+5.0%	-8.8%	+14.3%	➖ noise
93	datafusion:vortex-file-compressed	+13.6%	+5.0%	+8.1%	+11.9%	➖ noise
93	duckdb:duckdb	+1.2%	+5.0%	-3.7%	+13.4%	➖ noise
93	duckdb:vortex-compact	-8.3%	+5.0%	-12.7%	+11.7%	✅ faster
93	duckdb:vortex-file-compressed	+9.3%	+5.0%	+4.1%	+11.5%	➖ noise
94	datafusion:vortex-compact	+3.2%	+3.9%	-0.7%	+11.5%	➖ noise
94	datafusion:vortex-file-compressed	+16.2%	+3.9%	+11.9%	+11.5%	🚨 regression
94	duckdb:duckdb	-3.4%	+3.9%	-7.1%	+12.4%	➖ noise
94	duckdb:vortex-compact	-13.4%	+3.9%	-16.7%	+13.6%	✅ faster
94	duckdb:vortex-file-compressed	+4.5%	+3.9%	+0.6%	+11.5%	➖ noise
95	datafusion:vortex-compact	-2.5%	+4.6%	-6.8%	+11.5%	➖ noise
95	datafusion:vortex-file-compressed	+9.5%	+4.6%	+4.7%	+11.5%	➖ noise
95	duckdb:duckdb	-6.5%	+4.6%	-10.6%	+18.6%	➖ noise
95	duckdb:vortex-compact	+5.3%	+4.6%	+0.7%	+15.2%	➖ noise
95	duckdb:vortex-file-compressed	+12.5%	+4.6%	+7.5%	+12.3%	➖ noise
96	datafusion:vortex-compact	-6.6%	+0.1%	-6.7%	+15.8%	➖ noise
96	datafusion:vortex-file-compressed	+11.3%	+0.1%	+11.3%	+12.2%	➖ noise
96	duckdb:duckdb	-12.7%	+0.1%	-12.8%	+14.9%	➖ noise
96	duckdb:vortex-compact	-4.8%	+0.1%	-4.8%	+28.8%	➖ noise
96	duckdb:vortex-file-compressed	-2.5%	+0.1%	-2.5%	+19.2%	➖ noise
97	datafusion:vortex-compact	-6.9%	+6.2%	-12.3%	+11.5%	✅ faster
97	datafusion:vortex-file-compressed	+21.0%	+6.2%	+13.9%	+11.5%	🚨 regression
97	duckdb:duckdb	-1.3%	+6.2%	-7.0%	+11.5%	➖ noise
97	duckdb:vortex-compact	-3.8%	+6.2%	-9.4%	+12.3%	➖ noise
97	duckdb:vortex-file-compressed	+8.0%	+6.2%	+1.7%	+13.6%	➖ noise
98	datafusion:vortex-compact	-13.7%	+1.9%	-15.3%	+11.5%	✅ faster
98	datafusion:vortex-file-compressed	+7.5%	+1.9%	+5.6%	+11.5%	➖ noise
98	duckdb:duckdb	-0.4%	+1.9%	-2.2%	+14.6%	➖ noise
98	duckdb:vortex-compact	-3.6%	+1.9%	-5.4%	+13.0%	➖ noise
98	duckdb:vortex-file-compressed	+3.8%	+1.9%	+1.9%	+11.5%	➖ noise
99	datafusion:vortex-compact	-19.5%	+6.8%	-24.6%	+13.0%	✅ faster
99	datafusion:vortex-file-compressed	+15.1%	+6.8%	+7.8%	+12.5%	➖ noise
99	duckdb:duckdb	+1.8%	+6.8%	-4.6%	+11.5%	➖ noise
99	duckdb:vortex-compact	-5.7%	+6.8%	-11.7%	+12.4%	✅ faster
99	duckdb:vortex-file-compressed	+14.6%	+6.8%	+7.3%	+31.0%	➖ noise

github-actions · 2026-03-13T13:22:20Z

Benchmarks: PolarSignals Profiling

Summary

Overall: 1.012x ➖
Vortex: 1.012x ➖

datafusion / vortex-file-compressed (1.012x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed	115407311	113777969	1.01
polarsignals_q01/datafusion:vortex-file-compressed	341996863	347823686	0.98
polarsignals_q02/datafusion:vortex-file-compressed	21656746	20987293	1.03
polarsignals_q03/datafusion:vortex-file-compressed	346495908	347291394	1.00
polarsignals_q04/datafusion:vortex-file-compressed	11837520	11567780	1.02
polarsignals_q05/datafusion:vortex-file-compressed	15823413	16130606	0.98
polarsignals_q06/datafusion:vortex-file-compressed	20387110	20479258	1.00
polarsignals_q07/datafusion:vortex-file-compressed	12803907	12239904	1.05
polarsignals_q08/datafusion:vortex-file-compressed	437420733	427776674	1.02
polarsignals_q09/datafusion:vortex-file-compressed	10635255	10314245	1.03

github-actions · 2026-03-13T13:22:20Z

Benchmarks: TPC-H SF=10 on NVME

Summary

Overall: 0.917x ➖
Vortex: 0.908x ➖
Parquet: 0.940x ➖

Verdict

No clear signal

Attributed Vortex impact: -3.2%
Confidence: low
Environment shift: -6.0%

Statistical Summary

Systemic shift (parquet controls): -6.0%
Control sigma: +2.2%
Residual noise: +1.9%
Median polish overall: -8.4%

datafusion / vortex-file-compressed (0.898x ✅, 11↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀	415852377	488285500	0.85
tpch_q02/datafusion:vortex-file-compressed	159148540	175473460	0.91
tpch_q03/datafusion:vortex-file-compressed 🚀	249798626	281998528	0.89
tpch_q04/datafusion:vortex-file-compressed	108382985	116042878	0.93
tpch_q05/datafusion:vortex-file-compressed 🚀	456383099	513841339	0.89
tpch_q06/datafusion:vortex-file-compressed	41315310	44485486	0.93
tpch_q07/datafusion:vortex-file-compressed 🚀	638905249	757781463	0.84
tpch_q08/datafusion:vortex-file-compressed 🚀	465630486	526170356	0.88
tpch_q09/datafusion:vortex-file-compressed 🚀	796887625	903782106	0.88
tpch_q10/datafusion:vortex-file-compressed	296062279	328552457	0.90
tpch_q11/datafusion:vortex-file-compressed 🚀	114225911	129385002	0.88
tpch_q12/datafusion:vortex-file-compressed	127463793	137437387	0.93
tpch_q13/datafusion:vortex-file-compressed	227668622	246195819	0.92
tpch_q14/datafusion:vortex-file-compressed	73906463	78138628	0.95
tpch_q15/datafusion:vortex-file-compressed	107633182	118475752	0.91
tpch_q16/datafusion:vortex-file-compressed	91586193	100730627	0.91
tpch_q17/datafusion:vortex-file-compressed 🚀	734674189	828636212	0.89
tpch_q18/datafusion:vortex-file-compressed 🚀	959565752	1090943052	0.88
tpch_q19/datafusion:vortex-file-compressed	131512473	134800656	0.98
tpch_q20/datafusion:vortex-file-compressed 🚀	196444733	225142955	0.87
tpch_q21/datafusion:vortex-file-compressed 🚀	753204198	881154262	0.85
tpch_q22/datafusion:vortex-file-compressed	59520348	66116940	0.90

datafusion / vortex-compact (0.902x ➖, 13↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	458231936	505308312	0.91
tpch_q02/datafusion:vortex-compact 🚀	160024931	179052501	0.89
tpch_q03/datafusion:vortex-compact 🚀	262535661	295804468	0.89
tpch_q04/datafusion:vortex-compact 🚀	126209231	143136485	0.88
tpch_q05/datafusion:vortex-compact 🚀	466653743	532375362	0.88
tpch_q06/datafusion:vortex-compact	63355024	69414499	0.91
tpch_q07/datafusion:vortex-compact 🚀	669494560	752311806	0.89
tpch_q08/datafusion:vortex-compact 🚀	473518444	530276390	0.89
tpch_q09/datafusion:vortex-compact 🚀	812133805	920619356	0.88
tpch_q10/datafusion:vortex-compact	324489826	357349645	0.91
tpch_q11/datafusion:vortex-compact	122805277	133761326	0.92
tpch_q12/datafusion:vortex-compact 🚀	181376125	201753240	0.90
tpch_q13/datafusion:vortex-compact	272667481	296455319	0.92
tpch_q14/datafusion:vortex-compact	89630820	96152488	0.93
tpch_q15/datafusion:vortex-compact 🚀	164498324	185585587	0.89
tpch_q16/datafusion:vortex-compact	98961150	105058893	0.94
tpch_q17/datafusion:vortex-compact 🚀	739616965	825836062	0.90
tpch_q18/datafusion:vortex-compact 🚀	973606657	1107000406	0.88
tpch_q19/datafusion:vortex-compact 🚀	217928781	244662998	0.89
tpch_q20/datafusion:vortex-compact	229692867	248503458	0.92
tpch_q21/datafusion:vortex-compact 🚀	799454520	893588740	0.89
tpch_q22/datafusion:vortex-compact	70891298	76179859	0.93

datafusion / parquet (0.924x ➖, 5↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	461841183	496049299	0.93
tpch_q02/datafusion:parquet	256461894	273544939	0.94
tpch_q03/datafusion:parquet	389094764	424722183	0.92
tpch_q04/datafusion:parquet	147896820	155106114	0.95
tpch_q05/datafusion:parquet	578717307	633396261	0.91
tpch_q06/datafusion:parquet	126351090	132014908	0.96
tpch_q07/datafusion:parquet	783338999	868440918	0.90
tpch_q08/datafusion:parquet	634503112	697402841	0.91
tpch_q09/datafusion:parquet 🚀	956407149	1067351868	0.90
tpch_q10/datafusion:parquet	597440889	648308613	0.92
tpch_q11/datafusion:parquet	197260761	205293188	0.96
tpch_q12/datafusion:parquet	243871315	250519629	0.97
tpch_q13/datafusion:parquet	339854067	354165210	0.96
tpch_q14/datafusion:parquet	205735251	211652830	0.97
tpch_q15/datafusion:parquet 🚀	262830357	306743343	0.86
tpch_q16/datafusion:parquet	177832710	188932441	0.94
tpch_q17/datafusion:parquet 🚀	829782158	929998254	0.89
tpch_q18/datafusion:parquet	1026610515	1135025441	0.90
tpch_q19/datafusion:parquet 🚀	321674141	379536063	0.85
tpch_q20/datafusion:parquet	368556900	400463245	0.92
tpch_q21/datafusion:parquet 🚀	888950467	990716647	0.90
tpch_q22/datafusion:parquet	222031609	226128290	0.98

datafusion / arrow (0.871x ✅, 17↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:arrow 🚀	720171059	815031861	0.88
tpch_q02/datafusion:arrow	198440624	212158600	0.94
tpch_q03/datafusion:arrow 🚀	544542560	643680388	0.85
tpch_q04/datafusion:arrow 🚀	397672668	477750972	0.83
tpch_q05/datafusion:arrow 🚀	1062635077	1200549886	0.89
tpch_q06/datafusion:arrow 🚀	316417573	377490924	0.84
tpch_q07/datafusion:arrow 🚀	1356624702	1587353570	0.85
tpch_q08/datafusion:arrow 🚀	1274118380	1452381454	0.88
tpch_q09/datafusion:arrow 🚀	1538718623	1742180785	0.88
tpch_q10/datafusion:arrow 🚀	672402984	778056121	0.86
tpch_q11/datafusion:arrow	178977291	192980724	0.93
tpch_q12/datafusion:arrow 🚀	742927503	832646265	0.89
tpch_q13/datafusion:arrow	531441678	562298568	0.95
tpch_q14/datafusion:arrow 🚀	357063013	439236461	0.81
tpch_q15/datafusion:arrow 🚀	740003427	923179047	0.80
tpch_q16/datafusion:arrow	120874783	133840060	0.90
tpch_q17/datafusion:arrow 🚀	1552369566	1752383590	0.89
tpch_q18/datafusion:arrow 🚀	2112252190	2390053160	0.88
tpch_q19/datafusion:arrow 🚀	582168284	656268986	0.89
tpch_q20/datafusion:arrow 🚀	551692576	661098349	0.83
tpch_q21/datafusion:arrow 🚀	3746908258	4617867220	0.81
tpch_q22/datafusion:arrow	178266723	196524072	0.91

duckdb / vortex-file-compressed (0.909x ➖, 6↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	176316636	186767634	0.94
tpch_q02/duckdb:vortex-file-compressed 🚀	50771568	59599609	0.85
tpch_q03/duckdb:vortex-file-compressed	128442651	140605706	0.91
tpch_q04/duckdb:vortex-file-compressed 🚀	148833172	166885415	0.89
tpch_q05/duckdb:vortex-file-compressed	130633853	144263256	0.91
tpch_q06/duckdb:vortex-file-compressed 🚀	49359062	55215065	0.89
tpch_q07/duckdb:vortex-file-compressed	146959190	159754656	0.92
tpch_q08/duckdb:vortex-file-compressed 🚀	171544223	206206826	0.83
tpch_q09/duckdb:vortex-file-compressed	332375632	361636746	0.92
tpch_q10/duckdb:vortex-file-compressed	152177881	166933369	0.91
tpch_q11/duckdb:vortex-file-compressed	35654523	38969116	0.91
tpch_q12/duckdb:vortex-file-compressed	93337473	103680460	0.90
tpch_q13/duckdb:vortex-file-compressed	247456298	260026051	0.95
tpch_q14/duckdb:vortex-file-compressed	70507787	73564536	0.96
tpch_q15/duckdb:vortex-file-compressed 🚀	95947163	108210359	0.89
tpch_q16/duckdb:vortex-file-compressed	78047346	84917117	0.92
tpch_q17/duckdb:vortex-file-compressed 🚀	101356711	113890470	0.89
tpch_q18/duckdb:vortex-file-compressed	280880542	310600918	0.90
tpch_q19/duckdb:vortex-file-compressed	90808422	95525438	0.95
tpch_q20/duckdb:vortex-file-compressed	166741257	184647741	0.90
tpch_q21/duckdb:vortex-file-compressed	556733793	609329325	0.91
tpch_q22/duckdb:vortex-file-compressed	76710742	81898148	0.94

duckdb / vortex-compact (0.924x ➖, 3↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	230351726	236109871	0.98
tpch_q02/duckdb:vortex-compact	58574065	61668200	0.95
tpch_q03/duckdb:vortex-compact	139398746	151632342	0.92
tpch_q04/duckdb:vortex-compact	176647826	193906463	0.91
tpch_q05/duckdb:vortex-compact 🚀	145419775	165287220	0.88
tpch_q06/duckdb:vortex-compact	83852244	90703378	0.92
tpch_q07/duckdb:vortex-compact	202827583	220380063	0.92
tpch_q08/duckdb:vortex-compact 🚀	188117860	219464059	0.86
tpch_q09/duckdb:vortex-compact	366099296	390385777	0.94
tpch_q10/duckdb:vortex-compact 🚀	184541571	208476475	0.89
tpch_q11/duckdb:vortex-compact	42604491	46569198	0.91
tpch_q12/duckdb:vortex-compact	206550251	221597501	0.93
tpch_q13/duckdb:vortex-compact	294651610	312483563	0.94
tpch_q14/duckdb:vortex-compact	106245272	112673365	0.94
tpch_q15/duckdb:vortex-compact	119532329	129383288	0.92
tpch_q16/duckdb:vortex-compact	85749753	93114957	0.92
tpch_q17/duckdb:vortex-compact	116383631	129104146	0.90
tpch_q18/duckdb:vortex-compact	301765590	318585155	0.95
tpch_q19/duckdb:vortex-compact	113846683	118948743	0.96
tpch_q20/duckdb:vortex-compact	207343041	221535471	0.94
tpch_q21/duckdb:vortex-compact	628604125	688082228	0.91
tpch_q22/duckdb:vortex-compact	89385977	94566796	0.95

duckdb / parquet (0.956x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	258769659	257488989	1.00
tpch_q02/duckdb:parquet	105274947	109684663	0.96
tpch_q03/duckdb:parquet	208884092	223048588	0.94
tpch_q04/duckdb:parquet	133254676	140485527	0.95
tpch_q05/duckdb:parquet	217653146	230734435	0.94
tpch_q06/duckdb:parquet	68063786	69191599	0.98
tpch_q07/duckdb:parquet	182706418	188310312	0.97
tpch_q08/duckdb:parquet	255519340	273425288	0.93
tpch_q09/duckdb:parquet	457535088	479138792	0.95
tpch_q10/duckdb:parquet	602679007	630229692	0.96
tpch_q11/duckdb:parquet	40684731	44574015	0.91
tpch_q12/duckdb:parquet	124421564	133333908	0.93
tpch_q13/duckdb:parquet	437022471	469031305	0.93
tpch_q14/duckdb:parquet	171885609	173289894	0.99
tpch_q15/duckdb:parquet	98271713	103713775	0.95
tpch_q16/duckdb:parquet	161910166	169248016	0.96
tpch_q17/duckdb:parquet	177044371	184432150	0.96
tpch_q18/duckdb:parquet	347157261	362083853	0.96
tpch_q19/duckdb:parquet	288408560	289462837	1.00
tpch_q20/duckdb:parquet	222933254	234049435	0.95
tpch_q21/duckdb:parquet	564586045	606681416	0.93
tpch_q22/duckdb:parquet	289165723	296909571	0.97

duckdb / duckdb (0.958x ➖, 1↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:duckdb	117474870	118431716	0.99
tpch_q02/duckdb:duckdb	48473561	47863105	1.01
tpch_q03/duckdb:duckdb	96607885	101250817	0.95
tpch_q04/duckdb:duckdb	131932029	141622705	0.93
tpch_q05/duckdb:duckdb	110252306	117104506	0.94
tpch_q06/duckdb:duckdb	39246059	38449925	1.02
tpch_q07/duckdb:duckdb	86530989	89049897	0.97
tpch_q08/duckdb:duckdb	110288378	117070496	0.94
tpch_q09/duckdb:duckdb	278069464	289436123	0.96
tpch_q10/duckdb:duckdb	204452008	215301736	0.95
tpch_q11/duckdb:duckdb 🚀	15364204	18254757	0.84
tpch_q12/duckdb:duckdb	83775095	87767534	0.95
tpch_q13/duckdb:duckdb	252738321	265617192	0.95
tpch_q14/duckdb:duckdb	69673617	73961005	0.94
tpch_q15/duckdb:duckdb	79769956	81591735	0.98
tpch_q16/duckdb:duckdb	72360599	77149154	0.94
tpch_q17/duckdb:duckdb	85653718	85977001	1.00
tpch_q18/duckdb:duckdb	213045018	225093688	0.95
tpch_q19/duckdb:duckdb	114388364	120566286	0.95
tpch_q20/duckdb:duckdb	111956406	114572711	0.98
tpch_q21/duckdb:duckdb	294089653	320275415	0.92
tpch_q22/duckdb:duckdb	69586344	68393051	1.02

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:arrow	-11.6%	-3.3%	-8.7%	+11.4%	➖ noise
1	datafusion:vortex-compact	-9.3%	-3.3%	-6.3%	+13.5%	➖ noise
1	datafusion:vortex-file-compressed	-14.8%	-3.3%	-12.0%	+13.5%	✅ faster
1	duckdb:duckdb	-0.8%	-3.3%	+2.5%	+11.5%	➖ noise
1	duckdb:vortex-compact	-2.4%	-3.3%	+0.9%	+11.5%	➖ noise
1	duckdb:vortex-file-compressed	-5.6%	-3.3%	-2.4%	+12.2%	➖ noise
2	datafusion:arrow	-6.5%	-5.1%	-1.4%	+10.0%	➖ noise
2	datafusion:vortex-compact	-10.6%	-5.1%	-5.8%	+10.0%	➖ noise
2	datafusion:vortex-file-compressed	-9.3%	-5.1%	-4.4%	+10.0%	➖ noise
2	duckdb:duckdb	+1.3%	-5.1%	+6.8%	+16.7%	➖ noise
2	duckdb:vortex-compact	-5.0%	-5.1%	+0.1%	+10.0%	➖ noise
2	duckdb:vortex-file-compressed	-14.8%	-5.1%	-10.2%	+10.2%	✅ faster
3	datafusion:arrow	-15.4%	-7.4%	-8.7%	+10.0%	➖ noise
3	datafusion:vortex-compact	-11.2%	-7.4%	-4.2%	+10.0%	➖ noise
3	datafusion:vortex-file-compressed	-11.4%	-7.4%	-4.4%	+10.0%	➖ noise
3	duckdb:duckdb	-4.6%	-7.4%	+3.0%	+10.0%	➖ noise
3	duckdb:vortex-compact	-8.1%	-7.4%	-0.7%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	-8.7%	-7.4%	-1.4%	+10.0%	➖ noise
4	datafusion:arrow	-16.8%	-4.9%	-12.5%	+10.0%	✅ faster
4	datafusion:vortex-compact	-11.8%	-4.9%	-7.3%	+10.0%	➖ noise
4	datafusion:vortex-file-compressed	-6.6%	-4.9%	-1.8%	+10.0%	➖ noise
4	duckdb:duckdb	-6.8%	-4.9%	-2.0%	+10.0%	➖ noise
4	duckdb:vortex-compact	-8.9%	-4.9%	-4.2%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-10.8%	-4.9%	-6.2%	+10.0%	➖ noise
5	datafusion:arrow	-11.5%	-7.2%	-4.7%	+10.0%	➖ noise
5	datafusion:vortex-compact	-12.3%	-7.2%	-5.6%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	-11.2%	-7.2%	-4.3%	+10.0%	➖ noise
5	duckdb:duckdb	-5.9%	-7.2%	+1.4%	+10.0%	➖ noise
5	duckdb:vortex-compact	-12.0%	-7.2%	-5.2%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	-9.4%	-7.2%	-2.5%	+10.0%	➖ noise
6	datafusion:arrow	-16.2%	-3.0%	-13.6%	+10.0%	✅ faster
6	datafusion:vortex-compact	-8.7%	-3.0%	-5.9%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	-7.1%	-3.0%	-4.3%	+10.0%	➖ noise
6	duckdb:duckdb	+2.1%	-3.0%	+5.2%	+16.6%	➖ noise
6	duckdb:vortex-compact	-7.6%	-3.0%	-4.7%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	-10.6%	-3.0%	-7.9%	+10.4%	➖ noise
7	datafusion:arrow	-14.5%	-6.4%	-8.6%	+10.0%	➖ noise
7	datafusion:vortex-compact	-11.0%	-6.4%	-4.9%	+10.0%	➖ noise
7	datafusion:vortex-file-compressed	-15.7%	-6.4%	-9.9%	+10.0%	✅ faster
7	duckdb:duckdb	-2.8%	-6.4%	+3.9%	+10.0%	➖ noise
7	duckdb:vortex-compact	-8.0%	-6.4%	-1.6%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	-8.0%	-6.4%	-1.7%	+10.0%	➖ noise
8	datafusion:arrow	-12.3%	-7.8%	-4.9%	+10.0%	➖ noise
8	datafusion:vortex-compact	-10.7%	-7.8%	-3.2%	+10.0%	➖ noise
8	datafusion:vortex-file-compressed	-11.5%	-7.8%	-4.0%	+10.0%	➖ noise
8	duckdb:duckdb	-5.8%	-7.8%	+2.2%	+10.0%	➖ noise
8	duckdb:vortex-compact	-14.3%	-7.8%	-7.0%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-16.8%	-7.8%	-9.8%	+10.0%	✅ faster
9	datafusion:arrow	-11.7%	-7.5%	-4.5%	+10.0%	➖ noise
9	datafusion:vortex-compact	-11.8%	-7.5%	-4.6%	+10.0%	➖ noise
9	datafusion:vortex-file-compressed	-11.8%	-7.5%	-4.7%	+10.0%	➖ noise
9	duckdb:duckdb	-3.9%	-7.5%	+3.9%	+10.0%	➖ noise
9	duckdb:vortex-compact	-6.2%	-7.5%	+1.4%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	-8.1%	-7.5%	-0.6%	+10.0%	➖ noise
10	datafusion:arrow	-13.6%	-6.1%	-7.9%	+10.0%	➖ noise
10	datafusion:vortex-compact	-9.2%	-6.1%	-3.3%	+10.0%	➖ noise
10	datafusion:vortex-file-compressed	-9.9%	-6.1%	-4.0%	+10.0%	➖ noise
10	duckdb:duckdb	-5.0%	-6.1%	+1.2%	+10.0%	➖ noise
10	duckdb:vortex-compact	-11.5%	-6.1%	-5.7%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-8.8%	-6.1%	-2.9%	+10.0%	➖ noise
11	datafusion:arrow	-7.3%	-6.3%	-1.0%	+12.5%	➖ noise
11	datafusion:vortex-compact	-8.2%	-6.3%	-2.0%	+12.4%	➖ noise
11	datafusion:vortex-file-compressed	-11.7%	-6.3%	-5.7%	+12.9%	➖ noise
11	duckdb:duckdb	-15.8%	-6.3%	-10.1%	+21.0%	➖ noise
11	duckdb:vortex-compact	-8.5%	-6.3%	-2.3%	+21.1%	➖ noise
11	duckdb:vortex-file-compressed	-8.5%	-6.3%	-2.3%	+15.8%	➖ noise
12	datafusion:arrow	-10.8%	-4.7%	-6.4%	+40.3%	➖ noise
12	datafusion:vortex-compact	-10.1%	-4.7%	-5.7%	+10.0%	➖ noise
12	datafusion:vortex-file-compressed	-7.3%	-4.7%	-2.7%	+10.0%	➖ noise
12	duckdb:duckdb	-4.5%	-4.7%	+0.1%	+10.0%	➖ noise
12	duckdb:vortex-compact	-6.8%	-4.7%	-2.2%	+10.0%	➖ noise
12	duckdb:vortex-file-compressed	-10.0%	-4.7%	-5.5%	+10.0%	➖ noise
13	datafusion:arrow	-5.5%	-5.4%	-0.0%	+10.4%	➖ noise
13	datafusion:vortex-compact	-8.0%	-5.4%	-2.7%	+10.0%	➖ noise
13	datafusion:vortex-file-compressed	-7.5%	-5.4%	-2.2%	+10.0%	➖ noise
13	duckdb:duckdb	-4.8%	-5.4%	+0.6%	+10.0%	➖ noise
13	duckdb:vortex-compact	-5.7%	-5.4%	-0.3%	+10.0%	➖ noise
13	duckdb:vortex-file-compressed	-4.8%	-5.4%	+0.6%	+10.0%	➖ noise
14	datafusion:arrow	-18.7%	-1.8%	-17.2%	+10.0%	✅ faster
14	datafusion:vortex-compact	-6.8%	-1.8%	-5.1%	+10.0%	➖ noise
14	datafusion:vortex-file-compressed	-5.4%	-1.8%	-3.7%	+10.0%	➖ noise
14	duckdb:duckdb	-5.8%	-1.8%	-4.1%	+10.0%	➖ noise
14	duckdb:vortex-compact	-5.7%	-1.8%	-4.0%	+10.0%	➖ noise
14	duckdb:vortex-file-compressed	-4.2%	-1.8%	-2.4%	+10.0%	➖ noise
15	datafusion:arrow	-19.8%	-9.9%	-11.0%	+10.0%	✅ faster
15	datafusion:vortex-compact	-11.4%	-9.9%	-1.6%	+10.0%	➖ noise
15	datafusion:vortex-file-compressed	-9.2%	-9.9%	+0.8%	+10.0%	➖ noise
15	duckdb:duckdb	-2.2%	-9.9%	+8.5%	+10.0%	➖ noise
15	duckdb:vortex-compact	-7.6%	-9.9%	+2.5%	+10.0%	➖ noise
15	duckdb:vortex-file-compressed	-11.3%	-9.9%	-1.6%	+10.0%	➖ noise
16	datafusion:arrow	-9.7%	-5.1%	-4.8%	+10.0%	➖ noise
16	datafusion:vortex-compact	-5.8%	-5.1%	-0.7%	+10.0%	➖ noise
16	datafusion:vortex-file-compressed	-9.1%	-5.1%	-4.2%	+10.0%	➖ noise
16	duckdb:duckdb	-6.2%	-5.1%	-1.2%	+10.0%	➖ noise
16	duckdb:vortex-compact	-7.9%	-5.1%	-3.0%	+10.0%	➖ noise
16	duckdb:vortex-file-compressed	-8.1%	-5.1%	-3.1%	+10.0%	➖ noise
17	datafusion:arrow	-11.4%	-7.5%	-4.3%	+10.0%	➖ noise
17	datafusion:vortex-compact	-10.4%	-7.5%	-3.2%	+10.0%	➖ noise
17	datafusion:vortex-file-compressed	-11.3%	-7.5%	-4.2%	+10.0%	➖ noise
17	duckdb:duckdb	-0.4%	-7.5%	+7.6%	+10.0%	➖ noise
17	duckdb:vortex-compact	-9.9%	-7.5%	-2.6%	+10.0%	➖ noise
17	duckdb:vortex-file-compressed	-11.0%	-7.5%	-3.8%	+10.0%	➖ noise
18	datafusion:arrow	-11.6%	-6.9%	-5.1%	+12.4%	➖ noise
18	datafusion:vortex-compact	-12.1%	-6.9%	-5.6%	+10.0%	➖ noise
18	datafusion:vortex-file-compressed	-12.0%	-6.9%	-5.5%	+10.0%	➖ noise
18	duckdb:duckdb	-5.4%	-6.9%	+1.6%	+10.0%	➖ noise
18	duckdb:vortex-compact	-5.3%	-6.9%	+1.7%	+10.0%	➖ noise
18	duckdb:vortex-file-compressed	-9.6%	-6.9%	-2.9%	+10.0%	➖ noise
19	datafusion:arrow	-11.3%	-8.1%	-3.5%	+10.0%	➖ noise
19	datafusion:vortex-compact	-10.9%	-8.1%	-3.1%	+10.0%	➖ noise
19	datafusion:vortex-file-compressed	-2.4%	-8.1%	+6.2%	+10.0%	➖ noise
19	duckdb:duckdb	-5.1%	-8.1%	+3.2%	+10.0%	➖ noise
19	duckdb:vortex-compact	-4.3%	-8.1%	+4.2%	+10.0%	➖ noise
19	duckdb:vortex-file-compressed	-4.9%	-8.1%	+3.4%	+10.0%	➖ noise
20	datafusion:arrow	-16.5%	-6.4%	-10.9%	+12.7%	➖ noise
20	datafusion:vortex-compact	-7.6%	-6.4%	-1.3%	+10.0%	➖ noise
20	datafusion:vortex-file-compressed	-12.7%	-6.4%	-6.8%	+10.0%	➖ noise
20	duckdb:duckdb	-2.3%	-6.4%	+4.4%	+10.0%	➖ noise
20	duckdb:vortex-compact	-6.4%	-6.4%	-0.0%	+10.0%	➖ noise
20	duckdb:vortex-file-compressed	-9.7%	-6.4%	-3.6%	+10.0%	➖ noise
21	datafusion:arrow	-18.9%	-8.6%	-11.2%	+10.0%	✅ faster
21	datafusion:vortex-compact	-10.5%	-8.6%	-2.1%	+10.0%	➖ noise
21	datafusion:vortex-file-compressed	-14.5%	-8.6%	-6.5%	+10.0%	➖ noise
21	duckdb:duckdb	-8.2%	-8.6%	+0.5%	+10.0%	➖ noise
21	duckdb:vortex-compact	-8.6%	-8.6%	-0.0%	+10.0%	➖ noise
21	duckdb:vortex-file-compressed	-8.6%	-8.6%	-0.0%	+10.0%	➖ noise
22	datafusion:arrow	-9.3%	-2.2%	-7.2%	+10.0%	➖ noise
22	datafusion:vortex-compact	-6.9%	-2.2%	-4.8%	+10.0%	➖ noise
22	datafusion:vortex-file-compressed	-10.0%	-2.2%	-7.9%	+10.0%	➖ noise
22	duckdb:duckdb	+1.7%	-2.2%	+4.0%	+10.0%	➖ noise
22	duckdb:vortex-compact	-5.5%	-2.2%	-3.3%	+10.0%	➖ noise
22	duckdb:vortex-file-compressed	-6.3%	-2.2%	-4.2%	+10.0%	➖ noise

github-actions · 2026-03-13T13:24:15Z

Benchmarks: Clickbench on NVME

Summary

Overall: 1.008x ➖
Vortex: 1.001x ➖
Parquet: 0.999x ➖

Verdict

No clear signal

Attributed Vortex impact: +1.5%
Confidence: low
Environment shift: -0.1%

Statistical Summary

Systemic shift (parquet controls): -0.1%
Control sigma: +2.3%
Residual noise: +2.2%
Median polish overall: +0.6%

datafusion / vortex-file-compressed (1.005x ➖, 1↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed	1647558	1721085	0.96
clickbench_q01/datafusion:vortex-file-compressed	13338581	13321860	1.00
clickbench_q02/datafusion:vortex-file-compressed	32519132	33302791	0.98
clickbench_q03/datafusion:vortex-file-compressed	37376869	35838964	1.04
clickbench_q04/datafusion:vortex-file-compressed	333725269	327913019	1.02
clickbench_q05/datafusion:vortex-file-compressed	323994672	316070566	1.03
clickbench_q06/datafusion:vortex-file-compressed 🚀	1815719	2346062	0.77
clickbench_q07/datafusion:vortex-file-compressed	17931249	19794170	0.91
clickbench_q08/datafusion:vortex-file-compressed	396714039	391210620	1.01
clickbench_q09/datafusion:vortex-file-compressed	589187494	583938734	1.01
clickbench_q10/datafusion:vortex-file-compressed	70147862	76448405	0.92
clickbench_q11/datafusion:vortex-file-compressed	82321337	83722522	0.98
clickbench_q12/datafusion:vortex-file-compressed	281136587	272370878	1.03
clickbench_q13/datafusion:vortex-file-compressed	420612802	415644879	1.01
clickbench_q14/datafusion:vortex-file-compressed	255639114	253231154	1.01
clickbench_q15/datafusion:vortex-file-compressed	376345559	379665958	0.99
clickbench_q16/datafusion:vortex-file-compressed	735245852	728491294	1.01
clickbench_q17/datafusion:vortex-file-compressed	725394541	732628199	0.99
clickbench_q18/datafusion:vortex-file-compressed	1466281279	1437218177	1.02
clickbench_q19/datafusion:vortex-file-compressed	23394120	25265899	0.93
clickbench_q20/datafusion:vortex-file-compressed	366595705	338934820	1.08
clickbench_q21/datafusion:vortex-file-compressed	422826375	395645021	1.07
clickbench_q22/datafusion:vortex-file-compressed	580444700	558190458	1.04
clickbench_q23/datafusion:vortex-file-compressed	629357157	635432983	0.99
clickbench_q24/datafusion:vortex-file-compressed	50486306	48032359	1.05
clickbench_q25/datafusion:vortex-file-compressed	72357302	69175874	1.05
clickbench_q26/datafusion:vortex-file-compressed	53228266	50525111	1.05
clickbench_q27/datafusion:vortex-file-compressed	823071156	796017890	1.03
clickbench_q28/datafusion:vortex-file-compressed	6884952887	6821241989	1.01
clickbench_q29/datafusion:vortex-file-compressed	245882273	245496686	1.00
clickbench_q30/datafusion:vortex-file-compressed	260226290	254567176	1.02
clickbench_q31/datafusion:vortex-file-compressed	300635278	292163071	1.03
clickbench_q32/datafusion:vortex-file-compressed	1378519180	1266288826	1.09
clickbench_q33/datafusion:vortex-file-compressed	1477573942	1433180193	1.03
clickbench_q34/datafusion:vortex-file-compressed	1487832545	1414755953	1.05
clickbench_q35/datafusion:vortex-file-compressed	535642960	532109030	1.01
clickbench_q36/datafusion:vortex-file-compressed	85016112	78996661	1.08
clickbench_q37/datafusion:vortex-file-compressed	38154100	38598754	0.99
clickbench_q38/datafusion:vortex-file-compressed	24015220	24294276	0.99
clickbench_q39/datafusion:vortex-file-compressed	158007031	153688343	1.03
clickbench_q40/datafusion:vortex-file-compressed	20294517	20644830	0.98
clickbench_q41/datafusion:vortex-file-compressed	19215045	18861964	1.02
clickbench_q42/datafusion:vortex-file-compressed	21802122	22389509	0.97

datafusion / parquet (1.001x ➖, 1↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
clickbench_q00/datafusion:parquet 🚀	1720320	1930792	0.89
clickbench_q01/datafusion:parquet	21610869	21057243	1.03
clickbench_q02/datafusion:parquet	48541488	49933135	0.97
clickbench_q03/datafusion:parquet	39559822	43281315	0.91
clickbench_q04/datafusion:parquet	347877683	359383082	0.97
clickbench_q05/datafusion:parquet	392856119	378614000	1.04
clickbench_q06/datafusion:parquet	1539017	1601770	0.96
clickbench_q07/datafusion:parquet	26592808	27910768	0.95
clickbench_q08/datafusion:parquet	425017191	418949935	1.01
clickbench_q09/datafusion:parquet	661872190	666517656	0.99
clickbench_q10/datafusion:parquet	120221622	117668756	1.02
clickbench_q11/datafusion:parquet	146139591	145618707	1.00
clickbench_q12/datafusion:parquet	382673938	373322274	1.03
clickbench_q13/datafusion:parquet	533506082	528772571	1.01
clickbench_q14/datafusion:parquet	382601915	381392329	1.00
clickbench_q15/datafusion:parquet	401556838	402566687	1.00
clickbench_q16/datafusion:parquet	766372305	732189511	1.05
clickbench_q17/datafusion:parquet	758758653	727602679	1.04
clickbench_q18/datafusion:parquet	1561864173	1693478354	0.92
clickbench_q19/datafusion:parquet	33852823	35725939	0.95
clickbench_q20/datafusion:parquet	643169652	616125863	1.04
clickbench_q21/datafusion:parquet	700582754	676803723	1.04
clickbench_q22/datafusion:parquet	1023688120	980318715	1.04
clickbench_q23/datafusion:parquet	3837625724	3795432941	1.01
clickbench_q24/datafusion:parquet	96801901	95618630	1.01
clickbench_q25/datafusion:parquet	152113637	151526727	1.00
clickbench_q26/datafusion:parquet	96400063	94986590	1.01
clickbench_q27/datafusion:parquet	1081803589	1059707811	1.02
clickbench_q28/datafusion:parquet	6636948044	6623334451	1.00
clickbench_q29/datafusion:parquet	241328238	244129009	0.99
clickbench_q30/datafusion:parquet	390354576	384896783	1.01
clickbench_q31/datafusion:parquet	422302006	412394750	1.02
clickbench_q32/datafusion:parquet	1295723336	1277552026	1.01
clickbench_q33/datafusion:parquet	1592205906	1575658706	1.01
clickbench_q34/datafusion:parquet	1590259340	1551124301	1.03
clickbench_q35/datafusion:parquet	566952679	550395961	1.03
clickbench_q36/datafusion:parquet	153900993	146184997	1.05
clickbench_q37/datafusion:parquet	59636456	59672078	1.00
clickbench_q38/datafusion:parquet	93144896	99735353	0.93
clickbench_q39/datafusion:parquet	291963918	283396685	1.03
clickbench_q40/datafusion:parquet	36748435	35891007	1.02
clickbench_q41/datafusion:parquet	30093109	30667101	0.98
clickbench_q42/datafusion:parquet	32253400	32136473	1.00

duckdb / vortex-file-compressed (0.998x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed	6011631	6056617	0.99
clickbench_q01/duckdb:vortex-file-compressed	12981955	13726193	0.95
clickbench_q02/duckdb:vortex-file-compressed	24217070	23844711	1.02
clickbench_q03/duckdb:vortex-file-compressed	30448103	29983975	1.02
clickbench_q04/duckdb:vortex-file-compressed	171600351	174748096	0.98
clickbench_q05/duckdb:vortex-file-compressed	196608145	200281453	0.98
clickbench_q06/duckdb:vortex-file-compressed	19365402	19154948	1.01
clickbench_q07/duckdb:vortex-file-compressed	15160868	15939751	0.95
clickbench_q08/duckdb:vortex-file-compressed	262631728	265945358	0.99
clickbench_q09/duckdb:vortex-file-compressed	373814871	376764569	0.99
clickbench_q10/duckdb:vortex-file-compressed	73104222	75103927	0.97
clickbench_q11/duckdb:vortex-file-compressed	81493340	82322719	0.99
clickbench_q12/duckdb:vortex-file-compressed	212328576	215262328	0.99
clickbench_q13/duckdb:vortex-file-compressed	429769290	438319742	0.98
clickbench_q14/duckdb:vortex-file-compressed	242226391	240689505	1.01
clickbench_q15/duckdb:vortex-file-compressed	212073617	215780006	0.98
clickbench_q16/duckdb:vortex-file-compressed	633747350	659440107	0.96
clickbench_q17/duckdb:vortex-file-compressed	557579744	522723017	1.07
clickbench_q18/duckdb:vortex-file-compressed	1196262004	1169368246	1.02
clickbench_q19/duckdb:vortex-file-compressed	20124143	20951599	0.96
clickbench_q20/duckdb:vortex-file-compressed	374694434	355233556	1.05
clickbench_q21/duckdb:vortex-file-compressed	409475628	380717175	1.08
clickbench_q22/duckdb:vortex-file-compressed	745110040	705487735	1.06
clickbench_q23/duckdb:vortex-file-compressed	655635395	671531817	0.98
clickbench_q24/duckdb:vortex-file-compressed	50580981	50530978	1.00
clickbench_q25/duckdb:vortex-file-compressed	73210519	67465710	1.09
clickbench_q26/duckdb:vortex-file-compressed	45463635	45685815	1.00
clickbench_q27/duckdb:vortex-file-compressed	526913085	519006640	1.02
clickbench_q28/duckdb:vortex-file-compressed	3001044616	2984033493	1.01
clickbench_q29/duckdb:vortex-file-compressed	27536689	28355637	0.97
clickbench_q30/duckdb:vortex-file-compressed	193673904	192809362	1.00
clickbench_q31/duckdb:vortex-file-compressed	275443769	271403886	1.01
clickbench_q32/duckdb:vortex-file-compressed	1277268432	1192210012	1.07
clickbench_q33/duckdb:vortex-file-compressed	1497594625	1405666088	1.07
clickbench_q34/duckdb:vortex-file-compressed	1629260229	1547296035	1.05
clickbench_q35/duckdb:vortex-file-compressed	378059819	371278273	1.02
clickbench_q36/duckdb:vortex-file-compressed	30324934	31672792	0.96
clickbench_q37/duckdb:vortex-file-compressed	21899582	23281327	0.94
clickbench_q38/duckdb:vortex-file-compressed	22862775	24485411	0.93
clickbench_q39/duckdb:vortex-file-compressed	45938463	44281804	1.04
clickbench_q40/duckdb:vortex-file-compressed	21168522	22087095	0.96
clickbench_q41/duckdb:vortex-file-compressed	20264316	21666184	0.94
clickbench_q42/duckdb:vortex-file-compressed	24315528	26858456	0.91

duckdb / parquet (0.998x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
clickbench_q00/duckdb:parquet	218251687	223131015	0.98
clickbench_q01/duckdb:parquet	50470614	51328354	0.98
clickbench_q02/duckdb:parquet	65746523	66331152	0.99
clickbench_q03/duckdb:parquet	63393843	64617441	0.98
clickbench_q04/duckdb:parquet	205273937	204572511	1.00
clickbench_q05/duckdb:parquet	279587941	282949699	0.99
clickbench_q06/duckdb:parquet	60874109	60513441	1.01
clickbench_q07/duckdb:parquet	53312172	51179788	1.04
clickbench_q08/duckdb:parquet	270471765	270898369	1.00
clickbench_q09/duckdb:parquet	396809388	396338400	1.00
clickbench_q10/duckdb:parquet	95123915	95914308	0.99
clickbench_q11/duckdb:parquet	111092261	107687456	1.03
clickbench_q12/duckdb:parquet	298858336	297257198	1.01
clickbench_q13/duckdb:parquet	531628674	511294993	1.04
clickbench_q14/duckdb:parquet	332297247	332126829	1.00
clickbench_q15/duckdb:parquet	243039102	241648398	1.01
clickbench_q16/duckdb:parquet	614252153	613735083	1.00
clickbench_q17/duckdb:parquet	514157140	511336416	1.01
clickbench_q18/duckdb:parquet	1054585858	1060721656	0.99
clickbench_q19/duckdb:parquet	48979339	49864379	0.98
clickbench_q20/duckdb:parquet	435060658	441217267	0.99
clickbench_q21/duckdb:parquet	565309111	558322278	1.01
clickbench_q22/duckdb:parquet	937529472	928744462	1.01
clickbench_q23/duckdb:parquet	321891186	320728034	1.00
clickbench_q24/duckdb:parquet	76703789	78869315	0.97
clickbench_q25/duckdb:parquet	140975660	141970696	0.99
clickbench_q26/duckdb:parquet	50891594	52077872	0.98
clickbench_q27/duckdb:parquet	650302157	642160849	1.01
clickbench_q28/duckdb:parquet	4848488568	4829385673	1.00
clickbench_q29/duckdb:parquet	61145160	62009420	0.99
clickbench_q30/duckdb:parquet	304881910	306502338	0.99
clickbench_q31/duckdb:parquet	351615345	347517613	1.01
clickbench_q32/duckdb:parquet	1153726976	1181545230	0.98
clickbench_q33/duckdb:parquet	1259824839	1308878346	0.96
clickbench_q34/duckdb:parquet	1295237421	1311368449	0.99
clickbench_q35/duckdb:parquet	353972403	354613228	1.00
clickbench_q36/duckdb:parquet	64246365	63788330	1.01
clickbench_q37/duckdb:parquet	53223779	53892505	0.99
clickbench_q38/duckdb:parquet	57711665	58525338	0.99
clickbench_q39/duckdb:parquet	102684252	98178621	1.05
clickbench_q40/duckdb:parquet	54936124	56432880	0.97
clickbench_q41/duckdb:parquet	59274543	59110856	1.00
clickbench_q42/duckdb:parquet	52386483	53172618	0.99

duckdb / duckdb (1.040x ➖, 0↑ 5↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚨	20556424	17654069	1.16
clickbench_q01/duckdb:duckdb 🚨	36882863	32989984	1.12
clickbench_q02/duckdb:duckdb	49213538	45364491	1.08
clickbench_q03/duckdb:duckdb	50769271	47009842	1.08
clickbench_q04/duckdb:duckdb	211780343	215379562	0.98
clickbench_q05/duckdb:duckdb	319966652	310684006	1.03
clickbench_q06/duckdb:duckdb	38928552	35457193	1.10
clickbench_q07/duckdb:duckdb	38708565	36024039	1.07
clickbench_q08/duckdb:duckdb	303197841	302242290	1.00
clickbench_q09/duckdb:duckdb	470757976	484304746	0.97
clickbench_q10/duckdb:duckdb	99655236	97054777	1.03
clickbench_q11/duckdb:duckdb	108286001	107442164	1.01
clickbench_q12/duckdb:duckdb	296644192	291078227	1.02
clickbench_q13/duckdb:duckdb	528514010	516136455	1.02
clickbench_q14/duckdb:duckdb	342394784	346967495	0.99
clickbench_q15/duckdb:duckdb	255232136	256508841	1.00
clickbench_q16/duckdb:duckdb	685989655	686264058	1.00
clickbench_q17/duckdb:duckdb	569372932	579654239	0.98
clickbench_q18/duckdb:duckdb	1265977480	1254415446	1.01
clickbench_q19/duckdb:duckdb	38757759	35315957	1.10
clickbench_q20/duckdb:duckdb	876072614	827103769	1.06
clickbench_q21/duckdb:duckdb	880908774	922796618	0.95
clickbench_q22/duckdb:duckdb	1216057327	1129489199	1.08
clickbench_q23/duckdb:duckdb	253724286	252556695	1.00
clickbench_q24/duckdb:duckdb	64505690	60796410	1.06
clickbench_q25/duckdb:duckdb	130349305	122623543	1.06
clickbench_q26/duckdb:duckdb	60049135	56442783	1.06
clickbench_q27/duckdb:duckdb	1023093178	1017936239	1.01
clickbench_q28/duckdb:duckdb	4655677060	4645688670	1.00
clickbench_q29/duckdb:duckdb	52847813	49139461	1.08
clickbench_q30/duckdb:duckdb	293293132	287210231	1.02
clickbench_q31/duckdb:duckdb	424230363	424668238	1.00
clickbench_q32/duckdb:duckdb	1491391054	1438366665	1.04
clickbench_q33/duckdb:duckdb	1987408523	1911631283	1.04
clickbench_q34/duckdb:duckdb	2143714981	2013783261	1.06
clickbench_q35/duckdb:duckdb	264516176	264349730	1.00
clickbench_q36/duckdb:duckdb	40357151	41522413	0.97
clickbench_q37/duckdb:duckdb 🚨	34696268	31349280	1.11
clickbench_q38/duckdb:duckdb	33591159	30898153	1.09
clickbench_q39/duckdb:duckdb	61443404	64978578	0.95
clickbench_q40/duckdb:duckdb 🚨	35761216	31493538	1.14
clickbench_q41/duckdb:duckdb	34100507	31027810	1.10
clickbench_q42/duckdb:duckdb 🚨	35803728	31596068	1.13

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-file-compressed	-4.3%	-6.6%	+2.5%	+783.1%	➖ noise
0	duckdb:duckdb	+16.4%	-6.6%	+24.7%	+298.3%	➖ noise
0	duckdb:vortex-file-compressed	-0.7%	-6.6%	+6.3%	+345.0%	➖ noise
1	datafusion:vortex-file-compressed	+0.1%	+0.5%	-0.3%	+39.8%	➖ noise
1	duckdb:duckdb	+11.8%	+0.5%	+11.3%	+54.7%	➖ noise
1	duckdb:vortex-file-compressed	-5.4%	+0.5%	-5.9%	+17.6%	➖ noise
2	datafusion:vortex-file-compressed	-2.4%	-1.8%	-0.5%	+34.6%	➖ noise
2	duckdb:duckdb	+8.5%	-1.8%	+10.5%	+21.1%	➖ noise
2	duckdb:vortex-file-compressed	+1.6%	-1.8%	+3.5%	+16.5%	➖ noise
3	datafusion:vortex-file-compressed	+4.3%	-5.3%	+10.1%	+180.9%	➖ noise
3	duckdb:duckdb	+8.0%	-5.3%	+14.0%	+48.9%	➖ noise
3	duckdb:vortex-file-compressed	+1.5%	-5.3%	+7.2%	+33.4%	➖ noise
4	datafusion:vortex-file-compressed	+1.8%	-1.4%	+3.3%	+10.0%	➖ noise
4	duckdb:duckdb	-1.7%	-1.4%	-0.2%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-1.8%	-1.4%	-0.4%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	+2.5%	+1.3%	+1.2%	+10.0%	➖ noise
5	duckdb:duckdb	+3.0%	+1.3%	+1.7%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	-1.8%	+1.3%	-3.1%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	-22.6%	-1.7%	-21.3%	+32.0%	➖ noise
6	duckdb:duckdb	+9.8%	-1.7%	+11.7%	+30.2%	➖ noise
6	duckdb:vortex-file-compressed	+1.1%	-1.7%	+2.8%	+18.9%	➖ noise
7	datafusion:vortex-file-compressed	-9.4%	-0.4%	-9.1%	+16.2%	➖ noise
7	duckdb:duckdb	+7.5%	-0.4%	+7.9%	+12.8%	➖ noise
7	duckdb:vortex-file-compressed	-4.9%	-0.4%	-4.5%	+10.3%	➖ noise
8	datafusion:vortex-file-compressed	+1.4%	+0.6%	+0.8%	+10.0%	➖ noise
8	duckdb:duckdb	+0.3%	+0.6%	-0.3%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-1.2%	+0.6%	-1.9%	+10.0%	➖ noise
9	datafusion:vortex-file-compressed	+0.9%	-0.3%	+1.2%	+10.0%	➖ noise
9	duckdb:duckdb	-2.8%	-0.3%	-2.5%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	-0.8%	-0.3%	-0.5%	+10.0%	➖ noise
10	datafusion:vortex-file-compressed	-8.2%	+0.7%	-8.8%	+10.0%	➖ noise
10	duckdb:duckdb	+2.7%	+0.7%	+2.0%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-2.7%	+0.7%	-3.3%	+10.0%	➖ noise
11	datafusion:vortex-file-compressed	-1.7%	+1.8%	-3.4%	+10.0%	➖ noise
11	duckdb:duckdb	+0.8%	+1.8%	-0.9%	+10.0%	➖ noise
11	duckdb:vortex-file-compressed	-1.0%	+1.8%	-2.7%	+10.0%	➖ noise
12	datafusion:vortex-file-compressed	+3.2%	+1.5%	+1.7%	+10.0%	➖ noise
12	duckdb:duckdb	+1.9%	+1.5%	+0.4%	+10.0%	➖ noise
12	duckdb:vortex-file-compressed	-1.4%	+1.5%	-2.8%	+10.0%	➖ noise
13	datafusion:vortex-file-compressed	+1.2%	+2.4%	-1.2%	+10.0%	➖ noise
13	duckdb:duckdb	+2.4%	+2.4%	-0.0%	+10.0%	➖ noise
13	duckdb:vortex-file-compressed	-2.0%	+2.4%	-4.3%	+10.0%	➖ noise
14	datafusion:vortex-file-compressed	+1.0%	+0.2%	+0.8%	+10.0%	➖ noise
14	duckdb:duckdb	-1.3%	+0.2%	-1.5%	+10.0%	➖ noise
14	duckdb:vortex-file-compressed	+0.6%	+0.2%	+0.5%	+10.0%	➖ noise
15	datafusion:vortex-file-compressed	-0.9%	+0.2%	-1.0%	+10.0%	➖ noise
15	duckdb:duckdb	-0.5%	+0.2%	-0.7%	+10.0%	➖ noise
15	duckdb:vortex-file-compressed	-1.7%	+0.2%	-1.9%	+10.0%	➖ noise
16	datafusion:vortex-file-compressed	+0.9%	+2.4%	-1.4%	+10.0%	➖ noise
16	duckdb:duckdb	-0.0%	+2.4%	-2.3%	+10.0%	➖ noise
16	duckdb:vortex-file-compressed	-3.9%	+2.4%	-6.1%	+14.3%	➖ noise
17	datafusion:vortex-file-compressed	-1.0%	+2.4%	-3.3%	+10.0%	➖ noise
17	duckdb:duckdb	-1.8%	+2.4%	-4.1%	+10.0%	➖ noise
17	duckdb:vortex-file-compressed	+6.7%	+2.4%	+4.2%	+13.7%	➖ noise
18	datafusion:vortex-file-compressed	+2.0%	-4.2%	+6.5%	+10.0%	➖ noise
18	duckdb:duckdb	+0.9%	-4.2%	+5.4%	+10.0%	➖ noise
18	duckdb:vortex-file-compressed	+2.3%	-4.2%	+6.8%	+10.9%	➖ noise
19	datafusion:vortex-file-compressed	-7.4%	-3.5%	-4.0%	+15.1%	➖ noise
19	duckdb:duckdb	+9.7%	-3.5%	+13.8%	+16.0%	➖ noise
19	duckdb:vortex-file-compressed	-3.9%	-3.5%	-0.4%	+33.1%	➖ noise
20	datafusion:vortex-file-compressed	+8.2%	+1.5%	+6.6%	+195.8%	➖ noise
20	duckdb:duckdb	+5.9%	+1.5%	+4.4%	+28.3%	➖ noise
20	duckdb:vortex-file-compressed	+5.5%	+1.5%	+4.0%	+11.0%	➖ noise
21	datafusion:vortex-file-compressed	+6.9%	+2.4%	+4.4%	+10.0%	➖ noise
21	duckdb:duckdb	-4.5%	+2.4%	-6.8%	+14.7%	➖ noise
21	duckdb:vortex-file-compressed	+7.6%	+2.4%	+5.1%	+10.0%	➖ noise
22	datafusion:vortex-file-compressed	+4.0%	+2.7%	+1.3%	+10.0%	➖ noise
22	duckdb:duckdb	+7.7%	+2.7%	+4.9%	+11.0%	➖ noise
22	duckdb:vortex-file-compressed	+5.6%	+2.7%	+2.9%	+19.7%	➖ noise
23	datafusion:vortex-file-compressed	-1.0%	+0.7%	-1.7%	+55.9%	➖ noise
23	duckdb:duckdb	+0.5%	+0.7%	-0.3%	+10.0%	➖ noise
23	duckdb:vortex-file-compressed	-2.4%	+0.7%	-3.1%	+28.7%	➖ noise
24	datafusion:vortex-file-compressed	+5.1%	-0.8%	+5.9%	+13.7%	➖ noise
24	duckdb:duckdb	+6.1%	-0.8%	+6.9%	+12.0%	➖ noise
24	duckdb:vortex-file-compressed	+0.1%	-0.8%	+0.9%	+26.0%	➖ noise
25	datafusion:vortex-file-compressed	+4.6%	-0.2%	+4.8%	+10.0%	➖ noise
25	duckdb:duckdb	+6.3%	-0.2%	+6.5%	+10.0%	➖ noise
25	duckdb:vortex-file-compressed	+8.5%	-0.2%	+8.7%	+12.0%	➖ noise
26	datafusion:vortex-file-compressed	+5.4%	-0.4%	+5.8%	+18.0%	➖ noise
26	duckdb:duckdb	+6.4%	-0.4%	+6.8%	+14.9%	➖ noise
26	duckdb:vortex-file-compressed	-0.5%	-0.4%	-0.1%	+23.0%	➖ noise
27	datafusion:vortex-file-compressed	+3.4%	+1.7%	+1.7%	+10.0%	➖ noise
27	duckdb:duckdb	+0.5%	+1.7%	-1.1%	+10.7%	➖ noise
27	duckdb:vortex-file-compressed	+1.5%	+1.7%	-0.1%	+10.0%	➖ noise
28	datafusion:vortex-file-compressed	+0.9%	+0.3%	+0.6%	+10.0%	➖ noise
28	duckdb:duckdb	+0.2%	+0.3%	-0.1%	+10.0%	➖ noise
28	duckdb:vortex-file-compressed	+0.6%	+0.3%	+0.3%	+10.0%	➖ noise
29	datafusion:vortex-file-compressed	+0.2%	-1.3%	+1.4%	+10.0%	➖ noise
29	duckdb:duckdb	+7.5%	-1.3%	+8.9%	+10.0%	➖ noise
29	duckdb:vortex-file-compressed	-2.9%	-1.3%	-1.6%	+11.6%	➖ noise
30	datafusion:vortex-file-compressed	+2.2%	+0.4%	+1.8%	+10.0%	➖ noise
30	duckdb:duckdb	+2.1%	+0.4%	+1.7%	+10.0%	➖ noise
30	duckdb:vortex-file-compressed	+0.4%	+0.4%	+0.0%	+10.0%	➖ noise
31	datafusion:vortex-file-compressed	+2.9%	+1.8%	+1.1%	+10.0%	➖ noise
31	duckdb:duckdb	-0.1%	+1.8%	-1.9%	+10.0%	➖ noise
31	duckdb:vortex-file-compressed	+1.5%	+1.8%	-0.3%	+10.0%	➖ noise
32	datafusion:vortex-file-compressed	+8.9%	-0.5%	+9.4%	+18.6%	➖ noise
32	duckdb:duckdb	+3.7%	-0.5%	+4.2%	+10.0%	➖ noise
32	duckdb:vortex-file-compressed	+7.1%	-0.5%	+7.7%	+10.0%	➖ noise
33	datafusion:vortex-file-compressed	+3.1%	-1.4%	+4.5%	+10.0%	➖ noise
33	duckdb:duckdb	+4.0%	-1.4%	+5.4%	+10.0%	➖ noise
33	duckdb:vortex-file-compressed	+6.5%	-1.4%	+8.0%	+10.0%	➖ noise
34	datafusion:vortex-file-compressed	+5.2%	+0.6%	+4.5%	+10.0%	➖ noise
34	duckdb:duckdb	+6.5%	+0.6%	+5.8%	+10.0%	➖ noise
34	duckdb:vortex-file-compressed	+5.3%	+0.6%	+4.6%	+10.0%	➖ noise
35	datafusion:vortex-file-compressed	+0.7%	+1.4%	-0.7%	+10.0%	➖ noise
35	duckdb:duckdb	+0.1%	+1.4%	-1.3%	+10.0%	➖ noise
35	duckdb:vortex-file-compressed	+1.8%	+1.4%	+0.4%	+10.0%	➖ noise
36	datafusion:vortex-file-compressed	+7.6%	+3.0%	+4.5%	+13.2%	➖ noise
36	duckdb:duckdb	-2.8%	+3.0%	-5.6%	+10.2%	➖ noise
36	duckdb:vortex-file-compressed	-4.3%	+3.0%	-7.0%	+10.0%	➖ noise
37	datafusion:vortex-file-compressed	-1.2%	-0.7%	-0.5%	+10.0%	➖ noise
37	duckdb:duckdb	+10.7%	-0.7%	+11.4%	+10.0%	🚨 regression
37	duckdb:vortex-file-compressed	-5.9%	-0.7%	-5.3%	+10.0%	➖ noise
38	datafusion:vortex-file-compressed	-1.1%	-4.0%	+3.0%	+10.4%	➖ noise
38	duckdb:duckdb	+8.7%	-4.0%	+13.3%	+10.0%	🚨 regression
38	duckdb:vortex-file-compressed	-6.6%	-4.0%	-2.7%	+10.7%	➖ noise
39	datafusion:vortex-file-compressed	+2.8%	+3.8%	-1.0%	+10.0%	➖ noise
39	duckdb:duckdb	-5.4%	+3.8%	-8.9%	+17.2%	➖ noise
39	duckdb:vortex-file-compressed	+3.7%	+3.8%	-0.1%	+12.4%	➖ noise
40	datafusion:vortex-file-compressed	-1.7%	-0.2%	-1.5%	+11.7%	➖ noise
40	duckdb:duckdb	+13.6%	-0.2%	+13.7%	+14.9%	➖ noise
40	duckdb:vortex-file-compressed	-4.2%	-0.2%	-4.0%	+10.0%	➖ noise
41	datafusion:vortex-file-compressed	+1.9%	-0.8%	+2.7%	+10.0%	➖ noise
41	duckdb:duckdb	+9.9%	-0.8%	+10.8%	+10.4%	🚨 regression
41	duckdb:vortex-file-compressed	-6.5%	-0.8%	-5.7%	+10.5%	➖ noise
42	datafusion:vortex-file-compressed	-2.6%	-0.6%	-2.1%	+10.0%	➖ noise
42	duckdb:duckdb	+13.3%	-0.6%	+14.0%	+10.0%	🚨 regression
42	duckdb:vortex-file-compressed	-9.5%	-0.6%	-9.0%	+15.5%	➖ noise

github-actions · 2026-03-13T13:33:19Z

Benchmarks: TPC-H SF=1 on NVME

Summary

Overall: 0.996x ➖
Vortex: 1.001x ➖
Parquet: 0.983x ➖

Verdict

No clear signal

Attributed Vortex impact: +1.8%
Confidence: environment too noisy
Environment shift: -1.7%

Statistical Summary

Systemic shift (parquet controls): -1.7%
Control sigma: +6.9%
Residual noise: +2.7%
Median polish overall: -0.3%

datafusion / vortex-file-compressed (1.009x ➖, 0↑ 2↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨	55620135	50454042	1.10
tpch_q02/datafusion:vortex-file-compressed	48847620	49354556	0.99
tpch_q03/datafusion:vortex-file-compressed	27203258	27672188	0.98
tpch_q04/datafusion:vortex-file-compressed	19051817	18194870	1.05
tpch_q05/datafusion:vortex-file-compressed	76625431	77001674	1.00
tpch_q06/datafusion:vortex-file-compressed	9932576	10612039	0.94
tpch_q07/datafusion:vortex-file-compressed	89193011	88016153	1.01
tpch_q08/datafusion:vortex-file-compressed	64318668	64913795	0.99
tpch_q09/datafusion:vortex-file-compressed	89683236	86884033	1.03
tpch_q10/datafusion:vortex-file-compressed	75431554	77076682	0.98
tpch_q11/datafusion:vortex-file-compressed	19073583	18535460	1.03
tpch_q12/datafusion:vortex-file-compressed	32219919	32855723	0.98
tpch_q13/datafusion:vortex-file-compressed	27224177	27125464	1.00
tpch_q14/datafusion:vortex-file-compressed	26850377	27541436	0.97
tpch_q15/datafusion:vortex-file-compressed	24782970	25931983	0.96
tpch_q16/datafusion:vortex-file-compressed	33267322	34742206	0.96
tpch_q17/datafusion:vortex-file-compressed 🚨	85605990	71952433	1.19
tpch_q18/datafusion:vortex-file-compressed	101663734	100498872	1.01
tpch_q19/datafusion:vortex-file-compressed	37391272	34985614	1.07
tpch_q20/datafusion:vortex-file-compressed	48436823	48419814	1.00
tpch_q21/datafusion:vortex-file-compressed	92102678	94064892	0.98
tpch_q22/datafusion:vortex-file-compressed	14390259	14425822	1.00

datafusion / vortex-compact (1.002x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	59975703	61420502	0.98
tpch_q02/datafusion:vortex-compact	53931533	50640955	1.06
tpch_q03/datafusion:vortex-compact	32302789	31522867	1.02
tpch_q04/datafusion:vortex-compact	22838483	23265410	0.98
tpch_q05/datafusion:vortex-compact	81027903	82021875	0.99
tpch_q06/datafusion:vortex-compact	14282662	14340617	1.00
tpch_q07/datafusion:vortex-compact	97823815	93699695	1.04
tpch_q08/datafusion:vortex-compact	73483967	72024274	1.02
tpch_q09/datafusion:vortex-compact	94257653	96913656	0.97
tpch_q10/datafusion:vortex-compact	80906520	78679914	1.03
tpch_q11/datafusion:vortex-compact	20729437	20651500	1.00
tpch_q12/datafusion:vortex-compact	44462553	43265504	1.03
tpch_q13/datafusion:vortex-compact	36525890	36432774	1.00
tpch_q14/datafusion:vortex-compact	31622411	31008378	1.02
tpch_q15/datafusion:vortex-compact	33030947	33832702	0.98
tpch_q16/datafusion:vortex-compact	38688278	39706893	0.97
tpch_q17/datafusion:vortex-compact	87348733	82575518	1.06
tpch_q18/datafusion:vortex-compact	110168026	108632159	1.01
tpch_q19/datafusion:vortex-compact	44707024	44728986	1.00
tpch_q20/datafusion:vortex-compact	53912003	54737329	0.98
tpch_q21/datafusion:vortex-compact	105205865	108166754	0.97
tpch_q22/datafusion:vortex-compact	15620237	16755130	0.93

datafusion / parquet (0.994x ➖, 1↑ 1↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	141253846	145891135	0.97
tpch_q02/datafusion:parquet	81643000	80104188	1.02
tpch_q03/datafusion:parquet	77398780	85815692	0.90
tpch_q04/datafusion:parquet	53940669	55536333	0.97
tpch_q05/datafusion:parquet	160051589	161201352	0.99
tpch_q06/datafusion:parquet 🚀	36297439	48029224	0.76
tpch_q07/datafusion:parquet	181825935	179101027	1.02
tpch_q08/datafusion:parquet	161556909	162495701	0.99
tpch_q09/datafusion:parquet	221710999	209256592	1.06
tpch_q10/datafusion:parquet	183916765	187327916	0.98
tpch_q11/datafusion:parquet	60220556	58965582	1.02
tpch_q12/datafusion:parquet 🚨	122189446	106529045	1.15
tpch_q13/datafusion:parquet	197720860	202063361	0.98
tpch_q14/datafusion:parquet	80709043	83187082	0.97
tpch_q15/datafusion:parquet	67660819	64243421	1.05
tpch_q16/datafusion:parquet	53217715	54719821	0.97
tpch_q17/datafusion:parquet	170143435	173194574	0.98
tpch_q18/datafusion:parquet	229169981	229321451	1.00
tpch_q19/datafusion:parquet	94030966	93479233	1.01
tpch_q20/datafusion:parquet	122793808	115183893	1.07
tpch_q21/datafusion:parquet	189039829	178178151	1.06
tpch_q22/datafusion:parquet	39636327	38921209	1.02

datafusion / arrow (0.997x ➖, 1↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:arrow 🚀	60767626	68635337	0.89
tpch_q02/datafusion:arrow	23439880	23034041	1.02
tpch_q03/datafusion:arrow	37502456	36986948	1.01
tpch_q04/datafusion:arrow	29229774	29894861	0.98
tpch_q05/datafusion:arrow	92742734	90302802	1.03
tpch_q06/datafusion:arrow	21547729	21421763	1.01
tpch_q07/datafusion:arrow	176000825	176625732	1.00
tpch_q08/datafusion:arrow	49261760	48351760	1.02
tpch_q09/datafusion:arrow	77315476	77823832	0.99
tpch_q10/datafusion:arrow	57811474	57164844	1.01
tpch_q11/datafusion:arrow	11997232	11998482	1.00
tpch_q12/datafusion:arrow	60546753	57817611	1.05
tpch_q13/datafusion:arrow	52464119	50099859	1.05
tpch_q14/datafusion:arrow	26072977	26801301	0.97
tpch_q15/datafusion:arrow	52446199	52329191	1.00
tpch_q16/datafusion:arrow	24081851	25193745	0.96
tpch_q17/datafusion:arrow	89894457	88830335	1.01
tpch_q18/datafusion:arrow	157040352	157094234	1.00
tpch_q19/datafusion:arrow	39973391	40398068	0.99
tpch_q20/datafusion:arrow	40635320	41066802	0.99
tpch_q21/datafusion:arrow	231515541	236763126	0.98
tpch_q22/datafusion:arrow	21145149	21115363	1.00

duckdb / vortex-file-compressed (0.990x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	32611164	33751083	0.97
tpch_q02/duckdb:vortex-file-compressed	26684369	27322553	0.98
tpch_q03/duckdb:vortex-file-compressed	29395764	30329412	0.97
tpch_q04/duckdb:vortex-file-compressed	27732284	29957015	0.93
tpch_q05/duckdb:vortex-file-compressed	33399384	34042557	0.98
tpch_q06/duckdb:vortex-file-compressed	10192718	10676568	0.95
tpch_q07/duckdb:vortex-file-compressed	36147202	36414189	0.99
tpch_q08/duckdb:vortex-file-compressed	40377741	39881358	1.01
tpch_q09/duckdb:vortex-file-compressed	80447232	78343756	1.03
tpch_q10/duckdb:vortex-file-compressed	35498915	36969455	0.96
tpch_q11/duckdb:vortex-file-compressed	15815894	15553393	1.02
tpch_q12/duckdb:vortex-file-compressed	23381517	23138018	1.01
tpch_q13/duckdb:vortex-file-compressed	37681561	37825660	1.00
tpch_q14/duckdb:vortex-file-compressed	22581993	21139348	1.07
tpch_q15/duckdb:vortex-file-compressed	15342730	16416172	0.93
tpch_q16/duckdb:vortex-file-compressed	29337777	29273668	1.00
tpch_q17/duckdb:vortex-file-compressed	24732608	24923242	0.99
tpch_q18/duckdb:vortex-file-compressed	47653181	48444190	0.98
tpch_q19/duckdb:vortex-file-compressed	32881791	32307040	1.02
tpch_q20/duckdb:vortex-file-compressed	34197914	34440164	0.99
tpch_q21/duckdb:vortex-file-compressed	99564409	102234531	0.97
tpch_q22/duckdb:vortex-file-compressed	18529581	17756619	1.04

duckdb / vortex-compact (1.001x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	39610281	39488003	1.00
tpch_q02/duckdb:vortex-compact	36879486	37680125	0.98
tpch_q03/duckdb:vortex-compact	31850954	31821107	1.00
tpch_q04/duckdb:vortex-compact	33954352	34678720	0.98
tpch_q05/duckdb:vortex-compact	37995564	37477095	1.01
tpch_q06/duckdb:vortex-compact	14794927	14276328	1.04
tpch_q07/duckdb:vortex-compact	42805213	43345998	0.99
tpch_q08/duckdb:vortex-compact	45756988	47105772	0.97
tpch_q09/duckdb:vortex-compact	87204448	91315665	0.95
tpch_q10/duckdb:vortex-compact	40689833	41445680	0.98
tpch_q11/duckdb:vortex-compact	20829957	20403702	1.02
tpch_q12/duckdb:vortex-compact	38017731	35957784	1.06
tpch_q13/duckdb:vortex-compact	47261417	47119116	1.00
tpch_q14/duckdb:vortex-compact	29513324	31348151	0.94
tpch_q15/duckdb:vortex-compact	19703724	19719940	1.00
tpch_q16/duckdb:vortex-compact	36733774	35870025	1.02
tpch_q17/duckdb:vortex-compact	31412438	30559276	1.03
tpch_q18/duckdb:vortex-compact	50169159	51998941	0.96
tpch_q19/duckdb:vortex-compact	38948917	36433553	1.07
tpch_q20/duckdb:vortex-compact	45310962	43547447	1.04
tpch_q21/duckdb:vortex-compact	111032687	113318404	0.98
tpch_q22/duckdb:vortex-compact	20551695	20487013	1.00

duckdb / parquet (0.972x ➖, 5↑ 2↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet 🚀	75461707	91629048	0.82
tpch_q02/duckdb:parquet	39399722	39388645	1.00
tpch_q03/duckdb:parquet 🚀	69184302	79311685	0.87
tpch_q04/duckdb:parquet	47236750	46746251	1.01
tpch_q05/duckdb:parquet	68278160	67271089	1.01
tpch_q06/duckdb:parquet	20281657	20305443	1.00
tpch_q07/duckdb:parquet	68483001	66696013	1.03
tpch_q08/duckdb:parquet	80842938	82359111	0.98
tpch_q09/duckdb:parquet	147779811	156380037	0.95
tpch_q10/duckdb:parquet	124887725	127049443	0.98
tpch_q11/duckdb:parquet	22025092	22426073	0.98
tpch_q12/duckdb:parquet 🚨	56659706	46717804	1.21
tpch_q13/duckdb:parquet	267378066	260694190	1.03
tpch_q14/duckdb:parquet	49658401	48613300	1.02
tpch_q15/duckdb:parquet 🚀	28289631	32948318	0.86
tpch_q16/duckdb:parquet	55946844	56168028	1.00
tpch_q17/duckdb:parquet 🚨	57286580	50885873	1.13
tpch_q18/duckdb:parquet 🚀	119506848	136522321	0.88
tpch_q19/duckdb:parquet 🚀	68872314	88161812	0.78
tpch_q20/duckdb:parquet	63084001	64612998	0.98
tpch_q21/duckdb:parquet	173106956	175971713	0.98
tpch_q22/duckdb:parquet	51648242	52700481	0.98

duckdb / duckdb (1.003x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:duckdb	15911995	16330316	0.97
tpch_q02/duckdb:duckdb	12606560	13090632	0.96
tpch_q03/duckdb:duckdb	18871632	18636992	1.01
tpch_q04/duckdb:duckdb	18885630	19774732	0.96
tpch_q05/duckdb:duckdb	21169347	20742790	1.02
tpch_q06/duckdb:duckdb	5187473	5384459	0.96
tpch_q07/duckdb:duckdb	23627700	22559297	1.05
tpch_q08/duckdb:duckdb	20526401	20790400	0.99
tpch_q09/duckdb:duckdb	54074491	54636109	0.99
tpch_q10/duckdb:duckdb	40929269	44003489	0.93
tpch_q11/duckdb:duckdb	6000232	5649950	1.06
tpch_q12/duckdb:duckdb	13560353	13803947	0.98
tpch_q13/duckdb:duckdb	37168143	36708518	1.01
tpch_q14/duckdb:duckdb	16157053	15477516	1.04
tpch_q15/duckdb:duckdb	12027830	11649870	1.03
tpch_q16/duckdb:duckdb	22977330	23171712	0.99
tpch_q17/duckdb:duckdb	13751951	13614295	1.01
tpch_q18/duckdb:duckdb	38140274	38068513	1.00
tpch_q19/duckdb:duckdb	28487413	26280146	1.08
tpch_q20/duckdb:duckdb	22674893	22445458	1.01
tpch_q21/duckdb:duckdb	54895411	54520809	1.01
tpch_q22/duckdb:duckdb	23963033	24195014	0.99

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:arrow	-11.5%	-10.7%	-0.9%	+23.7%	➖ noise
1	datafusion:vortex-compact	-2.4%	-10.7%	+9.4%	+25.7%	➖ noise
1	datafusion:vortex-file-compressed	+10.2%	-10.7%	+23.5%	+24.3%	➖ noise
1	duckdb:duckdb	-2.6%	-10.7%	+9.1%	+24.1%	➖ noise
1	duckdb:vortex-compact	+0.3%	-10.7%	+12.3%	+23.8%	➖ noise
1	duckdb:vortex-file-compressed	-3.4%	-10.7%	+8.2%	+23.7%	➖ noise
2	datafusion:arrow	+1.8%	+1.0%	+0.8%	+18.8%	➖ noise
2	datafusion:vortex-compact	+6.5%	+1.0%	+5.5%	+18.8%	➖ noise
2	datafusion:vortex-file-compressed	-1.0%	+1.0%	-2.0%	+18.8%	➖ noise
2	duckdb:duckdb	-3.7%	+1.0%	-4.6%	+18.8%	➖ noise
2	duckdb:vortex-compact	-2.1%	+1.0%	-3.1%	+18.8%	➖ noise
2	duckdb:vortex-file-compressed	-2.3%	+1.0%	-3.3%	+18.8%	➖ noise
3	datafusion:arrow	+1.4%	-11.3%	+14.3%	+18.8%	➖ noise
3	datafusion:vortex-compact	+2.5%	-11.3%	+15.5%	+18.8%	➖ noise
3	datafusion:vortex-file-compressed	-1.7%	-11.3%	+10.8%	+18.8%	➖ noise
3	duckdb:duckdb	+1.3%	-11.3%	+14.2%	+18.8%	➖ noise
3	duckdb:vortex-compact	+0.1%	-11.3%	+12.8%	+18.8%	➖ noise
3	duckdb:vortex-file-compressed	-3.1%	-11.3%	+9.3%	+18.8%	➖ noise
4	datafusion:arrow	-2.2%	-0.9%	-1.3%	+18.8%	➖ noise
4	datafusion:vortex-compact	-1.8%	-0.9%	-0.9%	+18.8%	➖ noise
4	datafusion:vortex-file-compressed	+4.7%	-0.9%	+5.7%	+18.8%	➖ noise
4	duckdb:duckdb	-4.5%	-0.9%	-3.6%	+18.8%	➖ noise
4	duckdb:vortex-compact	-2.1%	-0.9%	-1.2%	+18.8%	➖ noise
4	duckdb:vortex-file-compressed	-7.4%	-0.9%	-6.6%	+18.8%	➖ noise
5	datafusion:arrow	+2.7%	+0.4%	+2.3%	+18.8%	➖ noise
5	datafusion:vortex-compact	-1.2%	+0.4%	-1.6%	+18.8%	➖ noise
5	datafusion:vortex-file-compressed	-0.5%	+0.4%	-0.9%	+18.8%	➖ noise
5	duckdb:duckdb	+2.1%	+0.4%	+1.7%	+18.8%	➖ noise
5	duckdb:vortex-compact	+1.4%	+0.4%	+1.0%	+18.8%	➖ noise
5	duckdb:vortex-file-compressed	-1.9%	+0.4%	-2.3%	+18.8%	➖ noise
6	datafusion:arrow	+0.6%	-13.1%	+15.8%	+21.2%	➖ noise
6	datafusion:vortex-compact	-0.4%	-13.1%	+14.6%	+23.5%	➖ noise
6	datafusion:vortex-file-compressed	-6.4%	-13.1%	+7.7%	+21.8%	➖ noise
6	duckdb:duckdb	-3.7%	-13.1%	+10.9%	+25.1%	➖ noise
6	duckdb:vortex-compact	+3.6%	-13.1%	+19.3%	+21.4%	➖ noise
6	duckdb:vortex-file-compressed	-4.5%	-13.1%	+9.9%	+22.7%	➖ noise
7	datafusion:arrow	-0.4%	+2.1%	-2.4%	+18.8%	➖ noise
7	datafusion:vortex-compact	+4.4%	+2.1%	+2.3%	+18.8%	➖ noise
7	datafusion:vortex-file-compressed	+1.3%	+2.1%	-0.7%	+18.8%	➖ noise
7	duckdb:duckdb	+4.7%	+2.1%	+2.6%	+18.8%	➖ noise
7	duckdb:vortex-compact	-1.2%	+2.1%	-3.3%	+18.8%	➖ noise
7	duckdb:vortex-file-compressed	-0.7%	+2.1%	-2.8%	+18.8%	➖ noise
8	datafusion:arrow	+1.9%	-1.2%	+3.1%	+18.8%	➖ noise
8	datafusion:vortex-compact	+2.0%	-1.2%	+3.3%	+18.8%	➖ noise
8	datafusion:vortex-file-compressed	-0.9%	-1.2%	+0.3%	+18.8%	➖ noise
8	duckdb:duckdb	-1.3%	-1.2%	-0.1%	+18.8%	➖ noise
8	duckdb:vortex-compact	-2.9%	-1.2%	-1.7%	+18.8%	➖ noise
8	duckdb:vortex-file-compressed	+1.2%	-1.2%	+2.5%	+18.8%	➖ noise
9	datafusion:arrow	-0.7%	+0.1%	-0.7%	+18.8%	➖ noise
9	datafusion:vortex-compact	-2.7%	+0.1%	-2.8%	+18.8%	➖ noise
9	datafusion:vortex-file-compressed	+3.2%	+0.1%	+3.2%	+18.8%	➖ noise
9	duckdb:duckdb	-1.0%	+0.1%	-1.1%	+18.8%	➖ noise
9	duckdb:vortex-compact	-4.5%	+0.1%	-4.6%	+18.8%	➖ noise
9	duckdb:vortex-file-compressed	+2.7%	+0.1%	+2.6%	+18.8%	➖ noise
10	datafusion:arrow	+1.1%	-1.8%	+2.9%	+18.8%	➖ noise
10	datafusion:vortex-compact	+2.8%	-1.8%	+4.7%	+18.8%	➖ noise
10	datafusion:vortex-file-compressed	-2.1%	-1.8%	-0.4%	+18.8%	➖ noise
10	duckdb:duckdb	-7.0%	-1.8%	-5.3%	+19.6%	➖ noise
10	duckdb:vortex-compact	-1.8%	-1.8%	-0.1%	+18.8%	➖ noise
10	duckdb:vortex-file-compressed	-4.0%	-1.8%	-2.3%	+18.8%	➖ noise
11	datafusion:arrow	-0.0%	+0.2%	-0.2%	+18.8%	➖ noise
11	datafusion:vortex-compact	+0.4%	+0.2%	+0.2%	+18.8%	➖ noise
11	datafusion:vortex-file-compressed	+2.9%	+0.2%	+2.7%	+18.8%	➖ noise
11	duckdb:duckdb	+6.2%	+0.2%	+6.0%	+18.8%	➖ noise
11	duckdb:vortex-compact	+2.1%	+0.2%	+1.9%	+18.8%	➖ noise
11	duckdb:vortex-file-compressed	+1.7%	+0.2%	+1.5%	+18.8%	➖ noise
12	datafusion:arrow	+4.7%	+17.9%	-11.2%	+18.8%	➖ noise
12	datafusion:vortex-compact	+2.8%	+17.9%	-12.9%	+18.8%	➖ noise
12	datafusion:vortex-file-compressed	-1.9%	+17.9%	-16.9%	+18.8%	✅ faster
12	duckdb:duckdb	-1.8%	+17.9%	-16.7%	+18.8%	✅ faster
12	duckdb:vortex-compact	+5.7%	+17.9%	-10.4%	+18.8%	➖ noise
12	duckdb:vortex-file-compressed	+1.1%	+17.9%	-14.3%	+20.4%	➖ noise
13	datafusion:arrow	+4.7%	+0.2%	+4.5%	+18.8%	➖ noise
13	datafusion:vortex-compact	+0.3%	+0.2%	+0.1%	+18.8%	➖ noise
13	datafusion:vortex-file-compressed	+0.4%	+0.2%	+0.2%	+18.8%	➖ noise
13	duckdb:duckdb	+1.3%	+0.2%	+1.1%	+18.8%	➖ noise
13	duckdb:vortex-compact	+0.3%	+0.2%	+0.1%	+18.8%	➖ noise
13	duckdb:vortex-file-compressed	-0.4%	+0.2%	-0.6%	+18.8%	➖ noise
14	datafusion:arrow	-2.7%	-0.4%	-2.3%	+18.8%	➖ noise
14	datafusion:vortex-compact	+2.0%	-0.4%	+2.4%	+18.8%	➖ noise
14	datafusion:vortex-file-compressed	-2.5%	-0.4%	-2.1%	+18.8%	➖ noise
14	duckdb:duckdb	+4.4%	-0.4%	+4.9%	+21.2%	➖ noise
14	duckdb:vortex-compact	-5.9%	-0.4%	-5.4%	+18.8%	➖ noise
14	duckdb:vortex-file-compressed	+6.8%	-0.4%	+7.3%	+18.8%	➖ noise
15	datafusion:arrow	+0.2%	-4.9%	+5.4%	+18.8%	➖ noise
15	datafusion:vortex-compact	-2.4%	-4.9%	+2.7%	+18.8%	➖ noise
15	datafusion:vortex-file-compressed	-4.4%	-4.9%	+0.5%	+18.8%	➖ noise
15	duckdb:duckdb	+3.2%	-4.9%	+8.6%	+18.8%	➖ noise
15	duckdb:vortex-compact	-0.1%	-4.9%	+5.1%	+18.8%	➖ noise
15	duckdb:vortex-file-compressed	-6.5%	-4.9%	-1.7%	+18.8%	➖ noise
16	datafusion:arrow	-4.4%	-1.6%	-2.9%	+18.8%	➖ noise
16	datafusion:vortex-compact	-2.6%	-1.6%	-1.0%	+18.8%	➖ noise
16	datafusion:vortex-file-compressed	-4.2%	-1.6%	-2.7%	+18.8%	➖ noise
16	duckdb:duckdb	-0.8%	-1.6%	+0.7%	+18.8%	➖ noise
16	duckdb:vortex-compact	+2.4%	-1.6%	+4.0%	+18.8%	➖ noise
16	duckdb:vortex-file-compressed	+0.2%	-1.6%	+1.8%	+18.8%	➖ noise
17	datafusion:arrow	+1.2%	+5.2%	-3.8%	+18.8%	➖ noise
17	datafusion:vortex-compact	+5.8%	+5.2%	+0.6%	+18.8%	➖ noise
17	datafusion:vortex-file-compressed	+19.0%	+5.2%	+13.1%	+18.8%	➖ noise
17	duckdb:duckdb	+1.0%	+5.2%	-3.9%	+18.8%	➖ noise
17	duckdb:vortex-compact	+2.8%	+5.2%	-2.3%	+18.8%	➖ noise
17	duckdb:vortex-file-compressed	-0.8%	+5.2%	-5.6%	+18.8%	➖ noise
18	datafusion:arrow	-0.0%	-6.5%	+6.9%	+18.8%	➖ noise
18	datafusion:vortex-compact	+1.4%	-6.5%	+8.4%	+18.8%	➖ noise
18	datafusion:vortex-file-compressed	+1.2%	-6.5%	+8.2%	+18.8%	➖ noise
18	duckdb:duckdb	+0.2%	-6.5%	+7.1%	+18.8%	➖ noise
18	duckdb:vortex-compact	-3.5%	-6.5%	+3.2%	+18.8%	➖ noise
18	duckdb:vortex-file-compressed	-1.6%	-6.5%	+5.2%	+18.8%	➖ noise
19	datafusion:arrow	-1.1%	-11.4%	+11.6%	+18.8%	➖ noise
19	datafusion:vortex-compact	-0.0%	-11.4%	+12.8%	+21.8%	➖ noise
19	datafusion:vortex-file-compressed	+6.9%	-11.4%	+20.6%	+18.8%	🚨 regression
19	duckdb:duckdb	+8.4%	-11.4%	+22.3%	+21.4%	🚨 regression
19	duckdb:vortex-compact	+6.9%	-11.4%	+20.6%	+18.9%	🚨 regression
19	duckdb:vortex-file-compressed	+1.8%	-11.4%	+14.8%	+18.8%	➖ noise
20	datafusion:arrow	-1.1%	+2.0%	-3.0%	+18.8%	➖ noise
20	datafusion:vortex-compact	-1.5%	+2.0%	-3.5%	+18.8%	➖ noise
20	datafusion:vortex-file-compressed	+0.0%	+2.0%	-1.9%	+18.8%	➖ noise
20	duckdb:duckdb	+1.0%	+2.0%	-1.0%	+18.8%	➖ noise
20	duckdb:vortex-compact	+4.0%	+2.0%	+2.0%	+18.8%	➖ noise
20	duckdb:vortex-file-compressed	-0.7%	+2.0%	-2.7%	+19.1%	➖ noise
21	datafusion:arrow	-2.2%	+2.2%	-4.3%	+18.8%	➖ noise
21	datafusion:vortex-compact	-2.7%	+2.2%	-4.8%	+18.8%	➖ noise
21	datafusion:vortex-file-compressed	-2.1%	+2.2%	-4.2%	+18.8%	➖ noise
21	duckdb:duckdb	+0.7%	+2.2%	-1.4%	+18.8%	➖ noise
21	duckdb:vortex-compact	-2.0%	+2.2%	-4.1%	+18.8%	➖ noise
21	duckdb:vortex-file-compressed	-2.6%	+2.2%	-4.7%	+18.8%	➖ noise
22	datafusion:arrow	+0.1%	-0.1%	+0.2%	+20.4%	➖ noise
22	datafusion:vortex-compact	-6.8%	-0.1%	-6.7%	+18.8%	➖ noise
22	datafusion:vortex-file-compressed	-0.2%	-0.1%	-0.1%	+18.8%	➖ noise
22	duckdb:duckdb	-1.0%	-0.1%	-0.9%	+18.8%	➖ noise
22	duckdb:vortex-compact	+0.3%	-0.1%	+0.4%	+18.8%	➖ noise
22	duckdb:vortex-file-compressed	+4.4%	-0.1%	+4.5%	+18.8%	➖ noise

github-actions · 2026-03-13T13:33:20Z

Benchmarks: TPC-H SF=1 on S3

Summary

Overall: 1.031x ➖
Vortex: 1.047x ➖
Parquet: 0.999x ➖

Verdict

No clear signal

Attributed Vortex impact: +4.9%
Confidence: environment too noisy
Environment shift: -0.1%

Statistical Summary

Systemic shift (parquet controls): -0.1%
Control sigma: +8.0%
Residual noise: +8.2%
Median polish overall: -1.0%

datafusion / vortex-file-compressed (1.168x ➖, 0↑ 3↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	230389934	181234068	1.27
tpch_q02/datafusion:vortex-file-compressed	560085893	454163453	1.23
tpch_q03/datafusion:vortex-file-compressed	438274412	369103860	1.19
tpch_q04/datafusion:vortex-file-compressed	285862538	236229371	1.21
tpch_q05/datafusion:vortex-file-compressed	480297680	403833084	1.19
tpch_q06/datafusion:vortex-file-compressed	264489846	259703027	1.02
tpch_q07/datafusion:vortex-file-compressed	480854963	386604746	1.24
tpch_q08/datafusion:vortex-file-compressed	615285860	662992164	0.93
tpch_q09/datafusion:vortex-file-compressed	510440802	592842927	0.86
tpch_q10/datafusion:vortex-file-compressed 🚨	736687395	477184452	1.54
tpch_q11/datafusion:vortex-file-compressed 🚨	397914996	271910635	1.46
tpch_q12/datafusion:vortex-file-compressed 🚨	539405142	342982778	1.57
tpch_q13/datafusion:vortex-file-compressed	227419332	226602628	1.00
tpch_q14/datafusion:vortex-file-compressed	216323286	179583538	1.20
tpch_q15/datafusion:vortex-file-compressed	378993883	299299253	1.27
tpch_q16/datafusion:vortex-file-compressed	215523402	195834940	1.10
tpch_q17/datafusion:vortex-file-compressed	304898277	317150789	0.96
tpch_q18/datafusion:vortex-file-compressed	362776602	314296851	1.15
tpch_q19/datafusion:vortex-file-compressed	385106286	326974427	1.18
tpch_q20/datafusion:vortex-file-compressed	446889557	377082547	1.19
tpch_q21/datafusion:vortex-file-compressed	545198607	549723582	0.99
tpch_q22/datafusion:vortex-file-compressed	247695524	201184961	1.23

datafusion / vortex-compact (1.096x ➖, 0↑ 5↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨	312848107	238859609	1.31
tpch_q02/datafusion:vortex-compact	498556227	459137827	1.09
tpch_q03/datafusion:vortex-compact 🚨	404926712	299081323	1.35
tpch_q04/datafusion:vortex-compact 🚨	298545368	209009060	1.43
tpch_q05/datafusion:vortex-compact	550798290	508466598	1.08
tpch_q06/datafusion:vortex-compact	409016509	443274434	0.92
tpch_q07/datafusion:vortex-compact	387642928	499024015	0.78
tpch_q08/datafusion:vortex-compact	579208403	573504595	1.01
tpch_q09/datafusion:vortex-compact	482911807	490902497	0.98
tpch_q10/datafusion:vortex-compact	513482159	468925453	1.10
tpch_q11/datafusion:vortex-compact	350712367	281429117	1.25
tpch_q12/datafusion:vortex-compact	431321604	517311553	0.83
tpch_q13/datafusion:vortex-compact 🚨	303309513	224678517	1.35
tpch_q14/datafusion:vortex-compact	325158464	311170520	1.04
tpch_q15/datafusion:vortex-compact	508709245	445494490	1.14
tpch_q16/datafusion:vortex-compact 🚨	316878062	223503743	1.42
tpch_q17/datafusion:vortex-compact	334647530	350452113	0.95
tpch_q18/datafusion:vortex-compact	292657804	308293296	0.95
tpch_q19/datafusion:vortex-compact	408745681	410538729	1.00
tpch_q20/datafusion:vortex-compact	493910209	447795329	1.10
tpch_q21/datafusion:vortex-compact	631216095	584630362	1.08
tpch_q22/datafusion:vortex-compact	148270754	117925749	1.26

datafusion / parquet (1.021x ➖, 0↑ 1↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	220326658	247787066	0.89
tpch_q02/datafusion:parquet	456484674	461744364	0.99
tpch_q03/datafusion:parquet	315939152	314120406	1.01
tpch_q04/datafusion:parquet	151677054	188302404	0.81
tpch_q05/datafusion:parquet	517415132	535684804	0.97
tpch_q06/datafusion:parquet	144294626	137888982	1.05
tpch_q07/datafusion:parquet	546088989	591698253	0.92
tpch_q08/datafusion:parquet	671110401	629253664	1.07
tpch_q09/datafusion:parquet	577998168	538557010	1.07
tpch_q10/datafusion:parquet	648802936	592715244	1.09
tpch_q11/datafusion:parquet	363457123	341338539	1.06
tpch_q12/datafusion:parquet	327243547	262152503	1.25
tpch_q13/datafusion:parquet	434250276	430870784	1.01
tpch_q14/datafusion:parquet 🚨	264783677	194044008	1.36
tpch_q15/datafusion:parquet	348355266	303418055	1.15
tpch_q16/datafusion:parquet	195614980	175983953	1.11
tpch_q17/datafusion:parquet	434483358	494909756	0.88
tpch_q18/datafusion:parquet	499951343	517690828	0.97
tpch_q19/datafusion:parquet	338531709	346172248	0.98
tpch_q20/datafusion:parquet	421963295	391328731	1.08
tpch_q21/datafusion:parquet	548233667	558543474	0.98
tpch_q22/datafusion:parquet	121901786	131610288	0.93

duckdb / vortex-file-compressed (0.977x ➖, 0↑ 1↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨	284826123	217197049	1.31
tpch_q02/duckdb:vortex-file-compressed	932349741	874905419	1.07
tpch_q03/duckdb:vortex-file-compressed	503170839	593712652	0.85
tpch_q04/duckdb:vortex-file-compressed	369528215	354693273	1.04
tpch_q05/duckdb:vortex-file-compressed	783758611	887503315	0.88
tpch_q06/duckdb:vortex-file-compressed	397380161	358635271	1.11
tpch_q07/duckdb:vortex-file-compressed	682057647	755537736	0.90
tpch_q08/duckdb:vortex-file-compressed	828971478	951703049	0.87
tpch_q09/duckdb:vortex-file-compressed	939114669	864844534	1.09
tpch_q10/duckdb:vortex-file-compressed	660438978	668514281	0.99
tpch_q11/duckdb:vortex-file-compressed	481685289	498177533	0.97
tpch_q12/duckdb:vortex-file-compressed	448564520	485834486	0.92
tpch_q13/duckdb:vortex-file-compressed	450776185	457421914	0.99
tpch_q14/duckdb:vortex-file-compressed	421650650	488488920	0.86
tpch_q15/duckdb:vortex-file-compressed	252071287	239109262	1.05
tpch_q16/duckdb:vortex-file-compressed	347662546	330764333	1.05
tpch_q17/duckdb:vortex-file-compressed	621538829	562349047	1.11
tpch_q18/duckdb:vortex-file-compressed	479061192	538129225	0.89
tpch_q19/duckdb:vortex-file-compressed	468302990	510040939	0.92
tpch_q20/duckdb:vortex-file-compressed	674683862	828746227	0.81
tpch_q21/duckdb:vortex-file-compressed	984439056	1037473295	0.95
tpch_q22/duckdb:vortex-file-compressed	361489946	357967306	1.01

duckdb / vortex-compact (0.962x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	275887333	266806052	1.03
tpch_q02/duckdb:vortex-compact	789595603	839833588	0.94
tpch_q03/duckdb:vortex-compact	534074451	532025016	1.00
tpch_q04/duckdb:vortex-compact	352620699	333714845	1.06
tpch_q05/duckdb:vortex-compact	784409536	848360636	0.92
tpch_q06/duckdb:vortex-compact	348398156	459828120	0.76
tpch_q07/duckdb:vortex-compact	575842998	633025872	0.91
tpch_q08/duckdb:vortex-compact	815001865	912123339	0.89
tpch_q09/duckdb:vortex-compact	793911986	919227950	0.86
tpch_q10/duckdb:vortex-compact	641542881	795694258	0.81
tpch_q11/duckdb:vortex-compact	506324805	482575291	1.05
tpch_q12/duckdb:vortex-compact	394633330	381919739	1.03
tpch_q13/duckdb:vortex-compact	435597570	450185285	0.97
tpch_q14/duckdb:vortex-compact	450731179	452173261	1.00
tpch_q15/duckdb:vortex-compact	274200633	270091303	1.02
tpch_q16/duckdb:vortex-compact	342025671	331888622	1.03
tpch_q17/duckdb:vortex-compact	600112899	584142002	1.03
tpch_q18/duckdb:vortex-compact	472416700	484358065	0.98
tpch_q19/duckdb:vortex-compact	542636712	513775511	1.06
tpch_q20/duckdb:vortex-compact	665640935	774651432	0.86
tpch_q21/duckdb:vortex-compact	1029755962	971723903	1.06
tpch_q22/duckdb:vortex-compact	315406890	319140898	0.99

duckdb / parquet (0.977x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	599062238	470970935	1.27
tpch_q02/duckdb:parquet	1231323676	1292414694	0.95
tpch_q03/duckdb:parquet	1157838545	1014786211	1.14
tpch_q04/duckdb:parquet	563877919	613775321	0.92
tpch_q05/duckdb:parquet	1335323637	1463951736	0.91
tpch_q06/duckdb:parquet	381678509	368294571	1.04
tpch_q07/duckdb:parquet	1150064602	1320608645	0.87
tpch_q08/duckdb:parquet	1485564040	1591299651	0.93
tpch_q09/duckdb:parquet	1250075461	1378242295	0.91
tpch_q10/duckdb:parquet	1237173500	1350636374	0.92
tpch_q11/duckdb:parquet	752201622	846843789	0.89
tpch_q12/duckdb:parquet	618391607	551342389	1.12
tpch_q13/duckdb:parquet	856924296	873131573	0.98
tpch_q14/duckdb:parquet	648446355	610484081	1.06
tpch_q15/duckdb:parquet	464432299	512989969	0.91
tpch_q16/duckdb:parquet	543221318	588070475	0.92
tpch_q17/duckdb:parquet	784992267	712988275	1.10
tpch_q18/duckdb:parquet	808120566	839496771	0.96
tpch_q19/duckdb:parquet	739151152	867593624	0.85
tpch_q20/duckdb:parquet	899308520	971898548	0.93
tpch_q21/duckdb:parquet	1169239524	1204471654	0.97
tpch_q22/duckdb:parquet	474119246	456382342	1.04

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	+31.0%	+6.3%	+23.2%	+178.6%	➖ noise
1	datafusion:vortex-file-compressed	+27.1%	+6.3%	+19.5%	+150.3%	➖ noise
1	duckdb:vortex-compact	+3.4%	+6.3%	-2.8%	+63.9%	➖ noise
1	duckdb:vortex-file-compressed	+31.1%	+6.3%	+23.3%	+60.9%	➖ noise
2	datafusion:vortex-compact	+8.6%	-2.9%	+11.9%	+38.6%	➖ noise
2	datafusion:vortex-file-compressed	+23.3%	-2.9%	+27.1%	+40.1%	➖ noise
2	duckdb:vortex-compact	-6.0%	-2.9%	-3.1%	+30.0%	➖ noise
2	duckdb:vortex-file-compressed	+6.6%	-2.9%	+9.8%	+33.3%	➖ noise
3	datafusion:vortex-compact	+35.4%	+7.1%	+26.4%	+60.2%	➖ noise
3	datafusion:vortex-file-compressed	+18.7%	+7.1%	+10.8%	+73.2%	➖ noise
3	duckdb:vortex-compact	+0.4%	+7.1%	-6.3%	+30.0%	➖ noise
3	duckdb:vortex-file-compressed	-15.3%	+7.1%	-20.9%	+30.0%	➖ noise
4	datafusion:vortex-compact	+42.8%	-14.0%	+66.0%	+63.0%	🚨 regression
4	datafusion:vortex-file-compressed	+21.0%	-14.0%	+40.7%	+31.5%	🚨 regression
4	duckdb:vortex-compact	+5.7%	-14.0%	+22.8%	+30.0%	➖ noise
4	duckdb:vortex-file-compressed	+4.2%	-14.0%	+21.1%	+43.9%	➖ noise
5	datafusion:vortex-compact	+8.3%	-6.1%	+15.4%	+82.1%	➖ noise
5	datafusion:vortex-file-compressed	+18.9%	-6.1%	+26.7%	+41.8%	➖ noise
5	duckdb:vortex-compact	-7.5%	-6.1%	-1.5%	+30.0%	➖ noise
5	duckdb:vortex-file-compressed	-11.7%	-6.1%	-5.9%	+30.0%	➖ noise
6	datafusion:vortex-compact	-7.7%	+4.1%	-11.4%	+52.9%	➖ noise
6	datafusion:vortex-file-compressed	+1.8%	+4.1%	-2.2%	+30.0%	➖ noise
6	duckdb:vortex-compact	-24.2%	+4.1%	-27.2%	+31.4%	✅ faster
6	duckdb:vortex-file-compressed	+10.8%	+4.1%	+6.4%	+51.5%	➖ noise
7	datafusion:vortex-compact	-22.3%	-10.3%	-13.4%	+30.0%	➖ noise
7	datafusion:vortex-file-compressed	+24.4%	-10.3%	+38.7%	+30.0%	🚨 regression
7	duckdb:vortex-compact	-9.0%	-10.3%	+1.5%	+30.0%	➖ noise
7	duckdb:vortex-file-compressed	-9.7%	-10.3%	+0.7%	+38.3%	➖ noise
8	datafusion:vortex-compact	+1.0%	-0.2%	+1.2%	+32.7%	➖ noise
8	datafusion:vortex-file-compressed	-7.2%	-0.2%	-7.0%	+30.0%	➖ noise
8	duckdb:vortex-compact	-10.6%	-0.2%	-10.5%	+30.0%	➖ noise
8	duckdb:vortex-file-compressed	-12.9%	-0.2%	-12.7%	+30.0%	➖ noise
9	datafusion:vortex-compact	-1.6%	-1.3%	-0.3%	+44.1%	➖ noise
9	datafusion:vortex-file-compressed	-13.9%	-1.3%	-12.7%	+45.8%	➖ noise
9	duckdb:vortex-compact	-13.6%	-1.3%	-12.5%	+30.0%	➖ noise
9	duckdb:vortex-file-compressed	+8.6%	-1.3%	+10.1%	+30.0%	➖ noise
10	datafusion:vortex-compact	+9.5%	+0.1%	+9.4%	+30.0%	➖ noise
10	datafusion:vortex-file-compressed	+54.4%	+0.1%	+54.2%	+30.0%	🚨 regression
10	duckdb:vortex-compact	-19.4%	+0.1%	-19.5%	+30.0%	➖ noise
10	duckdb:vortex-file-compressed	-1.2%	+0.1%	-1.3%	+30.0%	➖ noise
11	datafusion:vortex-compact	+24.6%	-2.7%	+28.1%	+30.0%	➖ noise
11	datafusion:vortex-file-compressed	+46.3%	-2.7%	+50.5%	+30.0%	🚨 regression
11	duckdb:vortex-compact	+4.9%	-2.7%	+7.9%	+30.0%	➖ noise
11	duckdb:vortex-file-compressed	-3.3%	-2.7%	-0.6%	+36.3%	➖ noise
12	datafusion:vortex-compact	-16.6%	+18.3%	-29.5%	+38.2%	✅ faster
12	datafusion:vortex-file-compressed	+57.3%	+18.3%	+32.9%	+30.0%	🚨 regression
12	duckdb:vortex-compact	+3.3%	+18.3%	-12.7%	+30.0%	➖ noise
12	duckdb:vortex-file-compressed	-7.7%	+18.3%	-22.0%	+30.0%	➖ noise
13	datafusion:vortex-compact	+35.0%	-0.5%	+35.7%	+74.6%	➖ noise
13	datafusion:vortex-file-compressed	+0.4%	-0.5%	+0.9%	+31.8%	➖ noise
13	duckdb:vortex-compact	-3.2%	-0.5%	-2.7%	+30.0%	➖ noise
13	duckdb:vortex-file-compressed	-1.5%	-0.5%	-0.9%	+30.0%	➖ noise
14	datafusion:vortex-compact	+4.5%	+20.4%	-13.2%	+48.9%	➖ noise
14	datafusion:vortex-file-compressed	+20.5%	+20.4%	+0.1%	+82.1%	➖ noise
14	duckdb:vortex-compact	-0.3%	+20.4%	-17.2%	+30.0%	➖ noise
14	duckdb:vortex-file-compressed	-13.7%	+20.4%	-28.3%	+33.2%	✅ faster
15	datafusion:vortex-compact	+14.2%	+2.0%	+12.0%	+40.4%	➖ noise
15	datafusion:vortex-file-compressed	+26.6%	+2.0%	+24.2%	+30.0%	➖ noise
15	duckdb:vortex-compact	+1.5%	+2.0%	-0.4%	+40.0%	➖ noise
15	duckdb:vortex-file-compressed	+5.4%	+2.0%	+3.4%	+30.0%	➖ noise
16	datafusion:vortex-compact	+41.8%	+1.3%	+39.9%	+74.0%	➖ noise
16	datafusion:vortex-file-compressed	+10.1%	+1.3%	+8.6%	+30.0%	➖ noise
16	duckdb:vortex-compact	+3.1%	+1.3%	+1.7%	+30.0%	➖ noise
16	duckdb:vortex-file-compressed	+5.1%	+1.3%	+3.7%	+30.0%	➖ noise
17	datafusion:vortex-compact	-4.5%	-1.7%	-2.9%	+30.0%	➖ noise
17	datafusion:vortex-file-compressed	-3.9%	-1.7%	-2.2%	+30.0%	➖ noise
17	duckdb:vortex-compact	+2.7%	-1.7%	+4.5%	+30.0%	➖ noise
17	duckdb:vortex-file-compressed	+10.5%	-1.7%	+12.4%	+30.0%	➖ noise
18	datafusion:vortex-compact	-5.1%	-3.6%	-1.5%	+48.3%	➖ noise
18	datafusion:vortex-file-compressed	+15.4%	-3.6%	+19.7%	+30.0%	➖ noise
18	duckdb:vortex-compact	-2.5%	-3.6%	+1.2%	+38.4%	➖ noise
18	duckdb:vortex-file-compressed	-11.0%	-3.6%	-7.7%	+30.0%	➖ noise
19	datafusion:vortex-compact	-0.4%	-8.7%	+9.1%	+33.9%	➖ noise
19	datafusion:vortex-file-compressed	+17.8%	-8.7%	+29.0%	+30.0%	➖ noise
19	duckdb:vortex-compact	+5.6%	-8.7%	+15.7%	+30.0%	➖ noise
19	duckdb:vortex-file-compressed	-8.2%	-8.7%	+0.6%	+30.0%	➖ noise
20	datafusion:vortex-compact	+10.3%	-0.1%	+10.4%	+30.0%	➖ noise
20	datafusion:vortex-file-compressed	+18.5%	-0.1%	+18.6%	+30.0%	➖ noise
20	duckdb:vortex-compact	-14.1%	-0.1%	-14.0%	+30.0%	➖ noise
20	duckdb:vortex-file-compressed	-18.6%	-0.1%	-18.5%	+30.0%	➖ noise
21	datafusion:vortex-compact	+8.0%	-2.4%	+10.6%	+30.0%	➖ noise
21	datafusion:vortex-file-compressed	-0.8%	-2.4%	+1.6%	+30.0%	➖ noise
21	duckdb:vortex-compact	+6.0%	-2.4%	+8.6%	+30.0%	➖ noise
21	duckdb:vortex-file-compressed	-5.1%	-2.4%	-2.8%	+30.0%	➖ noise
22	datafusion:vortex-compact	+25.7%	-1.9%	+28.2%	+36.8%	➖ noise
22	datafusion:vortex-file-compressed	+23.1%	-1.9%	+25.5%	+53.7%	➖ noise
22	duckdb:vortex-compact	-1.2%	-1.9%	+0.8%	+30.0%	➖ noise
22	duckdb:vortex-file-compressed	+1.0%	-1.9%	+2.9%	+30.0%	➖ noise

github-actions · 2026-03-13T13:33:38Z

Benchmarks: FineWeb NVMe

Summary

Overall: 0.960x ➖
Vortex: 0.968x ➖
Parquet: 0.943x ➖

Verdict

No clear signal

Attributed Vortex impact: +2.7%
Confidence: low
Environment shift: -5.7%

Statistical Summary

Systemic shift (parquet controls): -5.7%
Control sigma: +1.6%
Residual noise: +2.6%
Median polish overall: -3.6%

datafusion / vortex-file-compressed (0.958x ➖, 2↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀	4098784	5253096	0.78
fineweb_q01/datafusion:vortex-file-compressed	26858288	26518669	1.01
fineweb_q02/datafusion:vortex-file-compressed	27979199	27624430	1.01
fineweb_q03/datafusion:vortex-file-compressed	89328351	83033981	1.08
fineweb_q04/datafusion:vortex-file-compressed	217561381	227877723	0.95
fineweb_q05/datafusion:vortex-file-compressed	194463919	205051350	0.95
fineweb_q06/datafusion:vortex-file-compressed	68726063	71427908	0.96
fineweb_q07/datafusion:vortex-file-compressed	71783593	66328168	1.08
fineweb_q08/datafusion:vortex-file-compressed 🚀	22657986	27030628	0.84

datafusion / vortex-compact (0.987x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-compact	4624350	4553186	1.02
fineweb_q01/datafusion:vortex-compact	163321445	166450502	0.98
fineweb_q02/datafusion:vortex-compact	162350204	167086729	0.97
fineweb_q03/datafusion:vortex-compact	1446377122	1475630158	0.98
fineweb_q04/datafusion:vortex-compact	1564974268	1581301562	0.99
fineweb_q05/datafusion:vortex-compact	1222140641	1268587112	0.96
fineweb_q06/datafusion:vortex-compact	687495089	705657951	0.97
fineweb_q07/datafusion:vortex-compact	724763892	734989955	0.99
fineweb_q08/datafusion:vortex-compact	24350326	23870222	1.02

datafusion / parquet (0.920x ➖, 1↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet	5884094	6430208	0.92
fineweb_q01/datafusion:parquet 🚀	267106436	300086561	0.89
fineweb_q02/datafusion:parquet	267740543	289578203	0.92
fineweb_q03/datafusion:parquet	267342224	292602685	0.91
fineweb_q04/datafusion:parquet	284312272	313530314	0.91
fineweb_q05/datafusion:parquet	280129941	298951478	0.94
fineweb_q06/datafusion:parquet	272662991	296045167	0.92
fineweb_q07/datafusion:parquet	268571865	295219822	0.91
fineweb_q08/datafusion:parquet	265147932	274211770	0.97

duckdb / vortex-file-compressed (0.975x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed	3293335	3357410	0.98
fineweb_q01/duckdb:vortex-file-compressed	26995273	28469731	0.95
fineweb_q02/duckdb:vortex-file-compressed	26697470	27880574	0.96
fineweb_q03/duckdb:vortex-file-compressed	140299791	132487010	1.06
fineweb_q04/duckdb:vortex-file-compressed	210680998	216787214	0.97
fineweb_q05/duckdb:vortex-file-compressed	179043561	178856421	1.00
fineweb_q06/duckdb:vortex-file-compressed	70114273	68323953	1.03
fineweb_q07/duckdb:vortex-file-compressed	64961413	70404127	0.92
fineweb_q08/duckdb:vortex-file-compressed	25335149	27661036	0.92

duckdb / vortex-compact (0.953x ➖, 1↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀	3932314	4610981	0.85
fineweb_q01/duckdb:vortex-compact	110405206	113497946	0.97
fineweb_q02/duckdb:vortex-compact	111173623	119703668	0.93
fineweb_q03/duckdb:vortex-compact	852154224	878109910	0.97
fineweb_q04/duckdb:vortex-compact	898397502	923281308	0.97
fineweb_q05/duckdb:vortex-compact	808708776	830326318	0.97
fineweb_q06/duckdb:vortex-compact	457093333	466054981	0.98
fineweb_q07/duckdb:vortex-compact	472539826	480324910	0.98
fineweb_q08/duckdb:vortex-compact	22108174	23272169	0.95

duckdb / parquet (0.966x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet	35545486	37236527	0.95
fineweb_q01/duckdb:parquet	92142782	96120883	0.96
fineweb_q02/duckdb:parquet	94618668	99292199	0.95
fineweb_q03/duckdb:parquet	304287803	308856692	0.99
fineweb_q04/duckdb:parquet	436791946	445034788	0.98
fineweb_q05/duckdb:parquet	407745824	417173378	0.98
fineweb_q06/duckdb:parquet	196190886	208245629	0.94
fineweb_q07/duckdb:parquet	206913640	214737853	0.96
fineweb_q08/duckdb:parquet	56237593	57439719	0.98

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-compact	+1.6%	-6.5%	+8.7%	+44.5%	➖ noise
0	datafusion:vortex-file-compressed	-22.0%	-6.5%	-16.5%	+70.2%	➖ noise
0	duckdb:vortex-compact	-14.7%	-6.5%	-8.8%	+40.8%	➖ noise
0	duckdb:vortex-file-compressed	-1.9%	-6.5%	+5.0%	+54.2%	➖ noise
1	datafusion:vortex-compact	-1.9%	-7.6%	+6.2%	+10.0%	➖ noise
1	datafusion:vortex-file-compressed	+1.3%	-7.6%	+9.6%	+16.3%	➖ noise
1	duckdb:vortex-compact	-2.7%	-7.6%	+5.3%	+21.8%	➖ noise
1	duckdb:vortex-file-compressed	-5.2%	-7.6%	+2.7%	+39.8%	➖ noise
2	datafusion:vortex-compact	-2.8%	-6.1%	+3.5%	+10.0%	➖ noise
2	datafusion:vortex-file-compressed	+1.3%	-6.1%	+7.9%	+11.2%	➖ noise
2	duckdb:vortex-compact	-7.1%	-6.1%	-1.1%	+13.4%	➖ noise
2	duckdb:vortex-file-compressed	-4.2%	-6.1%	+2.0%	+10.4%	➖ noise
3	datafusion:vortex-compact	-2.0%	-5.1%	+3.3%	+10.0%	➖ noise
3	datafusion:vortex-file-compressed	+7.6%	-5.1%	+13.4%	+29.8%	➖ noise
3	duckdb:vortex-compact	-3.0%	-5.1%	+2.3%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	+5.9%	-5.1%	+11.6%	+26.4%	➖ noise
4	datafusion:vortex-compact	-1.0%	-5.7%	+4.9%	+10.0%	➖ noise
4	datafusion:vortex-file-compressed	-4.5%	-5.7%	+1.2%	+10.0%	➖ noise
4	duckdb:vortex-compact	-2.7%	-5.7%	+3.1%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-2.8%	-5.7%	+3.0%	+10.0%	➖ noise
5	datafusion:vortex-compact	-3.7%	-4.3%	+0.7%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	-5.2%	-4.3%	-0.9%	+10.0%	➖ noise
5	duckdb:vortex-compact	-2.6%	-4.3%	+1.8%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	+0.1%	-4.3%	+4.6%	+10.0%	➖ noise
6	datafusion:vortex-compact	-2.6%	-6.8%	+4.6%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	-3.8%	-6.8%	+3.3%	+10.6%	➖ noise
6	duckdb:vortex-compact	-1.9%	-6.8%	+5.3%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	+2.6%	-6.8%	+10.2%	+18.1%	➖ noise
7	datafusion:vortex-compact	-1.4%	-6.4%	+5.3%	+10.0%	➖ noise
7	datafusion:vortex-file-compressed	+8.2%	-6.4%	+15.6%	+16.7%	➖ noise
7	duckdb:vortex-compact	-1.6%	-6.4%	+5.1%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	-7.7%	-6.4%	-1.4%	+15.0%	➖ noise
8	datafusion:vortex-compact	+2.0%	-2.7%	+4.8%	+24.4%	➖ noise
8	datafusion:vortex-file-compressed	-16.2%	-2.7%	-13.8%	+17.5%	➖ noise
8	duckdb:vortex-compact	-5.0%	-2.7%	-2.4%	+14.6%	➖ noise
8	duckdb:vortex-file-compressed	-8.4%	-2.7%	-5.9%	+15.9%	➖ noise

github-actions · 2026-03-13T13:33:46Z

Benchmarks: FineWeb S3

Summary

Overall: 1.013x ➖
Vortex: 1.006x ➖
Parquet: 1.027x ➖

Verdict

No clear signal

Attributed Vortex impact: -2.0%
Confidence: low
Environment shift: +2.7%

Statistical Summary

Systemic shift (parquet controls): +2.7%
Control sigma: +3.5%
Residual noise: +3.4%
Median polish overall: +0.5%

datafusion / vortex-file-compressed (0.989x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed	50279442	45893138	1.10
fineweb_q01/datafusion:vortex-file-compressed	569645083	519198149	1.10
fineweb_q02/datafusion:vortex-file-compressed	489364377	559246073	0.88
fineweb_q03/datafusion:vortex-file-compressed	1442173940	1376010684	1.05
fineweb_q04/datafusion:vortex-file-compressed	1365172001	1391516446	0.98
fineweb_q05/datafusion:vortex-file-compressed	1354183821	1387337544	0.98
fineweb_q06/datafusion:vortex-file-compressed	1533557405	1542046418	0.99
fineweb_q07/datafusion:vortex-file-compressed	1360128784	1432777630	0.95
fineweb_q08/datafusion:vortex-file-compressed	524476977	578807928	0.91

datafusion / vortex-compact (1.035x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-compact	40987917	32682119	1.25
fineweb_q01/datafusion:vortex-compact	517388770	509961075	1.01
fineweb_q02/datafusion:vortex-compact	662105780	669060665	0.99
fineweb_q03/datafusion:vortex-compact	1812091252	1845794145	0.98
fineweb_q04/datafusion:vortex-compact	2286727022	2199675662	1.04
fineweb_q05/datafusion:vortex-compact	1682027202	1700214299	0.99
fineweb_q06/datafusion:vortex-compact	1456825540	1402302986	1.04
fineweb_q07/datafusion:vortex-compact	1434415755	1372519991	1.05
fineweb_q08/datafusion:vortex-compact	398731071	402528552	0.99

datafusion / parquet (1.050x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet	1153693183	1127078620	1.02
fineweb_q01/datafusion:parquet	1786829965	1790803230	1.00
fineweb_q02/datafusion:parquet	1716180851	1744640081	0.98
fineweb_q03/datafusion:parquet	1851113973	1829639301	1.01
fineweb_q04/datafusion:parquet	1920886206	1895426883	1.01
fineweb_q05/datafusion:parquet	1996539812	1725748611	1.16
fineweb_q06/datafusion:parquet	2073247520	1739640626	1.19
fineweb_q07/datafusion:parquet	1772403836	1877858916	0.94
fineweb_q08/datafusion:parquet	1963119314	1701798524	1.15

duckdb / vortex-file-compressed (1.035x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed	107731737	95570143	1.13
fineweb_q01/duckdb:vortex-file-compressed	609568462	557248689	1.09
fineweb_q02/duckdb:vortex-file-compressed	457842570	416818790	1.10
fineweb_q03/duckdb:vortex-file-compressed	1500754303	1462318377	1.03
fineweb_q04/duckdb:vortex-file-compressed	1527170802	1509888549	1.01
fineweb_q05/duckdb:vortex-file-compressed	1451453802	1529709156	0.95
fineweb_q06/duckdb:vortex-file-compressed	1695515301	1671408718	1.01
fineweb_q07/duckdb:vortex-file-compressed	1482904480	1543812261	0.96
fineweb_q08/duckdb:vortex-file-compressed	680058785	650063573	1.05

duckdb / vortex-compact (0.968x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-compact	79501546	82195790	0.97
fineweb_q01/duckdb:vortex-compact	518675727	533669108	0.97
fineweb_q02/duckdb:vortex-compact	561081092	603065551	0.93
fineweb_q03/duckdb:vortex-compact	1682189620	1691834592	0.99
fineweb_q04/duckdb:vortex-compact	1672735255	1757139049	0.95
fineweb_q05/duckdb:vortex-compact	1520884393	1589463577	0.96
fineweb_q06/duckdb:vortex-compact	1384288475	1455455116	0.95
fineweb_q07/duckdb:vortex-compact	1272203966	1349633319	0.94
fineweb_q08/duckdb:vortex-compact	506014917	482646287	1.05

duckdb / parquet (1.005x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet	1043031614	1055501310	0.99
fineweb_q01/duckdb:parquet	1584074190	1585567832	1.00
fineweb_q02/duckdb:parquet	1711421111	1619045705	1.06
fineweb_q03/duckdb:parquet	4064256119	3928111691	1.03
fineweb_q04/duckdb:parquet	1941458340	1900870547	1.02
fineweb_q05/duckdb:parquet	2608433699	2658829234	0.98
fineweb_q06/duckdb:parquet	3278734811	3314290748	0.99
fineweb_q07/duckdb:parquet	3879740999	3855168854	1.01
fineweb_q08/duckdb:parquet	1054748264	1086052827	0.97

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-compact	+25.4%	+0.6%	+24.7%	+174.2%	➖ noise
0	datafusion:vortex-file-compressed	+9.6%	+0.6%	+8.9%	+161.9%	➖ noise
0	duckdb:vortex-compact	-3.3%	+0.6%	-3.8%	+47.4%	➖ noise
0	duckdb:vortex-file-compressed	+12.7%	+0.6%	+12.1%	+36.0%	➖ noise
1	datafusion:vortex-compact	+1.5%	-0.2%	+1.6%	+81.8%	➖ noise
1	datafusion:vortex-file-compressed	+9.7%	-0.2%	+9.9%	+64.7%	➖ noise
1	duckdb:vortex-compact	-2.8%	-0.2%	-2.7%	+30.0%	➖ noise
1	duckdb:vortex-file-compressed	+9.4%	-0.2%	+9.6%	+30.0%	➖ noise
2	datafusion:vortex-compact	-1.0%	+2.0%	-3.0%	+30.0%	➖ noise
2	datafusion:vortex-file-compressed	-12.5%	+2.0%	-14.2%	+30.0%	➖ noise
2	duckdb:vortex-compact	-7.0%	+2.0%	-8.8%	+30.0%	➖ noise
2	duckdb:vortex-file-compressed	+9.8%	+2.0%	+7.7%	+30.0%	➖ noise
3	datafusion:vortex-compact	-1.8%	+2.3%	-4.0%	+30.0%	➖ noise
3	datafusion:vortex-file-compressed	+4.8%	+2.3%	+2.4%	+30.0%	➖ noise
3	duckdb:vortex-compact	-0.6%	+2.3%	-2.8%	+30.0%	➖ noise
3	duckdb:vortex-file-compressed	+2.6%	+2.3%	+0.3%	+30.0%	➖ noise
4	datafusion:vortex-compact	+4.0%	+1.7%	+2.2%	+30.0%	➖ noise
4	datafusion:vortex-file-compressed	-1.9%	+1.7%	-3.6%	+30.0%	➖ noise
4	duckdb:vortex-compact	-4.8%	+1.7%	-6.4%	+30.0%	➖ noise
4	duckdb:vortex-file-compressed	+1.1%	+1.7%	-0.6%	+30.0%	➖ noise
5	datafusion:vortex-compact	-1.1%	+6.5%	-7.1%	+30.0%	➖ noise
5	datafusion:vortex-file-compressed	-2.4%	+6.5%	-8.4%	+30.0%	➖ noise
5	duckdb:vortex-compact	-4.3%	+6.5%	-10.2%	+30.0%	➖ noise
5	duckdb:vortex-file-compressed	-5.1%	+6.5%	-10.9%	+30.0%	➖ noise
6	datafusion:vortex-compact	+3.9%	+8.6%	-4.3%	+30.0%	➖ noise
6	datafusion:vortex-file-compressed	-0.6%	+8.6%	-8.4%	+30.0%	➖ noise
6	duckdb:vortex-compact	-4.9%	+8.6%	-12.4%	+30.0%	➖ noise
6	duckdb:vortex-file-compressed	+1.4%	+8.6%	-6.6%	+30.0%	➖ noise
7	datafusion:vortex-compact	+4.5%	-2.5%	+7.2%	+30.0%	➖ noise
7	datafusion:vortex-file-compressed	-5.1%	-2.5%	-2.6%	+30.0%	➖ noise
7	duckdb:vortex-compact	-5.7%	-2.5%	-3.3%	+30.0%	➖ noise
7	duckdb:vortex-file-compressed	-3.9%	-2.5%	-1.4%	+30.0%	➖ noise
8	datafusion:vortex-compact	-0.9%	+5.8%	-6.4%	+30.0%	➖ noise
8	datafusion:vortex-file-compressed	-9.4%	+5.8%	-14.4%	+30.0%	➖ noise
8	duckdb:vortex-compact	+4.8%	+5.8%	-0.9%	+30.0%	➖ noise
8	duckdb:vortex-file-compressed	+4.6%	+5.8%	-1.2%	+30.0%	➖ noise

github-actions · 2026-03-13T13:33:58Z

Benchmarks: TPC-H SF=10 on S3

Summary

Overall: 1.031x ➖
Vortex: 1.040x ➖
Parquet: 1.015x ➖

Verdict

No clear signal

Attributed Vortex impact: +2.5%
Confidence: environment too noisy
Environment shift: +1.5%

Statistical Summary

Systemic shift (parquet controls): +1.5%
Control sigma: +7.8%
Residual noise: +7.0%
Median polish overall: +2.5%

datafusion / vortex-file-compressed (1.066x ➖, 0↑ 2↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	745670537	767401722	0.97
tpch_q02/datafusion:vortex-file-compressed	709656499	799957368	0.89
tpch_q03/datafusion:vortex-file-compressed	803277528	797148740	1.01
tpch_q04/datafusion:vortex-file-compressed	692828643	628179876	1.10
tpch_q05/datafusion:vortex-file-compressed	1210607270	1109573823	1.09
tpch_q06/datafusion:vortex-file-compressed	778682593	620228424	1.26
tpch_q07/datafusion:vortex-file-compressed	1433097515	1140186680	1.26
tpch_q08/datafusion:vortex-file-compressed	1428185891	1201587652	1.19
tpch_q09/datafusion:vortex-file-compressed	1442374975	1478324879	0.98
tpch_q10/datafusion:vortex-file-compressed	1043715747	1030496001	1.01
tpch_q11/datafusion:vortex-file-compressed	476869570	475997894	1.00
tpch_q12/datafusion:vortex-file-compressed	1090990394	1059815791	1.03
tpch_q13/datafusion:vortex-file-compressed	465655825	539821999	0.86
tpch_q14/datafusion:vortex-file-compressed	615668961	607014576	1.01
tpch_q15/datafusion:vortex-file-compressed	1278714109	1128102964	1.13
tpch_q16/datafusion:vortex-file-compressed 🚨	390186790	279226710	1.40
tpch_q17/datafusion:vortex-file-compressed	1191891954	1244644378	0.96
tpch_q18/datafusion:vortex-file-compressed	1464688281	1317021495	1.11
tpch_q19/datafusion:vortex-file-compressed 🚨	965699525	730080520	1.32
tpch_q20/datafusion:vortex-file-compressed	947621412	956498095	0.99
tpch_q21/datafusion:vortex-file-compressed	1679094470	1644035738	1.02
tpch_q22/datafusion:vortex-file-compressed	446035094	428038576	1.04

datafusion / vortex-compact (1.057x ➖, 1↑ 2↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	754754573	717395374	1.05
tpch_q02/datafusion:vortex-compact 🚨	916665014	638558707	1.44
tpch_q03/datafusion:vortex-compact	816351178	674477155	1.21
tpch_q04/datafusion:vortex-compact	627107238	549436420	1.14
tpch_q05/datafusion:vortex-compact	1029976448	982053562	1.05
tpch_q06/datafusion:vortex-compact	603174039	593125704	1.02
tpch_q07/datafusion:vortex-compact	1149414358	1240024449	0.93
tpch_q08/datafusion:vortex-compact	1166293801	1167247531	1.00
tpch_q09/datafusion:vortex-compact	1317660531	1315860510	1.00
tpch_q10/datafusion:vortex-compact	980987193	932137907	1.05
tpch_q11/datafusion:vortex-compact	463706804	442937415	1.05
tpch_q12/datafusion:vortex-compact 🚨	1136002087	810946333	1.40
tpch_q13/datafusion:vortex-compact	431725209	393075670	1.10
tpch_q14/datafusion:vortex-compact	677462793	579366170	1.17
tpch_q15/datafusion:vortex-compact	1306701449	1052025298	1.24
tpch_q16/datafusion:vortex-compact	333867007	334211129	1.00
tpch_q17/datafusion:vortex-compact	1175477138	1181389672	0.99
tpch_q18/datafusion:vortex-compact	1242341205	1196320724	1.04
tpch_q19/datafusion:vortex-compact	695337872	719319451	0.97
tpch_q20/datafusion:vortex-compact	918964752	847768250	1.08
tpch_q21/datafusion:vortex-compact	1538161223	1569044502	0.98
tpch_q22/datafusion:vortex-compact 🚀	326434001	520931060	0.63

datafusion / parquet (0.978x ➖, 0↑ 1↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	881849678	875884329	1.01
tpch_q02/datafusion:parquet 🚨	919521803	683894374	1.34
tpch_q03/datafusion:parquet	1013701742	1193439829	0.85
tpch_q04/datafusion:parquet	534567670	716761239	0.75
tpch_q05/datafusion:parquet	1251240741	1302653704	0.96
tpch_q06/datafusion:parquet	532068125	595179631	0.89
tpch_q07/datafusion:parquet	1388563494	1395323327	1.00
tpch_q08/datafusion:parquet	1691292904	1783612990	0.95
tpch_q09/datafusion:parquet	2048823325	1991121223	1.03
tpch_q10/datafusion:parquet	2731085606	2315453755	1.18
tpch_q11/datafusion:parquet	774613661	781174271	0.99
tpch_q12/datafusion:parquet	757375204	794766042	0.95
tpch_q13/datafusion:parquet	751624847	687648974	1.09
tpch_q14/datafusion:parquet	824702499	800859080	1.03
tpch_q15/datafusion:parquet	1248276690	1185759475	1.05
tpch_q16/datafusion:parquet	396956956	478094647	0.83
tpch_q17/datafusion:parquet	1457785322	1498933871	0.97
tpch_q18/datafusion:parquet	1662322786	1592184805	1.04
tpch_q19/datafusion:parquet	991923481	947629579	1.05
tpch_q20/datafusion:parquet	1136589246	1185341918	0.96
tpch_q21/datafusion:parquet	1826605962	1789484493	1.02
tpch_q22/datafusion:parquet	805773095	1081492689	0.75

duckdb / vortex-file-compressed (1.002x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	592657982	602359691	0.98
tpch_q02/duckdb:vortex-file-compressed	1094982165	1073843756	1.02
tpch_q03/duckdb:vortex-file-compressed	945410400	961648500	0.98
tpch_q04/duckdb:vortex-file-compressed	557171011	604883426	0.92
tpch_q05/duckdb:vortex-file-compressed	1030898082	1066713541	0.97
tpch_q06/duckdb:vortex-file-compressed	803230324	763642882	1.05
tpch_q07/duckdb:vortex-file-compressed	1096559585	1016253362	1.08
tpch_q08/duckdb:vortex-file-compressed	1309288892	1314353540	1.00
tpch_q09/duckdb:vortex-file-compressed	1399658513	1407605285	0.99
tpch_q10/duckdb:vortex-file-compressed	1028753791	1129439084	0.91
tpch_q11/duckdb:vortex-file-compressed	561923652	721901390	0.78
tpch_q12/duckdb:vortex-file-compressed	715262394	681286626	1.05
tpch_q13/duckdb:vortex-file-compressed	1024721584	995512255	1.03
tpch_q14/duckdb:vortex-file-compressed	882311605	868304158	1.02
tpch_q15/duckdb:vortex-file-compressed	533300371	554974251	0.96
tpch_q16/duckdb:vortex-file-compressed	476924638	401865389	1.19
tpch_q17/duckdb:vortex-file-compressed	936892316	980660750	0.96
tpch_q18/duckdb:vortex-file-compressed	1121777436	900670329	1.25
tpch_q19/duckdb:vortex-file-compressed	746728721	804554384	0.93
tpch_q20/duckdb:vortex-file-compressed	1318910993	1150773040	1.15
tpch_q21/duckdb:vortex-file-compressed	1863835066	1875191317	0.99
tpch_q22/duckdb:vortex-file-compressed	540978352	566769449	0.95

duckdb / vortex-compact (1.034x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	625952901	625322971	1.00
tpch_q02/duckdb:vortex-compact	986951923	1115916903	0.88
tpch_q03/duckdb:vortex-compact	900346733	825408218	1.09
tpch_q04/duckdb:vortex-compact	633834381	496821347	1.28
tpch_q05/duckdb:vortex-compact	986692981	1046816244	0.94
tpch_q06/duckdb:vortex-compact	704121693	681792961	1.03
tpch_q07/duckdb:vortex-compact	1123676905	1152704388	0.97
tpch_q08/duckdb:vortex-compact	1352044094	1365924125	0.99
tpch_q09/duckdb:vortex-compact	1356955510	1290473280	1.05
tpch_q10/duckdb:vortex-compact	965557380	905963959	1.07
tpch_q11/duckdb:vortex-compact	663210437	709123615	0.94
tpch_q12/duckdb:vortex-compact	639396188	648785113	0.99
tpch_q13/duckdb:vortex-compact	881695763	849261970	1.04
tpch_q14/duckdb:vortex-compact	945800818	864308225	1.09
tpch_q15/duckdb:vortex-compact	554038232	532548688	1.04
tpch_q16/duckdb:vortex-compact	495781139	432569620	1.15
tpch_q17/duckdb:vortex-compact	875743736	930642906	0.94
tpch_q18/duckdb:vortex-compact	751535338	656052640	1.15
tpch_q19/duckdb:vortex-compact	776216422	708010084	1.10
tpch_q20/duckdb:vortex-compact	1266363060	1165487890	1.09
tpch_q21/duckdb:vortex-compact	1724106827	1689573437	1.02
tpch_q22/duckdb:vortex-compact	621728264	629810140	0.99

duckdb / parquet (1.053x ➖, 0↑ 1↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	865966052	874751453	0.99
tpch_q02/duckdb:parquet	1474778750	1498957615	0.98
tpch_q03/duckdb:parquet	1950408209	1522257607	1.28
tpch_q04/duckdb:parquet	876632531	945328691	0.93
tpch_q05/duckdb:parquet	2123067008	2035023606	1.04
tpch_q06/duckdb:parquet	862689845	739007933	1.17
tpch_q07/duckdb:parquet	1842302789	1564355995	1.18
tpch_q08/duckdb:parquet	2382685016	2307279209	1.03
tpch_q09/duckdb:parquet	2305380243	2256829063	1.02
tpch_q10/duckdb:parquet	3060201078	3032822451	1.01
tpch_q11/duckdb:parquet	1075699762	966942116	1.11
tpch_q12/duckdb:parquet	1058156091	1013976574	1.04
tpch_q13/duckdb:parquet	1189872424	1158348427	1.03
tpch_q14/duckdb:parquet	1264294113	1238656360	1.02
tpch_q15/duckdb:parquet 🚨	1086961035	835264920	1.30
tpch_q16/duckdb:parquet	787277899	719401710	1.09
tpch_q17/duckdb:parquet	1268944347	1173488775	1.08
tpch_q18/duckdb:parquet	1369290182	1405069428	0.97
tpch_q19/duckdb:parquet	1394212001	1395808383	1.00
tpch_q20/duckdb:parquet	1601568165	1589500068	1.01
tpch_q21/duckdb:parquet	1768269080	1887047691	0.94
tpch_q22/duckdb:parquet	1055403148	1026690970	1.03

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	+5.2%	-0.2%	+5.4%	+57.4%	➖ noise
1	datafusion:vortex-file-compressed	-2.8%	-0.2%	-2.7%	+68.0%	➖ noise
1	duckdb:vortex-compact	+0.1%	-0.2%	+0.3%	+30.0%	➖ noise
1	duckdb:vortex-file-compressed	-1.6%	-0.2%	-1.4%	+30.0%	➖ noise
2	datafusion:vortex-compact	+43.6%	+15.0%	+24.8%	+57.3%	➖ noise
2	datafusion:vortex-file-compressed	-11.3%	+15.0%	-22.9%	+53.8%	➖ noise
2	duckdb:vortex-compact	-11.6%	+15.0%	-23.1%	+36.7%	➖ noise
2	duckdb:vortex-file-compressed	+2.0%	+15.0%	-11.3%	+35.0%	➖ noise
3	datafusion:vortex-compact	+21.0%	+4.3%	+16.0%	+80.4%	➖ noise
3	datafusion:vortex-file-compressed	+0.8%	+4.3%	-3.4%	+87.7%	➖ noise
3	duckdb:vortex-compact	+9.1%	+4.3%	+4.6%	+42.4%	➖ noise
3	duckdb:vortex-file-compressed	-1.7%	+4.3%	-5.8%	+35.5%	➖ noise
4	datafusion:vortex-compact	+14.1%	-16.8%	+37.2%	+30.0%	🚨 regression
4	datafusion:vortex-file-compressed	+10.3%	-16.8%	+32.6%	+31.5%	🚨 regression
4	duckdb:vortex-compact	+27.6%	-16.8%	+53.4%	+40.4%	🚨 regression
4	duckdb:vortex-file-compressed	-7.9%	-16.8%	+10.8%	+30.0%	➖ noise
5	datafusion:vortex-compact	+4.9%	+0.1%	+4.8%	+30.0%	➖ noise
5	datafusion:vortex-file-compressed	+9.1%	+0.1%	+9.0%	+30.0%	➖ noise
5	duckdb:vortex-compact	-5.7%	+0.1%	-5.8%	+30.0%	➖ noise
5	duckdb:vortex-file-compressed	-3.4%	+0.1%	-3.5%	+30.0%	➖ noise
6	datafusion:vortex-compact	+1.7%	+2.2%	-0.5%	+30.0%	➖ noise
6	datafusion:vortex-file-compressed	+25.5%	+2.2%	+22.9%	+35.6%	➖ noise
6	duckdb:vortex-compact	+3.3%	+2.2%	+1.1%	+30.0%	➖ noise
6	duckdb:vortex-file-compressed	+5.2%	+2.2%	+3.0%	+30.0%	➖ noise
7	datafusion:vortex-compact	-7.3%	+8.3%	-14.4%	+30.0%	➖ noise
7	datafusion:vortex-file-compressed	+25.7%	+8.3%	+16.1%	+30.0%	➖ noise
7	duckdb:vortex-compact	-2.5%	+8.3%	-10.0%	+30.0%	➖ noise
7	duckdb:vortex-file-compressed	+7.9%	+8.3%	-0.3%	+30.0%	➖ noise
8	datafusion:vortex-compact	-0.1%	-1.0%	+1.0%	+30.0%	➖ noise
8	datafusion:vortex-file-compressed	+18.9%	-1.0%	+20.1%	+30.9%	➖ noise
8	duckdb:vortex-compact	-1.0%	-1.0%	+0.0%	+30.0%	➖ noise
8	duckdb:vortex-file-compressed	-0.4%	-1.0%	+0.7%	+30.0%	➖ noise
9	datafusion:vortex-compact	+0.1%	+2.5%	-2.3%	+30.0%	➖ noise
9	datafusion:vortex-file-compressed	-2.4%	+2.5%	-4.8%	+30.0%	➖ noise
9	duckdb:vortex-compact	+5.2%	+2.5%	+2.6%	+30.0%	➖ noise
9	duckdb:vortex-file-compressed	-0.6%	+2.5%	-3.0%	+30.0%	➖ noise
10	datafusion:vortex-compact	+5.2%	+9.1%	-3.5%	+30.0%	➖ noise
10	datafusion:vortex-file-compressed	+1.3%	+9.1%	-7.2%	+30.0%	➖ noise
10	duckdb:vortex-compact	+6.6%	+9.1%	-2.3%	+34.0%	➖ noise
10	duckdb:vortex-file-compressed	-8.9%	+9.1%	-16.5%	+30.0%	➖ noise
11	datafusion:vortex-compact	+4.7%	+5.0%	-0.3%	+58.4%	➖ noise
11	datafusion:vortex-file-compressed	+0.2%	+5.0%	-4.6%	+33.1%	➖ noise
11	duckdb:vortex-compact	-6.5%	+5.0%	-11.0%	+30.0%	➖ noise
11	duckdb:vortex-file-compressed	-22.2%	+5.0%	-25.9%	+30.0%	✅ faster
12	datafusion:vortex-compact	+40.1%	-0.3%	+40.5%	+31.1%	🚨 regression
12	datafusion:vortex-file-compressed	+2.9%	-0.3%	+3.2%	+39.3%	➖ noise
12	duckdb:vortex-compact	-1.4%	-0.3%	-1.2%	+61.2%	➖ noise
12	duckdb:vortex-file-compressed	+5.0%	-0.3%	+5.3%	+30.0%	➖ noise
13	datafusion:vortex-compact	+9.8%	+6.0%	+3.7%	+33.0%	➖ noise
13	datafusion:vortex-file-compressed	-13.7%	+6.0%	-18.6%	+63.3%	➖ noise
13	duckdb:vortex-compact	+3.8%	+6.0%	-2.0%	+59.2%	➖ noise
13	duckdb:vortex-file-compressed	+2.9%	+6.0%	-2.9%	+43.2%	➖ noise
14	datafusion:vortex-compact	+16.9%	+2.5%	+14.1%	+30.0%	➖ noise
14	datafusion:vortex-file-compressed	+1.4%	+2.5%	-1.1%	+30.0%	➖ noise
14	duckdb:vortex-compact	+9.4%	+2.5%	+6.7%	+30.0%	➖ noise
14	duckdb:vortex-file-compressed	+1.6%	+2.5%	-0.9%	+30.0%	➖ noise
15	datafusion:vortex-compact	+24.2%	+17.0%	+6.1%	+30.0%	➖ noise
15	datafusion:vortex-file-compressed	+13.4%	+17.0%	-3.2%	+30.0%	➖ noise
15	duckdb:vortex-compact	+4.0%	+17.0%	-11.1%	+30.0%	➖ noise
15	duckdb:vortex-file-compressed	-3.9%	+17.0%	-17.9%	+30.0%	➖ noise
16	datafusion:vortex-compact	-0.1%	-4.7%	+4.8%	+30.0%	➖ noise
16	datafusion:vortex-file-compressed	+39.7%	-4.7%	+46.6%	+30.0%	🚨 regression
16	duckdb:vortex-compact	+14.6%	-4.7%	+20.2%	+30.0%	➖ noise
16	duckdb:vortex-file-compressed	+18.7%	-4.7%	+24.5%	+30.0%	➖ noise
17	datafusion:vortex-compact	-0.5%	+2.6%	-3.0%	+30.0%	➖ noise
17	datafusion:vortex-file-compressed	-4.2%	+2.6%	-6.6%	+30.0%	➖ noise
17	duckdb:vortex-compact	-5.9%	+2.6%	-8.2%	+30.0%	➖ noise
17	duckdb:vortex-file-compressed	-4.5%	+2.6%	-6.8%	+30.0%	➖ noise
18	datafusion:vortex-compact	+3.8%	+0.9%	+3.0%	+30.0%	➖ noise
18	datafusion:vortex-file-compressed	+11.2%	+0.9%	+10.3%	+30.0%	➖ noise
18	duckdb:vortex-compact	+14.6%	+0.9%	+13.6%	+30.0%	➖ noise
18	duckdb:vortex-file-compressed	+24.5%	+0.9%	+23.5%	+37.8%	➖ noise
19	datafusion:vortex-compact	-3.3%	+2.3%	-5.5%	+30.0%	➖ noise
19	datafusion:vortex-file-compressed	+32.3%	+2.3%	+29.4%	+30.0%	➖ noise
19	duckdb:vortex-compact	+9.6%	+2.3%	+7.2%	+30.0%	➖ noise
19	duckdb:vortex-file-compressed	-7.2%	+2.3%	-9.2%	+30.0%	➖ noise
20	datafusion:vortex-compact	+8.4%	-1.7%	+10.3%	+30.0%	➖ noise
20	datafusion:vortex-file-compressed	-0.9%	-1.7%	+0.8%	+35.9%	➖ noise
20	duckdb:vortex-compact	+8.7%	-1.7%	+10.5%	+30.0%	➖ noise
20	duckdb:vortex-file-compressed	+14.6%	-1.7%	+16.6%	+30.0%	➖ noise
21	datafusion:vortex-compact	-2.0%	-2.2%	+0.2%	+30.0%	➖ noise
21	datafusion:vortex-file-compressed	+2.1%	-2.2%	+4.4%	+30.0%	➖ noise
21	duckdb:vortex-compact	+2.0%	-2.2%	+4.3%	+30.0%	➖ noise
21	duckdb:vortex-file-compressed	-0.6%	-2.2%	+1.6%	+30.0%	➖ noise
22	datafusion:vortex-compact	-37.3%	-12.5%	-28.4%	+41.5%	➖ noise
22	datafusion:vortex-file-compressed	+4.2%	-12.5%	+19.1%	+68.9%	➖ noise
22	duckdb:vortex-compact	-1.3%	-12.5%	+12.8%	+46.8%	➖ noise
22	duckdb:vortex-file-compressed	-4.6%	-12.5%	+9.1%	+32.0%	➖ noise

github-actions · 2026-03-13T13:38:57Z

Benchmarks: Statistical and Population Genetics

Summary

Overall: 0.967x ➖
Vortex: 0.965x ➖
Parquet: 0.970x ➖

Verdict

No clear signal

Attributed Vortex impact: -0.5%
Confidence: low
Environment shift: -3.0%

Statistical Summary

Systemic shift (parquet controls): -3.0%
Control sigma: +1.5%
Residual noise: +0.3%
Median polish overall: -2.7%

duckdb / vortex-file-compressed (0.952x ➖, 1↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed	10772446	11374292	0.95
statpopgen_q01/duckdb:vortex-file-compressed 🚀	26793188	32542582	0.82
statpopgen_q02/duckdb:vortex-file-compressed	1296207372	1336274214	0.97
statpopgen_q03/duckdb:vortex-file-compressed	3021054811	3110205347	0.97
statpopgen_q04/duckdb:vortex-file-compressed	3029953237	3134096860	0.97
statpopgen_q05/duckdb:vortex-file-compressed	1368812940	1428536489	0.96
statpopgen_q06/duckdb:vortex-file-compressed	2060627520	2071336488	0.99
statpopgen_q07/duckdb:vortex-file-compressed	192335939	201934003	0.95
statpopgen_q08/duckdb:vortex-file-compressed	204871192	216986403	0.94
statpopgen_q09/duckdb:vortex-file-compressed	2869151371	2956096960	0.97
statpopgen_q10/duckdb:vortex-file-compressed	4657638054	4745124072	0.98

duckdb / vortex-compact (0.978x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact	10623869	11403520	0.93
statpopgen_q01/duckdb:vortex-compact	174587529	170906148	1.02
statpopgen_q02/duckdb:vortex-compact	1797930237	1860561279	0.97
statpopgen_q03/duckdb:vortex-compact	3525690252	3542046730	1.00
statpopgen_q04/duckdb:vortex-compact	3522121661	3590089656	0.98
statpopgen_q05/duckdb:vortex-compact	1799530910	1873415958	0.96
statpopgen_q06/duckdb:vortex-compact	2660246395	2731332169	0.97
statpopgen_q07/duckdb:vortex-compact	960519533	984747339	0.98
statpopgen_q08/duckdb:vortex-compact	1008726825	1018642549	0.99
statpopgen_q09/duckdb:vortex-compact	3309463809	3370621797	0.98
statpopgen_q10/duckdb:vortex-compact	5408643251	5488884648	0.99

duckdb / parquet (0.970x ➖, 0↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
statpopgen_q00/duckdb:parquet	310411849	323575495	0.96
statpopgen_q01/duckdb:parquet	398166371	411692198	0.97
statpopgen_q02/duckdb:parquet	1001274145	1023245572	0.98
statpopgen_q03/duckdb:parquet	1516159492	1551091331	0.98
statpopgen_q04/duckdb:parquet	1503093829	1534482876	0.98
statpopgen_q05/duckdb:parquet	990385664	1034909103	0.96
statpopgen_q06/duckdb:parquet	1490854244	1531064905	0.97
statpopgen_q07/duckdb:parquet	1891234536	1919967798	0.99
statpopgen_q08/duckdb:parquet	1881222609	1906230951	0.99
statpopgen_q09/duckdb:parquet	1353135040	1439599122	0.94
statpopgen_q10/duckdb:parquet	2675743298	2772380066	0.97

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	duckdb:vortex-compact	-6.8%	-4.1%	-2.9%	+10.0%	➖ noise
0	duckdb:vortex-file-compressed	-5.3%	-4.1%	-1.3%	+10.0%	➖ noise
1	duckdb:vortex-compact	+2.2%	-3.3%	+5.6%	+38.2%	➖ noise
1	duckdb:vortex-file-compressed	-17.7%	-3.3%	-14.9%	+257.7%	➖ noise
2	duckdb:vortex-compact	-3.4%	-2.1%	-1.2%	+10.0%	➖ noise
2	duckdb:vortex-file-compressed	-3.0%	-2.1%	-0.9%	+10.0%	➖ noise
3	duckdb:vortex-compact	-0.5%	-2.3%	+1.8%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	-2.9%	-2.3%	-0.6%	+10.0%	➖ noise
4	duckdb:vortex-compact	-1.9%	-2.0%	+0.2%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-3.3%	-2.0%	-1.3%	+10.0%	➖ noise
5	duckdb:vortex-compact	-3.9%	-4.3%	+0.4%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	-4.2%	-4.3%	+0.1%	+10.0%	➖ noise
6	duckdb:vortex-compact	-2.6%	-2.6%	+0.0%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	-0.5%	-2.6%	+2.2%	+10.0%	➖ noise
7	duckdb:vortex-compact	-2.5%	-1.5%	-1.0%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	-4.8%	-1.5%	-3.3%	+10.0%	➖ noise
8	duckdb:vortex-compact	-1.0%	-1.3%	+0.3%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-5.6%	-1.3%	-4.3%	+10.0%	➖ noise
9	duckdb:vortex-compact	-1.8%	-6.0%	+4.5%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	-2.9%	-6.0%	+3.3%	+10.0%	➖ noise
10	duckdb:vortex-compact	-1.5%	-3.5%	+2.1%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-1.8%	-3.5%	+1.7%	+10.0%	➖ noise

github-actions · 2026-03-13T14:44:31Z

Benchmarks: Random Access

Summary

Overall: 0.901x ➖
Vortex: 0.836x ✅
Parquet: 0.960x ➖

unknown / unknown (0.901x ➖, 13↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀	2589445	5285176	0.49
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚀	1339797	1496149	0.90
random-access/feature-vectors/correlated/parquet-tokio-local-disk	14014011170	13862083151	1.01
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer	13479533617	13717619543	0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk	7544063	7955517	0.95
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀	5643010	6574520	0.86
random-access/feature-vectors/uniform/lance-tokio-local-disk	1556161	1715636	0.91
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚀	2498283	2776754	0.90
random-access/feature-vectors/uniform/parquet-tokio-local-disk	13461289532	13780783637	0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer	13525816982	13701318913	0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀	12784643	14298781	0.89
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer	13104481	14230288	0.92
random-access/lance-tokio-local-disk	766848	783788	0.98
random-access/lance-tokio-local-disk-footer	1409814	1466246	0.96
random-access/nested-lists/correlated/lance-tokio-local-disk	272147	291673	0.93
random-access/nested-lists/correlated/lance-tokio-local-disk-footer	760111	832310	0.91
random-access/nested-lists/correlated/parquet-tokio-local-disk	165148579	169118219	0.98
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer	163023367	172998460	0.94
random-access/nested-lists/correlated/vortex-tokio-local-disk	716104	744352	0.96
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer	719795	744807	0.97
random-access/nested-lists/uniform/lance-tokio-local-disk	1228147	1284424	0.96
random-access/nested-lists/uniform/lance-tokio-local-disk-footer	1774118	1839590	0.96
random-access/nested-lists/uniform/parquet-tokio-local-disk	164584686	172409381	0.95
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer	163402873	171837738	0.95
random-access/nested-lists/uniform/vortex-tokio-local-disk	2369446	2626697	0.90
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀	2484732	2863427	0.87
random-access/nested-structs/correlated/lance-tokio-local-disk	441873	478005	0.92
random-access/nested-structs/correlated/lance-tokio-local-disk-footer	662837	727066	0.91
random-access/nested-structs/correlated/parquet-tokio-local-disk	27515242	29155786	0.94
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer	26995783	28746324	0.94
random-access/nested-structs/correlated/vortex-tokio-local-disk	897789	951104	0.94
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer	910461	974809	0.93
random-access/nested-structs/uniform/lance-tokio-local-disk	3004025	3129623	0.96
random-access/nested-structs/uniform/lance-tokio-local-disk-footer	3266249	3347786	0.98
random-access/nested-structs/uniform/parquet-tokio-local-disk	27295051	30028748	0.91
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer	27103899	29544180	0.92
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚀	1783144	1994376	0.89
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer	1792018	1959901	0.91
random-access/parquet-tokio-local-disk	187036073	193052192	0.97
random-access/parquet-tokio-local-disk-footer	187338351	194386169	0.96
random-access/taxi/correlated/lance-tokio-local-disk	987360	1032715	0.96
random-access/taxi/correlated/lance-tokio-local-disk-footer	1718601	1807275	0.95
random-access/taxi/correlated/parquet-tokio-local-disk	282025540	288497120	0.98
random-access/taxi/correlated/parquet-tokio-local-disk-footer	275817597	285111393	0.97
random-access/taxi/correlated/vortex-tokio-local-disk 🚀	1742569	2704935	0.64
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀	1750212	2651246	0.66
random-access/taxi/uniform/lance-tokio-local-disk	8961838	9132551	0.98
random-access/taxi/uniform/lance-tokio-local-disk-footer	9704699	9800523	0.99
random-access/taxi/uniform/parquet-tokio-local-disk	293949989	304002481	0.97
random-access/taxi/uniform/parquet-tokio-local-disk-footer	291675793	305630515	0.95
random-access/taxi/uniform/vortex-tokio-local-disk 🚀	4388780	5637993	0.78
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀	4443475	5665947	0.78
random-access/vortex-tokio-local-disk 🚀	1217971	1862968	0.65
random-access/vortex-tokio-local-disk-footer 🚀	1230919	1835928	0.67

github-actions · 2026-03-13T14:54:30Z

Benchmarks: Compression

Summary

Overall: 0.960x ➖
Vortex: 0.995x ➖
Parquet: 0.970x ➖

unknown / unknown (0.960x ➖, 21↑ 0↓)

name	PR `970af97` (ns)	base `0b981a8` (ns)	ratio (PR/base)
compress time/Arade	1119957832	1225918161	0.91
compress time/Bimbo	6934086146	7533164757	0.92
compress time/CMSprovider	2937577239	3074356385	0.96
compress time/Euro2016	421605506	467944999	0.90
compress time/Food	387984634	423894020	0.92
compress time/HashTags 🚀	897749553	1002892329	0.90
compress time/TPC-H l_comment canonical	1320059472	1409612936	0.94
compress time/TPC-H l_comment chunked	1355942410	1420513993	0.95
compress time/taxi	718258759	766625125	0.94
compress time/wide table cols=100 chunks=1 rows=1000 🚀	16001435	17939335	0.89
compress time/wide table cols=100 chunks=50 rows=1000 🚀	17040997	18936864	0.90
compress time/wide table cols=1000 chunks=1 rows=1000	159396668	175727839	0.91
compress time/wide table cols=1000 chunks=50 rows=1000	160682847	176564674	0.91
compress time/wide table cols=10000 chunks=1 rows=1000	1569462795	1670205970	0.94
compress time/wide table cols=10000 chunks=50 rows=1000	1560848592	1678718049	0.93
decompress time/Arade 🚀	31173512	36557074	0.85
decompress time/Bimbo 🚀	101933012	113399751	0.90
decompress time/CMSprovider 🚀	85635628	95617578	0.90
decompress time/Euro2016	22636203	23646469	0.96
decompress time/Food 🚀	8245891	9348825	0.88
decompress time/HashTags	80144843	87380342	0.92
decompress time/TPC-H l_comment canonical	41507317	43538230	0.95
decompress time/TPC-H l_comment chunked	42192583	45359835	0.93
decompress time/taxi 🚀	18981338	22387120	0.85
decompress time/wide table cols=100 chunks=1 rows=1000	2742599	2945057	0.93
decompress time/wide table cols=100 chunks=50 rows=1000 🚀	2660451	3011284	0.88
decompress time/wide table cols=1000 chunks=1 rows=1000	23202088	25163188	0.92
decompress time/wide table cols=1000 chunks=50 rows=1000	23336454	24665499	0.95
decompress time/wide table cols=10000 chunks=1 rows=1000 🚀	242394923	274665832	0.88
decompress time/wide table cols=10000 chunks=50 rows=1000 🚀	239177951	271228185	0.88
parquet size/Arade	305282152	305282152	1.00
parquet size/Bimbo	388935055	388935055	1.00
parquet size/CMSprovider	384634824	384634824	1.00
parquet size/Euro2016	123042700	123042700	1.00
parquet size/Food	36177631	36177631	1.00
parquet size/HashTags	133854962	133854962	1.00
parquet size/TPC-H l_comment canonical	158411391	158411391	1.00
parquet size/TPC-H l_comment chunked	158411391	158411391	1.00
parquet size/taxi	55879185	55879185	1.00
parquet size/wide table cols=100 chunks=1 rows=1000	932204	932204	1.00
parquet size/wide table cols=100 chunks=50 rows=1000	932204	932204	1.00
parquet size/wide table cols=1000 chunks=1 rows=1000	9322004	9322004	1.00
parquet size/wide table cols=1000 chunks=50 rows=1000	9322004	9322004	1.00
parquet size/wide table cols=10000 chunks=1 rows=1000	93220004	93220004	1.00
parquet size/wide table cols=10000 chunks=50 rows=1000	93220004	93220004	1.00
parquet_rs-zstd compress time/Arade	2483934795	2719370495	0.91
parquet_rs-zstd compress time/Bimbo	15602597964	17111069351	0.91
parquet_rs-zstd compress time/CMSprovider 🚀	7839742447	8761189518	0.89
parquet_rs-zstd compress time/Euro2016	1461332623	1545310166	0.95
parquet_rs-zstd compress time/Food	918072287	985987765	0.93
parquet_rs-zstd compress time/HashTags 🚀	2531026202	2876575745	0.88
parquet_rs-zstd compress time/TPC-H l_comment canonical	3188064151	3384582211	0.94
parquet_rs-zstd compress time/TPC-H l_comment chunked	3212834606	3427174707	0.94
parquet_rs-zstd compress time/taxi	1374502961	1462430954	0.94
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀	6757180	7689754	0.88
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000	6917296	7355708	0.94
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 🚀	83154402	100169700	0.83
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 🚀	83905353	100732365	0.83
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000	900775784	944718973	0.95
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000	888003393	942345412	0.94
parquet_rs-zstd decompress time/Arade	668653629	682972039	0.98
parquet_rs-zstd decompress time/Bimbo	2266151640	2367510059	0.96
parquet_rs-zstd decompress time/CMSprovider	2122505965	2265011661	0.94
parquet_rs-zstd decompress time/Euro2016	420919242	440369853	0.96
parquet_rs-zstd decompress time/Food	240412406	253319159	0.95
parquet_rs-zstd decompress time/HashTags 🚀	670370362	779012778	0.86
parquet_rs-zstd decompress time/TPC-H l_comment canonical	718075343	740317271	0.97
parquet_rs-zstd decompress time/TPC-H l_comment chunked	708611484	741861529	0.96
parquet_rs-zstd decompress time/taxi	286445353	299554711	0.96
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000	2555821	2718621	0.94
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000	2549972	2622130	0.97
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 🚀	28490367	33398022	0.85
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 🚀	28874475	33321332	0.87
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000	339617723	362462388	0.94
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000	333234777	358143291	0.93
vortex-file-compressed size/Arade	143320892	143320892	1.00
vortex-file-compressed size/Bimbo	526057964	526057964	1.00
vortex-file-compressed size/CMSprovider	448338524	448338524	1.00
vortex-file-compressed size/Euro2016	167863828	167863828	1.00
vortex-file-compressed size/Food	44162400	44162400	1.00
vortex-file-compressed size/HashTags	198700644	198700644	1.00
vortex-file-compressed size/TPC-H l_comment canonical	180408824	180408824	1.00
vortex-file-compressed size/TPC-H l_comment chunked	180408824	180408824	1.00
vortex-file-compressed size/taxi	51448740	51448740	1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000	884384	884384	1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000	884384	884384	1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000	8829584	8829584	1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000	8829584	8829584	1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000	88317584	88317584	1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000	88317584	88317584	1.00
vortex:parquet-zstd ratio compress time/Arade	0	0	1.00
vortex:parquet-zstd ratio compress time/Bimbo	0	0	1.01
vortex:parquet-zstd ratio compress time/CMSprovider	0	0	1.07
vortex:parquet-zstd ratio compress time/Euro2016	0	0	0.95
vortex:parquet-zstd ratio compress time/Food	0	0	0.98
vortex:parquet-zstd ratio compress time/HashTags	0	0	1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical	0	0	0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked	0	0	1.02
vortex:parquet-zstd ratio compress time/taxi	0	0	1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000	2	2	1.02
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000	2	2	0.96
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000	1	1	1.09
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000	1	1	1.09
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000	1	1	0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000	1	1	0.99
vortex:parquet-zstd ratio decompress time/Arade 🚀	0	0	0.87
vortex:parquet-zstd ratio decompress time/Bimbo	0	0	0.94
vortex:parquet-zstd ratio decompress time/CMSprovider	0	0	0.96
vortex:parquet-zstd ratio decompress time/Euro2016	0	0	1.00
vortex:parquet-zstd ratio decompress time/Food	0	0	0.93
vortex:parquet-zstd ratio decompress time/HashTags	0	0	1.07
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical	0	0	0.98
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked	0	0	0.97
vortex:parquet-zstd ratio decompress time/taxi 🚀	0	0	0.89
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000	1	1	0.99
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000	1	1	0.91
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000	0	0	1.08
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000	0	0	1.09
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000	0	0	0.94
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000	0	0	0.95
vortex:parquet-zstd size/Arade	0	0	1.00
vortex:parquet-zstd size/Bimbo	1	1	1.00
vortex:parquet-zstd size/CMSprovider	1	1	1.00
vortex:parquet-zstd size/Euro2016	1	1	1.00
vortex:parquet-zstd size/Food	1	1	1.00
vortex:parquet-zstd size/HashTags	1	1	1.00
vortex:parquet-zstd size/TPC-H l_comment canonical	1	1	1.00
vortex:parquet-zstd size/TPC-H l_comment chunked	1	1	1.00
vortex:parquet-zstd size/taxi	0	0	1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000	0	0	1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000	0	0	1.00

Signed-off-by: Robert Kruszewski <github@robertk.io>

robert3005 · 2026-03-17T05:58:29Z

This is a sampling problem, the one slowest run that triggers feature detection to run trips up the benchmark runner and causes it to run too few samples, i.e. 100 instead of 51200 thus measurements are not comparable. I have added call to x86 feature detection to remove that one slow run from the sampled runs and we get 51200 samples

Signed-off-by: Robert Kruszewski <github@robertk.io>

robert3005 added the changelog/performance A performance improvement label Mar 13, 2026

robert3005 force-pushed the rk/truecount branch from 44dacba to 1acfa00 Compare March 13, 2026 02:20

joseph-isaacs reviewed Mar 13, 2026

View reviewed changes

robert3005 force-pushed the rk/truecount branch from ba177b2 to f9e3725 Compare March 13, 2026 11:40

joseph-isaacs reviewed Mar 13, 2026

View reviewed changes

vortex-buffer/benches/vortex_bitbuffer.rs Show resolved Hide resolved

robert3005 added the do not merge Pull requests that are not intended to merge label Mar 13, 2026

joseph-isaacs approved these changes Mar 13, 2026

View reviewed changes

joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026

github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026

robert3005 force-pushed the rk/truecount branch from f9e3725 to 970af97 Compare March 13, 2026 14:11

robert3005 added the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026

github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026

robert3005 added 2 commits March 14, 2026 00:01

Faster true count using AVX intrinsics

df86041

Signed-off-by: Robert Kruszewski <github@robertk.io>

original

9a5d9d8

Signed-off-by: Robert Kruszewski <github@robertk.io>

trythis

d3c062d

robert3005 force-pushed the rk/truecount branch from 970af97 to d3c062d Compare March 14, 2026 02:04

robert3005 added 2 commits March 16, 2026 22:50

simpler

0a712cd

Signed-off-by: Robert Kruszewski <github@robertk.io>

comment

57eaf45

Signed-off-by: Robert Kruszewski <github@robertk.io>

robert3005 removed the do not merge Pull requests that are not intended to merge label Mar 17, 2026

robert3005 enabled auto-merge (squash) March 17, 2026 05:58

robert3005 disabled auto-merge March 17, 2026 06:08

miriignore

8720068

Signed-off-by: Robert Kruszewski <github@robertk.io>

robert3005 enabled auto-merge (squash) March 17, 2026 06:09

robert3005 merged commit 7899299 into develop Mar 17, 2026
51 of 52 checks passed

robert3005 deleted the rk/truecount branch March 17, 2026 06:14

Conversation

robert3005 commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

codspeed-hq bot commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will degrade performance by 50.39%

Performance Changes

Footnotes

Uh oh!

joseph-isaacs left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

robert3005 commented Mar 13, 2026

Uh oh!

Uh oh!

robert3005 commented Mar 13, 2026

Uh oh!

github-actions bot commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions bot commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-DS SF=1 on NVME

Summary

Verdict

Statistical Summary

Uh oh!

github-actions bot commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: PolarSignals Profiling

Summary

Uh oh!

github-actions bot commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=10 on NVME

Summary

Verdict

Statistical Summary

Uh oh!

github-actions bot commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench on NVME

Summary

Verdict

Statistical Summary

Uh oh!

github-actions bot commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on NVME

Summary

Verdict

Statistical Summary

Uh oh!

github-actions bot commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on S3

Summary

Verdict

Statistical Summary

Uh oh!

github-actions bot commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb NVMe

Summary

Verdict

Statistical Summary

Uh oh!

github-actions bot commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb S3

Summary

Verdict

Statistical Summary

Uh oh!

github-actions bot commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

robert3005 commented Mar 13, 2026 •

edited

Loading

codspeed-hq bot commented Mar 13, 2026 •

edited

Loading

joseph-isaacs left a comment •

edited

Loading

github-actions bot commented Mar 13, 2026 •

edited

Loading

github-actions bot commented Mar 13, 2026 •

edited

Loading

github-actions bot commented Mar 13, 2026 •

edited

Loading

github-actions bot commented Mar 13, 2026 •

edited

Loading

github-actions bot commented Mar 13, 2026 •

edited

Loading

github-actions bot commented Mar 13, 2026 •

edited

Loading

github-actions bot commented Mar 13, 2026 •

edited

Loading

github-actions bot commented Mar 13, 2026 •

edited

Loading

github-actions bot commented Mar 13, 2026 •

edited

Loading

github-actions bot commented Mar 13, 2026 •

edited

Loading

github-actions bot commented Mar 13, 2026 •

edited

Loading