Skip to content

[Experiment] Random IO ideas#6985

Draft
AdamGS wants to merge 7 commits intodevelopfrom
adam/codex-try-io
Draft

[Experiment] Random IO ideas#6985
AdamGS wants to merge 7 commits intodevelopfrom
adam/codex-try-io

Conversation

@AdamGS
Copy link
Contributor

@AdamGS AdamGS commented Mar 16, 2026

This is a mostly codex-driven experiment to play around with some general ideas I had and never got around to diving into, at least locally I've reached a point where perf looks interesting enough that I want to actually run benchmarks.

While I wat for benchmarks to run, some initial numbers from f3c23a6, running clickbench against develop (using GNU time):

  • peak RSS is down (16.5 GB vs 21.1GB)
  • Minor page faults down (~2.2 million vs 2.9 million).
  • Voluntary context switches (not sure how to interpret this number): Down to 67 vs 9,422

AdamGS added 4 commits March 16, 2026 15:12
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added do not merge Pull requests that are not intended to merge action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Mar 16, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 16, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done b613478 2 Explore Profiling Data
Previous Runs (5)
Status Commit Job Attempt Link
🟢 Done b613478 1 Explore Profiling Data
🟢 Done 86c286b 2 Explore Profiling Data
🟢 Done 86c286b 1 Explore Profiling Data
🟢 Done f3c23a6 2 Explore Profiling Data
🟢 Done f3c23a6 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.744x ❌


datafusion / vortex-file-compressed (1.744x ❌, 1↑ 6↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚨 744460092 122062895 6.10
polarsignals_q01/datafusion:vortex-file-compressed 🚨 989199155 353510310 2.80
polarsignals_q02/datafusion:vortex-file-compressed 🚨 36618279 23353110 1.57
polarsignals_q03/datafusion:vortex-file-compressed 🚨 979574403 358185509 2.73
polarsignals_q04/datafusion:vortex-file-compressed 11633700 12150732 0.96
polarsignals_q05/datafusion:vortex-file-compressed 17631533 16627750 1.06
polarsignals_q06/datafusion:vortex-file-compressed 21822769 20184012 1.08
polarsignals_q07/datafusion:vortex-file-compressed 🚀 11445675 12991212 0.88
polarsignals_q08/datafusion:vortex-file-compressed 🚨 1001112219 443405359 2.26
polarsignals_q09/datafusion:vortex-file-compressed 🚨 19375432 11901288 1.63

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.8%
Vortex (geomean): 1.115x ❌
Parquet (geomean): 1.059x ➖
Shifts: Parquet (control) +5.9% · Median polish +6.6%


datafusion / vortex-file-compressed (1.086x ➖, 0↑ 10↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 57776304 52324925 1.10
tpch_q02/datafusion:vortex-file-compressed 🚨 64443880 50838873 1.27
tpch_q03/datafusion:vortex-file-compressed 🚨 33300045 28014071 1.19
tpch_q04/datafusion:vortex-file-compressed 🚨 21027318 18986650 1.11
tpch_q05/datafusion:vortex-file-compressed 82963522 75903092 1.09
tpch_q06/datafusion:vortex-file-compressed 10109856 9963011 1.01
tpch_q07/datafusion:vortex-file-compressed 🚨 98456001 88681959 1.11
tpch_q08/datafusion:vortex-file-compressed 67587567 64811816 1.04
tpch_q09/datafusion:vortex-file-compressed 90192726 86532947 1.04
tpch_q10/datafusion:vortex-file-compressed 78600698 76651982 1.03
tpch_q11/datafusion:vortex-file-compressed 🚨 23165434 19123219 1.21
tpch_q12/datafusion:vortex-file-compressed 30613420 33847883 0.90
tpch_q13/datafusion:vortex-file-compressed 28817082 26557099 1.09
tpch_q14/datafusion:vortex-file-compressed 29122870 28179065 1.03
tpch_q15/datafusion:vortex-file-compressed 27653331 25951702 1.07
tpch_q16/datafusion:vortex-file-compressed 🚨 37932421 33380472 1.14
tpch_q17/datafusion:vortex-file-compressed 🚨 81276125 73819057 1.10
tpch_q18/datafusion:vortex-file-compressed 108563330 101889419 1.07
tpch_q19/datafusion:vortex-file-compressed 37967445 36492479 1.04
tpch_q20/datafusion:vortex-file-compressed 🚨 54193634 49222337 1.10
tpch_q21/datafusion:vortex-file-compressed 96423272 94290852 1.02
tpch_q22/datafusion:vortex-file-compressed 🚨 16831861 14275071 1.18
datafusion / vortex-compact (1.106x ❌, 0↑ 7↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 65981445 60697371 1.09
tpch_q02/datafusion:vortex-compact 🚨 63895281 54320776 1.18
tpch_q03/datafusion:vortex-compact 🚨 39150477 31851844 1.23
tpch_q04/datafusion:vortex-compact 🚨 27283386 23442754 1.16
tpch_q05/datafusion:vortex-compact 89146413 83658115 1.07
tpch_q06/datafusion:vortex-compact 14677479 13934401 1.05
tpch_q07/datafusion:vortex-compact 101109085 95171385 1.06
tpch_q08/datafusion:vortex-compact 77045109 73667818 1.05
tpch_q09/datafusion:vortex-compact 99561807 94313115 1.06
tpch_q10/datafusion:vortex-compact 82735006 78256559 1.06
tpch_q11/datafusion:vortex-compact 🚨 22421980 20158180 1.11
tpch_q12/datafusion:vortex-compact 45343603 43588439 1.04
tpch_q13/datafusion:vortex-compact 36194730 36142466 1.00
tpch_q14/datafusion:vortex-compact 33207617 31933484 1.04
tpch_q15/datafusion:vortex-compact 🚨 37305601 33257687 1.12
tpch_q16/datafusion:vortex-compact 42716969 40302199 1.06
tpch_q17/datafusion:vortex-compact 🚨 89348842 79084392 1.13
tpch_q18/datafusion:vortex-compact 118160382 109308280 1.08
tpch_q19/datafusion:vortex-compact 48605027 44694940 1.09
tpch_q20/datafusion:vortex-compact 58645704 53488204 1.10
tpch_q21/datafusion:vortex-compact 113657803 104915189 1.08
tpch_q22/datafusion:vortex-compact 🚨 25476435 15875554 1.60
datafusion / parquet (1.031x ➖, 2↑ 4↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 106287399 139956769 0.76
tpch_q02/datafusion:parquet 83634433 79689268 1.05
tpch_q03/datafusion:parquet 88878406 88836264 1.00
tpch_q04/datafusion:parquet 54886924 52527897 1.04
tpch_q05/datafusion:parquet 162133343 162189989 1.00
tpch_q06/datafusion:parquet 49876530 46867741 1.06
tpch_q07/datafusion:parquet 187091006 182934312 1.02
tpch_q08/datafusion:parquet 164739482 163876987 1.01
tpch_q09/datafusion:parquet 209414199 206714072 1.01
tpch_q10/datafusion:parquet 192436164 190625062 1.01
tpch_q11/datafusion:parquet 65427847 59751629 1.09
tpch_q12/datafusion:parquet 🚨 126458259 108427068 1.17
tpch_q13/datafusion:parquet 210276115 200223100 1.05
tpch_q14/datafusion:parquet 82755789 81990887 1.01
tpch_q15/datafusion:parquet 🚨 77143636 67998396 1.13
tpch_q16/datafusion:parquet 58470754 54115736 1.08
tpch_q17/datafusion:parquet 🚨 194995437 162780514 1.20
tpch_q18/datafusion:parquet 🚨 245747449 222783611 1.10
tpch_q19/datafusion:parquet 🚀 91609502 103127885 0.89
tpch_q20/datafusion:parquet 120537311 120409933 1.00
tpch_q21/datafusion:parquet 184828766 184730916 1.00
tpch_q22/datafusion:parquet 43384845 40492751 1.07
datafusion / arrow (1.066x ➖, 0↑ 4↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 61869296 61145669 1.01
tpch_q02/datafusion:arrow 23554822 22700394 1.04
tpch_q03/datafusion:arrow 38640373 36618357 1.06
tpch_q04/datafusion:arrow 🚨 32473581 29388883 1.10
tpch_q05/datafusion:arrow 93905243 90564299 1.04
tpch_q06/datafusion:arrow 21698581 21891736 0.99
tpch_q07/datafusion:arrow 🚨 197567342 169235533 1.17
tpch_q08/datafusion:arrow 51863628 47279815 1.10
tpch_q09/datafusion:arrow 🚨 84151571 75402259 1.12
tpch_q10/datafusion:arrow 61563199 57030723 1.08
tpch_q11/datafusion:arrow 13077423 12281370 1.06
tpch_q12/datafusion:arrow 60297069 56900789 1.06
tpch_q13/datafusion:arrow 52805961 50290341 1.05
tpch_q14/datafusion:arrow 27619472 25526058 1.08
tpch_q15/datafusion:arrow 52090548 48176213 1.08
tpch_q16/datafusion:arrow 23578983 23448201 1.01
tpch_q17/datafusion:arrow 80197848 76491448 1.05
tpch_q18/datafusion:arrow 167124299 169953348 0.98
tpch_q19/datafusion:arrow 43732764 40085036 1.09
tpch_q20/datafusion:arrow 42638464 39155770 1.09
tpch_q21/datafusion:arrow 🚨 260490859 225553194 1.15
tpch_q22/datafusion:arrow 22897679 21523448 1.06
duckdb / vortex-file-compressed (1.151x ❌, 0↑ 10↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 39318085 32756641 1.20
tpch_q02/duckdb:vortex-file-compressed 29312465 26887046 1.09
tpch_q03/duckdb:vortex-file-compressed 🚨 35268271 29779922 1.18
tpch_q04/duckdb:vortex-file-compressed 🚨 36721181 30685773 1.20
tpch_q05/duckdb:vortex-file-compressed 35358749 34453369 1.03
tpch_q06/duckdb:vortex-file-compressed 11074758 11060964 1.00
tpch_q07/duckdb:vortex-file-compressed 🚨 40632802 36588522 1.11
tpch_q08/duckdb:vortex-file-compressed 43411181 39935946 1.09
tpch_q09/duckdb:vortex-file-compressed 86463816 81689011 1.06
tpch_q10/duckdb:vortex-file-compressed 🚨 45701843 36184140 1.26
tpch_q11/duckdb:vortex-file-compressed 17034743 16040312 1.06
tpch_q12/duckdb:vortex-file-compressed 24992981 22891265 1.09
tpch_q13/duckdb:vortex-file-compressed 🚨 58284474 37548464 1.55
tpch_q14/duckdb:vortex-file-compressed 24464265 22556161 1.08
tpch_q15/duckdb:vortex-file-compressed 🚨 21042326 15718896 1.34
tpch_q16/duckdb:vortex-file-compressed 32783933 30173838 1.09
tpch_q17/duckdb:vortex-file-compressed 26032265 24124278 1.08
tpch_q18/duckdb:vortex-file-compressed 49599926 46204257 1.07
tpch_q19/duckdb:vortex-file-compressed 🚨 35888714 31825685 1.13
tpch_q20/duckdb:vortex-file-compressed 36303016 33496464 1.08
tpch_q21/duckdb:vortex-file-compressed 🚨 117233666 101944637 1.15
tpch_q22/duckdb:vortex-file-compressed 🚨 28885012 18715044 1.54
duckdb / vortex-compact (1.118x ❌, 0↑ 8↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 44304994 40065987 1.11
tpch_q02/duckdb:vortex-compact 40610483 37105399 1.09
tpch_q03/duckdb:vortex-compact 🚨 35631354 32068307 1.11
tpch_q04/duckdb:vortex-compact 🚨 45702040 34533556 1.32
tpch_q05/duckdb:vortex-compact 40166827 37969060 1.06
tpch_q06/duckdb:vortex-compact 🚨 17267723 14590689 1.18
tpch_q07/duckdb:vortex-compact 46667290 43042625 1.08
tpch_q08/duckdb:vortex-compact 46919313 45855757 1.02
tpch_q09/duckdb:vortex-compact 91429770 91296307 1.00
tpch_q10/duckdb:vortex-compact 🚨 49715516 41460710 1.20
tpch_q11/duckdb:vortex-compact 20937431 20380984 1.03
tpch_q12/duckdb:vortex-compact 38996012 37527095 1.04
tpch_q13/duckdb:vortex-compact 🚨 72912765 46602160 1.56
tpch_q14/duckdb:vortex-compact 32547254 30765403 1.06
tpch_q15/duckdb:vortex-compact 🚨 21978712 19396832 1.13
tpch_q16/duckdb:vortex-compact 40570910 36907075 1.10
tpch_q17/duckdb:vortex-compact 31716897 30310932 1.05
tpch_q18/duckdb:vortex-compact 50249740 49921277 1.01
tpch_q19/duckdb:vortex-compact 39192564 39103408 1.00
tpch_q20/duckdb:vortex-compact 45392450 45716691 0.99
tpch_q21/duckdb:vortex-compact 118313008 110370402 1.07
tpch_q22/duckdb:vortex-compact 🚨 33322281 21086487 1.58
duckdb / parquet (1.089x ➖, 2↑ 8↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 78067647 79378526 0.98
tpch_q02/duckdb:parquet 41320462 39295418 1.05
tpch_q03/duckdb:parquet 🚨 87398000 69291944 1.26
tpch_q04/duckdb:parquet 🚀 50920332 56816303 0.90
tpch_q05/duckdb:parquet 🚨 86265015 68571966 1.26
tpch_q06/duckdb:parquet 21336498 20766935 1.03
tpch_q07/duckdb:parquet 🚀 71985228 80706726 0.89
tpch_q08/duckdb:parquet 🚨 102817369 81751120 1.26
tpch_q09/duckdb:parquet 143078810 154589661 0.93
tpch_q10/duckdb:parquet 137032208 134150762 1.02
tpch_q11/duckdb:parquet 23262599 22104758 1.05
tpch_q12/duckdb:parquet 46947946 46187149 1.02
tpch_q13/duckdb:parquet 282886173 264823348 1.07
tpch_q14/duckdb:parquet 🚨 61463730 49287395 1.25
tpch_q15/duckdb:parquet 🚨 33622452 24361576 1.38
tpch_q16/duckdb:parquet 57506409 55100614 1.04
tpch_q17/duckdb:parquet 🚨 56343099 48262120 1.17
tpch_q18/duckdb:parquet 🚨 135719458 120505198 1.13
tpch_q19/duckdb:parquet 74161376 70297481 1.05
tpch_q20/duckdb:parquet 🚨 83369120 62459363 1.33
tpch_q21/duckdb:parquet 175764026 166903518 1.05
tpch_q22/duckdb:parquet 53132641 52491643 1.01
duckdb / duckdb (1.014x ➖, 0↑ 2↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16301770 16230803 1.00
tpch_q02/duckdb:duckdb 11725369 12055243 0.97
tpch_q03/duckdb:duckdb 19443697 19713020 0.99
tpch_q04/duckdb:duckdb 18023567 19174082 0.94
tpch_q05/duckdb:duckdb 19817413 19915085 1.00
tpch_q06/duckdb:duckdb 5381271 5363965 1.00
tpch_q07/duckdb:duckdb 23572209 22684062 1.04
tpch_q08/duckdb:duckdb 21618257 20354045 1.06
tpch_q09/duckdb:duckdb 56878688 56201624 1.01
tpch_q10/duckdb:duckdb 🚨 45852202 40978409 1.12
tpch_q11/duckdb:duckdb 🚨 6951296 5761367 1.21
tpch_q12/duckdb:duckdb 14083512 14689520 0.96
tpch_q13/duckdb:duckdb 37816301 35751685 1.06
tpch_q14/duckdb:duckdb 16397036 16711501 0.98
tpch_q15/duckdb:duckdb 12260199 11473828 1.07
tpch_q16/duckdb:duckdb 22946304 22488081 1.02
tpch_q17/duckdb:duckdb 13421455 13505374 0.99
tpch_q18/duckdb:duckdb 37278645 37635515 0.99
tpch_q19/duckdb:duckdb 27147052 26307390 1.03
tpch_q20/duckdb:duckdb 22099217 23281827 0.95
tpch_q21/duckdb:duckdb 56887362 57700461 0.99
tpch_q22/duckdb:duckdb 23877429 24512767 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +1.2% -13.6% +17.1% +27.3% ➖ noise
1 datafusion:vortex-compact +8.7% -13.6% +25.8% +23.8% 🚨 regression
1 datafusion:vortex-file-compressed +10.4% -13.6% +27.8% +27.8% ➖ noise
1 duckdb:duckdb +0.4% -13.6% +16.2% +23.8% ➖ noise
1 duckdb:vortex-compact +10.6% -13.6% +28.0% +23.8% 🚨 regression
1 duckdb:vortex-file-compressed +20.0% -13.6% +38.9% +23.8% 🚨 regression
2 datafusion:arrow +3.8% +5.1% -1.2% +23.8% ➖ noise
2 datafusion:vortex-compact +17.6% +5.1% +12.0% +23.8% ➖ noise
2 datafusion:vortex-file-compressed +26.8% +5.1% +20.7% +23.8% ➖ noise
2 duckdb:duckdb -2.7% +5.1% -7.4% +23.8% ➖ noise
2 duckdb:vortex-compact +9.4% +5.1% +4.2% +23.8% ➖ noise
2 duckdb:vortex-file-compressed +9.0% +5.1% +3.8% +23.8% ➖ noise
3 datafusion:arrow +5.5% +12.3% -6.1% +23.8% ➖ noise
3 datafusion:vortex-compact +22.9% +12.3% +9.4% +23.8% ➖ noise
3 datafusion:vortex-file-compressed +18.9% +12.3% +5.8% +23.8% ➖ noise
3 duckdb:duckdb -1.4% +12.3% -12.2% +23.8% ➖ noise
3 duckdb:vortex-compact +11.1% +12.3% -1.1% +23.8% ➖ noise
3 duckdb:vortex-file-compressed +18.4% +12.3% +5.4% +23.8% ➖ noise
4 datafusion:arrow +10.5% -3.2% +14.2% +23.8% ➖ noise
4 datafusion:vortex-compact +16.4% -3.2% +20.3% +23.8% ➖ noise
4 datafusion:vortex-file-compressed +10.7% -3.2% +14.4% +23.8% ➖ noise
4 duckdb:duckdb -6.0% -3.2% -2.9% +23.8% ➖ noise
4 duckdb:vortex-compact +32.3% -3.2% +36.8% +23.8% 🚨 regression
4 duckdb:vortex-file-compressed +19.7% -3.2% +23.7% +23.8% ➖ noise
5 datafusion:arrow +3.7% +12.1% -7.5% +23.8% ➖ noise
5 datafusion:vortex-compact +6.6% +12.1% -5.0% +23.8% ➖ noise
5 datafusion:vortex-file-compressed +9.3% +12.1% -2.5% +23.8% ➖ noise
5 duckdb:duckdb -0.5% +12.1% -11.3% +23.8% ➖ noise
5 duckdb:vortex-compact +5.8% +12.1% -5.7% +23.8% ➖ noise
5 duckdb:vortex-file-compressed +2.6% +12.1% -8.5% +23.8% ➖ noise
6 datafusion:arrow -0.9% +4.6% -5.2% +25.4% ➖ noise
6 datafusion:vortex-compact +5.3% +4.6% +0.7% +27.4% ➖ noise
6 datafusion:vortex-file-compressed +1.5% +4.6% -3.0% +25.4% ➖ noise
6 duckdb:duckdb +0.3% +4.6% -4.1% +27.1% ➖ noise
6 duckdb:vortex-compact +18.3% +4.6% +13.2% +24.3% ➖ noise
6 duckdb:vortex-file-compressed +0.1% +4.6% -4.2% +24.3% ➖ noise
7 datafusion:arrow +16.7% -4.5% +22.2% +23.8% ➖ noise
7 datafusion:vortex-compact +6.2% -4.5% +11.2% +23.8% ➖ noise
7 datafusion:vortex-file-compressed +11.0% -4.5% +16.2% +23.8% ➖ noise
7 duckdb:duckdb +3.9% -4.5% +8.8% +23.8% ➖ noise
7 duckdb:vortex-compact +8.4% -4.5% +13.5% +23.8% ➖ noise
7 duckdb:vortex-file-compressed +11.1% -4.5% +16.3% +23.8% ➖ noise
8 datafusion:arrow +9.7% +12.4% -2.4% +37.0% ➖ noise
8 datafusion:vortex-compact +4.6% +12.4% -7.0% +23.8% ➖ noise
8 datafusion:vortex-file-compressed +4.3% +12.4% -7.3% +23.8% ➖ noise
8 duckdb:duckdb +6.2% +12.4% -5.5% +23.8% ➖ noise
8 duckdb:vortex-compact +2.3% +12.4% -9.0% +23.8% ➖ noise
8 duckdb:vortex-file-compressed +8.7% +12.4% -3.3% +23.8% ➖ noise
9 datafusion:arrow +11.6% -3.2% +15.3% +23.8% ➖ noise
9 datafusion:vortex-compact +5.6% -3.2% +9.0% +23.8% ➖ noise
9 datafusion:vortex-file-compressed +4.2% -3.2% +7.6% +23.8% ➖ noise
9 duckdb:duckdb +1.2% -3.2% +4.5% +23.8% ➖ noise
9 duckdb:vortex-compact +0.1% -3.2% +3.4% +23.8% ➖ noise
9 duckdb:vortex-file-compressed +5.8% -3.2% +9.3% +23.8% ➖ noise
10 datafusion:arrow +7.9% +1.5% +6.3% +23.8% ➖ noise
10 datafusion:vortex-compact +5.7% +1.5% +4.1% +23.8% ➖ noise
10 datafusion:vortex-file-compressed +2.5% +1.5% +1.0% +23.8% ➖ noise
10 duckdb:duckdb +11.9% +1.5% +10.2% +23.8% ➖ noise
10 duckdb:vortex-compact +19.9% +1.5% +18.1% +23.8% ➖ noise
10 duckdb:vortex-file-compressed +26.3% +1.5% +24.4% +23.8% 🚨 regression
11 datafusion:arrow +6.5% +7.3% -0.8% +23.8% ➖ noise
11 datafusion:vortex-compact +11.2% +7.3% +3.6% +23.8% ➖ noise
11 datafusion:vortex-file-compressed +21.1% +7.3% +12.8% +23.8% ➖ noise
11 duckdb:duckdb +20.7% +7.3% +12.4% +23.8% ➖ noise
11 duckdb:vortex-compact +2.7% +7.3% -4.3% +23.8% ➖ noise
11 duckdb:vortex-file-compressed +6.2% +7.3% -1.1% +23.8% ➖ noise
12 datafusion:arrow +6.0% +8.9% -2.7% +23.8% ➖ noise
12 datafusion:vortex-compact +4.0% +8.9% -4.5% +23.8% ➖ noise
12 datafusion:vortex-file-compressed -9.6% +8.9% -16.9% +23.8% ➖ noise
12 duckdb:duckdb -4.1% +8.9% -11.9% +23.8% ➖ noise
12 duckdb:vortex-compact +3.9% +8.9% -4.6% +23.8% ➖ noise
12 duckdb:vortex-file-compressed +9.2% +8.9% +0.3% +23.8% ➖ noise
13 datafusion:arrow +5.0% +5.9% -0.9% +23.8% ➖ noise
13 datafusion:vortex-compact +0.1% +5.9% -5.4% +23.8% ➖ noise
13 datafusion:vortex-file-compressed +8.5% +5.9% +2.4% +23.8% ➖ noise
13 duckdb:duckdb +5.8% +5.9% -0.1% +23.8% ➖ noise
13 duckdb:vortex-compact +56.5% +5.9% +47.7% +23.8% 🚨 regression
13 duckdb:vortex-file-compressed +55.2% +5.9% +46.6% +23.8% 🚨 regression
14 datafusion:arrow +8.2% +12.2% -3.6% +23.8% ➖ noise
14 datafusion:vortex-compact +4.0% +12.2% -7.3% +23.8% ➖ noise
14 datafusion:vortex-file-compressed +3.3% +12.2% -7.9% +23.8% ➖ noise
14 duckdb:duckdb -1.9% +12.2% -12.5% +23.8% ➖ noise
14 duckdb:vortex-compact +5.8% +12.2% -5.7% +23.8% ➖ noise
14 duckdb:vortex-file-compressed +8.5% +12.2% -3.3% +23.8% ➖ noise
15 datafusion:arrow +8.1% +25.1% -13.6% +23.8% ➖ noise
15 datafusion:vortex-compact +12.2% +25.1% -10.4% +23.8% ➖ noise
15 datafusion:vortex-file-compressed +6.6% +25.1% -14.8% +23.8% ➖ noise
15 duckdb:duckdb +6.9% +25.1% -14.6% +23.8% ➖ noise
15 duckdb:vortex-compact +13.3% +25.1% -9.4% +23.8% ➖ noise
15 duckdb:vortex-file-compressed +33.9% +25.1% +7.0% +23.8% ➖ noise
16 datafusion:arrow +0.6% +6.2% -5.3% +23.8% ➖ noise
16 datafusion:vortex-compact +6.0% +6.2% -0.2% +23.8% ➖ noise
16 datafusion:vortex-file-compressed +13.6% +6.2% +7.0% +23.8% ➖ noise
16 duckdb:duckdb +2.0% +6.2% -3.9% +23.8% ➖ noise
16 duckdb:vortex-compact +9.9% +6.2% +3.5% +23.8% ➖ noise
16 duckdb:vortex-file-compressed +8.7% +6.2% +2.3% +23.8% ➖ noise
17 datafusion:arrow +4.8% +18.3% -11.3% +23.8% ➖ noise
17 datafusion:vortex-compact +13.0% +18.3% -4.5% +23.8% ➖ noise
17 datafusion:vortex-file-compressed +10.1% +18.3% -6.9% +23.8% ➖ noise
17 duckdb:duckdb -0.6% +18.3% -16.0% +23.8% ➖ noise
17 duckdb:vortex-compact +4.6% +18.3% -11.5% +23.8% ➖ noise
17 duckdb:vortex-file-compressed +7.9% +18.3% -8.8% +23.8% ➖ noise
18 datafusion:arrow -1.7% +11.5% -11.8% +23.8% ➖ noise
18 datafusion:vortex-compact +8.1% +11.5% -3.0% +23.8% ➖ noise
18 datafusion:vortex-file-compressed +6.6% +11.5% -4.4% +23.8% ➖ noise
18 duckdb:duckdb -0.9% +11.5% -11.1% +23.8% ➖ noise
18 duckdb:vortex-compact +0.7% +11.5% -9.7% +23.8% ➖ noise
18 duckdb:vortex-file-compressed +7.3% +11.5% -3.7% +23.8% ➖ noise
19 datafusion:arrow +9.1% -3.2% +12.7% +23.8% ➖ noise
19 datafusion:vortex-compact +8.7% -3.2% +12.3% +23.8% ➖ noise
19 datafusion:vortex-file-compressed +4.0% -3.2% +7.5% +23.8% ➖ noise
19 duckdb:duckdb +3.2% -3.2% +6.6% +23.8% ➖ noise
19 duckdb:vortex-compact +0.2% -3.2% +3.5% +23.8% ➖ noise
19 duckdb:vortex-file-compressed +12.8% -3.2% +16.5% +23.8% ➖ noise
20 datafusion:arrow +8.9% +15.6% -5.8% +23.8% ➖ noise
20 datafusion:vortex-compact +9.6% +15.6% -5.1% +23.8% ➖ noise
20 datafusion:vortex-file-compressed +10.1% +15.6% -4.8% +23.8% ➖ noise
20 duckdb:duckdb -5.1% +15.6% -17.9% +23.8% ➖ noise
20 duckdb:vortex-compact -0.7% +15.6% -14.1% +23.8% ➖ noise
20 duckdb:vortex-file-compressed +8.4% +15.6% -6.2% +23.8% ➖ noise
21 datafusion:arrow +15.5% +2.6% +12.5% +23.8% ➖ noise
21 datafusion:vortex-compact +8.3% +2.6% +5.5% +23.8% ➖ noise
21 datafusion:vortex-file-compressed +2.3% +2.6% -0.4% +23.8% ➖ noise
21 duckdb:duckdb -1.4% +2.6% -4.0% +23.8% ➖ noise
21 duckdb:vortex-compact +7.2% +2.6% +4.4% +23.8% ➖ noise
21 duckdb:vortex-file-compressed +15.0% +2.6% +12.0% +23.8% ➖ noise
22 datafusion:arrow +6.4% +4.1% +2.2% +23.8% ➖ noise
22 datafusion:vortex-compact +60.5% +4.1% +54.1% +23.8% 🚨 regression
22 datafusion:vortex-file-compressed +17.9% +4.1% +13.2% +23.8% ➖ noise
22 duckdb:duckdb -2.6% +4.1% -6.5% +23.8% ➖ noise
22 duckdb:vortex-compact +58.0% +4.1% +51.7% +23.8% 🚨 regression
22 duckdb:vortex-file-compressed +54.3% +4.1% +48.2% +23.8% 🚨 regression

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (medium confidence)
Attributed Vortex impact: -11.3%
Vortex (geomean): 0.824x ✅
Parquet (geomean): 0.929x ➖
Shifts: Parquet (control) -7.1% · Median polish -16.2%


datafusion / vortex-file-compressed (0.730x ✅, 7↑ 1↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4282435 4795213 0.89
fineweb_q01/datafusion:vortex-file-compressed 31030646 28837880 1.08
fineweb_q02/datafusion:vortex-file-compressed 🚨 33735941 29116869 1.16
fineweb_q03/datafusion:vortex-file-compressed 🚀 71611210 99993109 0.72
fineweb_q04/datafusion:vortex-file-compressed 🚀 213082151 239864968 0.89
fineweb_q05/datafusion:vortex-file-compressed 🚀 173503111 224136622 0.77
fineweb_q06/datafusion:vortex-file-compressed 🚀 59241650 76721685 0.77
fineweb_q07/datafusion:vortex-file-compressed 🚀 60210035 91664221 0.66
fineweb_q08/datafusion:vortex-file-compressed 🚀 6039222 28596872 0.21
datafusion / vortex-compact (0.639x ✅, 7↑ 2↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 4205223 5545871 0.76
fineweb_q01/datafusion:vortex-compact 🚨 235114682 169125473 1.39
fineweb_q02/datafusion:vortex-compact 🚨 247347067 174023135 1.42
fineweb_q03/datafusion:vortex-compact 🚀 783292113 1545161173 0.51
fineweb_q04/datafusion:vortex-compact 🚀 839939128 1700932096 0.49
fineweb_q05/datafusion:vortex-compact 🚀 732164974 1337585455 0.55
fineweb_q06/datafusion:vortex-compact 🚀 434271694 748549747 0.58
fineweb_q07/datafusion:vortex-compact 🚀 472962188 786012748 0.60
fineweb_q08/datafusion:vortex-compact 🚀 6044408 24257527 0.25
datafusion / parquet (0.911x ➖, 2↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 5819693 6399697 0.91
fineweb_q01/datafusion:parquet 266961151 292398990 0.91
fineweb_q02/datafusion:parquet 269927879 294175325 0.92
fineweb_q03/datafusion:parquet 273193291 297159123 0.92
fineweb_q04/datafusion:parquet 290673437 311928948 0.93
fineweb_q05/datafusion:parquet 🚀 281651060 315734348 0.89
fineweb_q06/datafusion:parquet 🚀 277305892 312905416 0.89
fineweb_q07/datafusion:parquet 272156399 297801122 0.91
fineweb_q08/datafusion:parquet 266387458 289560582 0.92
duckdb / vortex-file-compressed (1.032x ➖, 3↑ 4↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3509080 3830729 0.92
fineweb_q01/duckdb:vortex-file-compressed 🚨 105949281 25794895 4.11
fineweb_q02/duckdb:vortex-file-compressed 🚨 38325701 28392590 1.35
fineweb_q03/duckdb:vortex-file-compressed 🚨 161393321 134619345 1.20
fineweb_q04/duckdb:vortex-file-compressed 242891389 222548160 1.09
fineweb_q05/duckdb:vortex-file-compressed 🚨 232158844 200602958 1.16
fineweb_q06/duckdb:vortex-file-compressed 🚀 56641743 75041542 0.75
fineweb_q07/duckdb:vortex-file-compressed 🚀 65388952 74471692 0.88
fineweb_q08/duckdb:vortex-file-compressed 🚀 7059318 27097132 0.26
duckdb / vortex-compact (0.958x ➖, 7↑ 2↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 3898104 4494799 0.87
fineweb_q01/duckdb:vortex-compact 🚨 929988799 111326567 8.35
fineweb_q02/duckdb:vortex-compact 🚨 176769069 116639843 1.52
fineweb_q03/duckdb:vortex-compact 🚀 673014018 915074292 0.74
fineweb_q04/duckdb:vortex-compact 🚀 687361396 972219726 0.71
fineweb_q05/duckdb:vortex-compact 🚀 671101861 875188103 0.77
fineweb_q06/duckdb:vortex-compact 🚀 384368832 493017968 0.78
fineweb_q07/duckdb:vortex-compact 🚀 378381342 510951038 0.74
fineweb_q08/duckdb:vortex-compact 🚀 6839319 25417880 0.27
duckdb / parquet (0.947x ➖, 0↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36240932 37635193 0.96
fineweb_q01/duckdb:parquet 92495858 97818191 0.95
fineweb_q02/duckdb:parquet 95949944 99858850 0.96
fineweb_q03/duckdb:parquet 305799650 325863063 0.94
fineweb_q04/duckdb:parquet 437593382 456326090 0.96
fineweb_q05/duckdb:parquet 409293089 426764249 0.96
fineweb_q06/duckdb:parquet 197305452 211686488 0.93
fineweb_q07/duckdb:parquet 209386856 223361583 0.94
fineweb_q08/duckdb:parquet 57290438 61888570 0.93
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -24.2% -6.4% -19.0% +51.7% ➖ noise
0 datafusion:vortex-file-compressed -10.7% -6.4% -4.6% +87.3% ➖ noise
0 duckdb:vortex-compact -13.3% -6.4% -7.3% +42.7% ➖ noise
0 duckdb:vortex-file-compressed -8.4% -6.4% -2.1% +55.4% ➖ noise
1 datafusion:vortex-compact +39.0% -7.1% +49.6% +31.2% 🚨 regression
1 datafusion:vortex-file-compressed +7.6% -7.1% +15.8% +22.9% ➖ noise
1 duckdb:vortex-compact +735.4% -7.1% +799.1% +12.7% 🚨 regression
1 duckdb:vortex-file-compressed +310.7% -7.1% +342.1% +45.3% 🚨 regression
2 datafusion:vortex-compact +42.1% -6.1% +51.4% +25.9% 🚨 regression
2 datafusion:vortex-file-compressed +15.9% -6.1% +23.4% +23.2% 🚨 regression
2 duckdb:vortex-compact +51.6% -6.1% +61.4% +13.1% 🚨 regression
2 duckdb:vortex-file-compressed +35.0% -6.1% +43.8% +10.0% 🚨 regression
3 datafusion:vortex-compact -49.3% -7.1% -45.4% +10.0% ✅ faster
3 datafusion:vortex-file-compressed -28.4% -7.1% -22.9% +51.4% ➖ noise
3 duckdb:vortex-compact -26.5% -7.1% -20.8% +10.0% ✅ faster
3 duckdb:vortex-file-compressed +19.9% -7.1% +29.1% +21.4% 🚨 regression
4 datafusion:vortex-compact -50.6% -5.5% -47.8% +10.0% ✅ faster
4 datafusion:vortex-file-compressed -11.2% -5.5% -6.0% +10.0% ➖ noise
4 duckdb:vortex-compact -29.3% -5.5% -25.2% +10.0% ✅ faster
4 duckdb:vortex-file-compressed +9.1% -5.5% +15.5% +10.0% 🚨 regression
5 datafusion:vortex-compact -45.3% -7.5% -40.8% +10.0% ✅ faster
5 datafusion:vortex-file-compressed -22.6% -7.5% -16.3% +10.0% ✅ faster
5 duckdb:vortex-compact -23.3% -7.5% -17.1% +10.0% ✅ faster
5 duckdb:vortex-file-compressed +15.7% -7.5% +25.1% +10.0% 🚨 regression
6 datafusion:vortex-compact -42.0% -9.1% -36.2% +10.0% ✅ faster
6 datafusion:vortex-file-compressed -22.8% -9.1% -15.0% +14.4% ✅ faster
6 duckdb:vortex-compact -22.0% -9.1% -14.2% +10.0% ✅ faster
6 duckdb:vortex-file-compressed -24.5% -9.1% -17.0% +10.0% ✅ faster
7 datafusion:vortex-compact -39.8% -7.4% -35.0% +10.0% ✅ faster
7 datafusion:vortex-file-compressed -34.3% -7.4% -29.0% +24.1% ✅ faster
7 duckdb:vortex-compact -25.9% -7.4% -20.0% +10.0% ✅ faster
7 duckdb:vortex-file-compressed -12.2% -7.4% -5.1% +10.0% ➖ noise
8 datafusion:vortex-compact -75.1% -7.7% -73.0% +37.8% ✅ faster
8 datafusion:vortex-file-compressed -78.9% -7.7% -77.1% +32.5% ✅ faster
8 duckdb:vortex-compact -73.1% -7.7% -70.8% +14.2% ✅ faster
8 duckdb:vortex-file-compressed -73.9% -7.7% -71.8% +14.0% ✅ faster

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Vortex (geomean): 0.953x ➖
Parquet (geomean): 0.952x ➖
Shifts: Parquet (control) -4.8% · Median polish -5.2%


datafusion / vortex-file-compressed (0.932x ➖, 17↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 28420120 29561722 0.96
tpcds_q02/datafusion:vortex-file-compressed 73500740 79951063 0.92
tpcds_q03/datafusion:vortex-file-compressed 🚀 26715287 30209360 0.88
tpcds_q04/datafusion:vortex-file-compressed 380359947 411009964 0.93
tpcds_q05/datafusion:vortex-file-compressed 🚀 67149062 76312739 0.88
tpcds_q06/datafusion:vortex-file-compressed 76780083 79306580 0.97
tpcds_q07/datafusion:vortex-file-compressed 73527158 78009489 0.94
tpcds_q08/datafusion:vortex-file-compressed 38854187 40364577 0.96
tpcds_q09/datafusion:vortex-file-compressed 44119697 46891217 0.94
tpcds_q10/datafusion:vortex-file-compressed 49540072 50599835 0.98
tpcds_q11/datafusion:vortex-file-compressed 231456568 238072518 0.97
tpcds_q12/datafusion:vortex-file-compressed 34596656 36929450 0.94
tpcds_q13/datafusion:vortex-file-compressed 83955513 83196288 1.01
tpcds_q14/datafusion:vortex-file-compressed 🚀 203813617 230388710 0.88
tpcds_q15/datafusion:vortex-file-compressed 49416110 52098670 0.95
tpcds_q16/datafusion:vortex-file-compressed 29548635 29555394 1.00
tpcds_q17/datafusion:vortex-file-compressed 110587727 114967254 0.96
tpcds_q18/datafusion:vortex-file-compressed 98623716 106589139 0.93
tpcds_q19/datafusion:vortex-file-compressed 🚀 44821875 51880616 0.86
tpcds_q20/datafusion:vortex-file-compressed 39978009 42091015 0.95
tpcds_q21/datafusion:vortex-file-compressed 🚀 166729713 185400299 0.90
tpcds_q22/datafusion:vortex-file-compressed 68427198 71746913 0.95
tpcds_q23/datafusion:vortex-file-compressed 🚀 180902242 201054325 0.90
tpcds_q24/datafusion:vortex-file-compressed 173991638 187785479 0.93
tpcds_q25/datafusion:vortex-file-compressed 112042602 117817406 0.95
tpcds_q26/datafusion:vortex-file-compressed 🚀 58095540 65364965 0.89
tpcds_q27/datafusion:vortex-file-compressed 164577882 179386607 0.92
tpcds_q28/datafusion:vortex-file-compressed 🚀 44039778 51400658 0.86
tpcds_q29/datafusion:vortex-file-compressed 108233089 112745774 0.96
tpcds_q30/datafusion:vortex-file-compressed 29112063 32084213 0.91
tpcds_q31/datafusion:vortex-file-compressed 174599309 186384845 0.94
tpcds_q32/datafusion:vortex-file-compressed 🚀 23433260 26841627 0.87
tpcds_q33/datafusion:vortex-file-compressed 36989268 38823622 0.95
tpcds_q34/datafusion:vortex-file-compressed 36384477 38494271 0.95
tpcds_q35/datafusion:vortex-file-compressed 58995902 62235673 0.95
tpcds_q36/datafusion:vortex-file-compressed 100946971 106739695 0.95
tpcds_q37/datafusion:vortex-file-compressed 37739379 37833448 1.00
tpcds_q38/datafusion:vortex-file-compressed 85289172 86796679 0.98
tpcds_q39/datafusion:vortex-file-compressed 🚀 185605800 214052473 0.87
tpcds_q40/datafusion:vortex-file-compressed 55616357 55581402 1.00
tpcds_q41/datafusion:vortex-file-compressed 🚀 13810559 16014003 0.86
tpcds_q42/datafusion:vortex-file-compressed 30871052 30977529 1.00
tpcds_q43/datafusion:vortex-file-compressed 48733084 49431760 0.99
tpcds_q44/datafusion:vortex-file-compressed 41860852 43862111 0.95
tpcds_q45/datafusion:vortex-file-compressed 48499043 51370857 0.94
tpcds_q46/datafusion:vortex-file-compressed 62563898 67403823 0.93
tpcds_q47/datafusion:vortex-file-compressed 271644703 288736704 0.94
tpcds_q48/datafusion:vortex-file-compressed 70058992 72738735 0.96
tpcds_q49/datafusion:vortex-file-compressed 68618609 74270231 0.92
tpcds_q50/datafusion:vortex-file-compressed 72350043 78228769 0.92
tpcds_q51/datafusion:vortex-file-compressed 100150044 98004992 1.02
tpcds_q52/datafusion:vortex-file-compressed 29972846 31617243 0.95
tpcds_q53/datafusion:vortex-file-compressed 29504549 31007637 0.95
tpcds_q54/datafusion:vortex-file-compressed 48024015 50724238 0.95
tpcds_q55/datafusion:vortex-file-compressed 29044576 31507724 0.92
tpcds_q56/datafusion:vortex-file-compressed 44152601 48861636 0.90
tpcds_q57/datafusion:vortex-file-compressed 180281220 189914535 0.95
tpcds_q58/datafusion:vortex-file-compressed 111015028 116071383 0.96
tpcds_q59/datafusion:vortex-file-compressed 91013473 99612469 0.91
tpcds_q60/datafusion:vortex-file-compressed 46108582 48700232 0.95
tpcds_q61/datafusion:vortex-file-compressed 56283847 60124491 0.94
tpcds_q62/datafusion:vortex-file-compressed 42843560 47262036 0.91
tpcds_q63/datafusion:vortex-file-compressed 29624601 31219032 0.95
tpcds_q64/datafusion:vortex-file-compressed 691173620 754830350 0.92
tpcds_q65/datafusion:vortex-file-compressed 50980840 55547872 0.92
tpcds_q66/datafusion:vortex-file-compressed 🚀 101582851 123805064 0.82
tpcds_q67/datafusion:vortex-file-compressed 139531600 153786053 0.91
tpcds_q68/datafusion:vortex-file-compressed 🚀 62912337 71750581 0.88
tpcds_q69/datafusion:vortex-file-compressed 45124535 49439477 0.91
tpcds_q70/datafusion:vortex-file-compressed 🚀 127447832 142603191 0.89
tpcds_q71/datafusion:vortex-file-compressed 30637896 33179036 0.92
tpcds_q72/datafusion:vortex-file-compressed 3308660514 3670338410 0.90
tpcds_q73/datafusion:vortex-file-compressed 39163564 39972708 0.98
tpcds_q74/datafusion:vortex-file-compressed 163372429 171412325 0.95
tpcds_q75/datafusion:vortex-file-compressed 129231833 136000125 0.95
tpcds_q76/datafusion:vortex-file-compressed 60751373 67024558 0.91
tpcds_q77/datafusion:vortex-file-compressed 🚀 51900770 59902849 0.87
tpcds_q78/datafusion:vortex-file-compressed 179138239 198855700 0.90
tpcds_q79/datafusion:vortex-file-compressed 41771347 45425338 0.92
tpcds_q80/datafusion:vortex-file-compressed 116485375 126298580 0.92
tpcds_q81/datafusion:vortex-file-compressed 35942417 38184248 0.94
tpcds_q82/datafusion:vortex-file-compressed 39224826 42716556 0.92
tpcds_q83/datafusion:vortex-file-compressed 65060266 71606127 0.91
tpcds_q84/datafusion:vortex-file-compressed 16664765 17335463 0.96
tpcds_q85/datafusion:vortex-file-compressed 134401751 142595060 0.94
tpcds_q86/datafusion:vortex-file-compressed 29315187 31940212 0.92
tpcds_q87/datafusion:vortex-file-compressed 90278287 92663806 0.97
tpcds_q88/datafusion:vortex-file-compressed 🚀 74806308 83503391 0.90
tpcds_q89/datafusion:vortex-file-compressed 58098836 60268251 0.96
tpcds_q90/datafusion:vortex-file-compressed 16055983 17641637 0.91
tpcds_q91/datafusion:vortex-file-compressed 28657840 29226356 0.98
tpcds_q92/datafusion:vortex-file-compressed 19206368 21264081 0.90
tpcds_q93/datafusion:vortex-file-compressed 36569700 40571380 0.90
tpcds_q94/datafusion:vortex-file-compressed 26174315 28814133 0.91
tpcds_q95/datafusion:vortex-file-compressed 87862328 92292364 0.95
tpcds_q96/datafusion:vortex-file-compressed 15559618 15882621 0.98
tpcds_q97/datafusion:vortex-file-compressed 🚀 31298277 35068023 0.89
tpcds_q98/datafusion:vortex-file-compressed 49618073 52383779 0.95
tpcds_q99/datafusion:vortex-file-compressed 60831447 64161498 0.95
datafusion / vortex-compact (0.958x ➖, 9↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 38402780 36343086 1.06
tpcds_q02/datafusion:vortex-compact 79868278 87853979 0.91
tpcds_q03/datafusion:vortex-compact 33455992 34976196 0.96
tpcds_q04/datafusion:vortex-compact 432773153 460934487 0.94
tpcds_q05/datafusion:vortex-compact 82031718 85497080 0.96
tpcds_q06/datafusion:vortex-compact 80819866 89393661 0.90
tpcds_q07/datafusion:vortex-compact 🚀 90340148 101965553 0.89
tpcds_q08/datafusion:vortex-compact 49708642 51413436 0.97
tpcds_q09/datafusion:vortex-compact 95666690 102488159 0.93
tpcds_q10/datafusion:vortex-compact 70078987 68589226 1.02
tpcds_q11/datafusion:vortex-compact 265584612 277792021 0.96
tpcds_q12/datafusion:vortex-compact 37970255 40695696 0.93
tpcds_q13/datafusion:vortex-compact 143315289 147338330 0.97
tpcds_q14/datafusion:vortex-compact 266196548 283158770 0.94
tpcds_q15/datafusion:vortex-compact 🚀 51565356 57522671 0.90
tpcds_q16/datafusion:vortex-compact 41646254 41999155 0.99
tpcds_q17/datafusion:vortex-compact 129171273 128392887 1.01
tpcds_q18/datafusion:vortex-compact 115318441 123684722 0.93
tpcds_q19/datafusion:vortex-compact 62345941 63111860 0.99
tpcds_q20/datafusion:vortex-compact 44727474 46660722 0.96
tpcds_q21/datafusion:vortex-compact 172173607 183910904 0.94
tpcds_q22/datafusion:vortex-compact 78489936 80829171 0.97
tpcds_q23/datafusion:vortex-compact 222373815 236798608 0.94
tpcds_q24/datafusion:vortex-compact 210024891 222637884 0.94
tpcds_q25/datafusion:vortex-compact 129470933 134310329 0.96
tpcds_q26/datafusion:vortex-compact 68261669 72912026 0.94
tpcds_q27/datafusion:vortex-compact 208252579 211112848 0.99
tpcds_q28/datafusion:vortex-compact 101264902 103893768 0.97
tpcds_q29/datafusion:vortex-compact 128463470 136256160 0.94
tpcds_q30/datafusion:vortex-compact 35718722 37059610 0.96
tpcds_q31/datafusion:vortex-compact 211650575 220493626 0.96
tpcds_q32/datafusion:vortex-compact 30901545 29926808 1.03
tpcds_q33/datafusion:vortex-compact 52081053 53843349 0.97
tpcds_q34/datafusion:vortex-compact 62102070 61248870 1.01
tpcds_q35/datafusion:vortex-compact 77927398 80630846 0.97
tpcds_q36/datafusion:vortex-compact 130177058 136939102 0.95
tpcds_q37/datafusion:vortex-compact 🚀 48619330 55653327 0.87
tpcds_q38/datafusion:vortex-compact 100620712 106397258 0.95
tpcds_q39/datafusion:vortex-compact 🚀 185686081 234311711 0.79
tpcds_q40/datafusion:vortex-compact 62838411 68520087 0.92
tpcds_q41/datafusion:vortex-compact 🚀 15982205 17950022 0.89
tpcds_q42/datafusion:vortex-compact 35056086 37706165 0.93
tpcds_q43/datafusion:vortex-compact 🚀 53596191 59838942 0.90
tpcds_q44/datafusion:vortex-compact 🚀 66121492 75350491 0.88
tpcds_q45/datafusion:vortex-compact 51606069 56933072 0.91
tpcds_q46/datafusion:vortex-compact 94488960 94717020 1.00
tpcds_q47/datafusion:vortex-compact 🚀 287991304 322283041 0.89
tpcds_q48/datafusion:vortex-compact 105096208 112072230 0.94
tpcds_q49/datafusion:vortex-compact 98469225 103882547 0.95
tpcds_q50/datafusion:vortex-compact 96473711 97421498 0.99
tpcds_q51/datafusion:vortex-compact 102033802 106937630 0.95
tpcds_q52/datafusion:vortex-compact 35359616 38398708 0.92
tpcds_q53/datafusion:vortex-compact 38640067 41527252 0.93
tpcds_q54/datafusion:vortex-compact 65022177 66667863 0.98
tpcds_q55/datafusion:vortex-compact 34949143 34964934 1.00
tpcds_q56/datafusion:vortex-compact 60415562 61703188 0.98
tpcds_q57/datafusion:vortex-compact 194906711 204014751 0.96
tpcds_q58/datafusion:vortex-compact 116377220 121685601 0.96
tpcds_q59/datafusion:vortex-compact 109871996 111273864 0.99
tpcds_q60/datafusion:vortex-compact 59717061 63445857 0.94
tpcds_q61/datafusion:vortex-compact 85578888 84164017 1.02
tpcds_q62/datafusion:vortex-compact 45888659 47726666 0.96
tpcds_q63/datafusion:vortex-compact 41932952 40706795 1.03
tpcds_q64/datafusion:vortex-compact 778587268 808580600 0.96
tpcds_q65/datafusion:vortex-compact 74985466 77305464 0.97
tpcds_q66/datafusion:vortex-compact 110634410 119184131 0.93
tpcds_q67/datafusion:vortex-compact 145770480 149847811 0.97
tpcds_q68/datafusion:vortex-compact 96315353 95256025 1.01
tpcds_q69/datafusion:vortex-compact 65585620 67273012 0.97
tpcds_q70/datafusion:vortex-compact 141729928 145087126 0.98
tpcds_q71/datafusion:vortex-compact 47099872 48023349 0.98
tpcds_q72/datafusion:vortex-compact 3317692716 3453939171 0.96
tpcds_q73/datafusion:vortex-compact 61746595 58398681 1.06
tpcds_q74/datafusion:vortex-compact 185143175 191049513 0.97
tpcds_q75/datafusion:vortex-compact 182899358 187226915 0.98
tpcds_q76/datafusion:vortex-compact 75467568 82493162 0.91
tpcds_q77/datafusion:vortex-compact 73104584 70402012 1.04
tpcds_q78/datafusion:vortex-compact 205997070 215443764 0.96
tpcds_q79/datafusion:vortex-compact 71375112 70809045 1.01
tpcds_q80/datafusion:vortex-compact 135801319 143335098 0.95
tpcds_q81/datafusion:vortex-compact 42565994 43637011 0.98
tpcds_q82/datafusion:vortex-compact 50107393 53719326 0.93
tpcds_q83/datafusion:vortex-compact 64774077 67130681 0.96
tpcds_q84/datafusion:vortex-compact 19255525 18932425 1.02
tpcds_q85/datafusion:vortex-compact 155100466 162883488 0.95
tpcds_q86/datafusion:vortex-compact 31153526 32664072 0.95
tpcds_q87/datafusion:vortex-compact 107629655 106860709 1.01
tpcds_q88/datafusion:vortex-compact 125371311 136994810 0.92
tpcds_q89/datafusion:vortex-compact 67131314 72481170 0.93
tpcds_q90/datafusion:vortex-compact 23057065 23175728 0.99
tpcds_q91/datafusion:vortex-compact 40520148 42831987 0.95
tpcds_q92/datafusion:vortex-compact 🚀 21255184 23723712 0.90
tpcds_q93/datafusion:vortex-compact 57054077 56155252 1.02
tpcds_q94/datafusion:vortex-compact 33395847 36100818 0.93
tpcds_q95/datafusion:vortex-compact 103336261 102258400 1.01
tpcds_q96/datafusion:vortex-compact 26204145 25209654 1.04
tpcds_q97/datafusion:vortex-compact 47186720 46813073 1.01
tpcds_q98/datafusion:vortex-compact 57498825 58883806 0.98
tpcds_q99/datafusion:vortex-compact 64005412 67359166 0.95
datafusion / parquet (0.947x ➖, 5↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 38029898 40560684 0.94
tpcds_q02/datafusion:parquet 52382965 52602937 1.00
tpcds_q03/datafusion:parquet 16329347 17217334 0.95
tpcds_q04/datafusion:parquet 363484746 393738457 0.92
tpcds_q05/datafusion:parquet 91660729 94514162 0.97
tpcds_q06/datafusion:parquet 90780257 94279502 0.96
tpcds_q07/datafusion:parquet 139302201 143729777 0.97
tpcds_q08/datafusion:parquet 41668641 40086820 1.04
tpcds_q09/datafusion:parquet 52790967 55359138 0.95
tpcds_q10/datafusion:parquet 102366722 105512273 0.97
tpcds_q11/datafusion:parquet 220924185 239441585 0.92
tpcds_q12/datafusion:parquet 29704783 32476298 0.91
tpcds_q13/datafusion:parquet 138877745 145615113 0.95
tpcds_q14/datafusion:parquet 209931001 221258853 0.95
tpcds_q15/datafusion:parquet 56863346 57547014 0.99
tpcds_q16/datafusion:parquet 33242136 36276744 0.92
tpcds_q17/datafusion:parquet 172321462 181152909 0.95
tpcds_q18/datafusion:parquet 173535804 188161615 0.92
tpcds_q19/datafusion:parquet 35999100 38326780 0.94
tpcds_q20/datafusion:parquet 🚀 24227488 27288170 0.89
tpcds_q21/datafusion:parquet 26380142 28779689 0.92
tpcds_q22/datafusion:parquet 🚀 143571536 181573365 0.79
tpcds_q23/datafusion:parquet 188018678 192220462 0.98
tpcds_q24/datafusion:parquet 208675289 226342882 0.92
tpcds_q25/datafusion:parquet 175520447 188686137 0.93
tpcds_q26/datafusion:parquet 115390282 121598923 0.95
tpcds_q27/datafusion:parquet 252401359 268686884 0.94
tpcds_q28/datafusion:parquet 51472190 55947034 0.92
tpcds_q29/datafusion:parquet 181079393 184333741 0.98
tpcds_q30/datafusion:parquet 43712853 47595816 0.92
tpcds_q31/datafusion:parquet 106952543 110776632 0.97
tpcds_q32/datafusion:parquet 29119252 30308869 0.96
tpcds_q33/datafusion:parquet 37959253 38242924 0.99
tpcds_q34/datafusion:parquet 35084711 36536340 0.96
tpcds_q35/datafusion:parquet 97017033 102832030 0.94
tpcds_q36/datafusion:parquet 81642748 87111573 0.94
tpcds_q37/datafusion:parquet 25618803 26723972 0.96
tpcds_q38/datafusion:parquet 63611482 68118266 0.93
tpcds_q39/datafusion:parquet 100260476 108403954 0.92
tpcds_q40/datafusion:parquet 36221963 37074148 0.98
tpcds_q41/datafusion:parquet 12976654 13603832 0.95
tpcds_q42/datafusion:parquet 15469769 16098202 0.96
tpcds_q43/datafusion:parquet 26289181 28643399 0.92
tpcds_q44/datafusion:parquet 39905364 42819331 0.93
tpcds_q45/datafusion:parquet 66720472 70203787 0.95
tpcds_q46/datafusion:parquet 49567190 52299895 0.95
tpcds_q47/datafusion:parquet 188434698 197062819 0.96
tpcds_q48/datafusion:parquet 133394062 137179927 0.97
tpcds_q49/datafusion:parquet 70966398 75226639 0.94
tpcds_q50/datafusion:parquet 108353281 111111525 0.98
tpcds_q51/datafusion:parquet 100160565 99542398 1.01
tpcds_q52/datafusion:parquet 15723242 16551548 0.95
tpcds_q53/datafusion:parquet 31820818 32014311 0.99
tpcds_q54/datafusion:parquet 46514679 50590838 0.92
tpcds_q55/datafusion:parquet 15625672 17183455 0.91
tpcds_q56/datafusion:parquet 35473198 37111321 0.96
tpcds_q57/datafusion:parquet 135399514 133643491 1.01
tpcds_q58/datafusion:parquet 74322937 75173648 0.99
tpcds_q59/datafusion:parquet 70006053 70407793 0.99
tpcds_q60/datafusion:parquet 37135968 38529833 0.96
tpcds_q61/datafusion:parquet 66971816 69493122 0.96
tpcds_q62/datafusion:parquet 43556412 41744887 1.04
tpcds_q63/datafusion:parquet 31794902 32338247 0.98
tpcds_q64/datafusion:parquet 990171714 1028813533 0.96
tpcds_q65/datafusion:parquet 52062203 51592960 1.01
tpcds_q66/datafusion:parquet 84585474 92674113 0.91
tpcds_q67/datafusion:parquet 175628328 186401131 0.94
tpcds_q68/datafusion:parquet 49781508 55281559 0.90
tpcds_q69/datafusion:parquet 92247950 100284112 0.92
tpcds_q70/datafusion:parquet 111880095 118430813 0.94
tpcds_q71/datafusion:parquet 28425949 30900111 0.92
tpcds_q72/datafusion:parquet 847192413 921567597 0.92
tpcds_q73/datafusion:parquet 37699496 39894750 0.94
tpcds_q74/datafusion:parquet 131473206 141716004 0.93
tpcds_q75/datafusion:parquet 133727056 140355683 0.95
tpcds_q76/datafusion:parquet 87193289 95890982 0.91
tpcds_q77/datafusion:parquet 59879314 63590187 0.94
tpcds_q78/datafusion:parquet 177249546 195209416 0.91
tpcds_q79/datafusion:parquet 39777422 42083479 0.95
tpcds_q80/datafusion:parquet 114010094 120424532 0.95
tpcds_q81/datafusion:parquet 🚀 42213995 47163484 0.90
tpcds_q82/datafusion:parquet 28977032 31762137 0.91
tpcds_q83/datafusion:parquet 53456206 57976395 0.92
tpcds_q84/datafusion:parquet 49013312 49744170 0.99
tpcds_q85/datafusion:parquet 241239816 253761102 0.95
tpcds_q86/datafusion:parquet 🚀 19977341 22432236 0.89
tpcds_q87/datafusion:parquet 66098130 67439561 0.98
tpcds_q88/datafusion:parquet 78251044 84209719 0.93
tpcds_q89/datafusion:parquet 36861936 40654500 0.91
tpcds_q90/datafusion:parquet 🚀 17878291 20744736 0.86
tpcds_q91/datafusion:parquet 78811690 86956064 0.91
tpcds_q92/datafusion:parquet 27016014 27782084 0.97
tpcds_q93/datafusion:parquet 39360920 41548219 0.95
tpcds_q94/datafusion:parquet 30272736 29411445 1.03
tpcds_q95/datafusion:parquet 132701527 140090927 0.95
tpcds_q96/datafusion:parquet 15109165 16234313 0.93
tpcds_q97/datafusion:parquet 36870563 38939490 0.95
tpcds_q98/datafusion:parquet 37305012 38978437 0.96
tpcds_q99/datafusion:parquet 49003233 48204570 1.02
duckdb / vortex-file-compressed (0.948x ➖, 23↑ 8↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25196344 27636607 0.91
tpcds_q02/duckdb:vortex-file-compressed 🚨 163354570 84332307 1.94
tpcds_q03/duckdb:vortex-file-compressed 21475797 22786278 0.94
tpcds_q04/duckdb:vortex-file-compressed 🚨 138799343 105082206 1.32
tpcds_q05/duckdb:vortex-file-compressed 97996930 105786986 0.93
tpcds_q06/duckdb:vortex-file-compressed 🚀 35035121 39801601 0.88
tpcds_q07/duckdb:vortex-file-compressed 🚀 23112238 26407077 0.88
tpcds_q08/duckdb:vortex-file-compressed 🚀 22594709 25815337 0.88
tpcds_q09/duckdb:vortex-file-compressed 37478103 41525619 0.90
tpcds_q10/duckdb:vortex-file-compressed 🚀 34814298 39594143 0.88
tpcds_q11/duckdb:vortex-file-compressed 🚨 79596530 67860240 1.17
tpcds_q12/duckdb:vortex-file-compressed 14616347 14814844 0.99
tpcds_q13/duckdb:vortex-file-compressed 31765205 34302537 0.93
tpcds_q14/duckdb:vortex-file-compressed 192841451 207467422 0.93
tpcds_q15/duckdb:vortex-file-compressed 40040454 44398589 0.90
tpcds_q16/duckdb:vortex-file-compressed 🚀 28931885 33078344 0.87
tpcds_q17/duckdb:vortex-file-compressed 🚀 37043182 41390616 0.89
tpcds_q18/duckdb:vortex-file-compressed 44352147 49131755 0.90
tpcds_q19/duckdb:vortex-file-compressed 31917011 34805448 0.92
tpcds_q20/duckdb:vortex-file-compressed 15495383 16778175 0.92
tpcds_q21/duckdb:vortex-file-compressed 19672879 20920262 0.94
tpcds_q22/duckdb:vortex-file-compressed 104551032 112611820 0.93
tpcds_q23/duckdb:vortex-file-compressed 124263654 132739793 0.94
tpcds_q24/duckdb:vortex-file-compressed 56016173 57054574 0.98
tpcds_q25/duckdb:vortex-file-compressed 🚀 35868652 40564284 0.88
tpcds_q26/duckdb:vortex-file-compressed 40888583 44520468 0.92
tpcds_q27/duckdb:vortex-file-compressed 🚀 86093272 98404320 0.87
tpcds_q28/duckdb:vortex-file-compressed 36059828 39830824 0.91
tpcds_q29/duckdb:vortex-file-compressed 37746547 41236375 0.92
tpcds_q30/duckdb:vortex-file-compressed 🚨 39954276 30428288 1.31
tpcds_q31/duckdb:vortex-file-compressed 25573868 25422812 1.01
tpcds_q32/duckdb:vortex-file-compressed 🚀 15528208 17700147 0.88
tpcds_q33/duckdb:vortex-file-compressed 63206981 68382926 0.92
tpcds_q34/duckdb:vortex-file-compressed 18402204 19986554 0.92
tpcds_q35/duckdb:vortex-file-compressed 61214266 66930862 0.91
tpcds_q36/duckdb:vortex-file-compressed 27114362 27878238 0.97
tpcds_q37/duckdb:vortex-file-compressed 23874384 25130134 0.95
tpcds_q38/duckdb:vortex-file-compressed 37570724 38645224 0.97
tpcds_q39/duckdb:vortex-file-compressed 45788699 46420631 0.99
tpcds_q40/duckdb:vortex-file-compressed 22814179 25064073 0.91
tpcds_q41/duckdb:vortex-file-compressed 🚀 12980570 15166977 0.86
tpcds_q42/duckdb:vortex-file-compressed 🚀 11152355 13053083 0.85
tpcds_q43/duckdb:vortex-file-compressed 20436040 20905396 0.98
tpcds_q44/duckdb:vortex-file-compressed 23959905 24553314 0.98
tpcds_q45/duckdb:vortex-file-compressed 🚀 26116187 29115685 0.90
tpcds_q46/duckdb:vortex-file-compressed 46428617 49061659 0.95
tpcds_q47/duckdb:vortex-file-compressed 50705317 52544690 0.96
tpcds_q48/duckdb:vortex-file-compressed 28920065 31085571 0.93
tpcds_q49/duckdb:vortex-file-compressed 🚀 29545918 33539062 0.88
tpcds_q50/duckdb:vortex-file-compressed 35452752 35517244 1.00
tpcds_q51/duckdb:vortex-file-compressed 99520528 101434225 0.98
tpcds_q52/duckdb:vortex-file-compressed 11880025 12734305 0.93
tpcds_q53/duckdb:vortex-file-compressed 16711077 18056642 0.93
tpcds_q54/duckdb:vortex-file-compressed 48339705 52201654 0.93
tpcds_q55/duckdb:vortex-file-compressed 🚀 12021244 13451473 0.89
tpcds_q56/duckdb:vortex-file-compressed 🚀 60185201 67104586 0.90
tpcds_q57/duckdb:vortex-file-compressed 44144233 47790728 0.92
tpcds_q58/duckdb:vortex-file-compressed 32623073 35654009 0.91
tpcds_q59/duckdb:vortex-file-compressed 🚀 47609989 57554160 0.83
tpcds_q60/duckdb:vortex-file-compressed 🚀 62803207 75066120 0.84
tpcds_q61/duckdb:vortex-file-compressed 36445885 39530435 0.92
tpcds_q62/duckdb:vortex-file-compressed 17649772 18999147 0.93
tpcds_q63/duckdb:vortex-file-compressed 17220042 18613845 0.93
tpcds_q64/duckdb:vortex-file-compressed 77687502 84336830 0.92
tpcds_q65/duckdb:vortex-file-compressed 22313453 24662788 0.90
tpcds_q66/duckdb:vortex-file-compressed 62308798 61906314 1.01
tpcds_q67/duckdb:vortex-file-compressed 142545180 147920928 0.96
tpcds_q68/duckdb:vortex-file-compressed 39221101 43033350 0.91
tpcds_q69/duckdb:vortex-file-compressed 🚀 36883361 41672751 0.89
tpcds_q70/duckdb:vortex-file-compressed 24210535 26485508 0.91
tpcds_q71/duckdb:vortex-file-compressed 19773646 21084002 0.94
tpcds_q72/duckdb:vortex-file-compressed 171805184 179509356 0.96
tpcds_q73/duckdb:vortex-file-compressed 18651349 20521001 0.91
tpcds_q74/duckdb:vortex-file-compressed 🚨 59194850 52814817 1.12
tpcds_q75/duckdb:vortex-file-compressed 58541929 63908272 0.92
tpcds_q76/duckdb:vortex-file-compressed 55941455 61582819 0.91
tpcds_q77/duckdb:vortex-file-compressed 64930301 69345139 0.94
tpcds_q78/duckdb:vortex-file-compressed 79699475 83462447 0.95
tpcds_q79/duckdb:vortex-file-compressed 35915566 36746266 0.98
tpcds_q80/duckdb:vortex-file-compressed 88416177 98128863 0.90
tpcds_q81/duckdb:vortex-file-compressed 🚨 44114914 35868766 1.23
tpcds_q82/duckdb:vortex-file-compressed 21519994 22300428 0.97
tpcds_q83/duckdb:vortex-file-compressed 26703757 29148532 0.92
tpcds_q84/duckdb:vortex-file-compressed 🚨 21597367 18477288 1.17
tpcds_q85/duckdb:vortex-file-compressed 45432090 47875133 0.95
tpcds_q86/duckdb:vortex-file-compressed 16574843 16997492 0.98
tpcds_q87/duckdb:vortex-file-compressed 40200378 40105080 1.00
tpcds_q88/duckdb:vortex-file-compressed 41817566 42874408 0.98
tpcds_q89/duckdb:vortex-file-compressed 🚀 17295609 20278632 0.85
tpcds_q90/duckdb:vortex-file-compressed 🚀 13647921 16169365 0.84
tpcds_q91/duckdb:vortex-file-compressed 🚨 33724386 29482599 1.14
tpcds_q92/duckdb:vortex-file-compressed 🚀 13527849 15243986 0.89
tpcds_q93/duckdb:vortex-file-compressed 🚀 27827166 32077592 0.87
tpcds_q94/duckdb:vortex-file-compressed 21926762 23573096 0.93
tpcds_q95/duckdb:vortex-file-compressed 🚀 138821977 154797512 0.90
tpcds_q96/duckdb:vortex-file-compressed 17253579 18727653 0.92
tpcds_q97/duckdb:vortex-file-compressed 38341108 40547656 0.95
tpcds_q98/duckdb:vortex-file-compressed 17921382 18492772 0.97
tpcds_q99/duckdb:vortex-file-compressed 32686144 32985157 0.99
duckdb / vortex-compact (0.975x ➖, 8↑ 7↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 33487810 36849877 0.91
tpcds_q02/duckdb:vortex-compact 🚨 228284576 128874115 1.77
tpcds_q03/duckdb:vortex-compact 56698899 52355531 1.08
tpcds_q04/duckdb:vortex-compact 🚨 161643808 128898939 1.25
tpcds_q05/duckdb:vortex-compact 166041097 174141981 0.95
tpcds_q06/duckdb:vortex-compact 39412129 42794376 0.92
tpcds_q07/duckdb:vortex-compact 37072911 40278458 0.92
tpcds_q08/duckdb:vortex-compact 28576180 30236537 0.95
tpcds_q09/duckdb:vortex-compact 111683618 116268222 0.96
tpcds_q10/duckdb:vortex-compact 47503141 52010332 0.91
tpcds_q11/duckdb:vortex-compact 🚨 97618267 79646580 1.23
tpcds_q12/duckdb:vortex-compact 19300410 20361990 0.95
tpcds_q13/duckdb:vortex-compact 54643087 57212073 0.96
tpcds_q14/duckdb:vortex-compact 285919109 303447041 0.94
tpcds_q15/duckdb:vortex-compact 45101979 48386310 0.93
tpcds_q16/duckdb:vortex-compact 36749447 40497691 0.91
tpcds_q17/duckdb:vortex-compact 53691875 53677871 1.00
tpcds_q18/duckdb:vortex-compact 66543949 69939721 0.95
tpcds_q19/duckdb:vortex-compact 🚀 39636704 45188354 0.88
tpcds_q20/duckdb:vortex-compact 🚀 19879414 23051092 0.86
tpcds_q21/duckdb:vortex-compact 27741620 30564759 0.91
tpcds_q22/duckdb:vortex-compact 112336998 118556782 0.95
tpcds_q23/duckdb:vortex-compact 166246678 173515597 0.96
tpcds_q24/duckdb:vortex-compact 78903036 81152097 0.97
tpcds_q25/duckdb:vortex-compact 49455151 53720176 0.92
tpcds_q26/duckdb:vortex-compact 49872260 53565276 0.93
tpcds_q27/duckdb:vortex-compact 139501976 146080558 0.95
tpcds_q28/duckdb:vortex-compact 109010566 109246430 1.00
tpcds_q29/duckdb:vortex-compact 53745460 53946126 1.00
tpcds_q30/duckdb:vortex-compact 🚨 50733098 37280301 1.36
tpcds_q31/duckdb:vortex-compact 30754409 33723362 0.91
tpcds_q32/duckdb:vortex-compact 23988956 25541558 0.94
tpcds_q33/duckdb:vortex-compact 138743886 146140455 0.95
tpcds_q34/duckdb:vortex-compact 29414667 30576012 0.96
tpcds_q35/duckdb:vortex-compact 69834066 77355927 0.90
tpcds_q36/duckdb:vortex-compact 35026552 36574849 0.96
tpcds_q37/duckdb:vortex-compact 🚀 29632538 33298033 0.89
tpcds_q38/duckdb:vortex-compact 40040069 43322677 0.92
tpcds_q39/duckdb:vortex-compact 🚀 52111080 58167437 0.90
tpcds_q40/duckdb:vortex-compact 30690380 32482648 0.94
tpcds_q41/duckdb:vortex-compact 16532174 18321747 0.90
tpcds_q42/duckdb:vortex-compact 15220372 15961682 0.95
tpcds_q43/duckdb:vortex-compact 24763644 25304643 0.98
tpcds_q44/duckdb:vortex-compact 🚀 32282461 36070427 0.89
tpcds_q45/duckdb:vortex-compact 31206182 32371981 0.96
tpcds_q46/duckdb:vortex-compact 60553395 64854885 0.93
tpcds_q47/duckdb:vortex-compact 54311410 58445113 0.93
tpcds_q48/duckdb:vortex-compact 45933898 47233141 0.97
tpcds_q49/duckdb:vortex-compact 48796171 49514230 0.99
tpcds_q50/duckdb:vortex-compact 59579286 56023571 1.06
tpcds_q51/duckdb:vortex-compact 101837068 109434031 0.93
tpcds_q52/duckdb:vortex-compact 16251083 16366981 0.99
tpcds_q53/duckdb:vortex-compact 23197392 23742591 0.98
tpcds_q54/duckdb:vortex-compact 84495347 89214982 0.95
tpcds_q55/duckdb:vortex-compact 15171277 15337282 0.99
tpcds_q56/duckdb:vortex-compact 145524473 145320137 1.00
tpcds_q57/duckdb:vortex-compact 47998352 48661261 0.99
tpcds_q58/duckdb:vortex-compact 40615437 43488735 0.93
tpcds_q59/duckdb:vortex-compact 🚀 55027405 69843891 0.79
tpcds_q60/duckdb:vortex-compact 146028878 159306766 0.92
tpcds_q61/duckdb:vortex-compact 51701283 55237761 0.94
tpcds_q62/duckdb:vortex-compact 21432050 22488946 0.95
tpcds_q63/duckdb:vortex-compact 23681162 22673766 1.04
tpcds_q64/duckdb:vortex-compact 108463652 111017260 0.98
tpcds_q65/duckdb:vortex-compact 27474581 30316418 0.91
tpcds_q66/duckdb:vortex-compact 102391096 100967338 1.01
tpcds_q67/duckdb:vortex-compact 148016327 154613110 0.96
tpcds_q68/duckdb:vortex-compact 55844544 58646870 0.95
tpcds_q69/duckdb:vortex-compact 47663595 51017467 0.93
tpcds_q70/duckdb:vortex-compact 28630889 30406510 0.94
tpcds_q71/duckdb:vortex-compact 26771103 28883692 0.93
tpcds_q72/duckdb:vortex-compact 193838863 199885184 0.97
tpcds_q73/duckdb:vortex-compact 28014859 29072759 0.96
tpcds_q74/duckdb:vortex-compact 🚨 68219849 59741026 1.14
tpcds_q75/duckdb:vortex-compact 73740976 69197584 1.07
tpcds_q76/duckdb:vortex-compact 129426876 130455265 0.99
tpcds_q77/duckdb:vortex-compact 141910796 138346047 1.03
tpcds_q78/duckdb:vortex-compact 88461108 90465181 0.98
tpcds_q79/duckdb:vortex-compact 58239960 62253748 0.94
tpcds_q80/duckdb:vortex-compact 171797557 173587784 0.99
tpcds_q81/duckdb:vortex-compact 🚨 56652354 43463820 1.30
tpcds_q82/duckdb:vortex-compact 31315858 32636635 0.96
tpcds_q83/duckdb:vortex-compact 45085086 47562935 0.95
tpcds_q84/duckdb:vortex-compact 🚨 28012123 22019260 1.27
tpcds_q85/duckdb:vortex-compact 60373260 62148111 0.97
tpcds_q86/duckdb:vortex-compact 19871118 21647995 0.92
tpcds_q87/duckdb:vortex-compact 🚀 42000178 47037173 0.89
tpcds_q88/duckdb:vortex-compact 42236802 45871351 0.92
tpcds_q89/duckdb:vortex-compact 23570733 25336765 0.93
tpcds_q90/duckdb:vortex-compact 🚀 14436823 16652360 0.87
tpcds_q91/duckdb:vortex-compact 46536833 46045368 1.01
tpcds_q92/duckdb:vortex-compact 21518254 20085518 1.07
tpcds_q93/duckdb:vortex-compact 37501345 39725666 0.94
tpcds_q94/duckdb:vortex-compact 27794996 28291330 0.98
tpcds_q95/duckdb:vortex-compact 146306217 150547540 0.97
tpcds_q96/duckdb:vortex-compact 19010060 19031247 1.00
tpcds_q97/duckdb:vortex-compact 42066637 43516181 0.97
tpcds_q98/duckdb:vortex-compact 23708009 24026193 0.99
tpcds_q99/duckdb:vortex-compact 37638373 35635414 1.06
duckdb / parquet (0.956x ➖, 6↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 43764806 48582129 0.90
tpcds_q02/duckdb:parquet 59677289 64977351 0.92
tpcds_q03/duckdb:parquet 11896074 12766321 0.93
tpcds_q04/duckdb:parquet 123630581 128622400 0.96
tpcds_q05/duckdb:parquet 67175868 73166223 0.92
tpcds_q06/duckdb:parquet 28315447 30211240 0.94
tpcds_q07/duckdb:parquet 23666385 24040393 0.98
tpcds_q08/duckdb:parquet 28538830 29669957 0.96
tpcds_q09/duckdb:parquet 39674966 40359734 0.98
tpcds_q10/duckdb:parquet 33404079 34991093 0.95
tpcds_q11/duckdb:parquet 88207320 93872780 0.94
tpcds_q12/duckdb:parquet 15452932 14951456 1.03
tpcds_q13/duckdb:parquet 34074601 36720837 0.93
tpcds_q14/duckdb:parquet 155855219 169388916 0.92
tpcds_q15/duckdb:parquet 29638461 32708900 0.91
tpcds_q16/duckdb:parquet 21646139 22301758 0.97
tpcds_q17/duckdb:parquet 37296642 39489311 0.94
tpcds_q18/duckdb:parquet 46810118 48703306 0.96
tpcds_q19/duckdb:parquet 28998251 31308103 0.93
tpcds_q20/duckdb:parquet 15241909 15785153 0.97
tpcds_q21/duckdb:parquet 11014522 11251908 0.98
tpcds_q22/duckdb:parquet 65383492 69034960 0.95
tpcds_q23/duckdb:parquet 114173179 117139078 0.97
tpcds_q24/duckdb:parquet 45244778 48371026 0.94
tpcds_q25/duckdb:parquet 33217297 34225736 0.97
tpcds_q26/duckdb:parquet 🚀 37281729 41796020 0.89
tpcds_q27/duckdb:parquet 88239341 91249850 0.97
tpcds_q28/duckdb:parquet 37559569 37028937 1.01
tpcds_q29/duckdb:parquet 34123692 36223201 0.94
tpcds_q30/duckdb:parquet 🚀 38798376 43337521 0.90
tpcds_q31/duckdb:parquet 🚀 21766404 24584510 0.89
tpcds_q32/duckdb:parquet 11823831 11356412 1.04
tpcds_q33/duckdb:parquet 70097439 72766799 0.96
tpcds_q34/duckdb:parquet 21035352 22045491 0.95
tpcds_q35/duckdb:parquet 58227083 63749784 0.91
tpcds_q36/duckdb:parquet 20410333 21294716 0.96
tpcds_q37/duckdb:parquet 12822284 14153119 0.91
tpcds_q38/duckdb:parquet 🚀 32471538 36969407 0.88
tpcds_q39/duckdb:parquet 32451596 34754729 0.93
tpcds_q40/duckdb:parquet 18490590 19713394 0.94
tpcds_q41/duckdb:parquet 🚀 7304982 8891461 0.82
tpcds_q42/duckdb:parquet 🚀 10115047 11384443 0.89
tpcds_q43/duckdb:parquet 15298648 16680691 0.92
tpcds_q44/duckdb:parquet 22784399 23335316 0.98
tpcds_q45/duckdb:parquet 27318545 30087338 0.91
tpcds_q46/duckdb:parquet 44668968 49365620 0.90
tpcds_q47/duckdb:parquet 44946944 48212986 0.93
tpcds_q48/duckdb:parquet 30674896 31491350 0.97
tpcds_q49/duckdb:parquet 24883044 25213643 0.99
tpcds_q50/duckdb:parquet 24310133 25868745 0.94
tpcds_q51/duckdb:parquet 100127659 98483224 1.02
tpcds_q52/duckdb:parquet 11032311 11786156 0.94
tpcds_q53/duckdb:parquet 15938837 16842759 0.95
tpcds_q54/duckdb:parquet 39984338 38937269 1.03
tpcds_q55/duckdb:parquet 10343460 11169208 0.93
tpcds_q56/duckdb:parquet 69675918 68940138 1.01
tpcds_q57/duckdb:parquet 34568017 36144995 0.96
tpcds_q58/duckdb:parquet 21637144 22227152 0.97
tpcds_q59/duckdb:parquet 36784287 35915346 1.02
tpcds_q60/duckdb:parquet 70617476 73466717 0.96
tpcds_q61/duckdb:parquet 30167002 32269711 0.93
tpcds_q62/duckdb:parquet 11853587 12109937 0.98
tpcds_q63/duckdb:parquet 15069915 15293673 0.99
tpcds_q64/duckdb:parquet 75569879 74649365 1.01
tpcds_q65/duckdb:parquet 19924170 21474315 0.93
tpcds_q66/duckdb:parquet 53003537 54857960 0.97
tpcds_q67/duckdb:parquet 133544121 136485985 0.98
tpcds_q68/duckdb:parquet 37215894 38366634 0.97
tpcds_q69/duckdb:parquet 37479749 38556714 0.97
tpcds_q70/duckdb:parquet 19674696 19835946 0.99
tpcds_q71/duckdb:parquet 19068816 18247812 1.04
tpcds_q72/duckdb:parquet 163699545 165740773 0.99
tpcds_q73/duckdb:parquet 18027112 18407226 0.98
tpcds_q74/duckdb:parquet 50771864 51227836 0.99
tpcds_q75/duckdb:parquet 53005563 57312822 0.92
tpcds_q76/duckdb:parquet 68338075 71673310 0.95
tpcds_q77/duckdb:parquet 60974681 64386735 0.95
tpcds_q78/duckdb:parquet 74320952 75458597 0.98
tpcds_q79/duckdb:parquet 27524957 28082919 0.98
tpcds_q80/duckdb:parquet 77619075 83960545 0.92
tpcds_q81/duckdb:parquet 47148306 48063633 0.98
tpcds_q82/duckdb:parquet 15354927 16051104 0.96
tpcds_q83/duckdb:parquet 15763883 17444046 0.90
tpcds_q84/duckdb:parquet 19402345 20039026 0.97
tpcds_q85/duckdb:parquet 40668380 41958643 0.97
tpcds_q86/duckdb:parquet 12208309 12401290 0.98
tpcds_q87/duckdb:parquet 37104501 36987176 1.00
tpcds_q88/duckdb:parquet 28907047 29540295 0.98
tpcds_q89/duckdb:parquet 16800121 17769633 0.95
tpcds_q90/duckdb:parquet 7373915 7608647 0.97
tpcds_q91/duckdb:parquet 23531680 22889255 1.03
tpcds_q92/duckdb:parquet 11284468 11451302 0.99
tpcds_q93/duckdb:parquet 29670381 30912670 0.96
tpcds_q94/duckdb:parquet 16533853 16191461 1.02
tpcds_q95/duckdb:parquet 129393111 124211243 1.04
tpcds_q96/duckdb:parquet 9160170 9938114 0.92
tpcds_q97/duckdb:parquet 35096176 37212205 0.94
tpcds_q98/duckdb:parquet 18574286 19041605 0.98
tpcds_q99/duckdb:parquet 19521344 20813384 0.94
duckdb / duckdb (0.937x ➖, 16↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19626875 21750759 0.90
tpcds_q02/duckdb:duckdb 18231345 20198292 0.90
tpcds_q03/duckdb:duckdb 🚀 8540614 9864392 0.87
tpcds_q04/duckdb:duckdb 161293149 167714658 0.96
tpcds_q05/duckdb:duckdb 🚀 18112068 20415977 0.89
tpcds_q06/duckdb:duckdb 22024551 23380629 0.94
tpcds_q07/duckdb:duckdb 37784177 41746123 0.91
tpcds_q08/duckdb:duckdb 121566902 121382614 1.00
tpcds_q09/duckdb:duckdb 19247216 20205502 0.95
tpcds_q10/duckdb:duckdb 22951302 24356217 0.94
tpcds_q11/duckdb:duckdb 138791642 147683665 0.94
tpcds_q12/duckdb:duckdb 10812144 11805365 0.92
tpcds_q13/duckdb:duckdb 23245220 24542451 0.95
tpcds_q14/duckdb:duckdb 93324028 97398253 0.96
tpcds_q15/duckdb:duckdb 22750515 25174164 0.90
tpcds_q16/duckdb:duckdb 17823914 17502833 1.02
tpcds_q17/duckdb:duckdb 20869559 23156815 0.90
tpcds_q18/duckdb:duckdb 42699642 47243148 0.90
tpcds_q19/duckdb:duckdb 15978220 17356048 0.92
tpcds_q20/duckdb:duckdb 11416358 12074396 0.95
tpcds_q21/duckdb:duckdb 6780000 7233972 0.94
tpcds_q22/duckdb:duckdb 62708894 66755571 0.94
tpcds_q23/duckdb:duckdb 78450299 82870776 0.95
tpcds_q24/duckdb:duckdb 22084573 23868076 0.93
tpcds_q25/duckdb:duckdb 16633740 17039815 0.98
tpcds_q26/duckdb:duckdb 25579231 26063110 0.98
tpcds_q27/duckdb:duckdb 🚀 38114028 42521923 0.90
tpcds_q28/duckdb:duckdb 20876625 21817653 0.96
tpcds_q29/duckdb:duckdb 19882056 21354073 0.93
tpcds_q30/duckdb:duckdb 28764720 29488721 0.98
tpcds_q31/duckdb:duckdb 19717358 19887449 0.99
tpcds_q32/duckdb:duckdb 7176960 7267386 0.99
tpcds_q33/duckdb:duckdb 12215548 13506835 0.90
tpcds_q34/duckdb:duckdb 14782868 15529808 0.95
tpcds_q35/duckdb:duckdb 31884185 32827054 0.97
tpcds_q36/duckdb:duckdb 🚀 68349237 76983747 0.89
tpcds_q37/duckdb:duckdb 7844542 7874114 1.00
tpcds_q38/duckdb:duckdb 29270965 31323978 0.93
tpcds_q39/duckdb:duckdb 26334223 26388597 1.00
tpcds_q40/duckdb:duckdb 12957122 13214500 0.98
tpcds_q41/duckdb:duckdb 8086294 8643891 0.94
tpcds_q42/duckdb:duckdb 🚀 6025714 6752727 0.89
tpcds_q43/duckdb:duckdb 10609005 11277089 0.94
tpcds_q44/duckdb:duckdb 🚀 13059589 14593319 0.89
tpcds_q45/duckdb:duckdb 🚀 15865558 18016547 0.88
tpcds_q46/duckdb:duckdb 35865632 37906046 0.95
tpcds_q47/duckdb:duckdb 39445105 43541765 0.91
tpcds_q48/duckdb:duckdb 22468615 23074049 0.97
tpcds_q49/duckdb:duckdb 15978969 16813039 0.95
tpcds_q50/duckdb:duckdb 14336244 15862963 0.90
tpcds_q51/duckdb:duckdb 90546908 94960715 0.95
tpcds_q52/duckdb:duckdb 7319299 7676885 0.95
tpcds_q53/duckdb:duckdb 11658238 12217362 0.95
tpcds_q54/duckdb:duckdb 16296339 17813943 0.91
tpcds_q55/duckdb:duckdb 🚀 6595251 7453548 0.88
tpcds_q56/duckdb:duckdb 13918104 13375108 1.04
tpcds_q57/duckdb:duckdb 30615874 32370852 0.95
tpcds_q58/duckdb:duckdb 12013100 13060781 0.92
tpcds_q59/duckdb:duckdb 34008072 35533798 0.96
tpcds_q60/duckdb:duckdb 🚀 13802954 15617779 0.88
tpcds_q61/duckdb:duckdb 13907828 14502484 0.96
tpcds_q62/duckdb:duckdb 8995059 9846082 0.91
tpcds_q63/duckdb:duckdb 11036550 11817245 0.93
tpcds_q64/duckdb:duckdb 51584487 55485583 0.93
tpcds_q65/duckdb:duckdb 30549425 33013125 0.93
tpcds_q66/duckdb:duckdb 25564158 26372087 0.97
tpcds_q67/duckdb:duckdb 130083698 137058865 0.95
tpcds_q68/duckdb:duckdb 24271408 26663008 0.91
tpcds_q69/duckdb:duckdb 🚀 22440789 26159870 0.86
tpcds_q70/duckdb:duckdb 13464180 14332462 0.94
tpcds_q71/duckdb:duckdb 🚀 12072050 13458422 0.90
tpcds_q72/duckdb:duckdb 41424869 43055190 0.96
tpcds_q73/duckdb:duckdb 10319940 10997607 0.94
tpcds_q74/duckdb:duckdb 96463960 103019944 0.94
tpcds_q75/duckdb:duckdb 41638231 43549811 0.96
tpcds_q76/duckdb:duckdb 11968697 12446074 0.96
tpcds_q77/duckdb:duckdb 11529887 12102109 0.95
tpcds_q78/duckdb:duckdb 62783277 65275310 0.96
tpcds_q79/duckdb:duckdb 17909162 18488418 0.97
tpcds_q80/duckdb:duckdb 28987726 30102350 0.96
tpcds_q81/duckdb:duckdb 37711197 38679130 0.97
tpcds_q82/duckdb:duckdb 7834791 8503285 0.92
tpcds_q83/duckdb:duckdb 9155712 9780459 0.94
tpcds_q84/duckdb:duckdb 13563400 14106326 0.96
tpcds_q85/duckdb:duckdb 🚀 22217775 25613361 0.87
tpcds_q86/duckdb:duckdb 🚀 10334125 11978084 0.86
tpcds_q87/duckdb:duckdb 34046036 35008203 0.97
tpcds_q88/duckdb:duckdb 23834114 24987450 0.95
tpcds_q89/duckdb:duckdb 13509370 13587357 0.99
tpcds_q90/duckdb:duckdb 🚀 5431635 6415539 0.85
tpcds_q91/duckdb:duckdb 🚀 11612539 13553030 0.86
tpcds_q92/duckdb:duckdb 🚀 8994510 10212819 0.88
tpcds_q93/duckdb:duckdb 22079655 24455883 0.90
tpcds_q94/duckdb:duckdb 13176336 13521045 0.97
tpcds_q95/duckdb:duckdb 120768347 117998598 1.02
tpcds_q96/duckdb:duckdb 4379063 4781204 0.92
tpcds_q97/duckdb:duckdb 29067056 31401193 0.93
tpcds_q98/duckdb:duckdb 12957295 13453506 0.96
tpcds_q99/duckdb:duckdb 16079890 16779214 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +5.7% -8.1% +15.0% +10.0% 🚨 regression
1 datafusion:vortex-file-compressed -3.9% -8.1% +4.6% +20.5% ➖ noise
1 duckdb:duckdb -9.8% -8.1% -1.8% +12.9% ➖ noise
1 duckdb:vortex-compact -9.1% -8.1% -1.1% +12.2% ➖ noise
1 duckdb:vortex-file-compressed -8.8% -8.1% -0.8% +20.8% ➖ noise
2 datafusion:vortex-compact -9.1% -4.4% -4.9% +10.4% ➖ noise
2 datafusion:vortex-file-compressed -8.1% -4.4% -3.9% +10.0% ➖ noise
2 duckdb:duckdb -9.7% -4.4% -5.6% +15.2% ➖ noise
2 duckdb:vortex-compact +77.1% -4.4% +85.2% +12.5% 🚨 regression
2 duckdb:vortex-file-compressed +93.7% -4.4% +102.5% +14.0% 🚨 regression
3 datafusion:vortex-compact -4.3% -6.0% +1.7% +14.3% ➖ noise
3 datafusion:vortex-file-compressed -11.6% -6.0% -5.9% +13.0% ➖ noise
3 duckdb:duckdb -13.4% -6.0% -7.9% +19.0% ➖ noise
3 duckdb:vortex-compact +8.3% -6.0% +15.2% +23.4% ➖ noise
3 duckdb:vortex-file-compressed -5.8% -6.0% +0.3% +18.6% ➖ noise
4 datafusion:vortex-compact -6.1% -5.8% -0.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -7.5% -5.8% -1.8% +10.0% ➖ noise
4 duckdb:duckdb -3.8% -5.8% +2.1% +10.0% ➖ noise
4 duckdb:vortex-compact +25.4% -5.8% +33.1% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed +32.1% -5.8% +40.2% +10.0% 🚨 regression
5 datafusion:vortex-compact -4.1% -5.6% +1.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -12.0% -5.6% -6.8% +10.4% ➖ noise
5 duckdb:duckdb -11.3% -5.6% -6.0% +12.4% ➖ noise
5 duckdb:vortex-compact -4.7% -5.6% +1.0% +12.1% ➖ noise
5 duckdb:vortex-file-compressed -7.4% -5.6% -1.8% +13.0% ➖ noise
6 datafusion:vortex-compact -9.6% -5.0% -4.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.2% -5.0% +1.9% +10.0% ➖ noise
6 duckdb:duckdb -5.8% -5.0% -0.8% +14.6% ➖ noise
6 duckdb:vortex-compact -7.9% -5.0% -3.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -12.0% -5.0% -7.3% +10.0% ➖ noise
7 datafusion:vortex-compact -11.4% -2.3% -9.3% +10.0% ✅ faster
7 datafusion:vortex-file-compressed -5.7% -2.3% -3.5% +10.0% ➖ noise
7 duckdb:duckdb -9.5% -2.3% -7.3% +16.1% ➖ noise
7 duckdb:vortex-compact -8.0% -2.3% -5.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -12.5% -2.3% -10.4% +10.0% ✅ faster
8 datafusion:vortex-compact -3.3% -0.0% -3.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -3.7% -0.0% -3.7% +10.0% ➖ noise
8 duckdb:duckdb +0.2% -0.0% +0.2% +10.0% ➖ noise
8 duckdb:vortex-compact -5.5% -0.0% -5.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -12.5% -0.0% -12.5% +10.0% ✅ faster
9 datafusion:vortex-compact -6.7% -3.2% -3.6% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -5.9% -3.2% -2.8% +10.0% ➖ noise
9 duckdb:duckdb -4.7% -3.2% -1.6% +10.0% ➖ noise
9 duckdb:vortex-compact -3.9% -3.2% -0.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -9.7% -3.2% -6.8% +10.0% ➖ noise
10 datafusion:vortex-compact +2.2% -3.8% +6.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.1% -3.8% +1.7% +10.0% ➖ noise
10 duckdb:duckdb -5.8% -3.8% -2.1% +10.0% ➖ noise
10 duckdb:vortex-compact -8.7% -3.8% -5.1% +10.1% ➖ noise
10 duckdb:vortex-file-compressed -12.1% -3.8% -8.6% +10.0% ➖ noise
11 datafusion:vortex-compact -4.4% -6.9% +2.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.8% -6.9% +4.4% +10.0% ➖ noise
11 duckdb:duckdb -6.0% -6.9% +0.9% +10.0% ➖ noise
11 duckdb:vortex-compact +22.6% -6.9% +31.6% +12.2% 🚨 regression
11 duckdb:vortex-file-compressed +17.3% -6.9% +26.0% +12.4% 🚨 regression
12 datafusion:vortex-compact -6.7% -2.8% -4.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -6.3% -2.8% -3.6% +10.0% ➖ noise
12 duckdb:duckdb -8.4% -2.8% -5.8% +13.2% ➖ noise
12 duckdb:vortex-compact -5.2% -2.8% -2.5% +16.7% ➖ noise
12 duckdb:vortex-file-compressed -1.3% -2.8% +1.5% +13.1% ➖ noise
13 datafusion:vortex-compact -2.7% -5.9% +3.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.9% -5.9% +7.3% +10.0% ➖ noise
13 duckdb:duckdb -5.3% -5.9% +0.7% +10.0% ➖ noise
13 duckdb:vortex-compact -4.5% -5.9% +1.5% +11.1% ➖ noise
13 duckdb:vortex-file-compressed -7.4% -5.9% -1.6% +10.0% ➖ noise
14 datafusion:vortex-compact -6.0% -6.6% +0.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -11.5% -6.6% -5.3% +10.0% ➖ noise
14 duckdb:duckdb -4.2% -6.6% +2.6% +10.0% ➖ noise
14 duckdb:vortex-compact -5.8% -6.6% +0.8% +10.3% ➖ noise
14 duckdb:vortex-file-compressed -7.0% -6.6% -0.5% +10.5% ➖ noise
15 datafusion:vortex-compact -10.4% -5.4% -5.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -5.1% -5.4% +0.2% +10.0% ➖ noise
15 duckdb:duckdb -9.6% -5.4% -4.5% +10.0% ➖ noise
15 duckdb:vortex-compact -6.8% -5.4% -1.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -9.8% -5.4% -4.7% +10.2% ➖ noise
16 datafusion:vortex-compact -0.8% -5.7% +5.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -0.0% -5.7% +6.0% +11.3% ➖ noise
16 duckdb:duckdb +1.8% -5.7% +8.0% +15.0% ➖ noise
16 duckdb:vortex-compact -9.3% -5.7% -3.8% +10.3% ➖ noise
16 duckdb:vortex-file-compressed -12.5% -5.7% -7.3% +10.9% ➖ noise
17 datafusion:vortex-compact +0.6% -5.2% +6.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -3.8% -5.2% +1.5% +10.0% ➖ noise
17 duckdb:duckdb -9.9% -5.2% -4.9% +10.0% ➖ noise
17 duckdb:vortex-compact +0.0% -5.2% +5.5% +12.6% ➖ noise
17 duckdb:vortex-file-compressed -10.5% -5.2% -5.6% +10.0% ➖ noise
18 datafusion:vortex-compact -6.8% -5.9% -1.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -7.5% -5.9% -1.7% +10.0% ➖ noise
18 duckdb:duckdb -9.6% -5.9% -4.0% +10.0% ➖ noise
18 duckdb:vortex-compact -4.9% -5.9% +1.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -9.7% -5.9% -4.1% +10.0% ➖ noise
19 datafusion:vortex-compact -1.2% -6.7% +5.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -13.6% -6.7% -7.4% +10.0% ➖ noise
19 duckdb:duckdb -7.9% -6.7% -1.3% +12.1% ➖ noise
19 duckdb:vortex-compact -12.3% -6.7% -6.0% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -8.3% -6.7% -1.7% +10.0% ➖ noise
20 datafusion:vortex-compact -4.1% -7.4% +3.5% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -5.0% -7.4% +2.6% +10.0% ➖ noise
20 duckdb:duckdb -5.4% -7.4% +2.1% +11.3% ➖ noise
20 duckdb:vortex-compact -13.8% -7.4% -6.9% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -7.6% -7.4% -0.3% +10.9% ➖ noise
21 datafusion:vortex-compact -6.4% -5.3% -1.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -10.1% -5.3% -5.1% +10.0% ➖ noise
21 duckdb:duckdb -6.3% -5.3% -1.1% +18.6% ➖ noise
21 duckdb:vortex-compact -9.2% -5.3% -4.2% +13.4% ➖ noise
21 duckdb:vortex-file-compressed -6.0% -5.3% -0.7% +14.1% ➖ noise
22 datafusion:vortex-compact -2.9% -13.5% +12.2% +11.5% 🚨 regression
22 datafusion:vortex-file-compressed -4.6% -13.5% +10.2% +10.0% 🚨 regression
22 duckdb:duckdb -6.1% -13.5% +8.6% +11.8% ➖ noise
22 duckdb:vortex-compact -5.2% -13.5% +9.5% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -7.2% -13.5% +7.3% +10.0% ➖ noise
23 datafusion:vortex-compact -6.1% -2.4% -3.8% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -10.0% -2.4% -7.8% +10.0% ➖ noise
23 duckdb:duckdb -5.3% -2.4% -3.0% +16.9% ➖ noise
23 duckdb:vortex-compact -4.2% -2.4% -1.9% +12.1% ➖ noise
23 duckdb:vortex-file-compressed -6.4% -2.4% -4.1% +10.0% ➖ noise
24 datafusion:vortex-compact -5.7% -7.1% +1.6% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -7.3% -7.1% -0.2% +10.0% ➖ noise
24 duckdb:duckdb -7.5% -7.1% -0.4% +11.1% ➖ noise
24 duckdb:vortex-compact -2.8% -7.1% +4.7% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -1.8% -7.1% +5.7% +10.0% ➖ noise
25 datafusion:vortex-compact -3.6% -5.0% +1.5% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -4.9% -5.0% +0.1% +10.0% ➖ noise
25 duckdb:duckdb -2.4% -5.0% +2.7% +10.3% ➖ noise
25 duckdb:vortex-compact -7.9% -5.0% -3.1% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -11.6% -5.0% -6.9% +10.0% ➖ noise
26 datafusion:vortex-compact -6.4% -8.0% +1.8% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -11.1% -8.0% -3.4% +10.0% ➖ noise
26 duckdb:duckdb -1.9% -8.0% +6.7% +14.2% ➖ noise
26 duckdb:vortex-compact -6.9% -8.0% +1.2% +12.8% ➖ noise
26 duckdb:vortex-file-compressed -8.2% -8.0% -0.2% +12.9% ➖ noise
27 datafusion:vortex-compact -1.4% -4.7% +3.5% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -8.3% -4.7% -3.7% +10.0% ➖ noise
27 duckdb:duckdb -10.4% -4.7% -6.0% +17.2% ➖ noise
27 duckdb:vortex-compact -4.5% -4.7% +0.2% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -12.5% -4.7% -8.2% +10.0% ➖ noise
28 datafusion:vortex-compact -2.5% -3.4% +0.9% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -14.3% -3.4% -11.3% +10.0% ✅ faster
28 duckdb:duckdb -4.3% -3.4% -0.9% +10.0% ➖ noise
28 duckdb:vortex-compact -0.2% -3.4% +3.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -9.5% -3.4% -6.3% +10.0% ➖ noise
29 datafusion:vortex-compact -5.7% -3.8% -2.0% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -4.0% -3.8% -0.2% +10.0% ➖ noise
29 duckdb:duckdb -6.9% -3.8% -3.2% +10.0% ➖ noise
29 duckdb:vortex-compact -0.4% -3.8% +3.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -8.5% -3.8% -4.8% +14.3% ➖ noise
30 datafusion:vortex-compact -3.6% -9.3% +6.3% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -9.3% -9.3% +0.1% +10.0% ➖ noise
30 duckdb:duckdb -2.5% -9.3% +7.6% +10.0% ➖ noise
30 duckdb:vortex-compact +36.1% -9.3% +50.1% +13.9% 🚨 regression
30 duckdb:vortex-file-compressed +31.3% -9.3% +44.8% +10.0% 🚨 regression
31 datafusion:vortex-compact -4.0% -7.5% +3.8% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -6.3% -7.5% +1.3% +10.0% ➖ noise
31 duckdb:duckdb -0.9% -7.5% +7.2% +10.2% ➖ noise
31 duckdb:vortex-compact -8.8% -7.5% -1.4% +13.4% ➖ noise
31 duckdb:vortex-file-compressed +0.6% -7.5% +8.8% +10.3% ➖ noise
32 datafusion:vortex-compact +3.3% +0.0% +3.2% +14.1% ➖ noise
32 datafusion:vortex-file-compressed -12.7% +0.0% -12.7% +10.8% ✅ faster
32 duckdb:duckdb -1.2% +0.0% -1.3% +17.3% ➖ noise
32 duckdb:vortex-compact -6.1% +0.0% -6.1% +12.8% ➖ noise
32 duckdb:vortex-file-compressed -12.3% +0.0% -12.3% +10.0% ✅ faster
33 datafusion:vortex-compact -3.3% -2.2% -1.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -4.7% -2.2% -2.6% +12.0% ➖ noise
33 duckdb:duckdb -9.6% -2.2% -7.5% +11.6% ➖ noise
33 duckdb:vortex-compact -5.1% -2.2% -2.9% +10.8% ➖ noise
33 duckdb:vortex-file-compressed -7.6% -2.2% -5.5% +14.0% ➖ noise
34 datafusion:vortex-compact +1.4% -4.3% +5.9% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -5.5% -4.3% -1.3% +10.0% ➖ noise
34 duckdb:duckdb -4.8% -4.3% -0.6% +10.0% ➖ noise
34 duckdb:vortex-compact -3.8% -4.3% +0.5% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -7.9% -4.3% -3.8% +10.0% ➖ noise
35 datafusion:vortex-compact -3.4% -7.2% +4.1% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -5.2% -7.2% +2.1% +10.0% ➖ noise
35 duckdb:duckdb -2.9% -7.2% +4.6% +10.5% ➖ noise
35 duckdb:vortex-compact -9.7% -7.2% -2.7% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -8.5% -7.2% -1.5% +10.1% ➖ noise
36 datafusion:vortex-compact -4.9% -5.2% +0.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -5.4% -5.2% -0.2% +10.0% ➖ noise
36 duckdb:duckdb -11.2% -5.2% -6.3% +16.0% ➖ noise
36 duckdb:vortex-compact -4.2% -5.2% +1.0% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -2.7% -5.2% +2.6% +10.0% ➖ noise
37 datafusion:vortex-compact -12.6% -6.8% -6.3% +10.6% ➖ noise
37 datafusion:vortex-file-compressed -0.2% -6.8% +7.0% +10.0% ➖ noise
37 duckdb:duckdb -0.4% -6.8% +6.9% +13.8% ➖ noise
37 duckdb:vortex-compact -11.0% -6.8% -4.5% +10.5% ➖ noise
37 duckdb:vortex-file-compressed -5.0% -6.8% +1.9% +14.6% ➖ noise
38 datafusion:vortex-compact -5.4% -9.4% +4.4% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -1.7% -9.4% +8.5% +10.0% ➖ noise
38 duckdb:duckdb -6.6% -9.4% +3.2% +10.0% ➖ noise
38 duckdb:vortex-compact -7.6% -9.4% +2.1% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -2.8% -9.4% +7.3% +10.0% ➖ noise
39 datafusion:vortex-compact -20.8% -7.1% -14.7% +17.3% ➖ noise
39 datafusion:vortex-file-compressed -13.3% -7.1% -6.7% +24.7% ➖ noise
39 duckdb:duckdb -0.2% -7.1% +7.4% +24.6% ➖ noise
39 duckdb:vortex-compact -10.4% -7.1% -3.6% +23.2% ➖ noise
39 duckdb:vortex-file-compressed -1.4% -7.1% +6.1% +12.9% ➖ noise
40 datafusion:vortex-compact -8.3% -4.3% -4.2% +12.0% ➖ noise
40 datafusion:vortex-file-compressed +0.1% -4.3% +4.5% +11.6% ➖ noise
40 duckdb:duckdb -1.9% -4.3% +2.4% +16.3% ➖ noise
40 duckdb:vortex-compact -5.5% -4.3% -1.3% +10.6% ➖ noise
40 duckdb:vortex-file-compressed -9.0% -4.3% -4.9% +16.1% ➖ noise
41 datafusion:vortex-compact -11.0% -11.5% +0.6% +11.9% ➖ noise
41 datafusion:vortex-file-compressed -13.8% -11.5% -2.6% +15.4% ➖ noise
41 duckdb:duckdb -6.5% -11.5% +5.7% +12.0% ➖ noise
41 duckdb:vortex-compact -9.8% -11.5% +1.9% +11.2% ➖ noise
41 duckdb:vortex-file-compressed -14.4% -11.5% -3.3% +10.0% ➖ noise
42 datafusion:vortex-compact -7.0% -7.6% +0.6% +11.6% ➖ noise
42 datafusion:vortex-file-compressed -0.3% -7.6% +7.9% +12.0% ➖ noise
42 duckdb:duckdb -10.8% -7.6% -3.4% +13.7% ➖ noise
42 duckdb:vortex-compact -4.6% -7.6% +3.2% +14.6% ➖ noise
42 duckdb:vortex-file-compressed -14.6% -7.6% -7.5% +14.8% ➖ noise
43 datafusion:vortex-compact -10.4% -8.3% -2.4% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -1.4% -8.3% +7.5% +12.1% ➖ noise
43 duckdb:duckdb -5.9% -8.3% +2.5% +10.0% ➖ noise
43 duckdb:vortex-compact -2.1% -8.3% +6.7% +10.0% ➖ noise
43 duckdb:vortex-file-compressed -2.2% -8.3% +6.5% +10.0% ➖ noise
44 datafusion:vortex-compact -12.2% -4.6% -8.0% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -4.6% -4.6% +0.0% +10.0% ➖ noise
44 duckdb:duckdb -10.5% -4.6% -6.2% +10.0% ➖ noise
44 duckdb:vortex-compact -10.5% -4.6% -6.2% +16.9% ➖ noise
44 duckdb:vortex-file-compressed -2.4% -4.6% +2.3% +15.5% ➖ noise
45 datafusion:vortex-compact -9.4% -7.1% -2.4% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -5.6% -7.1% +1.6% +10.0% ➖ noise
45 duckdb:duckdb -11.9% -7.1% -5.2% +10.4% ➖ noise
45 duckdb:vortex-compact -3.6% -7.1% +3.8% +10.9% ➖ noise
45 duckdb:vortex-file-compressed -10.3% -7.1% -3.4% +10.0% ➖ noise
46 datafusion:vortex-compact -0.2% -7.4% +7.7% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -7.2% -7.4% +0.2% +10.0% ➖ noise
46 duckdb:duckdb -5.4% -7.4% +2.2% +10.0% ➖ noise
46 duckdb:vortex-compact -6.6% -7.4% +0.8% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -5.4% -7.4% +2.2% +10.0% ➖ noise
47 datafusion:vortex-compact -10.6% -5.6% -5.4% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -5.9% -5.6% -0.4% +10.0% ➖ noise
47 duckdb:duckdb -9.4% -5.6% -4.1% +10.0% ➖ noise
47 duckdb:vortex-compact -7.1% -5.6% -1.6% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -3.5% -5.6% +2.2% +10.1% ➖ noise
48 datafusion:vortex-compact -6.2% -2.7% -3.6% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -3.7% -2.7% -1.0% +10.0% ➖ noise
48 duckdb:duckdb -2.6% -2.7% +0.1% +10.0% ➖ noise
48 duckdb:vortex-compact -2.8% -2.7% -0.1% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -7.0% -2.7% -4.4% +10.1% ➖ noise
49 datafusion:vortex-compact -5.2% -3.5% -1.8% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -7.6% -3.5% -4.2% +10.0% ➖ noise
49 duckdb:duckdb -5.0% -3.5% -1.5% +12.9% ➖ noise
49 duckdb:vortex-compact -1.5% -3.5% +2.1% +10.0% ➖ noise
49 duckdb:vortex-file-compressed -11.9% -3.5% -8.7% +12.0% ➖ noise
50 datafusion:vortex-compact -1.0% -4.3% +3.4% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -7.5% -4.3% -3.4% +10.0% ➖ noise
50 duckdb:duckdb -9.6% -4.3% -5.6% +10.0% ➖ noise
50 duckdb:vortex-compact +6.3% -4.3% +11.1% +10.0% 🚨 regression
50 duckdb:vortex-file-compressed -0.2% -4.3% +4.3% +10.0% ➖ noise
51 datafusion:vortex-compact -4.6% +1.1% -5.7% +13.7% ➖ noise
51 datafusion:vortex-file-compressed +2.2% +1.1% +1.0% +15.5% ➖ noise
51 duckdb:duckdb -4.6% +1.1% -5.7% +13.3% ➖ noise
51 duckdb:vortex-compact -6.9% +1.1% -8.0% +19.1% ➖ noise
51 duckdb:vortex-file-compressed -1.9% +1.1% -3.0% +28.4% ➖ noise
52 datafusion:vortex-compact -7.9% -5.7% -2.3% +16.3% ➖ noise
52 datafusion:vortex-file-compressed -5.2% -5.7% +0.5% +16.1% ➖ noise
52 duckdb:duckdb -4.7% -5.7% +1.1% +20.6% ➖ noise
52 duckdb:vortex-compact -0.7% -5.7% +5.3% +18.1% ➖ noise
52 duckdb:vortex-file-compressed -6.7% -5.7% -1.1% +23.9% ➖ noise
53 datafusion:vortex-compact -7.0% -3.0% -4.1% +11.2% ➖ noise
53 datafusion:vortex-file-compressed -4.8% -3.0% -1.9% +10.0% ➖ noise
53 duckdb:duckdb -4.6% -3.0% -1.6% +11.4% ➖ noise
53 duckdb:vortex-compact -2.3% -3.0% +0.7% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -7.5% -3.0% -4.6% +12.5% ➖ noise
54 datafusion:vortex-compact -2.5% -2.8% +0.4% +10.1% ➖ noise
54 datafusion:vortex-file-compressed -5.3% -2.8% -2.6% +10.2% ➖ noise
54 duckdb:duckdb -8.5% -2.8% -5.9% +15.7% ➖ noise
54 duckdb:vortex-compact -5.3% -2.8% -2.5% +10.3% ➖ noise
54 duckdb:vortex-file-compressed -7.4% -2.8% -4.7% +13.8% ➖ noise
55 datafusion:vortex-compact -0.0% -8.2% +8.9% +12.4% ➖ noise
55 datafusion:vortex-file-compressed -7.8% -8.2% +0.5% +10.9% ➖ noise
55 duckdb:duckdb -11.5% -8.2% -3.6% +15.5% ➖ noise
55 duckdb:vortex-compact -1.1% -8.2% +7.8% +12.1% ➖ noise
55 duckdb:vortex-file-compressed -10.6% -8.2% -2.6% +17.0% ➖ noise
56 datafusion:vortex-compact -2.1% -1.7% -0.4% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -9.6% -1.7% -8.1% +10.0% ➖ noise
56 duckdb:duckdb +4.1% -1.7% +5.9% +10.5% ➖ noise
56 duckdb:vortex-compact +0.1% -1.7% +1.9% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -10.3% -1.7% -8.7% +10.4% ➖ noise
57 datafusion:vortex-compact -4.5% -1.6% -2.9% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -5.1% -1.6% -3.6% +10.0% ➖ noise
57 duckdb:duckdb -5.4% -1.6% -3.9% +10.0% ➖ noise
57 duckdb:vortex-compact -1.4% -1.6% +0.2% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -7.6% -1.6% -6.2% +16.2% ➖ noise
58 datafusion:vortex-compact -4.4% -1.9% -2.5% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -4.4% -1.9% -2.5% +10.0% ➖ noise
58 duckdb:duckdb -8.0% -1.9% -6.2% +14.2% ➖ noise
58 duckdb:vortex-compact -6.6% -1.9% -4.8% +17.8% ➖ noise
58 duckdb:vortex-file-compressed -8.5% -1.9% -6.7% +10.8% ➖ noise
59 datafusion:vortex-compact -1.3% +0.9% -2.2% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -8.6% +0.9% -9.5% +10.0% ✅ faster
59 duckdb:duckdb -4.3% +0.9% -5.2% +10.0% ➖ noise
59 duckdb:vortex-compact -21.2% +0.9% -21.9% +10.0% ✅ faster
59 duckdb:vortex-file-compressed -17.3% +0.9% -18.0% +13.5% ✅ faster
60 datafusion:vortex-compact -5.9% -3.7% -2.2% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -5.3% -3.7% -1.6% +10.0% ➖ noise
60 duckdb:duckdb -11.6% -3.7% -8.2% +14.3% ➖ noise
60 duckdb:vortex-compact -8.3% -3.7% -4.8% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -16.3% -3.7% -13.1% +13.9% ✅ faster
61 datafusion:vortex-compact +1.7% -5.1% +7.1% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -6.4% -5.1% -1.4% +10.0% ➖ noise
61 duckdb:duckdb -4.1% -5.1% +1.0% +10.0% ➖ noise
61 duckdb:vortex-compact -6.4% -5.1% -1.4% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -7.8% -5.1% -2.9% +10.0% ➖ noise
62 datafusion:vortex-compact -3.9% +1.1% -4.9% +10.0% ➖ noise
62 datafusion:vortex-file-compressed -9.3% +1.1% -10.3% +11.4% ✅ faster
62 duckdb:duckdb -8.6% +1.1% -9.6% +15.5% ➖ noise
62 duckdb:vortex-compact -4.7% +1.1% -5.7% +25.0% ➖ noise
62 duckdb:vortex-file-compressed -7.1% +1.1% -8.1% +18.7% ➖ noise
63 datafusion:vortex-compact +3.0% -1.6% +4.7% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -5.1% -1.6% -3.6% +10.7% ➖ noise
63 duckdb:duckdb -6.6% -1.6% -5.1% +10.0% ➖ noise
63 duckdb:vortex-compact +4.4% -1.6% +6.1% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -7.5% -1.6% -6.0% +10.0% ➖ noise
64 datafusion:vortex-compact -3.7% -1.3% -2.4% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -8.4% -1.3% -7.2% +10.0% ➖ noise
64 duckdb:duckdb -7.0% -1.3% -5.8% +10.0% ➖ noise
64 duckdb:vortex-compact -2.3% -1.3% -1.0% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -7.9% -1.3% -6.7% +10.0% ➖ noise
65 datafusion:vortex-compact -3.0% -3.2% +0.2% +10.4% ➖ noise
65 datafusion:vortex-file-compressed -8.2% -3.2% -5.1% +14.2% ➖ noise
65 duckdb:duckdb -7.5% -3.2% -4.4% +13.9% ➖ noise
65 duckdb:vortex-compact -9.4% -3.2% -6.3% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -9.5% -3.2% -6.5% +12.7% ➖ noise
66 datafusion:vortex-compact -7.2% -6.1% -1.2% +10.0% ➖ noise
66 datafusion:vortex-file-compressed -17.9% -6.1% -12.6% +10.4% ✅ faster
66 duckdb:duckdb -3.1% -6.1% +3.2% +12.4% ➖ noise
66 duckdb:vortex-compact +1.4% -6.1% +8.0% +14.1% ➖ noise
66 duckdb:vortex-file-compressed +0.7% -6.1% +7.2% +10.0% ➖ noise
67 datafusion:vortex-compact -2.7% -4.0% +1.3% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -9.3% -4.0% -5.5% +10.0% ➖ noise
67 duckdb:duckdb -5.1% -4.0% -1.2% +10.0% ➖ noise
67 duckdb:vortex-compact -4.3% -4.0% -0.3% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -3.6% -4.0% +0.4% +10.0% ➖ noise
68 datafusion:vortex-compact +1.1% -6.5% +8.2% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -12.3% -6.5% -6.2% +10.0% ➖ noise
68 duckdb:duckdb -9.0% -6.5% -2.6% +10.0% ➖ noise
68 duckdb:vortex-compact -4.8% -6.5% +1.9% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -8.9% -6.5% -2.5% +10.0% ➖ noise
69 datafusion:vortex-compact -2.5% -5.4% +3.1% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -8.7% -5.4% -3.5% +10.0% ➖ noise
69 duckdb:duckdb -14.2% -5.4% -9.3% +12.0% ➖ noise
69 duckdb:vortex-compact -6.6% -5.4% -1.2% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -11.5% -5.4% -6.4% +10.0% ➖ noise
70 datafusion:vortex-compact -2.3% -3.2% +0.9% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -10.6% -3.2% -7.7% +10.0% ➖ noise
70 duckdb:duckdb -6.1% -3.2% -3.0% +10.9% ➖ noise
70 duckdb:vortex-compact -5.8% -3.2% -2.7% +10.0% ➖ noise
70 duckdb:vortex-file-compressed -8.6% -3.2% -5.6% +12.4% ➖ noise
71 datafusion:vortex-compact -1.9% -2.0% +0.0% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -7.7% -2.0% -5.8% +11.6% ➖ noise
71 duckdb:duckdb -10.3% -2.0% -8.5% +10.3% ➖ noise
71 duckdb:vortex-compact -7.3% -2.0% -5.5% +10.0% ➖ noise
71 duckdb:vortex-file-compressed -6.2% -2.0% -4.3% +16.4% ➖ noise
72 datafusion:vortex-compact -3.9% -4.7% +0.8% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -9.9% -4.7% -5.4% +10.0% ➖ noise
72 duckdb:duckdb -3.8% -4.7% +1.0% +14.0% ➖ noise
72 duckdb:vortex-compact -3.0% -4.7% +1.8% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -4.3% -4.7% +0.4% +10.0% ➖ noise
73 datafusion:vortex-compact +5.7% -3.8% +9.9% +21.0% ➖ noise
73 datafusion:vortex-file-compressed -2.0% -3.8% +1.8% +17.0% ➖ noise
73 duckdb:duckdb -6.2% -3.8% -2.5% +10.6% ➖ noise
73 duckdb:vortex-compact -3.6% -3.8% +0.2% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -9.1% -3.8% -5.5% +10.0% ➖ noise
74 datafusion:vortex-compact -3.1% -4.1% +1.1% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -4.7% -4.1% -0.6% +10.0% ➖ noise
74 duckdb:duckdb -6.4% -4.1% -2.3% +10.0% ➖ noise
74 duckdb:vortex-compact +14.2% -4.1% +19.1% +10.0% 🚨 regression
74 duckdb:vortex-file-compressed +12.1% -4.1% +16.9% +10.0% 🚨 regression
75 datafusion:vortex-compact -2.3% -6.1% +4.1% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -5.0% -6.1% +1.2% +10.0% ➖ noise
75 duckdb:duckdb -4.4% -6.1% +1.9% +10.0% ➖ noise
75 duckdb:vortex-compact +6.6% -6.1% +13.5% +11.1% 🚨 regression
75 duckdb:vortex-file-compressed -8.4% -6.1% -2.4% +10.0% ➖ noise
76 datafusion:vortex-compact -8.5% -6.9% -1.7% +11.1% ➖ noise
76 datafusion:vortex-file-compressed -9.4% -6.9% -2.7% +10.6% ➖ noise
76 duckdb:duckdb -3.8% -6.9% +3.3% +16.4% ➖ noise
76 duckdb:vortex-compact -0.8% -6.9% +6.6% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -9.2% -6.9% -2.4% +19.5% ➖ noise
77 datafusion:vortex-compact +3.8% -5.6% +10.0% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -13.4% -5.6% -8.2% +11.5% ➖ noise
77 duckdb:duckdb -4.7% -5.6% +0.9% +10.0% ➖ noise
77 duckdb:vortex-compact +2.6% -5.6% +8.6% +10.0% ➖ noise
77 duckdb:vortex-file-compressed -6.4% -5.6% -0.8% +10.1% ➖ noise
78 datafusion:vortex-compact -4.4% -5.4% +1.1% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -9.9% -5.4% -4.7% +10.0% ➖ noise
78 duckdb:duckdb -3.8% -5.4% +1.7% +10.0% ➖ noise
78 duckdb:vortex-compact -2.2% -5.4% +3.4% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -4.5% -5.4% +1.0% +10.0% ➖ noise
79 datafusion:vortex-compact +0.8% -3.7% +4.7% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -8.0% -3.7% -4.5% +10.0% ➖ noise
79 duckdb:duckdb -3.1% -3.7% +0.6% +11.5% ➖ noise
79 duckdb:vortex-compact -6.4% -3.7% -2.8% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -2.3% -3.7% +1.5% +11.6% ➖ noise
80 datafusion:vortex-compact -5.3% -6.4% +1.3% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -7.8% -6.4% -1.4% +10.0% ➖ noise
80 duckdb:duckdb -3.7% -6.4% +2.9% +11.1% ➖ noise
80 duckdb:vortex-compact -1.0% -6.4% +5.8% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -9.9% -6.4% -3.7% +10.0% ➖ noise
81 datafusion:vortex-compact -2.5% -6.3% +4.1% +10.0% ➖ noise
81 datafusion:vortex-file-compressed -5.9% -6.3% +0.5% +10.0% ➖ noise
81 duckdb:duckdb -2.5% -6.3% +4.1% +12.0% ➖ noise
81 duckdb:vortex-compact +30.3% -6.3% +39.1% +10.3% 🚨 regression
81 duckdb:vortex-file-compressed +23.0% -6.3% +31.3% +10.0% 🚨 regression
82 datafusion:vortex-compact -6.7% -6.6% -0.2% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -8.2% -6.6% -1.7% +10.0% ➖ noise
82 duckdb:duckdb -7.9% -6.6% -1.4% +14.7% ➖ noise
82 duckdb:vortex-compact -4.0% -6.6% +2.7% +11.3% ➖ noise
82 duckdb:vortex-file-compressed -3.5% -6.6% +3.3% +19.9% ➖ noise
83 datafusion:vortex-compact -3.5% -8.7% +5.7% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -9.1% -8.7% -0.5% +10.0% ➖ noise
83 duckdb:duckdb -6.4% -8.7% +2.6% +13.3% ➖ noise
83 duckdb:vortex-compact -5.2% -8.7% +3.8% +10.0% ➖ noise
83 duckdb:vortex-file-compressed -8.4% -8.7% +0.4% +18.8% ➖ noise
84 datafusion:vortex-compact +1.7% -2.3% +4.1% +11.5% ➖ noise
84 datafusion:vortex-file-compressed -3.9% -2.3% -1.6% +10.6% ➖ noise
84 duckdb:duckdb -3.8% -2.3% -1.6% +13.1% ➖ noise
84 duckdb:vortex-compact +27.2% -2.3% +30.2% +10.0% 🚨 regression
84 duckdb:vortex-file-compressed +16.9% -2.3% +19.7% +10.0% 🚨 regression
85 datafusion:vortex-compact -4.8% -4.0% -0.8% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -5.7% -4.0% -1.8% +10.0% ➖ noise
85 duckdb:duckdb -13.3% -4.0% -9.6% +10.0% ✅ faster
85 duckdb:vortex-compact -2.9% -4.0% +1.2% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -5.1% -4.0% -1.1% +10.0% ➖ noise
86 datafusion:vortex-compact -4.6% -6.4% +1.9% +12.8% ➖ noise
86 datafusion:vortex-file-compressed -8.2% -6.4% -2.0% +11.2% ➖ noise
86 duckdb:duckdb -13.7% -6.4% -7.9% +17.9% ➖ noise
86 duckdb:vortex-compact -8.2% -6.4% -2.0% +19.1% ➖ noise
86 duckdb:vortex-file-compressed -2.5% -6.4% +4.1% +15.6% ➖ noise
87 datafusion:vortex-compact +0.7% -0.8% +1.6% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -2.6% -0.8% -1.7% +10.6% ➖ noise
87 duckdb:duckdb -2.7% -0.8% -1.9% +11.7% ➖ noise
87 duckdb:vortex-compact -10.7% -0.8% -9.9% +14.1% ➖ noise
87 duckdb:vortex-file-compressed +0.2% -0.8% +1.1% +12.3% ➖ noise
88 datafusion:vortex-compact -8.5% -4.6% -4.0% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -10.4% -4.6% -6.1% +10.0% ➖ noise
88 duckdb:duckdb -4.6% -4.6% +0.0% +10.0% ➖ noise
88 duckdb:vortex-compact -7.9% -4.6% -3.4% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -2.5% -4.6% +2.3% +10.0% ➖ noise
89 datafusion:vortex-compact -7.4% -7.4% +0.0% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -3.6% -7.4% +4.1% +10.0% ➖ noise
89 duckdb:duckdb -0.6% -7.4% +7.4% +10.7% ➖ noise
89 duckdb:vortex-compact -7.0% -7.4% +0.5% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -14.7% -7.4% -7.9% +12.2% ➖ noise
90 datafusion:vortex-compact -0.5% -8.6% +8.9% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -9.0% -8.6% -0.4% +10.0% ➖ noise
90 duckdb:duckdb -15.3% -8.6% -7.4% +11.7% ➖ noise
90 duckdb:vortex-compact -13.3% -8.6% -5.1% +10.4% ➖ noise
90 duckdb:vortex-file-compressed -15.6% -8.6% -7.6% +11.3% ➖ noise
91 datafusion:vortex-compact -5.4% -3.5% -2.0% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -1.9% -3.5% +1.6% +10.7% ➖ noise
91 duckdb:duckdb -14.3% -3.5% -11.2% +17.6% ➖ noise
91 duckdb:vortex-compact +1.1% -3.5% +4.7% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +14.4% -3.5% +18.5% +14.9% 🚨 regression
92 datafusion:vortex-compact -10.4% -2.1% -8.5% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -9.7% -2.1% -7.7% +10.0% ➖ noise
92 duckdb:duckdb -11.9% -2.1% -10.0% +15.0% ➖ noise
92 duckdb:vortex-compact +7.1% -2.1% +9.4% +15.8% ➖ noise
92 duckdb:vortex-file-compressed -11.3% -2.1% -9.3% +13.6% ➖ noise
93 datafusion:vortex-compact +1.6% -4.6% +6.5% +10.9% ➖ noise
93 datafusion:vortex-file-compressed -9.9% -4.6% -5.5% +10.8% ➖ noise
93 duckdb:duckdb -9.7% -4.6% -5.3% +11.3% ➖ noise
93 duckdb:vortex-compact -5.6% -4.6% -1.0% +13.3% ➖ noise
93 duckdb:vortex-file-compressed -13.3% -4.6% -9.0% +10.0% ➖ noise
94 datafusion:vortex-compact -7.5% +2.5% -9.8% +10.0% ✅ faster
94 datafusion:vortex-file-compressed -9.2% +2.5% -11.4% +13.6% ➖ noise
94 duckdb:duckdb -2.5% +2.5% -4.9% +10.6% ➖ noise
94 duckdb:vortex-compact -1.8% +2.5% -4.2% +11.3% ➖ noise
94 duckdb:vortex-file-compressed -7.0% +2.5% -9.3% +11.0% ➖ noise
95 datafusion:vortex-compact +1.1% -0.7% +1.7% +10.0% ➖ noise
95 datafusion:vortex-file-compressed -4.8% -0.7% -4.2% +10.0% ➖ noise
95 duckdb:duckdb +2.3% -0.7% +3.0% +18.6% ➖ noise
95 duckdb:vortex-compact -2.8% -0.7% -2.2% +17.1% ➖ noise
95 duckdb:vortex-file-compressed -10.3% -0.7% -9.7% +16.5% ➖ noise
96 datafusion:vortex-compact +3.9% -7.4% +12.2% +10.3% 🚨 regression
96 datafusion:vortex-file-compressed -2.0% -7.4% +5.8% +10.8% ➖ noise
96 duckdb:duckdb -8.4% -7.4% -1.1% +14.2% ➖ noise
96 duckdb:vortex-compact -0.1% -7.4% +7.8% +17.3% ➖ noise
96 duckdb:vortex-file-compressed -7.9% -7.4% -0.5% +17.8% ➖ noise
97 datafusion:vortex-compact +0.8% -5.5% +6.7% +10.5% ➖ noise
97 datafusion:vortex-file-compressed -10.7% -5.5% -5.6% +10.1% ➖ noise
97 duckdb:duckdb -7.4% -5.5% -2.0% +10.5% ➖ noise
97 duckdb:vortex-compact -3.3% -5.5% +2.3% +13.7% ➖ noise
97 duckdb:vortex-file-compressed -5.4% -5.5% +0.1% +12.1% ➖ noise
98 datafusion:vortex-compact -2.4% -3.4% +1.1% +10.4% ➖ noise
98 datafusion:vortex-file-compressed -5.3% -3.4% -2.0% +10.1% ➖ noise
98 duckdb:duckdb -3.7% -3.4% -0.3% +15.9% ➖ noise
98 duckdb:vortex-compact -1.3% -3.4% +2.1% +11.1% ➖ noise
98 duckdb:vortex-file-compressed -3.1% -3.4% +0.3% +16.0% ➖ noise
99 datafusion:vortex-compact -5.0% -2.4% -2.7% +10.8% ➖ noise
99 datafusion:vortex-file-compressed -5.2% -2.4% -2.9% +12.4% ➖ noise
99 duckdb:duckdb -4.2% -2.4% -1.9% +10.0% ➖ noise
99 duckdb:vortex-compact +5.6% -2.4% +8.2% +16.8% ➖ noise
99 duckdb:vortex-file-compressed -0.9% -2.4% +1.5% +28.2% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +7.3%
Vortex (geomean): 1.060x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish +3.6%


datafusion / vortex-file-compressed (1.030x ➖, 0↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 487255326 463313489 1.05
tpch_q02/datafusion:vortex-file-compressed 174952327 171092792 1.02
tpch_q03/datafusion:vortex-file-compressed 279297226 272461748 1.03
tpch_q04/datafusion:vortex-file-compressed 116370486 117879237 0.99
tpch_q05/datafusion:vortex-file-compressed 506489371 503083838 1.01
tpch_q06/datafusion:vortex-file-compressed 42617502 42157708 1.01
tpch_q07/datafusion:vortex-file-compressed 731586657 699070307 1.05
tpch_q08/datafusion:vortex-file-compressed 501403513 474951075 1.06
tpch_q09/datafusion:vortex-file-compressed 884875196 837724514 1.06
tpch_q10/datafusion:vortex-file-compressed 328032208 307112185 1.07
tpch_q11/datafusion:vortex-file-compressed 130376314 121725387 1.07
tpch_q12/datafusion:vortex-file-compressed 125134304 134890184 0.93
tpch_q13/datafusion:vortex-file-compressed 248572209 228391570 1.09
tpch_q14/datafusion:vortex-file-compressed 76226093 73070171 1.04
tpch_q15/datafusion:vortex-file-compressed 110159099 113312066 0.97
tpch_q16/datafusion:vortex-file-compressed 96843379 96975909 1.00
tpch_q17/datafusion:vortex-file-compressed 816984451 782458961 1.04
tpch_q18/datafusion:vortex-file-compressed 1070169931 979532950 1.09
tpch_q19/datafusion:vortex-file-compressed 129376731 132357433 0.98
tpch_q20/datafusion:vortex-file-compressed 218365690 210607412 1.04
tpch_q21/datafusion:vortex-file-compressed 851985277 819325425 1.04
tpch_q22/datafusion:vortex-file-compressed 64825511 61663558 1.05
datafusion / vortex-compact (1.020x ➖, 1↑ 3↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 509532913 496824672 1.03
tpch_q02/datafusion:vortex-compact 172034032 172608279 1.00
tpch_q03/datafusion:vortex-compact 292573205 288906821 1.01
tpch_q04/datafusion:vortex-compact 132358196 132770472 1.00
tpch_q05/datafusion:vortex-compact 511109360 498773324 1.02
tpch_q06/datafusion:vortex-compact 68602947 66706155 1.03
tpch_q07/datafusion:vortex-compact 766218786 714406386 1.07
tpch_q08/datafusion:vortex-compact 526662462 512224582 1.03
tpch_q09/datafusion:vortex-compact 904200143 900687791 1.00
tpch_q10/datafusion:vortex-compact 353710109 366307147 0.97
tpch_q11/datafusion:vortex-compact 🚨 137935343 123103395 1.12
tpch_q12/datafusion:vortex-compact 185210637 189897075 0.98
tpch_q13/datafusion:vortex-compact 284289740 283333932 1.00
tpch_q14/datafusion:vortex-compact 98315578 94007944 1.05
tpch_q15/datafusion:vortex-compact 184055196 179095857 1.03
tpch_q16/datafusion:vortex-compact 108688066 103007701 1.06
tpch_q17/datafusion:vortex-compact 🚨 844516962 758715143 1.11
tpch_q18/datafusion:vortex-compact 🚨 1099464944 992139290 1.11
tpch_q19/datafusion:vortex-compact 🚀 182369484 235268462 0.78
tpch_q20/datafusion:vortex-compact 248669039 231569442 1.07
tpch_q21/datafusion:vortex-compact 909467562 846489719 1.07
tpch_q22/datafusion:vortex-compact 73931275 76082121 0.97
datafusion / parquet (0.958x ➖, 7↑ 1↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 481148359 568495003 0.85
tpch_q02/datafusion:parquet 278297735 299047925 0.93
tpch_q03/datafusion:parquet 🚀 419738827 475168989 0.88
tpch_q04/datafusion:parquet 🚀 163259888 184236764 0.89
tpch_q05/datafusion:parquet 🚀 616637553 735844912 0.84
tpch_q06/datafusion:parquet 🚀 133751737 158044830 0.85
tpch_q07/datafusion:parquet 🚀 866559877 985401489 0.88
tpch_q08/datafusion:parquet 🚀 686089965 804190918 0.85
tpch_q09/datafusion:parquet 1048322003 1132886078 0.93
tpch_q10/datafusion:parquet 653810484 627468146 1.04
tpch_q11/datafusion:parquet 208435634 194094832 1.07
tpch_q12/datafusion:parquet 263025903 256848883 1.02
tpch_q13/datafusion:parquet 358063728 378518167 0.95
tpch_q14/datafusion:parquet 204893174 207349893 0.99
tpch_q15/datafusion:parquet 287459148 271563499 1.06
tpch_q16/datafusion:parquet 190369078 191196419 1.00
tpch_q17/datafusion:parquet 925099639 984189428 0.94
tpch_q18/datafusion:parquet 🚨 1173019808 1060055588 1.11
tpch_q19/datafusion:parquet 343568955 341411006 1.01
tpch_q20/datafusion:parquet 402492384 402941640 1.00
tpch_q21/datafusion:parquet 969777989 927995726 1.05
tpch_q22/datafusion:parquet 232998941 223377587 1.04
datafusion / arrow (1.104x ❌, 0↑ 12↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 813303212 729338732 1.12
tpch_q02/datafusion:arrow 210815709 197763558 1.07
tpch_q03/datafusion:arrow 🚨 617083728 546913875 1.13
tpch_q04/datafusion:arrow 🚨 455353599 386933141 1.18
tpch_q05/datafusion:arrow 🚨 1190707039 1039428273 1.15
tpch_q06/datafusion:arrow 🚨 364205708 314510214 1.16
tpch_q07/datafusion:arrow 🚨 1506897925 1339691123 1.12
tpch_q08/datafusion:arrow 🚨 1443992602 1293265948 1.12
tpch_q09/datafusion:arrow 1677783530 1563492655 1.07
tpch_q10/datafusion:arrow 🚨 747444922 663401771 1.13
tpch_q11/datafusion:arrow 193953950 178548644 1.09
tpch_q12/datafusion:arrow 788969255 724853357 1.09
tpch_q13/datafusion:arrow 563400458 531145542 1.06
tpch_q14/datafusion:arrow 🚨 416077264 349598871 1.19
tpch_q15/datafusion:arrow 🚨 900741682 748812364 1.20
tpch_q16/datafusion:arrow 129350475 120373549 1.07
tpch_q17/datafusion:arrow 🚨 1718733293 1550799405 1.11
tpch_q18/datafusion:arrow 2421299497 2208654139 1.10
tpch_q19/datafusion:arrow 630736997 577738925 1.09
tpch_q20/datafusion:arrow 🚨 627277726 552111218 1.14
tpch_q21/datafusion:arrow 4754509380 4684575914 1.01
tpch_q22/datafusion:arrow 206083931 218074845 0.95
duckdb / vortex-file-compressed (1.099x ➖, 0↑ 10↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 232459417 179368938 1.30
tpch_q02/duckdb:vortex-file-compressed 🚨 65143323 56447202 1.15
tpch_q03/duckdb:vortex-file-compressed 🚨 163041256 137291680 1.19
tpch_q04/duckdb:vortex-file-compressed 🚨 180844697 159051568 1.14
tpch_q05/duckdb:vortex-file-compressed 148310859 142305491 1.04
tpch_q06/duckdb:vortex-file-compressed 52106659 55921365 0.93
tpch_q07/duckdb:vortex-file-compressed 🚨 169432482 151269951 1.12
tpch_q08/duckdb:vortex-file-compressed 199513492 184313272 1.08
tpch_q09/duckdb:vortex-file-compressed 362237419 352606460 1.03
tpch_q10/duckdb:vortex-file-compressed 🚨 183022976 165384082 1.11
tpch_q11/duckdb:vortex-file-compressed 40869730 38310532 1.07
tpch_q12/duckdb:vortex-file-compressed 106258969 97192860 1.09
tpch_q13/duckdb:vortex-file-compressed 🚨 285609754 251548428 1.14
tpch_q14/duckdb:vortex-file-compressed 74778172 73491183 1.02
tpch_q15/duckdb:vortex-file-compressed 🚨 118350499 102571520 1.15
tpch_q16/duckdb:vortex-file-compressed 89257688 81944815 1.09
tpch_q17/duckdb:vortex-file-compressed 115158492 106622617 1.08
tpch_q18/duckdb:vortex-file-compressed 311168978 291919161 1.07
tpch_q19/duckdb:vortex-file-compressed 🚨 104818872 91327465 1.15
tpch_q20/duckdb:vortex-file-compressed 184303049 171765029 1.07
tpch_q21/duckdb:vortex-file-compressed 636193776 589873392 1.08
tpch_q22/duckdb:vortex-file-compressed 🚨 92286282 81169772 1.14
duckdb / vortex-compact (1.095x ➖, 0↑ 8↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 275938444 232351119 1.19
tpch_q02/duckdb:vortex-compact 🚨 90121801 61774933 1.46
tpch_q03/duckdb:vortex-compact 🚨 169924220 148561138 1.14
tpch_q04/duckdb:vortex-compact 208025591 189555324 1.10
tpch_q05/duckdb:vortex-compact 🚨 172504208 156003929 1.11
tpch_q06/duckdb:vortex-compact 95394110 88255423 1.08
tpch_q07/duckdb:vortex-compact 227256722 212265799 1.07
tpch_q08/duckdb:vortex-compact 🚨 224818610 201730240 1.11
tpch_q09/duckdb:vortex-compact 398629782 379008458 1.05
tpch_q10/duckdb:vortex-compact 209675837 204294080 1.03
tpch_q11/duckdb:vortex-compact 46907057 42959731 1.09
tpch_q12/duckdb:vortex-compact 226127456 217580572 1.04
tpch_q13/duckdb:vortex-compact 🚨 335112575 299789501 1.12
tpch_q14/duckdb:vortex-compact 111329046 111397853 1.00
tpch_q15/duckdb:vortex-compact 🚨 144099389 126748292 1.14
tpch_q16/duckdb:vortex-compact 97828205 91304675 1.07
tpch_q17/duckdb:vortex-compact 129647107 122533168 1.06
tpch_q18/duckdb:vortex-compact 323627947 311776370 1.04
tpch_q19/duckdb:vortex-compact 123641330 118921005 1.04
tpch_q20/duckdb:vortex-compact 220079037 217588058 1.01
tpch_q21/duckdb:vortex-compact 714893774 670505709 1.07
tpch_q22/duckdb:vortex-compact 🚨 105519570 91313019 1.16
duckdb / parquet (1.022x ➖, 0↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 261676635 263389936 0.99
tpch_q02/duckdb:parquet 109881782 108090357 1.02
tpch_q03/duckdb:parquet 227182278 215560457 1.05
tpch_q04/duckdb:parquet 146981816 135863694 1.08
tpch_q05/duckdb:parquet 234798913 220747462 1.06
tpch_q06/duckdb:parquet 70448716 67196357 1.05
tpch_q07/duckdb:parquet 194491758 180255850 1.08
tpch_q08/duckdb:parquet 274151090 272649179 1.01
tpch_q09/duckdb:parquet 509887658 471838863 1.08
tpch_q10/duckdb:parquet 639206149 621581846 1.03
tpch_q11/duckdb:parquet 43347458 46784733 0.93
tpch_q12/duckdb:parquet 130910595 128690213 1.02
tpch_q13/duckdb:parquet 480468173 455507234 1.05
tpch_q14/duckdb:parquet 176440960 179007925 0.99
tpch_q15/duckdb:parquet 101186041 100131375 1.01
tpch_q16/duckdb:parquet 169071205 164554330 1.03
tpch_q17/duckdb:parquet 179145599 181347490 0.99
tpch_q18/duckdb:parquet 356655944 361066760 0.99
tpch_q19/duckdb:parquet 290250562 286664303 1.01
tpch_q20/duckdb:parquet 235631129 236539722 1.00
tpch_q21/duckdb:parquet 612383225 593660043 1.03
tpch_q22/duckdb:parquet 300466722 298174204 1.01
duckdb / duckdb (1.028x ➖, 0↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 119522630 118161342 1.01
tpch_q02/duckdb:duckdb 49798312 49238517 1.01
tpch_q03/duckdb:duckdb 104185805 100616693 1.04
tpch_q04/duckdb:duckdb 143083244 143036801 1.00
tpch_q05/duckdb:duckdb 118939535 115247989 1.03
tpch_q06/duckdb:duckdb 40254400 38798369 1.04
tpch_q07/duckdb:duckdb 90324062 90900398 0.99
tpch_q08/duckdb:duckdb 118595640 117494293 1.01
tpch_q09/duckdb:duckdb 288519906 285165108 1.01
tpch_q10/duckdb:duckdb 225310417 205961820 1.09
tpch_q11/duckdb:duckdb 17548582 15954914 1.10
tpch_q12/duckdb:duckdb 87968927 86627038 1.02
tpch_q13/duckdb:duckdb 271114317 261814011 1.04
tpch_q14/duckdb:duckdb 73033519 74824654 0.98
tpch_q15/duckdb:duckdb 81758241 79746915 1.03
tpch_q16/duckdb:duckdb 80875259 76565745 1.06
tpch_q17/duckdb:duckdb 87430834 86053974 1.02
tpch_q18/duckdb:duckdb 228741657 220110859 1.04
tpch_q19/duckdb:duckdb 120749567 115885613 1.04
tpch_q20/duckdb:duckdb 114142301 112299414 1.02
tpch_q21/duckdb:duckdb 327986609 313896030 1.04
tpch_q22/duckdb:duckdb 74102931 72121456 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +11.5% -8.3% +21.6% +11.2% 🚨 regression
1 datafusion:vortex-compact +2.6% -8.3% +11.8% +13.1% ➖ noise
1 datafusion:vortex-file-compressed +5.2% -8.3% +14.7% +11.7% 🚨 regression
1 duckdb:duckdb +1.2% -8.3% +10.3% +12.7% ➖ noise
1 duckdb:vortex-compact +18.8% -8.3% +29.5% +10.8% 🚨 regression
1 duckdb:vortex-file-compressed +29.6% -8.3% +41.3% +10.8% 🚨 regression
2 datafusion:arrow +6.6% -2.7% +9.6% +10.1% ➖ noise
2 datafusion:vortex-compact -0.3% -2.7% +2.5% +10.1% ➖ noise
2 datafusion:vortex-file-compressed +2.3% -2.7% +5.1% +10.1% ➖ noise
2 duckdb:duckdb +1.1% -2.7% +4.0% +10.1% ➖ noise
2 duckdb:vortex-compact +45.9% -2.7% +50.0% +10.1% 🚨 regression
2 duckdb:vortex-file-compressed +15.4% -2.7% +18.7% +10.1% 🚨 regression
3 datafusion:arrow +12.8% -3.5% +16.9% +10.1% 🚨 regression
3 datafusion:vortex-compact +1.3% -3.5% +5.0% +10.1% ➖ noise
3 datafusion:vortex-file-compressed +2.5% -3.5% +6.2% +10.1% ➖ noise
3 duckdb:duckdb +3.5% -3.5% +7.3% +10.1% ➖ noise
3 duckdb:vortex-compact +14.4% -3.5% +18.5% +10.1% 🚨 regression
3 duckdb:vortex-file-compressed +18.8% -3.5% +23.1% +10.1% 🚨 regression
4 datafusion:arrow +17.7% -2.1% +20.2% +10.1% 🚨 regression
4 datafusion:vortex-compact -0.3% -2.1% +1.8% +10.1% ➖ noise
4 datafusion:vortex-file-compressed -1.3% -2.1% +0.8% +10.1% ➖ noise
4 duckdb:duckdb +0.0% -2.1% +2.2% +10.1% ➖ noise
4 duckdb:vortex-compact +9.7% -2.1% +12.1% +10.1% 🚨 regression
4 duckdb:vortex-file-compressed +13.7% -2.1% +16.1% +10.1% 🚨 regression
5 datafusion:arrow +14.6% -5.6% +21.3% +10.1% 🚨 regression
5 datafusion:vortex-compact +2.5% -5.6% +8.5% +10.1% ➖ noise
5 datafusion:vortex-file-compressed +0.7% -5.6% +6.6% +10.1% ➖ noise
5 duckdb:duckdb +3.2% -5.6% +9.3% +10.1% ➖ noise
5 duckdb:vortex-compact +10.6% -5.6% +17.1% +10.1% 🚨 regression
5 duckdb:vortex-file-compressed +4.2% -5.6% +10.4% +10.1% 🚨 regression
6 datafusion:arrow +15.8% -5.8% +22.9% +15.0% 🚨 regression
6 datafusion:vortex-compact +2.8% -5.8% +9.2% +15.0% ➖ noise
6 datafusion:vortex-file-compressed +1.1% -5.8% +7.3% +15.6% ➖ noise
6 duckdb:duckdb +3.8% -5.8% +10.1% +22.3% ➖ noise
6 duckdb:vortex-compact +8.1% -5.8% +14.8% +15.4% ➖ noise
6 duckdb:vortex-file-compressed -6.8% -5.8% -1.1% +17.0% ➖ noise
7 datafusion:arrow +12.5% -2.6% +15.5% +10.1% 🚨 regression
7 datafusion:vortex-compact +7.3% -2.6% +10.1% +10.1% ➖ noise
7 datafusion:vortex-file-compressed +4.7% -2.6% +7.4% +10.1% ➖ noise
7 duckdb:duckdb -0.6% -2.6% +2.0% +10.1% ➖ noise
7 duckdb:vortex-compact +7.1% -2.6% +9.9% +10.1% ➖ noise
7 duckdb:vortex-file-compressed +12.0% -2.6% +15.0% +10.1% 🚨 regression
8 datafusion:arrow +11.7% -7.4% +20.6% +10.1% 🚨 regression
8 datafusion:vortex-compact +2.8% -7.4% +11.0% +10.1% 🚨 regression
8 datafusion:vortex-file-compressed +5.6% -7.4% +14.0% +10.1% 🚨 regression
8 duckdb:duckdb +0.9% -7.4% +9.0% +10.1% ➖ noise
8 duckdb:vortex-compact +11.4% -7.4% +20.3% +10.1% 🚨 regression
8 duckdb:vortex-file-compressed +8.2% -7.4% +16.9% +10.1% 🚨 regression
9 datafusion:arrow +7.3% -0.0% +7.3% +10.1% ➖ noise
9 datafusion:vortex-compact +0.4% -0.0% +0.4% +10.1% ➖ noise
9 datafusion:vortex-file-compressed +5.6% -0.0% +5.6% +10.1% ➖ noise
9 duckdb:duckdb +1.2% -0.0% +1.2% +10.1% ➖ noise
9 duckdb:vortex-compact +5.2% -0.0% +5.2% +10.1% ➖ noise
9 duckdb:vortex-file-compressed +2.7% -0.0% +2.7% +10.1% ➖ noise
10 datafusion:arrow +12.7% +3.5% +8.8% +10.1% ➖ noise
10 datafusion:vortex-compact -3.4% +3.5% -6.7% +10.1% ➖ noise
10 datafusion:vortex-file-compressed +6.8% +3.5% +3.2% +10.1% ➖ noise
10 duckdb:duckdb +9.4% +3.5% +5.7% +10.1% ➖ noise
10 duckdb:vortex-compact +2.6% +3.5% -0.9% +10.1% ➖ noise
10 duckdb:vortex-file-compressed +10.7% +3.5% +6.9% +10.8% ➖ noise
11 datafusion:arrow +8.6% -0.3% +8.9% +10.1% ➖ noise
11 datafusion:vortex-compact +12.0% -0.3% +12.3% +10.1% 🚨 regression
11 datafusion:vortex-file-compressed +7.1% -0.3% +7.4% +10.1% ➖ noise
11 duckdb:duckdb +10.0% -0.3% +10.3% +15.5% ➖ noise
11 duckdb:vortex-compact +9.2% -0.3% +9.5% +10.6% ➖ noise
11 duckdb:vortex-file-compressed +6.7% -0.3% +6.9% +13.0% ➖ noise
12 datafusion:arrow +8.8% +2.1% +6.6% +33.1% ➖ noise
12 datafusion:vortex-compact -2.5% +2.1% -4.4% +10.1% ➖ noise
12 datafusion:vortex-file-compressed -7.2% +2.1% -9.1% +10.1% ➖ noise
12 duckdb:duckdb +1.5% +2.1% -0.5% +10.1% ➖ noise
12 duckdb:vortex-compact +3.9% +2.1% +1.8% +10.1% ➖ noise
12 duckdb:vortex-file-compressed +9.3% +2.1% +7.1% +10.1% ➖ noise
13 datafusion:arrow +6.1% -0.1% +6.2% +10.1% ➖ noise
13 datafusion:vortex-compact +0.3% -0.1% +0.4% +10.1% ➖ noise
13 datafusion:vortex-file-compressed +8.8% -0.1% +9.0% +11.9% ➖ noise
13 duckdb:duckdb +3.6% -0.1% +3.7% +10.1% ➖ noise
13 duckdb:vortex-compact +11.8% -0.1% +11.9% +10.1% 🚨 regression
13 duckdb:vortex-file-compressed +13.5% -0.1% +13.7% +10.1% 🚨 regression
14 datafusion:arrow +19.0% -1.3% +20.6% +10.1% 🚨 regression
14 datafusion:vortex-compact +4.6% -1.3% +6.0% +10.1% ➖ noise
14 datafusion:vortex-file-compressed +4.3% -1.3% +5.7% +10.1% ➖ noise
14 duckdb:duckdb -2.4% -1.3% -1.1% +11.4% ➖ noise
14 duckdb:vortex-compact -0.1% -1.3% +1.3% +10.1% ➖ noise
14 duckdb:vortex-file-compressed +1.8% -1.3% +3.1% +11.4% ➖ noise
15 datafusion:arrow +20.3% +3.4% +16.3% +10.1% 🚨 regression
15 datafusion:vortex-compact +2.8% +3.4% -0.6% +10.1% ➖ noise
15 datafusion:vortex-file-compressed -2.8% +3.4% -6.0% +10.1% ➖ noise
15 duckdb:duckdb +2.5% +3.4% -0.9% +10.1% ➖ noise
15 duckdb:vortex-compact +13.7% +3.4% +9.9% +10.1% ➖ noise
15 duckdb:vortex-file-compressed +15.4% +3.4% +11.6% +10.1% 🚨 regression
16 datafusion:arrow +7.5% +1.1% +6.2% +10.1% ➖ noise
16 datafusion:vortex-compact +5.5% +1.1% +4.3% +10.1% ➖ noise
16 datafusion:vortex-file-compressed -0.1% +1.1% -1.3% +10.1% ➖ noise
16 duckdb:duckdb +5.6% +1.1% +4.4% +10.1% ➖ noise
16 duckdb:vortex-compact +7.1% +1.1% +5.9% +10.1% ➖ noise
16 duckdb:vortex-file-compressed +8.9% +1.1% +7.7% +10.1% ➖ noise
17 datafusion:arrow +10.8% -3.6% +15.0% +10.1% 🚨 regression
17 datafusion:vortex-compact +11.3% -3.6% +15.5% +10.1% 🚨 regression
17 datafusion:vortex-file-compressed +4.4% -3.6% +8.4% +11.6% ➖ noise
17 duckdb:duckdb +1.6% -3.6% +5.4% +10.1% ➖ noise
17 duckdb:vortex-compact +5.8% -3.6% +9.8% +10.1% ➖ noise
17 duckdb:vortex-file-compressed +8.0% -3.6% +12.1% +11.1% 🚨 regression
18 datafusion:arrow +9.6% +4.5% +4.9% +13.7% ➖ noise
18 datafusion:vortex-compact +10.8% +4.5% +6.0% +10.1% ➖ noise
18 datafusion:vortex-file-compressed +9.3% +4.5% +4.5% +18.9% ➖ noise
18 duckdb:duckdb +3.9% +4.5% -0.6% +10.1% ➖ noise
18 duckdb:vortex-compact +3.8% +4.5% -0.7% +10.1% ➖ noise
18 duckdb:vortex-file-compressed +6.6% +4.5% +2.0% +39.5% ➖ noise
19 datafusion:arrow +9.2% +0.9% +8.2% +10.1% ➖ noise
19 datafusion:vortex-compact -22.5% +0.9% -23.2% +10.1% ✅ faster
19 datafusion:vortex-file-compressed -2.3% +0.9% -3.2% +10.1% ➖ noise
19 duckdb:duckdb +4.2% +0.9% +3.2% +10.1% ➖ noise
19 duckdb:vortex-compact +4.0% +0.9% +3.0% +10.1% ➖ noise
19 duckdb:vortex-file-compressed +14.8% +0.9% +13.7% +10.1% 🚨 regression
20 datafusion:arrow +13.6% -0.2% +13.9% +10.1% 🚨 regression
20 datafusion:vortex-compact +7.4% -0.2% +7.7% +10.1% ➖ noise
20 datafusion:vortex-file-compressed +3.7% -0.2% +3.9% +10.1% ➖ noise
20 duckdb:duckdb +1.6% -0.2% +1.9% +10.1% ➖ noise
20 duckdb:vortex-compact +1.1% -0.2% +1.4% +10.1% ➖ noise
20 duckdb:vortex-file-compressed +7.3% -0.2% +7.6% +10.1% ➖ noise
21 datafusion:arrow +1.5% +3.8% -2.2% +14.7% ➖ noise
21 datafusion:vortex-compact +7.4% +3.8% +3.5% +10.1% ➖ noise
21 datafusion:vortex-file-compressed +4.0% +3.8% +0.2% +10.1% ➖ noise
21 duckdb:duckdb +4.5% +3.8% +0.6% +10.1% ➖ noise
21 duckdb:vortex-compact +6.6% +3.8% +2.7% +10.1% ➖ noise
21 duckdb:vortex-file-compressed +7.9% +3.8% +3.9% +10.1% ➖ noise
22 datafusion:arrow -5.5% +2.5% -7.8% +11.7% ➖ noise
22 datafusion:vortex-compact -2.8% +2.5% -5.2% +10.1% ➖ noise
22 datafusion:vortex-file-compressed +5.1% +2.5% +2.5% +10.1% ➖ noise
22 duckdb:duckdb +2.7% +2.5% +0.2% +14.2% ➖ noise
22 duckdb:vortex-compact +15.6% +2.5% +12.7% +10.1% 🚨 regression
22 duckdb:vortex-file-compressed +13.7% +2.5% +10.9% +10.1% 🚨 regression

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.2%
Vortex (geomean): 0.914x ➖
Parquet (geomean): 0.943x ➖
Shifts: Parquet (control) -5.7% · Median polish -6.0%


datafusion / vortex-file-compressed (0.944x ➖, 8↑ 1↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1702930 1795217 0.95
clickbench_q01/datafusion:vortex-file-compressed 14669853 15872939 0.92
clickbench_q02/datafusion:vortex-file-compressed 34551105 37305041 0.93
clickbench_q03/datafusion:vortex-file-compressed 38122111 40217391 0.95
clickbench_q04/datafusion:vortex-file-compressed 327408647 351712532 0.93
clickbench_q05/datafusion:vortex-file-compressed 🚀 324912297 367323347 0.88
clickbench_q06/datafusion:vortex-file-compressed 1691311 1824814 0.93
clickbench_q07/datafusion:vortex-file-compressed 19614801 19193083 1.02
clickbench_q08/datafusion:vortex-file-compressed 403909175 430739959 0.94
clickbench_q09/datafusion:vortex-file-compressed 🚀 571842007 648218332 0.88
clickbench_q10/datafusion:vortex-file-compressed 75417455 78565369 0.96
clickbench_q11/datafusion:vortex-file-compressed 85764465 89783194 0.96
clickbench_q12/datafusion:vortex-file-compressed 285491909 314433705 0.91
clickbench_q13/datafusion:vortex-file-compressed 420697212 464510257 0.91
clickbench_q14/datafusion:vortex-file-compressed 263391792 283140551 0.93
clickbench_q15/datafusion:vortex-file-compressed 379985227 420073530 0.90
clickbench_q16/datafusion:vortex-file-compressed 742410894 817727349 0.91
clickbench_q17/datafusion:vortex-file-compressed 🚀 730625681 812340041 0.90
clickbench_q18/datafusion:vortex-file-compressed 1454173926 1593794697 0.91
clickbench_q19/datafusion:vortex-file-compressed 22449959 24629445 0.91
clickbench_q20/datafusion:vortex-file-compressed 356831416 375377537 0.95
clickbench_q21/datafusion:vortex-file-compressed 🚀 402186909 449085261 0.90
clickbench_q22/datafusion:vortex-file-compressed 🚀 512138719 617442610 0.83
clickbench_q23/datafusion:vortex-file-compressed 645272728 676109336 0.95
clickbench_q24/datafusion:vortex-file-compressed 50026220 52853627 0.95
clickbench_q25/datafusion:vortex-file-compressed 🚀 68713935 82232701 0.84
clickbench_q26/datafusion:vortex-file-compressed 47303764 51552498 0.92
clickbench_q27/datafusion:vortex-file-compressed 785065755 831125510 0.94
clickbench_q28/datafusion:vortex-file-compressed 6863506047 7003065389 0.98
clickbench_q29/datafusion:vortex-file-compressed 231356143 254599835 0.91
clickbench_q30/datafusion:vortex-file-compressed 254340225 279189381 0.91
clickbench_q31/datafusion:vortex-file-compressed 🚀 291010342 335531095 0.87
clickbench_q32/datafusion:vortex-file-compressed 1421150398 1448347227 0.98
clickbench_q33/datafusion:vortex-file-compressed 1533232565 1612444432 0.95
clickbench_q34/datafusion:vortex-file-compressed 1514853569 1609406497 0.94
clickbench_q35/datafusion:vortex-file-compressed 🚀 531489681 594261063 0.89
clickbench_q36/datafusion:vortex-file-compressed 89526630 83347609 1.07
clickbench_q37/datafusion:vortex-file-compressed 39254982 40520276 0.97
clickbench_q38/datafusion:vortex-file-compressed 🚨 43671001 26515722 1.65
clickbench_q39/datafusion:vortex-file-compressed 167215563 165611992 1.01
clickbench_q40/datafusion:vortex-file-compressed 21821549 21376216 1.02
clickbench_q41/datafusion:vortex-file-compressed 20643078 21020124 0.98
clickbench_q42/datafusion:vortex-file-compressed 21224550 23505538 0.90
datafusion / parquet (0.937x ➖, 5↑ 1↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1768597 1820142 0.97
clickbench_q01/datafusion:parquet 20873101 21450791 0.97
clickbench_q02/datafusion:parquet 48660609 52303511 0.93
clickbench_q03/datafusion:parquet 42661811 44216689 0.96
clickbench_q04/datafusion:parquet 352226515 380010832 0.93
clickbench_q05/datafusion:parquet 395213421 409627918 0.96
clickbench_q06/datafusion:parquet 🚀 1549851 1876962 0.83
clickbench_q07/datafusion:parquet 🚨 29222445 26468138 1.10
clickbench_q08/datafusion:parquet 432329882 460690753 0.94
clickbench_q09/datafusion:parquet 🚀 659721656 737237202 0.89
clickbench_q10/datafusion:parquet 🚀 117529588 136429625 0.86
clickbench_q11/datafusion:parquet 🚀 147219840 164549364 0.89
clickbench_q12/datafusion:parquet 379279982 407773436 0.93
clickbench_q13/datafusion:parquet 524472943 571946220 0.92
clickbench_q14/datafusion:parquet 373536149 404932787 0.92
clickbench_q15/datafusion:parquet 403072174 443339602 0.91
clickbench_q16/datafusion:parquet 759639194 810919712 0.94
clickbench_q17/datafusion:parquet 749936096 826845866 0.91
clickbench_q18/datafusion:parquet 1526685703 1676778873 0.91
clickbench_q19/datafusion:parquet 34848011 36263178 0.96
clickbench_q20/datafusion:parquet 623797830 674520019 0.92
clickbench_q21/datafusion:parquet 702923149 733382971 0.96
clickbench_q22/datafusion:parquet 1011189758 1090146753 0.93
clickbench_q23/datafusion:parquet 3863845746 4154504517 0.93
clickbench_q24/datafusion:parquet 95890989 96749928 0.99
clickbench_q25/datafusion:parquet 150450714 159511827 0.94
clickbench_q26/datafusion:parquet 98387110 101226308 0.97
clickbench_q27/datafusion:parquet 1082276315 1151612628 0.94
clickbench_q28/datafusion:parquet 6646367875 7112341526 0.93
clickbench_q29/datafusion:parquet 240911358 255620027 0.94
clickbench_q30/datafusion:parquet 379623806 419399886 0.91
clickbench_q31/datafusion:parquet 422465136 454140364 0.93
clickbench_q32/datafusion:parquet 1284270993 1411929198 0.91
clickbench_q33/datafusion:parquet 1567836906 1699842226 0.92
clickbench_q34/datafusion:parquet 1591131139 1715872867 0.93
clickbench_q35/datafusion:parquet 563495211 610307889 0.92
clickbench_q36/datafusion:parquet 151484505 163286196 0.93
clickbench_q37/datafusion:parquet 63223514 63598980 0.99
clickbench_q38/datafusion:parquet 96948810 94112300 1.03
clickbench_q39/datafusion:parquet 289221299 309703415 0.93
clickbench_q40/datafusion:parquet 🚀 33756069 39195796 0.86
clickbench_q41/datafusion:parquet 34346641 33188068 1.03
clickbench_q42/datafusion:parquet 32622076 34584008 0.94
duckdb / vortex-file-compressed (0.884x ✅, 21↑ 2↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 6011927 6707557 0.90
clickbench_q01/duckdb:vortex-file-compressed 14313043 14558981 0.98
clickbench_q02/duckdb:vortex-file-compressed 24726150 24899902 0.99
clickbench_q03/duckdb:vortex-file-compressed 31812423 32885434 0.97
clickbench_q04/duckdb:vortex-file-compressed 173493637 183755529 0.94
clickbench_q05/duckdb:vortex-file-compressed 202592356 216772085 0.93
clickbench_q06/duckdb:vortex-file-compressed 21079479 20946943 1.01
clickbench_q07/duckdb:vortex-file-compressed 16268081 17530158 0.93
clickbench_q08/duckdb:vortex-file-compressed 275754388 281281707 0.98
clickbench_q09/duckdb:vortex-file-compressed 383660635 403347786 0.95
clickbench_q10/duckdb:vortex-file-compressed 🚀 66301081 79028354 0.84
clickbench_q11/duckdb:vortex-file-compressed 🚀 76018627 89190702 0.85
clickbench_q12/duckdb:vortex-file-compressed 216986853 230222246 0.94
clickbench_q13/duckdb:vortex-file-compressed 🚀 420292358 475957442 0.88
clickbench_q14/duckdb:vortex-file-compressed 246999541 259575147 0.95
clickbench_q15/duckdb:vortex-file-compressed 213873972 232766741 0.92
clickbench_q16/duckdb:vortex-file-compressed 🚀 640254212 830485850 0.77
clickbench_q17/duckdb:vortex-file-compressed 🚀 530246747 603790021 0.88
clickbench_q18/duckdb:vortex-file-compressed 1185673988 1315568638 0.90
clickbench_q19/duckdb:vortex-file-compressed 🚀 2000678 24831655 0.81
clickbench_q20/duckdb:vortex-file-compressed 🚀 377893818 426122080 0.89
clickbench_q21/duckdb:vortex-file-compressed 406662055 447996336 0.91
clickbench_q22/duckdb:vortex-file-compressed 🚀 557652487 806828400 0.69
clickbench_q23/duckdb:vortex-file-compressed 🚀 579271418 1954386391 0.30
clickbench_q24/duckdb:vortex-file-compressed 🚀 39124046 55792166 0.70
clickbench_q25/duckdb:vortex-file-compressed 🚀 68247421 82835401 0.82
clickbench_q26/duckdb:vortex-file-compressed 🚀 40962756 45564041 0.90
clickbench_q27/duckdb:vortex-file-compressed 🚀 525021298 595225063 0.88
clickbench_q28/duckdb:vortex-file-compressed 2967154950 3220611175 0.92
clickbench_q29/duckdb:vortex-file-compressed 27809760 29797557 0.93
clickbench_q30/duckdb:vortex-file-compressed 193100991 212329625 0.91
clickbench_q31/duckdb:vortex-file-compressed 275554908 296937468 0.93
clickbench_q32/duckdb:vortex-file-compressed 🚀 1258068119 1469422344 0.86
clickbench_q33/duckdb:vortex-file-compressed 🚀 1458471185 1718382102 0.85
clickbench_q34/duckdb:vortex-file-compressed 🚀 1544372661 1772160132 0.87
clickbench_q35/duckdb:vortex-file-compressed 368221757 396036728 0.93
clickbench_q36/duckdb:vortex-file-compressed 🚀 29579804 32961955 0.90
clickbench_q37/duckdb:vortex-file-compressed 🚀 21371332 23847217 0.90
clickbench_q38/duckdb:vortex-file-compressed 🚨 29098766 26201493 1.11
clickbench_q39/duckdb:vortex-file-compressed 🚨 79500683 50571780 1.57
clickbench_q40/duckdb:vortex-file-compressed 🚀 21560964 26100236 0.83
clickbench_q41/duckdb:vortex-file-compressed 🚀 21275321 24665994 0.86
clickbench_q42/duckdb:vortex-file-compressed 23219547 24811554 0.94
duckdb / parquet (0.949x ➖, 1↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚀 219447390 249127874 0.88
clickbench_q01/duckdb:parquet 50605051 52034439 0.97
clickbench_q02/duckdb:parquet 66058846 68433436 0.97
clickbench_q03/duckdb:parquet 64241228 67251699 0.96
clickbench_q04/duckdb:parquet 205978599 226104784 0.91
clickbench_q05/duckdb:parquet 284501586 303780207 0.94
clickbench_q06/duckdb:parquet 60538733 63806667 0.95
clickbench_q07/duckdb:parquet 53615644 54500372 0.98
clickbench_q08/duckdb:parquet 268212668 292505737 0.92
clickbench_q09/duckdb:parquet 401445539 429215645 0.94
clickbench_q10/duckdb:parquet 94624367 102150407 0.93
clickbench_q11/duckdb:parquet 107245238 114650229 0.94
clickbench_q12/duckdb:parquet 299517921 316221754 0.95
clickbench_q13/duckdb:parquet 516527599 563707781 0.92
clickbench_q14/duckdb:parquet 327927071 357661900 0.92
clickbench_q15/duckdb:parquet 241541739 265819407 0.91
clickbench_q16/duckdb:parquet 614750575 677570649 0.91
clickbench_q17/duckdb:parquet 512867590 548643531 0.93
clickbench_q18/duckdb:parquet 1067124056 1142017683 0.93
clickbench_q19/duckdb:parquet 49246243 52002028 0.95
clickbench_q20/duckdb:parquet 438034058 462046423 0.95
clickbench_q21/duckdb:parquet 557129166 591065659 0.94
clickbench_q22/duckdb:parquet 938500013 990928802 0.95
clickbench_q23/duckdb:parquet 315460365 322425706 0.98
clickbench_q24/duckdb:parquet 77881560 81564128 0.95
clickbench_q25/duckdb:parquet 141204653 144837302 0.97
clickbench_q26/duckdb:parquet 52235927 55175617 0.95
clickbench_q27/duckdb:parquet 642644025 687664998 0.93
clickbench_q28/duckdb:parquet 4850859833 5147677899 0.94
clickbench_q29/duckdb:parquet 62090685 63486951 0.98
clickbench_q30/duckdb:parquet 307554703 326006220 0.94
clickbench_q31/duckdb:parquet 349106782 382803441 0.91
clickbench_q32/duckdb:parquet 1262106229 1246723352 1.01
clickbench_q33/duckdb:parquet 1394893206 1349084793 1.03
clickbench_q34/duckdb:parquet 1377037787 1436051591 0.96
clickbench_q35/duckdb:parquet 354702466 372773583 0.95
clickbench_q36/duckdb:parquet 65160771 65546301 0.99
clickbench_q37/duckdb:parquet 53186309 55411600 0.96
clickbench_q38/duckdb:parquet 59479123 60344554 0.99
clickbench_q39/duckdb:parquet 99471983 108049168 0.92
clickbench_q40/duckdb:parquet 55798019 57999565 0.96
clickbench_q41/duckdb:parquet 58700237 61698807 0.95
clickbench_q42/duckdb:parquet 53073209 52068563 1.02
duckdb / duckdb (0.970x ➖, 5↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 19219735 18334427 1.05
clickbench_q01/duckdb:duckdb 35338227 35158278 1.01
clickbench_q02/duckdb:duckdb 47706735 46263998 1.03
clickbench_q03/duckdb:duckdb 49452348 49034114 1.01
clickbench_q04/duckdb:duckdb 215095359 236149302 0.91
clickbench_q05/duckdb:duckdb 325673289 351311267 0.93
clickbench_q06/duckdb:duckdb 37684039 36474196 1.03
clickbench_q07/duckdb:duckdb 38411095 36517807 1.05
clickbench_q08/duckdb:duckdb 302950407 334438970 0.91
clickbench_q09/duckdb:duckdb 473864272 510123942 0.93
clickbench_q10/duckdb:duckdb 99877183 102029016 0.98
clickbench_q11/duckdb:duckdb 109264278 114800282 0.95
clickbench_q12/duckdb:duckdb 🚀 288578452 338172433 0.85
clickbench_q13/duckdb:duckdb 🚀 521732151 620970013 0.84
clickbench_q14/duckdb:duckdb 🚀 345027938 388336530 0.89
clickbench_q15/duckdb:duckdb 265534283 279742420 0.95
clickbench_q16/duckdb:duckdb 683477145 728207150 0.94
clickbench_q17/duckdb:duckdb 568860662 629760949 0.90
clickbench_q18/duckdb:duckdb 1250555123 1379789725 0.91
clickbench_q19/duckdb:duckdb 37127870 35828377 1.04
clickbench_q20/duckdb:duckdb 🚀 937826860 1085465043 0.86
clickbench_q21/duckdb:duckdb 🚀 945266519 1133963152 0.83
clickbench_q22/duckdb:duckdb 1065645703 1171109824 0.91
clickbench_q23/duckdb:duckdb 252417127 268915777 0.94
clickbench_q24/duckdb:duckdb 63199881 61997361 1.02
clickbench_q25/duckdb:duckdb 125331339 128149888 0.98
clickbench_q26/duckdb:duckdb 57576534 59362119 0.97
clickbench_q27/duckdb:duckdb 1045737380 1071880307 0.98
clickbench_q28/duckdb:duckdb 4640916760 4856103275 0.96
clickbench_q29/duckdb:duckdb 51092200 49123544 1.04
clickbench_q30/duckdb:duckdb 284456696 306557407 0.93
clickbench_q31/duckdb:duckdb 420535832 436635404 0.96
clickbench_q32/duckdb:duckdb 1517116423 1428386557 1.06
clickbench_q33/duckdb:duckdb 1987325303 1990209037 1.00
clickbench_q34/duckdb:duckdb 2136734306 2065204046 1.03
clickbench_q35/duckdb:duckdb 264339937 282219661 0.94
clickbench_q36/duckdb:duckdb 44032257 42179494 1.04
clickbench_q37/duckdb:duckdb 33691901 31690256 1.06
clickbench_q38/duckdb:duckdb 32074930 31275203 1.03
clickbench_q39/duckdb:duckdb 67767856 63041353 1.07
clickbench_q40/duckdb:duckdb 33489549 32272943 1.04
clickbench_q41/duckdb:duckdb 31433526 31218043 1.01
clickbench_q42/duckdb:duckdb 33604377 31991625 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -5.1% -7.5% +2.5% +692.4% ➖ noise
0 duckdb:duckdb +4.8% -7.5% +13.3% +301.2% ➖ noise
0 duckdb:vortex-file-compressed -10.4% -7.5% -3.1% +346.5% ➖ noise
1 datafusion:vortex-file-compressed -7.6% -2.7% -5.0% +31.3% ➖ noise
1 duckdb:duckdb +0.5% -2.7% +3.3% +69.6% ➖ noise
1 duckdb:vortex-file-compressed -1.7% -2.7% +1.1% +19.1% ➖ noise
2 datafusion:vortex-file-compressed -7.4% -5.2% -2.3% +32.1% ➖ noise
2 duckdb:duckdb +3.1% -5.2% +8.8% +24.4% ➖ noise
2 duckdb:vortex-file-compressed -0.7% -5.2% +4.8% +15.5% ➖ noise
3 datafusion:vortex-file-compressed -5.2% -4.0% -1.3% +159.3% ➖ noise
3 duckdb:duckdb +0.9% -4.0% +5.1% +61.5% ➖ noise
3 duckdb:vortex-file-compressed -3.3% -4.0% +0.8% +33.9% ➖ noise
4 datafusion:vortex-file-compressed -6.9% -8.1% +1.3% +10.0% ➖ noise
4 duckdb:duckdb -8.9% -8.1% -0.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -5.6% -8.1% +2.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -11.5% -4.9% -6.9% +10.0% ➖ noise
5 duckdb:duckdb -7.3% -4.9% -2.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -6.5% -4.9% -1.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -7.3% -11.5% +4.7% +45.8% ➖ noise
6 duckdb:duckdb +3.3% -11.5% +16.7% +29.5% ➖ noise
6 duckdb:vortex-file-compressed +0.6% -11.5% +13.7% +20.0% ➖ noise
7 datafusion:vortex-file-compressed +2.2% +4.2% -1.9% +18.2% ➖ noise
7 duckdb:duckdb +5.2% +4.2% +0.9% +12.5% ➖ noise
7 duckdb:vortex-file-compressed -7.2% +4.2% -11.0% +10.0% ✅ faster
8 datafusion:vortex-file-compressed -6.2% -7.2% +1.1% +10.0% ➖ noise
8 duckdb:duckdb -9.4% -7.2% -2.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.0% -7.2% +5.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -11.8% -8.5% -3.6% +10.0% ➖ noise
9 duckdb:duckdb -7.1% -8.5% +1.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -4.9% -8.5% +4.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -4.0% -10.7% +7.5% +10.0% ➖ noise
10 duckdb:duckdb -2.1% -10.7% +9.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -16.1% -10.7% -6.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -4.5% -8.5% +4.4% +10.0% ➖ noise
11 duckdb:duckdb -4.8% -8.5% +4.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -14.8% -8.5% -6.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -9.2% -6.1% -3.3% +10.0% ➖ noise
12 duckdb:duckdb -14.7% -6.1% -9.1% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -5.7% -6.1% +0.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -9.4% -8.3% -1.2% +10.0% ➖ noise
13 duckdb:duckdb -16.0% -8.3% -8.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -11.7% -8.3% -3.7% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -7.0% -8.0% +1.2% +10.0% ➖ noise
14 duckdb:duckdb -11.2% -8.0% -3.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -4.8% -8.0% +3.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -9.5% -9.1% -0.5% +10.0% ➖ noise
15 duckdb:duckdb -5.1% -9.1% +4.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -8.1% -9.1% +1.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -9.2% -7.8% -1.5% +10.0% ➖ noise
16 duckdb:duckdb -6.1% -7.8% +1.8% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -22.9% -7.8% -16.4% +11.0% ✅ faster
17 datafusion:vortex-file-compressed -10.1% -7.9% -2.3% +10.0% ➖ noise
17 duckdb:duckdb -9.7% -7.9% -1.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -12.2% -7.9% -4.6% +13.4% ➖ noise
18 datafusion:vortex-file-compressed -8.8% -7.8% -1.1% +10.2% ➖ noise
18 duckdb:duckdb -9.4% -7.8% -1.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -9.9% -7.8% -2.3% +12.0% ➖ noise
19 datafusion:vortex-file-compressed -8.8% -4.6% -4.5% +16.8% ➖ noise
19 duckdb:duckdb +3.6% -4.6% +8.6% +11.0% ➖ noise
19 duckdb:vortex-file-compressed -19.4% -4.6% -15.5% +27.9% ➖ noise
20 datafusion:vortex-file-compressed -4.9% -6.4% +1.5% +179.0% ➖ noise
20 duckdb:duckdb -13.6% -6.4% -7.7% +27.7% ➖ noise
20 duckdb:vortex-file-compressed -11.3% -6.4% -5.3% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -10.4% -5.0% -5.8% +10.0% ➖ noise
21 duckdb:duckdb -16.6% -5.0% -12.3% +10.0% ✅ faster
21 duckdb:vortex-file-compressed -9.2% -5.0% -4.5% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -17.1% -6.3% -11.5% +10.0% ✅ faster
22 duckdb:duckdb -9.0% -6.3% -2.9% +12.1% ➖ noise
22 duckdb:vortex-file-compressed -30.9% -6.3% -26.3% +10.0% ✅ faster
23 datafusion:vortex-file-compressed -4.6% -4.6% +0.1% +59.6% ➖ noise
23 duckdb:duckdb -6.1% -4.6% -1.6% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -70.4% -4.6% -68.9% +20.6% ✅ faster
24 datafusion:vortex-file-compressed -5.3% -2.7% -2.7% +10.0% ➖ noise
24 duckdb:duckdb +1.9% -2.7% +4.8% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -29.9% -2.7% -27.9% +15.2% ✅ faster
25 datafusion:vortex-file-compressed -16.4% -4.1% -12.9% +13.8% ✅ faster
25 duckdb:duckdb -2.2% -4.1% +2.0% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -17.6% -4.1% -14.1% +11.1% ✅ faster
26 datafusion:vortex-file-compressed -8.2% -4.1% -4.3% +13.1% ➖ noise
26 duckdb:duckdb -3.0% -4.1% +1.1% +13.0% ➖ noise
26 duckdb:vortex-file-compressed -10.1% -4.1% -6.3% +16.6% ➖ noise
27 datafusion:vortex-file-compressed -5.5% -6.3% +0.8% +10.0% ➖ noise
27 duckdb:duckdb -2.4% -6.3% +4.1% +10.6% ➖ noise
27 duckdb:vortex-file-compressed -11.8% -6.3% -5.9% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -2.0% -6.2% +4.4% +10.0% ➖ noise
28 duckdb:duckdb -4.4% -6.2% +1.8% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -7.9% -6.2% -1.8% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -9.1% -4.0% -5.3% +10.0% ➖ noise
29 duckdb:duckdb +4.0% -4.0% +8.3% +10.1% ➖ noise
29 duckdb:vortex-file-compressed -6.7% -4.0% -2.8% +33.8% ➖ noise
30 datafusion:vortex-file-compressed -8.9% -7.6% -1.4% +10.0% ➖ noise
30 duckdb:duckdb -7.2% -7.6% +0.4% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -9.1% -7.6% -1.6% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -13.3% -7.9% -5.8% +10.0% ➖ noise
31 duckdb:duckdb -3.7% -7.9% +4.6% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -7.2% -7.9% +0.8% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -1.9% -4.0% +2.3% +14.6% ➖ noise
32 duckdb:duckdb +6.2% -4.0% +10.7% +10.0% 🚨 regression
32 duckdb:vortex-file-compressed -14.4% -4.0% -10.8% +10.0% ✅ faster
33 datafusion:vortex-file-compressed -4.9% -2.3% -2.6% +10.0% ➖ noise
33 duckdb:duckdb -0.1% -2.3% +2.3% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -15.1% -2.3% -13.1% +10.0% ✅ faster
34 datafusion:vortex-file-compressed -5.9% -5.7% -0.2% +10.0% ➖ noise
34 duckdb:duckdb +3.5% -5.7% +9.7% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -12.9% -5.7% -7.6% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -10.6% -6.3% -4.6% +10.0% ➖ noise
35 duckdb:duckdb -6.3% -6.3% -0.1% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -7.0% -6.3% -0.8% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +7.4% -4.0% +11.8% +10.0% 🚨 regression
36 duckdb:duckdb +4.4% -4.0% +8.7% +13.9% ➖ noise
36 duckdb:vortex-file-compressed -10.3% -4.0% -6.6% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -3.1% -2.3% -0.8% +10.0% ➖ noise
37 duckdb:duckdb +6.3% -2.3% +8.8% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -10.4% -2.3% -8.3% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +64.7% +0.8% +63.4% +10.0% 🚨 regression
38 duckdb:duckdb +2.6% +0.8% +1.8% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +11.1% +0.8% +10.2% +10.0% 🚨 regression
39 datafusion:vortex-file-compressed +1.0% -7.3% +8.9% +10.0% ➖ noise
39 duckdb:duckdb +7.5% -7.3% +15.9% +14.2% 🚨 regression
39 duckdb:vortex-file-compressed +57.2% -7.3% +69.5% +16.8% 🚨 regression
40 datafusion:vortex-file-compressed +2.1% -9.0% +12.2% +13.7% ➖ noise
40 duckdb:duckdb +3.8% -9.0% +14.0% +10.0% 🚨 regression
40 duckdb:vortex-file-compressed -17.4% -9.0% -9.2% +11.9% ➖ noise
41 datafusion:vortex-file-compressed -1.8% -0.8% -1.0% +11.6% ➖ noise
41 duckdb:duckdb +0.7% -0.8% +1.5% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -13.7% -0.8% -13.1% +10.0% ✅ faster
42 datafusion:vortex-file-compressed -9.7% -1.9% -7.9% +10.3% ➖ noise
42 duckdb:duckdb +5.0% -1.9% +7.1% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -6.4% -1.9% -4.6% +18.8% ➖ noise

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 16, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 16, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -15.5%
Vortex (geomean): 0.811x ➖
Parquet (geomean): 0.959x ➖
Shifts: Parquet (control) -4.1% · Median polish -3.0%


datafusion / vortex-file-compressed (0.695x ✅, 2↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 33088317 47273900 0.70
fineweb_q01/datafusion:vortex-file-compressed 411783434 544013324 0.76
fineweb_q02/datafusion:vortex-file-compressed 482889150 567776489 0.85
fineweb_q03/datafusion:vortex-file-compressed 1399670079 1395877132 1.00
fineweb_q04/datafusion:vortex-file-compressed 1433215015 1418693220 1.01
fineweb_q05/datafusion:vortex-file-compressed 1433778984 1389048211 1.03
fineweb_q06/datafusion:vortex-file-compressed 1562758086 1887419770 0.83
fineweb_q07/datafusion:vortex-file-compressed 1447487788 1475579162 0.98
fineweb_q08/datafusion:vortex-file-compressed 🚀 74407456 749554092 0.10
datafusion / vortex-compact (0.669x ✅, 3↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 33824890 43273476 0.78
fineweb_q01/datafusion:vortex-compact 702552498 696079362 1.01
fineweb_q02/datafusion:vortex-compact 633498440 669100642 0.95
fineweb_q03/datafusion:vortex-compact 🚀 1363627137 2026250011 0.67
fineweb_q04/datafusion:vortex-compact 🚀 1489106084 2168935132 0.69
fineweb_q05/datafusion:vortex-compact 1353740454 1708154511 0.79
fineweb_q06/datafusion:vortex-compact 1230737346 1489198724 0.83
fineweb_q07/datafusion:vortex-compact 1155709845 1324326109 0.87
fineweb_q08/datafusion:vortex-compact 🚀 54279062 396350922 0.14
datafusion / parquet (0.957x ➖, 0↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1035949452 1314821757 0.79
fineweb_q01/datafusion:parquet 1772331054 1842947670 0.96
fineweb_q02/datafusion:parquet 1863566273 2032007501 0.92
fineweb_q03/datafusion:parquet 1893948422 1967581840 0.96
fineweb_q04/datafusion:parquet 1878296250 1792115041 1.05
fineweb_q05/datafusion:parquet 1918691655 2105232393 0.91
fineweb_q06/datafusion:parquet 1826683678 1897435333 0.96
fineweb_q07/datafusion:parquet 1969961153 1777499029 1.11
fineweb_q08/datafusion:parquet 1986643666 2020957548 0.98
duckdb / vortex-file-compressed (0.970x ➖, 1↑ 1↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 111697953 104173735 1.07
fineweb_q01/duckdb:vortex-file-compressed 🚨 967152928 610118259 1.59
fineweb_q02/duckdb:vortex-file-compressed 479735558 533232348 0.90
fineweb_q03/duckdb:vortex-file-compressed 1805257152 1508180176 1.20
fineweb_q04/duckdb:vortex-file-compressed 1701041483 1579563953 1.08
fineweb_q05/duckdb:vortex-file-compressed 1712254909 1613220683 1.06
fineweb_q06/duckdb:vortex-file-compressed 1692514029 1745096631 0.97
fineweb_q07/duckdb:vortex-file-compressed 1683246858 1471778723 1.14
fineweb_q08/duckdb:vortex-file-compressed 🚀 201602164 614956736 0.33
duckdb / vortex-compact (0.956x ➖, 1↑ 1↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 89525134 94645399 0.95
fineweb_q01/duckdb:vortex-compact 🚨 1530060884 582328805 2.63
fineweb_q02/duckdb:vortex-compact 522340972 625780586 0.83
fineweb_q03/duckdb:vortex-compact 1730423368 1578959513 1.10
fineweb_q04/duckdb:vortex-compact 1550956403 1719653939 0.90
fineweb_q05/duckdb:vortex-compact 1504372563 1510227592 1.00
fineweb_q06/duckdb:vortex-compact 1327547495 1597317791 0.83
fineweb_q07/duckdb:vortex-compact 1270342055 1364527713 0.93
fineweb_q08/duckdb:vortex-compact 🚀 194577619 461978510 0.42
duckdb / parquet (0.961x ➖, 0↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1122494311 1120932334 1.00
fineweb_q01/duckdb:parquet 1667039061 1729043795 0.96
fineweb_q02/duckdb:parquet 1694709937 1890759387 0.90
fineweb_q03/duckdb:parquet 4055233158 4257949945 0.95
fineweb_q04/duckdb:parquet 1917041592 1986849679 0.96
fineweb_q05/duckdb:parquet 2651902100 2777297922 0.95
fineweb_q06/duckdb:parquet 3465246023 3318042944 1.04
fineweb_q07/duckdb:parquet 4017562686 4504276330 0.89
fineweb_q08/duckdb:parquet 1099620976 1108597781 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -21.8% -11.2% -12.0% +178.5% ➖ noise
0 datafusion:vortex-file-compressed -30.0% -11.2% -21.2% +153.5% ➖ noise
0 duckdb:vortex-compact -5.4% -11.2% +6.5% +38.7% ➖ noise
0 duckdb:vortex-file-compressed +7.2% -11.2% +20.7% +56.4% ➖ noise
1 datafusion:vortex-compact +0.9% -3.7% +4.8% +59.0% ➖ noise
1 datafusion:vortex-file-compressed -24.3% -3.7% -21.4% +57.8% ➖ noise
1 duckdb:vortex-compact +162.7% -3.7% +172.9% +41.6% 🚨 regression
1 duckdb:vortex-file-compressed +58.5% -3.7% +64.6% +30.0% 🚨 regression
2 datafusion:vortex-compact -5.3% -9.3% +4.4% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -15.0% -9.3% -6.2% +30.0% ➖ noise
2 duckdb:vortex-compact -16.5% -9.3% -7.9% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -10.0% -9.3% -0.8% +30.0% ➖ noise
3 datafusion:vortex-compact -32.7% -4.3% -29.7% +30.0% ✅ faster
3 datafusion:vortex-file-compressed +0.3% -4.3% +4.7% +30.0% ➖ noise
3 duckdb:vortex-compact +9.6% -4.3% +14.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +19.7% -4.3% +25.0% +30.0% ➖ noise
4 datafusion:vortex-compact -31.3% +0.6% -31.7% +30.0% ✅ faster
4 datafusion:vortex-file-compressed +1.0% +0.6% +0.5% +30.0% ➖ noise
4 duckdb:vortex-compact -9.8% +0.6% -10.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +7.7% +0.6% +7.1% +30.0% ➖ noise
5 datafusion:vortex-compact -20.7% -6.7% -15.0% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +3.2% -6.7% +10.6% +30.0% ➖ noise
5 duckdb:vortex-compact -0.4% -6.7% +6.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +6.1% -6.7% +13.8% +30.0% ➖ noise
6 datafusion:vortex-compact -17.4% +0.3% -17.6% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -17.2% +0.3% -17.4% +30.0% ➖ noise
6 duckdb:vortex-compact -16.9% +0.3% -17.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -3.0% +0.3% -3.3% +30.0% ➖ noise
7 datafusion:vortex-compact -12.7% -0.6% -12.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -1.9% -0.6% -1.3% +30.0% ➖ noise
7 duckdb:vortex-compact -6.9% -0.6% -6.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +14.4% -0.6% +15.0% +30.0% ➖ noise
8 datafusion:vortex-compact -86.3% -1.3% -86.1% +37.6% ✅ faster
8 datafusion:vortex-file-compressed -90.1% -1.3% -89.9% +49.7% ✅ faster
8 duckdb:vortex-compact -57.9% -1.3% -57.3% +30.0% ✅ faster
8 duckdb:vortex-file-compressed -67.2% -1.3% -66.8% +30.0% ✅ faster

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +19.5%
Vortex (geomean): 1.075x ➖
Parquet (geomean): 0.900x ➖
Shifts: Parquet (control) -10.0% · Median polish +4.0%


datafusion / vortex-file-compressed (1.171x ➖, 0↑ 5↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 711425961 749954343 0.95
tpch_q02/datafusion:vortex-file-compressed 973167095 916867653 1.06
tpch_q03/datafusion:vortex-file-compressed 886124205 862855755 1.03
tpch_q04/datafusion:vortex-file-compressed 677501988 639838256 1.06
tpch_q05/datafusion:vortex-file-compressed 1139523912 1186475169 0.96
tpch_q06/datafusion:vortex-file-compressed 797173101 639065387 1.25
tpch_q07/datafusion:vortex-file-compressed 🚨 3300011341 1284543840 2.57
tpch_q08/datafusion:vortex-file-compressed 1497259391 1274002201 1.18
tpch_q09/datafusion:vortex-file-compressed 1730215447 1532086566 1.13
tpch_q10/datafusion:vortex-file-compressed 1191205069 1096060381 1.09
tpch_q11/datafusion:vortex-file-compressed 678980795 587746643 1.16
tpch_q12/datafusion:vortex-file-compressed 924488551 1085803329 0.85
tpch_q13/datafusion:vortex-file-compressed 502219110 504506463 1.00
tpch_q14/datafusion:vortex-file-compressed 656854417 730426119 0.90
tpch_q15/datafusion:vortex-file-compressed 🚨 1472624908 1112226374 1.32
tpch_q16/datafusion:vortex-file-compressed 🚨 619767175 295598380 2.10
tpch_q17/datafusion:vortex-file-compressed 1239389933 1350370606 0.92
tpch_q18/datafusion:vortex-file-compressed 1429020179 1473293715 0.97
tpch_q19/datafusion:vortex-file-compressed 924953187 797416375 1.16
tpch_q20/datafusion:vortex-file-compressed 🚨 1564962904 1012031120 1.55
tpch_q21/datafusion:vortex-file-compressed 2020284940 1916229958 1.05
tpch_q22/datafusion:vortex-file-compressed 🚨 788900002 487922369 1.62
datafusion / vortex-compact (1.069x ➖, 0↑ 2↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 726294312 746937789 0.97
tpch_q02/datafusion:vortex-compact 759240078 732127301 1.04
tpch_q03/datafusion:vortex-compact 1057666589 824719210 1.28
tpch_q04/datafusion:vortex-compact 754955168 664645709 1.14
tpch_q05/datafusion:vortex-compact 1062530339 1007976642 1.05
tpch_q06/datafusion:vortex-compact 643755188 623639157 1.03
tpch_q07/datafusion:vortex-compact 1223840802 1271786820 0.96
tpch_q08/datafusion:vortex-compact 1177409190 1278664116 0.92
tpch_q09/datafusion:vortex-compact 1391114261 1405994971 0.99
tpch_q10/datafusion:vortex-compact 1128478834 1050142236 1.07
tpch_q11/datafusion:vortex-compact 568469538 502925572 1.13
tpch_q12/datafusion:vortex-compact 819778598 959776171 0.85
tpch_q13/datafusion:vortex-compact 484266329 431627637 1.12
tpch_q14/datafusion:vortex-compact 617723894 708599615 0.87
tpch_q15/datafusion:vortex-compact 1244731596 1125706912 1.11
tpch_q16/datafusion:vortex-compact 🚨 439891546 308822445 1.42
tpch_q17/datafusion:vortex-compact 1205892503 1460138049 0.83
tpch_q18/datafusion:vortex-compact 1278092233 1284549725 0.99
tpch_q19/datafusion:vortex-compact 🚨 1038627304 760883348 1.37
tpch_q20/datafusion:vortex-compact 1167475525 898211343 1.30
tpch_q21/datafusion:vortex-compact 1708488513 1463352479 1.17
tpch_q22/datafusion:vortex-compact 497053559 440766321 1.13
datafusion / parquet (0.904x ➖, 0↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 862949230 941546451 0.92
tpch_q02/datafusion:parquet 789842254 850296813 0.93
tpch_q03/datafusion:parquet 988327269 1161050345 0.85
tpch_q04/datafusion:parquet 453997674 543193071 0.84
tpch_q05/datafusion:parquet 1239675496 1431596956 0.87
tpch_q06/datafusion:parquet 529428193 525334192 1.01
tpch_q07/datafusion:parquet 1365178332 1597475924 0.85
tpch_q08/datafusion:parquet 1674060191 1926966309 0.87
tpch_q09/datafusion:parquet 2144202902 2492839816 0.86
tpch_q10/datafusion:parquet 2061413900 2051974780 1.00
tpch_q11/datafusion:parquet 762919713 827657072 0.92
tpch_q12/datafusion:parquet 699875739 783207427 0.89
tpch_q13/datafusion:parquet 703813636 789777996 0.89
tpch_q14/datafusion:parquet 778080045 813480819 0.96
tpch_q15/datafusion:parquet 1225254493 1259880001 0.97
tpch_q16/datafusion:parquet 435257216 436978645 1.00
tpch_q17/datafusion:parquet 1420833728 1803496669 0.79
tpch_q18/datafusion:parquet 1621493745 2181281900 0.74
tpch_q19/datafusion:parquet 1045649868 1097951575 0.95
tpch_q20/datafusion:parquet 1163074109 1347393443 0.86
tpch_q21/datafusion:parquet 1873886020 2214078297 0.85
tpch_q22/datafusion:parquet 861779294 742914265 1.16
duckdb / vortex-file-compressed (1.021x ➖, 0↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 759967099 684994807 1.11
tpch_q02/duckdb:vortex-file-compressed 1263352472 1378803745 0.92
tpch_q03/duckdb:vortex-file-compressed 1082702115 1051355689 1.03
tpch_q04/duckdb:vortex-file-compressed 642305271 875420528 0.73
tpch_q05/duckdb:vortex-file-compressed 1247097434 1228492067 1.02
tpch_q06/duckdb:vortex-file-compressed 804578675 841606586 0.96
tpch_q07/duckdb:vortex-file-compressed 1363248525 1261908140 1.08
tpch_q08/duckdb:vortex-file-compressed 1666957115 1594531021 1.05
tpch_q09/duckdb:vortex-file-compressed 1736587730 1588991365 1.09
tpch_q10/duckdb:vortex-file-compressed 1340369238 1415057061 0.95
tpch_q11/duckdb:vortex-file-compressed 755703885 962696837 0.78
tpch_q12/duckdb:vortex-file-compressed 1041055264 924922954 1.13
tpch_q13/duckdb:vortex-file-compressed 720952746 989938578 0.73
tpch_q14/duckdb:vortex-file-compressed 915227191 870135710 1.05
tpch_q15/duckdb:vortex-file-compressed 662305865 581555439 1.14
tpch_q16/duckdb:vortex-file-compressed 617076627 558602133 1.10
tpch_q17/duckdb:vortex-file-compressed 1188121616 1008769596 1.18
tpch_q18/duckdb:vortex-file-compressed 1081897779 1142817341 0.95
tpch_q19/duckdb:vortex-file-compressed 994076730 868305839 1.14
tpch_q20/duckdb:vortex-file-compressed 1680222284 1293903080 1.30
tpch_q21/duckdb:vortex-file-compressed 2496489411 2386906526 1.05
tpch_q22/duckdb:vortex-file-compressed 719664821 584014751 1.23
duckdb / vortex-compact (1.044x ➖, 1↑ 1↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 742662333 723049589 1.03
tpch_q02/duckdb:vortex-compact 1298787759 1212999228 1.07
tpch_q03/duckdb:vortex-compact 1009922738 1005065678 1.00
tpch_q04/duckdb:vortex-compact 600760434 578336617 1.04
tpch_q05/duckdb:vortex-compact 1204082811 1230155607 0.98
tpch_q06/duckdb:vortex-compact 777906723 762366772 1.02
tpch_q07/duckdb:vortex-compact 1318917167 1080696419 1.22
tpch_q08/duckdb:vortex-compact 1632241980 1511234138 1.08
tpch_q09/duckdb:vortex-compact 1584146809 1445067257 1.10
tpch_q10/duckdb:vortex-compact 1228915587 1393193229 0.88
tpch_q11/duckdb:vortex-compact 687359814 888239280 0.77
tpch_q12/duckdb:vortex-compact 887832159 767481515 1.16
tpch_q13/duckdb:vortex-compact 🚀 680430246 1033534149 0.66
tpch_q14/duckdb:vortex-compact 876957236 906189445 0.97
tpch_q15/duckdb:vortex-compact 650970249 574767501 1.13
tpch_q16/duckdb:vortex-compact 530952703 470718294 1.13
tpch_q17/duckdb:vortex-compact 1239228663 1023942357 1.21
tpch_q18/duckdb:vortex-compact 907347004 698641726 1.30
tpch_q19/duckdb:vortex-compact 902277205 889317621 1.01
tpch_q20/duckdb:vortex-compact 🚨 1671325208 1193250894 1.40
tpch_q21/duckdb:vortex-compact 2024326310 1944761653 1.04
tpch_q22/duckdb:vortex-compact 831051912 792748520 1.05
duckdb / parquet (0.895x ➖, 0↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 907033112 968164878 0.94
tpch_q02/duckdb:parquet 1549789642 1839885572 0.84
tpch_q03/duckdb:parquet 1689558519 2257719811 0.75
tpch_q04/duckdb:parquet 1049717173 1211796572 0.87
tpch_q05/duckdb:parquet 2148431134 2188477028 0.98
tpch_q06/duckdb:parquet 721033176 876761497 0.82
tpch_q07/duckdb:parquet 1864891875 2201646825 0.85
tpch_q08/duckdb:parquet 2402216776 2630084620 0.91
tpch_q09/duckdb:parquet 2399379998 2472173931 0.97
tpch_q10/duckdb:parquet 2984047667 3147740702 0.95
tpch_q11/duckdb:parquet 880579223 1044444927 0.84
tpch_q12/duckdb:parquet 1005732728 966243630 1.04
tpch_q13/duckdb:parquet 1148820273 1269703064 0.90
tpch_q14/duckdb:parquet 1285328813 1535125165 0.84
tpch_q15/duckdb:parquet 878854599 969123329 0.91
tpch_q16/duckdb:parquet 762470886 868012581 0.88
tpch_q17/duckdb:parquet 1166497330 1373372684 0.85
tpch_q18/duckdb:parquet 1339670458 1522748199 0.88
tpch_q19/duckdb:parquet 1476045317 1861499051 0.79
tpch_q20/duckdb:parquet 1794315940 1635878406 1.10
tpch_q21/duckdb:parquet 1713508804 2070106526 0.83
tpch_q22/duckdb:parquet 1046951820 997089911 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.8% -7.3% +4.9% +57.1% ➖ noise
1 datafusion:vortex-file-compressed -5.1% -7.3% +2.4% +59.7% ➖ noise
1 duckdb:vortex-compact +2.7% -7.3% +10.8% +53.7% ➖ noise
1 duckdb:vortex-file-compressed +10.9% -7.3% +19.7% +35.7% ➖ noise
2 datafusion:vortex-compact +3.7% -11.5% +17.2% +46.0% ➖ noise
2 datafusion:vortex-file-compressed +6.1% -11.5% +20.0% +47.2% ➖ noise
2 duckdb:vortex-compact +7.1% -11.5% +21.0% +34.5% ➖ noise
2 duckdb:vortex-file-compressed -8.4% -11.5% +3.6% +33.1% ➖ noise
3 datafusion:vortex-compact +28.2% -20.2% +60.7% +67.5% ➖ noise
3 datafusion:vortex-file-compressed +2.7% -20.2% +28.7% +90.6% ➖ noise
3 duckdb:vortex-compact +0.5% -20.2% +25.9% +49.2% ➖ noise
3 duckdb:vortex-file-compressed +3.0% -20.2% +29.0% +50.4% ➖ noise
4 datafusion:vortex-compact +13.6% -14.9% +33.5% +30.0% 🚨 regression
4 datafusion:vortex-file-compressed +5.9% -14.9% +24.4% +38.8% ➖ noise
4 duckdb:vortex-compact +3.9% -14.9% +22.1% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -26.6% -14.9% -13.8% +38.1% ➖ noise
5 datafusion:vortex-compact +5.4% -7.8% +14.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -4.0% -7.8% +4.2% +30.0% ➖ noise
5 duckdb:vortex-compact -2.1% -7.8% +6.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +1.5% -7.8% +10.1% +30.0% ➖ noise
6 datafusion:vortex-compact +3.2% -9.0% +13.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +24.7% -9.0% +37.0% +30.0% 🚨 regression
6 duckdb:vortex-compact +2.0% -9.0% +12.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -4.4% -9.0% +5.0% +30.0% ➖ noise
7 datafusion:vortex-compact -3.8% -14.9% +13.1% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +156.9% -14.9% +202.0% +39.5% 🚨 regression
7 duckdb:vortex-compact +22.0% -14.9% +43.4% +30.0% 🚨 regression
7 duckdb:vortex-file-compressed +8.0% -14.9% +27.0% +30.0% ➖ noise
8 datafusion:vortex-compact -7.9% -10.9% +3.4% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +17.5% -10.9% +31.9% +30.0% 🚨 regression
8 duckdb:vortex-compact +8.0% -10.9% +21.3% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +4.5% -10.9% +17.4% +30.0% ➖ noise
9 datafusion:vortex-compact -1.1% -8.6% +8.3% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +12.9% -8.6% +23.6% +30.0% ➖ noise
9 duckdb:vortex-compact +9.6% -8.6% +20.0% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +9.3% -8.6% +19.6% +30.0% ➖ noise
10 datafusion:vortex-compact +7.5% -2.4% +10.1% +40.3% ➖ noise
10 datafusion:vortex-file-compressed +8.7% -2.4% +11.4% +31.3% ➖ noise
10 duckdb:vortex-compact -11.8% -2.4% -9.6% +42.1% ➖ noise
10 duckdb:vortex-file-compressed -5.3% -2.4% -2.9% +32.7% ➖ noise
11 datafusion:vortex-compact +13.0% -11.8% +28.2% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +15.5% -11.8% +31.0% +30.0% 🚨 regression
11 duckdb:vortex-compact -22.6% -11.8% -12.2% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -21.5% -11.8% -11.0% +40.5% ➖ noise
12 datafusion:vortex-compact -14.6% -3.6% -11.4% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -14.9% -3.6% -11.7% +30.0% ➖ noise
12 duckdb:vortex-compact +15.7% -3.6% +19.9% +142.8% ➖ noise
12 duckdb:vortex-file-compressed +12.6% -3.6% +16.7% +36.4% ➖ noise
13 datafusion:vortex-compact +12.2% -10.2% +24.9% +59.9% ➖ noise
13 datafusion:vortex-file-compressed -0.5% -10.2% +10.9% +41.4% ➖ noise
13 duckdb:vortex-compact -34.2% -10.2% -26.7% +68.6% ➖ noise
13 duckdb:vortex-file-compressed -27.2% -10.2% -18.9% +49.3% ➖ noise
14 datafusion:vortex-compact -12.8% -10.5% -2.6% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -10.1% -10.5% +0.5% +30.0% ➖ noise
14 duckdb:vortex-compact -3.2% -10.5% +8.1% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +5.2% -10.5% +17.5% +30.0% ➖ noise
15 datafusion:vortex-compact +10.6% -6.1% +17.7% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +32.4% -6.1% +41.0% +30.0% 🚨 regression
15 duckdb:vortex-compact +13.3% -6.1% +20.6% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +13.9% -6.1% +21.3% +30.0% ➖ noise
16 datafusion:vortex-compact +42.4% -6.5% +52.3% +30.0% 🚨 regression
16 datafusion:vortex-file-compressed +109.7% -6.5% +124.1% +30.0% 🚨 regression
16 duckdb:vortex-compact +12.8% -6.5% +20.6% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +10.5% -6.5% +18.1% +45.8% ➖ noise
17 datafusion:vortex-compact -17.4% -18.2% +1.0% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -8.2% -18.2% +12.2% +30.0% ➖ noise
17 duckdb:vortex-compact +21.0% -18.2% +47.9% +30.0% 🚨 regression
17 duckdb:vortex-file-compressed +17.8% -18.2% +44.0% +30.0% 🚨 regression
18 datafusion:vortex-compact -0.5% -19.1% +23.0% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -3.0% -19.1% +19.9% +30.0% ➖ noise
18 duckdb:vortex-compact +29.9% -19.1% +60.6% +30.0% 🚨 regression
18 duckdb:vortex-file-compressed -5.3% -19.1% +17.1% +30.0% ➖ noise
19 datafusion:vortex-compact +36.5% -13.1% +57.1% +30.0% 🚨 regression
19 datafusion:vortex-file-compressed +16.0% -13.1% +33.5% +30.0% 🚨 regression
19 duckdb:vortex-compact +1.5% -13.1% +16.8% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +14.5% -13.1% +31.7% +30.0% 🚨 regression
20 datafusion:vortex-compact +30.0% -2.7% +33.6% +30.0% 🚨 regression
20 datafusion:vortex-file-compressed +54.6% -2.7% +58.9% +30.0% 🚨 regression
20 duckdb:vortex-compact +40.1% -2.7% +43.9% +30.0% 🚨 regression
20 duckdb:vortex-file-compressed +29.9% -2.7% +33.5% +30.0% 🚨 regression
21 datafusion:vortex-compact +16.8% -16.3% +39.5% +30.0% 🚨 regression
21 datafusion:vortex-file-compressed +5.4% -16.3% +26.0% +30.0% ➖ noise
21 duckdb:vortex-compact +4.1% -16.3% +24.4% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +4.6% -16.3% +25.0% +30.0% ➖ noise
22 datafusion:vortex-compact +12.8% +10.4% +2.2% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +61.7% +10.4% +46.5% +35.2% 🚨 regression
22 duckdb:vortex-compact +4.8% +10.4% -5.0% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +23.2% +10.4% +11.7% +35.3% ➖ noise

@danking
Copy link
Contributor

danking commented Mar 16, 2026

Do you think the vortex-compact improvements are from more parallelism in decompression?

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Vortex (geomean): 0.983x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -1.8%


duckdb / vortex-file-compressed (0.987x ➖, 1↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11665313 11753318 0.99
statpopgen_q01/duckdb:vortex-file-compressed 🚀 22266111 28027761 0.79
statpopgen_q02/duckdb:vortex-file-compressed 1338253621 1330379291 1.01
statpopgen_q03/duckdb:vortex-file-compressed 3205795638 3091860709 1.04
statpopgen_q04/duckdb:vortex-file-compressed 3190815745 3206616569 1.00
statpopgen_q05/duckdb:vortex-file-compressed 1413208981 1408418303 1.00
statpopgen_q06/duckdb:vortex-file-compressed 2088737891 2078660351 1.00
statpopgen_q07/duckdb:vortex-file-compressed 210347946 206872817 1.02
statpopgen_q08/duckdb:vortex-file-compressed 226978503 216252162 1.05
statpopgen_q09/duckdb:vortex-file-compressed 2960423608 2985895537 0.99
statpopgen_q10/duckdb:vortex-file-compressed 4662570013 4705126596 0.99
duckdb / vortex-compact (0.980x ➖, 1↑ 1↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10868225 11483888 0.95
statpopgen_q01/duckdb:vortex-compact 🚀 146844698 169887464 0.86
statpopgen_q02/duckdb:vortex-compact 1802197876 1864823998 0.97
statpopgen_q03/duckdb:vortex-compact 3509925120 3552254185 0.99
statpopgen_q04/duckdb:vortex-compact 3523735198 3658740487 0.96
statpopgen_q05/duckdb:vortex-compact 1849680505 1907688594 0.97
statpopgen_q06/duckdb:vortex-compact 2677816458 2747112533 0.97
statpopgen_q07/duckdb:vortex-compact 🚨 1081170436 973890205 1.11
statpopgen_q08/duckdb:vortex-compact 1106386415 1016922471 1.09
statpopgen_q09/duckdb:vortex-compact 3312701429 3476584989 0.95
statpopgen_q10/duckdb:vortex-compact 5398759274 5546698182 0.97
duckdb / parquet (0.990x ➖, 0↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 324286481 324433386 1.00
statpopgen_q01/duckdb:parquet 419360514 411899206 1.02
statpopgen_q02/duckdb:parquet 1010296166 1020744485 0.99
statpopgen_q03/duckdb:parquet 1503484691 1534296989 0.98
statpopgen_q04/duckdb:parquet 1509789291 1548516260 0.97
statpopgen_q05/duckdb:parquet 1010350997 1035938834 0.98
statpopgen_q06/duckdb:parquet 1498839549 1516178182 0.99
statpopgen_q07/duckdb:parquet 1946589151 1935690549 1.01
statpopgen_q08/duckdb:parquet 1915958156 1929114457 0.99
statpopgen_q09/duckdb:parquet 1398386619 1425955592 0.98
statpopgen_q10/duckdb:parquet 2662586704 2716439315 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -5.4% -0.0% -5.3% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -0.7% -0.0% -0.7% +10.0% ➖ noise
1 duckdb:vortex-compact -13.6% +1.8% -15.1% +197.9% ➖ noise
1 duckdb:vortex-file-compressed -20.6% +1.8% -22.0% +236.4% ➖ noise
2 duckdb:vortex-compact -3.4% -1.0% -2.4% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.6% -1.0% +1.6% +10.0% ➖ noise
3 duckdb:vortex-compact -1.2% -2.0% +0.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +3.7% -2.0% +5.8% +10.0% ➖ noise
4 duckdb:vortex-compact -3.7% -2.5% -1.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.5% -2.5% +2.1% +10.0% ➖ noise
5 duckdb:vortex-compact -3.0% -2.5% -0.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.3% -2.5% +2.9% +10.0% ➖ noise
6 duckdb:vortex-compact -2.5% -1.1% -1.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.5% -1.1% +1.6% +10.0% ➖ noise
7 duckdb:vortex-compact +11.0% +0.6% +10.4% +10.0% 🚨 regression
7 duckdb:vortex-file-compressed +1.7% +0.6% +1.1% +10.2% ➖ noise
8 duckdb:vortex-compact +8.8% -0.7% +9.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +5.0% -0.7% +5.7% +10.0% ➖ noise
9 duckdb:vortex-compact -4.7% -1.9% -2.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.9% -1.9% +1.1% +10.0% ➖ noise
10 duckdb:vortex-compact -2.7% -2.0% -0.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.9% -2.0% +1.1% +10.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.4%
Vortex (geomean): 0.942x ➖
Parquet (geomean): 0.920x ➖
Shifts: Parquet (control) -8.0% · Median polish -5.6%


datafusion / vortex-file-compressed (0.890x ➖, 3↑ 2↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 202238020 224873471 0.90
tpch_q02/datafusion:vortex-file-compressed 575140860 560133040 1.03
tpch_q03/datafusion:vortex-file-compressed 525480857 533145612 0.99
tpch_q04/datafusion:vortex-file-compressed 294872276 322338158 0.91
tpch_q05/datafusion:vortex-file-compressed 478255488 605402580 0.79
tpch_q06/datafusion:vortex-file-compressed 275694530 360357225 0.77
tpch_q07/datafusion:vortex-file-compressed 522373728 729742494 0.72
tpch_q08/datafusion:vortex-file-compressed 687920723 838168959 0.82
tpch_q09/datafusion:vortex-file-compressed 575136372 678504037 0.85
tpch_q10/datafusion:vortex-file-compressed 🚀 574812094 897862189 0.64
tpch_q11/datafusion:vortex-file-compressed 535727509 437588051 1.22
tpch_q12/datafusion:vortex-file-compressed 🚀 328734592 670739854 0.49
tpch_q13/datafusion:vortex-file-compressed 248417164 255671564 0.97
tpch_q14/datafusion:vortex-file-compressed 250944890 258535132 0.97
tpch_q15/datafusion:vortex-file-compressed 446358921 407391680 1.10
tpch_q16/datafusion:vortex-file-compressed 🚨 371323742 262643280 1.41
tpch_q17/datafusion:vortex-file-compressed 400138058 414713866 0.96
tpch_q18/datafusion:vortex-file-compressed 360449403 376693391 0.96
tpch_q19/datafusion:vortex-file-compressed 379952203 349204714 1.09
tpch_q20/datafusion:vortex-file-compressed 🚨 485350508 367535529 1.32
tpch_q21/datafusion:vortex-file-compressed 638724213 671471475 0.95
tpch_q22/datafusion:vortex-file-compressed 🚀 192568020 445023296 0.43
datafusion / vortex-compact (0.880x ➖, 2↑ 2↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 221536299 283412136 0.78
tpch_q02/datafusion:vortex-compact 537750946 727542169 0.74
tpch_q03/datafusion:vortex-compact 🚨 498725784 350259007 1.42
tpch_q04/datafusion:vortex-compact 246570738 295716385 0.83
tpch_q05/datafusion:vortex-compact 523066332 465559412 1.12
tpch_q06/datafusion:vortex-compact 327088356 355656733 0.92
tpch_q07/datafusion:vortex-compact 541920013 500849513 1.08
tpch_q08/datafusion:vortex-compact 🚨 854079796 597049104 1.43
tpch_q09/datafusion:vortex-compact 556108262 575448234 0.97
tpch_q10/datafusion:vortex-compact 585140438 770509987 0.76
tpch_q11/datafusion:vortex-compact 346348886 393227937 0.88
tpch_q12/datafusion:vortex-compact 🚀 323228113 670294249 0.48
tpch_q13/datafusion:vortex-compact 255202164 321405787 0.79
tpch_q14/datafusion:vortex-compact 🚀 281189556 433765995 0.65
tpch_q15/datafusion:vortex-compact 507735240 627543329 0.81
tpch_q16/datafusion:vortex-compact 386578331 318523640 1.21
tpch_q17/datafusion:vortex-compact 409288617 518467475 0.79
tpch_q18/datafusion:vortex-compact 324208940 444631455 0.73
tpch_q19/datafusion:vortex-compact 404500182 556394065 0.73
tpch_q20/datafusion:vortex-compact 630015694 600236134 1.05
tpch_q21/datafusion:vortex-compact 679406194 840907373 0.81
tpch_q22/datafusion:vortex-compact 220851094 226656798 0.97
datafusion / parquet (0.925x ➖, 0↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 204072543 245340410 0.83
tpch_q02/datafusion:parquet 437096894 469395273 0.93
tpch_q03/datafusion:parquet 397519548 328584388 1.21
tpch_q04/datafusion:parquet 187716088 178710444 1.05
tpch_q05/datafusion:parquet 601597462 616428786 0.98
tpch_q06/datafusion:parquet 184437170 152703130 1.21
tpch_q07/datafusion:parquet 609831681 607810216 1.00
tpch_q08/datafusion:parquet 667827254 774579233 0.86
tpch_q09/datafusion:parquet 569497364 799195215 0.71
tpch_q10/datafusion:parquet 559955503 653940454 0.86
tpch_q11/datafusion:parquet 349740603 433022479 0.81
tpch_q12/datafusion:parquet 251037968 270996195 0.93
tpch_q13/datafusion:parquet 441186367 431347851 1.02
tpch_q14/datafusion:parquet 206023946 293908297 0.70
tpch_q15/datafusion:parquet 328353647 407743563 0.81
tpch_q16/datafusion:parquet 224662830 252773481 0.89
tpch_q17/datafusion:parquet 480406539 504887524 0.95
tpch_q18/datafusion:parquet 678118567 587707917 1.15
tpch_q19/datafusion:parquet 471134601 515045988 0.91
tpch_q20/datafusion:parquet 416276361 368110800 1.13
tpch_q21/datafusion:parquet 624485194 683454667 0.91
tpch_q22/datafusion:parquet 149782842 201018836 0.75
duckdb / vortex-file-compressed (0.965x ➖, 3↑ 2↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 223007474 274458670 0.81
tpch_q02/duckdb:vortex-file-compressed 🚨 1311920657 957060083 1.37
tpch_q03/duckdb:vortex-file-compressed 668015858 642482357 1.04
tpch_q04/duckdb:vortex-file-compressed 🚀 482224865 737869660 0.65
tpch_q05/duckdb:vortex-file-compressed 891501454 981370386 0.91
tpch_q06/duckdb:vortex-file-compressed 412326064 423232080 0.97
tpch_q07/duckdb:vortex-file-compressed 754241243 799289028 0.94
tpch_q08/duckdb:vortex-file-compressed 1082485252 1003171631 1.08
tpch_q09/duckdb:vortex-file-compressed 1054609298 886370441 1.19
tpch_q10/duckdb:vortex-file-compressed 729957364 763978738 0.96
tpch_q11/duckdb:vortex-file-compressed 536548497 494484737 1.09
tpch_q12/duckdb:vortex-file-compressed 573157516 461073769 1.24
tpch_q13/duckdb:vortex-file-compressed 🚀 356729657 533273215 0.67
tpch_q14/duckdb:vortex-file-compressed 505578831 671324814 0.75
tpch_q15/duckdb:vortex-file-compressed 🚀 248296481 357961112 0.69
tpch_q16/duckdb:vortex-file-compressed 467250537 389736972 1.20
tpch_q17/duckdb:vortex-file-compressed 613200485 650536764 0.94
tpch_q18/duckdb:vortex-file-compressed 553979490 719830709 0.77
tpch_q19/duckdb:vortex-file-compressed 516451786 468737238 1.10
tpch_q20/duckdb:vortex-file-compressed 878510186 788929119 1.11
tpch_q21/duckdb:vortex-file-compressed 1063590538 1269756074 0.84
tpch_q22/duckdb:vortex-file-compressed 🚨 471077701 334587145 1.41
duckdb / vortex-compact (1.042x ➖, 0↑ 1↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 282453459 266242488 1.06
tpch_q02/duckdb:vortex-compact 1109338173 966156119 1.15
tpch_q03/duckdb:vortex-compact 669019401 605072227 1.11
tpch_q04/duckdb:vortex-compact 448479125 353226597 1.27
tpch_q05/duckdb:vortex-compact 915697649 932040586 0.98
tpch_q06/duckdb:vortex-compact 435898675 479603504 0.91
tpch_q07/duckdb:vortex-compact 735998406 707899977 1.04
tpch_q08/duckdb:vortex-compact 1046284951 859370332 1.22
tpch_q09/duckdb:vortex-compact 852192239 817566167 1.04
tpch_q10/duckdb:vortex-compact 743019678 726768399 1.02
tpch_q11/duckdb:vortex-compact 600453949 509149459 1.18
tpch_q12/duckdb:vortex-compact 555264515 440516267 1.26
tpch_q13/duckdb:vortex-compact 341087487 432910632 0.79
tpch_q14/duckdb:vortex-compact 463156109 512405083 0.90
tpch_q15/duckdb:vortex-compact 275469099 298486235 0.92
tpch_q16/duckdb:vortex-compact 🚨 451650501 331293836 1.36
tpch_q17/duckdb:vortex-compact 705864585 628796712 1.12
tpch_q18/duckdb:vortex-compact 448161858 576253764 0.78
tpch_q19/duckdb:vortex-compact 452990544 504235552 0.90
tpch_q20/duckdb:vortex-compact 809844675 797638722 1.02
tpch_q21/duckdb:vortex-compact 1056603794 1128882818 0.94
tpch_q22/duckdb:vortex-compact 457614090 381134369 1.20
duckdb / parquet (0.914x ➖, 0↑ 0↓)
name PR b613478 (ns) base 91e4e3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 543735942 735880088 0.74
tpch_q02/duckdb:parquet 1204244952 1305475160 0.92
tpch_q03/duckdb:parquet 956932409 967439064 0.99
tpch_q04/duckdb:parquet 713933945 698785590 1.02
tpch_q05/duckdb:parquet 1625207487 1850339104 0.88
tpch_q06/duckdb:parquet 435456890 506090267 0.86
tpch_q07/duckdb:parquet 1178650446 1342870606 0.88
tpch_q08/duckdb:parquet 1686055076 1810139312 0.93
tpch_q09/duckdb:parquet 1461655772 1458158971 1.00
tpch_q10/duckdb:parquet 1284562606 1440667342 0.89
tpch_q11/duckdb:parquet 824943651 971376105 0.85
tpch_q12/duckdb:parquet 620731191 810313182 0.77
tpch_q13/duckdb:parquet 896516458 907037240 0.99
tpch_q14/duckdb:parquet 688528533 805585738 0.85
tpch_q15/duckdb:parquet 515422826 591107233 0.87
tpch_q16/duckdb:parquet 554071602 604702218 0.92
tpch_q17/duckdb:parquet 752677981 754801483 1.00
tpch_q18/duckdb:parquet 924517111 882761281 1.05
tpch_q19/duckdb:parquet 817593324 968130120 0.84
tpch_q20/duckdb:parquet 1056847588 1121970282 0.94
tpch_q21/duckdb:parquet 1166380010 1231555416 0.95
tpch_q22/duckdb:parquet 540931317 515746216 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -21.8% -21.6% -0.3% +136.8% ➖ noise
1 datafusion:vortex-file-compressed -10.1% -21.6% +14.7% +134.1% ➖ noise
1 duckdb:vortex-compact +6.1% -21.6% +35.3% +66.9% ➖ noise
1 duckdb:vortex-file-compressed -18.7% -21.6% +3.6% +59.0% ➖ noise
2 datafusion:vortex-compact -26.1% -7.3% -20.3% +44.9% ➖ noise
2 datafusion:vortex-file-compressed +2.7% -7.3% +10.8% +39.9% ➖ noise
2 duckdb:vortex-compact +14.8% -7.3% +23.9% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +37.1% -7.3% +47.9% +30.0% 🚨 regression
3 datafusion:vortex-compact +42.4% +9.4% +30.2% +79.2% ➖ noise
3 datafusion:vortex-file-compressed -1.4% +9.4% -9.9% +80.3% ➖ noise
3 duckdb:vortex-compact +10.6% +9.4% +1.1% +39.9% ➖ noise
3 duckdb:vortex-file-compressed +4.0% +9.4% -5.0% +36.6% ➖ noise
4 datafusion:vortex-compact -16.6% +3.6% -19.5% +47.2% ➖ noise
4 datafusion:vortex-file-compressed -8.5% +3.6% -11.7% +39.8% ➖ noise
4 duckdb:vortex-compact +27.0% +3.6% +22.6% +31.2% ➖ noise
4 duckdb:vortex-file-compressed -34.6% +3.6% -36.9% +81.9% ➖ noise
5 datafusion:vortex-compact +12.4% -7.4% +21.4% +39.4% ➖ noise
5 datafusion:vortex-file-compressed -21.0% -7.4% -14.7% +30.0% ➖ noise
5 duckdb:vortex-compact -1.8% -7.4% +6.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -9.2% -7.4% -1.9% +30.0% ➖ noise
6 datafusion:vortex-compact -8.0% +1.9% -9.8% +61.3% ➖ noise
6 datafusion:vortex-file-compressed -23.5% +1.9% -25.0% +30.0% ✅ faster
6 duckdb:vortex-compact -9.1% +1.9% -10.8% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -2.6% +1.9% -4.4% +37.2% ➖ noise
7 datafusion:vortex-compact +8.2% -6.2% +15.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -28.4% -6.2% -23.7% +43.7% ➖ noise
7 duckdb:vortex-compact +4.0% -6.2% +10.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -5.6% -6.2% +0.6% +30.0% ➖ noise
8 datafusion:vortex-compact +43.1% -10.4% +59.6% +30.0% 🚨 regression
8 datafusion:vortex-file-compressed -17.9% -10.4% -8.4% +30.0% ➖ noise
8 duckdb:vortex-compact +21.8% -10.4% +35.9% +30.0% 🚨 regression
8 duckdb:vortex-file-compressed +7.9% -10.4% +20.4% +30.0% ➖ noise
9 datafusion:vortex-compact -3.4% -15.5% +14.3% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -15.2% -15.5% +0.3% +33.8% ➖ noise
9 duckdb:vortex-compact +4.2% -15.5% +23.3% +31.6% ➖ noise
9 duckdb:vortex-file-compressed +19.0% -15.5% +40.8% +30.0% 🚨 regression
10 datafusion:vortex-compact -24.1% -12.6% -13.1% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -36.0% -12.6% -26.7% +48.6% ➖ noise
10 duckdb:vortex-compact +2.2% -12.6% +17.0% +31.8% ➖ noise
10 duckdb:vortex-file-compressed -4.5% -12.6% +9.3% +30.0% ➖ noise
11 datafusion:vortex-compact -11.9% -17.2% +6.3% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +22.4% -17.2% +47.8% +30.0% 🚨 regression
11 duckdb:vortex-compact +17.9% -17.2% +42.4% +30.0% 🚨 regression
11 duckdb:vortex-file-compressed +8.5% -17.2% +31.0% +30.0% 🚨 regression
12 datafusion:vortex-compact -51.8% -15.8% -42.8% +30.6% ✅ faster
12 datafusion:vortex-file-compressed -51.0% -15.8% -41.8% +43.6% ✅ faster
12 duckdb:vortex-compact +26.0% -15.8% +49.6% +36.9% 🚨 regression
12 duckdb:vortex-file-compressed +24.3% -15.8% +47.6% +41.9% 🚨 regression
13 datafusion:vortex-compact -20.6% +0.5% -21.0% +110.2% ➖ noise
13 datafusion:vortex-file-compressed -2.8% +0.5% -3.4% +30.0% ➖ noise
13 duckdb:vortex-compact -21.2% +0.5% -21.6% +36.0% ➖ noise
13 duckdb:vortex-file-compressed -33.1% +0.5% -33.5% +42.7% ✅ faster
14 datafusion:vortex-compact -35.2% -22.6% -16.2% +53.7% ➖ noise
14 datafusion:vortex-file-compressed -2.9% -22.6% +25.4% +52.0% ➖ noise
14 duckdb:vortex-compact -9.6% -22.6% +16.8% +33.6% ➖ noise
14 duckdb:vortex-file-compressed -24.7% -22.6% -2.7% +39.3% ➖ noise
15 datafusion:vortex-compact -19.1% -16.2% -3.4% +35.4% ➖ noise
15 datafusion:vortex-file-compressed +9.6% -16.2% +30.8% +30.0% 🚨 regression
15 duckdb:vortex-compact -7.7% -16.2% +10.1% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -30.6% -16.2% -17.2% +68.7% ➖ noise
16 datafusion:vortex-compact +21.4% -9.8% +34.5% +30.2% 🚨 regression
16 datafusion:vortex-file-compressed +41.4% -9.8% +56.7% +30.0% 🚨 regression
16 duckdb:vortex-compact +36.3% -9.8% +51.1% +30.0% 🚨 regression
16 duckdb:vortex-file-compressed +19.9% -9.8% +32.9% +30.0% 🚨 regression
17 datafusion:vortex-compact -21.1% -2.6% -19.0% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -3.5% -2.6% -0.9% +30.0% ➖ noise
17 duckdb:vortex-compact +12.3% -2.6% +15.2% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -5.7% -2.6% -3.2% +30.0% ➖ noise
18 datafusion:vortex-compact -27.1% +9.9% -33.7% +48.3% ✅ faster
18 datafusion:vortex-file-compressed -4.3% +9.9% -13.0% +30.0% ➖ noise
18 duckdb:vortex-compact -22.2% +9.9% -29.3% +30.7% ✅ faster
18 duckdb:vortex-file-compressed -23.0% +9.9% -30.0% +30.0% ✅ faster
19 datafusion:vortex-compact -27.3% -12.1% -17.3% +34.8% ➖ noise
19 datafusion:vortex-file-compressed +8.8% -12.1% +23.8% +30.0% ➖ noise
19 duckdb:vortex-compact -10.2% -12.1% +2.2% +32.8% ➖ noise
19 duckdb:vortex-file-compressed +10.2% -12.1% +25.4% +30.0% ➖ noise
20 datafusion:vortex-compact +5.0% +3.2% +1.7% +33.3% ➖ noise
20 datafusion:vortex-file-compressed +32.1% +3.2% +27.9% +41.6% ➖ noise
20 duckdb:vortex-compact +1.5% +3.2% -1.6% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +11.4% +3.2% +7.9% +32.1% ➖ noise
21 datafusion:vortex-compact -19.2% -7.0% -13.1% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -4.9% -7.0% +2.3% +58.5% ➖ noise
21 duckdb:vortex-compact -6.4% -7.0% +0.6% +30.9% ➖ noise
21 duckdb:vortex-file-compressed -16.2% -7.0% -10.0% +30.0% ➖ noise
22 datafusion:vortex-compact -2.6% -11.6% +10.2% +43.1% ➖ noise
22 datafusion:vortex-file-compressed -56.7% -11.6% -51.1% +92.3% ✅ faster
22 duckdb:vortex-compact +20.1% -11.6% +35.8% +30.0% 🚨 regression
22 duckdb:vortex-file-compressed +40.8% -11.6% +59.3% +30.0% 🚨 regression

AdamGS added 2 commits March 16, 2026 19:33
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 16, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

do not merge Pull requests that are not intended to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants