Skip to content

tryout fsst decompress speedup#6998

Draft
joseph-isaacs wants to merge 4 commits intodevelopfrom
ji/make-view
Draft

tryout fsst decompress speedup#6998
joseph-isaacs wants to merge 4 commits intodevelopfrom
ji/make-view

Conversation

@joseph-isaacs
Copy link
Contributor

Summary

Closes: #000

Testing

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@codspeed-hq
Copy link

codspeed-hq bot commented Mar 17, 2026

Merging this PR will improve performance by 22.5%

⚡ 21 improved benchmarks
✅ 988 untouched benchmarks
🆕 20 new benchmarks
⏩ 1515 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
🆕 Simulation canonicalize_compare[(10000, 256, 8)] N/A 10.4 ms N/A
🆕 Simulation canonicalize_compare[(1000, 256, 4)] N/A 944.7 µs N/A
🆕 Simulation canonicalize_compare[(1000, 256, 8)] N/A 1.1 ms N/A
Simulation canonicalize_compare[(10000, 16, 8)] 1.5 ms 1.4 ms +11.08%
Simulation canonicalize_compare[(10000, 16, 4)] 1.4 ms 1.3 ms +12.02%
Simulation canonicalize_compare[(10000, 4, 4)] 1.2 ms 1 ms +13.93%
🆕 Simulation canonicalize_compare[(10000, 256, 4)] N/A 8.6 ms N/A
Simulation chunked_into_canonical[(1000, 100, 16, 4)] 15.2 ms 13.6 ms +11.94%
Simulation chunked_into_canonical[(10, 10000, 16, 4)] 11.6 ms 10.1 ms +15.13%
Simulation chunked_canonicalize_into[(10, 10000, 4, 4)] 7.8 ms 6.4 ms +21.79%
🆕 Simulation compress_fsst[(1000, 256, 8)] N/A 3.5 ms N/A
Simulation chunked_into_canonical[(10, 10000, 4, 4)] 7.8 ms 6.4 ms +21.75%
Simulation chunked_canonicalize_into[(1000, 100, 16, 4)] 15 ms 13.4 ms +12.12%
Simulation chunked_into_canonical[(1000, 50, 8, 4)] 8 ms 7.3 ms +10.81%
Simulation chunked_canonicalize_into[(1000, 50, 8, 4)] 7.8 ms 7 ms +11.2%
Simulation canonicalize_compare[(10000, 4, 8)] 1.2 ms 1 ms +13.57%
🆕 Simulation compress_fsst[(1000, 256, 4)] N/A 2.9 ms N/A
Simulation chunked_canonicalize_into[(10, 10000, 16, 4)] 11.6 ms 10 ms +15.11%
🆕 Simulation compress_fsst[(10000, 256, 4)] N/A 28.7 ms N/A
🆕 Simulation compress_fsst[(10000, 256, 8)] N/A 34.1 ms N/A
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing ji/make-view (a05fcab) with develop (50868db)

Open in CodSpeed

Footnotes

  1. 1515 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 17, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 17, 2026
@joseph-isaacs joseph-isaacs changed the title fix tryout fsst decompress speedup Mar 17, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done a05fcab 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.018x ➖


datafusion / vortex-file-compressed (1.018x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 115320255 112984071 1.02
polarsignals_q01/datafusion:vortex-file-compressed 354505011 344283846 1.03
polarsignals_q02/datafusion:vortex-file-compressed 21639571 21043692 1.03
polarsignals_q03/datafusion:vortex-file-compressed 348423935 345853630 1.01
polarsignals_q04/datafusion:vortex-file-compressed 12396044 11400809 1.09
polarsignals_q05/datafusion:vortex-file-compressed 16236099 16363635 0.99
polarsignals_q06/datafusion:vortex-file-compressed 21350955 19869302 1.07
polarsignals_q07/datafusion:vortex-file-compressed 12506357 13015559 0.96
polarsignals_q08/datafusion:vortex-file-compressed 432020982 430377582 1.00
polarsignals_q09/datafusion:vortex-file-compressed 11338044 11521622 0.98

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.5%
Vortex (geomean): 0.990x ➖
Parquet (geomean): 0.978x ➖
Shifts: Parquet (control) -2.2% · Median polish -0.7%


datafusion / vortex-file-compressed (0.984x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 52128397 52066568 1.00
tpch_q02/datafusion:vortex-file-compressed 49609604 52331292 0.95
tpch_q03/datafusion:vortex-file-compressed 26368479 27874422 0.95
tpch_q04/datafusion:vortex-file-compressed 18828686 18373651 1.02
tpch_q05/datafusion:vortex-file-compressed 79534042 76811393 1.04
tpch_q06/datafusion:vortex-file-compressed 10150335 10413053 0.97
tpch_q07/datafusion:vortex-file-compressed 91150153 91012057 1.00
tpch_q08/datafusion:vortex-file-compressed 64505428 65491164 0.98
tpch_q09/datafusion:vortex-file-compressed 86212913 86696642 0.99
tpch_q10/datafusion:vortex-file-compressed 74694586 75888571 0.98
tpch_q11/datafusion:vortex-file-compressed 19039867 18775245 1.01
tpch_q12/datafusion:vortex-file-compressed 32946693 33425256 0.99
tpch_q13/datafusion:vortex-file-compressed 27021248 27855452 0.97
tpch_q14/datafusion:vortex-file-compressed 28197559 28308238 1.00
tpch_q15/datafusion:vortex-file-compressed 24805075 26242427 0.95
tpch_q16/datafusion:vortex-file-compressed 34026937 35159226 0.97
tpch_q17/datafusion:vortex-file-compressed 74701751 75147127 0.99
tpch_q18/datafusion:vortex-file-compressed 99733155 102579520 0.97
tpch_q19/datafusion:vortex-file-compressed 36843486 37245214 0.99
tpch_q20/datafusion:vortex-file-compressed 48662554 50684995 0.96
tpch_q21/datafusion:vortex-file-compressed 92996968 93389147 1.00
tpch_q22/datafusion:vortex-file-compressed 14959053 15318692 0.98
datafusion / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59417248 61824224 0.96
tpch_q02/datafusion:vortex-compact 53192352 55952552 0.95
tpch_q03/datafusion:vortex-compact 31481916 32549660 0.97
tpch_q04/datafusion:vortex-compact 22987126 22938178 1.00
tpch_q05/datafusion:vortex-compact 85077304 83135552 1.02
tpch_q06/datafusion:vortex-compact 13947934 13908552 1.00
tpch_q07/datafusion:vortex-compact 97673083 99978378 0.98
tpch_q08/datafusion:vortex-compact 72738437 74988844 0.97
tpch_q09/datafusion:vortex-compact 92989224 92696738 1.00
tpch_q10/datafusion:vortex-compact 79410247 80967627 0.98
tpch_q11/datafusion:vortex-compact 21335171 20081610 1.06
tpch_q12/datafusion:vortex-compact 43820982 43399162 1.01
tpch_q13/datafusion:vortex-compact 36520383 38442599 0.95
tpch_q14/datafusion:vortex-compact 32235250 31619690 1.02
tpch_q15/datafusion:vortex-compact 32884476 33884729 0.97
tpch_q16/datafusion:vortex-compact 39733504 40360063 0.98
tpch_q17/datafusion:vortex-compact 79176482 79816344 0.99
tpch_q18/datafusion:vortex-compact 108584135 109431771 0.99
tpch_q19/datafusion:vortex-compact 47341650 44256568 1.07
tpch_q20/datafusion:vortex-compact 54838529 54745527 1.00
tpch_q21/datafusion:vortex-compact 107050989 106870872 1.00
tpch_q22/datafusion:vortex-compact 16475973 16983126 0.97
datafusion / parquet (0.966x ➖, 3↑ 1↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 106782141 149082082 0.72
tpch_q02/datafusion:parquet 82256113 80670771 1.02
tpch_q03/datafusion:parquet 🚨 86548244 77489632 1.12
tpch_q04/datafusion:parquet 52469736 55353931 0.95
tpch_q05/datafusion:parquet 165815585 162222909 1.02
tpch_q06/datafusion:parquet 48873653 48762171 1.00
tpch_q07/datafusion:parquet 179835622 185517651 0.97
tpch_q08/datafusion:parquet 164367531 163249075 1.01
tpch_q09/datafusion:parquet 205391534 209797387 0.98
tpch_q10/datafusion:parquet 185573815 188948547 0.98
tpch_q11/datafusion:parquet 58850234 59775963 0.98
tpch_q12/datafusion:parquet 🚀 109710614 127431971 0.86
tpch_q13/datafusion:parquet 198765500 209779715 0.95
tpch_q14/datafusion:parquet 79946226 79730952 1.00
tpch_q15/datafusion:parquet 68008854 69296924 0.98
tpch_q16/datafusion:parquet 54442739 54471135 1.00
tpch_q17/datafusion:parquet 160715830 176129972 0.91
tpch_q18/datafusion:parquet 226507482 232592893 0.97
tpch_q19/datafusion:parquet 🚀 82101800 94404688 0.87
tpch_q20/datafusion:parquet 122252696 120684276 1.01
tpch_q21/datafusion:parquet 184413212 181133762 1.02
tpch_q22/datafusion:parquet 41446584 41874789 0.99
datafusion / arrow (0.995x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 65216151 62978079 1.04
tpch_q02/datafusion:arrow 22932593 23817354 0.96
tpch_q03/datafusion:arrow 36588168 38187900 0.96
tpch_q04/datafusion:arrow 28723415 30622054 0.94
tpch_q05/datafusion:arrow 90396817 97688549 0.93
tpch_q06/datafusion:arrow 22832564 22622475 1.01
tpch_q07/datafusion:arrow 176123275 171034629 1.03
tpch_q08/datafusion:arrow 48041769 48763136 0.99
tpch_q09/datafusion:arrow 75653853 76713418 0.99
tpch_q10/datafusion:arrow 61381624 59006321 1.04
tpch_q11/datafusion:arrow 12603194 12488359 1.01
tpch_q12/datafusion:arrow 60505784 57487730 1.05
tpch_q13/datafusion:arrow 52377437 51486287 1.02
tpch_q14/datafusion:arrow 25214577 26072030 0.97
tpch_q15/datafusion:arrow 48367936 49441729 0.98
tpch_q16/datafusion:arrow 24743238 23590554 1.05
tpch_q17/datafusion:arrow 80916506 88764695 0.91
tpch_q18/datafusion:arrow 162950252 167892896 0.97
tpch_q19/datafusion:arrow 41472120 42541367 0.97
tpch_q20/datafusion:arrow 41933886 40057234 1.05
tpch_q21/datafusion:arrow 233385601 233451674 1.00
tpch_q22/datafusion:arrow 23024649 21871058 1.05
duckdb / vortex-file-compressed (0.982x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32260427 33414487 0.97
tpch_q02/duckdb:vortex-file-compressed 26682205 28708897 0.93
tpch_q03/duckdb:vortex-file-compressed 29066252 31349559 0.93
tpch_q04/duckdb:vortex-file-compressed 30127589 29378755 1.03
tpch_q05/duckdb:vortex-file-compressed 35591245 34999676 1.02
tpch_q06/duckdb:vortex-file-compressed 10886185 10875420 1.00
tpch_q07/duckdb:vortex-file-compressed 37032864 36782060 1.01
tpch_q08/duckdb:vortex-file-compressed 41285070 40073672 1.03
tpch_q09/duckdb:vortex-file-compressed 78414734 83707302 0.94
tpch_q10/duckdb:vortex-file-compressed 36326453 36525766 0.99
tpch_q11/duckdb:vortex-file-compressed 16880696 16658703 1.01
tpch_q12/duckdb:vortex-file-compressed 23416645 23804200 0.98
tpch_q13/duckdb:vortex-file-compressed 37306600 37149735 1.00
tpch_q14/duckdb:vortex-file-compressed 22450993 21727538 1.03
tpch_q15/duckdb:vortex-file-compressed 15783694 15841951 1.00
tpch_q16/duckdb:vortex-file-compressed 29341555 29758632 0.99
tpch_q17/duckdb:vortex-file-compressed 24347143 25538921 0.95
tpch_q18/duckdb:vortex-file-compressed 47060694 50099109 0.94
tpch_q19/duckdb:vortex-file-compressed 31504508 33084393 0.95
tpch_q20/duckdb:vortex-file-compressed 33609471 34402972 0.98
tpch_q21/duckdb:vortex-file-compressed 102401997 103471544 0.99
tpch_q22/duckdb:vortex-file-compressed 18074016 18926315 0.95
duckdb / vortex-compact (1.001x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39110985 39158557 1.00
tpch_q02/duckdb:vortex-compact 37514252 37373947 1.00
tpch_q03/duckdb:vortex-compact 31873854 32073800 0.99
tpch_q04/duckdb:vortex-compact 33305514 34328128 0.97
tpch_q05/duckdb:vortex-compact 37483436 38113112 0.98
tpch_q06/duckdb:vortex-compact 14678893 14782551 0.99
tpch_q07/duckdb:vortex-compact 42985726 43488392 0.99
tpch_q08/duckdb:vortex-compact 46128490 45697161 1.01
tpch_q09/duckdb:vortex-compact 91148336 87337093 1.04
tpch_q10/duckdb:vortex-compact 41184740 41285893 1.00
tpch_q11/duckdb:vortex-compact 21036677 20364594 1.03
tpch_q12/duckdb:vortex-compact 37190630 36972481 1.01
tpch_q13/duckdb:vortex-compact 48212910 46246585 1.04
tpch_q14/duckdb:vortex-compact 30603174 31142505 0.98
tpch_q15/duckdb:vortex-compact 19655282 19672652 1.00
tpch_q16/duckdb:vortex-compact 37370873 36004829 1.04
tpch_q17/duckdb:vortex-compact 31671093 31703933 1.00
tpch_q18/duckdb:vortex-compact 50536388 49982822 1.01
tpch_q19/duckdb:vortex-compact 38454958 39258433 0.98
tpch_q20/duckdb:vortex-compact 45094828 44886761 1.00
tpch_q21/duckdb:vortex-compact 112189122 113298124 0.99
tpch_q22/duckdb:vortex-compact 20145077 21211129 0.95
duckdb / parquet (0.991x ➖, 2↑ 1↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 83904803 79571884 1.05
tpch_q02/duckdb:parquet 39316864 40328301 0.97
tpch_q03/duckdb:parquet 75618150 76323716 0.99
tpch_q04/duckdb:parquet 53578098 52104907 1.03
tpch_q05/duckdb:parquet 65627111 68948863 0.95
tpch_q06/duckdb:parquet 20171556 20333753 0.99
tpch_q07/duckdb:parquet 🚨 80832418 68432530 1.18
tpch_q08/duckdb:parquet 89227328 82569599 1.08
tpch_q09/duckdb:parquet 🚀 131144055 153063484 0.86
tpch_q10/duckdb:parquet 128247936 141308843 0.91
tpch_q11/duckdb:parquet 22480484 21826349 1.03
tpch_q12/duckdb:parquet 44441580 45230601 0.98
tpch_q13/duckdb:parquet 261565827 268558565 0.97
tpch_q14/duckdb:parquet 49101713 48545393 1.01
tpch_q15/duckdb:parquet 24474482 24986480 0.98
tpch_q16/duckdb:parquet 56624414 55924352 1.01
tpch_q17/duckdb:parquet 56651147 57925998 0.98
tpch_q18/duckdb:parquet 120185560 120745292 1.00
tpch_q19/duckdb:parquet 69410954 69034798 1.01
tpch_q20/duckdb:parquet 🚀 65184282 77255774 0.84
tpch_q21/duckdb:parquet 170997817 167950652 1.02
tpch_q22/duckdb:parquet 52674464 52409651 1.01
duckdb / duckdb (1.002x ➖, 0↑ 1↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15936685 15795976 1.01
tpch_q02/duckdb:duckdb 11486794 12319551 0.93
tpch_q03/duckdb:duckdb 19750706 19455792 1.02
tpch_q04/duckdb:duckdb 19028105 18177655 1.05
tpch_q05/duckdb:duckdb 20485947 19646028 1.04
tpch_q06/duckdb:duckdb 5301336 5339397 0.99
tpch_q07/duckdb:duckdb 23048024 23897460 0.96
tpch_q08/duckdb:duckdb 21272773 20681493 1.03
tpch_q09/duckdb:duckdb 51935223 55846248 0.93
tpch_q10/duckdb:duckdb 41567345 43840047 0.95
tpch_q11/duckdb:duckdb 🚨 6213704 5575537 1.11
tpch_q12/duckdb:duckdb 13495349 13934450 0.97
tpch_q13/duckdb:duckdb 37570682 36814021 1.02
tpch_q14/duckdb:duckdb 15706686 15952917 0.98
tpch_q15/duckdb:duckdb 11645091 11892971 0.98
tpch_q16/duckdb:duckdb 23731869 22516846 1.05
tpch_q17/duckdb:duckdb 13858328 14091776 0.98
tpch_q18/duckdb:duckdb 38203459 38265148 1.00
tpch_q19/duckdb:duckdb 27366077 26408288 1.04
tpch_q20/duckdb:duckdb 22948602 22128510 1.04
tpch_q21/duckdb:duckdb 55320891 56437881 0.98
tpch_q22/duckdb:duckdb 24412740 24651246 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +3.6% -13.1% +19.2% +25.8% ➖ noise
1 datafusion:vortex-compact -3.9% -13.1% +10.6% +23.3% ➖ noise
1 datafusion:vortex-file-compressed +0.1% -13.1% +15.2% +27.5% ➖ noise
1 duckdb:duckdb +0.9% -13.1% +16.1% +23.5% ➖ noise
1 duckdb:vortex-compact -0.1% -13.1% +14.9% +22.0% ➖ noise
1 duckdb:vortex-file-compressed -3.5% -13.1% +11.1% +23.0% ➖ noise
2 datafusion:arrow -3.7% -0.3% -3.4% +13.8% ➖ noise
2 datafusion:vortex-compact -4.9% -0.3% -4.7% +13.8% ➖ noise
2 datafusion:vortex-file-compressed -5.2% -0.3% -4.9% +13.8% ➖ noise
2 duckdb:duckdb -6.8% -0.3% -6.5% +13.8% ➖ noise
2 duckdb:vortex-compact +0.4% -0.3% +0.7% +13.8% ➖ noise
2 duckdb:vortex-file-compressed -7.1% -0.3% -6.8% +13.8% ➖ noise
3 datafusion:arrow -4.2% +5.2% -8.9% +13.8% ➖ noise
3 datafusion:vortex-compact -3.3% +5.2% -8.1% +14.5% ➖ noise
3 datafusion:vortex-file-compressed -5.4% +5.2% -10.1% +14.7% ➖ noise
3 duckdb:duckdb +1.5% +5.2% -3.5% +16.7% ➖ noise
3 duckdb:vortex-compact -0.6% +5.2% -5.5% +15.5% ➖ noise
3 duckdb:vortex-file-compressed -7.3% +5.2% -11.9% +16.5% ➖ noise
4 datafusion:arrow -6.2% -1.3% -5.0% +13.8% ➖ noise
4 datafusion:vortex-compact +0.2% -1.3% +1.5% +13.8% ➖ noise
4 datafusion:vortex-file-compressed +2.5% -1.3% +3.8% +13.8% ➖ noise
4 duckdb:duckdb +4.7% -1.3% +6.0% +15.1% ➖ noise
4 duckdb:vortex-compact -3.0% -1.3% -1.7% +13.8% ➖ noise
4 duckdb:vortex-file-compressed +2.5% -1.3% +3.9% +14.6% ➖ noise
5 datafusion:arrow -7.5% -1.4% -6.2% +13.8% ➖ noise
5 datafusion:vortex-compact +2.3% -1.4% +3.8% +13.8% ➖ noise
5 datafusion:vortex-file-compressed +3.5% -1.4% +5.0% +13.8% ➖ noise
5 duckdb:duckdb +4.3% -1.4% +5.7% +14.0% ➖ noise
5 duckdb:vortex-compact -1.7% -1.4% -0.3% +13.8% ➖ noise
5 duckdb:vortex-file-compressed +1.7% -1.4% +3.1% +13.8% ➖ noise
6 datafusion:arrow +0.9% -0.3% +1.2% +20.7% ➖ noise
6 datafusion:vortex-compact +0.3% -0.3% +0.6% +21.5% ➖ noise
6 datafusion:vortex-file-compressed -2.5% -0.3% -2.2% +22.4% ➖ noise
6 duckdb:duckdb -0.7% -0.3% -0.4% +23.7% ➖ noise
6 duckdb:vortex-compact -0.7% -0.3% -0.4% +23.1% ➖ noise
6 duckdb:vortex-file-compressed +0.1% -0.3% +0.4% +25.6% ➖ noise
7 datafusion:arrow +3.0% +7.0% -3.8% +13.8% ➖ noise
7 datafusion:vortex-compact -2.3% +7.0% -8.7% +13.8% ➖ noise
7 datafusion:vortex-file-compressed +0.2% +7.0% -6.4% +13.8% ➖ noise
7 duckdb:duckdb -3.6% +7.0% -9.9% +19.1% ➖ noise
7 duckdb:vortex-compact -1.2% +7.0% -7.6% +13.8% ➖ noise
7 duckdb:vortex-file-compressed +0.7% +7.0% -5.9% +13.8% ➖ noise
8 datafusion:arrow -1.5% +4.3% -5.5% +13.8% ➖ noise
8 datafusion:vortex-compact -3.0% +4.3% -7.0% +13.8% ➖ noise
8 datafusion:vortex-file-compressed -1.5% +4.3% -5.6% +13.8% ➖ noise
8 duckdb:duckdb +2.9% +4.3% -1.4% +13.8% ➖ noise
8 duckdb:vortex-compact +0.9% +4.3% -3.2% +13.8% ➖ noise
8 duckdb:vortex-file-compressed +3.0% +4.3% -1.2% +13.8% ➖ noise
9 datafusion:arrow -1.4% -8.4% +7.7% +13.8% ➖ noise
9 datafusion:vortex-compact +0.3% -8.4% +9.5% +13.8% ➖ noise
9 datafusion:vortex-file-compressed -0.6% -8.4% +8.6% +13.8% ➖ noise
9 duckdb:duckdb -7.0% -8.4% +1.5% +13.8% ➖ noise
9 duckdb:vortex-compact +4.4% -8.4% +14.0% +13.8% 🚨 regression
9 duckdb:vortex-file-compressed -6.3% -8.4% +2.3% +13.8% ➖ noise
10 datafusion:arrow +4.0% -5.6% +10.2% +13.8% ➖ noise
10 datafusion:vortex-compact -1.9% -5.6% +3.9% +13.8% ➖ noise
10 datafusion:vortex-file-compressed -1.6% -5.6% +4.3% +13.8% ➖ noise
10 duckdb:duckdb -5.2% -5.6% +0.4% +15.2% ➖ noise
10 duckdb:vortex-compact -0.2% -5.6% +5.7% +13.8% ➖ noise
10 duckdb:vortex-file-compressed -0.5% -5.6% +5.3% +13.8% ➖ noise
11 datafusion:arrow +0.9% +0.7% +0.2% +13.8% ➖ noise
11 datafusion:vortex-compact +6.2% +0.7% +5.5% +13.8% ➖ noise
11 datafusion:vortex-file-compressed +1.4% +0.7% +0.7% +13.8% ➖ noise
11 duckdb:duckdb +11.4% +0.7% +10.7% +15.3% ➖ noise
11 duckdb:vortex-compact +3.3% +0.7% +2.6% +13.8% ➖ noise
11 duckdb:vortex-file-compressed +1.3% +0.7% +0.6% +13.8% ➖ noise
12 datafusion:arrow +5.2% -8.0% +14.4% +16.5% ➖ noise
12 datafusion:vortex-compact +1.0% -8.0% +9.8% +13.8% ➖ noise
12 datafusion:vortex-file-compressed -1.4% -8.0% +7.2% +13.8% ➖ noise
12 duckdb:duckdb -3.2% -8.0% +5.3% +14.9% ➖ noise
12 duckdb:vortex-compact +0.6% -8.0% +9.4% +13.8% ➖ noise
12 duckdb:vortex-file-compressed -1.6% -8.0% +7.0% +13.8% ➖ noise
13 datafusion:arrow +1.7% -3.9% +5.9% +13.8% ➖ noise
13 datafusion:vortex-compact -5.0% -3.9% -1.1% +13.8% ➖ noise
13 datafusion:vortex-file-compressed -3.0% -3.9% +1.0% +13.8% ➖ noise
13 duckdb:duckdb +2.1% -3.9% +6.2% +16.6% ➖ noise
13 duckdb:vortex-compact +4.3% -3.9% +8.5% +13.8% ➖ noise
13 duckdb:vortex-file-compressed +0.4% -3.9% +4.5% +13.8% ➖ noise
14 datafusion:arrow -3.3% +0.7% -4.0% +13.8% ➖ noise
14 datafusion:vortex-compact +1.9% +0.7% +1.2% +13.8% ➖ noise
14 datafusion:vortex-file-compressed -0.4% +0.7% -1.1% +13.8% ➖ noise
14 duckdb:duckdb -1.5% +0.7% -2.2% +21.1% ➖ noise
14 duckdb:vortex-compact -1.7% +0.7% -2.4% +13.8% ➖ noise
14 duckdb:vortex-file-compressed +3.3% +0.7% +2.6% +13.8% ➖ noise
15 datafusion:arrow -2.2% -2.0% -0.2% +13.8% ➖ noise
15 datafusion:vortex-compact -3.0% -2.0% -1.0% +13.8% ➖ noise
15 datafusion:vortex-file-compressed -5.5% -2.0% -3.6% +13.8% ➖ noise
15 duckdb:duckdb -2.1% -2.0% -0.1% +15.2% ➖ noise
15 duckdb:vortex-compact -0.1% -2.0% +1.9% +13.8% ➖ noise
15 duckdb:vortex-file-compressed -0.4% -2.0% +1.6% +13.8% ➖ noise
16 datafusion:arrow +4.9% +0.6% +4.3% +13.8% ➖ noise
16 datafusion:vortex-compact -1.6% +0.6% -2.1% +13.8% ➖ noise
16 datafusion:vortex-file-compressed -3.2% +0.6% -3.8% +13.8% ➖ noise
16 duckdb:duckdb +5.4% +0.6% +4.8% +13.8% ➖ noise
16 duckdb:vortex-compact +3.8% +0.6% +3.2% +13.8% ➖ noise
16 duckdb:vortex-file-compressed -1.4% +0.6% -2.0% +13.8% ➖ noise
17 datafusion:arrow -8.8% -5.5% -3.5% +13.8% ➖ noise
17 datafusion:vortex-compact -0.8% -5.5% +5.0% +13.8% ➖ noise
17 datafusion:vortex-file-compressed -0.6% -5.5% +5.2% +14.0% ➖ noise
17 duckdb:duckdb -1.7% -5.5% +4.1% +14.5% ➖ noise
17 duckdb:vortex-compact -0.1% -5.5% +5.7% +16.3% ➖ noise
17 duckdb:vortex-file-compressed -4.7% -5.5% +0.9% +15.6% ➖ noise
18 datafusion:arrow -2.9% -1.5% -1.4% +13.8% ➖ noise
18 datafusion:vortex-compact -0.8% -1.5% +0.8% +13.8% ➖ noise
18 datafusion:vortex-file-compressed -2.8% -1.5% -1.2% +13.8% ➖ noise
18 duckdb:duckdb -0.2% -1.5% +1.4% +13.8% ➖ noise
18 duckdb:vortex-compact +1.1% -1.5% +2.7% +13.8% ➖ noise
18 duckdb:vortex-file-compressed -6.1% -1.5% -4.6% +13.8% ➖ noise
19 datafusion:arrow -2.5% -6.5% +4.3% +16.5% ➖ noise
19 datafusion:vortex-compact +7.0% -6.5% +14.4% +19.2% ➖ noise
19 datafusion:vortex-file-compressed -1.1% -6.5% +5.8% +19.6% ➖ noise
19 duckdb:duckdb +3.6% -6.5% +10.8% +19.1% ➖ noise
19 duckdb:vortex-compact -2.0% -6.5% +4.8% +17.2% ➖ noise
19 duckdb:vortex-file-compressed -4.8% -6.5% +1.8% +18.0% ➖ noise
20 datafusion:arrow +4.7% -7.5% +13.2% +13.8% ➖ noise
20 datafusion:vortex-compact +0.2% -7.5% +8.3% +13.8% ➖ noise
20 datafusion:vortex-file-compressed -4.0% -7.5% +3.8% +13.8% ➖ noise
20 duckdb:duckdb +3.7% -7.5% +12.2% +13.8% ➖ noise
20 duckdb:vortex-compact +0.5% -7.5% +8.7% +14.6% ➖ noise
20 duckdb:vortex-file-compressed -2.3% -7.5% +5.7% +19.4% ➖ noise
21 datafusion:arrow -0.0% +1.8% -1.8% +13.8% ➖ noise
21 datafusion:vortex-compact +0.2% +1.8% -1.6% +13.8% ➖ noise
21 datafusion:vortex-file-compressed -0.4% +1.8% -2.2% +13.8% ➖ noise
21 duckdb:duckdb -2.0% +1.8% -3.7% +13.8% ➖ noise
21 duckdb:vortex-compact -1.0% +1.8% -2.7% +13.8% ➖ noise
21 duckdb:vortex-file-compressed -1.0% +1.8% -2.8% +13.8% ➖ noise
22 datafusion:arrow +5.3% -0.3% +5.6% +17.0% ➖ noise
22 datafusion:vortex-compact -3.0% -0.3% -2.7% +14.3% ➖ noise
22 datafusion:vortex-file-compressed -2.3% -0.3% -2.1% +13.8% ➖ noise
22 duckdb:duckdb -1.0% -0.3% -0.7% +13.8% ➖ noise
22 duckdb:vortex-compact -5.0% -0.3% -4.8% +13.8% ➖ noise
22 duckdb:vortex-file-compressed -4.5% -0.3% -4.3% +13.8% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.2%
Vortex (geomean): 1.012x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) -0.0% · Median polish +1.6%


datafusion / vortex-file-compressed (0.930x ➖, 3↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4485280 5583159 0.80
fineweb_q01/datafusion:vortex-file-compressed 25463359 27711710 0.92
fineweb_q02/datafusion:vortex-file-compressed 🚀 27358390 31455913 0.87
fineweb_q03/datafusion:vortex-file-compressed 86977043 80110221 1.09
fineweb_q04/datafusion:vortex-file-compressed 227689999 232642149 0.98
fineweb_q05/datafusion:vortex-file-compressed 201163359 206264634 0.98
fineweb_q06/datafusion:vortex-file-compressed 71971375 71657405 1.00
fineweb_q07/datafusion:vortex-file-compressed 68094183 74071771 0.92
fineweb_q08/datafusion:vortex-file-compressed 🚀 22904156 27056281 0.85
datafusion / vortex-compact (1.053x ➖, 0↑ 2↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 4966842 4307343 1.15
fineweb_q01/datafusion:vortex-compact 161071507 163745266 0.98
fineweb_q02/datafusion:vortex-compact 162941837 166489398 0.98
fineweb_q03/datafusion:vortex-compact 1434178449 1457866946 0.98
fineweb_q04/datafusion:vortex-compact 1606649997 1625918277 0.99
fineweb_q05/datafusion:vortex-compact 1288144982 1241937625 1.04
fineweb_q06/datafusion:vortex-compact 717197317 698314370 1.03
fineweb_q07/datafusion:vortex-compact 808548909 736134295 1.10
fineweb_q08/datafusion:vortex-compact 🚨 31049720 24691781 1.26
datafusion / parquet (0.973x ➖, 1↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 5640792 6427107 0.88
fineweb_q01/datafusion:parquet 271386173 280135658 0.97
fineweb_q02/datafusion:parquet 274588308 284879066 0.96
fineweb_q03/datafusion:parquet 273466611 276365965 0.99
fineweb_q04/datafusion:parquet 288936135 288476614 1.00
fineweb_q05/datafusion:parquet 283384445 282802111 1.00
fineweb_q06/datafusion:parquet 275220258 284328104 0.97
fineweb_q07/datafusion:parquet 274312693 274527830 1.00
fineweb_q08/datafusion:parquet 266050269 268433745 0.99
duckdb / vortex-file-compressed (1.007x ➖, 1↑ 2↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 4077581 3588483 1.14
fineweb_q01/duckdb:vortex-file-compressed 27829090 30837459 0.90
fineweb_q02/duckdb:vortex-file-compressed 26072875 27718852 0.94
fineweb_q03/duckdb:vortex-file-compressed 🚀 125318934 155490360 0.81
fineweb_q04/duckdb:vortex-file-compressed 218257875 213812172 1.02
fineweb_q05/duckdb:vortex-file-compressed 203166571 191708689 1.06
fineweb_q06/duckdb:vortex-file-compressed 72632021 70113802 1.04
fineweb_q07/duckdb:vortex-file-compressed 67974540 72553769 0.94
fineweb_q08/duckdb:vortex-file-compressed 🚨 33076595 25255783 1.31
duckdb / vortex-compact (1.062x ➖, 0↑ 2↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 5760336 4191809 1.37
fineweb_q01/duckdb:vortex-compact 109238968 114025781 0.96
fineweb_q02/duckdb:vortex-compact 127314213 118671170 1.07
fineweb_q03/duckdb:vortex-compact 875613489 864813591 1.01
fineweb_q04/duckdb:vortex-compact 🚨 1010200438 912789276 1.11
fineweb_q05/duckdb:vortex-compact 842949058 815465856 1.03
fineweb_q06/duckdb:vortex-compact 474367890 469163240 1.01
fineweb_q07/duckdb:vortex-compact 477836314 482449730 0.99
fineweb_q08/duckdb:vortex-compact 23499245 22448175 1.05
duckdb / parquet (1.028x ➖, 0↑ 1↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 35045864 35964458 0.97
fineweb_q01/duckdb:parquet 96620722 95239451 1.01
fineweb_q02/duckdb:parquet 101231780 98816970 1.02
fineweb_q03/duckdb:parquet 319860667 312783080 1.02
fineweb_q04/duckdb:parquet 455439244 444763685 1.02
fineweb_q05/duckdb:parquet 435111783 414148229 1.05
fineweb_q06/duckdb:parquet 203998659 201099195 1.01
fineweb_q07/duckdb:parquet 214018639 212224356 1.01
fineweb_q08/duckdb:parquet 🚨 66511223 59312444 1.12
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +15.3% -7.5% +24.7% +47.9% ➖ noise
0 datafusion:vortex-file-compressed -19.7% -7.5% -13.1% +82.2% ➖ noise
0 duckdb:vortex-compact +37.4% -7.5% +48.6% +46.6% 🚨 regression
0 duckdb:vortex-file-compressed +13.6% -7.5% +22.9% +54.9% ➖ noise
1 datafusion:vortex-compact -1.6% -0.9% -0.8% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -8.1% -0.9% -7.3% +18.9% ➖ noise
1 duckdb:vortex-compact -4.2% -0.9% -3.4% +20.1% ➖ noise
1 duckdb:vortex-file-compressed -9.8% -0.9% -9.0% +51.9% ➖ noise
2 datafusion:vortex-compact -2.1% -0.6% -1.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -13.0% -0.6% -12.5% +10.0% ✅ faster
2 duckdb:vortex-compact +7.3% -0.6% +8.0% +14.4% ➖ noise
2 duckdb:vortex-file-compressed -5.9% -0.6% -5.3% +10.3% ➖ noise
3 datafusion:vortex-compact -1.6% +0.6% -2.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +8.6% +0.6% +7.9% +23.0% ➖ noise
3 duckdb:vortex-compact +1.2% +0.6% +0.7% +10.6% ➖ noise
3 duckdb:vortex-file-compressed -19.4% +0.6% -19.9% +31.7% ➖ noise
4 datafusion:vortex-compact -1.2% +1.3% -2.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.1% +1.3% -3.4% +10.0% ➖ noise
4 duckdb:vortex-compact +10.7% +1.3% +9.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.1% +1.3% +0.8% +17.9% ➖ noise
5 datafusion:vortex-compact +3.7% +2.6% +1.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.5% +2.6% -4.9% +10.0% ➖ noise
5 duckdb:vortex-compact +3.4% +2.6% +0.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +6.0% +2.6% +3.3% +10.0% ➖ noise
6 datafusion:vortex-compact +2.7% -0.9% +3.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.4% -0.9% +1.4% +10.2% ➖ noise
6 duckdb:vortex-compact +1.1% -0.9% +2.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +3.6% -0.9% +4.5% +15.0% ➖ noise
7 datafusion:vortex-compact +9.8% +0.4% +9.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -8.1% +0.4% -8.4% +10.6% ➖ noise
7 duckdb:vortex-compact -1.0% +0.4% -1.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -6.3% +0.4% -6.7% +18.6% ➖ noise
8 datafusion:vortex-compact +25.7% +5.4% +19.3% +23.6% ➖ noise
8 datafusion:vortex-file-compressed -15.3% +5.4% -19.7% +22.0% ✅ faster
8 duckdb:vortex-compact +4.7% +5.4% -0.7% +21.0% ➖ noise
8 duckdb:vortex-file-compressed +31.0% +5.4% +24.2% +32.4% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 1.001x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.0%


datafusion / vortex-file-compressed (1.001x ➖, 0↑ 2↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27108957 28530527 0.95
tpcds_q02/datafusion:vortex-file-compressed 77282715 73043068 1.06
tpcds_q03/datafusion:vortex-file-compressed 28017644 26738620 1.05
tpcds_q04/datafusion:vortex-file-compressed 383341950 381438999 1.00
tpcds_q05/datafusion:vortex-file-compressed 72618756 73623579 0.99
tpcds_q06/datafusion:vortex-file-compressed 75886427 75171530 1.01
tpcds_q07/datafusion:vortex-file-compressed 75126643 75899931 0.99
tpcds_q08/datafusion:vortex-file-compressed 40928184 39632880 1.03
tpcds_q09/datafusion:vortex-file-compressed 47675524 46386249 1.03
tpcds_q10/datafusion:vortex-file-compressed 48285761 47744105 1.01
tpcds_q11/datafusion:vortex-file-compressed 230695055 220952912 1.04
tpcds_q12/datafusion:vortex-file-compressed 35785861 36015978 0.99
tpcds_q13/datafusion:vortex-file-compressed 77581367 78589809 0.99
tpcds_q14/datafusion:vortex-file-compressed 214367886 218705732 0.98
tpcds_q15/datafusion:vortex-file-compressed 47950696 48506061 0.99
tpcds_q16/datafusion:vortex-file-compressed 28238623 29241975 0.97
tpcds_q17/datafusion:vortex-file-compressed 106053088 109226461 0.97
tpcds_q18/datafusion:vortex-file-compressed 97745193 98207772 1.00
tpcds_q19/datafusion:vortex-file-compressed 46078563 46295045 1.00
tpcds_q20/datafusion:vortex-file-compressed 39130091 39199952 1.00
tpcds_q21/datafusion:vortex-file-compressed 166191043 172139741 0.97
tpcds_q22/datafusion:vortex-file-compressed 68444583 72209500 0.95
tpcds_q23/datafusion:vortex-file-compressed 186257009 185094538 1.01
tpcds_q24/datafusion:vortex-file-compressed 178368051 176768687 1.01
tpcds_q25/datafusion:vortex-file-compressed 108274029 109704897 0.99
tpcds_q26/datafusion:vortex-file-compressed 57160849 60860314 0.94
tpcds_q27/datafusion:vortex-file-compressed 167274154 168169378 0.99
tpcds_q28/datafusion:vortex-file-compressed 49267392 49062279 1.00
tpcds_q29/datafusion:vortex-file-compressed 108112405 109042741 0.99
tpcds_q30/datafusion:vortex-file-compressed 28914226 29047145 1.00
tpcds_q31/datafusion:vortex-file-compressed 175139227 175164480 1.00
tpcds_q32/datafusion:vortex-file-compressed 24166155 23542517 1.03
tpcds_q33/datafusion:vortex-file-compressed 36362482 37725041 0.96
tpcds_q34/datafusion:vortex-file-compressed 38543066 38051567 1.01
tpcds_q35/datafusion:vortex-file-compressed 59401940 61720791 0.96
tpcds_q36/datafusion:vortex-file-compressed 108260498 104472449 1.04
tpcds_q37/datafusion:vortex-file-compressed 39522303 37657179 1.05
tpcds_q38/datafusion:vortex-file-compressed 86454105 84161364 1.03
tpcds_q39/datafusion:vortex-file-compressed 🚨 208781165 186980357 1.12
tpcds_q40/datafusion:vortex-file-compressed 55918172 59102090 0.95
tpcds_q41/datafusion:vortex-file-compressed 12974743 13154567 0.99
tpcds_q42/datafusion:vortex-file-compressed 28756292 29979187 0.96
tpcds_q43/datafusion:vortex-file-compressed 46772244 47947056 0.98
tpcds_q44/datafusion:vortex-file-compressed 42424801 42801575 0.99
tpcds_q45/datafusion:vortex-file-compressed 49069775 47331404 1.04
tpcds_q46/datafusion:vortex-file-compressed 65243979 63536549 1.03
tpcds_q47/datafusion:vortex-file-compressed 271975834 270957298 1.00
tpcds_q48/datafusion:vortex-file-compressed 68522242 67671257 1.01
tpcds_q49/datafusion:vortex-file-compressed 70454163 67185002 1.05
tpcds_q50/datafusion:vortex-file-compressed 73197829 73111644 1.00
tpcds_q51/datafusion:vortex-file-compressed 93291308 91312069 1.02
tpcds_q52/datafusion:vortex-file-compressed 30618027 29939030 1.02
tpcds_q53/datafusion:vortex-file-compressed 29542383 28895717 1.02
tpcds_q54/datafusion:vortex-file-compressed 47244939 47178191 1.00
tpcds_q55/datafusion:vortex-file-compressed 30799883 31293598 0.98
tpcds_q56/datafusion:vortex-file-compressed 46633062 45463593 1.03
tpcds_q57/datafusion:vortex-file-compressed 179845781 179020260 1.00
tpcds_q58/datafusion:vortex-file-compressed 108485153 106572730 1.02
tpcds_q59/datafusion:vortex-file-compressed 91306849 92956439 0.98
tpcds_q60/datafusion:vortex-file-compressed 43715242 46687329 0.94
tpcds_q61/datafusion:vortex-file-compressed 58205500 57664211 1.01
tpcds_q62/datafusion:vortex-file-compressed 43382777 43932428 0.99
tpcds_q63/datafusion:vortex-file-compressed 29098207 29096623 1.00
tpcds_q64/datafusion:vortex-file-compressed 703508665 688453577 1.02
tpcds_q65/datafusion:vortex-file-compressed 48756247 48974008 1.00
tpcds_q66/datafusion:vortex-file-compressed 104822004 101777611 1.03
tpcds_q67/datafusion:vortex-file-compressed 144161239 142187414 1.01
tpcds_q68/datafusion:vortex-file-compressed 63782651 67265697 0.95
tpcds_q69/datafusion:vortex-file-compressed 45500772 46544098 0.98
tpcds_q70/datafusion:vortex-file-compressed 129085906 129444502 1.00
tpcds_q71/datafusion:vortex-file-compressed 30610790 29249167 1.05
tpcds_q72/datafusion:vortex-file-compressed 3296766790 3348296197 0.98
tpcds_q73/datafusion:vortex-file-compressed 38056169 38682361 0.98
tpcds_q74/datafusion:vortex-file-compressed 162889287 162423890 1.00
tpcds_q75/datafusion:vortex-file-compressed 130169817 136509145 0.95
tpcds_q76/datafusion:vortex-file-compressed 62026638 59527441 1.04
tpcds_q77/datafusion:vortex-file-compressed 52806601 53071773 1.00
tpcds_q78/datafusion:vortex-file-compressed 174096053 177967101 0.98
tpcds_q79/datafusion:vortex-file-compressed 43428887 41236522 1.05
tpcds_q80/datafusion:vortex-file-compressed 115426788 116535714 0.99
tpcds_q81/datafusion:vortex-file-compressed 33305549 36227403 0.92
tpcds_q82/datafusion:vortex-file-compressed 39565869 40506956 0.98
tpcds_q83/datafusion:vortex-file-compressed 63507579 64840765 0.98
tpcds_q84/datafusion:vortex-file-compressed 14639325 14665817 1.00
tpcds_q85/datafusion:vortex-file-compressed 134592241 132444154 1.02
tpcds_q86/datafusion:vortex-file-compressed 30780447 29806432 1.03
tpcds_q87/datafusion:vortex-file-compressed 87016708 86623679 1.00
tpcds_q88/datafusion:vortex-file-compressed 81988568 78722794 1.04
tpcds_q89/datafusion:vortex-file-compressed 56374504 58252449 0.97
tpcds_q90/datafusion:vortex-file-compressed 16190198 15962066 1.01
tpcds_q91/datafusion:vortex-file-compressed 27075294 26163284 1.03
tpcds_q92/datafusion:vortex-file-compressed 18773491 19390332 0.97
tpcds_q93/datafusion:vortex-file-compressed 35794716 37092837 0.97
tpcds_q94/datafusion:vortex-file-compressed 26921271 27002262 1.00
tpcds_q95/datafusion:vortex-file-compressed 87124350 88552093 0.98
tpcds_q96/datafusion:vortex-file-compressed 🚨 15744425 14251738 1.10
tpcds_q97/datafusion:vortex-file-compressed 31055332 31045039 1.00
tpcds_q98/datafusion:vortex-file-compressed 47376837 47092101 1.01
tpcds_q99/datafusion:vortex-file-compressed 58998152 58675558 1.01
datafusion / vortex-compact (1.002x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 34549686 35688008 0.97
tpcds_q02/datafusion:vortex-compact 79368822 79380692 1.00
tpcds_q03/datafusion:vortex-compact 33640009 33643313 1.00
tpcds_q04/datafusion:vortex-compact 425561027 425821017 1.00
tpcds_q05/datafusion:vortex-compact 80792093 80844667 1.00
tpcds_q06/datafusion:vortex-compact 82223771 82165880 1.00
tpcds_q07/datafusion:vortex-compact 91605651 89336911 1.03
tpcds_q08/datafusion:vortex-compact 48671821 48802789 1.00
tpcds_q09/datafusion:vortex-compact 94275075 95179382 0.99
tpcds_q10/datafusion:vortex-compact 67037762 65922280 1.02
tpcds_q11/datafusion:vortex-compact 257130184 253689671 1.01
tpcds_q12/datafusion:vortex-compact 37917204 37459071 1.01
tpcds_q13/datafusion:vortex-compact 136299496 140477696 0.97
tpcds_q14/datafusion:vortex-compact 261003722 265726769 0.98
tpcds_q15/datafusion:vortex-compact 53913876 53842768 1.00
tpcds_q16/datafusion:vortex-compact 40184741 39785229 1.01
tpcds_q17/datafusion:vortex-compact 127045381 125051525 1.02
tpcds_q18/datafusion:vortex-compact 115036206 110645834 1.04
tpcds_q19/datafusion:vortex-compact 60652776 57865377 1.05
tpcds_q20/datafusion:vortex-compact 42528380 45435329 0.94
tpcds_q21/datafusion:vortex-compact 183748838 174942431 1.05
tpcds_q22/datafusion:vortex-compact 77101439 76910813 1.00
tpcds_q23/datafusion:vortex-compact 226494531 223664263 1.01
tpcds_q24/datafusion:vortex-compact 207301148 210275258 0.99
tpcds_q25/datafusion:vortex-compact 124463638 127095446 0.98
tpcds_q26/datafusion:vortex-compact 70224461 68158954 1.03
tpcds_q27/datafusion:vortex-compact 201870236 208109799 0.97
tpcds_q28/datafusion:vortex-compact 98417778 99524473 0.99
tpcds_q29/datafusion:vortex-compact 128175062 128459575 1.00
tpcds_q30/datafusion:vortex-compact 34895272 35033495 1.00
tpcds_q31/datafusion:vortex-compact 204793193 207786230 0.99
tpcds_q32/datafusion:vortex-compact 27914945 28789948 0.97
tpcds_q33/datafusion:vortex-compact 51344078 51922496 0.99
tpcds_q34/datafusion:vortex-compact 56762766 56006494 1.01
tpcds_q35/datafusion:vortex-compact 71744127 72380728 0.99
tpcds_q36/datafusion:vortex-compact 127025344 126649173 1.00
tpcds_q37/datafusion:vortex-compact 49573568 50216329 0.99
tpcds_q38/datafusion:vortex-compact 100497112 99476053 1.01
tpcds_q39/datafusion:vortex-compact 211792813 212495539 1.00
tpcds_q40/datafusion:vortex-compact 60433983 58624326 1.03
tpcds_q41/datafusion:vortex-compact 17049021 16018067 1.06
tpcds_q42/datafusion:vortex-compact 34095602 36431893 0.94
tpcds_q43/datafusion:vortex-compact 54874902 53930618 1.02
tpcds_q44/datafusion:vortex-compact 69566079 70835525 0.98
tpcds_q45/datafusion:vortex-compact 53265332 51871251 1.03
tpcds_q46/datafusion:vortex-compact 88283863 89544176 0.99
tpcds_q47/datafusion:vortex-compact 299294074 292209345 1.02
tpcds_q48/datafusion:vortex-compact 107551953 106619677 1.01
tpcds_q49/datafusion:vortex-compact 99110414 98138371 1.01
tpcds_q50/datafusion:vortex-compact 91328128 91010758 1.00
tpcds_q51/datafusion:vortex-compact 101964053 100781394 1.01
tpcds_q52/datafusion:vortex-compact 34924667 36314628 0.96
tpcds_q53/datafusion:vortex-compact 38764740 40208697 0.96
tpcds_q54/datafusion:vortex-compact 63796833 61976725 1.03
tpcds_q55/datafusion:vortex-compact 37634531 36070251 1.04
tpcds_q56/datafusion:vortex-compact 58400271 59302294 0.98
tpcds_q57/datafusion:vortex-compact 197342160 194498930 1.01
tpcds_q58/datafusion:vortex-compact 114608260 114278364 1.00
tpcds_q59/datafusion:vortex-compact 108464206 108221969 1.00
tpcds_q60/datafusion:vortex-compact 58268531 56896498 1.02
tpcds_q61/datafusion:vortex-compact 80729402 82716382 0.98
tpcds_q62/datafusion:vortex-compact 45239644 46246710 0.98
tpcds_q63/datafusion:vortex-compact 38908358 39168601 0.99
tpcds_q64/datafusion:vortex-compact 784374081 763290934 1.03
tpcds_q65/datafusion:vortex-compact 68194190 69454019 0.98
tpcds_q66/datafusion:vortex-compact 109101928 107518948 1.01
tpcds_q67/datafusion:vortex-compact 150565230 144258180 1.04
tpcds_q68/datafusion:vortex-compact 90206141 87818176 1.03
tpcds_q69/datafusion:vortex-compact 63463837 63447702 1.00
tpcds_q70/datafusion:vortex-compact 137923906 144672534 0.95
tpcds_q71/datafusion:vortex-compact 44548632 45035319 0.99
tpcds_q72/datafusion:vortex-compact 3327294748 3342592231 1.00
tpcds_q73/datafusion:vortex-compact 58991047 56433825 1.05
tpcds_q74/datafusion:vortex-compact 181645370 181857144 1.00
tpcds_q75/datafusion:vortex-compact 176277561 172641211 1.02
tpcds_q76/datafusion:vortex-compact 75557453 78403199 0.96
tpcds_q77/datafusion:vortex-compact 65298465 67881273 0.96
tpcds_q78/datafusion:vortex-compact 202010492 197450376 1.02
tpcds_q79/datafusion:vortex-compact 68842086 69055570 1.00
tpcds_q80/datafusion:vortex-compact 135268050 135120872 1.00
tpcds_q81/datafusion:vortex-compact 40947565 40812887 1.00
tpcds_q82/datafusion:vortex-compact 52742784 50803445 1.04
tpcds_q83/datafusion:vortex-compact 65517145 64654440 1.01
tpcds_q84/datafusion:vortex-compact 17505862 18216881 0.96
tpcds_q85/datafusion:vortex-compact 156151018 158472933 0.99
tpcds_q86/datafusion:vortex-compact 32331746 31292722 1.03
tpcds_q87/datafusion:vortex-compact 100815236 102160273 0.99
tpcds_q88/datafusion:vortex-compact 130468132 130950535 1.00
tpcds_q89/datafusion:vortex-compact 65724151 62300632 1.05
tpcds_q90/datafusion:vortex-compact 21822502 21632444 1.01
tpcds_q91/datafusion:vortex-compact 40691968 40965471 0.99
tpcds_q92/datafusion:vortex-compact 21928329 21729023 1.01
tpcds_q93/datafusion:vortex-compact 54579302 52100776 1.05
tpcds_q94/datafusion:vortex-compact 32416691 31745097 1.02
tpcds_q95/datafusion:vortex-compact 96151004 99064831 0.97
tpcds_q96/datafusion:vortex-compact 24419566 23795127 1.03
tpcds_q97/datafusion:vortex-compact 43359635 43166060 1.00
tpcds_q98/datafusion:vortex-compact 55364057 56944860 0.97
tpcds_q99/datafusion:vortex-compact 65894151 65206546 1.01
datafusion / parquet (1.006x ➖, 2↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 38759096 39175614 0.99
tpcds_q02/datafusion:parquet 52880570 50112937 1.06
tpcds_q03/datafusion:parquet 17246400 16056448 1.07
tpcds_q04/datafusion:parquet 359141982 357459206 1.00
tpcds_q05/datafusion:parquet 92258627 91505724 1.01
tpcds_q06/datafusion:parquet 94599561 91114007 1.04
tpcds_q07/datafusion:parquet 135050341 135031765 1.00
tpcds_q08/datafusion:parquet 38492391 37825718 1.02
tpcds_q09/datafusion:parquet 56374210 53540883 1.05
tpcds_q10/datafusion:parquet 105547192 98873121 1.07
tpcds_q11/datafusion:parquet 223964276 224341027 1.00
tpcds_q12/datafusion:parquet 30484426 29501663 1.03
tpcds_q13/datafusion:parquet 140386615 136179283 1.03
tpcds_q14/datafusion:parquet 210927897 207186990 1.02
tpcds_q15/datafusion:parquet 56444176 55998224 1.01
tpcds_q16/datafusion:parquet 32366724 33565122 0.96
tpcds_q17/datafusion:parquet 167512698 165427929 1.01
tpcds_q18/datafusion:parquet 178850593 180632193 0.99
tpcds_q19/datafusion:parquet 34519450 36372740 0.95
tpcds_q20/datafusion:parquet 24116253 23983327 1.01
tpcds_q21/datafusion:parquet 27797859 26057813 1.07
tpcds_q22/datafusion:parquet 163010804 155116921 1.05
tpcds_q23/datafusion:parquet 184684642 180379602 1.02
tpcds_q24/datafusion:parquet 211419981 206138494 1.03
tpcds_q25/datafusion:parquet 174572899 173630509 1.01
tpcds_q26/datafusion:parquet 114679653 119911715 0.96
tpcds_q27/datafusion:parquet 257092641 253424881 1.01
tpcds_q28/datafusion:parquet 51279870 51750498 0.99
tpcds_q29/datafusion:parquet 176359352 174781641 1.01
tpcds_q30/datafusion:parquet 44261136 44023771 1.01
tpcds_q31/datafusion:parquet 103767397 103771913 1.00
tpcds_q32/datafusion:parquet 29363356 29463996 1.00
tpcds_q33/datafusion:parquet 37230610 36135118 1.03
tpcds_q34/datafusion:parquet 36264037 34740822 1.04
tpcds_q35/datafusion:parquet 95537797 93797463 1.02
tpcds_q36/datafusion:parquet 81422055 82320572 0.99
tpcds_q37/datafusion:parquet 26414197 26065376 1.01
tpcds_q38/datafusion:parquet 64263817 62918883 1.02
tpcds_q39/datafusion:parquet 97976708 98501860 0.99
tpcds_q40/datafusion:parquet 36251900 35329247 1.03
tpcds_q41/datafusion:parquet 12016782 11973953 1.00
tpcds_q42/datafusion:parquet 15193111 15567244 0.98
tpcds_q43/datafusion:parquet 27112855 27688219 0.98
tpcds_q44/datafusion:parquet 41288892 38954105 1.06
tpcds_q45/datafusion:parquet 66267769 69042005 0.96
tpcds_q46/datafusion:parquet 52356688 50896645 1.03
tpcds_q47/datafusion:parquet 177536881 182766497 0.97
tpcds_q48/datafusion:parquet 131825417 129180875 1.02
tpcds_q49/datafusion:parquet 73959138 72142919 1.03
tpcds_q50/datafusion:parquet 107185366 111698895 0.96
tpcds_q51/datafusion:parquet 98203530 99022099 0.99
tpcds_q52/datafusion:parquet 16277686 15493771 1.05
tpcds_q53/datafusion:parquet 31270871 31144160 1.00
tpcds_q54/datafusion:parquet 46934736 47377915 0.99
tpcds_q55/datafusion:parquet 16204892 16268371 1.00
tpcds_q56/datafusion:parquet 36357515 36625733 0.99
tpcds_q57/datafusion:parquet 132703210 132744558 1.00
tpcds_q58/datafusion:parquet 73723606 72793830 1.01
tpcds_q59/datafusion:parquet 66038529 68038634 0.97
tpcds_q60/datafusion:parquet 36403144 37108105 0.98
tpcds_q61/datafusion:parquet 66224136 65430025 1.01
tpcds_q62/datafusion:parquet 🚀 41702475 47035411 0.89
tpcds_q63/datafusion:parquet 30801022 30403968 1.01
tpcds_q64/datafusion:parquet 997597384 985100645 1.01
tpcds_q65/datafusion:parquet 51488283 49284237 1.04
tpcds_q66/datafusion:parquet 88152867 88265119 1.00
tpcds_q67/datafusion:parquet 169586971 184735080 0.92
tpcds_q68/datafusion:parquet 52772543 50025863 1.05
tpcds_q69/datafusion:parquet 95553025 93431162 1.02
tpcds_q70/datafusion:parquet 109998775 109483723 1.00
tpcds_q71/datafusion:parquet 28584708 29224247 0.98
tpcds_q72/datafusion:parquet 857820424 853777464 1.00
tpcds_q73/datafusion:parquet 35668380 35580841 1.00
tpcds_q74/datafusion:parquet 131117754 125164514 1.05
tpcds_q75/datafusion:parquet 134256935 131980340 1.02
tpcds_q76/datafusion:parquet 90658568 93683589 0.97
tpcds_q77/datafusion:parquet 59873705 59467317 1.01
tpcds_q78/datafusion:parquet 182467387 181258039 1.01
tpcds_q79/datafusion:parquet 41578208 40001659 1.04
tpcds_q80/datafusion:parquet 112025643 108491735 1.03
tpcds_q81/datafusion:parquet 43296035 42685524 1.01
tpcds_q82/datafusion:parquet 30129181 28541356 1.06
tpcds_q83/datafusion:parquet 53801510 54238544 0.99
tpcds_q84/datafusion:parquet 49454721 48547418 1.02
tpcds_q85/datafusion:parquet 243953824 245365759 0.99
tpcds_q86/datafusion:parquet 20721360 21258326 0.97
tpcds_q87/datafusion:parquet 63686138 65023351 0.98
tpcds_q88/datafusion:parquet 80642439 80330986 1.00
tpcds_q89/datafusion:parquet 37697959 36028859 1.05
tpcds_q90/datafusion:parquet 19137963 18688849 1.02
tpcds_q91/datafusion:parquet 77453444 78509448 0.99
tpcds_q92/datafusion:parquet 24885806 24778492 1.00
tpcds_q93/datafusion:parquet 39794063 37470777 1.06
tpcds_q94/datafusion:parquet 28818308 29299195 0.98
tpcds_q95/datafusion:parquet 130927412 130297925 1.00
tpcds_q96/datafusion:parquet 14889093 14725390 1.01
tpcds_q97/datafusion:parquet 37687490 37651374 1.00
tpcds_q98/datafusion:parquet 35710720 35105850 1.02
tpcds_q99/datafusion:parquet 🚀 46003187 52699746 0.87
duckdb / vortex-file-compressed (1.006x ➖, 1↑ 1↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 26768544 26353762 1.02
tpcds_q02/duckdb:vortex-file-compressed 80129144 82730551 0.97
tpcds_q03/duckdb:vortex-file-compressed 21779893 22352304 0.97
tpcds_q04/duckdb:vortex-file-compressed 106014186 106226359 1.00
tpcds_q05/duckdb:vortex-file-compressed 99651775 100977557 0.99
tpcds_q06/duckdb:vortex-file-compressed 35684747 35617035 1.00
tpcds_q07/duckdb:vortex-file-compressed 24303353 23840141 1.02
tpcds_q08/duckdb:vortex-file-compressed 23918832 23579168 1.01
tpcds_q09/duckdb:vortex-file-compressed 40091649 39819068 1.01
tpcds_q10/duckdb:vortex-file-compressed 36285538 35582864 1.02
tpcds_q11/duckdb:vortex-file-compressed 63141643 59130743 1.07
tpcds_q12/duckdb:vortex-file-compressed 13729939 14398757 0.95
tpcds_q13/duckdb:vortex-file-compressed 35075196 32130032 1.09
tpcds_q14/duckdb:vortex-file-compressed 189510062 194406406 0.97
tpcds_q15/duckdb:vortex-file-compressed 41057026 40771239 1.01
tpcds_q16/duckdb:vortex-file-compressed 29077418 29451631 0.99
tpcds_q17/duckdb:vortex-file-compressed 38669726 38342620 1.01
tpcds_q18/duckdb:vortex-file-compressed 45579895 45935750 0.99
tpcds_q19/duckdb:vortex-file-compressed 33529607 31873445 1.05
tpcds_q20/duckdb:vortex-file-compressed 15199193 16290546 0.93
tpcds_q21/duckdb:vortex-file-compressed 20824588 19153833 1.09
tpcds_q22/duckdb:vortex-file-compressed 107505385 108951775 0.99
tpcds_q23/duckdb:vortex-file-compressed 121096120 127748777 0.95
tpcds_q24/duckdb:vortex-file-compressed 58571457 54099224 1.08
tpcds_q25/duckdb:vortex-file-compressed 37409683 36748750 1.02
tpcds_q26/duckdb:vortex-file-compressed 39903607 38448441 1.04
tpcds_q27/duckdb:vortex-file-compressed 89266914 85986462 1.04
tpcds_q28/duckdb:vortex-file-compressed 38347783 38761031 0.99
tpcds_q29/duckdb:vortex-file-compressed 38586997 38432524 1.00
tpcds_q30/duckdb:vortex-file-compressed 27610699 28985801 0.95
tpcds_q31/duckdb:vortex-file-compressed 25843599 26020401 0.99
tpcds_q32/duckdb:vortex-file-compressed 16387213 16904672 0.97
tpcds_q33/duckdb:vortex-file-compressed 69949190 65612999 1.07
tpcds_q34/duckdb:vortex-file-compressed 19119100 19801735 0.97
tpcds_q35/duckdb:vortex-file-compressed 66560430 62091851 1.07
tpcds_q36/duckdb:vortex-file-compressed 28154043 28129711 1.00
tpcds_q37/duckdb:vortex-file-compressed 21533163 22677766 0.95
tpcds_q38/duckdb:vortex-file-compressed 37794929 37271953 1.01
tpcds_q39/duckdb:vortex-file-compressed 46757008 44374967 1.05
tpcds_q40/duckdb:vortex-file-compressed 23945514 23817357 1.01
tpcds_q41/duckdb:vortex-file-compressed 12947745 13071100 0.99
tpcds_q42/duckdb:vortex-file-compressed 11748214 12254228 0.96
tpcds_q43/duckdb:vortex-file-compressed 20209986 19923853 1.01
tpcds_q44/duckdb:vortex-file-compressed 24849753 24756229 1.00
tpcds_q45/duckdb:vortex-file-compressed 27550619 27208927 1.01
tpcds_q46/duckdb:vortex-file-compressed 46850092 47276483 0.99
tpcds_q47/duckdb:vortex-file-compressed 48620243 48070551 1.01
tpcds_q48/duckdb:vortex-file-compressed 30962559 28984475 1.07
tpcds_q49/duckdb:vortex-file-compressed 32062633 30764597 1.04
tpcds_q50/duckdb:vortex-file-compressed 34643605 34095656 1.02
tpcds_q51/duckdb:vortex-file-compressed 101013547 97468896 1.04
tpcds_q52/duckdb:vortex-file-compressed 12289373 11906195 1.03
tpcds_q53/duckdb:vortex-file-compressed 17204788 17002736 1.01
tpcds_q54/duckdb:vortex-file-compressed 50952359 48588927 1.05
tpcds_q55/duckdb:vortex-file-compressed 12160041 11397257 1.07
tpcds_q56/duckdb:vortex-file-compressed 63839122 64737912 0.99
tpcds_q57/duckdb:vortex-file-compressed 46278796 44612066 1.04
tpcds_q58/duckdb:vortex-file-compressed 🚨 37016253 33479649 1.11
tpcds_q59/duckdb:vortex-file-compressed 56613736 55770700 1.02
tpcds_q60/duckdb:vortex-file-compressed 69359768 68704235 1.01
tpcds_q61/duckdb:vortex-file-compressed 37797522 36071313 1.05
tpcds_q62/duckdb:vortex-file-compressed 17698031 18099288 0.98
tpcds_q63/duckdb:vortex-file-compressed 18236040 17320356 1.05
tpcds_q64/duckdb:vortex-file-compressed 78820808 79823011 0.99
tpcds_q65/duckdb:vortex-file-compressed 24173821 23948445 1.01
tpcds_q66/duckdb:vortex-file-compressed 62977401 58160898 1.08
tpcds_q67/duckdb:vortex-file-compressed 145861645 144848440 1.01
tpcds_q68/duckdb:vortex-file-compressed 40057620 40678494 0.98
tpcds_q69/duckdb:vortex-file-compressed 38000947 37048240 1.03
tpcds_q70/duckdb:vortex-file-compressed 24550504 24905318 0.99
tpcds_q71/duckdb:vortex-file-compressed 20406166 21060544 0.97
tpcds_q72/duckdb:vortex-file-compressed 178046755 177614185 1.00
tpcds_q73/duckdb:vortex-file-compressed 18987511 19539731 0.97
tpcds_q74/duckdb:vortex-file-compressed 51448045 52029530 0.99
tpcds_q75/duckdb:vortex-file-compressed 60161414 59583073 1.01
tpcds_q76/duckdb:vortex-file-compressed 55547354 55437540 1.00
tpcds_q77/duckdb:vortex-file-compressed 65406766 65223749 1.00
tpcds_q78/duckdb:vortex-file-compressed 80346988 78488039 1.02
tpcds_q79/duckdb:vortex-file-compressed 34073581 34531400 0.99
tpcds_q80/duckdb:vortex-file-compressed 90252237 92365010 0.98
tpcds_q81/duckdb:vortex-file-compressed 33189442 33484315 0.99
tpcds_q82/duckdb:vortex-file-compressed 21762188 22303783 0.98
tpcds_q83/duckdb:vortex-file-compressed 27019764 27628528 0.98
tpcds_q84/duckdb:vortex-file-compressed 17268117 16959003 1.02
tpcds_q85/duckdb:vortex-file-compressed 46437975 45325802 1.02
tpcds_q86/duckdb:vortex-file-compressed 17379155 16430224 1.06
tpcds_q87/duckdb:vortex-file-compressed 40856572 39958850 1.02
tpcds_q88/duckdb:vortex-file-compressed 43063425 40506508 1.06
tpcds_q89/duckdb:vortex-file-compressed 19464158 19334985 1.01
tpcds_q90/duckdb:vortex-file-compressed 15033580 15180457 0.99
tpcds_q91/duckdb:vortex-file-compressed 26958235 26728596 1.01
tpcds_q92/duckdb:vortex-file-compressed 14176418 13976675 1.01
tpcds_q93/duckdb:vortex-file-compressed 29416717 28056598 1.05
tpcds_q94/duckdb:vortex-file-compressed 22417234 22934031 0.98
tpcds_q95/duckdb:vortex-file-compressed 143008878 144804529 0.99
tpcds_q96/duckdb:vortex-file-compressed 18461905 18482560 1.00
tpcds_q97/duckdb:vortex-file-compressed 38340996 39147837 0.98
tpcds_q98/duckdb:vortex-file-compressed 18175500 18334348 0.99
tpcds_q99/duckdb:vortex-file-compressed 🚀 32892389 47650767 0.69
duckdb / vortex-compact (0.995x ➖, 1↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 34755901 36569346 0.95
tpcds_q02/duckdb:vortex-compact 125523837 124916778 1.00
tpcds_q03/duckdb:vortex-compact 50037649 50749653 0.99
tpcds_q04/duckdb:vortex-compact 125211265 125717941 1.00
tpcds_q05/duckdb:vortex-compact 172922336 171871729 1.01
tpcds_q06/duckdb:vortex-compact 41164880 41679849 0.99
tpcds_q07/duckdb:vortex-compact 39051561 38923552 1.00
tpcds_q08/duckdb:vortex-compact 28891738 29370770 0.98
tpcds_q09/duckdb:vortex-compact 109711562 111849871 0.98
tpcds_q10/duckdb:vortex-compact 47157323 47883688 0.98
tpcds_q11/duckdb:vortex-compact 77751421 76673691 1.01
tpcds_q12/duckdb:vortex-compact 20248493 18486835 1.10
tpcds_q13/duckdb:vortex-compact 54070248 54234347 1.00
tpcds_q14/duckdb:vortex-compact 290079926 296129063 0.98
tpcds_q15/duckdb:vortex-compact 45687862 44920306 1.02
tpcds_q16/duckdb:vortex-compact 37154888 37602275 0.99
tpcds_q17/duckdb:vortex-compact 52823044 52309741 1.01
tpcds_q18/duckdb:vortex-compact 66949731 66950970 1.00
tpcds_q19/duckdb:vortex-compact 40318743 43332458 0.93
tpcds_q20/duckdb:vortex-compact 20248366 20166809 1.00
tpcds_q21/duckdb:vortex-compact 28335591 28358979 1.00
tpcds_q22/duckdb:vortex-compact 116662081 120791692 0.97
tpcds_q23/duckdb:vortex-compact 172720731 177320904 0.97
tpcds_q24/duckdb:vortex-compact 77652518 77850002 1.00
tpcds_q25/duckdb:vortex-compact 50197131 50495031 0.99
tpcds_q26/duckdb:vortex-compact 50440396 51940378 0.97
tpcds_q27/duckdb:vortex-compact 139381023 141863687 0.98
tpcds_q28/duckdb:vortex-compact 109039261 108123171 1.01
tpcds_q29/duckdb:vortex-compact 53329958 51972010 1.03
tpcds_q30/duckdb:vortex-compact 34163239 35972702 0.95
tpcds_q31/duckdb:vortex-compact 30330357 29473329 1.03
tpcds_q32/duckdb:vortex-compact 22549237 23383449 0.96
tpcds_q33/duckdb:vortex-compact 142574184 144743323 0.99
tpcds_q34/duckdb:vortex-compact 30117015 30032416 1.00
tpcds_q35/duckdb:vortex-compact 71125299 72125483 0.99
tpcds_q36/duckdb:vortex-compact 34958292 35133259 1.00
tpcds_q37/duckdb:vortex-compact 32324329 29763115 1.09
tpcds_q38/duckdb:vortex-compact 42177108 38714721 1.09
tpcds_q39/duckdb:vortex-compact 53586517 55147365 0.97
tpcds_q40/duckdb:vortex-compact 29485037 28773228 1.02
tpcds_q41/duckdb:vortex-compact 16972514 16758222 1.01
tpcds_q42/duckdb:vortex-compact 15541309 15599643 1.00
tpcds_q43/duckdb:vortex-compact 24652344 24809275 0.99
tpcds_q44/duckdb:vortex-compact 35266676 35445393 0.99
tpcds_q45/duckdb:vortex-compact 32658957 31839090 1.03
tpcds_q46/duckdb:vortex-compact 61409636 63501785 0.97
tpcds_q47/duckdb:vortex-compact 55485664 54203256 1.02
tpcds_q48/duckdb:vortex-compact 46194904 44442323 1.04
tpcds_q49/duckdb:vortex-compact 48504067 49488700 0.98
tpcds_q50/duckdb:vortex-compact 55381428 55978992 0.99
tpcds_q51/duckdb:vortex-compact 104631259 102686399 1.02
tpcds_q52/duckdb:vortex-compact 15721473 15061420 1.04
tpcds_q53/duckdb:vortex-compact 22837341 22609110 1.01
tpcds_q54/duckdb:vortex-compact 85698797 86667193 0.99
tpcds_q55/duckdb:vortex-compact 15184003 15533155 0.98
tpcds_q56/duckdb:vortex-compact 141655069 146032552 0.97
tpcds_q57/duckdb:vortex-compact 46582875 48335655 0.96
tpcds_q58/duckdb:vortex-compact 42147209 42892052 0.98
tpcds_q59/duckdb:vortex-compact 67702293 64927390 1.04
tpcds_q60/duckdb:vortex-compact 146072429 153197038 0.95
tpcds_q61/duckdb:vortex-compact 50845844 52719634 0.96
tpcds_q62/duckdb:vortex-compact 22042047 22134012 1.00
tpcds_q63/duckdb:vortex-compact 22609376 22404565 1.01
tpcds_q64/duckdb:vortex-compact 105094485 107098604 0.98
tpcds_q65/duckdb:vortex-compact 28380299 27933364 1.02
tpcds_q66/duckdb:vortex-compact 95507958 102720260 0.93
tpcds_q67/duckdb:vortex-compact 154529060 151510490 1.02
tpcds_q68/duckdb:vortex-compact 57280840 56438005 1.01
tpcds_q69/duckdb:vortex-compact 49840272 48683124 1.02
tpcds_q70/duckdb:vortex-compact 30523779 29167010 1.05
tpcds_q71/duckdb:vortex-compact 26750608 28020611 0.95
tpcds_q72/duckdb:vortex-compact 198639112 201072838 0.99
tpcds_q73/duckdb:vortex-compact 28404188 28245242 1.01
tpcds_q74/duckdb:vortex-compact 58420662 60239765 0.97
tpcds_q75/duckdb:vortex-compact 70495737 71889666 0.98
tpcds_q76/duckdb:vortex-compact 129917519 135029096 0.96
tpcds_q77/duckdb:vortex-compact 138291368 139845455 0.99
tpcds_q78/duckdb:vortex-compact 89784555 86178796 1.04
tpcds_q79/duckdb:vortex-compact 60964999 61098039 1.00
tpcds_q80/duckdb:vortex-compact 170330581 171349277 0.99
tpcds_q81/duckdb:vortex-compact 40518461 39308535 1.03
tpcds_q82/duckdb:vortex-compact 29923615 31405417 0.95
tpcds_q83/duckdb:vortex-compact 46924134 45102398 1.04
tpcds_q84/duckdb:vortex-compact 20941649 21599883 0.97
tpcds_q85/duckdb:vortex-compact 60754500 63694245 0.95
tpcds_q86/duckdb:vortex-compact 🚀 19612040 24496618 0.80
tpcds_q87/duckdb:vortex-compact 43283099 44760316 0.97
tpcds_q88/duckdb:vortex-compact 46016708 43250438 1.06
tpcds_q89/duckdb:vortex-compact 23612588 23999078 0.98
tpcds_q90/duckdb:vortex-compact 16010468 15734828 1.02
tpcds_q91/duckdb:vortex-compact 46892732 45528666 1.03
tpcds_q92/duckdb:vortex-compact 18990224 19883968 0.96
tpcds_q93/duckdb:vortex-compact 37485567 39021350 0.96
tpcds_q94/duckdb:vortex-compact 26726859 28554381 0.94
tpcds_q95/duckdb:vortex-compact 161670836 162357631 1.00
tpcds_q96/duckdb:vortex-compact 18961282 18529354 1.02
tpcds_q97/duckdb:vortex-compact 42399982 41690823 1.02
tpcds_q98/duckdb:vortex-compact 24074581 22955806 1.05
tpcds_q99/duckdb:vortex-compact 36590387 36265215 1.01
duckdb / parquet (1.000x ➖, 1↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 45453818 43274317 1.05
tpcds_q02/duckdb:parquet 60487172 58825657 1.03
tpcds_q03/duckdb:parquet 11674039 11575973 1.01
tpcds_q04/duckdb:parquet 127738865 123782150 1.03
tpcds_q05/duckdb:parquet 76415638 73751932 1.04
tpcds_q06/duckdb:parquet 28322213 28363130 1.00
tpcds_q07/duckdb:parquet 22937223 22949488 1.00
tpcds_q08/duckdb:parquet 28390731 28613953 0.99
tpcds_q09/duckdb:parquet 39657569 38878163 1.02
tpcds_q10/duckdb:parquet 33775432 35348168 0.96
tpcds_q11/duckdb:parquet 84651459 85467531 0.99
tpcds_q12/duckdb:parquet 14101951 14381402 0.98
tpcds_q13/duckdb:parquet 34502115 33985268 1.02
tpcds_q14/duckdb:parquet 159699672 165366424 0.97
tpcds_q15/duckdb:parquet 29531655 30531221 0.97
tpcds_q16/duckdb:parquet 20997630 21852027 0.96
tpcds_q17/duckdb:parquet 37036440 38242168 0.97
tpcds_q18/duckdb:parquet 45127982 47661221 0.95
tpcds_q19/duckdb:parquet 28948933 29013285 1.00
tpcds_q20/duckdb:parquet 15000848 14909432 1.01
tpcds_q21/duckdb:parquet 11110252 11117498 1.00
tpcds_q22/duckdb:parquet 65928142 68624869 0.96
tpcds_q23/duckdb:parquet 114539117 112552443 1.02
tpcds_q24/duckdb:parquet 43382961 43962932 0.99
tpcds_q25/duckdb:parquet 33414053 32287307 1.03
tpcds_q26/duckdb:parquet 38030505 35832055 1.06
tpcds_q27/duckdb:parquet 87954972 88544674 0.99
tpcds_q28/duckdb:parquet 36697710 37002554 0.99
tpcds_q29/duckdb:parquet 36798690 33823956 1.09
tpcds_q30/duckdb:parquet 40267344 38024406 1.06
tpcds_q31/duckdb:parquet 22873613 22087825 1.04
tpcds_q32/duckdb:parquet 11859108 11441640 1.04
tpcds_q33/duckdb:parquet 72249601 70157798 1.03
tpcds_q34/duckdb:parquet 21008410 21101398 1.00
tpcds_q35/duckdb:parquet 59806007 60018361 1.00
tpcds_q36/duckdb:parquet 20583835 20717362 0.99
tpcds_q37/duckdb:parquet 12918290 12819655 1.01
tpcds_q38/duckdb:parquet 35203082 32839943 1.07
tpcds_q39/duckdb:parquet 31225780 32383926 0.96
tpcds_q40/duckdb:parquet 17155940 18087002 0.95
tpcds_q41/duckdb:parquet 7615432 7401124 1.03
tpcds_q42/duckdb:parquet 10120886 10058524 1.01
tpcds_q43/duckdb:parquet 15963034 15465903 1.03
tpcds_q44/duckdb:parquet 22214727 22129234 1.00
tpcds_q45/duckdb:parquet 25464668 26383645 0.97
tpcds_q46/duckdb:parquet 47604794 45271961 1.05
tpcds_q47/duckdb:parquet 45022478 45690670 0.99
tpcds_q48/duckdb:parquet 30556367 30307002 1.01
tpcds_q49/duckdb:parquet 23982677 24454286 0.98
tpcds_q50/duckdb:parquet 24960778 24548253 1.02
tpcds_q51/duckdb:parquet 96096478 98196823 0.98
tpcds_q52/duckdb:parquet 10807673 10691296 1.01
tpcds_q53/duckdb:parquet 15628549 16049521 0.97
tpcds_q54/duckdb:parquet 40084337 41122658 0.97
tpcds_q55/duckdb:parquet 10859316 10815189 1.00
tpcds_q56/duckdb:parquet 66674161 67469995 0.99
tpcds_q57/duckdb:parquet 34753780 33536357 1.04
tpcds_q58/duckdb:parquet 20910215 20928593 1.00
tpcds_q59/duckdb:parquet 36529015 36434694 1.00
tpcds_q60/duckdb:parquet 73636510 71624889 1.03
tpcds_q61/duckdb:parquet 30355898 30652253 0.99
tpcds_q62/duckdb:parquet 🚀 11220880 12635680 0.89
tpcds_q63/duckdb:parquet 15160442 15722353 0.96
tpcds_q64/duckdb:parquet 73933078 72126386 1.03
tpcds_q65/duckdb:parquet 19858099 19967794 0.99
tpcds_q66/duckdb:parquet 55371262 59948035 0.92
tpcds_q67/duckdb:parquet 134947744 134499982 1.00
tpcds_q68/duckdb:parquet 38444857 37426282 1.03
tpcds_q69/duckdb:parquet 37851493 36337925 1.04
tpcds_q70/duckdb:parquet 19443599 19424091 1.00
tpcds_q71/duckdb:parquet 18711855 18117994 1.03
tpcds_q72/duckdb:parquet 164270446 165108470 0.99
tpcds_q73/duckdb:parquet 18151120 18466077 0.98
tpcds_q74/duckdb:parquet 49915439 49113320 1.02
tpcds_q75/duckdb:parquet 52584100 52866582 0.99
tpcds_q76/duckdb:parquet 72383682 68891410 1.05
tpcds_q77/duckdb:parquet 64865642 63553394 1.02
tpcds_q78/duckdb:parquet 73988940 73156366 1.01
tpcds_q79/duckdb:parquet 27063533 27501038 0.98
tpcds_q80/duckdb:parquet 82438808 84481415 0.98
tpcds_q81/duckdb:parquet 46124293 46386016 0.99
tpcds_q82/duckdb:parquet 15156874 16353297 0.93
tpcds_q83/duckdb:parquet 15951094 15492127 1.03
tpcds_q84/duckdb:parquet 19724191 19966340 0.99
tpcds_q85/duckdb:parquet 40616280 40798239 1.00
tpcds_q86/duckdb:parquet 13157599 12344758 1.07
tpcds_q87/duckdb:parquet 36945136 36974934 1.00
tpcds_q88/duckdb:parquet 28977677 28645041 1.01
tpcds_q89/duckdb:parquet 17136848 17272465 0.99
tpcds_q90/duckdb:parquet 8174071 7926534 1.03
tpcds_q91/duckdb:parquet 23226140 23065314 1.01
tpcds_q92/duckdb:parquet 10968213 11362634 0.97
tpcds_q93/duckdb:parquet 29578013 30177656 0.98
tpcds_q94/duckdb:parquet 16297847 17241359 0.95
tpcds_q95/duckdb:parquet 140005923 142155263 0.98
tpcds_q96/duckdb:parquet 8967619 8932327 1.00
tpcds_q97/duckdb:parquet 33740799 34312237 0.98
tpcds_q98/duckdb:parquet 18443027 18689219 0.99
tpcds_q99/duckdb:parquet 20231342 20119733 1.01
duckdb / duckdb (1.000x ➖, 2↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19990793 19868272 1.01
tpcds_q02/duckdb:duckdb 18053626 18408004 0.98
tpcds_q03/duckdb:duckdb 8349656 8546365 0.98
tpcds_q04/duckdb:duckdb 161907136 161722747 1.00
tpcds_q05/duckdb:duckdb 18330489 18674346 0.98
tpcds_q06/duckdb:duckdb 22560731 22397103 1.01
tpcds_q07/duckdb:duckdb 38253798 38135079 1.00
tpcds_q08/duckdb:duckdb 119041942 119164770 1.00
tpcds_q09/duckdb:duckdb 19597732 19625871 1.00
tpcds_q10/duckdb:duckdb 22750915 22654161 1.00
tpcds_q11/duckdb:duckdb 139632005 138094408 1.01
tpcds_q12/duckdb:duckdb 11338935 10914029 1.04
tpcds_q13/duckdb:duckdb 23540815 23200073 1.01
tpcds_q14/duckdb:duckdb 93631064 93802105 1.00
tpcds_q15/duckdb:duckdb 24267563 23182737 1.05
tpcds_q16/duckdb:duckdb 17761714 17197161 1.03
tpcds_q17/duckdb:duckdb 21534498 21813990 0.99
tpcds_q18/duckdb:duckdb 40994072 42625152 0.96
tpcds_q19/duckdb:duckdb 16382237 16285124 1.01
tpcds_q20/duckdb:duckdb 11491489 11765898 0.98
tpcds_q21/duckdb:duckdb 🚀 6426725 7187518 0.89
tpcds_q22/duckdb:duckdb 60646141 62155783 0.98
tpcds_q23/duckdb:duckdb 81326524 78744546 1.03
tpcds_q24/duckdb:duckdb 23888706 23353278 1.02
tpcds_q25/duckdb:duckdb 15930729 16576050 0.96
tpcds_q26/duckdb:duckdb 24355806 25056539 0.97
tpcds_q27/duckdb:duckdb 39933879 40185433 0.99
tpcds_q28/duckdb:duckdb 21279685 20829732 1.02
tpcds_q29/duckdb:duckdb 19767467 19395802 1.02
tpcds_q30/duckdb:duckdb 28948145 28647723 1.01
tpcds_q31/duckdb:duckdb 19646238 20085587 0.98
tpcds_q32/duckdb:duckdb 7237213 6842986 1.06
tpcds_q33/duckdb:duckdb 12326658 12406480 0.99
tpcds_q34/duckdb:duckdb 14607280 13969514 1.05
tpcds_q35/duckdb:duckdb 30135330 32449677 0.93
tpcds_q36/duckdb:duckdb 66444245 67934061 0.98
tpcds_q37/duckdb:duckdb 7461130 7428856 1.00
tpcds_q38/duckdb:duckdb 29765268 29712783 1.00
tpcds_q39/duckdb:duckdb 25536536 25255273 1.01
tpcds_q40/duckdb:duckdb 13506252 13681719 0.99
tpcds_q41/duckdb:duckdb 8308086 8302226 1.00
tpcds_q42/duckdb:duckdb 🚀 5789540 6476515 0.89
tpcds_q43/duckdb:duckdb 10982507 10882980 1.01
tpcds_q44/duckdb:duckdb 13069214 13682545 0.96
tpcds_q45/duckdb:duckdb 17383867 16314125 1.07
tpcds_q46/duckdb:duckdb 35720408 36409643 0.98
tpcds_q47/duckdb:duckdb 40861169 40371001 1.01
tpcds_q48/duckdb:duckdb 21113157 21701241 0.97
tpcds_q49/duckdb:duckdb 16233415 16805506 0.97
tpcds_q50/duckdb:duckdb 13957634 14404351 0.97
tpcds_q51/duckdb:duckdb 89880897 90389320 0.99
tpcds_q52/duckdb:duckdb 7383863 7321110 1.01
tpcds_q53/duckdb:duckdb 11644589 11729889 0.99
tpcds_q54/duckdb:duckdb 16154073 16028985 1.01
tpcds_q55/duckdb:duckdb 6573932 6700544 0.98
tpcds_q56/duckdb:duckdb 13055692 12834593 1.02
tpcds_q57/duckdb:duckdb 32299671 31257183 1.03
tpcds_q58/duckdb:duckdb 11777645 12762673 0.92
tpcds_q59/duckdb:duckdb 34282344 34259750 1.00
tpcds_q60/duckdb:duckdb 14087243 14934916 0.94
tpcds_q61/duckdb:duckdb 14642101 13830319 1.06
tpcds_q62/duckdb:duckdb 9069748 9165885 0.99
tpcds_q63/duckdb:duckdb 11034951 11032245 1.00
tpcds_q64/duckdb:duckdb 54278470 50217680 1.08
tpcds_q65/duckdb:duckdb 31447325 31880023 0.99
tpcds_q66/duckdb:duckdb 23878997 24251498 0.98
tpcds_q67/duckdb:duckdb 129718181 128248428 1.01
tpcds_q68/duckdb:duckdb 24213107 24311010 1.00
tpcds_q69/duckdb:duckdb 22846515 22921846 1.00
tpcds_q70/duckdb:duckdb 14339748 14646923 0.98
tpcds_q71/duckdb:duckdb 12519075 11757519 1.06
tpcds_q72/duckdb:duckdb 42027722 41875909 1.00
tpcds_q73/duckdb:duckdb 10473613 10060468 1.04
tpcds_q74/duckdb:duckdb 96442275 98034037 0.98
tpcds_q75/duckdb:duckdb 42893735 41078810 1.04
tpcds_q76/duckdb:duckdb 11176868 11846900 0.94
tpcds_q77/duckdb:duckdb 11621295 11587354 1.00
tpcds_q78/duckdb:duckdb 62513677 62805336 1.00
tpcds_q79/duckdb:duckdb 17443196 17187190 1.01
tpcds_q80/duckdb:duckdb 27913468 28302763 0.99
tpcds_q81/duckdb:duckdb 38580367 35300058 1.09
tpcds_q82/duckdb:duckdb 8245996 7747571 1.06
tpcds_q83/duckdb:duckdb 9153344 8866649 1.03
tpcds_q84/duckdb:duckdb 13402234 13279955 1.01
tpcds_q85/duckdb:duckdb 22647348 22748869 1.00
tpcds_q86/duckdb:duckdb 10702577 10588910 1.01
tpcds_q87/duckdb:duckdb 33312146 32741076 1.02
tpcds_q88/duckdb:duckdb 23806014 23749051 1.00
tpcds_q89/duckdb:duckdb 13056816 13191801 0.99
tpcds_q90/duckdb:duckdb 5350605 5298630 1.01
tpcds_q91/duckdb:duckdb 12715535 13321036 0.95
tpcds_q92/duckdb:duckdb 9214335 8829801 1.04
tpcds_q93/duckdb:duckdb 21988302 22362873 0.98
tpcds_q94/duckdb:duckdb 13048716 12301541 1.06
tpcds_q95/duckdb:duckdb 108487598 107233362 1.01
tpcds_q96/duckdb:duckdb 4383560 4585154 0.96
tpcds_q97/duckdb:duckdb 29538636 30061947 0.98
tpcds_q98/duckdb:duckdb 13064116 12271273 1.06
tpcds_q99/duckdb:duckdb 16061041 16380041 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -3.2% +1.9% -5.0% +12.9% ➖ noise
1 datafusion:vortex-file-compressed -5.0% +1.9% -6.8% +17.0% ➖ noise
1 duckdb:duckdb +0.6% +1.9% -1.3% +11.9% ➖ noise
1 duckdb:vortex-compact -5.0% +1.9% -6.8% +14.9% ➖ noise
1 duckdb:vortex-file-compressed +1.6% +1.9% -0.4% +18.7% ➖ noise
2 datafusion:vortex-compact -0.0% +4.2% -4.0% +10.5% ➖ noise
2 datafusion:vortex-file-compressed +5.8% +4.2% +1.6% +12.1% ➖ noise
2 duckdb:duckdb -1.9% +4.2% -5.8% +10.3% ➖ noise
2 duckdb:vortex-compact +0.5% +4.2% -3.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -3.1% +4.2% -7.0% +15.1% ➖ noise
3 datafusion:vortex-compact -0.0% +4.1% -3.9% +14.3% ➖ noise
3 datafusion:vortex-file-compressed +4.8% +4.1% +0.7% +13.7% ➖ noise
3 duckdb:duckdb -2.3% +4.1% -6.1% +21.6% ➖ noise
3 duckdb:vortex-compact -1.4% +4.1% -5.3% +16.6% ➖ noise
3 duckdb:vortex-file-compressed -2.6% +4.1% -6.4% +16.8% ➖ noise
4 datafusion:vortex-compact -0.1% +1.8% -1.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.5% +1.8% -1.3% +10.0% ➖ noise
4 duckdb:duckdb +0.1% +1.8% -1.7% +10.0% ➖ noise
4 duckdb:vortex-compact -0.4% +1.8% -2.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.2% +1.8% -2.0% +10.0% ➖ noise
5 datafusion:vortex-compact -0.1% +2.2% -2.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.4% +2.2% -3.5% +10.0% ➖ noise
5 duckdb:duckdb -1.8% +2.2% -4.0% +12.7% ➖ noise
5 duckdb:vortex-compact +0.6% +2.2% -1.6% +11.0% ➖ noise
5 duckdb:vortex-file-compressed -1.3% +2.2% -3.4% +12.4% ➖ noise
6 datafusion:vortex-compact +0.1% +1.8% -1.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.0% +1.8% -0.9% +10.0% ➖ noise
6 duckdb:duckdb +0.7% +1.8% -1.1% +14.4% ➖ noise
6 duckdb:vortex-compact -1.2% +1.8% -3.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.2% +1.8% -1.6% +10.0% ➖ noise
7 datafusion:vortex-compact +2.5% -0.0% +2.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.0% -0.0% -1.0% +10.0% ➖ noise
7 duckdb:duckdb +0.3% -0.0% +0.3% +17.3% ➖ noise
7 duckdb:vortex-compact +0.3% -0.0% +0.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.9% -0.0% +2.0% +10.0% ➖ noise
8 datafusion:vortex-compact -0.3% +0.5% -0.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +3.3% +0.5% +2.8% +10.0% ➖ noise
8 duckdb:duckdb -0.1% +0.5% -0.6% +10.0% ➖ noise
8 duckdb:vortex-compact -1.6% +0.5% -2.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.4% +0.5% +1.0% +10.0% ➖ noise
9 datafusion:vortex-compact -1.0% +3.6% -4.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.8% +3.6% -0.8% +10.0% ➖ noise
9 duckdb:duckdb -0.1% +3.6% -3.6% +10.0% ➖ noise
9 duckdb:vortex-compact -1.9% +3.6% -5.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.7% +3.6% -2.8% +10.0% ➖ noise
10 datafusion:vortex-compact +1.7% +1.0% +0.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.1% +1.0% +0.1% +10.0% ➖ noise
10 duckdb:duckdb +0.4% +1.0% -0.6% +10.0% ➖ noise
10 duckdb:vortex-compact -1.5% +1.0% -2.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.0% +1.0% +1.0% +10.0% ➖ noise
11 datafusion:vortex-compact +1.4% -0.6% +1.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +4.4% -0.6% +5.0% +10.0% ➖ noise
11 duckdb:duckdb +1.1% -0.6% +1.7% +10.0% ➖ noise
11 duckdb:vortex-compact +1.4% -0.6% +2.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +6.8% -0.6% +7.4% +10.0% ➖ noise
12 datafusion:vortex-compact +1.2% +0.7% +0.6% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.6% +0.7% -1.3% +11.0% ➖ noise
12 duckdb:duckdb +3.9% +0.7% +3.2% +12.3% ➖ noise
12 duckdb:vortex-compact +9.5% +0.7% +8.8% +16.2% ➖ noise
12 duckdb:vortex-file-compressed -4.6% +0.7% -5.3% +13.1% ➖ noise
13 datafusion:vortex-compact -3.0% +2.3% -5.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.3% +2.3% -3.5% +10.0% ➖ noise
13 duckdb:duckdb +1.5% +2.3% -0.8% +10.0% ➖ noise
13 duckdb:vortex-compact -0.3% +2.3% -2.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +9.2% +2.3% +6.7% +10.0% ➖ noise
14 datafusion:vortex-compact -1.8% -0.8% -0.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.0% -0.8% -1.1% +10.0% ➖ noise
14 duckdb:duckdb -0.2% -0.8% +0.7% +10.0% ➖ noise
14 duckdb:vortex-compact -2.0% -0.8% -1.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.5% -0.8% -1.7% +10.0% ➖ noise
15 datafusion:vortex-compact +0.1% -1.3% +1.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -1.1% -1.3% +0.1% +10.0% ➖ noise
15 duckdb:duckdb +4.7% -1.3% +6.0% +12.9% ➖ noise
15 duckdb:vortex-compact +1.7% -1.3% +3.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.7% -1.3% +2.0% +10.0% ➖ noise
16 datafusion:vortex-compact +1.0% -3.7% +4.9% +12.2% ➖ noise
16 datafusion:vortex-file-compressed -3.4% -3.7% +0.3% +11.3% ➖ noise
16 duckdb:duckdb +3.3% -3.7% +7.3% +16.7% ➖ noise
16 duckdb:vortex-compact -1.2% -3.7% +2.6% +13.3% ➖ noise
16 duckdb:vortex-file-compressed -1.3% -3.7% +2.6% +15.6% ➖ noise
17 datafusion:vortex-compact +1.6% -1.0% +2.6% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -2.9% -1.0% -2.0% +10.0% ➖ noise
17 duckdb:duckdb -1.3% -1.0% -0.3% +10.0% ➖ noise
17 duckdb:vortex-compact +1.0% -1.0% +2.0% +15.8% ➖ noise
17 duckdb:vortex-file-compressed +0.9% -1.0% +1.8% +10.7% ➖ noise
18 datafusion:vortex-compact +4.0% -3.2% +7.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.5% -3.2% +2.8% +10.0% ➖ noise
18 duckdb:duckdb -3.8% -3.2% -0.7% +10.9% ➖ noise
18 duckdb:vortex-compact -0.0% -3.2% +3.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.8% -3.2% +2.5% +10.0% ➖ noise
19 datafusion:vortex-compact +4.8% -2.7% +7.7% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.5% -2.7% +2.3% +10.0% ➖ noise
19 duckdb:duckdb +0.6% -2.7% +3.4% +10.0% ➖ noise
19 duckdb:vortex-compact -7.0% -2.7% -4.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +5.2% -2.7% +8.1% +10.0% ➖ noise
20 datafusion:vortex-compact -6.4% +0.6% -6.9% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -0.2% +0.6% -0.8% +10.0% ➖ noise
20 duckdb:duckdb -2.3% +0.6% -2.9% +10.0% ➖ noise
20 duckdb:vortex-compact +0.4% +0.6% -0.2% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -6.7% +0.6% -7.2% +16.5% ➖ noise
21 datafusion:vortex-compact +5.0% +3.3% +1.7% +12.3% ➖ noise
21 datafusion:vortex-file-compressed -3.5% +3.3% -6.5% +13.4% ➖ noise
21 duckdb:duckdb -10.6% +3.3% -13.4% +15.4% ✅ faster
21 duckdb:vortex-compact -0.1% +3.3% -3.2% +14.9% ➖ noise
21 duckdb:vortex-file-compressed +8.7% +3.3% +5.3% +14.2% ➖ noise
22 datafusion:vortex-compact +0.2% +0.5% -0.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -5.2% +0.5% -5.7% +12.2% ➖ noise
22 duckdb:duckdb -2.4% +0.5% -2.9% +10.4% ➖ noise
22 duckdb:vortex-compact -3.4% +0.5% -3.9% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -1.3% +0.5% -1.8% +10.0% ➖ noise
23 datafusion:vortex-compact +1.3% +2.1% -0.8% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +0.6% +2.1% -1.4% +10.0% ➖ noise
23 duckdb:duckdb +3.3% +2.1% +1.2% +16.9% ➖ noise
23 duckdb:vortex-compact -2.6% +2.1% -4.6% +10.4% ➖ noise
23 duckdb:vortex-file-compressed -5.2% +2.1% -7.1% +10.0% ➖ noise
24 datafusion:vortex-compact -1.4% +0.6% -2.0% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +0.9% +0.6% +0.3% +10.0% ➖ noise
24 duckdb:duckdb +2.3% +0.6% +1.7% +10.0% ➖ noise
24 duckdb:vortex-compact -0.3% +0.6% -0.9% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +8.3% +0.6% +7.6% +10.0% ➖ noise
25 datafusion:vortex-compact -2.1% +2.0% -4.0% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -1.3% +2.0% -3.2% +10.0% ➖ noise
25 duckdb:duckdb -3.9% +2.0% -5.8% +10.0% ➖ noise
25 duckdb:vortex-compact -0.6% +2.0% -2.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +1.8% +2.0% -0.2% +10.6% ➖ noise
26 datafusion:vortex-compact +3.0% +0.7% +2.3% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -6.1% +0.7% -6.8% +10.1% ➖ noise
26 duckdb:duckdb -2.8% +0.7% -3.5% +13.5% ➖ noise
26 duckdb:vortex-compact -2.9% +0.7% -3.6% +15.8% ➖ noise
26 duckdb:vortex-file-compressed +3.8% +0.7% +3.0% +15.9% ➖ noise
27 datafusion:vortex-compact -3.0% +0.4% -3.4% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -0.5% +0.4% -0.9% +10.0% ➖ noise
27 duckdb:duckdb -0.6% +0.4% -1.0% +16.9% ➖ noise
27 duckdb:vortex-compact -1.8% +0.4% -2.1% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +3.8% +0.4% +3.4% +10.0% ➖ noise
28 datafusion:vortex-compact -1.1% -0.9% -0.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.4% -0.9% +1.3% +10.0% ➖ noise
28 duckdb:duckdb +2.2% -0.9% +3.1% +10.0% ➖ noise
28 duckdb:vortex-compact +0.8% -0.9% +1.7% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -1.1% -0.9% -0.2% +10.0% ➖ noise
29 datafusion:vortex-compact -0.2% +4.8% -4.8% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -0.9% +4.8% -5.4% +10.0% ➖ noise
29 duckdb:duckdb +1.9% +4.8% -2.7% +10.0% ➖ noise
29 duckdb:vortex-compact +2.6% +4.8% -2.1% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +0.4% +4.8% -4.2% +10.0% ➖ noise
30 datafusion:vortex-compact -0.4% +3.2% -3.5% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -0.5% +3.2% -3.5% +10.4% ➖ noise
30 duckdb:duckdb +1.0% +3.2% -2.1% +10.0% ➖ noise
30 duckdb:vortex-compact -5.0% +3.2% -8.0% +13.9% ➖ noise
30 duckdb:vortex-file-compressed -4.7% +3.2% -7.7% +10.0% ➖ noise
31 datafusion:vortex-compact -1.4% +1.8% -3.1% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.0% +1.8% -1.7% +10.0% ➖ noise
31 duckdb:duckdb -2.2% +1.8% -3.9% +10.4% ➖ noise
31 duckdb:vortex-compact +2.9% +1.8% +1.1% +10.8% ➖ noise
31 duckdb:vortex-file-compressed -0.7% +1.8% -2.4% +14.4% ➖ noise
32 datafusion:vortex-compact -3.0% +1.6% -4.6% +10.1% ➖ noise
32 datafusion:vortex-file-compressed +2.6% +1.6% +1.0% +11.9% ➖ noise
32 duckdb:duckdb +5.8% +1.6% +4.1% +15.9% ➖ noise
32 duckdb:vortex-compact -3.6% +1.6% -5.1% +22.5% ➖ noise
32 duckdb:vortex-file-compressed -3.1% +1.6% -4.6% +10.0% ➖ noise
33 datafusion:vortex-compact -1.1% +3.0% -4.0% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -3.6% +3.0% -6.4% +10.0% ➖ noise
33 duckdb:duckdb -0.6% +3.0% -3.5% +10.0% ➖ noise
33 duckdb:vortex-compact -1.5% +3.0% -4.4% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +6.6% +3.0% +3.5% +13.5% ➖ noise
34 datafusion:vortex-compact +1.4% +1.9% -0.6% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +1.3% +1.9% -0.6% +10.0% ➖ noise
34 duckdb:duckdb +4.6% +1.9% +2.6% +10.0% ➖ noise
34 duckdb:vortex-compact +0.3% +1.9% -1.6% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -3.4% +1.9% -5.3% +18.1% ➖ noise
35 datafusion:vortex-compact -0.9% +0.7% -1.6% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -3.8% +0.7% -4.5% +10.0% ➖ noise
35 duckdb:duckdb -7.1% +0.7% -7.8% +11.8% ➖ noise
35 duckdb:vortex-compact -1.4% +0.7% -2.1% +10.8% ➖ noise
35 duckdb:vortex-file-compressed +7.2% +0.7% +6.4% +15.7% ➖ noise
36 datafusion:vortex-compact +0.3% -0.9% +1.2% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +3.6% -0.9% +4.5% +10.0% ➖ noise
36 duckdb:duckdb -2.2% -0.9% -1.3% +10.0% ➖ noise
36 duckdb:vortex-compact -0.5% -0.9% +0.4% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +0.1% -0.9% +1.0% +10.3% ➖ noise
37 datafusion:vortex-compact -1.3% +1.1% -2.3% +11.3% ➖ noise
37 datafusion:vortex-file-compressed +5.0% +1.1% +3.9% +10.0% ➖ noise
37 duckdb:duckdb +0.4% +1.1% -0.6% +16.8% ➖ noise
37 duckdb:vortex-compact +8.6% +1.1% +7.5% +13.8% ➖ noise
37 duckdb:vortex-file-compressed -5.0% +1.1% -6.0% +10.3% ➖ noise
38 datafusion:vortex-compact +1.0% +4.6% -3.4% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +2.7% +4.6% -1.8% +10.0% ➖ noise
38 duckdb:duckdb +0.2% +4.6% -4.3% +10.5% ➖ noise
38 duckdb:vortex-compact +8.9% +4.6% +4.1% +12.6% ➖ noise
38 duckdb:vortex-file-compressed +1.4% +4.6% -3.1% +15.8% ➖ noise
39 datafusion:vortex-compact -0.3% -2.1% +1.8% +15.9% ➖ noise
39 datafusion:vortex-file-compressed +11.7% -2.1% +14.0% +19.8% ➖ noise
39 duckdb:duckdb +1.1% -2.1% +3.2% +10.0% ➖ noise
39 duckdb:vortex-compact -2.8% -2.1% -0.8% +10.0% ➖ noise
39 duckdb:vortex-file-compressed +5.4% -2.1% +7.6% +15.8% ➖ noise
40 datafusion:vortex-compact +3.1% -1.3% +4.5% +13.5% ➖ noise
40 datafusion:vortex-file-compressed -5.4% -1.3% -4.1% +13.4% ➖ noise
40 duckdb:duckdb -1.3% -1.3% +0.1% +13.5% ➖ noise
40 duckdb:vortex-compact +2.5% -1.3% +3.9% +19.2% ➖ noise
40 duckdb:vortex-file-compressed +0.5% -1.3% +1.9% +15.1% ➖ noise
41 datafusion:vortex-compact +6.4% +1.6% +4.7% +18.9% ➖ noise
41 datafusion:vortex-file-compressed -1.4% +1.6% -2.9% +18.0% ➖ noise
41 duckdb:duckdb +0.1% +1.6% -1.5% +10.0% ➖ noise
41 duckdb:vortex-compact +1.3% +1.6% -0.3% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -0.9% +1.6% -2.5% +10.0% ➖ noise
42 datafusion:vortex-compact -6.4% -0.9% -5.6% +12.5% ➖ noise
42 datafusion:vortex-file-compressed -4.1% -0.9% -3.2% +11.9% ➖ noise
42 duckdb:duckdb -10.6% -0.9% -9.8% +14.4% ➖ noise
42 duckdb:vortex-compact -0.4% -0.9% +0.5% +13.8% ➖ noise
42 duckdb:vortex-file-compressed -4.1% -0.9% -3.3% +14.4% ➖ noise
43 datafusion:vortex-compact +1.8% +0.5% +1.2% +10.8% ➖ noise
43 datafusion:vortex-file-compressed -2.5% +0.5% -3.0% +10.0% ➖ noise
43 duckdb:duckdb +0.9% +0.5% +0.4% +10.1% ➖ noise
43 duckdb:vortex-compact -0.6% +0.5% -1.2% +10.0% ➖ noise
43 duckdb:vortex-file-compressed +1.4% +0.5% +0.9% +10.0% ➖ noise
44 datafusion:vortex-compact -1.8% +3.2% -4.8% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -0.9% +3.2% -3.9% +10.0% ➖ noise
44 duckdb:duckdb -4.5% +3.2% -7.4% +10.0% ➖ noise
44 duckdb:vortex-compact -0.5% +3.2% -3.5% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +0.4% +3.2% -2.7% +10.0% ➖ noise
45 datafusion:vortex-compact +2.7% -3.8% +6.7% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +3.7% -3.8% +7.7% +10.0% ➖ noise
45 duckdb:duckdb +6.6% -3.8% +10.7% +11.3% ➖ noise
45 duckdb:vortex-compact +2.6% -3.8% +6.6% +11.4% ➖ noise
45 duckdb:vortex-file-compressed +1.3% -3.8% +5.2% +10.0% ➖ noise
46 datafusion:vortex-compact -1.4% +4.0% -5.2% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +2.7% +4.0% -1.3% +10.0% ➖ noise
46 duckdb:duckdb -1.9% +4.0% -5.7% +10.0% ➖ noise
46 duckdb:vortex-compact -3.3% +4.0% -7.0% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -0.9% +4.0% -4.7% +10.0% ➖ noise
47 datafusion:vortex-compact +2.4% -2.2% +4.7% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +0.4% -2.2% +2.6% +10.0% ➖ noise
47 duckdb:duckdb +1.2% -2.2% +3.5% +10.0% ➖ noise
47 duckdb:vortex-compact +2.4% -2.2% +4.6% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +1.1% -2.2% +3.4% +10.0% ➖ noise
48 datafusion:vortex-compact +0.9% +1.4% -0.6% +10.0% ➖ noise
48 datafusion:vortex-file-compressed +1.3% +1.4% -0.2% +10.8% ➖ noise
48 duckdb:duckdb -2.7% +1.4% -4.1% +10.0% ➖ noise
48 duckdb:vortex-compact +3.9% +1.4% +2.5% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +6.8% +1.4% +5.3% +10.1% ➖ noise
49 datafusion:vortex-compact +1.0% +0.3% +0.7% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +4.9% +0.3% +4.6% +15.0% ➖ noise
49 duckdb:duckdb -3.4% +0.3% -3.7% +14.2% ➖ noise
49 duckdb:vortex-compact -2.0% +0.3% -2.3% +10.0% ➖ noise
49 duckdb:vortex-file-compressed +4.2% +0.3% +3.9% +14.4% ➖ noise
50 datafusion:vortex-compact +0.3% -1.2% +1.6% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +0.1% -1.2% +1.4% +10.0% ➖ noise
50 duckdb:duckdb -3.1% -1.2% -1.9% +16.0% ➖ noise
50 duckdb:vortex-compact -1.1% -1.2% +0.2% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +1.6% -1.2% +2.9% +10.0% ➖ noise
51 datafusion:vortex-compact +1.2% -1.5% +2.7% +11.4% ➖ noise
51 datafusion:vortex-file-compressed +2.2% -1.5% +3.7% +11.5% ➖ noise
51 duckdb:duckdb -0.6% -1.5% +0.9% +10.0% ➖ noise
51 duckdb:vortex-compact +1.9% -1.5% +3.4% +10.5% ➖ noise
51 duckdb:vortex-file-compressed +3.6% -1.5% +5.2% +20.2% ➖ noise
52 datafusion:vortex-compact -3.8% +3.1% -6.7% +10.1% ➖ noise
52 datafusion:vortex-file-compressed +2.3% +3.1% -0.8% +13.4% ➖ noise
52 duckdb:duckdb +0.9% +3.1% -2.1% +14.8% ➖ noise
52 duckdb:vortex-compact +4.4% +3.1% +1.3% +19.5% ➖ noise
52 duckdb:vortex-file-compressed +3.2% +3.1% +0.2% +19.7% ➖ noise
53 datafusion:vortex-compact -3.6% -1.1% -2.5% +10.0% ➖ noise
53 datafusion:vortex-file-compressed +2.2% -1.1% +3.4% +10.0% ➖ noise
53 duckdb:duckdb -0.7% -1.1% +0.4% +11.8% ➖ noise
53 duckdb:vortex-compact +1.0% -1.1% +2.2% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +1.2% -1.1% +2.3% +10.6% ➖ noise
54 datafusion:vortex-compact +2.9% -1.7% +4.8% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +0.1% -1.7% +1.9% +10.0% ➖ noise
54 duckdb:duckdb +0.8% -1.7% +2.6% +10.9% ➖ noise
54 duckdb:vortex-compact -1.1% -1.7% +0.6% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +4.9% -1.7% +6.7% +11.6% ➖ noise
55 datafusion:vortex-compact +4.3% +0.0% +4.3% +15.4% ➖ noise
55 datafusion:vortex-file-compressed -1.6% +0.0% -1.6% +13.0% ➖ noise
55 duckdb:duckdb -1.9% +0.0% -1.9% +22.6% ➖ noise
55 duckdb:vortex-compact -2.2% +0.0% -2.3% +17.8% ➖ noise
55 duckdb:vortex-file-compressed +6.7% +0.0% +6.7% +16.8% ➖ noise
56 datafusion:vortex-compact -1.5% -1.0% -0.6% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +2.6% -1.0% +3.6% +10.0% ➖ noise
56 duckdb:duckdb +1.7% -1.0% +2.7% +14.7% ➖ noise
56 duckdb:vortex-compact -3.0% -1.0% -2.1% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -1.4% -1.0% -0.4% +10.0% ➖ noise
57 datafusion:vortex-compact +1.5% +1.8% -0.3% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +0.5% +1.8% -1.3% +10.0% ➖ noise
57 duckdb:duckdb +3.3% +1.8% +1.5% +16.3% ➖ noise
57 duckdb:vortex-compact -3.6% +1.8% -5.3% +21.6% ➖ noise
57 duckdb:vortex-file-compressed +3.7% +1.8% +1.9% +16.2% ➖ noise
58 datafusion:vortex-compact +0.3% +0.6% -0.3% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +1.8% +0.6% +1.2% +10.0% ➖ noise
58 duckdb:duckdb -7.7% +0.6% -8.3% +19.5% ➖ noise
58 duckdb:vortex-compact -1.7% +0.6% -2.3% +17.4% ➖ noise
58 duckdb:vortex-file-compressed +10.6% +0.6% +9.9% +11.8% ➖ noise
59 datafusion:vortex-compact +0.2% -1.4% +1.6% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -1.8% -1.4% -0.4% +10.0% ➖ noise
59 duckdb:duckdb +0.1% -1.4% +1.4% +10.0% ➖ noise
59 duckdb:vortex-compact +4.3% -1.4% +5.7% +10.1% ➖ noise
59 duckdb:vortex-file-compressed +1.5% -1.4% +2.9% +10.0% ➖ noise
60 datafusion:vortex-compact +2.4% +0.4% +2.0% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -6.4% +0.4% -6.8% +10.0% ➖ noise
60 duckdb:duckdb -5.7% +0.4% -6.1% +13.3% ➖ noise
60 duckdb:vortex-compact -4.7% +0.4% -5.1% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +1.0% +0.4% +0.5% +13.3% ➖ noise
61 datafusion:vortex-compact -2.4% +0.1% -2.5% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +0.9% +0.1% +0.8% +10.0% ➖ noise
61 duckdb:duckdb +5.9% +0.1% +5.7% +10.0% ➖ noise
61 duckdb:vortex-compact -3.6% +0.1% -3.7% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +4.8% +0.1% +4.7% +12.5% ➖ noise
62 datafusion:vortex-compact -2.2% -11.3% +10.2% +10.7% ➖ noise
62 datafusion:vortex-file-compressed -1.3% -11.3% +11.3% +10.8% 🚨 regression
62 duckdb:duckdb -1.0% -11.3% +11.5% +10.0% 🚨 regression
62 duckdb:vortex-compact -0.4% -11.3% +12.2% +29.0% ➖ noise
62 duckdb:vortex-file-compressed -2.2% -11.3% +10.2% +17.2% ➖ noise
63 datafusion:vortex-compact -0.7% -1.2% +0.5% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +0.0% -1.2% +1.2% +10.0% ➖ noise
63 duckdb:duckdb +0.0% -1.2% +1.2% +10.0% ➖ noise
63 duckdb:vortex-compact +0.9% -1.2% +2.1% +10.1% ➖ noise
63 duckdb:vortex-file-compressed +5.3% -1.2% +6.5% +10.8% ➖ noise
64 datafusion:vortex-compact +2.8% +1.9% +0.9% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +2.2% +1.9% +0.3% +10.0% ➖ noise
64 duckdb:duckdb +8.1% +1.9% +6.1% +10.0% ➖ noise
64 duckdb:vortex-compact -1.9% +1.9% -3.7% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -1.3% +1.9% -3.1% +10.0% ➖ noise
65 datafusion:vortex-compact -1.8% +1.9% -3.7% +10.4% ➖ noise
65 datafusion:vortex-file-compressed -0.4% +1.9% -2.3% +11.0% ➖ noise
65 duckdb:duckdb -1.4% +1.9% -3.2% +15.8% ➖ noise
65 duckdb:vortex-compact +1.6% +1.9% -0.3% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +0.9% +1.9% -1.0% +15.0% ➖ noise
66 datafusion:vortex-compact +1.5% -4.0% +5.6% +10.8% ➖ noise
66 datafusion:vortex-file-compressed +3.0% -4.0% +7.2% +10.8% ➖ noise
66 duckdb:duckdb -1.5% -4.0% +2.5% +12.6% ➖ noise
66 duckdb:vortex-compact -7.0% -4.0% -3.2% +12.1% ➖ noise
66 duckdb:vortex-file-compressed +8.3% -4.0% +12.7% +22.5% ➖ noise
67 datafusion:vortex-compact +4.4% -4.0% +8.8% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +1.4% -4.0% +5.6% +10.0% ➖ noise
67 duckdb:duckdb +1.1% -4.0% +5.4% +10.0% ➖ noise
67 duckdb:vortex-compact +2.0% -4.0% +6.3% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +0.7% -4.0% +4.9% +10.0% ➖ noise
68 datafusion:vortex-compact +2.7% +4.1% -1.3% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -5.2% +4.1% -8.9% +10.5% ➖ noise
68 duckdb:duckdb -0.4% +4.1% -4.3% +11.0% ➖ noise
68 duckdb:vortex-compact +1.5% +4.1% -2.5% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -1.5% +4.1% -5.4% +11.4% ➖ noise
69 datafusion:vortex-compact +0.0% +3.2% -3.1% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -2.2% +3.2% -5.3% +15.4% ➖ noise
69 duckdb:duckdb -0.3% +3.2% -3.4% +10.0% ➖ noise
69 duckdb:vortex-compact +2.4% +3.2% -0.8% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +2.6% +3.2% -0.6% +10.0% ➖ noise
70 datafusion:vortex-compact -4.7% +0.3% -4.9% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -0.3% +0.3% -0.6% +10.0% ➖ noise
70 duckdb:duckdb -2.1% +0.3% -2.4% +14.2% ➖ noise
70 duckdb:vortex-compact +4.7% +0.3% +4.4% +10.0% ➖ noise
70 duckdb:vortex-file-compressed -1.4% +0.3% -1.7% +10.0% ➖ noise
71 datafusion:vortex-compact -1.1% +0.5% -1.6% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +4.7% +0.5% +4.1% +10.0% ➖ noise
71 duckdb:duckdb +6.5% +0.5% +5.9% +15.8% ➖ noise
71 duckdb:vortex-compact -4.5% +0.5% -5.0% +12.1% ➖ noise
71 duckdb:vortex-file-compressed -3.1% +0.5% -3.6% +15.7% ➖ noise
72 datafusion:vortex-compact -0.5% -0.0% -0.4% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -1.5% -0.0% -1.5% +10.0% ➖ noise
72 duckdb:duckdb +0.4% -0.0% +0.4% +11.9% ➖ noise
72 duckdb:vortex-compact -1.2% -0.0% -1.2% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.2% -0.0% +0.3% +10.0% ➖ noise
73 datafusion:vortex-compact +4.5% -0.7% +5.3% +10.0% ➖ noise
73 datafusion:vortex-file-compressed -1.6% -0.7% -0.9% +11.7% ➖ noise
73 duckdb:duckdb +4.1% -0.7% +4.9% +10.2% ➖ noise
73 duckdb:vortex-compact +0.6% -0.7% +1.3% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -2.8% -0.7% -2.1% +10.0% ➖ noise
74 datafusion:vortex-compact -0.1% +3.2% -3.2% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +0.3% +3.2% -2.8% +10.0% ➖ noise
74 duckdb:duckdb -1.6% +3.2% -4.7% +10.0% ➖ noise
74 duckdb:vortex-compact -3.0% +3.2% -6.0% +10.0% ➖ noise
74 duckdb:vortex-file-compressed -1.1% +3.2% -4.2% +12.0% ➖ noise
75 datafusion:vortex-compact +2.1% +0.6% +1.5% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -4.6% +0.6% -5.2% +10.0% ➖ noise
75 duckdb:duckdb +4.4% +0.6% +3.8% +10.0% ➖ noise
75 duckdb:vortex-compact -1.9% +0.6% -2.5% +10.3% ➖ noise
75 duckdb:vortex-file-compressed +1.0% +0.6% +0.4% +10.3% ➖ noise
76 datafusion:vortex-compact -3.6% +0.8% -4.4% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +4.2% +0.8% +3.3% +11.3% ➖ noise
76 duckdb:duckdb -5.7% +0.8% -6.4% +21.4% ➖ noise
76 duckdb:vortex-compact -3.8% +0.8% -4.6% +10.0% ➖ noise
76 duckdb:vortex-file-compressed +0.2% +0.8% -0.6% +19.6% ➖ noise
77 datafusion:vortex-compact -3.8% +1.4% -5.1% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -0.5% +1.4% -1.8% +10.0% ➖ noise
77 duckdb:duckdb +0.3% +1.4% -1.1% +10.4% ➖ noise
77 duckdb:vortex-compact -1.1% +1.4% -2.4% +10.8% ➖ noise
77 duckdb:vortex-file-compressed +0.3% +1.4% -1.1% +16.0% ➖ noise
78 datafusion:vortex-compact +2.3% +0.9% +1.4% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -2.2% +0.9% -3.0% +10.0% ➖ noise
78 duckdb:duckdb -0.5% +0.9% -1.4% +10.0% ➖ noise
78 duckdb:vortex-compact +4.2% +0.9% +3.3% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +2.4% +0.9% +1.5% +10.0% ➖ noise
79 datafusion:vortex-compact -0.3% +1.1% -1.4% +11.3% ➖ noise
79 datafusion:vortex-file-compressed +5.3% +1.1% +4.1% +12.3% ➖ noise
79 duckdb:duckdb +1.5% +1.1% +0.3% +11.8% ➖ noise
79 duckdb:vortex-compact -0.2% +1.1% -1.3% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -1.3% +1.1% -2.4% +13.3% ➖ noise
80 datafusion:vortex-compact +0.1% +0.4% -0.3% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -1.0% +0.4% -1.3% +10.0% ➖ noise
80 duckdb:duckdb -1.4% +0.4% -1.7% +15.6% ➖ noise
80 duckdb:vortex-compact -0.6% +0.4% -1.0% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -2.3% +0.4% -2.7% +10.0% ➖ noise
81 datafusion:vortex-compact +0.3% +0.4% -0.1% +13.7% ➖ noise
81 datafusion:vortex-file-compressed -8.1% +0.4% -8.5% +11.9% ➖ noise
81 duckdb:duckdb +9.3% +0.4% +8.8% +12.6% ➖ noise
81 duckdb:vortex-compact +3.1% +0.4% +2.6% +12.5% ➖ noise
81 duckdb:vortex-file-compressed -0.9% +0.4% -1.3% +12.6% ➖ noise
82 datafusion:vortex-compact +3.8% -1.1% +5.0% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -2.3% -1.1% -1.3% +10.0% ➖ noise
82 duckdb:duckdb +6.4% -1.1% +7.6% +14.8% ➖ noise
82 duckdb:vortex-compact -4.7% -1.1% -3.7% +10.0% ➖ noise
82 duckdb:vortex-file-compressed -2.4% -1.1% -1.4% +15.4% ➖ noise
83 datafusion:vortex-compact +1.3% +1.1% +0.3% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -2.1% +1.1% -3.1% +10.0% ➖ noise
83 duckdb:duckdb +3.2% +1.1% +2.1% +13.0% ➖ noise
83 duckdb:vortex-compact +4.0% +1.1% +2.9% +10.7% ➖ noise
83 duckdb:vortex-file-compressed -2.2% +1.1% -3.2% +10.0% ➖ noise
84 datafusion:vortex-compact -3.9% +0.3% -4.2% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -0.2% +0.3% -0.5% +14.7% ➖ noise
84 duckdb:duckdb +0.9% +0.3% +0.6% +10.0% ➖ noise
84 duckdb:vortex-compact -3.0% +0.3% -3.4% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +1.8% +0.3% +1.5% +10.0% ➖ noise
85 datafusion:vortex-compact -1.5% -0.5% -1.0% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +1.6% -0.5% +2.1% +10.0% ➖ noise
85 duckdb:duckdb -0.4% -0.5% +0.1% +11.1% ➖ noise
85 duckdb:vortex-compact -4.6% -0.5% -4.1% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +2.5% -0.5% +3.0% +10.0% ➖ noise
86 datafusion:vortex-compact +3.3% +1.9% +1.4% +13.0% ➖ noise
86 datafusion:vortex-file-compressed +3.3% +1.9% +1.3% +12.3% ➖ noise
86 duckdb:duckdb +1.1% +1.9% -0.8% +14.4% ➖ noise
86 duckdb:vortex-compact -19.9% +1.9% -21.5% +25.0% ✅ faster
86 duckdb:vortex-file-compressed +5.8% +1.9% +3.8% +10.2% ➖ noise
87 datafusion:vortex-compact -1.3% -1.1% -0.2% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +0.5% -1.1% +1.5% +10.0% ➖ noise
87 duckdb:duckdb +1.7% -1.1% +2.8% +14.7% ➖ noise
87 duckdb:vortex-compact -3.3% -1.1% -2.3% +14.9% ➖ noise
87 duckdb:vortex-file-compressed +2.2% -1.1% +3.4% +10.0% ➖ noise
88 datafusion:vortex-compact -0.4% +0.8% -1.1% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +4.1% +0.8% +3.3% +10.0% ➖ noise
88 duckdb:duckdb +0.2% +0.8% -0.5% +10.0% ➖ noise
88 duckdb:vortex-compact +6.4% +0.8% +5.6% +10.2% ➖ noise
88 duckdb:vortex-file-compressed +6.3% +0.8% +5.5% +10.6% ➖ noise
89 datafusion:vortex-compact +5.5% +1.9% +3.5% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -3.2% +1.9% -5.0% +10.0% ➖ noise
89 duckdb:duckdb -1.0% +1.9% -2.9% +12.5% ➖ noise
89 duckdb:vortex-compact -1.6% +1.9% -3.4% +11.0% ➖ noise
89 duckdb:vortex-file-compressed +0.7% +1.9% -1.2% +14.9% ➖ noise
90 datafusion:vortex-compact +0.9% +2.8% -1.8% +20.4% ➖ noise
90 datafusion:vortex-file-compressed +1.4% +2.8% -1.3% +19.8% ➖ noise
90 duckdb:duckdb +1.0% +2.8% -1.7% +20.7% ➖ noise
90 duckdb:vortex-compact +1.8% +2.8% -1.0% +20.6% ➖ noise
90 duckdb:vortex-file-compressed -1.0% +2.8% -3.6% +21.7% ➖ noise
91 datafusion:vortex-compact -0.7% -0.3% -0.3% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +3.5% -0.3% +3.8% +11.1% ➖ noise
91 duckdb:duckdb -4.5% -0.3% -4.2% +34.1% ➖ noise
91 duckdb:vortex-compact +3.0% -0.3% +3.3% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +0.9% -0.3% +1.2% +10.2% ➖ noise
92 datafusion:vortex-compact +0.9% -1.5% +2.5% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -3.2% -1.5% -1.7% +10.0% ➖ noise
92 duckdb:duckdb +4.4% -1.5% +6.0% +12.5% ➖ noise
92 duckdb:vortex-compact -4.5% -1.5% -3.0% +13.7% ➖ noise
92 duckdb:vortex-file-compressed +1.4% -1.5% +3.0% +13.6% ➖ noise
93 datafusion:vortex-compact +4.8% +2.0% +2.7% +11.1% ➖ noise
93 datafusion:vortex-file-compressed -3.5% +2.0% -5.4% +12.2% ➖ noise
93 duckdb:duckdb -1.7% +2.0% -3.6% +15.3% ➖ noise
93 duckdb:vortex-compact -3.9% +2.0% -5.8% +16.6% ➖ noise
93 duckdb:vortex-file-compressed +4.8% +2.0% +2.8% +15.5% ➖ noise
94 datafusion:vortex-compact +2.1% -3.6% +5.9% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -0.3% -3.6% +3.4% +10.0% ➖ noise
94 duckdb:duckdb +6.1% -3.6% +10.0% +10.9% ➖ noise
94 duckdb:vortex-compact -6.4% -3.6% -2.9% +16.0% ➖ noise
94 duckdb:vortex-file-compressed -2.3% -3.6% +1.4% +10.0% ➖ noise
95 datafusion:vortex-compact -2.9% -0.5% -2.4% +10.0% ➖ noise
95 datafusion:vortex-file-compressed -1.6% -0.5% -1.1% +10.0% ➖ noise
95 duckdb:duckdb +1.2% -0.5% +1.7% +17.8% ➖ noise
95 duckdb:vortex-compact -0.4% -0.5% +0.1% +17.5% ➖ noise
95 duckdb:vortex-file-compressed -1.2% -0.5% -0.7% +16.2% ➖ noise
96 datafusion:vortex-compact +2.6% +0.8% +1.9% +11.0% ➖ noise
96 datafusion:vortex-file-compressed +10.5% +0.8% +9.6% +12.5% ➖ noise
96 duckdb:duckdb -4.4% +0.8% -5.1% +15.0% ➖ noise
96 duckdb:vortex-compact +2.3% +0.8% +1.6% +15.9% ➖ noise
96 duckdb:vortex-file-compressed -0.1% +0.8% -0.9% +23.8% ➖ noise
97 datafusion:vortex-compact +0.4% -0.8% +1.2% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +0.0% -0.8% +0.8% +10.0% ➖ noise
97 duckdb:duckdb -1.7% -0.8% -1.0% +10.0% ➖ noise
97 duckdb:vortex-compact +1.7% -0.8% +2.5% +11.0% ➖ noise
97 duckdb:vortex-file-compressed -2.1% -0.8% -1.3% +10.0% ➖ noise
98 datafusion:vortex-compact -2.8% +0.2% -3.0% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +0.6% +0.2% +0.4% +10.0% ➖ noise
98 duckdb:duckdb +6.5% +0.2% +6.3% +11.9% ➖ noise
98 duckdb:vortex-compact +4.9% +0.2% +4.7% +11.3% ➖ noise
98 duckdb:vortex-file-compressed -0.9% +0.2% -1.1% +12.9% ➖ noise
99 datafusion:vortex-compact +1.1% -6.3% +7.9% +21.2% ➖ noise
99 datafusion:vortex-file-compressed +0.5% -6.3% +7.3% +19.6% ➖ noise
99 duckdb:duckdb -1.9% -6.3% +4.7% +42.7% ➖ noise
99 duckdb:vortex-compact +0.9% -6.3% +7.7% +31.8% ➖ noise
99 duckdb:vortex-file-compressed -31.0% -6.3% -26.3% +36.2% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 0.989x ➖
Parquet (geomean): 0.989x ➖
Shifts: Parquet (control) -1.1% · Median polish -1.3%


datafusion / vortex-file-compressed (0.978x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 445236142 443791375 1.00
tpch_q02/datafusion:vortex-file-compressed 159065563 160477311 0.99
tpch_q03/datafusion:vortex-file-compressed 245688009 253852935 0.97
tpch_q04/datafusion:vortex-file-compressed 107245195 108067843 0.99
tpch_q05/datafusion:vortex-file-compressed 468934070 465012396 1.01
tpch_q06/datafusion:vortex-file-compressed 40542907 41171701 0.98
tpch_q07/datafusion:vortex-file-compressed 638710388 650648139 0.98
tpch_q08/datafusion:vortex-file-compressed 475906594 478210253 1.00
tpch_q09/datafusion:vortex-file-compressed 816758737 824511924 0.99
tpch_q10/datafusion:vortex-file-compressed 290325230 299453893 0.97
tpch_q11/datafusion:vortex-file-compressed 115436877 118657081 0.97
tpch_q12/datafusion:vortex-file-compressed 126121394 126514187 1.00
tpch_q13/datafusion:vortex-file-compressed 219554636 228554769 0.96
tpch_q14/datafusion:vortex-file-compressed 74547846 72077464 1.03
tpch_q15/datafusion:vortex-file-compressed 107521128 110454122 0.97
tpch_q16/datafusion:vortex-file-compressed 92932360 95773661 0.97
tpch_q17/datafusion:vortex-file-compressed 730351860 761576912 0.96
tpch_q18/datafusion:vortex-file-compressed 961565334 1002831328 0.96
tpch_q19/datafusion:vortex-file-compressed 124411822 129958494 0.96
tpch_q20/datafusion:vortex-file-compressed 202988203 208463770 0.97
tpch_q21/datafusion:vortex-file-compressed 755219996 775971381 0.97
tpch_q22/datafusion:vortex-file-compressed 58736476 64237891 0.91
datafusion / vortex-compact (0.980x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 486102932 472978840 1.03
tpch_q02/datafusion:vortex-compact 163570125 163783878 1.00
tpch_q03/datafusion:vortex-compact 262808847 275335683 0.95
tpch_q04/datafusion:vortex-compact 126673265 128853581 0.98
tpch_q05/datafusion:vortex-compact 471609368 477688004 0.99
tpch_q06/datafusion:vortex-compact 63139260 64765956 0.97
tpch_q07/datafusion:vortex-compact 674164196 686080942 0.98
tpch_q08/datafusion:vortex-compact 476616579 489998745 0.97
tpch_q09/datafusion:vortex-compact 823630457 845604111 0.97
tpch_q10/datafusion:vortex-compact 329574437 333677247 0.99
tpch_q11/datafusion:vortex-compact 121809003 124153694 0.98
tpch_q12/datafusion:vortex-compact 184659910 188091544 0.98
tpch_q13/datafusion:vortex-compact 272169005 278125334 0.98
tpch_q14/datafusion:vortex-compact 87216043 90521209 0.96
tpch_q15/datafusion:vortex-compact 164456381 169812097 0.97
tpch_q16/datafusion:vortex-compact 95866990 101479566 0.94
tpch_q17/datafusion:vortex-compact 742103877 758732763 0.98
tpch_q18/datafusion:vortex-compact 970579079 993806921 0.98
tpch_q19/datafusion:vortex-compact 232275966 234599181 0.99
tpch_q20/datafusion:vortex-compact 225820234 228215102 0.99
tpch_q21/datafusion:vortex-compact 797941325 813187571 0.98
tpch_q22/datafusion:vortex-compact 69995718 71763149 0.98
datafusion / parquet (0.986x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 496674738 500972669 0.99
tpch_q02/datafusion:parquet 255159288 260071032 0.98
tpch_q03/datafusion:parquet 388291693 398024719 0.98
tpch_q04/datafusion:parquet 150088623 156885776 0.96
tpch_q05/datafusion:parquet 573842843 589082313 0.97
tpch_q06/datafusion:parquet 134565322 123652687 1.09
tpch_q07/datafusion:parquet 795133460 824466698 0.96
tpch_q08/datafusion:parquet 649567400 668100420 0.97
tpch_q09/datafusion:parquet 958501440 993294646 0.96
tpch_q10/datafusion:parquet 601538926 618622044 0.97
tpch_q11/datafusion:parquet 189410954 202847591 0.93
tpch_q12/datafusion:parquet 248654974 246093040 1.01
tpch_q13/datafusion:parquet 341019925 347951801 0.98
tpch_q14/datafusion:parquet 202427806 209571536 0.97
tpch_q15/datafusion:parquet 266526146 258902908 1.03
tpch_q16/datafusion:parquet 182875033 183878671 0.99
tpch_q17/datafusion:parquet 836563596 839872610 1.00
tpch_q18/datafusion:parquet 1034277722 1038765024 1.00
tpch_q19/datafusion:parquet 336245114 333618682 1.01
tpch_q20/datafusion:parquet 371473152 380977852 0.98
tpch_q21/datafusion:parquet 892409135 902455498 0.99
tpch_q22/datafusion:parquet 219052492 221317324 0.99
datafusion / arrow (0.956x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 719042617 749334681 0.96
tpch_q02/datafusion:arrow 198452912 214893079 0.92
tpch_q03/datafusion:arrow 531965315 573851142 0.93
tpch_q04/datafusion:arrow 390790541 409452290 0.95
tpch_q05/datafusion:arrow 1028533710 1087361480 0.95
tpch_q06/datafusion:arrow 307831243 328686711 0.94
tpch_q07/datafusion:arrow 1323380454 1388024689 0.95
tpch_q08/datafusion:arrow 1259937637 1355755091 0.93
tpch_q09/datafusion:arrow 1518620298 1614495767 0.94
tpch_q10/datafusion:arrow 664890988 709194332 0.94
tpch_q11/datafusion:arrow 178761563 183596038 0.97
tpch_q12/datafusion:arrow 811114195 806093251 1.01
tpch_q13/datafusion:arrow 527863419 527372982 1.00
tpch_q14/datafusion:arrow 344249379 371665777 0.93
tpch_q15/datafusion:arrow 739058786 804627850 0.92
tpch_q16/datafusion:arrow 123283932 123872885 1.00
tpch_q17/datafusion:arrow 1539580885 1621058416 0.95
tpch_q18/datafusion:arrow 2110606713 2168926363 0.97
tpch_q19/datafusion:arrow 567419812 592246585 0.96
tpch_q20/datafusion:arrow 549960176 583391683 0.94
tpch_q21/datafusion:arrow 4019091106 4055203384 0.99
tpch_q22/datafusion:arrow 178940111 181439643 0.99
duckdb / vortex-file-compressed (1.005x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 179830988 178623503 1.01
tpch_q02/duckdb:vortex-file-compressed 53449302 53789611 0.99
tpch_q03/duckdb:vortex-file-compressed 128593710 130664806 0.98
tpch_q04/duckdb:vortex-file-compressed 151201468 152523461 0.99
tpch_q05/duckdb:vortex-file-compressed 131077136 131818589 0.99
tpch_q06/duckdb:vortex-file-compressed 53272881 49944289 1.07
tpch_q07/duckdb:vortex-file-compressed 158803839 149923869 1.06
tpch_q08/duckdb:vortex-file-compressed 186928947 177114665 1.06
tpch_q09/duckdb:vortex-file-compressed 336840038 338561419 0.99
tpch_q10/duckdb:vortex-file-compressed 155230712 156395637 0.99
tpch_q11/duckdb:vortex-file-compressed 35338745 34996218 1.01
tpch_q12/duckdb:vortex-file-compressed 94071181 94657738 0.99
tpch_q13/duckdb:vortex-file-compressed 241819607 248950424 0.97
tpch_q14/duckdb:vortex-file-compressed 71458125 71505224 1.00
tpch_q15/duckdb:vortex-file-compressed 98644557 97680302 1.01
tpch_q16/duckdb:vortex-file-compressed 77753436 80342165 0.97
tpch_q17/duckdb:vortex-file-compressed 104323601 105315457 0.99
tpch_q18/duckdb:vortex-file-compressed 294200447 285331954 1.03
tpch_q19/duckdb:vortex-file-compressed 91793585 90056170 1.02
tpch_q20/duckdb:vortex-file-compressed 165701718 164269144 1.01
tpch_q21/duckdb:vortex-file-compressed 560422069 558858918 1.00
tpch_q22/duckdb:vortex-file-compressed 75956787 77880148 0.98
duckdb / vortex-compact (0.992x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229673979 232478354 0.99
tpch_q02/duckdb:vortex-compact 59954126 59456683 1.01
tpch_q03/duckdb:vortex-compact 142086644 142168354 1.00
tpch_q04/duckdb:vortex-compact 180761467 185005548 0.98
tpch_q05/duckdb:vortex-compact 150176810 151679315 0.99
tpch_q06/duckdb:vortex-compact 85786810 85202973 1.01
tpch_q07/duckdb:vortex-compact 205844803 205932173 1.00
tpch_q08/duckdb:vortex-compact 198151518 195030946 1.02
tpch_q09/duckdb:vortex-compact 365312422 367293111 0.99
tpch_q10/duckdb:vortex-compact 186851460 189794942 0.98
tpch_q11/duckdb:vortex-compact 42210477 41818602 1.01
tpch_q12/duckdb:vortex-compact 207754831 210059538 0.99
tpch_q13/duckdb:vortex-compact 291546459 302119082 0.97
tpch_q14/duckdb:vortex-compact 104767619 106768527 0.98
tpch_q15/duckdb:vortex-compact 121552931 122897246 0.99
tpch_q16/duckdb:vortex-compact 89350809 88772355 1.01
tpch_q17/duckdb:vortex-compact 117409820 117942013 1.00
tpch_q18/duckdb:vortex-compact 292549902 302368884 0.97
tpch_q19/duckdb:vortex-compact 117474095 118519788 0.99
tpch_q20/duckdb:vortex-compact 208395166 211165687 0.99
tpch_q21/duckdb:vortex-compact 634915349 635722329 1.00
tpch_q22/duckdb:vortex-compact 89068306 91107965 0.98
duckdb / parquet (0.992x ➖, 1↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 255883105 261906522 0.98
tpch_q02/duckdb:parquet 102417115 106074836 0.97
tpch_q03/duckdb:parquet 214411182 210651990 1.02
tpch_q04/duckdb:parquet 135942153 133189635 1.02
tpch_q05/duckdb:parquet 217020833 220065748 0.99
tpch_q06/duckdb:parquet 68571898 66098626 1.04
tpch_q07/duckdb:parquet 177428568 181949778 0.98
tpch_q08/duckdb:parquet 254283035 258172225 0.98
tpch_q09/duckdb:parquet 464361950 471300455 0.99
tpch_q10/duckdb:parquet 604144580 609796671 0.99
tpch_q11/duckdb:parquet 45956363 42078578 1.09
tpch_q12/duckdb:parquet 125095410 128180209 0.98
tpch_q13/duckdb:parquet 🚀 409131697 462620590 0.88
tpch_q14/duckdb:parquet 172659396 173901431 0.99
tpch_q15/duckdb:parquet 97170273 97506312 1.00
tpch_q16/duckdb:parquet 163910512 164706239 1.00
tpch_q17/duckdb:parquet 178034314 178771076 1.00
tpch_q18/duckdb:parquet 350017296 356802930 0.98
tpch_q19/duckdb:parquet 279114188 279650625 1.00
tpch_q20/duckdb:parquet 227144078 229186376 0.99
tpch_q21/duckdb:parquet 570549189 573068311 1.00
tpch_q22/duckdb:parquet 294721167 292020217 1.01
duckdb / duckdb (0.988x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116946682 117524334 1.00
tpch_q02/duckdb:duckdb 44419185 45803390 0.97
tpch_q03/duckdb:duckdb 99131290 95834667 1.03
tpch_q04/duckdb:duckdb 130943884 135486152 0.97
tpch_q05/duckdb:duckdb 109134788 111460587 0.98
tpch_q06/duckdb:duckdb 36471419 40450457 0.90
tpch_q07/duckdb:duckdb 86827909 86865347 1.00
tpch_q08/duckdb:duckdb 110200157 111255115 0.99
tpch_q09/duckdb:duckdb 277717021 278415259 1.00
tpch_q10/duckdb:duckdb 203626858 204220713 1.00
tpch_q11/duckdb:duckdb 15111114 15513371 0.97
tpch_q12/duckdb:duckdb 81979003 86577480 0.95
tpch_q13/duckdb:duckdb 251921690 253994159 0.99
tpch_q14/duckdb:duckdb 71446429 71061431 1.01
tpch_q15/duckdb:duckdb 77811809 78419592 0.99
tpch_q16/duckdb:duckdb 73416158 75044311 0.98
tpch_q17/duckdb:duckdb 84245994 85048404 0.99
tpch_q18/duckdb:duckdb 212242993 214050695 0.99
tpch_q19/duckdb:duckdb 114604267 116199671 0.99
tpch_q20/duckdb:duckdb 110814143 111247260 1.00
tpch_q21/duckdb:duckdb 301145180 304326498 0.99
tpch_q22/duckdb:duckdb 68306459 64403626 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -4.0% -1.6% -2.5% +12.0% ➖ noise
1 datafusion:vortex-compact +2.8% -1.6% +4.4% +12.8% ➖ noise
1 datafusion:vortex-file-compressed +0.3% -1.6% +1.9% +14.1% ➖ noise
1 duckdb:duckdb -0.5% -1.6% +1.1% +11.9% ➖ noise
1 duckdb:vortex-compact -1.2% -1.6% +0.4% +11.8% ➖ noise
1 duckdb:vortex-file-compressed +0.7% -1.6% +2.3% +12.9% ➖ noise
2 datafusion:arrow -7.7% -2.7% -5.1% +10.0% ➖ noise
2 datafusion:vortex-compact -0.1% -2.7% +2.6% +13.0% ➖ noise
2 datafusion:vortex-file-compressed -0.9% -2.7% +1.8% +10.0% ➖ noise
2 duckdb:duckdb -3.0% -2.7% -0.4% +11.3% ➖ noise
2 duckdb:vortex-compact +0.8% -2.7% +3.6% +11.4% ➖ noise
2 duckdb:vortex-file-compressed -0.6% -2.7% +2.1% +10.0% ➖ noise
3 datafusion:arrow -7.3% -0.4% -7.0% +10.0% ➖ noise
3 datafusion:vortex-compact -4.5% -0.4% -4.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -3.2% -0.4% -2.9% +10.0% ➖ noise
3 duckdb:duckdb +3.4% -0.4% +3.8% +10.0% ➖ noise
3 duckdb:vortex-compact -0.1% -0.4% +0.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.6% -0.4% -1.2% +10.0% ➖ noise
4 datafusion:arrow -4.6% -1.2% -3.4% +10.0% ➖ noise
4 datafusion:vortex-compact -1.7% -1.2% -0.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.8% -1.2% +0.4% +10.0% ➖ noise
4 duckdb:duckdb -3.4% -1.2% -2.2% +10.0% ➖ noise
4 duckdb:vortex-compact -2.3% -1.2% -1.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.9% -1.2% +0.3% +10.0% ➖ noise
5 datafusion:arrow -5.4% -2.0% -3.5% +10.0% ➖ noise
5 datafusion:vortex-compact -1.3% -2.0% +0.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.8% -2.0% +2.9% +10.0% ➖ noise
5 duckdb:duckdb -2.1% -2.0% -0.1% +10.0% ➖ noise
5 duckdb:vortex-compact -1.0% -2.0% +1.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.6% -2.0% +1.5% +10.0% ➖ noise
6 datafusion:arrow -6.3% +6.3% -11.9% +10.0% ✅ faster
6 datafusion:vortex-compact -2.5% +6.3% -8.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.5% +6.3% -7.3% +10.0% ➖ noise
6 duckdb:duckdb -9.8% +6.3% -15.1% +17.3% ✅ faster
6 duckdb:vortex-compact +0.7% +6.3% -5.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +6.7% +6.3% +0.4% +11.1% ➖ noise
7 datafusion:arrow -4.7% -3.0% -1.7% +10.0% ➖ noise
7 datafusion:vortex-compact -1.7% -3.0% +1.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.8% -3.0% +1.2% +10.0% ➖ noise
7 duckdb:duckdb -0.0% -3.0% +3.1% +10.0% ➖ noise
7 duckdb:vortex-compact -0.0% -3.0% +3.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +5.9% -3.0% +9.2% +10.0% ➖ noise
8 datafusion:arrow -7.1% -2.1% -5.0% +10.0% ➖ noise
8 datafusion:vortex-compact -2.7% -2.1% -0.6% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.5% -2.1% +1.7% +10.0% ➖ noise
8 duckdb:duckdb -0.9% -2.1% +1.2% +10.0% ➖ noise
8 duckdb:vortex-compact +1.6% -2.1% +3.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +5.5% -2.1% +7.9% +10.0% ➖ noise
9 datafusion:arrow -5.9% -2.5% -3.5% +10.0% ➖ noise
9 datafusion:vortex-compact -2.6% -2.5% -0.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.9% -2.5% +1.6% +10.0% ➖ noise
9 duckdb:duckdb -0.3% -2.5% +2.3% +10.0% ➖ noise
9 duckdb:vortex-compact -0.5% -2.5% +2.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.5% -2.5% +2.0% +10.0% ➖ noise
10 datafusion:arrow -6.2% -1.8% -4.5% +10.0% ➖ noise
10 datafusion:vortex-compact -1.2% -1.8% +0.6% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -3.0% -1.8% -1.2% +10.0% ➖ noise
10 duckdb:duckdb -0.3% -1.8% +1.6% +10.0% ➖ noise
10 duckdb:vortex-compact -1.6% -1.8% +0.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.7% -1.8% +1.1% +10.0% ➖ noise
11 datafusion:arrow -2.6% +1.0% -3.6% +10.0% ➖ noise
11 datafusion:vortex-compact -1.9% +1.0% -2.8% +10.4% ➖ noise
11 datafusion:vortex-file-compressed -2.7% +1.0% -3.7% +10.0% ➖ noise
11 duckdb:duckdb -2.6% +1.0% -3.5% +18.6% ➖ noise
11 duckdb:vortex-compact +0.9% +1.0% -0.0% +12.4% ➖ noise
11 duckdb:vortex-file-compressed +1.0% +1.0% -0.0% +15.4% ➖ noise
12 datafusion:arrow +0.6% -0.7% +1.3% +40.2% ➖ noise
12 datafusion:vortex-compact -1.8% -0.7% -1.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.3% -0.7% +0.4% +10.0% ➖ noise
12 duckdb:duckdb -5.3% -0.7% -4.6% +10.0% ➖ noise
12 duckdb:vortex-compact -1.1% -0.7% -0.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.6% -0.7% +0.1% +10.0% ➖ noise
13 datafusion:arrow +0.1% -6.9% +7.5% +10.0% ➖ noise
13 datafusion:vortex-compact -2.1% -6.9% +5.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -3.9% -6.9% +3.2% +10.0% ➖ noise
13 duckdb:duckdb -0.8% -6.9% +6.5% +10.0% ➖ noise
13 duckdb:vortex-compact -3.5% -6.9% +3.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.9% -6.9% +4.3% +10.0% ➖ noise
14 datafusion:arrow -7.4% -2.1% -5.4% +10.0% ➖ noise
14 datafusion:vortex-compact -3.7% -2.1% -1.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +3.4% -2.1% +5.6% +10.0% ➖ noise
14 duckdb:duckdb +0.5% -2.1% +2.7% +10.0% ➖ noise
14 duckdb:vortex-compact -1.9% -2.1% +0.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.1% -2.1% +2.0% +11.2% ➖ noise
15 datafusion:arrow -8.1% +1.3% -9.3% +10.0% ✅ faster
15 datafusion:vortex-compact -3.2% +1.3% -4.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -2.7% +1.3% -3.9% +10.0% ➖ noise
15 duckdb:duckdb -0.8% +1.3% -2.0% +10.0% ➖ noise
15 duckdb:vortex-compact -1.1% +1.3% -2.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +1.0% +1.3% -0.3% +10.0% ➖ noise
16 datafusion:arrow -0.5% -0.5% +0.0% +11.4% ➖ noise
16 datafusion:vortex-compact -5.5% -0.5% -5.0% +11.7% ➖ noise
16 datafusion:vortex-file-compressed -3.0% -0.5% -2.5% +11.6% ➖ noise
16 duckdb:duckdb -2.2% -0.5% -1.7% +10.7% ➖ noise
16 duckdb:vortex-compact +0.7% -0.5% +1.2% +10.3% ➖ noise
16 duckdb:vortex-file-compressed -3.2% -0.5% -2.7% +10.0% ➖ noise
17 datafusion:arrow -5.0% -0.4% -4.6% +10.0% ➖ noise
17 datafusion:vortex-compact -2.2% -0.4% -1.8% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -4.1% -0.4% -3.7% +10.0% ➖ noise
17 duckdb:duckdb -0.9% -0.4% -0.5% +10.0% ➖ noise
17 duckdb:vortex-compact -0.5% -0.4% -0.0% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.9% -0.4% -0.5% +10.0% ➖ noise
18 datafusion:arrow -2.7% -1.2% -1.5% +10.0% ➖ noise
18 datafusion:vortex-compact -2.3% -1.2% -1.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -4.1% -1.2% -3.0% +10.0% ➖ noise
18 duckdb:duckdb -0.8% -1.2% +0.3% +10.0% ➖ noise
18 duckdb:vortex-compact -3.2% -1.2% -2.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +3.1% -1.2% +4.3% +10.0% ➖ noise
19 datafusion:arrow -4.2% +0.3% -4.5% +10.0% ➖ noise
19 datafusion:vortex-compact -1.0% +0.3% -1.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -4.3% +0.3% -4.6% +10.1% ➖ noise
19 duckdb:duckdb -1.4% +0.3% -1.7% +10.0% ➖ noise
19 duckdb:vortex-compact -0.9% +0.3% -1.2% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.9% +0.3% +1.6% +10.0% ➖ noise
20 datafusion:arrow -5.7% -1.7% -4.1% +10.0% ➖ noise
20 datafusion:vortex-compact -1.0% -1.7% +0.7% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -2.6% -1.7% -0.9% +10.0% ➖ noise
20 duckdb:duckdb -0.4% -1.7% +1.3% +10.0% ➖ noise
20 duckdb:vortex-compact -1.3% -1.7% +0.4% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.9% -1.7% +2.6% +10.0% ➖ noise
21 datafusion:arrow -0.9% -0.8% -0.1% +10.0% ➖ noise
21 datafusion:vortex-compact -1.9% -0.8% -1.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -2.7% -0.8% -1.9% +10.0% ➖ noise
21 duckdb:duckdb -1.0% -0.8% -0.3% +10.0% ➖ noise
21 duckdb:vortex-compact -0.1% -0.8% +0.7% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.3% -0.8% +1.1% +10.0% ➖ noise
22 datafusion:arrow -1.4% -0.1% -1.3% +10.0% ➖ noise
22 datafusion:vortex-compact -2.5% -0.1% -2.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -8.6% -0.1% -8.5% +10.0% ➖ noise
22 duckdb:duckdb +6.1% -0.1% +6.1% +10.0% ➖ noise
22 duckdb:vortex-compact -2.2% -0.1% -2.2% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -2.5% -0.1% -2.4% +10.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.4%
Vortex (geomean): 1.043x ➖
Parquet (geomean): 1.115x ➖
Shifts: Parquet (control) +11.5% · Median polish +7.6%


datafusion / vortex-file-compressed (1.033x ➖, 0↑ 3↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 183265848 177618725 1.03
tpch_q02/datafusion:vortex-file-compressed 🚨 823577282 458544389 1.80
tpch_q03/datafusion:vortex-file-compressed 🚨 421730569 309782929 1.36
tpch_q04/datafusion:vortex-file-compressed 🚨 356907337 229966018 1.55
tpch_q05/datafusion:vortex-file-compressed 569984145 486885966 1.17
tpch_q06/datafusion:vortex-file-compressed 324527116 290037456 1.12
tpch_q07/datafusion:vortex-file-compressed 475139410 435132296 1.09
tpch_q08/datafusion:vortex-file-compressed 674470749 695234366 0.97
tpch_q09/datafusion:vortex-file-compressed 528408177 552437880 0.96
tpch_q10/datafusion:vortex-file-compressed 533024761 628666647 0.85
tpch_q11/datafusion:vortex-file-compressed 346971135 458326910 0.76
tpch_q12/datafusion:vortex-file-compressed 393370786 479240328 0.82
tpch_q13/datafusion:vortex-file-compressed 249844407 288187387 0.87
tpch_q14/datafusion:vortex-file-compressed 199252276 213424287 0.93
tpch_q15/datafusion:vortex-file-compressed 339135221 344134162 0.99
tpch_q16/datafusion:vortex-file-compressed 205555093 226336011 0.91
tpch_q17/datafusion:vortex-file-compressed 349921206 399454984 0.88
tpch_q18/datafusion:vortex-file-compressed 348312324 335922854 1.04
tpch_q19/datafusion:vortex-file-compressed 377295281 378716147 1.00
tpch_q20/datafusion:vortex-file-compressed 424117967 419985675 1.01
tpch_q21/datafusion:vortex-file-compressed 544960942 489873351 1.11
tpch_q22/datafusion:vortex-file-compressed 172511946 172056099 1.00
datafusion / vortex-compact (1.049x ➖, 0↑ 4↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 290803263 239280279 1.22
tpch_q02/datafusion:vortex-compact 🚨 554782490 388852282 1.43
tpch_q03/datafusion:vortex-compact 🚨 472816448 308878766 1.53
tpch_q04/datafusion:vortex-compact 238445549 237212442 1.01
tpch_q05/datafusion:vortex-compact 432997370 382913975 1.13
tpch_q06/datafusion:vortex-compact 326169405 425355777 0.77
tpch_q07/datafusion:vortex-compact 443605025 535324929 0.83
tpch_q08/datafusion:vortex-compact 638463962 624987025 1.02
tpch_q09/datafusion:vortex-compact 492188653 493380629 1.00
tpch_q10/datafusion:vortex-compact 491333766 464119247 1.06
tpch_q11/datafusion:vortex-compact 322737285 404118611 0.80
tpch_q12/datafusion:vortex-compact 483723589 640472037 0.76
tpch_q13/datafusion:vortex-compact 215593004 258150880 0.84
tpch_q14/datafusion:vortex-compact 289547820 257666383 1.12
tpch_q15/datafusion:vortex-compact 571360194 472292109 1.21
tpch_q16/datafusion:vortex-compact 206829774 185335581 1.12
tpch_q17/datafusion:vortex-compact 375505108 363470179 1.03
tpch_q18/datafusion:vortex-compact 433536218 491059042 0.88
tpch_q19/datafusion:vortex-compact 548052128 664887609 0.82
tpch_q20/datafusion:vortex-compact 544241951 538896926 1.01
tpch_q21/datafusion:vortex-compact 🚨 733042409 504869321 1.45
tpch_q22/datafusion:vortex-compact 🚨 207950066 125859208 1.65
datafusion / parquet (1.148x ➖, 1↑ 6↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 275144595 233889521 1.18
tpch_q02/datafusion:parquet 🚨 660587666 409915838 1.61
tpch_q03/datafusion:parquet 🚨 435588896 304167272 1.43
tpch_q04/datafusion:parquet 🚨 216098153 140380925 1.54
tpch_q05/datafusion:parquet 669570553 529080275 1.27
tpch_q06/datafusion:parquet 🚨 181838625 136529446 1.33
tpch_q07/datafusion:parquet 634373188 527650574 1.20
tpch_q08/datafusion:parquet 597002239 604988315 0.99
tpch_q09/datafusion:parquet 574090405 573216688 1.00
tpch_q10/datafusion:parquet 607281012 577104638 1.05
tpch_q11/datafusion:parquet 🚨 492040586 355383221 1.38
tpch_q12/datafusion:parquet 🚨 409156296 248871673 1.64
tpch_q13/datafusion:parquet 447096147 436154910 1.03
tpch_q14/datafusion:parquet 209344583 196959679 1.06
tpch_q15/datafusion:parquet 324973672 285201063 1.14
tpch_q16/datafusion:parquet 208267537 176961648 1.18
tpch_q17/datafusion:parquet 436610877 386520594 1.13
tpch_q18/datafusion:parquet 492547020 479741458 1.03
tpch_q19/datafusion:parquet 387769771 329784010 1.18
tpch_q20/datafusion:parquet 354906637 377322140 0.94
tpch_q21/datafusion:parquet 553649780 624780200 0.89
tpch_q22/datafusion:parquet 🚀 131797683 210795090 0.63
duckdb / vortex-file-compressed (1.024x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 287014354 238453890 1.20
tpch_q02/duckdb:vortex-file-compressed 886455927 863007665 1.03
tpch_q03/duckdb:vortex-file-compressed 568016264 547068706 1.04
tpch_q04/duckdb:vortex-file-compressed 344315582 375813596 0.92
tpch_q05/duckdb:vortex-file-compressed 793709269 998126539 0.80
tpch_q06/duckdb:vortex-file-compressed 349832353 464081071 0.75
tpch_q07/duckdb:vortex-file-compressed 785123378 755466366 1.04
tpch_q08/duckdb:vortex-file-compressed 951680788 902394365 1.05
tpch_q09/duckdb:vortex-file-compressed 917116520 845776165 1.08
tpch_q10/duckdb:vortex-file-compressed 834830628 683734129 1.22
tpch_q11/duckdb:vortex-file-compressed 502429839 453861779 1.11
tpch_q12/duckdb:vortex-file-compressed 491409735 510565793 0.96
tpch_q13/duckdb:vortex-file-compressed 475399043 493083950 0.96
tpch_q14/duckdb:vortex-file-compressed 506982252 454301198 1.12
tpch_q15/duckdb:vortex-file-compressed 326840732 259985370 1.26
tpch_q16/duckdb:vortex-file-compressed 337227720 340017601 0.99
tpch_q17/duckdb:vortex-file-compressed 580700209 698283597 0.83
tpch_q18/duckdb:vortex-file-compressed 583465040 532818225 1.10
tpch_q19/duckdb:vortex-file-compressed 487705977 501348954 0.97
tpch_q20/duckdb:vortex-file-compressed 804926513 819318437 0.98
tpch_q21/duckdb:vortex-file-compressed 1165192690 913684541 1.28
tpch_q22/duckdb:vortex-file-compressed 401199293 385943041 1.04
duckdb / vortex-compact (1.068x ➖, 0↑ 1↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 322808310 277593258 1.16
tpch_q02/duckdb:vortex-compact 953361340 858791643 1.11
tpch_q03/duckdb:vortex-compact 543862457 505874548 1.08
tpch_q04/duckdb:vortex-compact 311808912 325024443 0.96
tpch_q05/duckdb:vortex-compact 782975144 797748795 0.98
tpch_q06/duckdb:vortex-compact 437612131 380100870 1.15
tpch_q07/duckdb:vortex-compact 689461958 614029640 1.12
tpch_q08/duckdb:vortex-compact 966928903 835852910 1.16
tpch_q09/duckdb:vortex-compact 847522554 768398711 1.10
tpch_q10/duckdb:vortex-compact 655402925 689725396 0.95
tpch_q11/duckdb:vortex-compact 501391335 460679154 1.09
tpch_q12/duckdb:vortex-compact 410393944 419805733 0.98
tpch_q13/duckdb:vortex-compact 424481393 463088637 0.92
tpch_q14/duckdb:vortex-compact 456444077 440726794 1.04
tpch_q15/duckdb:vortex-compact 🚨 348890690 256519978 1.36
tpch_q16/duckdb:vortex-compact 372197559 349136481 1.07
tpch_q17/duckdb:vortex-compact 699673651 565262069 1.24
tpch_q18/duckdb:vortex-compact 534946734 483060080 1.11
tpch_q19/duckdb:vortex-compact 450913271 415142723 1.09
tpch_q20/duckdb:vortex-compact 736167974 715810387 1.03
tpch_q21/duckdb:vortex-compact 1022433067 1117548367 0.91
tpch_q22/duckdb:vortex-compact 330803505 329889695 1.00
duckdb / parquet (1.083x ➖, 0↑ 1↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 550765744 480295090 1.15
tpch_q02/duckdb:parquet 1302200759 1393055101 0.93
tpch_q03/duckdb:parquet 994654809 935780055 1.06
tpch_q04/duckdb:parquet 606459193 639326698 0.95
tpch_q05/duckdb:parquet 1605266814 1458681836 1.10
tpch_q06/duckdb:parquet 401407651 358220765 1.12
tpch_q07/duckdb:parquet 1269553827 1286618869 0.99
tpch_q08/duckdb:parquet 1735336066 1636908601 1.06
tpch_q09/duckdb:parquet 1536159618 1346666092 1.14
tpch_q10/duckdb:parquet 1393073142 1222975537 1.14
tpch_q11/duckdb:parquet 🚨 985010723 718156678 1.37
tpch_q12/duckdb:parquet 666999901 587439378 1.14
tpch_q13/duckdb:parquet 846460384 861349765 0.98
tpch_q14/duckdb:parquet 733399666 666762264 1.10
tpch_q15/duckdb:parquet 572965402 597641730 0.96
tpch_q16/duckdb:parquet 527119223 475975670 1.11
tpch_q17/duckdb:parquet 709020913 787381762 0.90
tpch_q18/duckdb:parquet 1011506298 857098205 1.18
tpch_q19/duckdb:parquet 899890885 770008553 1.17
tpch_q20/duckdb:parquet 1249190813 989935993 1.26
tpch_q21/duckdb:parquet 1183487129 1075910563 1.10
tpch_q22/duckdb:parquet 510852610 497928577 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +21.5% +16.1% +4.6% +158.8% ➖ noise
1 datafusion:vortex-file-compressed +3.2% +16.1% -11.2% +169.9% ➖ noise
1 duckdb:vortex-compact +16.3% +16.1% +0.1% +67.2% ➖ noise
1 duckdb:vortex-file-compressed +20.4% +16.1% +3.6% +55.5% ➖ noise
2 datafusion:vortex-compact +42.7% +22.7% +16.2% +49.8% ➖ noise
2 datafusion:vortex-file-compressed +79.6% +22.7% +46.3% +42.8% 🚨 regression
2 duckdb:vortex-compact +11.0% +22.7% -9.6% +35.3% ➖ noise
2 duckdb:vortex-file-compressed +2.7% +22.7% -16.3% +35.3% ➖ noise
3 datafusion:vortex-compact +53.1% +23.4% +24.1% +91.4% ➖ noise
3 datafusion:vortex-file-compressed +36.1% +23.4% +10.3% +120.3% ➖ noise
3 duckdb:vortex-compact +7.5% +23.4% -12.9% +41.4% ➖ noise
3 duckdb:vortex-file-compressed +3.8% +23.4% -15.8% +35.8% ➖ noise
4 datafusion:vortex-compact +0.5% +20.8% -16.8% +35.8% ➖ noise
4 datafusion:vortex-file-compressed +55.2% +20.8% +28.4% +59.5% ➖ noise
4 duckdb:vortex-compact -4.1% +20.8% -20.6% +35.3% ➖ noise
4 duckdb:vortex-file-compressed -8.4% +20.8% -24.2% +209.9% ➖ noise
5 datafusion:vortex-compact +13.1% +18.0% -4.2% +35.3% ➖ noise
5 datafusion:vortex-file-compressed +17.1% +18.0% -0.8% +41.8% ➖ noise
5 duckdb:vortex-compact -1.9% +18.0% -16.8% +35.3% ➖ noise
5 duckdb:vortex-file-compressed -20.5% +18.0% -32.6% +35.3% ✅ faster
6 datafusion:vortex-compact -23.3% +22.2% -37.2% +35.3% ✅ faster
6 datafusion:vortex-file-compressed +11.9% +22.2% -8.4% +35.3% ➖ noise
6 duckdb:vortex-compact +15.1% +22.2% -5.8% +35.3% ➖ noise
6 duckdb:vortex-file-compressed -24.6% +22.2% -38.3% +35.3% ✅ faster
7 datafusion:vortex-compact -17.1% +8.9% -23.9% +35.3% ➖ noise
7 datafusion:vortex-file-compressed +9.2% +8.9% +0.3% +35.3% ➖ noise
7 duckdb:vortex-compact +12.3% +8.9% +3.1% +35.3% ➖ noise
7 duckdb:vortex-file-compressed +3.9% +8.9% -4.6% +35.3% ➖ noise
8 datafusion:vortex-compact +2.2% +2.3% -0.1% +44.8% ➖ noise
8 datafusion:vortex-file-compressed -3.0% +2.3% -5.1% +35.3% ➖ noise
8 duckdb:vortex-compact +15.7% +2.3% +13.1% +35.3% ➖ noise
8 duckdb:vortex-file-compressed +5.5% +2.3% +3.1% +35.3% ➖ noise
9 datafusion:vortex-compact -0.2% +6.9% -6.7% +35.3% ➖ noise
9 datafusion:vortex-file-compressed -4.3% +6.9% -10.5% +38.3% ➖ noise
9 duckdb:vortex-compact +10.3% +6.9% +3.2% +35.3% ➖ noise
9 duckdb:vortex-file-compressed +8.4% +6.9% +1.4% +35.3% ➖ noise
10 datafusion:vortex-compact +5.9% +9.5% -3.3% +35.3% ➖ noise
10 datafusion:vortex-file-compressed -15.2% +9.5% -22.6% +35.3% ➖ noise
10 duckdb:vortex-compact -5.0% +9.5% -13.2% +35.3% ➖ noise
10 duckdb:vortex-file-compressed +22.1% +9.5% +11.5% +35.3% ➖ noise
11 datafusion:vortex-compact -20.1% +37.8% -42.0% +35.3% ✅ faster
11 datafusion:vortex-file-compressed -24.3% +37.8% -45.1% +35.3% ✅ faster
11 duckdb:vortex-compact +8.8% +37.8% -21.0% +35.3% ➖ noise
11 duckdb:vortex-file-compressed +10.7% +37.8% -19.7% +35.3% ➖ noise
12 datafusion:vortex-compact -24.5% +36.6% -44.7% +48.7% ✅ faster
12 datafusion:vortex-file-compressed -17.9% +36.6% -39.9% +46.9% ✅ faster
12 duckdb:vortex-compact -2.2% +36.6% -28.4% +35.3% ✅ faster
12 duckdb:vortex-file-compressed -3.8% +36.6% -29.6% +35.3% ✅ faster
13 datafusion:vortex-compact -16.5% +0.4% -16.8% +79.1% ➖ noise
13 datafusion:vortex-file-compressed -13.3% +0.4% -13.6% +65.7% ➖ noise
13 duckdb:vortex-compact -8.3% +0.4% -8.7% +35.3% ➖ noise
13 duckdb:vortex-file-compressed -3.6% +0.4% -3.9% +35.3% ➖ noise
14 datafusion:vortex-compact +12.4% +8.1% +3.9% +54.3% ➖ noise
14 datafusion:vortex-file-compressed -6.6% +8.1% -13.7% +38.7% ➖ noise
14 duckdb:vortex-compact +3.6% +8.1% -4.2% +35.3% ➖ noise
14 duckdb:vortex-file-compressed +11.6% +8.1% +3.2% +35.3% ➖ noise
15 datafusion:vortex-compact +21.0% +4.5% +15.7% +36.8% ➖ noise
15 datafusion:vortex-file-compressed -1.5% +4.5% -5.7% +42.5% ➖ noise
15 duckdb:vortex-compact +36.0% +4.5% +30.1% +44.3% ➖ noise
15 duckdb:vortex-file-compressed +25.7% +4.5% +20.3% +35.3% ➖ noise
16 datafusion:vortex-compact +11.6% +14.2% -2.2% +35.3% ➖ noise
16 datafusion:vortex-file-compressed -9.2% +14.2% -20.4% +35.3% ➖ noise
16 duckdb:vortex-compact +6.6% +14.2% -6.6% +35.3% ➖ noise
16 duckdb:vortex-file-compressed -0.8% +14.2% -13.1% +44.0% ➖ noise
17 datafusion:vortex-compact +3.3% +0.9% +2.4% +42.1% ➖ noise
17 datafusion:vortex-file-compressed -12.4% +0.9% -13.1% +35.3% ➖ noise
17 duckdb:vortex-compact +23.8% +0.9% +22.7% +35.3% ➖ noise
17 duckdb:vortex-file-compressed -16.8% +0.9% -17.5% +35.3% ➖ noise
18 datafusion:vortex-compact -11.7% +10.1% -19.8% +69.6% ➖ noise
18 datafusion:vortex-file-compressed +3.7% +10.1% -5.8% +35.3% ➖ noise
18 duckdb:vortex-compact +10.7% +10.1% +0.6% +35.3% ➖ noise
18 duckdb:vortex-file-compressed +9.5% +10.1% -0.5% +35.3% ➖ noise
19 datafusion:vortex-compact -17.6% +17.2% -29.7% +55.4% ➖ noise
19 datafusion:vortex-file-compressed -0.4% +17.2% -15.0% +35.3% ➖ noise
19 duckdb:vortex-compact +8.6% +17.2% -7.3% +35.3% ➖ noise
19 duckdb:vortex-file-compressed -2.7% +17.2% -17.0% +35.3% ➖ noise
20 datafusion:vortex-compact +1.0% +8.9% -7.3% +35.3% ➖ noise
20 datafusion:vortex-file-compressed +1.0% +8.9% -7.3% +35.3% ➖ noise
20 duckdb:vortex-compact +2.8% +8.9% -5.6% +35.3% ➖ noise
20 duckdb:vortex-file-compressed -1.8% +8.9% -9.8% +35.3% ➖ noise
21 datafusion:vortex-compact +45.2% -1.3% +47.1% +46.0% 🚨 regression
21 datafusion:vortex-file-compressed +11.2% -1.3% +12.7% +35.3% ➖ noise
21 duckdb:vortex-compact -8.5% -1.3% -7.3% +35.3% ➖ noise
21 duckdb:vortex-file-compressed +27.5% -1.3% +29.2% +35.3% ➖ noise
22 datafusion:vortex-compact +65.2% -19.9% +106.3% +42.4% 🚨 regression
22 datafusion:vortex-file-compressed +0.3% -19.9% +25.2% +35.3% ➖ noise
22 duckdb:vortex-compact +0.3% -19.9% +25.2% +35.3% ➖ noise
22 duckdb:vortex-file-compressed +4.0% -19.9% +29.8% +39.3% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.5%
Vortex (geomean): 1.032x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.1%


datafusion / vortex-file-compressed (1.001x ➖, 0↑ 1↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 54495271 31704045 1.72
fineweb_q01/datafusion:vortex-file-compressed 520296541 718951254 0.72
fineweb_q02/datafusion:vortex-file-compressed 551540562 675198811 0.82
fineweb_q03/datafusion:vortex-file-compressed 1402775535 1404943936 1.00
fineweb_q04/datafusion:vortex-file-compressed 1394345698 1395388173 1.00
fineweb_q05/datafusion:vortex-file-compressed 1384189031 1377909223 1.00
fineweb_q06/datafusion:vortex-file-compressed 1539145886 1567559086 0.98
fineweb_q07/datafusion:vortex-file-compressed 1388867215 1406545423 0.99
fineweb_q08/datafusion:vortex-file-compressed 568445954 555408933 1.02
datafusion / vortex-compact (0.990x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 41630321 48013484 0.87
fineweb_q01/datafusion:vortex-compact 557151037 575891376 0.97
fineweb_q02/datafusion:vortex-compact 681739933 633597027 1.08
fineweb_q03/datafusion:vortex-compact 1834531337 1857707364 0.99
fineweb_q04/datafusion:vortex-compact 2202661036 2246292956 0.98
fineweb_q05/datafusion:vortex-compact 1685894346 1684659978 1.00
fineweb_q06/datafusion:vortex-compact 1490776272 1399750746 1.07
fineweb_q07/datafusion:vortex-compact 1339132493 1325970648 1.01
fineweb_q08/datafusion:vortex-compact 398672235 411184724 0.97
datafusion / parquet (0.982x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1022907870 1068246151 0.96
fineweb_q01/datafusion:parquet 1907342664 1762648074 1.08
fineweb_q02/datafusion:parquet 1836007970 1850104498 0.99
fineweb_q03/datafusion:parquet 1899507324 1967751939 0.97
fineweb_q04/datafusion:parquet 1912160041 1881175561 1.02
fineweb_q05/datafusion:parquet 1742374110 1921909153 0.91
fineweb_q06/datafusion:parquet 1800632752 1778042194 1.01
fineweb_q07/datafusion:parquet 1851552729 2002849397 0.92
fineweb_q08/datafusion:parquet 1846404078 1854850384 1.00
duckdb / vortex-file-compressed (1.016x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 107114146 99380924 1.08
fineweb_q01/duckdb:vortex-file-compressed 624658447 532831026 1.17
fineweb_q02/duckdb:vortex-file-compressed 431506962 495370060 0.87
fineweb_q03/duckdb:vortex-file-compressed 1575287142 1544773301 1.02
fineweb_q04/duckdb:vortex-file-compressed 1656708264 1589931140 1.04
fineweb_q05/duckdb:vortex-file-compressed 1562319482 1516440449 1.03
fineweb_q06/duckdb:vortex-file-compressed 1769549494 1655566447 1.07
fineweb_q07/duckdb:vortex-file-compressed 1553656363 1786898308 0.87
fineweb_q08/duckdb:vortex-file-compressed 703828729 685358712 1.03
duckdb / vortex-compact (1.129x ➖, 0↑ 1↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 109089515 75664949 1.44
fineweb_q01/duckdb:vortex-compact 604564417 533273960 1.13
fineweb_q02/duckdb:vortex-compact 615998708 570366438 1.08
fineweb_q03/duckdb:vortex-compact 1788792689 1643998151 1.09
fineweb_q04/duckdb:vortex-compact 1783755594 1603635287 1.11
fineweb_q05/duckdb:vortex-compact 1522647171 1434099623 1.06
fineweb_q06/duckdb:vortex-compact 1551378610 1450532691 1.07
fineweb_q07/duckdb:vortex-compact 1495832386 1302421539 1.15
fineweb_q08/duckdb:vortex-compact 532493401 499496830 1.07
duckdb / parquet (1.012x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1087004919 1121376312 0.97
fineweb_q01/duckdb:parquet 1728029302 1600393496 1.08
fineweb_q02/duckdb:parquet 1741574474 1651385162 1.05
fineweb_q03/duckdb:parquet 4360181226 3996670510 1.09
fineweb_q04/duckdb:parquet 1889907253 1932392622 0.98
fineweb_q05/duckdb:parquet 2564507506 2628515821 0.98
fineweb_q06/duckdb:parquet 3513612816 3576119276 0.98
fineweb_q07/duckdb:parquet 4144507484 4201194665 0.99
fineweb_q08/duckdb:parquet 1083791235 1080002105 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -13.3% -3.7% -10.0% +186.8% ➖ noise
0 datafusion:vortex-file-compressed +71.9% -3.7% +78.4% +177.8% ➖ noise
0 duckdb:vortex-compact +44.2% -3.7% +49.6% +45.3% 🚨 regression
0 duckdb:vortex-file-compressed +7.8% -3.7% +11.9% +47.6% ➖ noise
1 datafusion:vortex-compact -3.3% +8.1% -10.5% +70.0% ➖ noise
1 datafusion:vortex-file-compressed -27.6% +8.1% -33.0% +57.3% ➖ noise
1 duckdb:vortex-compact +13.4% +8.1% +4.9% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +17.2% +8.1% +8.5% +41.6% ➖ noise
2 datafusion:vortex-compact +7.6% +2.3% +5.2% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -18.3% +2.3% -20.2% +48.3% ➖ noise
2 duckdb:vortex-compact +8.0% +2.3% +5.6% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -12.9% +2.3% -14.9% +30.0% ➖ noise
3 datafusion:vortex-compact -1.2% +2.6% -3.8% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -0.2% +2.6% -2.7% +30.0% ➖ noise
3 duckdb:vortex-compact +8.8% +2.6% +6.0% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +2.0% +2.6% -0.6% +30.0% ➖ noise
4 datafusion:vortex-compact -1.9% -0.3% -1.7% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.1% -0.3% +0.2% +30.0% ➖ noise
4 duckdb:vortex-compact +11.2% -0.3% +11.6% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +4.2% -0.3% +4.5% +30.0% ➖ noise
5 datafusion:vortex-compact +0.1% -6.0% +6.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +0.5% -6.0% +6.8% +30.0% ➖ noise
5 duckdb:vortex-compact +6.2% -6.0% +12.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +3.0% -6.0% +9.5% +30.0% ➖ noise
6 datafusion:vortex-compact +6.5% -0.3% +6.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -1.8% -0.3% -1.6% +30.0% ➖ noise
6 duckdb:vortex-compact +7.0% -0.3% +7.2% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +6.9% -0.3% +7.2% +30.0% ➖ noise
7 datafusion:vortex-compact +1.0% -4.5% +5.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -1.3% -4.5% +3.4% +30.0% ➖ noise
7 duckdb:vortex-compact +14.9% -4.5% +20.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -13.1% -4.5% -9.0% +30.4% ➖ noise
8 datafusion:vortex-compact -3.0% -0.1% -3.0% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +2.3% -0.1% +2.4% +30.0% ➖ noise
8 duckdb:vortex-compact +6.6% -0.1% +6.7% +41.2% ➖ noise
8 duckdb:vortex-file-compressed +2.7% -0.1% +2.7% +30.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: Random Access

Vortex (geomean): 0.877x ✅
Parquet (geomean): 0.975x ➖


unknown / unknown (0.934x ➖, 9↑ 1↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 2578672 2321312 1.11
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1333696 1452658 0.92
random-access/feature-vectors/correlated/parquet-tokio-local-disk 13923429598 13982384004 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 13429367878 13758499681 0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8122518 8009041 1.01
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 5880977 6796705 0.87
random-access/feature-vectors/uniform/lance-tokio-local-disk 1624753 1698343 0.96
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2553480 2668334 0.96
random-access/feature-vectors/uniform/parquet-tokio-local-disk 13419461192 13784897316 0.97
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 13379396451 13743481787 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 12711565 14918374 0.85
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 12999791 14662545 0.89
random-access/lance-tokio-local-disk 746695 788392 0.95
random-access/lance-tokio-local-disk-footer 1339274 1475494 0.91
random-access/nested-lists/correlated/lance-tokio-local-disk 265454 283518 0.94
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 765505 818411 0.94
random-access/nested-lists/correlated/parquet-tokio-local-disk 164632491 167920868 0.98
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 166027894 169361842 0.98
random-access/nested-lists/correlated/vortex-tokio-local-disk 745457 747497 1.00
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 744455 752805 0.99
random-access/nested-lists/uniform/lance-tokio-local-disk 1224006 1270561 0.96
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1800281 1811490 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk 169522221 170404988 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 169661671 169487946 1.00
random-access/nested-lists/uniform/vortex-tokio-local-disk 2514316 2680795 0.94
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2555839 2767303 0.92
random-access/nested-structs/correlated/lance-tokio-local-disk 439959 464054 0.95
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 662038 710026 0.93
random-access/nested-structs/correlated/parquet-tokio-local-disk 29052458 29262619 0.99
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 28884834 28752416 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk 922298 956354 0.96
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 919893 934944 0.98
random-access/nested-structs/uniform/lance-tokio-local-disk 2923328 3089487 0.95
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3273445 3402382 0.96
random-access/nested-structs/uniform/parquet-tokio-local-disk 29016221 29027107 1.00
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 28939943 28886265 1.00
random-access/nested-structs/uniform/vortex-tokio-local-disk 1801924 1888887 0.95
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1906139 1890178 1.01
random-access/parquet-tokio-local-disk 185770045 195102144 0.95
random-access/parquet-tokio-local-disk-footer 184834828 194262645 0.95
random-access/taxi/correlated/lance-tokio-local-disk 967605 1032456 0.94
random-access/taxi/correlated/lance-tokio-local-disk-footer 1644343 1802420 0.91
random-access/taxi/correlated/parquet-tokio-local-disk 271465931 288565650 0.94
random-access/taxi/correlated/parquet-tokio-local-disk-footer 275784500 289995799 0.95
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1700292 1998841 0.85
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1706166 2619448 0.65
random-access/taxi/uniform/lance-tokio-local-disk 8644805 9166779 0.94
random-access/taxi/uniform/lance-tokio-local-disk-footer 9306613 9850219 0.94
random-access/taxi/uniform/parquet-tokio-local-disk 289949450 306082591 0.95
random-access/taxi/uniform/parquet-tokio-local-disk-footer 290030948 307495041 0.94
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4280413 5637978 0.76
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4264905 5669055 0.75
random-access/vortex-tokio-local-disk 🚀 1197779 1386932 0.86
random-access/vortex-tokio-local-disk-footer 🚀 1200877 1813408 0.66

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.1%
Vortex (geomean): 0.923x ➖
Parquet (geomean): 0.953x ➖
Shifts: Parquet (control) -4.7% · Median polish -5.1%


duckdb / vortex-file-compressed (0.884x ✅, 4↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 🚀 11098625 13015249 0.85
statpopgen_q01/duckdb:vortex-file-compressed 🚀 19070445 29148581 0.65
statpopgen_q02/duckdb:vortex-file-compressed 1299126046 1427635580 0.91
statpopgen_q03/duckdb:vortex-file-compressed 3054785876 3333895697 0.92
statpopgen_q04/duckdb:vortex-file-compressed 3096575261 3289473522 0.94
statpopgen_q05/duckdb:vortex-file-compressed 1375420356 1505179427 0.91
statpopgen_q06/duckdb:vortex-file-compressed 2058314830 2203357917 0.93
statpopgen_q07/duckdb:vortex-file-compressed 198516509 209863763 0.95
statpopgen_q08/duckdb:vortex-file-compressed 🚀 201664208 230023256 0.88
statpopgen_q09/duckdb:vortex-file-compressed 🚀 2797931451 3118177895 0.90
statpopgen_q10/duckdb:vortex-file-compressed 4626457003 4980055228 0.93
duckdb / vortex-compact (0.964x ➖, 1↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 🚀 10709852 12300842 0.87
statpopgen_q01/duckdb:vortex-compact 166725489 176710327 0.94
statpopgen_q02/duckdb:vortex-compact 1801771886 1963484233 0.92
statpopgen_q03/duckdb:vortex-compact 3468608770 3509113630 0.99
statpopgen_q04/duckdb:vortex-compact 3514627034 3559602262 0.99
statpopgen_q05/duckdb:vortex-compact 1817665300 1938401703 0.94
statpopgen_q06/duckdb:vortex-compact 2656186314 2688600786 0.99
statpopgen_q07/duckdb:vortex-compact 956741425 959801576 1.00
statpopgen_q08/duckdb:vortex-compact 987630283 1007861622 0.98
statpopgen_q09/duckdb:vortex-compact 3305041478 3321777956 0.99
statpopgen_q10/duckdb:vortex-compact 5424368037 5382263616 1.01
duckdb / parquet (0.953x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 322951121 335590093 0.96
statpopgen_q01/duckdb:parquet 410442200 424226030 0.97
statpopgen_q02/duckdb:parquet 1021618355 1078623317 0.95
statpopgen_q03/duckdb:parquet 1511930010 1649102984 0.92
statpopgen_q04/duckdb:parquet 1519004975 1637746647 0.93
statpopgen_q05/duckdb:parquet 1029397721 1079460435 0.95
statpopgen_q06/duckdb:parquet 1527977775 1643016955 0.93
statpopgen_q07/duckdb:parquet 1952766321 1956027649 1.00
statpopgen_q08/duckdb:parquet 1953731950 1987405015 0.98
statpopgen_q09/duckdb:parquet 1420116621 1454531352 0.98
statpopgen_q10/duckdb:parquet 2681716092 2895927251 0.93
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -12.9% -3.8% -9.5% +10.0% ✅ faster
0 duckdb:vortex-file-compressed -14.7% -3.8% -11.4% +10.0% ✅ faster
1 duckdb:vortex-compact -5.7% -3.2% -2.5% +31.9% ➖ noise
1 duckdb:vortex-file-compressed -34.6% -3.2% -32.4% +204.5% ➖ noise
2 duckdb:vortex-compact -8.2% -5.3% -3.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -9.0% -5.3% -3.9% +10.0% ➖ noise
3 duckdb:vortex-compact -1.2% -8.3% +7.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -8.4% -8.3% -0.1% +10.0% ➖ noise
4 duckdb:vortex-compact -1.3% -7.3% +6.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -5.9% -7.3% +1.5% +10.0% ➖ noise
5 duckdb:vortex-compact -6.2% -4.6% -1.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -8.6% -4.6% -4.2% +10.0% ➖ noise
6 duckdb:vortex-compact -1.2% -7.0% +6.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -6.6% -7.0% +0.5% +10.0% ➖ noise
7 duckdb:vortex-compact -0.3% -0.2% -0.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.4% -0.2% -5.2% +10.0% ➖ noise
8 duckdb:vortex-compact -2.0% -1.7% -0.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -12.3% -1.7% -10.8% +10.0% ✅ faster
9 duckdb:vortex-compact -0.5% -2.4% +1.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -10.3% -2.4% -8.1% +10.0% ➖ noise
10 duckdb:vortex-compact +0.8% -7.4% +8.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -7.1% -7.4% +0.3% +10.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.7%
Vortex (geomean): 1.015x ➖
Parquet (geomean): 0.960x ➖
Shifts: Parquet (control) -4.0% · Median polish +2.4%


datafusion / vortex-file-compressed (0.891x ➖, 3↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 713566293 724403674 0.99
tpch_q02/datafusion:vortex-file-compressed 735660452 927608073 0.79
tpch_q03/datafusion:vortex-file-compressed 🚀 761667729 1577194530 0.48
tpch_q04/datafusion:vortex-file-compressed 🚀 602194016 912199777 0.66
tpch_q05/datafusion:vortex-file-compressed 1095551073 1188901970 0.92
tpch_q06/datafusion:vortex-file-compressed 635742631 676616754 0.94
tpch_q07/datafusion:vortex-file-compressed 1219774443 1252865829 0.97
tpch_q08/datafusion:vortex-file-compressed 1267284985 1263712088 1.00
tpch_q09/datafusion:vortex-file-compressed 1427676083 1901056141 0.75
tpch_q10/datafusion:vortex-file-compressed 980760583 1113083433 0.88
tpch_q11/datafusion:vortex-file-compressed 🚀 457483823 672602217 0.68
tpch_q12/datafusion:vortex-file-compressed 916746202 1102478893 0.83
tpch_q13/datafusion:vortex-file-compressed 479447595 429458084 1.12
tpch_q14/datafusion:vortex-file-compressed 597033631 565253296 1.06
tpch_q15/datafusion:vortex-file-compressed 1129884464 1133090965 1.00
tpch_q16/datafusion:vortex-file-compressed 362115151 299647859 1.21
tpch_q17/datafusion:vortex-file-compressed 1227905920 1161319181 1.06
tpch_q18/datafusion:vortex-file-compressed 1305525252 1311259380 1.00
tpch_q19/datafusion:vortex-file-compressed 732493031 705184224 1.04
tpch_q20/datafusion:vortex-file-compressed 974967780 1375824446 0.71
tpch_q21/datafusion:vortex-file-compressed 1659419546 1750822523 0.95
tpch_q22/datafusion:vortex-file-compressed 378469933 395603010 0.96
datafusion / vortex-compact (1.053x ➖, 0↑ 1↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 770409751 737633566 1.04
tpch_q02/datafusion:vortex-compact 675893812 622848338 1.09
tpch_q03/datafusion:vortex-compact 915800178 734595651 1.25
tpch_q04/datafusion:vortex-compact 510714403 561265220 0.91
tpch_q05/datafusion:vortex-compact 950307020 1083634255 0.88
tpch_q06/datafusion:vortex-compact 784804020 646619535 1.21
tpch_q07/datafusion:vortex-compact 1234064762 1183493708 1.04
tpch_q08/datafusion:vortex-compact 1280274065 1216886524 1.05
tpch_q09/datafusion:vortex-compact 1568792963 1579160764 0.99
tpch_q10/datafusion:vortex-compact 1192447877 1179434196 1.01
tpch_q11/datafusion:vortex-compact 🚨 679718822 427542522 1.59
tpch_q12/datafusion:vortex-compact 962139058 890368881 1.08
tpch_q13/datafusion:vortex-compact 435660473 392865852 1.11
tpch_q14/datafusion:vortex-compact 630566065 587686324 1.07
tpch_q15/datafusion:vortex-compact 1170864981 1215107078 0.96
tpch_q16/datafusion:vortex-compact 297083235 367235771 0.81
tpch_q17/datafusion:vortex-compact 1206779535 1173605594 1.03
tpch_q18/datafusion:vortex-compact 1211279259 1190768631 1.02
tpch_q19/datafusion:vortex-compact 658203999 674751957 0.98
tpch_q20/datafusion:vortex-compact 897076076 936192325 0.96
tpch_q21/datafusion:vortex-compact 1579845890 1445099069 1.09
tpch_q22/datafusion:vortex-compact 434661322 355372818 1.22
datafusion / parquet (0.926x ➖, 3↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 913319595 941934099 0.97
tpch_q02/datafusion:parquet 🚀 821567289 1418950359 0.58
tpch_q03/datafusion:parquet 🚀 1008099997 1507715378 0.67
tpch_q04/datafusion:parquet 🚀 486976196 770459600 0.63
tpch_q05/datafusion:parquet 1305074758 1259500073 1.04
tpch_q06/datafusion:parquet 524548662 527366642 0.99
tpch_q07/datafusion:parquet 1649501194 1331754906 1.24
tpch_q08/datafusion:parquet 1659333321 1639449677 1.01
tpch_q09/datafusion:parquet 2120421828 1755046175 1.21
tpch_q10/datafusion:parquet 2045920094 2060471546 0.99
tpch_q11/datafusion:parquet 546448089 657764140 0.83
tpch_q12/datafusion:parquet 671294856 889844893 0.75
tpch_q13/datafusion:parquet 696348507 700471925 0.99
tpch_q14/datafusion:parquet 818755852 832338243 0.98
tpch_q15/datafusion:parquet 1145814443 1232560029 0.93
tpch_q16/datafusion:parquet 383886463 435776576 0.88
tpch_q17/datafusion:parquet 1419774918 1467471399 0.97
tpch_q18/datafusion:parquet 1635610461 1734257327 0.94
tpch_q19/datafusion:parquet 1162936775 1068430906 1.09
tpch_q20/datafusion:parquet 1353697307 1225396510 1.10
tpch_q21/datafusion:parquet 1815456559 2011897860 0.90
tpch_q22/datafusion:parquet 771944758 771911331 1.00
duckdb / vortex-file-compressed (1.044x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 644688621 636967751 1.01
tpch_q02/duckdb:vortex-file-compressed 1118431903 1264496576 0.88
tpch_q03/duckdb:vortex-file-compressed 911390699 900358307 1.01
tpch_q04/duckdb:vortex-file-compressed 647545773 636287122 1.02
tpch_q05/duckdb:vortex-file-compressed 1067428790 994434024 1.07
tpch_q06/duckdb:vortex-file-compressed 875238139 796164871 1.10
tpch_q07/duckdb:vortex-file-compressed 1089530124 1106453879 0.98
tpch_q08/duckdb:vortex-file-compressed 1640472675 1391321178 1.18
tpch_q09/duckdb:vortex-file-compressed 1562901345 1327871623 1.18
tpch_q10/duckdb:vortex-file-compressed 1064778617 1381937808 0.77
tpch_q11/duckdb:vortex-file-compressed 610404459 715634263 0.85
tpch_q12/duckdb:vortex-file-compressed 730102776 673455074 1.08
tpch_q13/duckdb:vortex-file-compressed 1064086837 1014860563 1.05
tpch_q14/duckdb:vortex-file-compressed 916235440 828218422 1.11
tpch_q15/duckdb:vortex-file-compressed 574719180 522142375 1.10
tpch_q16/duckdb:vortex-file-compressed 422719295 349573642 1.21
tpch_q17/duckdb:vortex-file-compressed 951252458 923328545 1.03
tpch_q18/duckdb:vortex-file-compressed 1049848720 940227624 1.12
tpch_q19/duckdb:vortex-file-compressed 746166714 689914143 1.08
tpch_q20/duckdb:vortex-file-compressed 1295623802 1181844146 1.10
tpch_q21/duckdb:vortex-file-compressed 2062475974 1897923064 1.09
tpch_q22/duckdb:vortex-file-compressed 605464864 564325937 1.07
duckdb / vortex-compact (1.082x ➖, 0↑ 2↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 626586591 568818862 1.10
tpch_q02/duckdb:vortex-compact 1008964537 1034557334 0.98
tpch_q03/duckdb:vortex-compact 924363151 837279077 1.10
tpch_q04/duckdb:vortex-compact 🚨 662556289 491434087 1.35
tpch_q05/duckdb:vortex-compact 1106330908 1045759611 1.06
tpch_q06/duckdb:vortex-compact 709099528 701508114 1.01
tpch_q07/duckdb:vortex-compact 958198706 921890688 1.04
tpch_q08/duckdb:vortex-compact 1548720919 1311796889 1.18
tpch_q09/duckdb:vortex-compact 1357595572 1337786135 1.01
tpch_q10/duckdb:vortex-compact 1079067878 1075033629 1.00
tpch_q11/duckdb:vortex-compact 606682826 635108958 0.96
tpch_q12/duckdb:vortex-compact 631330278 607066731 1.04
tpch_q13/duckdb:vortex-compact 🚨 1093732696 827818785 1.32
tpch_q14/duckdb:vortex-compact 862258774 789565187 1.09
tpch_q15/duckdb:vortex-compact 579544133 574800942 1.01
tpch_q16/duckdb:vortex-compact 454890484 391071687 1.16
tpch_q17/duckdb:vortex-compact 886027787 859495730 1.03
tpch_q18/duckdb:vortex-compact 821743956 676747441 1.21
tpch_q19/duckdb:vortex-compact 725027605 685719729 1.06
tpch_q20/duckdb:vortex-compact 1121171215 1261034973 0.89
tpch_q21/duckdb:vortex-compact 1713992452 1634144840 1.05
tpch_q22/duckdb:vortex-compact 671953117 525454316 1.28
duckdb / parquet (0.997x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 969277580 976506272 0.99
tpch_q02/duckdb:parquet 1366806376 1675324398 0.82
tpch_q03/duckdb:parquet 1673843705 1745211588 0.96
tpch_q04/duckdb:parquet 1004243260 1043523964 0.96
tpch_q05/duckdb:parquet 2243413218 1929762689 1.16
tpch_q06/duckdb:parquet 682089874 757261463 0.90
tpch_q07/duckdb:parquet 1938867354 1789089204 1.08
tpch_q08/duckdb:parquet 2465986409 2319402466 1.06
tpch_q09/duckdb:parquet 2402009475 2276780847 1.06
tpch_q10/duckdb:parquet 3140986779 3040650733 1.03
tpch_q11/duckdb:parquet 1074556526 936360358 1.15
tpch_q12/duckdb:parquet 965596801 988324259 0.98
tpch_q13/duckdb:parquet 1165667590 1504697902 0.77
tpch_q14/duckdb:parquet 1077529029 1294779206 0.83
tpch_q15/duckdb:parquet 875834895 843734242 1.04
tpch_q16/duckdb:parquet 768005496 690061914 1.11
tpch_q17/duckdb:parquet 1284436511 1260327883 1.02
tpch_q18/duckdb:parquet 1540564001 1454661914 1.06
tpch_q19/duckdb:parquet 1587908905 1504147848 1.06
tpch_q20/duckdb:parquet 1619320566 1620149261 1.00
tpch_q21/duckdb:parquet 1836282573 1835574357 1.00
tpch_q22/duckdb:parquet 1019221905 1028280869 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +4.4% -1.9% +6.5% +72.1% ➖ noise
1 datafusion:vortex-file-compressed -1.5% -1.9% +0.4% +87.7% ➖ noise
1 duckdb:vortex-compact +10.2% -1.9% +12.3% +60.4% ➖ noise
1 duckdb:vortex-file-compressed +1.2% -1.9% +3.2% +42.2% ➖ noise
2 datafusion:vortex-compact +8.5% -31.3% +57.9% +72.8% ➖ noise
2 datafusion:vortex-file-compressed -20.7% -31.3% +15.4% +52.8% ➖ noise
2 duckdb:vortex-compact -2.5% -31.3% +41.9% +47.6% ➖ noise
2 duckdb:vortex-file-compressed -11.6% -31.3% +28.7% +54.1% ➖ noise
3 datafusion:vortex-compact +24.7% -19.9% +55.7% +96.8% ➖ noise
3 datafusion:vortex-file-compressed -51.7% -19.9% -39.7% +77.8% ➖ noise
3 duckdb:vortex-compact +10.4% -19.9% +37.9% +51.4% ➖ noise
3 duckdb:vortex-file-compressed +1.2% -19.9% +26.4% +82.3% ➖ noise
4 datafusion:vortex-compact -9.0% -22.0% +16.7% +37.9% ➖ noise
4 datafusion:vortex-file-compressed -34.0% -22.0% -15.4% +37.9% ➖ noise
4 duckdb:vortex-compact +34.8% -22.0% +72.9% +47.1% 🚨 regression
4 duckdb:vortex-file-compressed +1.8% -22.0% +30.5% +37.9% ➖ noise
5 datafusion:vortex-compact -12.3% +9.8% -20.1% +37.9% ➖ noise
5 datafusion:vortex-file-compressed -7.9% +9.8% -16.0% +37.9% ➖ noise
5 duckdb:vortex-compact +5.8% +9.8% -3.6% +37.9% ➖ noise
5 duckdb:vortex-file-compressed +7.3% +9.8% -2.2% +37.9% ➖ noise
6 datafusion:vortex-compact +21.4% -5.3% +28.2% +37.9% ➖ noise
6 datafusion:vortex-file-compressed -6.0% -5.3% -0.7% +37.9% ➖ noise
6 duckdb:vortex-compact +1.1% -5.3% +6.8% +37.9% ➖ noise
6 duckdb:vortex-file-compressed +9.9% -5.3% +16.1% +37.9% ➖ noise
7 datafusion:vortex-compact +4.3% +15.9% -10.0% +37.9% ➖ noise
7 datafusion:vortex-file-compressed -2.6% +15.9% -16.0% +37.9% ➖ noise
7 duckdb:vortex-compact +3.9% +15.9% -10.3% +37.9% ➖ noise
7 duckdb:vortex-file-compressed -1.5% +15.9% -15.0% +37.9% ➖ noise
8 datafusion:vortex-compact +5.2% +3.7% +1.4% +37.9% ➖ noise
8 datafusion:vortex-file-compressed +0.3% +3.7% -3.3% +37.9% ➖ noise
8 duckdb:vortex-compact +18.1% +3.7% +13.8% +37.9% ➖ noise
8 duckdb:vortex-file-compressed +17.9% +3.7% +13.7% +37.9% ➖ noise
9 datafusion:vortex-compact -0.7% +12.9% -12.0% +37.9% ➖ noise
9 datafusion:vortex-file-compressed -24.9% +12.9% -33.5% +37.9% ✅ faster
9 duckdb:vortex-compact +1.5% +12.9% -10.1% +37.9% ➖ noise
9 duckdb:vortex-file-compressed +17.7% +12.9% +4.3% +37.9% ➖ noise
10 datafusion:vortex-compact +1.1% +1.3% -0.2% +64.1% ➖ noise
10 datafusion:vortex-file-compressed -11.9% +1.3% -13.0% +38.9% ➖ noise
10 duckdb:vortex-compact +0.4% +1.3% -0.9% +44.0% ➖ noise
10 duckdb:vortex-file-compressed -23.0% +1.3% -23.9% +50.8% ➖ noise
11 datafusion:vortex-compact +59.0% -2.4% +62.8% +47.7% 🚨 regression
11 datafusion:vortex-file-compressed -32.0% -2.4% -30.3% +41.0% ✅ faster
11 duckdb:vortex-compact -4.5% -2.4% -2.2% +37.9% ➖ noise
11 duckdb:vortex-file-compressed -14.7% -2.4% -12.6% +37.9% ➖ noise
12 datafusion:vortex-compact +8.1% -14.1% +25.9% +37.9% ➖ noise
12 datafusion:vortex-file-compressed -16.8% -14.1% -3.1% +37.9% ➖ noise
12 duckdb:vortex-compact +4.0% -14.1% +21.1% +37.9% ➖ noise
12 duckdb:vortex-file-compressed +8.4% -14.1% +26.3% +37.9% ➖ noise
13 datafusion:vortex-compact +10.9% -12.2% +26.4% +77.1% ➖ noise
13 datafusion:vortex-file-compressed +11.6% -12.2% +27.2% +37.9% ➖ noise
13 duckdb:vortex-compact +32.1% -12.2% +50.6% +78.9% ➖ noise
13 duckdb:vortex-file-compressed +4.9% -12.2% +19.5% +53.6% ➖ noise
14 datafusion:vortex-compact +7.3% -9.5% +18.6% +37.9% ➖ noise
14 datafusion:vortex-file-compressed +5.6% -9.5% +16.7% +37.9% ➖ noise
14 duckdb:vortex-compact +9.2% -9.5% +20.7% +37.9% ➖ noise
14 duckdb:vortex-file-compressed +10.6% -9.5% +22.3% +66.7% ➖ noise
15 datafusion:vortex-compact -3.6% -1.8% -1.9% +37.9% ➖ noise
15 datafusion:vortex-file-compressed -0.3% -1.8% +1.5% +37.9% ➖ noise
15 duckdb:vortex-compact +0.8% -1.8% +2.6% +37.9% ➖ noise
15 duckdb:vortex-file-compressed +10.1% -1.8% +12.0% +37.9% ➖ noise
16 datafusion:vortex-compact -19.1% -1.0% -18.3% +37.9% ➖ noise
16 datafusion:vortex-file-compressed +20.8% -1.0% +22.0% +37.9% ➖ noise
16 duckdb:vortex-compact +16.3% -1.0% +17.5% +37.9% ➖ noise
16 duckdb:vortex-file-compressed +20.9% -1.0% +22.1% +37.9% ➖ noise
17 datafusion:vortex-compact +2.8% -0.7% +3.6% +37.9% ➖ noise
17 datafusion:vortex-file-compressed +5.7% -0.7% +6.5% +37.9% ➖ noise
17 duckdb:vortex-compact +3.1% -0.7% +3.8% +37.9% ➖ noise
17 duckdb:vortex-file-compressed +3.0% -0.7% +3.8% +37.9% ➖ noise
18 datafusion:vortex-compact +1.7% -0.1% +1.8% +37.9% ➖ noise
18 datafusion:vortex-file-compressed -0.4% -0.1% -0.4% +37.9% ➖ noise
18 duckdb:vortex-compact +21.4% -0.1% +21.5% +37.9% ➖ noise
18 duckdb:vortex-file-compressed +11.7% -0.1% +11.7% +38.7% ➖ noise
19 datafusion:vortex-compact -2.5% +7.2% -9.0% +37.9% ➖ noise
19 datafusion:vortex-file-compressed +3.9% +7.2% -3.1% +37.9% ➖ noise
19 duckdb:vortex-compact +5.7% +7.2% -1.4% +37.9% ➖ noise
19 duckdb:vortex-file-compressed +8.2% +7.2% +0.9% +37.9% ➖ noise
20 datafusion:vortex-compact -4.2% +5.1% -8.8% +37.9% ➖ noise
20 datafusion:vortex-file-compressed -29.1% +5.1% -32.6% +37.9% ✅ faster
20 duckdb:vortex-compact -11.1% +5.1% -15.4% +37.9% ➖ noise
20 duckdb:vortex-file-compressed +9.6% +5.1% +4.3% +37.9% ➖ noise
21 datafusion:vortex-compact +9.3% -5.0% +15.1% +37.9% ➖ noise
21 datafusion:vortex-file-compressed -5.2% -5.0% -0.2% +37.9% ➖ noise
21 duckdb:vortex-compact +4.9% -5.0% +10.4% +37.9% ➖ noise
21 duckdb:vortex-file-compressed +8.7% -5.0% +14.4% +37.9% ➖ noise
22 datafusion:vortex-compact +22.3% -0.4% +22.9% +37.9% ➖ noise
22 datafusion:vortex-file-compressed -4.3% -0.4% -3.9% +37.9% ➖ noise
22 duckdb:vortex-compact +27.9% -0.4% +28.4% +37.9% ➖ noise
22 duckdb:vortex-file-compressed +7.3% -0.4% +7.8% +37.9% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Vortex (geomean): 0.981x ➖
Parquet (geomean): 0.985x ➖
Shifts: Parquet (control) -1.5% · Median polish -2.1%


datafusion / vortex-file-compressed (0.967x ➖, 2↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1635678 1692220 0.97
clickbench_q01/datafusion:vortex-file-compressed 14435110 14713050 0.98
clickbench_q02/datafusion:vortex-file-compressed 33072098 35429307 0.93
clickbench_q03/datafusion:vortex-file-compressed 36747650 37117633 0.99
clickbench_q04/datafusion:vortex-file-compressed 317812179 333019354 0.95
clickbench_q05/datafusion:vortex-file-compressed 313470751 323172947 0.97
clickbench_q06/datafusion:vortex-file-compressed 1711993 1703504 1.00
clickbench_q07/datafusion:vortex-file-compressed 18118853 16962555 1.07
clickbench_q08/datafusion:vortex-file-compressed 384523015 394264902 0.98
clickbench_q09/datafusion:vortex-file-compressed 576355250 592498453 0.97
clickbench_q10/datafusion:vortex-file-compressed 72761250 74348017 0.98
clickbench_q11/datafusion:vortex-file-compressed 82447004 84861219 0.97
clickbench_q12/datafusion:vortex-file-compressed 275181411 287477027 0.96
clickbench_q13/datafusion:vortex-file-compressed 419870549 432082098 0.97
clickbench_q14/datafusion:vortex-file-compressed 257930180 261600625 0.99
clickbench_q15/datafusion:vortex-file-compressed 387075678 386174250 1.00
clickbench_q16/datafusion:vortex-file-compressed 736341415 754736721 0.98
clickbench_q17/datafusion:vortex-file-compressed 737718550 745791018 0.99
clickbench_q18/datafusion:vortex-file-compressed 1511773113 1491051922 1.01
clickbench_q19/datafusion:vortex-file-compressed 23769356 23650049 1.01
clickbench_q20/datafusion:vortex-file-compressed 350394935 366556114 0.96
clickbench_q21/datafusion:vortex-file-compressed 411582452 424954333 0.97
clickbench_q22/datafusion:vortex-file-compressed 573951261 599879729 0.96
clickbench_q23/datafusion:vortex-file-compressed 591460690 643696584 0.92
clickbench_q24/datafusion:vortex-file-compressed 🚀 45299850 54551684 0.83
clickbench_q25/datafusion:vortex-file-compressed 🚀 70279838 80058457 0.88
clickbench_q26/datafusion:vortex-file-compressed 47575036 49785426 0.96
clickbench_q27/datafusion:vortex-file-compressed 803524334 828566695 0.97
clickbench_q28/datafusion:vortex-file-compressed 6769889428 6883599456 0.98
clickbench_q29/datafusion:vortex-file-compressed 239373744 237407127 1.01
clickbench_q30/datafusion:vortex-file-compressed 258364432 262661002 0.98
clickbench_q31/datafusion:vortex-file-compressed 298007838 303240058 0.98
clickbench_q32/datafusion:vortex-file-compressed 1308266825 1362609034 0.96
clickbench_q33/datafusion:vortex-file-compressed 1399133407 1500461931 0.93
clickbench_q34/datafusion:vortex-file-compressed 1398374661 1497728495 0.93
clickbench_q35/datafusion:vortex-file-compressed 517258556 543405745 0.95
clickbench_q36/datafusion:vortex-file-compressed 80670963 83603470 0.96
clickbench_q37/datafusion:vortex-file-compressed 38787823 38742322 1.00
clickbench_q38/datafusion:vortex-file-compressed 23695911 24232605 0.98
clickbench_q39/datafusion:vortex-file-compressed 152006446 159564537 0.95
clickbench_q40/datafusion:vortex-file-compressed 21209298 20474629 1.04
clickbench_q41/datafusion:vortex-file-compressed 18456161 19574733 0.94
clickbench_q42/datafusion:vortex-file-compressed 21413262 23336472 0.92
datafusion / parquet (0.975x ➖, 0↑ 1↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1683239 1562949 1.08
clickbench_q01/datafusion:parquet 21232259 21534018 0.99
clickbench_q02/datafusion:parquet 48859885 49400607 0.99
clickbench_q03/datafusion:parquet 41051219 41651819 0.99
clickbench_q04/datafusion:parquet 343463396 360523411 0.95
clickbench_q05/datafusion:parquet 373488768 391694045 0.95
clickbench_q06/datafusion:parquet 1580877 1732627 0.91
clickbench_q07/datafusion:parquet 27414147 28727861 0.95
clickbench_q08/datafusion:parquet 413014944 429908986 0.96
clickbench_q09/datafusion:parquet 642124656 684346567 0.94
clickbench_q10/datafusion:parquet 119302262 124791045 0.96
clickbench_q11/datafusion:parquet 146898084 155272159 0.95
clickbench_q12/datafusion:parquet 368693815 388866489 0.95
clickbench_q13/datafusion:parquet 523964399 537598865 0.97
clickbench_q14/datafusion:parquet 379425737 381423810 0.99
clickbench_q15/datafusion:parquet 390745694 417658177 0.94
clickbench_q16/datafusion:parquet 742321872 791334785 0.94
clickbench_q17/datafusion:parquet 728053328 760680050 0.96
clickbench_q18/datafusion:parquet 1458923689 1588492159 0.92
clickbench_q19/datafusion:parquet 🚨 40709426 32980371 1.23
clickbench_q20/datafusion:parquet 608464428 639092555 0.95
clickbench_q21/datafusion:parquet 672072237 696424866 0.97
clickbench_q22/datafusion:parquet 977268277 998821945 0.98
clickbench_q23/datafusion:parquet 3771726368 3862767734 0.98
clickbench_q24/datafusion:parquet 95141468 94392427 1.01
clickbench_q25/datafusion:parquet 152122819 151232611 1.01
clickbench_q26/datafusion:parquet 101074877 97633225 1.04
clickbench_q27/datafusion:parquet 1074887572 1102819965 0.97
clickbench_q28/datafusion:parquet 6544993611 6815995371 0.96
clickbench_q29/datafusion:parquet 235380420 239978938 0.98
clickbench_q30/datafusion:parquet 376167237 393320250 0.96
clickbench_q31/datafusion:parquet 410348194 424237254 0.97
clickbench_q32/datafusion:parquet 1406619776 1427121309 0.99
clickbench_q33/datafusion:parquet 1597301321 1600271274 1.00
clickbench_q34/datafusion:parquet 1550315090 1618050371 0.96
clickbench_q35/datafusion:parquet 549042849 566785694 0.97
clickbench_q36/datafusion:parquet 142589958 150035903 0.95
clickbench_q37/datafusion:parquet 57468403 59710374 0.96
clickbench_q38/datafusion:parquet 93651682 89569554 1.05
clickbench_q39/datafusion:parquet 272852738 290299163 0.94
clickbench_q40/datafusion:parquet 36095836 35691826 1.01
clickbench_q41/datafusion:parquet 31175824 33405834 0.93
clickbench_q42/datafusion:parquet 31537038 33059516 0.95
duckdb / vortex-file-compressed (0.994x ➖, 1↑ 3↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5843883 6175653 0.95
clickbench_q01/duckdb:vortex-file-compressed 13475651 13934047 0.97
clickbench_q02/duckdb:vortex-file-compressed 23415347 25157351 0.93
clickbench_q03/duckdb:vortex-file-compressed 29785862 30802636 0.97
clickbench_q04/duckdb:vortex-file-compressed 172948786 173596821 1.00
clickbench_q05/duckdb:vortex-file-compressed 197418773 202601914 0.97
clickbench_q06/duckdb:vortex-file-compressed 18989320 20208824 0.94
clickbench_q07/duckdb:vortex-file-compressed 15038702 15681540 0.96
clickbench_q08/duckdb:vortex-file-compressed 264536499 265823695 1.00
clickbench_q09/duckdb:vortex-file-compressed 378428110 376706115 1.00
clickbench_q10/duckdb:vortex-file-compressed 73057417 75298578 0.97
clickbench_q11/duckdb:vortex-file-compressed 80493587 83230320 0.97
clickbench_q12/duckdb:vortex-file-compressed 215293775 223444085 0.96
clickbench_q13/duckdb:vortex-file-compressed 436309862 443155411 0.98
clickbench_q14/duckdb:vortex-file-compressed 240791463 247081895 0.97
clickbench_q15/duckdb:vortex-file-compressed 209030192 214628565 0.97
clickbench_q16/duckdb:vortex-file-compressed 736005760 742438502 0.99
clickbench_q17/duckdb:vortex-file-compressed 623629162 617150452 1.01
clickbench_q18/duckdb:vortex-file-compressed 1237218658 1241744138 1.00
clickbench_q19/duckdb:vortex-file-compressed 20898014 22103710 0.95
clickbench_q20/duckdb:vortex-file-compressed 431565852 414965398 1.04
clickbench_q21/duckdb:vortex-file-compressed 426303763 427701807 1.00
clickbench_q22/duckdb:vortex-file-compressed 🚨 749718178 659281435 1.14
clickbench_q23/duckdb:vortex-file-compressed 🚀 811812976 1139165653 0.71
clickbench_q24/duckdb:vortex-file-compressed 46143280 48830339 0.94
clickbench_q25/duckdb:vortex-file-compressed 74720996 75202892 0.99
clickbench_q26/duckdb:vortex-file-compressed 44610382 46721154 0.95
clickbench_q27/duckdb:vortex-file-compressed 534718045 556735203 0.96
clickbench_q28/duckdb:vortex-file-compressed 3012138671 3034843558 0.99
clickbench_q29/duckdb:vortex-file-compressed 27963036 28052384 1.00
clickbench_q30/duckdb:vortex-file-compressed 195859328 197980195 0.99
clickbench_q31/duckdb:vortex-file-compressed 277347184 280054195 0.99
clickbench_q32/duckdb:vortex-file-compressed 1416877317 1407607181 1.01
clickbench_q33/duckdb:vortex-file-compressed 1730923911 1730418753 1.00
clickbench_q34/duckdb:vortex-file-compressed 1832889004 1808831067 1.01
clickbench_q35/duckdb:vortex-file-compressed 368602828 368010097 1.00
clickbench_q36/duckdb:vortex-file-compressed 29692136 28836326 1.03
clickbench_q37/duckdb:vortex-file-compressed 22846605 20874626 1.09
clickbench_q38/duckdb:vortex-file-compressed 22986766 21403273 1.07
clickbench_q39/duckdb:vortex-file-compressed 46371861 43813929 1.06
clickbench_q40/duckdb:vortex-file-compressed 🚨 23123133 19243415 1.20
clickbench_q41/duckdb:vortex-file-compressed 🚨 22608819 19596565 1.15
clickbench_q42/duckdb:vortex-file-compressed 22189350 20642194 1.07
duckdb / parquet (0.995x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 219947380 233805875 0.94
clickbench_q01/duckdb:parquet 51102606 50935437 1.00
clickbench_q02/duckdb:parquet 65956919 66740931 0.99
clickbench_q03/duckdb:parquet 64864029 64537578 1.01
clickbench_q04/duckdb:parquet 204398026 206463275 0.99
clickbench_q05/duckdb:parquet 279205983 281610858 0.99
clickbench_q06/duckdb:parquet 60647572 60669171 1.00
clickbench_q07/duckdb:parquet 53101207 50549365 1.05
clickbench_q08/duckdb:parquet 269068261 273527416 0.98
clickbench_q09/duckdb:parquet 395383608 398491139 0.99
clickbench_q10/duckdb:parquet 97057951 94930397 1.02
clickbench_q11/duckdb:parquet 107556027 108720022 0.99
clickbench_q12/duckdb:parquet 299342747 297823272 1.01
clickbench_q13/duckdb:parquet 509810586 531599948 0.96
clickbench_q14/duckdb:parquet 332357857 332744072 1.00
clickbench_q15/duckdb:parquet 241265691 246678094 0.98
clickbench_q16/duckdb:parquet 615481600 622105285 0.99
clickbench_q17/duckdb:parquet 509561354 522869079 0.97
clickbench_q18/duckdb:parquet 1057438665 1070540237 0.99
clickbench_q19/duckdb:parquet 50016366 50347141 0.99
clickbench_q20/duckdb:parquet 436110877 440808691 0.99
clickbench_q21/duckdb:parquet 561024011 560938484 1.00
clickbench_q22/duckdb:parquet 945730771 932835249 1.01
clickbench_q23/duckdb:parquet 319161416 320426970 1.00
clickbench_q24/duckdb:parquet 78758836 76694641 1.03
clickbench_q25/duckdb:parquet 140754423 140382176 1.00
clickbench_q26/duckdb:parquet 52238081 52480924 1.00
clickbench_q27/duckdb:parquet 640087933 642289321 1.00
clickbench_q28/duckdb:parquet 4846409952 4861549715 1.00
clickbench_q29/duckdb:parquet 61240678 61807260 0.99
clickbench_q30/duckdb:parquet 305983085 307515964 1.00
clickbench_q31/duckdb:parquet 349176138 352147729 0.99
clickbench_q32/duckdb:parquet 1178311523 1165682353 1.01
clickbench_q33/duckdb:parquet 1271156551 1251946361 1.02
clickbench_q34/duckdb:parquet 1279707626 1304423450 0.98
clickbench_q35/duckdb:parquet 353612439 355523999 0.99
clickbench_q36/duckdb:parquet 64681764 64775899 1.00
clickbench_q37/duckdb:parquet 53757779 53921596 1.00
clickbench_q38/duckdb:parquet 56534192 58356470 0.97
clickbench_q39/duckdb:parquet 98642993 100629546 0.98
clickbench_q40/duckdb:parquet 55822680 55080591 1.01
clickbench_q41/duckdb:parquet 59569484 59765740 1.00
clickbench_q42/duckdb:parquet 53092498 52612681 1.01
duckdb / duckdb (0.971x ➖, 0↑ 0↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17823102 18796801 0.95
clickbench_q01/duckdb:duckdb 32435245 33430374 0.97
clickbench_q02/duckdb:duckdb 44943767 45398349 0.99
clickbench_q03/duckdb:duckdb 46732631 47350277 0.99
clickbench_q04/duckdb:duckdb 222012390 222709035 1.00
clickbench_q05/duckdb:duckdb 321257196 323670564 0.99
clickbench_q06/duckdb:duckdb 34626457 35994798 0.96
clickbench_q07/duckdb:duckdb 36034845 35526096 1.01
clickbench_q08/duckdb:duckdb 299970700 313510534 0.96
clickbench_q09/duckdb:duckdb 469492129 489778400 0.96
clickbench_q10/duckdb:duckdb 98238227 98200920 1.00
clickbench_q11/duckdb:duckdb 107190545 108856624 0.98
clickbench_q12/duckdb:duckdb 291626190 304906846 0.96
clickbench_q13/duckdb:duckdb 518975000 562427841 0.92
clickbench_q14/duckdb:duckdb 333799183 354134876 0.94
clickbench_q15/duckdb:duckdb 257861098 269239723 0.96
clickbench_q16/duckdb:duckdb 674753004 692070021 0.97
clickbench_q17/duckdb:duckdb 568838776 602307877 0.94
clickbench_q18/duckdb:duckdb 1259133624 1295843877 0.97
clickbench_q19/duckdb:duckdb 35409397 35537030 1.00
clickbench_q20/duckdb:duckdb 897332470 984439759 0.91
clickbench_q21/duckdb:duckdb 985453416 1080876516 0.91
clickbench_q22/duckdb:duckdb 1058972011 1148445355 0.92
clickbench_q23/duckdb:duckdb 247187554 257753156 0.96
clickbench_q24/duckdb:duckdb 60706178 61152242 0.99
clickbench_q25/duckdb:duckdb 123877008 123510443 1.00
clickbench_q26/duckdb:duckdb 55349245 57645947 0.96
clickbench_q27/duckdb:duckdb 1000788692 1073283980 0.93
clickbench_q28/duckdb:duckdb 4667148521 4667473885 1.00
clickbench_q29/duckdb:duckdb 48477122 47928842 1.01
clickbench_q30/duckdb:duckdb 284543358 308622348 0.92
clickbench_q31/duckdb:duckdb 421929090 463520638 0.91
clickbench_q32/duckdb:duckdb 1457547318 1539384623 0.95
clickbench_q33/duckdb:duckdb 2022196046 2100444563 0.96
clickbench_q34/duckdb:duckdb 2193667407 2155500787 1.02
clickbench_q35/duckdb:duckdb 265940130 265079664 1.00
clickbench_q36/duckdb:duckdb 41681135 40750975 1.02
clickbench_q37/duckdb:duckdb 31483690 31416935 1.00
clickbench_q38/duckdb:duckdb 30826535 30895017 1.00
clickbench_q39/duckdb:duckdb 66043923 65127584 1.01
clickbench_q40/duckdb:duckdb 31554888 31902615 0.99
clickbench_q41/duckdb:duckdb 29474583 30474324 0.97
clickbench_q42/duckdb:duckdb 31252576 31320270 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -3.3% +0.7% -4.0% +818.5% ➖ noise
0 duckdb:duckdb -5.2% +0.7% -5.8% +305.4% ➖ noise
0 duckdb:vortex-file-compressed -5.4% +0.7% -6.0% +351.1% ➖ noise
1 datafusion:vortex-file-compressed -1.9% -0.5% -1.4% +32.9% ➖ noise
1 duckdb:duckdb -3.0% -0.5% -2.4% +60.5% ➖ noise
1 duckdb:vortex-file-compressed -3.3% -0.5% -2.8% +18.9% ➖ noise
2 datafusion:vortex-file-compressed -6.7% -1.1% -5.6% +31.0% ➖ noise
2 duckdb:duckdb -1.0% -1.1% +0.1% +25.1% ➖ noise
2 duckdb:vortex-file-compressed -6.9% -1.1% -5.9% +15.8% ➖ noise
3 datafusion:vortex-file-compressed -1.0% -0.5% -0.5% +173.8% ➖ noise
3 duckdb:duckdb -1.3% -0.5% -0.8% +58.1% ➖ noise
3 duckdb:vortex-file-compressed -3.3% -0.5% -2.8% +30.5% ➖ noise
4 datafusion:vortex-file-compressed -4.6% -2.9% -1.7% +10.0% ➖ noise
4 duckdb:duckdb -0.3% -2.9% +2.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.4% -2.9% +2.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -3.0% -2.8% -0.2% +10.0% ➖ noise
5 duckdb:duckdb -0.7% -2.8% +2.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.6% -2.8% +0.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.5% -4.5% +5.2% +45.6% ➖ noise
6 duckdb:duckdb -3.8% -4.5% +0.7% +28.0% ➖ noise
6 duckdb:vortex-file-compressed -6.0% -4.5% -1.6% +20.6% ➖ noise
7 datafusion:vortex-file-compressed +6.8% +0.1% +6.7% +16.3% ➖ noise
7 duckdb:duckdb +1.4% +0.1% +1.3% +12.8% ➖ noise
7 duckdb:vortex-file-compressed -4.1% +0.1% -4.2% +13.3% ➖ noise
8 datafusion:vortex-file-compressed -2.5% -2.8% +0.3% +10.0% ➖ noise
8 duckdb:duckdb -4.3% -2.8% -1.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.5% -2.8% +2.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -2.7% -3.5% +0.8% +10.0% ➖ noise
9 duckdb:duckdb -4.1% -3.5% -0.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.5% -3.5% +4.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.1% -1.1% -1.0% +10.0% ➖ noise
10 duckdb:duckdb +0.0% -1.1% +1.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -3.0% -1.1% -1.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.8% -3.3% +0.4% +10.0% ➖ noise
11 duckdb:duckdb -1.5% -3.3% +1.8% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -3.3% -3.3% -0.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -4.3% -2.4% -1.9% +10.0% ➖ noise
12 duckdb:duckdb -4.4% -2.4% -2.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -3.6% -2.4% -1.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.8% -3.3% +0.5% +10.0% ➖ noise
13 duckdb:duckdb -7.7% -3.3% -4.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -1.5% -3.3% +1.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.4% -0.3% -1.1% +10.0% ➖ noise
14 duckdb:duckdb -5.7% -0.3% -5.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.5% -0.3% -2.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.2% -4.3% +4.8% +10.0% ➖ noise
15 duckdb:duckdb -4.2% -4.3% +0.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -2.6% -4.3% +1.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.4% -3.7% +1.3% +10.0% ➖ noise
16 duckdb:duckdb -2.5% -3.7% +1.2% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.9% -3.7% +2.9% +17.7% ➖ noise
17 datafusion:vortex-file-compressed -1.1% -3.4% +2.4% +10.0% ➖ noise
17 duckdb:duckdb -5.6% -3.4% -2.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.0% -3.4% +4.6% +14.2% ➖ noise
18 datafusion:vortex-file-compressed +1.4% -4.8% +6.4% +10.8% ➖ noise
18 duckdb:duckdb -2.8% -4.8% +2.0% +10.8% ➖ noise
18 duckdb:vortex-file-compressed -0.4% -4.8% +4.6% +13.6% ➖ noise
19 datafusion:vortex-file-compressed +0.5% +10.7% -9.2% +14.1% ➖ noise
19 duckdb:duckdb -0.4% +10.7% -10.0% +12.0% ➖ noise
19 duckdb:vortex-file-compressed -5.5% +10.7% -14.6% +29.8% ➖ noise
20 datafusion:vortex-file-compressed -4.4% -2.9% -1.5% +186.4% ➖ noise
20 duckdb:duckdb -8.8% -2.9% -6.1% +29.2% ➖ noise
20 duckdb:vortex-file-compressed +4.0% -2.9% +7.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -3.1% -1.8% -1.4% +10.0% ➖ noise
21 duckdb:duckdb -8.8% -1.8% -7.2% +12.9% ➖ noise
21 duckdb:vortex-file-compressed -0.3% -1.8% +1.5% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -4.3% -0.4% -3.9% +10.0% ➖ noise
22 duckdb:duckdb -7.8% -0.4% -7.4% +12.6% ➖ noise
22 duckdb:vortex-file-compressed +13.7% -0.4% +14.2% +15.6% ➖ noise
23 datafusion:vortex-file-compressed -8.1% -1.4% -6.8% +56.8% ➖ noise
23 duckdb:duckdb -4.1% -1.4% -2.8% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -28.7% -1.4% -27.7% +32.2% ✅ faster
24 datafusion:vortex-file-compressed -17.0% +1.7% -18.4% +14.3% ✅ faster
24 duckdb:duckdb -0.7% +1.7% -2.4% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -5.5% +1.7% -7.1% +39.0% ➖ noise
25 datafusion:vortex-file-compressed -12.2% +0.4% -12.6% +11.6% ✅ faster
25 duckdb:duckdb +0.3% +0.4% -0.1% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -0.6% +0.4% -1.1% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -4.4% +1.5% -5.9% +14.3% ➖ noise
26 duckdb:duckdb -4.0% +1.5% -5.4% +15.2% ➖ noise
26 duckdb:vortex-file-compressed -4.5% +1.5% -5.9% +20.7% ➖ noise
27 datafusion:vortex-file-compressed -3.0% -1.4% -1.6% +10.0% ➖ noise
27 duckdb:duckdb -6.8% -1.4% -5.4% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -4.0% -1.4% -2.5% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -1.7% -2.2% +0.5% +10.0% ➖ noise
28 duckdb:duckdb -0.0% -2.2% +2.2% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.7% -2.2% +1.4% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +0.8% -1.4% +2.3% +13.1% ➖ noise
29 duckdb:duckdb +1.1% -1.4% +2.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -0.3% -1.4% +1.1% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -1.6% -2.4% +0.8% +10.0% ➖ noise
30 duckdb:duckdb -7.8% -2.4% -5.5% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -1.1% -2.4% +1.4% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -1.7% -2.1% +0.3% +10.0% ➖ noise
31 duckdb:duckdb -9.0% -2.1% -7.1% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -1.0% -2.1% +1.1% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -4.0% -0.2% -3.8% +18.5% ➖ noise
32 duckdb:duckdb -5.3% -0.2% -5.1% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +0.7% -0.2% +0.8% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -6.8% +0.7% -7.4% +10.0% ➖ noise
33 duckdb:duckdb -3.7% +0.7% -4.4% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +0.0% +0.7% -0.6% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -6.6% -3.0% -3.7% +10.0% ➖ noise
34 duckdb:duckdb +1.8% -3.0% +5.0% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +1.3% -3.0% +4.5% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -4.8% -1.8% -3.0% +10.0% ➖ noise
35 duckdb:duckdb +0.3% -1.8% +2.2% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.2% -1.8% +2.0% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -3.5% -2.6% -0.9% +10.0% ➖ noise
36 duckdb:duckdb +2.3% -2.6% +5.0% +10.3% ➖ noise
36 duckdb:vortex-file-compressed +3.0% -2.6% +5.7% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +0.1% -2.0% +2.2% +10.0% ➖ noise
37 duckdb:duckdb +0.2% -2.0% +2.3% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +9.4% -2.0% +11.7% +10.0% 🚨 regression
38 datafusion:vortex-file-compressed -2.2% +0.6% -2.8% +10.0% ➖ noise
38 duckdb:duckdb -0.2% +0.6% -0.9% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +7.4% +0.6% +6.7% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -4.7% -4.0% -0.8% +10.0% ➖ noise
39 duckdb:duckdb +1.4% -4.0% +5.6% +13.7% ➖ noise
39 duckdb:vortex-file-compressed +5.8% -4.0% +10.3% +16.5% ➖ noise
40 datafusion:vortex-file-compressed +3.6% +1.2% +2.3% +10.0% ➖ noise
40 duckdb:duckdb -1.1% +1.2% -2.3% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +20.2% +1.2% +18.7% +10.1% 🚨 regression
41 datafusion:vortex-file-compressed -5.7% -3.6% -2.2% +10.0% ➖ noise
41 duckdb:duckdb -3.3% -3.6% +0.3% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +15.4% -3.6% +19.6% +10.0% 🚨 regression
42 datafusion:vortex-file-compressed -8.2% -1.9% -6.5% +10.0% ➖ noise
42 duckdb:duckdb -0.2% -1.9% +1.7% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +7.5% -1.9% +9.6% +11.3% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: Compression

Vortex (geomean): 0.999x ➖
Parquet (geomean): 1.001x ➖


unknown / unknown (1.002x ➖, 0↑ 2↓)
name PR a05fcab (ns) base 50868db (ns) ratio (PR/base)
compress time/Arade 1117245298 1128228180 0.99
compress time/Bimbo 7101985883 6946197798 1.02
compress time/CMSprovider 2953680042 2917426314 1.01
compress time/Euro2016 432262318 415719260 1.04
compress time/Food 405407772 384623856 1.05
compress time/HashTags 906609171 907367383 1.00
compress time/TPC-H l_comment canonical 1328356769 1316328127 1.01
compress time/TPC-H l_comment chunked 1329244759 1317349765 1.01
compress time/taxi 708595781 719624910 0.98
compress time/wide table cols=100 chunks=1 rows=1000 15696842 15875127 0.99
compress time/wide table cols=100 chunks=50 rows=1000 16333106 15727004 1.04
compress time/wide table cols=1000 chunks=1 rows=1000 155400447 160149157 0.97
compress time/wide table cols=1000 chunks=50 rows=1000 160639005 160064606 1.00
compress time/wide table cols=10000 chunks=1 rows=1000 1524124997 1559982102 0.98
compress time/wide table cols=10000 chunks=50 rows=1000 1541173099 1541490380 1.00
decompress time/Arade 31420460 30979957 1.01
decompress time/Bimbo 🚨 109023836 98998679 1.10
decompress time/CMSprovider 87126106 84994940 1.03
decompress time/Euro2016 21871591 23079309 0.95
decompress time/Food 8559764 8820011 0.97
decompress time/HashTags 77244857 81762257 0.94
decompress time/TPC-H l_comment canonical 40925003 41402673 0.99
decompress time/TPC-H l_comment chunked 40522095 42000325 0.96
decompress time/taxi 19714485 20764591 0.95
decompress time/wide table cols=100 chunks=1 rows=1000 2680326 2756762 0.97
decompress time/wide table cols=100 chunks=50 rows=1000 2699588 2659979 1.01
decompress time/wide table cols=1000 chunks=1 rows=1000 23864862 22919174 1.04
decompress time/wide table cols=1000 chunks=50 rows=1000 23556418 23159421 1.02
decompress time/wide table cols=10000 chunks=1 rows=1000 242250878 234710960 1.03
decompress time/wide table cols=10000 chunks=50 rows=1000 247752007 237381133 1.04
parquet size/Arade 305282152 305282152 1.00
parquet size/Bimbo 388935055 388935055 1.00
parquet size/CMSprovider 384634824 384634824 1.00
parquet size/Euro2016 123042700 123042700 1.00
parquet size/Food 36177631 36177631 1.00
parquet size/HashTags 133854962 133854962 1.00
parquet size/TPC-H l_comment canonical 158411391 158411391 1.00
parquet size/TPC-H l_comment chunked 158411391 158411391 1.00
parquet size/taxi 55879185 55879185 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932204 932204 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932204 932204 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93220004 93220004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93220004 93220004 1.00
parquet_rs-zstd compress time/Arade 2491059002 2486936808 1.00
parquet_rs-zstd compress time/Bimbo 15676914408 15719219436 1.00
parquet_rs-zstd compress time/CMSprovider 8090377954 7917790168 1.02
parquet_rs-zstd compress time/Euro2016 1461689157 1450549043 1.01
parquet_rs-zstd compress time/Food 925342027 928932014 1.00
parquet_rs-zstd compress time/HashTags 2523421440 2547117733 0.99
parquet_rs-zstd compress time/TPC-H l_comment canonical 3174590781 3198826245 0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked 3192687740 3166208895 1.01
parquet_rs-zstd compress time/taxi 1386449124 1383133395 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6494265 6479437 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 7234722 6435507 1.12
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 85837286 86145296 1.00
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 86627327 86884387 1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 898045330 887203983 1.01
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 883925372 891857997 0.99
parquet_rs-zstd decompress time/Arade 665004439 664450638 1.00
parquet_rs-zstd decompress time/Bimbo 2312738294 2233450643 1.04
parquet_rs-zstd decompress time/CMSprovider 2118017903 2107349168 1.01
parquet_rs-zstd decompress time/Euro2016 418622881 418968299 1.00
parquet_rs-zstd decompress time/Food 241210642 238958414 1.01
parquet_rs-zstd decompress time/HashTags 670107674 692367090 0.97
parquet_rs-zstd decompress time/TPC-H l_comment canonical 714898945 716749095 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked 719047274 704942291 1.02
parquet_rs-zstd decompress time/taxi 291638864 285271635 1.02
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2535146 2551554 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2599388 2568172 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 29847020 29979050 1.00
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 29935775 30530142 0.98
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 339539838 345565621 0.98
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 341744896 341003003 1.00
vortex-file-compressed size/Arade 143320892 143320892 1.00
vortex-file-compressed size/Bimbo 526057964 526057964 1.00
vortex-file-compressed size/CMSprovider 448338524 448338524 1.00
vortex-file-compressed size/Euro2016 167917628 167858692 1.00
vortex-file-compressed size/Food 44162400 44162400 1.00
vortex-file-compressed size/HashTags 198700644 198700644 1.00
vortex-file-compressed size/TPC-H l_comment canonical 180408824 180408824 1.00
vortex-file-compressed size/TPC-H l_comment chunked 180408824 180408824 1.00
vortex-file-compressed size/taxi 51448740 51448740 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317584 88317584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317584 88317584 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.99
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.03
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.99
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.03
vortex:parquet-zstd ratio compress time/Food 0 0 1.06
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio compress time/taxi 0 0 0.98
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 0.92
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.01
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.06
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.95
vortex:parquet-zstd ratio decompress time/Food 0 0 0.96
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.98
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.95
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 17, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 17, 2026
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 17, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant