duckdb: honor preserve_insertion_order for scans by myrrc · Pull Request #9604 · vortex-data/vortex

myrrc · 2026-08-25T10:33:11Z

Duckdb provides ordering guarantees for file scans by default unlike ANSI SQL.
These are provided via preserve_insertion_order setting. Use this setting in
scans.

Resolves: #9481

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>

codspeed-hq · 2026-08-25T10:38:43Z

Merging this PR will regress 3 benchmarks

⚠️

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️

Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 2 improved benchmarks
❌ 3 regressed benchmarks
✅ 2092 untouched benchmarks
⏩ 106 skipped benchmarks¹

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

	Mode	Benchmark	`BASE`	`HEAD`	Efficiency
❌	WallTime	`words_gather_scalar_avx2[65536]`	8.3 µs	9.4 µs	-11.96%
❌	Simulation	`cold_misaligned[(16, 64)]`	344.6 µs	390.2 µs	-11.67%
❌	Simulation	`compress_fsst[(500, 64, 8)]`	480.4 µs	538 µs	-10.72%
⚡	WallTime	`arrow_checked_add_u32_neon[16384]`	20.4 µs	13.5 µs	+50.62%
⚡	WallTime	`arrow_checked_add_u32_avx512[16384]`	21.4 µs	17.6 µs	+21.22%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

_{Comparing myrrc/duckdb-chunk-offset (6554a82) with develop (17bd9e2)}

106 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

github-actions · 2026-08-25T10:39:00Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟡 In Progress	`6554a82`	compress-bench	1	Explore Profiling Data
🟢 Done	`6554a82`	random-access-bench	1	Explore Profiling Data
🟢 Done	`6554a82`	string-bench	1	Explore Profiling Data
🟢 Done	`6554a82`	statpopgen	1	Explore Profiling Data
🟢 Done	`6554a82`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`6554a82`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`6554a82`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`6554a82`	fineweb	1	Explore Profiling Data
🟢 Done	`6554a82`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`6554a82`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`6554a82`	polarsignals	1	Explore Profiling Data
🟢 Done	`6554a82`	tpch-s3	1	Explore Profiling Data
🟢 Done	`6554a82`	tpch-nvme	1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-08-25T10:40:39Z

Benchmarks: PolarSignals Profiling 📖

Commits: PR 6554a829 vs base 17bd9e27
Vortex (geomean): hot 0.991x ➖ · cold 1.094x ➖

datafusion / vortex-file-compressed / ns (0.991x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed	97532782 / 114397560 / -14.7% 🟢	206945744 / 200267203 / +3.3%	0.47 / 0.57 / -17.5%
polarsignals_q01/datafusion:vortex-file-compressed	159031623 / 159037656 / -0.0%	276448690 / 266936168 / +3.6%	0.58 / 0.60 / -3.4%
polarsignals_q02/datafusion:vortex-file-compressed	21327208 / 20914258 / +2.0%	89988955 / 79741522 / +12.9% 🔴	0.24 / 0.26 / -9.6%
polarsignals_q03/datafusion:vortex-file-compressed	160700550 / 164825572 / -2.5%	282228997 / 267601721 / +5.5%	0.57 / 0.62 / -7.6%
polarsignals_q04/datafusion:vortex-file-compressed	11165727 / 11255690 / -0.8%	80707139 / 69112511 / +16.8% 🔴	0.14 / 0.16 / -15.1%
polarsignals_q05/datafusion:vortex-file-compressed	14120730 / 14385990 / -1.8%	85567012 / 80750606 / +6.0%	0.17 / 0.18 / -7.4%
polarsignals_q06/datafusion:vortex-file-compressed	23451266 / 23807786 / -1.5%	98214564 / 86786580 / +13.2% 🔴	0.24 / 0.27 / -13.0%
polarsignals_q07/datafusion:vortex-file-compressed	11833930 / 11729864 / +0.9%	82192594 / 74353872 / +10.5% 🔴	0.14 / 0.16 / -8.7%
polarsignals_q08/datafusion:vortex-file-compressed	278515042 / 279132286 / -0.2%	381737570 / 375239080 / +1.7%	0.73 / 0.74 / -1.9%
polarsignals_q09/datafusion:vortex-file-compressed	14204696 / 12666912 / +12.1% 🔴	82229921 / 66975912 / +22.8% 🔴	0.17 / 0.19 / -8.7%

No file size changes detected.

github-actions · 2026-08-25T10:41:45Z

Benchmarks: FineWeb NVMe 📖

Commits: PR 6554a829 vs base 17bd9e27
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.8%
Engines: DataFusion No clear signal (-2.0%, low confidence) · DuckDB No clear signal (-1.6%, low confidence)
Vortex (geomean): hot 0.988x ➖ · cold 1.007x ➖
Parquet (geomean): hot 1.007x ➖ · cold 0.985x ➖
Shifts: Parquet (control) +0.7% · Median polish -0.6%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	7870568 / 8623330 / -8.7%	38439416 / 36057984 / +6.6%	0.20 / 0.24 / -14.4%
fineweb_q01/datafusion:vortex-file-compressed	27592198 / 28677068 / -3.8%	102620604 / 103048519 / -0.4%	0.27 / 0.28 / -3.4%
fineweb_q02/datafusion:vortex-file-compressed	33318676 / 33023122 / +0.9%	102108204 / 106921231 / -4.5%	0.33 / 0.31 / +5.7%
fineweb_q03/datafusion:vortex-file-compressed	41995802 / 43330196 / -3.1%	189314327 / 182754525 / +3.6%	0.22 / 0.24 / -6.4%
fineweb_q04/datafusion:vortex-file-compressed	207852732 / 206679574 / +0.6%	353324862 / 321334209 / +10.0%	0.59 / 0.64 / -8.5%
fineweb_q05/datafusion:vortex-file-compressed	150840172 / 152090434 / -0.8%	286200175 / 278137343 / +2.9%	0.53 / 0.55 / -3.6%
fineweb_q06/datafusion:vortex-file-compressed	38340385 / 37744855 / +1.6%	195799555 / 184441678 / +6.2%	0.20 / 0.20 / -4.3%
fineweb_q07/datafusion:vortex-file-compressed	38249664 / 38273886 / -0.1%	185669369 / 178652010 / +3.9%	0.21 / 0.21 / -3.8%
fineweb_q08/datafusion:vortex-file-compressed	21160132 / 18641613 / +13.5% 🔴	75226860 / 78351061 / -4.0%	0.28 / 0.24 / +18.2%

datafusion / parquet / ns (1.019x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	9701030 / 8486138 / +14.3% 🔴	46388965 / 50359049 / -7.9%	0.21 / 0.17 / +24.1%
fineweb_q01/datafusion:parquet	195084758 / 196812876 / -0.9%	334391018 / 328402794 / +1.8%	0.58 / 0.60 / -2.7%
fineweb_q02/datafusion:parquet	197960688 / 196543086 / +0.7%	328218157 / 327279256 / +0.3%	0.60 / 0.60 / +0.4%
fineweb_q03/datafusion:parquet	191092344 / 190425544 / +0.4%	283564388 / 293275990 / -3.3%	0.67 / 0.65 / +3.8%
fineweb_q04/datafusion:parquet	207287430 / 207860532 / -0.3%	303854993 / 304758054 / -0.3%	0.68 / 0.68 / +0.0%
fineweb_q05/datafusion:parquet	203489328 / 203715638 / -0.1%	293903015 / 293523012 / +0.1%	0.69 / 0.69 / -0.2%
fineweb_q06/datafusion:parquet	200354199 / 196003382 / +2.2%	329995889 / 332649873 / -0.8%	0.61 / 0.59 / +3.0%
fineweb_q07/datafusion:parquet	191349360 / 191222285 / +0.1%	282669963 / 283770144 / -0.4%	0.68 / 0.67 / +0.5%
fineweb_q08/datafusion:parquet	188395004 / 186224804 / +1.2%	283803091 / 282526935 / +0.5%	0.66 / 0.66 / +0.7%

duckdb / vortex-file-compressed / ns (0.978x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	4540924 / 4985404 / -8.9%	14680695 / 14318499 / +2.5%	0.31 / 0.35 / -11.2%
fineweb_q01/duckdb:vortex-file-compressed	43463154 / 40299518 / +7.9%	141842278 / 116336801 / +21.9% 🔴	0.31 / 0.35 / -11.5%
fineweb_q02/duckdb:vortex-file-compressed	48308607 / 50010728 / -3.4%	110487254 / 127015148 / -13.0% 🟢	0.44 / 0.39 / +11.0%
fineweb_q03/duckdb:vortex-file-compressed	63434266 / 65348373 / -2.9%	195551483 / 218731506 / -10.6% 🟢	0.32 / 0.30 / +8.6%
fineweb_q04/duckdb:vortex-file-compressed	282155115 / 290388896 / -2.8%	428148895 / 422174821 / +1.4%	0.66 / 0.69 / -4.2%
fineweb_q05/duckdb:vortex-file-compressed	220551172 / 219273494 / +0.6%	320597282 / 332164202 / -3.5%	0.69 / 0.66 / +4.2%
fineweb_q06/duckdb:vortex-file-compressed	61978910 / 64583907 / -4.0%	233815596 / 267771763 / -12.7% 🟢	0.27 / 0.24 / +9.9%
fineweb_q07/duckdb:vortex-file-compressed	58657790 / 60402936 / -2.9%	193445037 / 184933700 / +4.6%	0.30 / 0.33 / -7.2%
fineweb_q08/duckdb:vortex-file-compressed	25663263 / 26188212 / -2.0%	94811465 / 90873961 / +4.3%	0.27 / 0.29 / -6.1%

duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	37096270 / 36885892 / +0.6%	41436989 / 40515254 / +2.3%	0.90 / 0.91 / -1.7%
fineweb_q01/duckdb:parquet	75615145 / 75662060 / -0.1%	104928610 / 108692189 / -3.5%	0.72 / 0.70 / +3.5%
fineweb_q02/duckdb:parquet	77688751 / 78417496 / -0.9%	104591644 / 107931851 / -3.1%	0.74 / 0.73 / +2.2%
fineweb_q03/duckdb:parquet	203907496 / 207568736 / -1.8%	405791763 / 432269894 / -6.1%	0.50 / 0.48 / +4.6%
fineweb_q04/duckdb:parquet	230501816 / 232588622 / -0.9%	441253101 / 426062366 / +3.6%	0.52 / 0.55 / -4.3%
fineweb_q05/duckdb:parquet	201684236 / 203532040 / -0.9%	431442558 / 424259153 / +1.7%	0.47 / 0.48 / -2.6%
fineweb_q06/duckdb:parquet	143683334 / 142377556 / +0.9%	279525767 / 277169951 / +0.8%	0.51 / 0.51 / +0.1%
fineweb_q07/duckdb:parquet	144168004 / 144764786 / -0.4%	328581325 / 333053490 / -1.3%	0.44 / 0.43 / +0.9%
fineweb_q08/duckdb:parquet	37521108 / 38023190 / -1.3%	38945206 / 42973922 / -9.4%	0.96 / 0.88 / +8.9%

File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)

File	Scale	Format	Base	HEAD	Change	%
duckdb.db	1.0	vortex-compact	268.00 KB	0 B	268.00 KB	-100.0%
sample.vortex	1.0	vortex-compact	1.23 GB	0 B	1.23 GB	-100.0%

Totals:

vortex-compact: 1.23 GB → 0 B (-100.0%)
vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

github-actions · 2026-08-25T10:41:56Z

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 6554a829 vs base 17bd9e27
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (-1.1%, environment too noisy confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.996x ➖
Parquet (geomean): hot 1.007x ➖ · cold 0.964x ➖
Shifts: Parquet (control) +0.7% · Median polish +0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	42727390 / 41328112 / +3.4%	100489050 / 99031694 / +1.5%	0.43 / 0.42 / +1.9%
tpch_q02/datafusion:vortex-file-compressed	24471002 / 24135932 / +1.4%	67932374 / 68898593 / -1.4%	0.36 / 0.35 / +2.8%
tpch_q03/datafusion:vortex-file-compressed	30138432 / 29960873 / +0.6%	92698771 / 91083404 / +1.8%	0.33 / 0.33 / -1.2%
tpch_q04/datafusion:vortex-file-compressed	16159997 / 15678700 / +3.1%	60834959 / 63932770 / -4.8%	0.27 / 0.25 / +8.3%
tpch_q05/datafusion:vortex-file-compressed	50208930 / 50119889 / +0.2%	120149617 / 114721122 / +4.7%	0.42 / 0.44 / -4.3%
tpch_q06/datafusion:vortex-file-compressed	8377450 / 8370300 / +0.1%	51508191 / 54539167 / -5.6%	0.16 / 0.15 / +6.0%
tpch_q07/datafusion:vortex-file-compressed	55251050 / 54978672 / +0.5%	123787105 / 124918286 / -0.9%	0.45 / 0.44 / +1.4%
tpch_q08/datafusion:vortex-file-compressed	45572572 / 44543510 / +2.3%	112533483 / 106107323 / +6.1%	0.40 / 0.42 / -3.5%
tpch_q09/datafusion:vortex-file-compressed	56005307 / 55327631 / +1.2%	125725247 / 127145425 / -1.1%	0.45 / 0.44 / +2.4%
tpch_q10/datafusion:vortex-file-compressed	29026274 / 29012972 / +0.0%	94239062 / 97012411 / -2.9%	0.31 / 0.30 / +3.0%
tpch_q11/datafusion:vortex-file-compressed	17170263 / 17681779 / -2.9%	58742963 / 61842069 / -5.0%	0.29 / 0.29 / +2.2%
tpch_q12/datafusion:vortex-file-compressed	26174604 / 26393532 / -0.8%	72113312 / 69625456 / +3.6%	0.36 / 0.38 / -4.3%
tpch_q13/datafusion:vortex-file-compressed	24396373 / 24385898 / +0.0%	68731347 / 68032438 / +1.0%	0.35 / 0.36 / -1.0%
tpch_q14/datafusion:vortex-file-compressed	16332285 / 16153941 / +1.1%	67282119 / 69006883 / -2.5%	0.24 / 0.23 / +3.7%
tpch_q15/datafusion:vortex-file-compressed	20916375 / 20794298 / +0.6%	77063159 / 75344718 / +2.3%	0.27 / 0.28 / -1.7%
tpch_q16/datafusion:vortex-file-compressed	24026794 / 24699124 / -2.7%	73923708 / 74224106 / -0.4%	0.33 / 0.33 / -2.3%
tpch_q17/datafusion:vortex-file-compressed	54506378 / 55421918 / -1.7%	117820459 / 116916960 / +0.8%	0.46 / 0.47 / -2.4%
tpch_q18/datafusion:vortex-file-compressed	66649825 / 67662479 / -1.5%	120668319 / 119046297 / +1.4%	0.55 / 0.57 / -2.8%
tpch_q19/datafusion:vortex-file-compressed	15599734 / 15822241 / -1.4%	60022972 / 62600724 / -4.1%	0.26 / 0.25 / +2.8%
tpch_q20/datafusion:vortex-file-compressed	30780803 / 30979229 / -0.6%	82319535 / 84641514 / -2.7%	0.37 / 0.37 / +2.2%
tpch_q21/datafusion:vortex-file-compressed	59584299 / 60354883 / -1.3%	131369104 / 139449481 / -5.8%	0.45 / 0.43 / +4.8%
tpch_q22/datafusion:vortex-file-compressed	13557679 / 13598986 / -0.3%	53915525 / 51359795 / +5.0%	0.25 / 0.26 / -5.0%

datafusion / parquet / ns (1.011x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	107265168 / 107549911 / -0.3%	135260217 / 223138854 / -39.4% 🟢	0.79 / 0.48 / +64.5%
tpch_q02/datafusion:parquet	68401136 / 69462004 / -1.5%	116517539 / 122212696 / -4.7%	0.59 / 0.57 / +3.3%
tpch_q03/datafusion:parquet	94230211 / 94465569 / -0.2%	146541713 / 163152989 / -10.2% 🟢	0.64 / 0.58 / +11.1%
tpch_q04/datafusion:parquet	52154483 / 54688474 / -4.6%	100015622 / 100977825 / -1.0%	0.52 / 0.54 / -3.7%
tpch_q05/datafusion:parquet	124830686 / 114354708 / +9.2%	196816184 / 202021488 / -2.6%	0.63 / 0.57 / +12.0%
tpch_q06/datafusion:parquet	45557539 / 45371462 / +0.4%	75403173 / 91889975 / -17.9% 🟢	0.60 / 0.49 / +22.4%
tpch_q07/datafusion:parquet	130263167 / 128021163 / +1.8%	203821679 / 204702376 / -0.4%	0.64 / 0.63 / +2.2%
tpch_q08/datafusion:parquet	120142239 / 124097608 / -3.2%	190183597 / 204050664 / -6.8%	0.63 / 0.61 / +3.9%
tpch_q09/datafusion:parquet	153676430 / 146821171 / +4.7%	230265355 / 238705580 / -3.5%	0.67 / 0.62 / +8.5%
tpch_q10/datafusion:parquet	117331915 / 115940047 / +1.2%	193165971 / 207797265 / -7.0%	0.61 / 0.56 / +8.9%
tpch_q11/datafusion:parquet	49475028 / 49569377 / -0.2%	98194987 / 104819443 / -6.3%	0.50 / 0.47 / +6.5%
tpch_q12/datafusion:parquet	96274969 / 99124994 / -2.9%	145700135 / 154209645 / -5.5%	0.66 / 0.64 / +2.8%
tpch_q13/datafusion:parquet	216966260 / 218222043 / -0.6%	262849418 / 261444465 / +0.5%	0.83 / 0.83 / -1.1%
tpch_q14/datafusion:parquet	49970894 / 47953685 / +4.2%	102346997 / 106017127 / -3.5%	0.49 / 0.45 / +7.9%
tpch_q15/datafusion:parquet	66405070 / 65876856 / +0.8%	114760566 / 120842837 / -5.0%	0.58 / 0.55 / +6.1%
tpch_q16/datafusion:parquet	49706769 / 48864217 / +1.7%	99950180 / 100476507 / -0.5%	0.50 / 0.49 / +2.3%
tpch_q17/datafusion:parquet	142976410 / 140522600 / +1.7%	210230325 / 225177743 / -6.6%	0.68 / 0.62 / +9.0%
tpch_q18/datafusion:parquet	174697904 / 172178962 / +1.5%	233657072 / 227056839 / +2.9%	0.75 / 0.76 / -1.4%
tpch_q19/datafusion:parquet	84248176 / 68816168 / +22.4% 🔴	145062240 / 143137813 / +1.3%	0.58 / 0.48 / +20.8%
tpch_q20/datafusion:parquet	83606319 / 90755880 / -7.9%	155982084 / 145050717 / +7.5%	0.54 / 0.63 / -14.3%
tpch_q21/datafusion:parquet	157956845 / 156775876 / +0.8%	222324645 / 227046606 / -2.1%	0.71 / 0.69 / +2.9%
tpch_q22/datafusion:parquet	55106610 / 55395851 / -0.5%	98619270 / 101834317 / -3.2%	0.56 / 0.54 / +2.7%

duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	25126390 / 23745230 / +5.8%	63705138 / 62998599 / +1.1%	0.39 / 0.38 / +4.6%
tpch_q02/duckdb:vortex-file-compressed	30023267 / 29534084 / +1.7%	56706197 / 53577786 / +5.8%	0.53 / 0.55 / -4.0%
tpch_q03/duckdb:vortex-file-compressed	37039232 / 36360887 / +1.9%	88593097 / 81452162 / +8.8%	0.42 / 0.45 / -6.3%
tpch_q04/duckdb:vortex-file-compressed	32405430 / 32837629 / -1.3%	69019588 / 74398607 / -7.2%	0.47 / 0.44 / +6.4%
tpch_q05/duckdb:vortex-file-compressed	40618134 / 41092032 / -1.2%	78536858 / 78692816 / -0.2%	0.52 / 0.52 / -1.0%
tpch_q06/duckdb:vortex-file-compressed	9385803 / 9459924 / -0.8%	38658473 / 41328727 / -6.5%	0.24 / 0.23 / +6.1%
tpch_q07/duckdb:vortex-file-compressed	41122863 / 39005341 / +5.4%	78545426 / 81768205 / -3.9%	0.52 / 0.48 / +9.8%
tpch_q08/duckdb:vortex-file-compressed	47946151 / 47016109 / +2.0%	89052036 / 90080554 / -1.1%	0.54 / 0.52 / +3.2%
tpch_q09/duckdb:vortex-file-compressed	57636565 / 58290342 / -1.1%	106531085 / 105359131 / +1.1%	0.54 / 0.55 / -2.2%
tpch_q10/duckdb:vortex-file-compressed	49517608 / 52823696 / -6.3%	89267087 / 93299465 / -4.3%	0.55 / 0.57 / -2.0%
tpch_q11/duckdb:vortex-file-compressed	16945698 / 15805489 / +7.2%	37923740 / 38661578 / -1.9%	0.45 / 0.41 / +9.3%
tpch_q12/duckdb:vortex-file-compressed	26695383 / 27185414 / -1.8%	55161587 / 60126345 / -8.3%	0.48 / 0.45 / +7.0%
tpch_q13/duckdb:vortex-file-compressed	41952309 / 41920014 / +0.1%	114306289 / 112949150 / +1.2%	0.37 / 0.37 / -1.1%
tpch_q14/duckdb:vortex-file-compressed	21439264 / 21818108 / -1.7%	55228962 / 59791390 / -7.6%	0.39 / 0.36 / +6.4%
tpch_q15/duckdb:vortex-file-compressed	17723300 / 18934667 / -6.4%	58490133 / 52550116 / +11.3% 🔴	0.30 / 0.36 / -15.9%
tpch_q16/duckdb:vortex-file-compressed	30929572 / 31599588 / -2.1%	47367704 / 46486871 / +1.9%	0.65 / 0.68 / -3.9%
tpch_q17/duckdb:vortex-file-compressed	33182571 / 33958244 / -2.3%	87455144 / 92167268 / -5.1%	0.38 / 0.37 / +3.0%
tpch_q18/duckdb:vortex-file-compressed	52321913 / 53879098 / -2.9%	90165277 / 79663320 / +13.2% 🔴	0.58 / 0.68 / -14.2%
tpch_q19/duckdb:vortex-file-compressed	35083466 / 35690979 / -1.7%	68111175 / 65204352 / +4.5%	0.52 / 0.55 / -5.9%
tpch_q20/duckdb:vortex-file-compressed	34998615 / 35110836 / -0.3%	85844000 / 95455964 / -10.1% 🟢	0.41 / 0.37 / +10.8%
tpch_q21/duckdb:vortex-file-compressed	117819624 / 119416972 / -1.3%	154764353 / 160010305 / -3.3%	0.76 / 0.75 / +2.0%
tpch_q22/duckdb:vortex-file-compressed	21951028 / 22031948 / -0.4%	45005240 / 41828848 / +7.6%	0.49 / 0.53 / -7.4%

duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	81635846 / 81494098 / +0.2%	92689224 / 93194950 / -0.5%	0.88 / 0.87 / +0.7%
tpch_q02/duckdb:parquet	45758172 / 46025171 / -0.6%	60052559 / 62863219 / -4.5%	0.76 / 0.73 / +4.1%
tpch_q03/duckdb:parquet	80755344 / 80452595 / +0.4%	103396972 / 100700371 / +2.7%	0.78 / 0.80 / -2.2%
tpch_q04/duckdb:parquet	57438539 / 57452408 / -0.0%	75732080 / 75115379 / +0.8%	0.76 / 0.76 / -0.8%
tpch_q05/duckdb:parquet	79114156 / 78345586 / +1.0%	99887813 / 100661894 / -0.8%	0.79 / 0.78 / +1.8%
tpch_q06/duckdb:parquet	25016878 / 24674414 / +1.4%	32567363 / 33262685 / -2.1%	0.77 / 0.74 / +3.6%
tpch_q07/duckdb:parquet	79836891 / 81035915 / -1.5%	101590462 / 101630845 / -0.0%	0.79 / 0.80 / -1.4%
tpch_q08/duckdb:parquet	96414849 / 96766135 / -0.4%	118594010 / 120289286 / -1.4%	0.81 / 0.80 / +1.1%
tpch_q09/duckdb:parquet	148809534 / 147771023 / +0.7%	169569697 / 170105074 / -0.3%	0.88 / 0.87 / +1.0%
tpch_q10/duckdb:parquet	142421474 / 141044737 / +1.0%	164251574 / 164233316 / +0.0%	0.87 / 0.86 / +1.0%
tpch_q11/duckdb:parquet	25374715 / 25455294 / -0.3%	32482979 / 34404336 / -5.6%	0.78 / 0.74 / +5.6%
tpch_q12/duckdb:parquet	53431634 / 52957910 / +0.9%	67376381 / 67075139 / +0.4%	0.79 / 0.79 / +0.4%
tpch_q13/duckdb:parquet	287538525 / 290970868 / -1.2%	301803610 / 302457968 / -0.2%	0.95 / 0.96 / -1.0%
tpch_q14/duckdb:parquet	56137348 / 56083798 / +0.1%	71158869 / 71931665 / -1.1%	0.79 / 0.78 / +1.2%
tpch_q15/duckdb:parquet	30660194 / 30841124 / -0.6%	42734941 / 43156018 / -1.0%	0.72 / 0.71 / +0.4%
tpch_q16/duckdb:parquet	66440927 / 67099702 / -1.0%	79614525 / 82144444 / -3.1%	0.83 / 0.82 / +2.2%
tpch_q17/duckdb:parquet	58254877 / 58317373 / -0.1%	74773285 / 80216431 / -6.8%	0.78 / 0.73 / +7.2%
tpch_q18/duckdb:parquet	128748351 / 126940547 / +1.4%	146520752 / 144951948 / +1.1%	0.88 / 0.88 / +0.3%
tpch_q19/duckdb:parquet	78238784 / 77580489 / +0.8%	95148370 / 97767240 / -2.7%	0.82 / 0.79 / +3.6%
tpch_q20/duckdb:parquet	77835275 / 77467919 / +0.5%	98838978 / 103345149 / -4.4%	0.79 / 0.75 / +5.1%
tpch_q21/duckdb:parquet	193846020 / 189993251 / +2.0%	208662189 / 205864228 / +1.4%	0.93 / 0.92 / +0.7%
tpch_q22/duckdb:parquet	63885146 / 63271849 / +1.0%	76409169 / 78255582 / -2.4%	0.84 / 0.81 / +3.4%

File Size Changes (9 files changed, -43.9% overall, 0↑ 9↓)

File	Scale	Format	Base	Change	%
customer.vortex	1.0	vortex-compact	7.40 MB	7.40 MB	-100.0%
duckdb.db	1.0	vortex-compact	268.00 KB	268.00 KB	-100.0%
lineitem.vortex	1.0	vortex-compact	125.99 MB	125.99 MB	-100.0%
nation.vortex	1.0	vortex-compact	7.68 KB	7.68 KB	-100.0%
orders.vortex	1.0	vortex-compact	31.72 MB	31.72 MB	-100.0%
part.vortex	1.0	vortex-compact	3.55 MB	3.55 MB	-100.0%
partsupp.vortex	1.0	vortex-compact	20.29 MB	20.29 MB	-100.0%
region.vortex	1.0	vortex-compact	5.87 KB	5.87 KB	-100.0%
supplier.vortex	1.0	vortex-compact	495.77 KB	495.77 KB	-100.0%

Totals:

vortex-compact: 189.71 MB → 0 B (-100.0%)
vortex-file-compressed: 242.81 MB → 242.81 MB (0.0%)

github-actions · 2026-08-25T10:44:29Z

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 6554a829 vs base 17bd9e27
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.5%
Engines: DataFusion No clear signal (-7.6%, environment too noisy confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): hot 0.967x ➖ · cold 0.945x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.012x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.923x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed	165441970 / 353746119 / -53.2% 🟢	352581523 / 813660453 / -56.7% 🟢	0.47 / 0.43 / +7.9%
clickbench-sorted_q24/datafusion:vortex-file-compressed	25498426 / 24587699 / +3.7%	89543326 / 85182992 / +5.1%	0.28 / 0.29 / -1.3%
clickbench-sorted_q26/datafusion:vortex-file-compressed	25285905 / 27135075 / -6.8%	86004327 / 84981913 / +1.2%	0.29 / 0.32 / -7.9%
clickbench-sorted_q36/datafusion:vortex-file-compressed	48141786 / 47861286 / +0.6%	120800494 / 123562674 / -2.2%	0.40 / 0.39 / +2.9%
clickbench-sorted_q37/datafusion:vortex-file-compressed	35737235 / 35733284 / +0.0%	104427657 / 102718860 / +1.7%	0.34 / 0.35 / -1.6%
clickbench-sorted_q38/datafusion:vortex-file-compressed	33496690 / 33197116 / +0.9%	97867782 / 102339168 / -4.4%	0.34 / 0.32 / +5.5%
clickbench-sorted_q39/datafusion:vortex-file-compressed	85119942 / 84974242 / +0.2%	180870113 / 167417201 / +8.0%	0.47 / 0.51 / -7.3%
clickbench-sorted_q40/datafusion:vortex-file-compressed	16778240 / 16714150 / +0.4%	75985449 / 75953623 / +0.0%	0.22 / 0.22 / +0.3%
clickbench-sorted_q41/datafusion:vortex-file-compressed	16911622 / 16858906 / +0.3%	75428748 / 73219907 / +3.0%	0.22 / 0.23 / -2.6%
clickbench-sorted_q42/datafusion:vortex-file-compressed	12868979 / 13229754 / -2.7%	64468998 / 60859851 / +5.9%	0.20 / 0.22 / -8.2%

datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet	2885211009 / 2936560838 / -1.7%	3373472385 / 3470257411 / -2.8%	0.86 / 0.85 / +1.1%
clickbench-sorted_q24/datafusion:parquet	31115020 / 32915342 / -5.5%	147480619 / 152318402 / -3.2%	0.21 / 0.22 / -2.4%
clickbench-sorted_q26/datafusion:parquet	35272590 / 33544941 / +5.2%	152397577 / 150121543 / +1.5%	0.23 / 0.22 / +3.6%
clickbench-sorted_q36/datafusion:parquet	178355959 / 164104873 / +8.7%	293548444 / 283811837 / +3.4%	0.61 / 0.58 / +5.1%
clickbench-sorted_q37/datafusion:parquet	101548277 / 110479223 / -8.1%	227316590 / 220733259 / +3.0%	0.45 / 0.50 / -10.7%
clickbench-sorted_q38/datafusion:parquet	160273940 / 159536609 / +0.5%	289137824 / 280235822 / +3.2%	0.55 / 0.57 / -2.6%
clickbench-sorted_q39/datafusion:parquet	297707748 / 285004892 / +4.5%	450435395 / 433644924 / +3.9%	0.66 / 0.66 / +0.6%
clickbench-sorted_q40/datafusion:parquet	61479333 / 67973454 / -9.6%	190103877 / 184021991 / +3.3%	0.32 / 0.37 / -12.4%
clickbench-sorted_q41/datafusion:parquet	61336898 / 60047623 / +2.1%	184147535 / 186467801 / -1.2%	0.33 / 0.32 / +3.4%
clickbench-sorted_q42/datafusion:parquet	35699192 / 33862125 / +5.4%	147865657 / 143111325 / +3.3%	0.24 / 0.24 / +2.0%

duckdb / vortex-file-compressed / ns (1.012x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed	106006626 / 90399460 / +17.3% 🔴	199408108 / 184596473 / +8.0%	0.53 / 0.49 / +8.6%
clickbench-sorted_q24/duckdb:vortex-file-compressed	28405879 / 29624084 / -4.1%	72422826 / 68895974 / +5.1%	0.39 / 0.43 / -8.8%
clickbench-sorted_q26/duckdb:vortex-file-compressed	29887461 / 29807654 / +0.3%	75758160 / 93971569 / -19.4% 🟢	0.39 / 0.32 / +24.4%
clickbench-sorted_q36/duckdb:vortex-file-compressed	61791343 / 60632666 / +1.9%	168721096 / 172215226 / -2.0%	0.37 / 0.35 / +4.0%
clickbench-sorted_q37/duckdb:vortex-file-compressed	50174822 / 50357556 / -0.4%	156003268 / 161248158 / -3.3%	0.32 / 0.31 / +3.0%
clickbench-sorted_q38/duckdb:vortex-file-compressed	54585594 / 56209523 / -2.9%	152542597 / 158602181 / -3.8%	0.36 / 0.35 / +1.0%
clickbench-sorted_q39/duckdb:vortex-file-compressed	108384977 / 107890152 / +0.5%	230138099 / 255516040 / -9.9%	0.47 / 0.42 / +11.5%
clickbench-sorted_q40/duckdb:vortex-file-compressed	28091607 / 27418292 / +2.5%	112954710 / 115531676 / -2.2%	0.25 / 0.24 / +4.8%
clickbench-sorted_q41/duckdb:vortex-file-compressed	27584452 / 26993630 / +2.2%	100854770 / 118838432 / -15.1% 🟢	0.27 / 0.23 / +20.4%
clickbench-sorted_q42/duckdb:vortex-file-compressed	21499906 / 22334968 / -3.7%	107452381 / 107945108 / -0.5%	0.20 / 0.21 / -3.3%

duckdb / parquet / ns (1.003x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet	216683177 / 214305118 / +1.1%	265539398 / 254449730 / +4.4%	0.82 / 0.84 / -3.1%
clickbench-sorted_q24/duckdb:parquet	35372736 / 34988842 / +1.1%	50371939 / 56338212 / -10.6% 🟢	0.70 / 0.62 / +13.1%
clickbench-sorted_q26/duckdb:parquet	28231686 / 24937799 / +13.2% 🔴	54306379 / 54598311 / -0.5%	0.52 / 0.46 / +13.8%
clickbench-sorted_q36/duckdb:parquet	69401624 / 69947782 / -0.8%	99550140 / 104842660 / -5.0%	0.70 / 0.67 / +4.5%
clickbench-sorted_q37/duckdb:parquet	59599652 / 62559026 / -4.7%	92599813 / 93191933 / -0.6%	0.64 / 0.67 / -4.1%
clickbench-sorted_q38/duckdb:parquet	62358599 / 61914178 / +0.7%	93308031 / 97989013 / -4.8%	0.67 / 0.63 / +5.8%
clickbench-sorted_q39/duckdb:parquet	106020906 / 106995490 / -0.9%	158339059 / 158500435 / -0.1%	0.67 / 0.68 / -0.8%
clickbench-sorted_q40/duckdb:parquet	29772979 / 30582422 / -2.6%	72146369 / 67758170 / +6.5%	0.41 / 0.45 / -8.6%
clickbench-sorted_q41/duckdb:parquet	29760471 / 30354991 / -2.0%	77492612 / 61467317 / +26.1% 🔴	0.38 / 0.49 / -22.2%
clickbench-sorted_q42/duckdb:parquet	20305365 / 20597944 / -1.4%	44418165 / 44578994 / -0.4%	0.46 / 0.46 / -1.1%

File Size Changes (201 files changed, -42.8% overall, 53↑ 148↓)

File	Scale	Format	Base	HEAD	Change	%
hits_087.vortex	1.0	vortex-file-compressed	159.61 MB	160.99 MB	+1.38 MB	+0.9%
hits_082.vortex	1.0	vortex-file-compressed	139.90 MB	141.00 MB	+1.11 MB	+0.8%
hits_055.vortex	1.0	vortex-file-compressed	198.60 MB	200.12 MB	+1.52 MB	+0.8%
hits_071.vortex	1.0	vortex-file-compressed	139.94 MB	140.57 MB	+649.89 KB	+0.5%
hits_022.vortex	1.0	vortex-file-compressed	198.06 MB	198.89 MB	+852.20 KB	+0.4%
hits_024.vortex	1.0	vortex-file-compressed	160.45 MB	161.03 MB	+592.84 KB	+0.4%
hits_033.vortex	1.0	vortex-file-compressed	199.46 MB	200.07 MB	+622.34 KB	+0.3%
hits_073.vortex	1.0	vortex-file-compressed	172.64 MB	173.13 MB	+501.79 KB	+0.3%
hits_042.vortex	1.0	vortex-file-compressed	201.82 MB	202.38 MB	+579.05 KB	+0.3%
hits_019.vortex	1.0	vortex-file-compressed	140.79 MB	141.17 MB	+397.30 KB	+0.3%
hits_075.vortex	1.0	vortex-file-compressed	189.53 MB	190.01 MB	+493.75 KB	+0.3%
hits_035.vortex	1.0	vortex-file-compressed	102.78 MB	103.04 MB	+266.91 KB	+0.3%
hits_034.vortex	1.0	vortex-file-compressed	181.98 MB	182.44 MB	+469.50 KB	+0.3%
hits_072.vortex	1.0	vortex-file-compressed	102.15 MB	102.34 MB	+203.73 KB	+0.2%
hits_060.vortex	1.0	vortex-file-compressed	193.17 MB	193.49 MB	+323.95 KB	+0.2%
hits_057.vortex	1.0	vortex-file-compressed	159.95 MB	160.16 MB	+213.98 KB	+0.1%
hits_065.vortex	1.0	vortex-file-compressed	161.25 MB	161.41 MB	+173.54 KB	+0.1%
hits_005.vortex	1.0	vortex-file-compressed	167.87 MB	168.03 MB	+164.29 KB	+0.1%
hits_063.vortex	1.0	vortex-file-compressed	131.55 MB	131.68 MB	+128.27 KB	+0.1%
hits_051.vortex	1.0	vortex-file-compressed	172.30 MB	172.46 MB	+160.46 KB	+0.1%
hits_023.vortex	1.0	vortex-file-compressed	195.32 MB	195.49 MB	+177.55 KB	+0.1%
hits_048.vortex	1.0	vortex-file-compressed	199.60 MB	199.77 MB	+165.81 KB	+0.1%
hits_068.vortex	1.0	vortex-file-compressed	160.50 MB	160.63 MB	+132.10 KB	+0.1%
hits_007.vortex	1.0	vortex-file-compressed	200.34 MB	200.49 MB	+154.45 KB	+0.1%
hits_052.vortex	1.0	vortex-file-compressed	130.93 MB	131.03 MB	+100.43 KB	+0.1%
hits_011.vortex	1.0	vortex-file-compressed	199.21 MB	199.36 MB	+151.41 KB	+0.1%
hits_092.vortex	1.0	vortex-file-compressed	199.40 MB	199.55 MB	+146.82 KB	+0.1%
hits_038.vortex	1.0	vortex-file-compressed	190.03 MB	190.17 MB	+139.40 KB	+0.1%
hits_009.vortex	1.0	vortex-file-compressed	101.20 MB	101.27 MB	+70.73 KB	+0.1%
hits_054.vortex	1.0	vortex-file-compressed	146.95 MB	147.05 MB	+102.40 KB	+0.1%
hits_076.vortex	1.0	vortex-file-compressed	160.77 MB	160.87 MB	+99.41 KB	+0.1%
hits_043.vortex	1.0	vortex-file-compressed	126.41 MB	126.48 MB	+71.71 KB	+0.1%
hits_081.vortex	1.0	vortex-file-compressed	199.88 MB	199.99 MB	+112.77 KB	+0.1%
hits_080.vortex	1.0	vortex-file-compressed	126.77 MB	126.84 MB	+64.88 KB	+0.0%
hits_085.vortex	1.0	vortex-file-compressed	200.06 MB	200.16 MB	+99.41 KB	+0.0%
hits_069.vortex	1.0	vortex-file-compressed	142.27 MB	142.33 MB	+70.33 KB	+0.0%
hits_021.vortex	1.0	vortex-file-compressed	154.30 MB	154.36 MB	+65.27 KB	+0.0%
hits_002.vortex	1.0	vortex-file-compressed	161.04 MB	161.10 MB	+66.14 KB	+0.0%
hits_062.vortex	1.0	vortex-file-compressed	170.71 MB	170.77 MB	+67.33 KB	+0.0%
hits_004.vortex	1.0	vortex-file-compressed	131.50 MB	131.55 MB	+43.62 KB	+0.0%
hits_016.vortex	1.0	vortex-file-compressed	180.47 MB	180.52 MB	+50.58 KB	+0.0%
hits_089.vortex	1.0	vortex-file-compressed	131.52 MB	131.56 MB	+35.92 KB	+0.0%
hits_026.vortex	1.0	vortex-file-compressed	131.30 MB	131.33 MB	+31.97 KB	+0.0%
hits_061.vortex	1.0	vortex-file-compressed	161.34 MB	161.37 MB	+35.99 KB	+0.0%
hits_012.vortex	1.0	vortex-file-compressed	190.86 MB	190.90 MB	+40.90 KB	+0.0%
hits_088.vortex	1.0	vortex-file-compressed	171.96 MB	171.99 MB	+35.24 KB	+0.0%
hits_015.vortex	1.0	vortex-file-compressed	131.12 MB	131.14 MB	+16.81 KB	+0.0%
hits_090.vortex	1.0	vortex-file-compressed	192.57 MB	192.59 MB	+21.98 KB	+0.0%
hits_003.vortex	1.0	vortex-file-compressed	136.44 MB	136.46 MB	+14.52 KB	+0.0%
hits_041.vortex	1.0	vortex-file-compressed	131.21 MB	131.22 MB	+8.14 KB	+0.0%
hits_064.vortex	1.0	vortex-file-compressed	191.04 MB	191.04 MB	+3.45 KB	+0.0%
hits_083.vortex	1.0	vortex-file-compressed	157.13 MB	157.13 MB	+1.58 KB	+0.0%
hits_050.vortex	1.0	vortex-file-compressed	161.01 MB	161.01 MB	+392 B	+0.0%
hits_078.vortex	1.0	vortex-file-compressed	131.00 MB	131.00 MB	2.82 KB	-0.0%
hits_097.vortex	1.0	vortex-file-compressed	192.78 MB	192.78 MB	5.37 KB	-0.0%
hits_045.vortex	1.0	vortex-file-compressed	140.06 MB	140.04 MB	16.22 KB	-0.0%
hits_014.vortex	1.0	vortex-file-compressed	172.33 MB	172.31 MB	20.35 KB	-0.0%
hits_006.vortex	1.0	vortex-file-compressed	126.34 MB	126.32 MB	19.41 KB	-0.0%
hits_036.vortex	1.0	vortex-file-compressed	171.41 MB	171.38 MB	27.20 KB	-0.0%
hits_028.vortex	1.0	vortex-file-compressed	151.79 MB	151.77 MB	24.90 KB	-0.0%
hits_095.vortex	1.0	vortex-file-compressed	154.33 MB	154.31 MB	28.80 KB	-0.0%
hits_053.vortex	1.0	vortex-file-compressed	189.89 MB	189.85 MB	44.18 KB	-0.0%
hits_000.vortex	1.0	vortex-file-compressed	131.57 MB	131.54 MB	34.09 KB	-0.0%
hits_046.vortex	1.0	vortex-file-compressed	101.23 MB	101.20 MB	27.38 KB	-0.0%
hits_018.vortex	1.0	vortex-file-compressed	199.54 MB	199.47 MB	64.60 KB	-0.0%
hits_098.vortex	1.0	vortex-file-compressed	137.57 MB	137.52 MB	56.05 KB	-0.0%
hits_044.vortex	1.0	vortex-file-compressed	200.01 MB	199.92 MB	93.05 KB	-0.0%
hits_067.vortex	1.0	vortex-file-compressed	131.76 MB	131.70 MB	63.00 KB	-0.0%
hits_093.vortex	1.0	vortex-file-compressed	131.75 MB	131.68 MB	74.05 KB	-0.1%
hits_086.vortex	1.0	vortex-file-compressed	192.21 MB	192.10 MB	109.63 KB	-0.1%
hits_056.vortex	1.0	vortex-file-compressed	135.67 MB	135.59 MB	77.82 KB	-0.1%
hits_058.vortex	1.0	vortex-file-compressed	155.24 MB	155.15 MB	91.46 KB	-0.1%
hits_013.vortex	1.0	vortex-file-compressed	161.28 MB	161.17 MB	106.06 KB	-0.1%
hits_037.vortex	1.0	vortex-file-compressed	177.20 MB	177.08 MB	126.20 KB	-0.1%
hits_025.vortex	1.0	vortex-file-compressed	172.06 MB	171.93 MB	130.29 KB	-0.1%
hits_010.vortex	1.0	vortex-file-compressed	169.08 MB	168.96 MB	128.91 KB	-0.1%
hits_079.vortex	1.0	vortex-file-compressed	180.99 MB	180.84 MB	154.78 KB	-0.1%
hits_027.vortex	1.0	vortex-file-compressed	190.11 MB	189.91 MB	203.88 KB	-0.1%
hits_039.vortex	1.0	vortex-file-compressed	161.16 MB	160.99 MB	173.10 KB	-0.1%
hits_020.vortex	1.0	vortex-file-compressed	160.28 MB	160.09 MB	194.10 KB	-0.1%
hits_084.vortex	1.0	vortex-file-compressed	154.60 MB	154.40 MB	201.56 KB	-0.1%
hits_077.vortex	1.0	vortex-file-compressed	172.47 MB	172.22 MB	252.18 KB	-0.1%
hits_074.vortex	1.0	vortex-file-compressed	199.32 MB	199.02 MB	307.45 KB	-0.2%
hits_047.vortex	1.0	vortex-file-compressed	154.66 MB	154.43 MB	239.20 KB	-0.2%
hits_070.vortex	1.0	vortex-file-compressed	200.36 MB	199.99 MB	372.50 KB	-0.2%
hits_031.vortex	1.0	vortex-file-compressed	160.03 MB	159.74 MB	302.95 KB	-0.2%
hits_030.vortex	1.0	vortex-file-compressed	132.19 MB	131.89 MB	307.42 KB	-0.2%
hits_008.vortex	1.0	vortex-file-compressed	140.38 MB	140.06 MB	329.59 KB	-0.2%
hits_049.vortex	1.0	vortex-file-compressed	191.75 MB	191.30 MB	460.06 KB	-0.2%
hits_059.vortex	1.0	vortex-file-compressed	199.01 MB	198.52 MB	504.17 KB	-0.2%
hits_091.vortex	1.0	vortex-file-compressed	147.41 MB	147.01 MB	410.98 KB	-0.3%
hits_099.vortex	1.0	vortex-file-compressed	171.72 MB	171.20 MB	523.80 KB	-0.3%
hits_017.vortex	1.0	vortex-file-compressed	147.19 MB	146.72 MB	481.31 KB	-0.3%
hits_096.vortex	1.0	vortex-file-compressed	199.39 MB	198.43 MB	982.79 KB	-0.5%
hits_040.vortex	1.0	vortex-file-compressed	143.73 MB	142.91 MB	837.34 KB	-0.6%
hits_094.vortex	1.0	vortex-file-compressed	159.06 MB	157.78 MB	1.28 MB	-0.8%
hits_029.vortex	1.0	vortex-file-compressed	200.23 MB	198.56 MB	1.66 MB	-0.8%
hits_001.vortex	1.0	vortex-file-compressed	190.75 MB	189.12 MB	1.63 MB	-0.9%
hits_032.vortex	1.0	vortex-file-compressed	154.67 MB	153.09 MB	1.58 MB	-1.0%
hits_066.vortex	1.0	vortex-file-compressed	164.66 MB	162.90 MB	1.76 MB	-1.1%
duckdb.db	1.0	vortex-compact	268.00 KB	0 B	268.00 KB	-100.0%
hits_000.vortex	1.0	vortex-compact	97.87 MB	0 B	97.87 MB	-100.0%
hits_001.vortex	1.0	vortex-compact	138.95 MB	0 B	138.95 MB	-100.0%
hits_002.vortex	1.0	vortex-compact	125.24 MB	0 B	125.24 MB	-100.0%
hits_003.vortex	1.0	vortex-compact	104.57 MB	0 B	104.57 MB	-100.0%
hits_004.vortex	1.0	vortex-compact	97.61 MB	0 B	97.61 MB	-100.0%
hits_005.vortex	1.0	vortex-compact	115.82 MB	0 B	115.82 MB	-100.0%
hits_006.vortex	1.0	vortex-compact	95.93 MB	0 B	95.93 MB	-100.0%
hits_007.vortex	1.0	vortex-compact	153.59 MB	0 B	153.59 MB	-100.0%
hits_008.vortex	1.0	vortex-compact	105.77 MB	0 B	105.77 MB	-100.0%
hits_009.vortex	1.0	vortex-compact	75.19 MB	0 B	75.19 MB	-100.0%
hits_010.vortex	1.0	vortex-compact	123.31 MB	0 B	123.31 MB	-100.0%
hits_011.vortex	1.0	vortex-compact	152.88 MB	0 B	152.88 MB	-100.0%
hits_012.vortex	1.0	vortex-compact	139.92 MB	0 B	139.92 MB	-100.0%
hits_013.vortex	1.0	vortex-compact	124.41 MB	0 B	124.41 MB	-100.0%
hits_014.vortex	1.0	vortex-compact	133.80 MB	0 B	133.80 MB	-100.0%
hits_015.vortex	1.0	vortex-compact	97.87 MB	0 B	97.87 MB	-100.0%
hits_016.vortex	1.0	vortex-compact	127.39 MB	0 B	127.39 MB	-100.0%
hits_017.vortex	1.0	vortex-compact	112.11 MB	0 B	112.11 MB	-100.0%
hits_018.vortex	1.0	vortex-compact	153.64 MB	0 B	153.64 MB	-100.0%
hits_019.vortex	1.0	vortex-compact	106.19 MB	0 B	106.19 MB	-100.0%
hits_020.vortex	1.0	vortex-compact	111.58 MB	0 B	111.58 MB	-100.0%
hits_021.vortex	1.0	vortex-compact	110.52 MB	0 B	110.52 MB	-100.0%
hits_022.vortex	1.0	vortex-compact	153.03 MB	0 B	153.03 MB	-100.0%
hits_023.vortex	1.0	vortex-compact	142.63 MB	0 B	142.63 MB	-100.0%
hits_024.vortex	1.0	vortex-compact	125.08 MB	0 B	125.08 MB	-100.0%
hits_025.vortex	1.0	vortex-compact	133.60 MB	0 B	133.60 MB	-100.0%
hits_026.vortex	1.0	vortex-compact	98.88 MB	0 B	98.88 MB	-100.0%
hits_027.vortex	1.0	vortex-compact	139.28 MB	0 B	139.28 MB	-100.0%
hits_028.vortex	1.0	vortex-compact	115.77 MB	0 B	115.77 MB	-100.0%
hits_029.vortex	1.0	vortex-compact	153.50 MB	0 B	153.50 MB	-100.0%
hits_030.vortex	1.0	vortex-compact	98.03 MB	0 B	98.03 MB	-100.0%
hits_031.vortex	1.0	vortex-compact	111.58 MB	0 B	111.58 MB	-100.0%
hits_032.vortex	1.0	vortex-compact	110.59 MB	0 B	110.59 MB	-100.0%
hits_033.vortex	1.0	vortex-compact	153.47 MB	0 B	153.47 MB	-100.0%
hits_034.vortex	1.0	vortex-compact	133.38 MB	0 B	133.38 MB	-100.0%
hits_035.vortex	1.0	vortex-compact	75.90 MB	0 B	75.90 MB	-100.0%
hits_036.vortex	1.0	vortex-compact	133.26 MB	0 B	133.26 MB	-100.0%
hits_037.vortex	1.0	vortex-compact	132.26 MB	0 B	132.26 MB	-100.0%
hits_038.vortex	1.0	vortex-compact	139.60 MB	0 B	139.60 MB	-100.0%
hits_039.vortex	1.0	vortex-compact	124.24 MB	0 B	124.24 MB	-100.0%
hits_040.vortex	1.0	vortex-compact	110.16 MB	0 B	110.16 MB	-100.0%
hits_041.vortex	1.0	vortex-compact	98.09 MB	0 B	98.09 MB	-100.0%
hits_042.vortex	1.0	vortex-compact	136.29 MB	0 B	136.29 MB	-100.0%
hits_043.vortex	1.0	vortex-compact	94.32 MB	0 B	94.32 MB	-100.0%
hits_044.vortex	1.0	vortex-compact	153.39 MB	0 B	153.39 MB	-100.0%
hits_045.vortex	1.0	vortex-compact	106.13 MB	0 B	106.13 MB	-100.0%
hits_046.vortex	1.0	vortex-compact	74.84 MB	0 B	74.84 MB	-100.0%
hits_047.vortex	1.0	vortex-compact	110.46 MB	0 B	110.46 MB	-100.0%
hits_048.vortex	1.0	vortex-compact	153.33 MB	0 B	153.33 MB	-100.0%
hits_049.vortex	1.0	vortex-compact	139.94 MB	0 B	139.94 MB	-100.0%
hits_050.vortex	1.0	vortex-compact	125.61 MB	0 B	125.61 MB	-100.0%
hits_051.vortex	1.0	vortex-compact	133.84 MB	0 B	133.84 MB	-100.0%
hits_052.vortex	1.0	vortex-compact	98.14 MB	0 B	98.14 MB	-100.0%
hits_053.vortex	1.0	vortex-compact	138.44 MB	0 B	138.44 MB	-100.0%
hits_054.vortex	1.0	vortex-compact	112.25 MB	0 B	112.25 MB	-100.0%
hits_055.vortex	1.0	vortex-compact	153.27 MB	0 B	153.27 MB	-100.0%
hits_056.vortex	1.0	vortex-compact	101.30 MB	0 B	101.30 MB	-100.0%
hits_057.vortex	1.0	vortex-compact	111.78 MB	0 B	111.78 MB	-100.0%
hits_058.vortex	1.0	vortex-compact	111.06 MB	0 B	111.06 MB	-100.0%
hits_059.vortex	1.0	vortex-compact	152.92 MB	0 B	152.92 MB	-100.0%
hits_060.vortex	1.0	vortex-compact	141.32 MB	0 B	141.32 MB	-100.0%
hits_061.vortex	1.0	vortex-compact	123.46 MB	0 B	123.46 MB	-100.0%
hits_062.vortex	1.0	vortex-compact	132.60 MB	0 B	132.60 MB	-100.0%
hits_063.vortex	1.0	vortex-compact	97.84 MB	0 B	97.84 MB	-100.0%
hits_064.vortex	1.0	vortex-compact	140.10 MB	0 B	140.10 MB	-100.0%
hits_065.vortex	1.0	vortex-compact	125.63 MB	0 B	125.63 MB	-100.0%
hits_066.vortex	1.0	vortex-compact	118.21 MB	0 B	118.21 MB	-100.0%
hits_067.vortex	1.0	vortex-compact	99.44 MB	0 B	99.44 MB	-100.0%
hits_068.vortex	1.0	vortex-compact	112.40 MB	0 B	112.40 MB	-100.0%
hits_069.vortex	1.0	vortex-compact	100.05 MB	0 B	100.05 MB	-100.0%
hits_070.vortex	1.0	vortex-compact	153.80 MB	0 B	153.80 MB	-100.0%
hits_071.vortex	1.0	vortex-compact	105.77 MB	0 B	105.77 MB	-100.0%
hits_072.vortex	1.0	vortex-compact	75.53 MB	0 B	75.53 MB	-100.0%
hits_073.vortex	1.0	vortex-compact	134.18 MB	0 B	134.18 MB	-100.0%
hits_074.vortex	1.0	vortex-compact	152.92 MB	0 B	152.92 MB	-100.0%
hits_075.vortex	1.0	vortex-compact	139.07 MB	0 B	139.07 MB	-100.0%
hits_076.vortex	1.0	vortex-compact	125.43 MB	0 B	125.43 MB	-100.0%
hits_077.vortex	1.0	vortex-compact	134.14 MB	0 B	134.14 MB	-100.0%
hits_078.vortex	1.0	vortex-compact	97.16 MB	0 B	97.16 MB	-100.0%
hits_079.vortex	1.0	vortex-compact	128.04 MB	0 B	128.04 MB	-100.0%
hits_080.vortex	1.0	vortex-compact	97.13 MB	0 B	97.13 MB	-100.0%
hits_081.vortex	1.0	vortex-compact	153.47 MB	0 B	153.47 MB	-100.0%
hits_082.vortex	1.0	vortex-compact	105.74 MB	0 B	105.74 MB	-100.0%
hits_083.vortex	1.0	vortex-compact	110.06 MB	0 B	110.06 MB	-100.0%
hits_084.vortex	1.0	vortex-compact	110.66 MB	0 B	110.66 MB	-100.0%
hits_085.vortex	1.0	vortex-compact	153.53 MB	0 B	153.53 MB	-100.0%
hits_086.vortex	1.0	vortex-compact	139.66 MB	0 B	139.66 MB	-100.0%
hits_087.vortex	1.0	vortex-compact	124.79 MB	0 B	124.79 MB	-100.0%
hits_088.vortex	1.0	vortex-compact	134.09 MB	0 B	134.09 MB	-100.0%
hits_089.vortex	1.0	vortex-compact	98.81 MB	0 B	98.81 MB	-100.0%
hits_090.vortex	1.0	vortex-compact	141.20 MB	0 B	141.20 MB	-100.0%
hits_091.vortex	1.0	vortex-compact	112.38 MB	0 B	112.38 MB	-100.0%
hits_092.vortex	1.0	vortex-compact	153.29 MB	0 B	153.29 MB	-100.0%
hits_093.vortex	1.0	vortex-compact	98.56 MB	0 B	98.56 MB	-100.0%
hits_094.vortex	1.0	vortex-compact	110.72 MB	0 B	110.72 MB	-100.0%
hits_095.vortex	1.0	vortex-compact	110.69 MB	0 B	110.69 MB	-100.0%
hits_096.vortex	1.0	vortex-compact	153.07 MB	0 B	153.07 MB	-100.0%
hits_097.vortex	1.0	vortex-compact	141.29 MB	0 B	141.29 MB	-100.0%
hits_098.vortex	1.0	vortex-compact	104.03 MB	0 B	104.03 MB	-100.0%
hits_099.vortex	1.0	vortex-compact	132.99 MB	0 B	132.99 MB	-100.0%

Totals:

vortex-compact: 11.93 GB → 0 B (-100.0%)
vortex-file-compressed: 15.96 GB → 15.96 GB (-0.0%)

github-actions · 2026-08-25T10:45:45Z

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 6554a829 vs base 17bd9e27
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+1.3%, environment too noisy confidence)
Vortex (geomean): hot 1.006x ➖ · cold 0.998x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed	27648155 / 28662555 / -3.5%	87434476 / 84866928 / +3.0%	0.32 / 0.34 / -6.4%
tpcds_q02/datafusion:vortex-file-compressed	51817069 / 52121703 / -0.6%	102066462 / 100441828 / +1.6%	0.51 / 0.52 / -2.2%
tpcds_q03/datafusion:vortex-file-compressed	14632148 / 14695352 / -0.4%	64332403 / 63619054 / +1.1%	0.23 / 0.23 / -1.5%
tpcds_q04/datafusion:vortex-file-compressed	205314162 / 206246284 / -0.5%	287266146 / 274950771 / +4.5%	0.71 / 0.75 / -4.7%
tpcds_q05/datafusion:vortex-file-compressed	62975186 / 63439464 / -0.7%	122729595 / 127674203 / -3.9%	0.51 / 0.50 / +3.3%
tpcds_q06/datafusion:vortex-file-compressed	25254296 / 25745125 / -1.9%	79485141 / 78110960 / +1.8%	0.32 / 0.33 / -3.6%
tpcds_q07/datafusion:vortex-file-compressed	44140434 / 43543372 / +1.4%	99950925 / 99429187 / +0.5%	0.44 / 0.44 / +0.8%
tpcds_q08/datafusion:vortex-file-compressed	33503552 / 33117114 / +1.2%	84740346 / 82925952 / +2.2%	0.40 / 0.40 / -1.0%
tpcds_q09/datafusion:vortex-file-compressed	27227784 / 26188678 / +4.0%	66403620 / 66241963 / +0.2%	0.41 / 0.40 / +3.7%
tpcds_q10/datafusion:vortex-file-compressed	37109562 / 35648754 / +4.1%	87336112 / 85883115 / +1.7%	0.42 / 0.42 / +2.4%
tpcds_q11/datafusion:vortex-file-compressed	112494604 / 111075141 / +1.3%	188570878 / 179609517 / +5.0%	0.60 / 0.62 / -3.5%
tpcds_q12/datafusion:vortex-file-compressed	21815496 / 21379182 / +2.0%	67904766 / 66316054 / +2.4%	0.32 / 0.32 / -0.3%
tpcds_q13/datafusion:vortex-file-compressed	44690670 / 44223473 / +1.1%	93075647 / 90984742 / +2.3%	0.48 / 0.49 / -1.2%
tpcds_q14/datafusion:vortex-file-compressed	197867204 / 193365059 / +2.3%	251242188 / 262167151 / -4.2%	0.79 / 0.74 / +6.8%
tpcds_q15/datafusion:vortex-file-compressed	29163054 / 29439610 / -0.9%	75647373 / 76420649 / -1.0%	0.39 / 0.39 / +0.1%
tpcds_q16/datafusion:vortex-file-compressed	24953006 / 25191318 / -0.9%	71260071 / 70930138 / +0.5%	0.35 / 0.36 / -1.4%
tpcds_q17/datafusion:vortex-file-compressed	70704209 / 72890024 / -3.0%	141047010 / 136223129 / +3.5%	0.50 / 0.54 / -6.3%
tpcds_q18/datafusion:vortex-file-compressed	85764049 / 85247150 / +0.6%	145022857 / 137962965 / +5.1%	0.59 / 0.62 / -4.3%
tpcds_q19/datafusion:vortex-file-compressed	22183038 / 21357902 / +3.9%	76089767 / 73459906 / +3.6%	0.29 / 0.29 / +0.3%
tpcds_q20/datafusion:vortex-file-compressed	26828524 / 26574964 / +1.0%	77859484 / 80219323 / -2.9%	0.34 / 0.33 / +4.0%
tpcds_q21/datafusion:vortex-file-compressed	30134170 / 30684360 / -1.8%	88793115 / 92575577 / -4.1%	0.34 / 0.33 / +2.4%
tpcds_q22/datafusion:vortex-file-compressed	84032444 / 85166503 / -1.3%	191825805 / 133637751 / +43.5% 🔴	0.44 / 0.64 / -31.3%
tpcds_q23/datafusion:vortex-file-compressed	123188244 / 124881470 / -1.4%	197318512 / 197155114 / +0.1%	0.62 / 0.63 / -1.4%
tpcds_q24/datafusion:vortex-file-compressed	93591088 / 92690042 / +1.0%	162964063 / 161953687 / +0.6%	0.57 / 0.57 / +0.3%
tpcds_q25/datafusion:vortex-file-compressed	72440925 / 71852166 / +0.8%	148552262 / 144872314 / +2.5%	0.49 / 0.50 / -1.7%
tpcds_q26/datafusion:vortex-file-compressed	37761330 / 36871606 / +2.4%	86420789 / 88033005 / -1.8%	0.44 / 0.42 / +4.3%
tpcds_q27/datafusion:vortex-file-compressed	92157734 / 90282621 / +2.1%	161155663 / 163175714 / -1.2%	0.57 / 0.55 / +3.4%
tpcds_q28/datafusion:vortex-file-compressed	24535279 / 23992440 / +2.3%	69517676 / 68371764 / +1.7%	0.35 / 0.35 / +0.6%
tpcds_q29/datafusion:vortex-file-compressed	69535074 / 68721175 / +1.2%	140356464 / 139411970 / +0.7%	0.50 / 0.49 / +0.5%
tpcds_q30/datafusion:vortex-file-compressed	31850558 / 31166474 / +2.2%	74863956 / 75756977 / -1.2%	0.43 / 0.41 / +3.4%
tpcds_q31/datafusion:vortex-file-compressed	72098286 / 72728493 / -0.9%	138892704 / 138738810 / +0.1%	0.52 / 0.52 / -1.0%
tpcds_q32/datafusion:vortex-file-compressed	18614496 / 18297642 / +1.7%	62171984 / 61054529 / +1.8%	0.30 / 0.30 / -0.1%
tpcds_q33/datafusion:vortex-file-compressed	32086718 / 31961754 / +0.4%	88952795 / 90031695 / -1.2%	0.36 / 0.36 / +1.6%
tpcds_q34/datafusion:vortex-file-compressed	26563166 / 27263406 / -2.6%	79760964 / 82087731 / -2.8%	0.33 / 0.33 / +0.3%
tpcds_q35/datafusion:vortex-file-compressed	43803085 / 44561136 / -1.7%	93339270 / 96537753 / -3.3%	0.47 / 0.46 / +1.7%
tpcds_q36/datafusion:vortex-file-compressed	61086819 / 60517625 / +0.9%	132296283 / 130962362 / +1.0%	0.46 / 0.46 / -0.1%
tpcds_q37/datafusion:vortex-file-compressed	18904853 / 19626418 / -3.7%	62356247 / 61546918 / +1.3%	0.30 / 0.32 / -4.9%
tpcds_q38/datafusion:vortex-file-compressed	38676844 / 40393168 / -4.2%	96469740 / 99394389 / -2.9%	0.40 / 0.41 / -1.3%
tpcds_q39/datafusion:vortex-file-compressed	87243600 / 88282038 / -1.2%	150177461 / 149501623 / +0.5%	0.58 / 0.59 / -1.6%
tpcds_q40/datafusion:vortex-file-compressed	32068291 / 31818952 / +0.8%	90144911 / 90173805 / -0.0%	0.36 / 0.35 / +0.8%
tpcds_q41/datafusion:vortex-file-compressed	21181629 / 21250753 / -0.3%	50493668 / 49808290 / +1.4%	0.42 / 0.43 / -1.7%
tpcds_q42/datafusion:vortex-file-compressed	14646692 / 14074238 / +4.1%	58617800 / 58925485 / -0.5%	0.25 / 0.24 / +4.6%
tpcds_q43/datafusion:vortex-file-compressed	18327965 / 19125584 / -4.2%	67537512 / 63304329 / +6.7%	0.27 / 0.30 / -10.2%
tpcds_q44/datafusion:vortex-file-compressed	32741498 / 31843378 / +2.8%	84149720 / 88343347 / -4.7%	0.39 / 0.36 / +7.9%
tpcds_q45/datafusion:vortex-file-compressed	32603928 / 32545280 / +0.2%	79193368 / 81167070 / -2.4%	0.41 / 0.40 / +2.7%
tpcds_q46/datafusion:vortex-file-compressed	34238018 / 33220518 / +3.1%	96404084 / 95700626 / +0.7%	0.36 / 0.35 / +2.3%
tpcds_q47/datafusion:vortex-file-compressed	121160739 / 119306562 / +1.6%	195968387 / 198840417 / -1.4%	0.62 / 0.60 / +3.0%
tpcds_q48/datafusion:vortex-file-compressed	34898308 / 34916828 / -0.1%	81724949 / 81494423 / +0.3%	0.43 / 0.43 / -0.3%
tpcds_q49/datafusion:vortex-file-compressed	64050813 / 65259443 / -1.9%	128105318 / 128309201 / -0.2%	0.50 / 0.51 / -1.7%
tpcds_q50/datafusion:vortex-file-compressed	44976209 / 44971687 / +0.0%	98281606 / 99862282 / -1.6%	0.46 / 0.45 / +1.6%
tpcds_q51/datafusion:vortex-file-compressed	72170469 / 72613921 / -0.6%	136581013 / 137030732 / -0.3%	0.53 / 0.53 / -0.3%
tpcds_q52/datafusion:vortex-file-compressed	14354789 / 14616568 / -1.8%	62214969 / 59967230 / +3.7%	0.23 / 0.24 / -5.3%
tpcds_q53/datafusion:vortex-file-compressed	23553796 / 24042132 / -2.0%	71616648 / 71726446 / -0.2%	0.33 / 0.34 / -1.9%
tpcds_q54/datafusion:vortex-file-compressed	36343384 / 36588971 / -0.7%	91909409 / 92693086 / -0.8%	0.40 / 0.39 / +0.2%
tpcds_q55/datafusion:vortex-file-compressed	13820210 / 14077994 / -1.8%	57442438 / 58380230 / -1.6%	0.24 / 0.24 / -0.2%
tpcds_q56/datafusion:vortex-file-compressed	31931000 / 31868364 / +0.2%	89122047 / 89349908 / -0.3%	0.36 / 0.36 / +0.5%
tpcds_q57/datafusion:vortex-file-compressed	95493194 / 96951220 / -1.5%	166508536 / 156257633 / +6.6%	0.57 / 0.62 / -7.6%
tpcds_q58/datafusion:vortex-file-compressed	55931399 / 57774612 / -3.2%	123333860 / 119576127 / +3.1%	0.45 / 0.48 / -6.1%
tpcds_q59/datafusion:vortex-file-compressed	53797994 / 54021785 / -0.4%	105139328 / 105246249 / -0.1%	0.51 / 0.51 / -0.3%
tpcds_q60/datafusion:vortex-file-compressed	31286171 / 31640733 / -1.1%	89285813 / 86630158 / +3.1%	0.35 / 0.37 / -4.1%
tpcds_q61/datafusion:vortex-file-compressed	35871959 / 36056440 / -0.5%	92644977 / 91679155 / +1.1%	0.39 / 0.39 / -1.5%
tpcds_q62/datafusion:vortex-file-compressed	23347236 / 23407736 / -0.3%	71636411 / 69662419 / +2.8%	0.33 / 0.34 / -3.0%
tpcds_q63/datafusion:vortex-file-compressed	23056042 / 23583472 / -2.2%	75866909 / 75379834 / +0.6%	0.30 / 0.31 / -2.9%
tpcds_q64/datafusion:vortex-file-compressed	449624291 / 444546328 / +1.1%	555088675 / 555305413 / -0.0%	0.81 / 0.80 / +1.2%
tpcds_q65/datafusion:vortex-file-compressed	67250414 / 68127232 / -1.3%	128881398 / 124740787 / +3.3%	0.52 / 0.55 / -4.5%
tpcds_q66/datafusion:vortex-file-compressed	75922536 / 74403732 / +2.0%	135767339 / 140482689 / -3.4%	0.56 / 0.53 / +5.6%
tpcds_q67/datafusion:vortex-file-compressed	113135998 / 110643586 / +2.3%	186256763 / 186160267 / +0.1%	0.61 / 0.59 / +2.2%
tpcds_q68/datafusion:vortex-file-compressed	31996642 / 32432239 / -1.3%	95512123 / 95091082 / +0.4%	0.34 / 0.34 / -1.8%
tpcds_q69/datafusion:vortex-file-compressed	33733232 / 34038358 / -0.9%	77505314 / 83481279 / -7.2%	0.44 / 0.41 / +6.7%
tpcds_q70/datafusion:vortex-file-compressed	107160062 / 107091366 / +0.1%	163298029 / 163845539 / -0.3%	0.66 / 0.65 / +0.4%
tpcds_q71/datafusion:vortex-file-compressed	24012666 / 24254818 / -1.0%	74022450 / 69377523 / +6.7%	0.32 / 0.35 / -7.2%
tpcds_q72/datafusion:vortex-file-compressed	1446153143 / 1452343942 / -0.4%	1551976799 / 1535035036 / +1.1%	0.93 / 0.95 / -1.5%
tpcds_q73/datafusion:vortex-file-compressed	24194785 / 24366841 / -0.7%	83315035 / 78663770 / +5.9%	0.29 / 0.31 / -6.2%
tpcds_q74/datafusion:vortex-file-compressed	71201596 / 71825720 / -0.9%	135061844 / 135987572 / -0.7%	0.53 / 0.53 / -0.2%
tpcds_q75/datafusion:vortex-file-compressed	129737709 / 131410096 / -1.3%	201775602 / 206267438 / -2.2%	0.64 / 0.64 / +0.9%
tpcds_q76/datafusion:vortex-file-compressed	39926664 / 38934679 / +2.5%	93270949 / 92798859 / +0.5%	0.43 / 0.42 / +2.0%
tpcds_q77/datafusion:vortex-file-compressed	42141778 / 42117534 / +0.1%	100873322 / 95083709 / +6.1%	0.42 / 0.44 / -5.7%
tpcds_q78/datafusion:vortex-file-compressed	103054846 / 102756284 / +0.3%	173802915 / 175843944 / -1.2%	0.59 / 0.58 / +1.5%
tpcds_q79/datafusion:vortex-file-compressed	28079130 / 27646960 / +1.6%	82564455 / 80447450 / +2.6%	0.34 / 0.34 / -1.0%
tpcds_q80/datafusion:vortex-file-compressed	93009226 / 95452201 / -2.6%	175593898 / 182231889 / -3.6%	0.53 / 0.52 / +1.1%
tpcds_q81/datafusion:vortex-file-compressed	35180454 / 33089862 / +6.3%	75578842 / 77591236 / -2.6%	0.47 / 0.43 / +9.1%
tpcds_q82/datafusion:vortex-file-compressed	20171248 / 20355579 / -0.9%	66482536 / 68642210 / -3.1%	0.30 / 0.30 / +2.3%
tpcds_q83/datafusion:vortex-file-compressed	43653296 / 44562425 / -2.0%	85783619 / 86443784 / -0.8%	0.51 / 0.52 / -1.3%
tpcds_q84/datafusion:vortex-file-compressed	14479952 / 14686440 / -1.4%	48092744 / 56725560 / -15.2% 🟢	0.30 / 0.26 / +16.3%
tpcds_q85/datafusion:vortex-file-compressed	97784970 / 97729444 / +0.1%	164801667 / 164783429 / +0.0%	0.59 / 0.59 / +0.0%
tpcds_q86/datafusion:vortex-file-compressed	18674734 / 19151484 / -2.5%	64195458 / 63069897 / +1.8%	0.29 / 0.30 / -4.2%
tpcds_q87/datafusion:vortex-file-compressed	39301783 / 39425957 / -0.3%	99781787 / 98066742 / +1.7%	0.39 / 0.40 / -2.0%
tpcds_q88/datafusion:vortex-file-compressed	51155000 / 51548788 / -0.8%	112320465 / 110796884 / +1.4%	0.46 / 0.47 / -2.1%
tpcds_q89/datafusion:vortex-file-compressed	26544857 / 26282052 / +1.0%	77430489 / 78937340 / -1.9%	0.34 / 0.33 / +3.0%
tpcds_q90/datafusion:vortex-file-compressed	14041329 / 14193479 / -1.1%	51314859 / 52049879 / -1.4%	0.27 / 0.27 / +0.3%
tpcds_q91/datafusion:vortex-file-compressed	21116515 / 20172750 / +4.7%	56543835 / 55781381 / +1.4%	0.37 / 0.36 / +3.3%
tpcds_q92/datafusion:vortex-file-compressed	17227654 / 17712108 / -2.7%	61798896 / 60886529 / +1.5%	0.28 / 0.29 / -4.2%
tpcds_q93/datafusion:vortex-file-compressed	31262046 / 30466348 / +2.6%	81634022 / 81199395 / +0.5%	0.38 / 0.38 / +2.1%
tpcds_q94/datafusion:vortex-file-compressed	22533234 / 22764232 / -1.0%	64040517 / 65729819 / -2.6%	0.35 / 0.35 / +1.6%
tpcds_q95/datafusion:vortex-file-compressed	59716685 / 58877184 / +1.4%	116715745 / 118046542 / -1.1%	0.51 / 0.50 / +2.6%
tpcds_q96/datafusion:vortex-file-compressed	11796297 / 11749526 / +0.4%	52638442 / 52884277 / -0.5%	0.22 / 0.22 / +0.9%
tpcds_q97/datafusion:vortex-file-compressed	26344758 / 27047275 / -2.6%	82529771 / 80966520 / +1.9%	0.32 / 0.33 / -4.4%
tpcds_q98/datafusion:vortex-file-compressed	23938316 / 23707658 / +1.0%	76297870 / 79092830 / -3.5%	0.31 / 0.30 / +4.7%
tpcds_q99/datafusion:vortex-file-compressed	27209298 / 26440035 / +2.9%	73455120 / 73596947 / -0.2%	0.37 / 0.36 / +3.1%

datafusion / parquet / ns (0.995x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet	30049071 / 29960816 / +0.3%	73121679 / 70294720 / +4.0%	0.41 / 0.43 / -3.6%
tpcds_q02/datafusion:parquet	52982009 / 52473474 / +1.0%	100751822 / 98756319 / +2.0%	0.53 / 0.53 / -1.0%
tpcds_q03/datafusion:parquet	18047604 / 19311532 / -6.5%	57055059 / 58937316 / -3.2%	0.32 / 0.33 / -3.5%
tpcds_q04/datafusion:parquet	337145382 / 323990686 / +4.1%	419350098 / 392344306 / +6.9%	0.80 / 0.83 / -2.6%
tpcds_q05/datafusion:parquet	77485188 / 82019872 / -5.5%	144602846 / 145658399 / -0.7%	0.54 / 0.56 / -4.8%
tpcds_q06/datafusion:parquet	29812624 / 29558470 / +0.9%	79592910 / 80728643 / -1.4%	0.37 / 0.37 / +2.3%
tpcds_q07/datafusion:parquet	94986374 / 95599260 / -0.6%	156593258 / 154686551 / +1.2%	0.61 / 0.62 / -1.9%
tpcds_q08/datafusion:parquet	37539304 / 37961394 / -1.1%	85553403 / 85018656 / +0.6%	0.44 / 0.45 / -1.7%
tpcds_q09/datafusion:parquet	33327416 / 33624588 / -0.9%	94478778 / 89205123 / +5.9%	0.35 / 0.38 / -6.4%
tpcds_q10/datafusion:parquet	89437646 / 89956418 / -0.6%	134805489 / 139528272 / -3.4%	0.66 / 0.64 / +2.9%
tpcds_q11/datafusion:parquet	161338946 / 161735736 / -0.2%	237615825 / 227580943 / +4.4%	0.68 / 0.71 / -4.5%
tpcds_q12/datafusion:parquet	26818352 / 27435237 / -2.2%	62413550 / 62556063 / -0.2%	0.43 / 0.44 / -2.0%
tpcds_q13/datafusion:parquet	95983376 / 96733171 / -0.8%	162345001 / 163058295 / -0.4%	0.59 / 0.59 / -0.3%
tpcds_q14/datafusion:parquet	262906814 / 266392482 / -1.3%	341371134 / 336179956 / +1.5%	0.77 / 0.79 / -2.8%
tpcds_q15/datafusion:parquet	38335297 / 36785344 / +4.2%	78847179 / 82479491 / -4.4%	0.49 / 0.45 / +9.0%
tpcds_q16/datafusion:parquet	45960960 / 47434246 / -3.1%	88587548 / 88943726 / -0.4%	0.52 / 0.53 / -2.7%
tpcds_q17/datafusion:parquet	108553391 / 108202061 / +0.3%	173715044 / 172741382 / +0.6%	0.62 / 0.63 / -0.2%
tpcds_q18/datafusion:parquet	125879736 / 125762008 / +0.1%	190193672 / 185693316 / +2.4%	0.66 / 0.68 / -2.3%
tpcds_q19/datafusion:parquet	30705540 / 30343144 / +1.2%	77360677 / 79817978 / -3.1%	0.40 / 0.38 / +4.4%
tpcds_q20/datafusion:parquet	28332182 / 30392822 / -6.8%	69764682 / 71531509 / -2.5%	0.41 / 0.42 / -4.4%
tpcds_q21/datafusion:parquet	22925156 / 24630693 / -6.9%	67582547 / 66782405 / +1.2%	0.34 / 0.37 / -8.0%
tpcds_q22/datafusion:parquet	120502250 / 106248840 / +13.4% 🔴	176912769 / 161084292 / +9.8%	0.68 / 0.66 / +3.3%
tpcds_q23/datafusion:parquet	163472479 / 162792846 / +0.4%	238905365 / 238882994 / +0.0%	0.68 / 0.68 / +0.4%
tpcds_q24/datafusion:parquet	130394429 / 132336818 / -1.5%	201209508 / 205135850 / -1.9%	0.65 / 0.65 / +0.5%
tpcds_q25/datafusion:parquet	107929843 / 105762311 / +2.0%	176852753 / 173615042 / +1.9%	0.61 / 0.61 / +0.2%
tpcds_q26/datafusion:parquet	87075754 / 83382888 / +4.4%	136723871 / 136829398 / -0.1%	0.64 / 0.61 / +4.5%
tpcds_q27/datafusion:parquet	148407634 / 147429431 / +0.7%	234931572 / 238531041 / -1.5%	0.63 / 0.62 / +2.2%
tpcds_q28/datafusion:parquet	36571934 / 37003206 / -1.2%	93825909 / 95140537 / -1.4%	0.39 / 0.39 / +0.2%
tpcds_q29/datafusion:parquet	105267362 / 106746042 / -1.4%	178567642 / 179517835 / -0.5%	0.59 / 0.59 / -0.9%
tpcds_q30/datafusion:parquet	44234327 / 44368712 / -0.3%	89755955 / 90329494 / -0.6%	0.49 / 0.49 / +0.3%
tpcds_q31/datafusion:parquet	90550858 / 90364436 / +0.2%	143243106 / 147537203 / -2.9%	0.63 / 0.61 / +3.2%
tpcds_q32/datafusion:parquet	25441353 / 25811357 / -1.4%	62593336 / 65096468 / -3.8%	0.41 / 0.40 / +2.5%
tpcds_q33/datafusion:parquet	39884213 / 40765553 / -2.2%	89776289 / 89892683 / -0.1%	0.44 / 0.45 / -2.0%
tpcds_q34/datafusion:parquet	29385890 / 30096173 / -2.4%	72108507 / 72234731 / -0.2%	0.41 / 0.42 / -2.2%
tpcds_q35/datafusion:parquet	93945486 / 92223040 / +1.9%	140583497 / 143258522 / -1.9%	0.67 / 0.64 / +3.8%
tpcds_q36/datafusion:parquet	64615119 / 66768093 / -3.2%	144194934 / 141620704 / +1.8%	0.45 / 0.47 / -5.0%
tpcds_q37/datafusion:parquet	26609221 / 26494218 / +0.4%	64279383 / 65823895 / -2.3%	0.41 / 0.40 / +2.8%
tpcds_q38/datafusion:parquet	55765932 / 55063956 / +1.3%	104763986 / 103634907 / +1.1%	0.53 / 0.53 / +0.2%
tpcds_q39/datafusion:parquet	77042356 / 76802386 / +0.3%	127440899 / 145069900 / -12.2% 🟢	0.60 / 0.53 / +14.2%
tpcds_q40/datafusion:parquet	32575832 / 33034460 / -1.4%	79128684 / 80326884 / -1.5%	0.41 / 0.41 / +0.1%
tpcds_q41/datafusion:parquet	22053191 / 22074556 / -0.1%	47856386 / 46511612 / +2.9%	0.46 / 0.47 / -2.9%
tpcds_q42/datafusion:parquet	16458127 / 17512962 / -6.0%	52523554 / 55970954 / -6.2%	0.31 / 0.31 / +0.1%
tpcds_q43/datafusion:parquet	22605480 / 22092622 / +2.3%	64743284 / 66231478 / -2.2%	0.35 / 0.33 / +4.7%
tpcds_q44/datafusion:parquet	38670586 / 38515238 / +0.4%	94520945 / 95930778 / -1.5%	0.41 / 0.40 / +1.9%
tpcds_q45/datafusion:parquet	44997637 / 46596276 / -3.4%	93621077 / 96923823 / -3.4%	0.48 / 0.48 / -0.0%
tpcds_q46/datafusion:parquet	40674482 / 41100134 / -1.0%	97613058 / 95266494 / +2.5%	0.42 / 0.43 / -3.4%
tpcds_q47/datafusion:parquet	140885858 / 140801520 / +0.1%	211029813 / 212417764 / -0.7%	0.67 / 0.66 / +0.7%
tpcds_q48/datafusion:parquet	86217372 / 86303590 / -0.1%	139757766 / 135392609 / +3.2%	0.62 / 0.64 / -3.2%
tpcds_q49/datafusion:parquet	71964334 / 73945177 / -2.7%	139341769 / 140037288 / -0.5%	0.52 / 0.53 / -2.2%
tpcds_q50/datafusion:parquet	72901838 / 74634289 / -2.3%	120796903 / 121317649 / -0.4%	0.60 / 0.62 / -1.9%
tpcds_q51/datafusion:parquet	78976214 / 79187926 / -0.3%	137342843 / 141988750 / -3.3%	0.58 / 0.56 / +3.1%
tpcds_q52/datafusion:parquet	16737754 / 17519512 / -4.5%	57748504 / 56664642 / +1.9%	0.29 / 0.31 / -6.3%
tpcds_q53/datafusion:parquet	23563402 / 25198142 / -6.5%	66194933 / 68716078 / -3.7%	0.36 / 0.37 / -2.9%
tpcds_q54/datafusion:parquet	45191077 / 45098902 / +0.2%	96268173 / 93444039 / +3.0%	0.47 / 0.48 / -2.7%
tpcds_q55/datafusion:parquet	16641824 / 16873760 / -1.4%	55354231 / 53110943 / +4.2%	0.30 / 0.32 / -5.4%
tpcds_q56/datafusion:parquet	40662409 / 39501741 / +2.9%	96211436 / 92485457 / +4.0%	0.42 / 0.43 / -1.0%
tpcds_q57/datafusion:parquet	117069618 / 119081717 / -1.7%	174991504 / 189655258 / -7.7%	0.67 / 0.63 / +6.5%
tpcds_q58/datafusion:parquet	82474712 / 80568990 / +2.4%	143765124 / 139972579 / +2.7%	0.57 / 0.58 / -0.3%
tpcds_q59/datafusion:parquet	71561074 / 71298910 / +0.4%	125658908 / 121155743 / +3.7%	0.57 / 0.59 / -3.2%
tpcds_q60/datafusion:parquet	37869646 / 38055036 / -0.5%	90151084 / 94905360 / -5.0%	0.42 / 0.40 / +4.8%
tpcds_q61/datafusion:parquet	45559260 / 46378584 / -1.8%	104240855 / 104665964 / -0.4%	0.44 / 0.44 / -1.4%
tpcds_q62/datafusion:parquet	26650996 / 32783958 / -18.7% 🟢	72111508 / 71537261 / +0.8%	0.37 / 0.46 / -19.4%
tpcds_q63/datafusion:parquet	25938592 / 24765626 / +4.7%	70518332 / 70126647 / +0.6%	0.37 / 0.35 / +4.2%
tpcds_q64/datafusion:parquet	351579937 / 349901996 / +0.5%	436878470 / 429324658 / +1.8%	0.80 / 0.82 / -1.3%
tpcds_q65/datafusion:parquet	46887568 / 47060676 / -0.4%	107265864 / 100198238 / +7.1%	0.44 / 0.47 / -6.9%
tpcds_q66/datafusion:parquet	85330414 / 84799637 / +0.6%	130090005 / 130398541 / -0.2%	0.66 / 0.65 / +0.9%
tpcds_q67/datafusion:parquet	138226753 / 130089047 / +6.3%	213685349 / 206524399 / +3.5%	0.65 / 0.63 / +2.7%
tpcds_q68/datafusion:parquet	39495566 / 39206890 / +0.7%	96408195 / 96833316 / -0.4%	0.41 / 0.40 / +1.2%
tpcds_q69/datafusion:parquet	84933369 / 86893710 / -2.3%	132531377 / 134551610 / -1.5%	0.64 / 0.65 / -0.8%
tpcds_q70/datafusion:parquet	42772661 / 44116831 / -3.0%	92597654 / 90990376 / +1.8%	0.46 / 0.48 / -4.7%
tpcds_q71/datafusion:parquet	29578930 / 28030482 / +5.5%	76638607 / 72872122 / +5.2%	0.39 / 0.38 / +0.3%
tpcds_q72/datafusion:parquet	439516766 / 439681284 / -0.0%	568405564 / 536292213 / +6.0%	0.77 / 0.82 / -5.7%
tpcds_q73/datafusion:parquet	30397280 / 29702775 / +2.3%	71437311 / 70082512 / +1.9%	0.43 / 0.42 / +0.4%
tpcds_q74/datafusion:parquet	95764780 / 97086472 / -1.4%	152694055 / 153233114 / -0.4%	0.63 / 0.63 / -1.0%
tpcds_q75/datafusion:parquet	159505078 / 159255671 / +0.2%	238845409 / 238019156 / +0.3%	0.67 / 0.67 / -0.2%
tpcds_q76/datafusion:parquet	58049411 / 57331969 / +1.3%	102663461 / 107221383 / -4.3%	0.57 / 0.53 / +5.7%
tpcds_q77/datafusion:parquet	54047430 / 53756467 / +0.5%	104712238 / 106157294 / -1.4%	0.52 / 0.51 / +1.9%
tpcds_q78/datafusion:parquet	114748656 / 114615154 / +0.1%	199817503 / 200245116 / -0.2%	0.57 / 0.57 / +0.3%
tpcds_q79/datafusion:parquet	34120821 / 33017734 / +3.3%	81210833 / 81552734 / -0.4%	0.42 / 0.40 / +3.8%
tpcds_q80/datafusion:parquet	93575790 / 91276354 / +2.5%	177236232 / 179083621 / -1.0%	0.53 / 0.51 / +3.6%
tpcds_q81/datafusion:parquet	39903480 / 39973823 / -0.2%	89806127 / 90112169 / -0.3%	0.44 / 0.44 / +0.2%
tpcds_q82/datafusion:parquet	24751442 / 25399191 / -2.6%	67458323 / 64468345 / +4.6%	0.37 / 0.39 / -6.9%
tpcds_q83/datafusion:parquet	55623858 / 55237950 / +0.7%	106804469 / 106667787 / +0.1%	0.52 / 0.52 / +0.6%
tpcds_q84/datafusion:parquet	46710370 / 46478604 / +0.5%	88807146 / 87034923 / +2.0%	0.53 / 0.53 / -1.5%
tpcds_q85/datafusion:parquet	184825902 / 185787466 / -0.5%	257158796 / 259051391 / -0.7%	0.72 / 0.72 / +0.2%
tpcds_q86/datafusion:parquet	24555945 / 22768784 / +7.8%	60203369 / 59196149 / +1.7%	0.41 / 0.38 / +6.0%
tpcds_q87/datafusion:parquet	58836804 / 59896826 / -1.8%	111008152 / 106101282 / +4.6%	0.53 / 0.56 / -6.1%
tpcds_q88/datafusion:parquet	56975446 / 58498946 / -2.6%	115558345 / 116330315 / -0.7%	0.49 / 0.50 / -2.0%
tpcds_q89/datafusion:parquet	29453508 / 29729358 / -0.9%	74655359 / 76879085 / -2.9%	0.39 / 0.39 / +2.0%
tpcds_q90/datafusion:parquet	19893729 / 20450562 / -2.7%	54095561 / 52641392 / +2.8%	0.37 / 0.39 / -5.3%
tpcds_q91/datafusion:parquet	62298528 / 63465650 / -1.8%	106720115 / 106342721 / +0.4%	0.58 / 0.60 / -2.2%
tpcds_q92/datafusion:parquet	24538520 / 24698036 / -0.6%	62743486 / 64543823 / -2.8%	0.39 / 0.38 / +2.2%
tpcds_q93/datafusion:parquet	32865170 / 34585388 / -5.0%	89900705 / 91181979 / -1.4%	0.37 / 0.38 / -3.6%
tpcds_q94/datafusion:parquet	30685492 / 31339525 / -2.1%	73819964 / 70767743 / +4.3%	0.42 / 0.44 / -6.1%
tpcds_q95/datafusion:parquet	84529421 / 84887809 / -0.4%	144370890 / 142724912 / +1.2%	0.59 / 0.59 / -1.6%
tpcds_q96/datafusion:parquet	16470598 / 16575994 / -0.6%	53330290 / 54276640 / -1.7%	0.31 / 0.31 / +1.1%
tpcds_q97/datafusion:parquet	37462316 / 36979300 / +1.3%	86279095 / 87097215 / -0.9%	0.43 / 0.42 / +2.3%
tpcds_q98/datafusion:parquet	27631646 / 27232412 / +1.5%	71765655 / 73005067 / -1.7%	0.39 / 0.37 / +3.2%
tpcds_q99/datafusion:parquet	34707604 / 34426850 / +0.8%	79048543 / 67156726 / +17.7% 🔴	0.44 / 0.51 / -14.4%

duckdb / vortex-file-compressed / ns (1.011x ➖, 1↑ 8↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed	25483147 / 23988134 / +6.2%	50627313 / 42821883 / +18.2% 🔴	0.50 / 0.56 / -10.1%
tpcds_q02/duckdb:vortex-file-compressed	27926970 / 28541597 / -2.2%	41619375 / 42241838 / -1.5%	0.67 / 0.68 / -0.7%
tpcds_q03/duckdb:vortex-file-compressed	21339134 / 19183821 / +11.2% 🔴	43286653 / 41193785 / +5.1%	0.49 / 0.47 / +5.9%
tpcds_q04/duckdb:vortex-file-compressed	89884612 / 93498684 / -3.9%	120308786 / 124936004 / -3.7%	0.75 / 0.75 / -0.2%
tpcds_q05/duckdb:vortex-file-compressed	34374912 / 33358368 / +3.0%	58793047 / 58333601 / +0.8%	0.58 / 0.57 / +2.2%
tpcds_q06/duckdb:vortex-file-compressed	44599212 / 46217266 / -3.5%	69510503 / 69025995 / +0.7%	0.64 / 0.67 / -4.2%
tpcds_q07/duckdb:vortex-file-compressed	26706264 / 30218782 / -11.6% 🟢	57477230 / 55534712 / +3.5%	0.46 / 0.54 / -14.6%
tpcds_q08/duckdb:vortex-file-compressed	31289844 / 30546156 / +2.4%	50304351 / 57524380 / -12.6% 🟢	0.62 / 0.53 / +17.1%
tpcds_q09/duckdb:vortex-file-compressed	17497098 / 17986414 / -2.7%	51801091 / 59233483 / -12.5% 🟢	0.34 / 0.30 / +11.2%
tpcds_q10/duckdb:vortex-file-compressed	50497594 / 50024766 / +0.9%	90314448 / 82841925 / +9.0%	0.56 / 0.60 / -7.4%
tpcds_q11/duckdb:vortex-file-compressed	73532771 / 72469741 / +1.5%	102753762 / 101052524 / +1.7%	0.72 / 0.72 / -0.2%
tpcds_q12/duckdb:vortex-file-compressed	16201258 / 16921495 / -4.3%	33492037 / 31794589 / +5.3%	0.48 / 0.53 / -9.1%
tpcds_q13/duckdb:vortex-file-compressed	37899876 / 36386688 / +4.2%	68484884 / 70679977 / -3.1%	0.55 / 0.51 / +7.5%
tpcds_q14/duckdb:vortex-file-compressed	106919720 / 107057034 / -0.1%	147292278 / 145185526 / +1.5%	0.73 / 0.74 / -1.6%
tpcds_q15/duckdb:vortex-file-compressed	30992895 / 30790600 / +0.7%	48441291 / 47973807 / +1.0%	0.64 / 0.64 / -0.3%
tpcds_q16/duckdb:vortex-file-compressed	30834788 / 32263452 / -4.4%	52914958 / 52549053 / +0.7%	0.58 / 0.61 / -5.1%
tpcds_q17/duckdb:vortex-file-compressed	49946414 / 49587571 / +0.7%	85870657 / 94830086 / -9.4%	0.58 / 0.52 / +11.2%
tpcds_q18/duckdb:vortex-file-compressed	47857146 / 45857238 / +4.4%	65092909 / 65816275 / -1.1%	0.74 / 0.70 / +5.5%
tpcds_q19/duckdb:vortex-file-compressed	37203539 / 38702382 / -3.9%	65328651 / 64173382 / +1.8%	0.57 / 0.60 / -5.6%
tpcds_q20/duckdb:vortex-file-compressed	16526993 / 16414707 / +0.7%	31528030 / 32277849 / -2.3%	0.52 / 0.51 / +3.1%
tpcds_q21/duckdb:vortex-file-compressed	21122434 / 17656383 / +19.6% 🔴	46582720 / 52330274 / -11.0% 🟢	0.45 / 0.34 / +34.4%
tpcds_q22/duckdb:vortex-file-compressed	71385842 / 66373399 / +7.6%	97380859 / 103535641 / -5.9%	0.73 / 0.64 / +14.3%
tpcds_q23/duckdb:vortex-file-compressed	72324714 / 71225834 / +1.5%	120047284 / 112808771 / +6.4%	0.60 / 0.63 / -4.6%
tpcds_q24/duckdb:vortex-file-compressed	50641142 / 50598303 / +0.1%	80782693 / 77931989 / +3.7%	0.63 / 0.65 / -3.4%
tpcds_q25/duckdb:vortex-file-compressed	44216884 / 41925957 / +5.5%	73360417 / 78310972 / -6.3%	0.60 / 0.54 / +12.6%
tpcds_q26/duckdb:vortex-file-compressed	22429718 / 23075192 / -2.8%	42332639 / 40522444 / +4.5%	0.53 / 0.57 / -7.0%
tpcds_q27/duckdb:vortex-file-compressed	32142934 / 30372806 / +5.8%	66647563 / 62493813 / +6.6%	0.48 / 0.49 / -0.8%
tpcds_q28/duckdb:vortex-file-compressed	13314584 / 11999670 / +11.0% 🔴	28611295 / 25787200 / +11.0% 🔴	0.47 / 0.47 / +0.0%
tpcds_q29/duckdb:vortex-file-compressed	48151866 / 49032683 / -1.8%	84509417 / 94309438 / -10.4% 🟢	0.57 / 0.52 / +9.6%
tpcds_q30/duckdb:vortex-file-compressed	32762600 / 31101134 / +5.3%	54532615 / 56099293 / -2.8%	0.60 / 0.55 / +8.4%
tpcds_q31/duckdb:vortex-file-compressed	30437712 / 31387545 / -3.0%	60944236 / 62736196 / -2.9%	0.50 / 0.50 / -0.2%
tpcds_q32/duckdb:vortex-file-compressed	17608382 / 17319392 / +1.7%	35845237 / 35043918 / +2.3%	0.49 / 0.49 / -0.6%
tpcds_q33/duckdb:vortex-file-compressed	31051110 / 29437504 / +5.5%	61399233 / 66929547 / -8.3%	0.51 / 0.44 / +15.0%
tpcds_q34/duckdb:vortex-file-compressed	27788362 / 26840174 / +3.5%	44006356 / 51004812 / -13.7% 🟢	0.63 / 0.53 / +20.0%
tpcds_q35/duckdb:vortex-file-compressed	74208948 / 75941908 / -2.3%	111486616 / 110104669 / +1.3%	0.67 / 0.69 / -3.5%
tpcds_q36/duckdb:vortex-file-compressed	28433698 / 27765833 / +2.4%	59772962 / 58399966 / +2.4%	0.48 / 0.48 / +0.1%
tpcds_q37/duckdb:vortex-file-compressed	26529062 / 25920227 / +2.3%	57609817 / 58664805 / -1.8%	0.46 / 0.44 / +4.2%
tpcds_q38/duckdb:vortex-file-compressed	38671243 / 38401127 / +0.7%	62894280 / 61219843 / +2.7%	0.61 / 0.63 / -2.0%
tpcds_q39/duckdb:vortex-file-compressed	36360154 / 34095796 / +6.6%	59629183 / 60302182 / -1.1%	0.61 / 0.57 / +7.8%
tpcds_q40/duckdb:vortex-file-compressed	22577828 / 23091114 / -2.2%	38372877 / 41753075 / -8.1%	0.59 / 0.55 / +6.4%
tpcds_q41/duckdb:vortex-file-compressed	9274299 / 9873711 / -6.1%	20664985 / 20566265 / +0.5%	0.45 / 0.48 / -6.5%
tpcds_q42/duckdb:vortex-file-compressed	17724276 / 18000487 / -1.5%	36972943 / 40673253 / -9.1%	0.48 / 0.44 / +8.3%
tpcds_q43/duckdb:vortex-file-compressed	20571974 / 20407402 / +0.8%	38314587 / 44128691 / -13.2% 🟢	0.54 / 0.46 / +16.1%
tpcds_q44/duckdb:vortex-file-compressed	24003342 / 25091860 / -4.3%	64399542 / 60812660 / +5.9%	0.37 / 0.41 / -9.7%
tpcds_q45/duckdb:vortex-file-compressed	34006486 / 32984117 / +3.1%	50864098 / 48055358 / +5.8%	0.67 / 0.69 / -2.6%
tpcds_q46/duckdb:vortex-file-compressed	31224740 / 33545638 / -6.9%	68477257 / 66441374 / +3.1%	0.46 / 0.50 / -9.7%
tpcds_q47/duckdb:vortex-file-compressed	54608928 / 51829877 / +5.4%	82868450 / 80855391 / +2.5%	0.66 / 0.64 / +2.8%
tpcds_q48/duckdb:vortex-file-compressed	33284116 / 35747093 / -6.9%	67644703 / 65837770 / +2.7%	0.49 / 0.54 / -9.4%
tpcds_q49/duckdb:vortex-file-compressed	32171242 / 31904772 / +0.8%	70775869 / 70086544 / +1.0%	0.45 / 0.46 / -0.1%
tpcds_q50/duckdb:vortex-file-compressed	31047922 / 33033794 / -6.0%	62200760 / 57755029 / +7.7%	0.50 / 0.57 / -12.7%
tpcds_q51/duckdb:vortex-file-compressed	95521476 / 96796370 / -1.3%	118027297 / 121167531 / -2.6%	0.81 / 0.80 / +1.3%
tpcds_q52/duckdb:vortex-file-compressed	16706666 / 17887360 / -6.6%	38227719 / 40974518 / -6.7%	0.44 / 0.44 / +0.1%
tpcds_q53/duckdb:vortex-file-compressed	24886862 / 24640077 / +1.0%	50792552 / 50020399 / +1.5%	0.49 / 0.49 / -0.5%
tpcds_q54/duckdb:vortex-file-compressed	36504925 / 37611662 / -2.9%	60378089 / 60628771 / -0.4%	0.60 / 0.62 / -2.5%
tpcds_q55/duckdb:vortex-file-compressed	15174660 / 15197706 / -0.2%	38728339 / 41935829 / -7.6%	0.39 / 0.36 / +8.1%
tpcds_q56/duckdb:vortex-file-compressed	29712180 / 31052980 / -4.3%	60742667 / 62052499 / -2.1%	0.49 / 0.50 / -2.3%
tpcds_q57/duckdb:vortex-file-compressed	39613772 / 40231003 / -1.5%	60819503 / 60411146 / +0.7%	0.65 / 0.67 / -2.2%
tpcds_q58/duckdb:vortex-file-compressed	32248050 / 32709558 / -1.4%	55582792 / 60445928 / -8.0%	0.58 / 0.54 / +7.2%
tpcds_q59/duckdb:vortex-file-compressed	37893483 / 38219770 / -0.9%	57499320 / 60193179 / -4.5%	0.66 / 0.63 / +3.8%
tpcds_q60/duckdb:vortex-file-compressed	30764148 / 29687129 / +3.6%	61479541 / 60486227 / +1.6%	0.50 / 0.49 / +2.0%
tpcds_q61/duckdb:vortex-file-compressed	34869855 / 36948452 / -5.6%	75253473 / 76368497 / -1.5%	0.46 / 0.48 / -4.2%
tpcds_q62/duckdb:vortex-file-compressed	19399368 / 18877622 / +2.8%	34947488 / 35411470 / -1.3%	0.56 / 0.53 / +4.1%
tpcds_q63/duckdb:vortex-file-compressed	24441620 / 21414982 / +14.1% 🔴	46135198 / 51678633 / -10.7% 🟢	0.53 / 0.41 / +27.8%
tpcds_q64/duckdb:vortex-file-compressed	105923360 / 104661790 / +1.2%	142323487 / 150715657 / -5.6%	0.74 / 0.69 / +7.2%
tpcds_q65/duckdb:vortex-file-compressed	25126998 / 24917198 / +0.8%	46587555 / 49309068 / -5.5%	0.54 / 0.51 / +6.7%
tpcds_q66/duckdb:vortex-file-compressed	38910126 / 39163054 / -0.6%	68710982 / 66611522 / +3.2%	0.57 / 0.59 / -3.7%
tpcds_q67/duckdb:vortex-file-compressed	125785238 / 126421520 / -0.5%	158817127 / 152319151 / +4.3%	0.79 / 0.83 / -4.6%
tpcds_q68/duckdb:vortex-file-compressed	34355712 / 31628984 / +8.6%	65618996 / 64086411 / +2.4%	0.52 / 0.49 / +6.1%
tpcds_q69/duckdb:vortex-file-compressed	50840189 / 49884475 / +1.9%	88337528 / 89242395 / -1.0%	0.58 / 0.56 / +3.0%
tpcds_q70/duckdb:vortex-file-compressed	36516322 / 36000044 / +1.4%	70850729 / 64655821 / +9.6%	0.52 / 0.56 / -7.4%
tpcds_q71/duckdb:vortex-file-compressed	24458000 / 24464354 / -0.0%	50581076 / 54149589 / -6.6%	0.48 / 0.45 / +7.0%
tpcds_q72/duckdb:vortex-file-compressed	144290462 / 148326757 / -2.7%	190561655 / 188734373 / +1.0%	0.76 / 0.79 / -3.7%
tpcds_q73/duckdb:vortex-file-compressed	26896200 / 26410102 / +1.8%	45116397 / 53841995 / -16.2% 🟢	0.60 / 0.49 / +21.5%
tpcds_q74/duckdb:vortex-file-compressed	50773372 / 49747955 / +2.1%	72327199 / 77613322 / -6.8%	0.70 / 0.64 / +9.5%
tpcds_q75/duckdb:vortex-file-compressed	54201348 / 52283039 / +3.7%	96837597 / 84934176 / +14.0% 🔴	0.56 / 0.62 / -9.1%
tpcds_q76/duckdb:vortex-file-compressed	23305516 / 22983946 / +1.4%	56252893 / 57485019 / -2.1%	0.41 / 0.40 / +3.6%
tpcds_q77/duckdb:vortex-file-compressed	28005286 / 27226312 / +2.9%	52635808 / 52847396 / -0.4%	0.53 / 0.52 / +3.3%
tpcds_q78/duckdb:vortex-file-compressed	72223620 / 73928412 / -2.3%	95518970 / 96028931 / -0.5%	0.76 / 0.77 / -1.8%
tpcds_q79/duckdb:vortex-file-compressed	28850406 / 26503970 / +8.9%	54860806 / 57019385 / -3.8%	0.53 / 0.46 / +13.1%
tpcds_q80/duckdb:vortex-file-compressed	50711773 / 48293242 / +5.0%	81187503 / 88311788 / -8.1%	0.62 / 0.55 / +14.2%
tpcds_q81/duckdb:vortex-file-compressed	37002340 / 36955724 / +0.1%	57031551 / 52899878 / +7.8%	0.65 / 0.70 / -7.1%
tpcds_q82/duckdb:vortex-file-compressed	53612170 / 55570677 / -3.5%	87431084 / 85968352 / +1.7%	0.61 / 0.65 / -5.1%
tpcds_q83/duckdb:vortex-file-compressed	34498744 / 31135503 / +10.8% 🔴	44484330 / 43750912 / +1.7%	0.78 / 0.71 / +9.0%
tpcds_q84/duckdb:vortex-file-compressed	22538632 / 23143850 / -2.6%	44088444 / 43474224 / +1.4%	0.51 / 0.53 / -4.0%
tpcds_q85/duckdb:vortex-file-compressed	49228821 / 51111854 / -3.7%	74021188 / 73572154 / +0.6%	0.67 / 0.69 / -4.3%
tpcds_q86/duckdb:vortex-file-compressed	20875221 / 18940135 / +10.2% 🔴	38757427 / 38922169 / -0.4%	0.54 / 0.49 / +10.7%
tpcds_q87/duckdb:vortex-file-compressed	41206418 / 45642993 / -9.7%	65584780 / 70354508 / -6.8%	0.63 / 0.65 / -3.2%
tpcds_q88/duckdb:vortex-file-compressed	59910272 / 60114740 / -0.3%	118444331 / 117035425 / +1.2%	0.51 / 0.51 / -1.5%
tpcds_q89/duckdb:vortex-file-compressed	23121008 / 25271241 / -8.5%	47981984 / 51530247 / -6.9%	0.48 / 0.49 / -1.7%
tpcds_q90/duckdb:vortex-file-compressed	14723350 / 11889055 / +23.8% 🔴	25619979 / 29931378 / -14.4% 🟢	0.57 / 0.40 / +44.7%
tpcds_q91/duckdb:vortex-file-compressed	26295434 / 24789850 / +6.1%	43886670 / 45688431 / -3.9%	0.60 / 0.54 / +10.4%
tpcds_q92/duckdb:vortex-file-compressed	19926792 / 21043514 / -5.3%	43512773 / 39124097 / +11.2% 🔴	0.46 / 0.54 / -14.9%
tpcds_q93/duckdb:vortex-file-compressed	29981895 / 29207108 / +2.7%	49609957 / 46743552 / +6.1%	0.60 / 0.62 / -3.3%
tpcds_q94/duckdb:vortex-file-compressed	29105474 / 27512746 / +5.8%	47516413 / 51219569 / -7.2%	0.61 / 0.54 / +14.0%
tpcds_q95/duckdb:vortex-file-compressed	131658884 / 132432669 / -0.6%	166751885 / 157818737 / +5.7%	0.79 / 0.84 / -5.9%
tpcds_q96/duckdb:vortex-file-compressed	16742914 / 13714251 / +22.1% 🔴	38117104 / 35519567 / +7.3%	0.44 / 0.39 / +13.8%
tpcds_q97/duckdb:vortex-file-compressed	38866049 / 38538981 / +0.8%	65955908 / 61794586 / +6.7%	0.59 / 0.62 / -5.5%
tpcds_q98/duckdb:vortex-file-compressed	21695961 / 22942653 / -5.4%	49003290 / 48035847 / +2.0%	0.44 / 0.48 / -7.3%
tpcds_q99/duckdb:vortex-file-compressed	24565928 / 22497918 / +9.2%	36710701 / 39664655 / -7.4%	0.67 / 0.57 / +18.0%

duckdb / parquet / ns (0.998x ➖, 5↑ 6↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet	31812952 / 31349318 / +1.5%	49623558 / 46733583 / +6.2%	0.64 / 0.67 / -4.4%
tpcds_q02/duckdb:parquet	22192392 / 28944356 / -23.3% 🟢	31076137 / 38242826 / -18.7% 🟢	0.71 / 0.76 / -5.6%
tpcds_q03/duckdb:parquet	12330987 / 13295200 / -7.3%	24121646 / 22708150 / +6.2%	0.51 / 0.59 / -12.7%
tpcds_q04/duckdb:parquet	198271432 / 196165975 / +1.1%	205761080 / 203953173 / +0.9%	0.96 / 0.96 / +0.2%
tpcds_q05/duckdb:parquet	32500754 / 33232295 / -2.2%	42549292 / 41277641 / +3.1%	0.76 / 0.81 / -5.1%
tpcds_q06/duckdb:parquet	35567828 / 35507716 / +0.2%	54954302 / 56196137 / -2.2%	0.65 / 0.63 / +2.4%
tpcds_q07/duckdb:parquet	22562517 / 23219229 / -2.8%	34645022 / 36333769 / -4.6%	0.65 / 0.64 / +1.9%
tpcds_q08/duckdb:parquet	32996830 / 34101712 / -3.2%	48100960 / 46509467 / +3.4%	0.69 / 0.73 / -6.4%
tpcds_q09/duckdb:parquet	30958319 / 31848920 / -2.8%	41549941 / 38920736 / +6.8%	0.75 / 0.82 / -8.9%
tpcds_q10/duckdb:parquet	41371854 / 41401528 / -0.1%	60206091 / 60836718 / -1.0%	0.69 / 0.68 / +1.0%
tpcds_q11/duckdb:parquet	102957782 / 107816958 / -4.5%	114058661 / 116298114 / -1.9%	0.90 / 0.93 / -2.6%
tpcds_q12/duckdb:parquet	17922024 / 17946106 / -0.1%	27638356 / 27380400 / +0.9%	0.65 / 0.66 / -1.1%
tpcds_q13/duckdb:parquet	33919566 / 39794370 / -14.8% 🟢	54331919 / 56579997 / -4.0%	0.62 / 0.70 / -11.2%
tpcds_q14/duckdb:parquet	100340808 / 104085424 / -3.6%	115972708 / 114837931 / +1.0%	0.87 / 0.91 / -4.5%
tpcds_q15/duckdb:parquet	35809730 / 35938916 / -0.4%	46879176 / 48398028 / -3.1%	0.76 / 0.74 / +2.9%
tpcds_q16/duckdb:parquet	27333714 / 27901824 / -2.0%	43148238 / 42929758 / +0.5%	0.63 / 0.65 / -2.5%
tpcds_q17/duckdb:parquet	44546756 / 44047681 / +1.1%	61100732 / 57120072 / +7.0%	0.73 / 0.77 / -5.5%
tpcds_q18/duckdb:parquet	55993026 / 55383013 / +1.1%	76166748 / 77082746 / -1.2%	0.74 / 0.72 / +2.3%
tpcds_q19/duckdb:parquet	33340998 / 33494217 / -0.5%	46523482 / 48598123 / -4.3%	0.72 / 0.69 / +4.0%
tpcds_q20/duckdb:parquet	19422736 / 19197327 / +1.2%	29255839 / 28995595 / +0.9%	0.66 / 0.66 / +0.3%
tpcds_q21/duckdb:parquet	13879958 / 15191620 / -8.6%	23772166 / 25540075 / -6.9%	0.58 / 0.59 / -1.8%
tpcds_q22/duckdb:parquet	59064978 / 64724100 / -8.7%	57202589 / 80798960 / -29.2% 🟢	1.03 / 0.80 / +28.9%
tpcds_q23/duckdb:parquet	70830440 / 67944460 / +4.2%	79138307 / 78663573 / +0.6%	0.90 / 0.86 / +3.6%
tpcds_q24/duckdb:parquet	48003684 / 47901438 / +0.2%	67071393 / 69633516 / -3.7%	0.72 / 0.69 / +4.0%
tpcds_q25/duckdb:parquet	41608554 / 42874466 / -3.0%	58583528 / 62825783 / -6.8%	0.71 / 0.68 / +4.1%
tpcds_q26/duckdb:parquet	44182236 / 45003375 / -1.8%	58659129 / 56485751 / +3.8%	0.75 / 0.80 / -5.5%
tpcds_q27/duckdb:parquet	58349116 / 55119303 / +5.9%	75496633 / 73747550 / +2.4%	0.77 / 0.75 / +3.4%
tpcds_q28/duckdb:parquet	30464390 / 29724548 / +2.5%	38117475 / 41092895 / -7.2%	0.80 / 0.72 / +10.5%
tpcds_q29/duckdb:parquet	42685502 / 43609662 / -2.1%	55967171 / 56390014 / -0.7%	0.76 / 0.77 / -1.4%
tpcds_q30/duckdb:parquet	43549618 / 44258646 / -1.6%	60047149 / 63852608 / -6.0%	0.73 / 0.69 / +4.6%
tpcds_q31/duckdb:parquet	29436112 / 30849056 / -4.6%	41269240 / 43335203 / -4.8%	0.71 / 0.71 / +0.2%
tpcds_q32/duckdb:parquet	15094305 / 15225280 / -0.9%	27149980 / 29300885 / -7.3%	0.56 / 0.52 / +7.0%
tpcds_q33/duckdb:parquet	23864178 / 23315676 / +2.4%	39036694 / 39038797 / -0.0%	0.61 / 0.60 / +2.4%
tpcds_q34/duckdb:parquet	22773662 / 21689865 / +5.0%	35975024 / 34393823 / +4.6%	0.63 / 0.63 / +0.4%
tpcds_q35/duckdb:parquet	68611488 / 68500997 / +0.2%	85380343 / 87530165 / -2.5%	0.80 / 0.78 / +2.7%
tpcds_q36/duckdb:parquet	21852117 / 22479554 / -2.8%	39834619 / 42799420 / -6.9%	0.55 / 0.53 / +4.4%
tpcds_q37/duckdb:parquet	17151596 / 17476526 / -1.9%	31321989 / 30338749 / +3.2%	0.55 / 0.58 / -4.9%
tpcds_q38/duckdb:parquet	40374522 / 41256424 / -2.1%	50290026 / 50544433 / -0.5%	0.80 / 0.82 / -1.6%
tpcds_q39/duckdb:parquet	37146752 / 37014864 / +0.4%	61796719 / 60687367 / +1.8%	0.60 / 0.61 / -1.4%
tpcds_q40/duckdb:parquet	22689795 / 23068230 / -1.6%	30828972 / 32532036 / -5.2%	0.74 / 0.71 / +3.8%
tpcds_q41/duckdb:parquet	10757058 / 10458872 / +2.9%	23420249 / 24919923 / -6.0%	0.46 / 0.42 / +9.4%
tpcds_q42/duckdb:parquet	13188260 / 13198920 / -0.1%	21765231 / 22869506 / -4.8%	0.61 / 0.58 / +5.0%
tpcds_q43/duckdb:parquet	14837593 / 18216606 / -18.5% 🟢	25972447 / 26771983 / -3.0%	0.57 / 0.68 / -16.0%
tpcds_q44/duckdb:parquet	25540126 / 25094173 / +1.8%	37950307 / 38004450 / -0.1%	0.67 / 0.66 / +1.9%
tpcds_q45/duckdb:parquet	33694787 / 32823303 / +2.7%	42804081 / 42864989 / -0.1%	0.79 / 0.77 / +2.8%
tpcds_q46/duckdb:parquet	49914395 / 55054634 / -9.3%	66944860 / 70503677 / -5.0%	0.75 / 0.78 / -4.5%
tpcds_q47/duckdb:parquet	51582051 / 47509724 / +8.6%	64776255 / 65595892 / -1.2%	0.80 / 0.72 / +9.9%
tpcds_q48/duckdb:parquet	30404228 / 29970629 / +1.4%	42986855 / 45354901 / -5.2%	0.71 / 0.66 / +7.0%
tpcds_q49/duckdb:parquet	28022179 / 28822392 / -2.8%	43672647 / 42341448 / +3.1%	0.64 / 0.68 / -5.7%
tpcds_q50/duckdb:parquet	24957096 / 24348790 / +2.5%	37518898 / 37269487 / +0.7%	0.67 / 0.65 / +1.8%
tpcds_q51/duckdb:parquet	95341316 / 94979905 / +0.4%	146638554 / 144762032 / +1.3%	0.65 / 0.66 / -0.9%
tpcds_q52/duckdb:parquet	13732634 / 12132438 / +13.2% 🔴	22747211 / 22932385 / -0.8%	0.60 / 0.53 / +14.1%
tpcds_q53/duckdb:parquet	16130086 / 16642733 / -3.1%	29197268 / 29481526 / -1.0%	0.55 / 0.56 / -2.1%
tpcds_q54/duckdb:parquet	31661709 / 29980464 / +5.6%	46960593 / 46290624 / +1.4%	0.67 / 0.65 / +4.1%
tpcds_q55/duckdb:parquet	11677022 / 13060400 / -10.6% 🟢	22908004 / 23721791 / -3.4%	0.51 / 0.55 / -7.4%
tpcds_q56/duckdb:parquet	25227573 / 24644580 / +2.4%	40538781 / 43750069 / -7.3%	0.62 / 0.56 / +10.5%
tpcds_q57/duckdb:parquet	42465052 / 50415104 / -15.8% 🟢	55037050 / 57708148 / -4.6%	0.77 / 0.87 / -11.7%
tpcds_q58/duckdb:parquet	28528361 / 28427036 / +0.4%	38150502 / 39650947 / -3.8%	0.75 / 0.72 / +4.3%
tpcds_q59/duckdb:parquet	29862748 / 30151044 / -1.0%	42461717 / 54619239 / -22.3% 🟢	0.70 / 0.55 / +27.4%
tpcds_q60/duckdb:parquet	25976951 / 25184545 / +3.1%	38363139 / 38648233 / -0.7%	0.68 / 0.65 / +3.9%
tpcds_q61/duckdb:parquet	32457960 / 33736565 / -3.8%	44400980 / 43609261 / +1.8%	0.73 / 0.77 / -5.5%
tpcds_q62/duckdb:parquet	15167078 / 14694290 / +3.2%	23027941 / 24325086 / -5.3%	0.66 / 0.60 / +9.0%
tpcds_q63/duckdb:parquet	17508564 / 16791310 / +4.3%	29753274 / 30428472 / -2.2%	0.59 / 0.55 / +6.6%
tpcds_q64/duckdb:parquet	81599474 / 80298071 / +1.6%	102606317 / 102700129 / -0.1%	0.80 / 0.78 / +1.7%
tpcds_q65/duckdb:parquet	21255021 / 21529990 / -1.3%	39695572 / 36096038 / +10.0%	0.54 / 0.60 / -10.2%
tpcds_q66/duckdb:parquet	35156146 / 35487413 / -0.9%	47545978 / 46889916 / +1.4%	0.74 / 0.76 / -2.3%
tpcds_q67/duckdb:parquet	125558064 / 130772487 / -4.0%	151653048 / 134692245 / +12.6% 🔴	0.83 / 0.97 / -14.7%
tpcds_q68/duckdb:parquet	43643833 / 39095023 / +11.6% 🔴	58325515 / 60717111 / -3.9%	0.75 / 0.64 / +16.2%
tpcds_q69/duckdb:parquet	44193049 / 42376778 / +4.3%	66175256 / 60185785 / +10.0%	0.67 / 0.70 / -5.2%
tpcds_q70/duckdb:parquet	29133366 / 28546650 / +2.1%	45284362 / 42484037 / +6.6%	0.64 / 0.67 / -4.3%
tpcds_q71/duckdb:parquet	21241985 / 21354271 / -0.5%	34966569 / 36540349 / -4.3%	0.61 / 0.58 / +4.0%
tpcds_q72/duckdb:parquet	191347534 / 137375013 / +39.3% 🔴	138563485 / 132076477 / +4.9%	1.38 / 1.04 / +32.8%
tpcds_q73/duckdb:parquet	18191990 / 18923700 / -3.9%	33152163 / 30897373 / +7.3%	0.55 / 0.61 / -10.4%
tpcds_q74/duckdb:parquet	143153374 / 143796922 / -0.4%	162051921 / 163841903 / -1.1%	0.88 / 0.88 / +0.7%
tpcds_q75/duckdb:parquet	59940836 / 60649325 / -1.2%	80160494 / 78464548 / +2.2%	0.75 / 0.77 / -3.3%
tpcds_q76/duckdb:parquet	20381842 / 19691440 / +3.5%	31604832 / 32756167 / -3.5%	0.64 / 0.60 / +7.3%
tpcds_q77/duckdb:parquet	25318412 / 26311492 / -3.8%	39569291 / 37704425 / +4.9%	0.64 / 0.70 / -8.3%
tpcds_q78/duckdb:parquet	77532800 / 79396390 / -2.3%	90015108 / 91689625 / -1.8%	0.86 / 0.87 / -0.5%
tpcds_q79/duckdb:parquet	33154440 / 28433130 / +16.6% 🔴	47680773 / 44883428 / +6.2%	0.70 / 0.63 / +9.8%
tpcds_q80/duckdb:parquet	46506997 / 47558644 / -2.2%	60439790 / 59814308 / +1.0%	0.77 / 0.80 / -3.2%
tpcds_q81/duckdb:parquet	42149186 / 40012692 / +5.3%	61182141 / 61280559 / -0.2%	0.69 / 0.65 / +5.5%
tpcds_q82/duckdb:parquet	19072694 / 19826073 / -3.8%	32984318 / 33528395 / -1.6%	0.58 / 0.59 / -2.2%
tpcds_q83/duckdb:parquet	22145956 / 22506323 / -1.6%	31860025 / 33312598 / -4.4%	0.70 / 0.68 / +2.9%
tpcds_q84/duckdb:parquet	23470331 / 23948001 / -2.0%	34625235 / 33869225 / +2.2%	0.68 / 0.71 / -4.1%
tpcds_q85/duckdb:parquet	47615236 / 47282280 / +0.7%	64590028 / 64848019 / -0.4%	0.74 / 0.73 / +1.1%
tpcds_q86/duckdb:parquet	15149228 / 15234342 / -0.6%	26927997 / 26571600 / +1.3%	0.56 / 0.57 / -1.9%
tpcds_q87/duckdb:parquet	43673972 / 44802522 / -2.5%	57170424 / 54922829 / +4.1%	0.76 / 0.82 / -6.4%
tpcds_q88/duckdb:parquet	43671109 / 42238239 / +3.4%	54160874 / 53209457 / +1.8%	0.81 / 0.79 / +1.6%
tpcds_q89/duckdb:parquet	20713996 / 18158836 / +14.1% 🔴	33364545 / 32043077 / +4.1%	0.62 / 0.57 / +9.6%
tpcds_q90/duckdb:parquet	10277166 / 10090460 / +1.9%	23007071 / 20634556 / +11.5% 🔴	0.45 / 0.49 / -8.7%
tpcds_q91/duckdb:parquet	27844821 / 27080022 / +2.8%	41873731 / 41526195 / +0.8%	0.66 / 0.65 / +2.0%
tpcds_q92/duckdb:parquet	15787630 / 15432522 / +2.3%	27229977 / 26692712 / +2.0%	0.58 / 0.58 / +0.3%
tpcds_q93/duckdb:parquet	31209174 / 30933074 / +0.9%	47437849 / 47831610 / -0.8%	0.66 / 0.65 / +1.7%
tpcds_q94/duckdb:parquet	21633066 / 21587280 / +0.2%	35052202 / 35884856 / -2.3%	0.62 / 0.60 / +2.6%
tpcds_q95/duckdb:parquet	138653539 / 137266974 / +1.0%	148216599 / 152392733 / -2.7%	0.94 / 0.90 / +3.9%
tpcds_q96/duckdb:parquet	10023170 / 10706071 / -6.4%	17283959 / 17514736 / -1.3%	0.58 / 0.61 / -5.1%
tpcds_q97/duckdb:parquet	38641262 / 40130090 / -3.7%	53312918 / 50576167 / +5.4%	0.72 / 0.79 / -8.7%
tpcds_q98/duckdb:parquet	22294284 / 21539559 / +3.5%	33093014 / 35190253 / -6.0%	0.67 / 0.61 / +10.1%
tpcds_q99/duckdb:parquet	29337096 / 24215548 / +21.1% 🔴	33072496 / 33805990 / -2.2%	0.89 / 0.72 / +23.8%

File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)

File	Scale	Format	Base	Change	%
call_center.vortex	1.0	vortex-compact	46.28 KB	46.28 KB	-100.0%
catalog_page.vortex	1.0	vortex-compact	361.51 KB	361.51 KB	-100.0%
catalog_returns.vortex	1.0	vortex-compact	6.04 MB	6.04 MB	-100.0%
catalog_sales.vortex	1.0	vortex-compact	59.45 MB	59.45 MB	-100.0%
customer.vortex	1.0	vortex-compact	3.29 MB	3.29 MB	-100.0%
customer_address.vortex	1.0	vortex-compact	638.37 KB	638.37 KB	-100.0%
customer_demographics.vortex	1.0	vortex-compact	422.35 KB	422.35 KB	-100.0%
date_dim.vortex	1.0	vortex-compact	136.00 KB	136.00 KB	-100.0%
duckdb.db	1.0	vortex-compact	268.00 KB	268.00 KB	-100.0%
household_demographics.vortex	1.0	vortex-compact	9.90 KB	9.90 KB	-100.0%
income_band.vortex	1.0	vortex-compact	5.31 KB	5.31 KB	-100.0%
inventory.vortex	1.0	vortex-compact	16.06 MB	16.06 MB	-100.0%
item.vortex	1.0	vortex-compact	998.45 KB	998.45 KB	-100.0%
promotion.vortex	1.0	vortex-compact	49.62 KB	49.62 KB	-100.0%
reason.vortex	1.0	vortex-compact	5.96 KB	5.96 KB	-100.0%
ship_mode.vortex	1.0	vortex-compact	10.74 KB	10.74 KB	-100.0%
store.vortex	1.0	vortex-compact	42.16 KB	42.16 KB	-100.0%
store_returns.vortex	1.0	vortex-compact	9.36 MB	9.36 MB	-100.0%
store_sales.vortex	1.0	vortex-compact	78.09 MB	78.09 MB	-100.0%
time_dim.vortex	1.0	vortex-compact	95.41 KB	95.41 KB	-100.0%
warehouse.vortex	1.0	vortex-compact	21.88 KB	21.88 KB	-100.0%
web_page.vortex	1.0	vortex-compact	24.09 KB	24.09 KB	-100.0%
web_returns.vortex	1.0	vortex-compact	2.99 MB	2.99 MB	-100.0%
web_sales.vortex	1.0	vortex-compact	29.43 MB	29.43 MB	-100.0%
web_site.vortex	1.0	vortex-compact	41.37 KB	41.37 KB	-100.0%

Totals:

vortex-compact: 207.80 MB → 0 B (-100.0%)
vortex-file-compressed: 269.78 MB → 269.78 MB (0.0%)

github-actions · 2026-08-25T10:46:16Z

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 6554a829 vs base 17bd9e27
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (+2.0%, environment too noisy confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.991x ➖
Parquet (geomean): hot 0.994x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.6% · Median polish +0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	331713539 / 331061098 / +0.2%	462898339 / 472294928 / -2.0%	0.72 / 0.70 / +2.2%
tpch_q02/datafusion:vortex-file-compressed	98405474 / 100367923 / -2.0%	178594603 / 173412875 / +3.0%	0.55 / 0.58 / -4.8%
tpch_q03/datafusion:vortex-file-compressed	148406471 / 149974545 / -1.0%	259530076 / 280141632 / -7.4%	0.57 / 0.54 / +6.8%
tpch_q04/datafusion:vortex-file-compressed	64380927 / 64115224 / +0.4%	138639030 / 137171239 / +1.1%	0.46 / 0.47 / -0.6%
tpch_q05/datafusion:vortex-file-compressed	262960878 / 261530921 / +0.5%	421194429 / 464991030 / -9.4%	0.62 / 0.56 / +11.0%
tpch_q06/datafusion:vortex-file-compressed	24074634 / 24586998 / -2.1%	128154701 / 126326109 / +1.4%	0.19 / 0.19 / -3.5%
tpch_q07/datafusion:vortex-file-compressed	346159771 / 343811693 / +0.7%	458719453 / 499088070 / -8.1%	0.75 / 0.69 / +9.5%
tpch_q08/datafusion:vortex-file-compressed	268971614 / 282744713 / -4.9%	425242483 / 421706509 / +0.8%	0.63 / 0.67 / -5.7%
tpch_q09/datafusion:vortex-file-compressed	466845497 / 464333576 / +0.5%	610795771 / 613621189 / -0.5%	0.76 / 0.76 / +1.0%
tpch_q10/datafusion:vortex-file-compressed	165970209 / 166788559 / -0.5%	301961461 / 332751689 / -9.3%	0.55 / 0.50 / +9.7%
tpch_q11/datafusion:vortex-file-compressed	72071132 / 70870204 / +1.7%	125364818 / 128311598 / -2.3%	0.57 / 0.55 / +4.1%
tpch_q12/datafusion:vortex-file-compressed	79782690 / 82420447 / -3.2%	162381399 / 171237243 / -5.2%	0.49 / 0.48 / +2.1%
tpch_q13/datafusion:vortex-file-compressed	114899203 / 114767036 / +0.1%	182752765 / 177526631 / +2.9%	0.63 / 0.65 / -2.7%
tpch_q14/datafusion:vortex-file-compressed	40556576 / 39639991 / +2.3%	165163742 / 173248222 / -4.7%	0.25 / 0.23 / +7.3%
tpch_q15/datafusion:vortex-file-compressed	69526556 / 69634507 / -0.2%	199668376 / 186960854 / +6.8%	0.35 / 0.37 / -6.5%
tpch_q16/datafusion:vortex-file-compressed	64281486 / 64558698 / -0.4%	131631320 / 135251483 / -2.7%	0.49 / 0.48 / +2.3%
tpch_q17/datafusion:vortex-file-compressed	408384620 / 399893291 / +2.1%	504855766 / 514513644 / -1.9%	0.81 / 0.78 / +4.1%
tpch_q18/datafusion:vortex-file-compressed	619602201 / 602347893 / +2.9%	780704897 / 779804479 / +0.1%	0.79 / 0.77 / +2.7%
tpch_q19/datafusion:vortex-file-compressed	54114545 / 54524229 / -0.8%	168172366 / 180145065 / -6.6%	0.32 / 0.30 / +6.3%
tpch_q20/datafusion:vortex-file-compressed	130059791 / 130265851 / -0.2%	262537044 / 251728384 / +4.3%	0.50 / 0.52 / -4.3%
tpch_q21/datafusion:vortex-file-compressed	426374975 / 443958179 / -4.0%	557971323 / 569219283 / -2.0%	0.76 / 0.78 / -2.0%
tpch_q22/datafusion:vortex-file-compressed	40102545 / 39015921 / +2.8%	97471288 / 92860266 / +5.0%	0.41 / 0.42 / -2.1%

datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	323462354 / 320677621 / +0.9%	419958535 / 416266334 / +0.9%	0.77 / 0.77 / -0.0%
tpch_q02/datafusion:parquet	212647581 / 210431375 / +1.1%	295178742 / 311028862 / -5.1%	0.72 / 0.68 / +6.5%
tpch_q03/datafusion:parquet	223723283 / 222048525 / +0.8%	361773816 / 354461172 / +2.1%	0.62 / 0.63 / -1.3%
tpch_q04/datafusion:parquet	96185528 / 93883824 / +2.5%	192554683 / 191632087 / +0.5%	0.50 / 0.49 / +2.0%
tpch_q05/datafusion:parquet	354860444 / 354502086 / +0.1%	517498516 / 508067653 / +1.9%	0.69 / 0.70 / -1.7%
tpch_q06/datafusion:parquet	64867401 / 63089986 / +2.8%	169560840 / 172421682 / -1.7%	0.38 / 0.37 / +4.6%
tpch_q07/datafusion:parquet	493202003 / 492929649 / +0.1%	677467284 / 663570680 / +2.1%	0.73 / 0.74 / -2.0%
tpch_q08/datafusion:parquet	397975744 / 395559351 / +0.6%	573453236 / 559911168 / +2.4%	0.69 / 0.71 / -1.8%
tpch_q09/datafusion:parquet	651329545 / 653997386 / -0.4%	840138295 / 834549146 / +0.7%	0.78 / 0.78 / -1.1%
tpch_q10/datafusion:parquet	517576242 / 513450529 / +0.8%	689889891 / 703305271 / -1.9%	0.75 / 0.73 / +2.8%
tpch_q11/datafusion:parquet	145230868 / 137722121 / +5.5%	210164399 / 200432979 / +4.9%	0.69 / 0.69 / +0.6%
tpch_q12/datafusion:parquet	142262352 / 142107534 / +0.1%	250645759 / 258926625 / -3.2%	0.57 / 0.55 / +3.4%
tpch_q13/datafusion:parquet	343298966 / 345397567 / -0.6%	425331075 / 415915928 / +2.3%	0.81 / 0.83 / -2.8%
tpch_q14/datafusion:parquet	115525873 / 114583561 / +0.8%	245706580 / 246849134 / -0.5%	0.47 / 0.46 / +1.3%
tpch_q15/datafusion:parquet	176117605 / 177614994 / -0.8%	293554243 / 283117464 / +3.7%	0.60 / 0.63 / -4.4%
tpch_q16/datafusion:parquet	127190246 / 131792056 / -3.5%	220689464 / 207055985 / +6.6%	0.58 / 0.64 / -9.5%
tpch_q17/datafusion:parquet	484276698 / 485407636 / -0.2%	616947192 / 623027898 / -1.0%	0.78 / 0.78 / +0.8%
tpch_q18/datafusion:parquet	676011989 / 691385416 / -2.2%	831695950 / 856398798 / -2.9%	0.81 / 0.81 / +0.7%
tpch_q19/datafusion:parquet	182864942 / 183723926 / -0.5%	319952503 / 325000448 / -1.6%	0.57 / 0.57 / +1.1%
tpch_q20/datafusion:parquet	290247276 / 292935324 / -0.9%	430547523 / 427669089 / +0.7%	0.67 / 0.68 / -1.6%
tpch_q21/datafusion:parquet	534964004 / 533781978 / +0.2%	677250316 / 671426738 / +0.9%	0.79 / 0.79 / -0.6%
tpch_q22/datafusion:parquet	238630575 / 237956603 / +0.3%	325160163 / 338596710 / -4.0%	0.73 / 0.70 / +4.4%

duckdb / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	103145049 / 101301332 / +1.8%	201521776 / 201610109 / -0.0%	0.51 / 0.50 / +1.9%
tpch_q02/duckdb:vortex-file-compressed	67243619 / 67318575 / -0.1%	121065708 / 115323059 / +5.0%	0.56 / 0.58 / -4.8%
tpch_q03/duckdb:vortex-file-compressed	131464888 / 132492539 / -0.8%	249715082 / 239720260 / +4.2%	0.53 / 0.55 / -4.7%
tpch_q04/duckdb:vortex-file-compressed	169519220 / 175094506 / -3.2%	242528142 / 263088640 / -7.8%	0.70 / 0.67 / +5.0%
tpch_q05/duckdb:vortex-file-compressed	141064302 / 143613800 / -1.8%	251957483 / 247664945 / +1.7%	0.56 / 0.58 / -3.4%
tpch_q06/duckdb:vortex-file-compressed	36238018 / 36864469 / -1.7%	140317332 / 139571317 / +0.5%	0.26 / 0.26 / -2.2%
tpch_q07/duckdb:vortex-file-compressed	125104685 / 127729162 / -2.1%	309406814 / 286690302 / +7.9%	0.40 / 0.45 / -9.2%
tpch_q08/duckdb:vortex-file-compressed	174195867 / 170978533 / +1.9%	285912948 / 286100983 / -0.1%	0.61 / 0.60 / +1.9%
tpch_q09/duckdb:vortex-file-compressed	307526793 / 304009548 / +1.2%	410846874 / 443028353 / -7.3%	0.75 / 0.69 / +9.1%
tpch_q10/duckdb:vortex-file-compressed	228032732 / 213242736 / +6.9%	395169516 / 374772246 / +5.4%	0.58 / 0.57 / +1.4%
tpch_q11/duckdb:vortex-file-compressed	40766613 / 40854134 / -0.2%	97846669 / 90929582 / +7.6%	0.42 / 0.45 / -7.3%
tpch_q12/duckdb:vortex-file-compressed	111662814 / 108748775 / +2.7%	185001131 / 206461760 / -10.4% 🟢	0.60 / 0.53 / +14.6%
tpch_q13/duckdb:vortex-file-compressed	195399408 / 192664023 / +1.4%	285664905 / 305376167 / -6.5%	0.68 / 0.63 / +8.4%
tpch_q14/duckdb:vortex-file-compressed	55306209 / 53921021 / +2.6%	172134591 / 176177351 / -2.3%	0.32 / 0.31 / +5.0%
tpch_q15/duckdb:vortex-file-compressed	80993224 / 81547881 / -0.7%	192874505 / 185648715 / +3.9%	0.42 / 0.44 / -4.4%
tpch_q16/duckdb:vortex-file-compressed	84686261 / 84739359 / -0.1%	129106090 / 134329515 / -3.9%	0.66 / 0.63 / +4.0%
tpch_q17/duckdb:vortex-file-compressed	110304603 / 108071619 / +2.1%	271777233 / 269266539 / +0.9%	0.41 / 0.40 / +1.1%
tpch_q18/duckdb:vortex-file-compressed	263121723 / 260095610 / +1.2%	337118942 / 313078004 / +7.7%	0.78 / 0.83 / -6.1%
tpch_q19/duckdb:vortex-file-compressed	90592730 / 84758957 / +6.9%	221441398 / 197324446 / +12.2% 🔴	0.41 / 0.43 / -4.8%
tpch_q20/duckdb:vortex-file-compressed	138205017 / 140816321 / -1.9%	258096164 / 267682598 / -3.6%	0.54 / 0.53 / +1.8%
tpch_q21/duckdb:vortex-file-compressed	491779905 / 505716267 / -2.8%	572360265 / 585117748 / -2.2%	0.86 / 0.86 / -0.6%
tpch_q22/duckdb:vortex-file-compressed	72058941 / 72526520 / -0.6%	120444066 / 132285300 / -9.0%	0.60 / 0.55 / +9.1%

duckdb / parquet / ns (0.986x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	101703836 / 139512585 / -27.1% 🟢	193837906 / 183352013 / +5.7%	0.52 / 0.76 / -31.0%
tpch_q02/duckdb:parquet	101213619 / 100815057 / +0.4%	120787972 / 122117976 / -1.1%	0.84 / 0.83 / +1.5%
tpch_q03/duckdb:parquet	166374323 / 164181868 / +1.3%	222505652 / 224854329 / -1.0%	0.75 / 0.73 / +2.4%
tpch_q04/duckdb:parquet	118621581 / 118412358 / +0.2%	162853261 / 150503218 / +8.2%	0.73 / 0.79 / -7.4%
tpch_q05/duckdb:parquet	185756893 / 184953968 / +0.4%	264927519 / 264055391 / +0.3%	0.70 / 0.70 / +0.1%
tpch_q06/duckdb:parquet	59979495 / 59195397 / +1.3%	94039458 / 92327523 / +1.9%	0.64 / 0.64 / -0.5%
tpch_q07/duckdb:parquet	149957936 / 150165030 / -0.1%	227376531 / 231313261 / -1.7%	0.66 / 0.65 / +1.6%
tpch_q08/duckdb:parquet	217426134 / 218331028 / -0.4%	318700863 / 303076756 / +5.2%	0.68 / 0.72 / -5.3%
tpch_q09/duckdb:parquet	343835951 / 352218813 / -2.4%	433246594 / 432261934 / +0.2%	0.79 / 0.81 / -2.6%
tpch_q10/duckdb:parquet	651616006 / 659339177 / -1.2%	734547158 / 729966814 / +0.6%	0.89 / 0.90 / -1.8%
tpch_q11/duckdb:parquet	41542478 / 41287359 / +0.6%	54096562 / 54641196 / -1.0%	0.77 / 0.76 / +1.6%
tpch_q12/duckdb:parquet	121365670 / 118088309 / +2.8%	162662909 / 160443551 / +1.4%	0.75 / 0.74 / +1.4%
tpch_q13/duckdb:parquet	396552689 / 394469456 / +0.5%	431600030 / 425436964 / +1.4%	0.92 / 0.93 / -0.9%
tpch_q14/duckdb:parquet	153309493 / 150363810 / +2.0%	214848588 / 221667756 / -3.1%	0.71 / 0.68 / +5.2%
tpch_q15/duckdb:parquet	73838062 / 78995444 / -6.5%	122521490 / 124942277 / -1.9%	0.60 / 0.63 / -4.7%
tpch_q16/duckdb:parquet	155079147 / 154068593 / +0.7%	172805037 / 172960187 / -0.1%	0.90 / 0.89 / +0.7%
tpch_q17/duckdb:parquet	127779368 / 126771569 / +0.8%	193222431 / 196653014 / -1.7%	0.66 / 0.64 / +2.6%
tpch_q18/duckdb:parquet	293116990 / 295503318 / -0.8%	257893388 / 288004292 / -10.5% 🟢	1.14 / 1.03 / +10.8%
tpch_q19/duckdb:parquet	239697875 / 243656991 / -1.6%	307026462 / 322688771 / -4.9%	0.78 / 0.76 / +3.4%
tpch_q20/duckdb:parquet	197714465 / 197858105 / -0.1%	302930721 / 276691308 / +9.5%	0.65 / 0.72 / -8.7%
tpch_q21/duckdb:parquet	440879068 / 433456687 / +1.7%	481573997 / 459871400 / +4.7%	0.92 / 0.94 / -2.9%
tpch_q22/duckdb:parquet	336846782 / 334524172 / +0.7%	360705778 / 361299955 / -0.2%	0.93 / 0.93 / +0.9%

File Size Changes (9 files changed, -44.0% overall, 0↑ 9↓)

File	Scale	Format	Base	Change	%
customer.vortex	10.0	vortex-compact	74.00 MB	74.00 MB	-100.0%
duckdb.db	10.0	vortex-compact	268.00 KB	268.00 KB	-100.0%
lineitem.vortex	10.0	vortex-compact	1.28 GB	1.28 GB	-100.0%
nation.vortex	10.0	vortex-compact	7.68 KB	7.68 KB	-100.0%
orders.vortex	10.0	vortex-compact	344.29 MB	344.29 MB	-100.0%
part.vortex	10.0	vortex-compact	35.89 MB	35.89 MB	-100.0%
partsupp.vortex	10.0	vortex-compact	203.66 MB	203.66 MB	-100.0%
region.vortex	10.0	vortex-compact	5.87 KB	5.87 KB	-100.0%
supplier.vortex	10.0	vortex-compact	4.73 MB	4.73 MB	-100.0%

Totals:

vortex-compact: 1.92 GB → 0 B (-100.0%)
vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

github-actions · 2026-08-25T10:46:37Z

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 6554a829 vs base 17bd9e27
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.2%
Engines: DuckDB No clear signal (+5.2%, low confidence)
Vortex (geomean): hot 1.048x ➖ · cold 1.065x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.998x ➖
Shifts: Parquet (control) -0.4% · Median polish -1.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.048x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed	15961189 / 17010972 / -6.2%	26810599 / 26013169 / +3.1%	0.60 / 0.65 / -9.0%
statpopgen_q01/duckdb:vortex-file-compressed	17243992 / 17573588 / -1.9%	32040149 / 31170965 / +2.8%	0.54 / 0.56 / -4.5%
statpopgen_q02/duckdb:vortex-file-compressed	547636599 / 563316972 / -2.8%	601905050 / 749189868 / -19.7% 🟢	0.91 / 0.75 / +21.0%
statpopgen_q03/duckdb:vortex-file-compressed	1741976180 / 1165991846 / +49.4% 🔴	1322406519 / 1211472602 / +9.2%	1.32 / 0.96 / +36.9%
statpopgen_q04/duckdb:vortex-file-compressed	1544730352 / 1200469462 / +28.7% 🔴	1743181550 / 1225243566 / +42.3% 🔴	0.89 / 0.98 / -9.6%
statpopgen_q05/duckdb:vortex-file-compressed	568075638 / 562105308 / +1.1%	630547202 / 636580744 / -0.9%	0.90 / 0.88 / +2.0%
statpopgen_q06/duckdb:vortex-file-compressed	1853717740 / 1992470306 / -7.0%	2680638026 / 2226445744 / +20.4% 🔴	0.69 / 0.89 / -22.7%
statpopgen_q07/duckdb:vortex-file-compressed	236364020 / 260005199 / -9.1%	284183917 / 417075608 / -31.9% 🟢	0.83 / 0.62 / +33.4%
statpopgen_q08/duckdb:vortex-file-compressed	275352540 / 262755126 / +4.8%	443626153 / 328988048 / +34.8% 🔴	0.62 / 0.80 / -22.3%
statpopgen_q09/duckdb:vortex-file-compressed	970926790 / 1054706262 / -7.9%	1339036630 / 978027847 / +36.9% 🔴	0.73 / 1.08 / -32.8%
statpopgen_q10/duckdb:vortex-file-compressed	4386611810 / 3715121578 / +18.1% 🔴	4304568929 / 4261044445 / +1.0%	1.02 / 0.87 / +16.9%

duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet	376360209 / 378375662 / -0.5%	378511782 / 377619352 / +0.2%	0.99 / 1.00 / -0.8%
statpopgen_q01/duckdb:parquet	466030845 / 467249614 / -0.3%	471826519 / 474451977 / -0.6%	0.99 / 0.98 / +0.3%
statpopgen_q02/duckdb:parquet	772290931 / 777154900 / -0.6%	801626381 / 809731982 / -1.0%	0.96 / 0.96 / +0.4%
statpopgen_q03/duckdb:parquet	1049294274 / 1057795894 / -0.8%	1084942668 / 1094037371 / -0.8%	0.97 / 0.97 / +0.0%
statpopgen_q04/duckdb:parquet	1057115695 / 1059491340 / -0.2%	1111697886 / 1104146659 / +0.7%	0.95 / 0.96 / -0.9%
statpopgen_q05/duckdb:parquet	780716850 / 771493101 / +1.2%	824237767 / 813081945 / +1.4%	0.95 / 0.95 / -0.2%
statpopgen_q06/duckdb:parquet	1018053642 / 1029100589 / -1.1%	1049978192 / 1071441896 / -2.0%	0.97 / 0.96 / +0.9%
statpopgen_q07/duckdb:parquet	940627646 / 943963848 / -0.4%	1076124896 / 1129027652 / -4.7%	0.87 / 0.84 / +4.5%
statpopgen_q08/duckdb:parquet	968682540 / 972722533 / -0.4%	1105736781 / 1054881008 / +4.8%	0.88 / 0.92 / -5.0%
statpopgen_q09/duckdb:parquet	1007483084 / 1002963831 / +0.5%	1070028711 / 1055812330 / +1.3%	0.94 / 0.95 / -0.9%
statpopgen_q10/duckdb:parquet	1645488286 / 1670969826 / -1.5%	1692911868 / 1709415483 / -1.0%	0.97 / 0.98 / -0.6%

File Size Changes (2 files changed, -32.3% overall, 0↑ 2↓)

File	Scale	Format	Base	HEAD	Change	%
duckdb.db	100000	vortex-compact	268.00 KB	0 B	268.00 KB	-100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex	100000	vortex-compact	960.56 MB	0 B	960.56 MB	-100.0%

Totals:

vortex-compact: 960.82 MB → 0 B (-100.0%)
vortex-file-compressed: 1.96 GB → 1.96 GB (0.0%)

github-actions · 2026-08-25T10:46:57Z

Benchmarks: FineWeb S3 📖

Commits: PR 6554a829 vs base 17bd9e27
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.8%
Engines: DataFusion No clear signal (+2.1%, environment too noisy confidence) · DuckDB No clear signal (-7.5%, environment too noisy confidence)
Vortex (geomean): hot 1.008x ➖ · cold 1.078x ➖
Parquet (geomean): hot 1.037x ➖ · cold 1.004x ➖
Shifts: Parquet (control) +3.7% · Median polish +0.7%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.040x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	47758290 / 41869142 / +14.1%	187928395 / 149077876 / +26.1%	0.25 / 0.28 / -9.5%
fineweb_q01/datafusion:vortex-file-compressed	535877074 / 489987425 / +9.4%	640670003 / 590951710 / +8.4%	0.84 / 0.83 / +0.9%
fineweb_q02/datafusion:vortex-file-compressed	371811289 / 375567552 / -1.0%	404802682 / 395418981 / +2.4%	0.92 / 0.95 / -3.3%
fineweb_q03/datafusion:vortex-file-compressed	608646690 / 804432996 / -24.3%	4071316178 / 685951146 / +493.5% 🔴	0.15 / 1.17 / -87.3%
fineweb_q04/datafusion:vortex-file-compressed	623694728 / 675068572 / -7.6%	450138073 / 618036362 / -27.2%	1.39 / 1.09 / +26.9%
fineweb_q05/datafusion:vortex-file-compressed	583646816 / 576668206 / +1.2%	630759503 / 449833415 / +40.2% 🔴	0.93 / 1.28 / -27.8%
fineweb_q06/datafusion:vortex-file-compressed	701707296 / 671116628 / +4.6%	851787426 / 877115752 / -2.9%	0.82 / 0.77 / +7.7%
fineweb_q07/datafusion:vortex-file-compressed	489443668 / 472588250 / +3.6%	435524680 / 511741200 / -14.9%	1.12 / 0.92 / +21.7%
fineweb_q08/datafusion:vortex-file-compressed	275624256 / 183287625 / +50.4% 🔴	209112500 / 208540858 / +0.3%	1.32 / 0.88 / +50.0%

datafusion / parquet / ns (1.019x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	496721962 / 486926808 / +2.0%	979470754 / 940109530 / +4.2%	0.51 / 0.52 / -2.1%
fineweb_q01/datafusion:parquet	969283528 / 873858021 / +10.9%	972833565 / 899759358 / +8.1%	1.00 / 0.97 / +2.6%
fineweb_q02/datafusion:parquet	911745881 / 926577236 / -1.6%	1019365382 / 1087544885 / -6.3%	0.89 / 0.85 / +5.0%
fineweb_q03/datafusion:parquet	847550828 / 920037554 / -7.9%	906264766 / 968401036 / -6.4%	0.94 / 0.95 / -1.6%
fineweb_q04/datafusion:parquet	907154509 / 944307504 / -3.9%	940299071 / 970866299 / -3.1%	0.96 / 0.97 / -0.8%
fineweb_q05/datafusion:parquet	867443526 / 895627850 / -3.1%	926771440 / 928276843 / -0.2%	0.94 / 0.96 / -3.0%
fineweb_q06/datafusion:parquet	956359692 / 789582874 / +21.1%	949408149 / 860337036 / +10.4%	1.01 / 0.92 / +9.8%
fineweb_q07/datafusion:parquet	885108193 / 900508938 / -1.7%	913267312 / 880119549 / +3.8%	0.97 / 1.02 / -5.3%
fineweb_q08/datafusion:parquet	974508967 / 935355402 / +4.2%	957330584 / 901172387 / +6.2%	1.02 / 1.04 / -1.9%

duckdb / vortex-file-compressed / ns (0.977x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	85340200 / 71341772 / +19.6%	94074725 / 112612280 / -16.5%	0.91 / 0.63 / +43.2%
fineweb_q01/duckdb:vortex-file-compressed	573363105 / 541224580 / +5.9%	610800588 / 674754283 / -9.5%	0.94 / 0.80 / +17.0%
fineweb_q02/duckdb:vortex-file-compressed	656987296 / 656872148 / +0.0%	738930153 / 680693395 / +8.6%	0.89 / 0.97 / -7.9%
fineweb_q03/duckdb:vortex-file-compressed	1449255042 / 1493197992 / -2.9%	1596156365 / 1939906918 / -17.7%	0.91 / 0.77 / +18.0%
fineweb_q04/duckdb:vortex-file-compressed	1627010287 / 2343336152 / -30.6% 🟢	1673226431 / 1874364996 / -10.7%	0.97 / 1.25 / -22.2%
fineweb_q05/duckdb:vortex-file-compressed	1525776358 / 1461905930 / +4.4%	1564127737 / 1404934255 / +11.3%	0.98 / 1.04 / -6.3%
fineweb_q06/duckdb:vortex-file-compressed	1600030620 / 1665411058 / -3.9%	1566758102 / 1774183978 / -11.7%	1.02 / 0.94 / +8.8%
fineweb_q07/duckdb:vortex-file-compressed	1445592661 / 1458968952 / -0.9%	1523370171 / 1569701084 / -3.0%	0.95 / 0.93 / +2.1%
fineweb_q08/duckdb:vortex-file-compressed	626959550 / 658132794 / -4.7%	670281344 / 706837200 / -5.2%	0.94 / 0.93 / +0.5%

duckdb / parquet / ns (1.055x ➖, 1↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	2846070286 / 5276749156 / -46.1% 🟢	523861374 / 584865965 / -10.4%	5.43 / 9.02 / -39.8%
fineweb_q01/duckdb:parquet	5321043334 / 5313765068 / +0.1%	651148128 / 651788031 / -0.1%	8.17 / 8.15 / +0.2%
fineweb_q02/duckdb:parquet	5342302534 / 2951257341 / +81.0% 🔴	818239049 / 784925939 / +4.2%	6.53 / 3.76 / +73.6%
fineweb_q03/duckdb:parquet	5350994588 / 5342193500 / +0.2%	1425955292 / 1194612194 / +19.4%	3.75 / 4.47 / -16.1%
fineweb_q04/duckdb:parquet	5283337896 / 5316274022 / -0.6%	807382352 / 877716116 / -8.0%	6.54 / 6.06 / +8.0%
fineweb_q05/duckdb:parquet	5299400726 / 5310266357 / -0.2%	897278858 / 868492118 / +3.3%	5.91 / 6.11 / -3.4%
fineweb_q06/duckdb:parquet	5403027045 / 5414540010 / -0.2%	1437094382 / 1516893813 / -5.3%	3.76 / 3.57 / +5.3%
fineweb_q07/duckdb:parquet	5348397006 / 3196381662 / +67.3% 🔴	966453011 / 997540187 / -3.1%	5.53 / 3.20 / +72.7%
fineweb_q08/duckdb:parquet	5264910929 / 5256109656 / +0.2%	531604097 / 556984957 / -4.6%	9.90 / 9.44 / +4.9%

github-actions · 2026-08-25T10:47:14Z

Benchmarks: Clickbench on NVME 📖

Commits: PR 6554a829 vs base 17bd9e27
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (+1.1%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 0.999x ➖
Parquet (geomean): hot 0.994x ➖ · cold 1.001x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.5%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed	1876834 / 1878295 / -0.1%	36297420 / 37837417 / -4.1%	0.05 / 0.05 / +4.2%
clickbench_q01/datafusion:vortex-file-compressed	11029230 / 10978231 / +0.5%	59042869 / 56785901 / +4.0%	0.19 / 0.19 / -3.4%
clickbench_q02/datafusion:vortex-file-compressed	21745490 / 22443348 / -3.1%	71929113 / 70752220 / +1.7%	0.30 / 0.32 / -4.7%
clickbench_q03/datafusion:vortex-file-compressed	24912023 / 25127438 / -0.9%	95165020 / 94429675 / +0.8%	0.26 / 0.27 / -1.6%
clickbench_q04/datafusion:vortex-file-compressed	157286849 / 154350955 / +1.9%	229443406 / 231030090 / -0.7%	0.69 / 0.67 / +2.6%
clickbench_q05/datafusion:vortex-file-compressed	210136698 / 207158198 / +1.4%	288647726 / 291245431 / -0.9%	0.73 / 0.71 / +2.4%
clickbench_q06/datafusion:vortex-file-compressed	1859702 / 1977258 / -5.9%	38084331 / 37168847 / +2.5%	0.05 / 0.05 / -8.2%
clickbench_q07/datafusion:vortex-file-compressed	14857796 / 14737883 / +0.8%	61447156 / 61141987 / +0.5%	0.24 / 0.24 / +0.3%
clickbench_q08/datafusion:vortex-file-compressed	211660062 / 211375395 / +0.1%	300775861 / 298825536 / +0.7%	0.70 / 0.71 / -0.5%
clickbench_q09/datafusion:vortex-file-compressed	333483595 / 327686686 / +1.8%	415185547 / 428067747 / -3.0%	0.80 / 0.77 / +4.9%
clickbench_q10/datafusion:vortex-file-compressed	47890294 / 47537698 / +0.7%	119909536 / 121485641 / -1.3%	0.40 / 0.39 / +2.1%
clickbench_q11/datafusion:vortex-file-compressed	57035278 / 55596064 / +2.6%	128820443 / 125725631 / +2.5%	0.44 / 0.44 / +0.1%
clickbench_q12/datafusion:vortex-file-compressed	191301586 / 188924566 / +1.3%	282856189 / 285885800 / -1.1%	0.68 / 0.66 / +2.3%
clickbench_q13/datafusion:vortex-file-compressed	331715624 / 334726288 / -0.9%	445849727 / 448412911 / -0.6%	0.74 / 0.75 / -0.3%
clickbench_q14/datafusion:vortex-file-compressed	190898902 / 190633179 / +0.1%	279754585 / 291483929 / -4.0%	0.68 / 0.65 / +4.3%
clickbench_q15/datafusion:vortex-file-compressed	178690842 / 179462290 / -0.4%	259523788 / 260077531 / -0.2%	0.69 / 0.69 / -0.2%
clickbench_q16/datafusion:vortex-file-compressed	461064954 / 453910068 / +1.6%	585901404 / 568370792 / +3.1%	0.79 / 0.80 / -1.5%
clickbench_q17/datafusion:vortex-file-compressed	459941963 / 466918578 / -1.5%	577192592 / 576636786 / +0.1%	0.80 / 0.81 / -1.6%
clickbench_q18/datafusion:vortex-file-compressed	886264172 / 898063148 / -1.3%	986628240 / 997001788 / -1.0%	0.90 / 0.90 / -0.3%
clickbench_q19/datafusion:vortex-file-compressed	16478594 / 16446609 / +0.2%	86034808 / 87236295 / -1.4%	0.19 / 0.19 / +1.6%
clickbench_q20/datafusion:vortex-file-compressed	178767388 / 180702004 / -1.1%	382845788 / 377984792 / +1.3%	0.47 / 0.48 / -2.3%
clickbench_q21/datafusion:vortex-file-compressed	247714861 / 249765079 / -0.8%	474123559 / 473204416 / +0.2%	0.52 / 0.53 / -1.0%
clickbench_q22/datafusion:vortex-file-compressed	322293726 / 323975688 / -0.5%	605279571 / 611897993 / -1.1%	0.53 / 0.53 / +0.6%
clickbench_q23/datafusion:vortex-file-compressed	409850156 / 411524286 / -0.4%	716994511 / 669112730 / +7.2%	0.57 / 0.62 / -7.1%
clickbench_q24/datafusion:vortex-file-compressed	36250621 / 37097787 / -2.3%	111875420 / 115293128 / -3.0%	0.32 / 0.32 / +0.7%
clickbench_q25/datafusion:vortex-file-compressed	46585140 / 46376952 / +0.4%	115826377 / 112831242 / +2.7%	0.40 / 0.41 / -2.1%
clickbench_q26/datafusion:vortex-file-compressed	37219006 / 36922718 / +0.8%	111476011 / 109838988 / +1.5%	0.33 / 0.34 / -0.7%
clickbench_q27/datafusion:vortex-file-compressed	272316244 / 267201596 / +1.9%	443702498 / 454361936 / -2.3%	0.61 / 0.59 / +4.4%
clickbench_q28/datafusion:vortex-file-compressed	1432090941 / 1444584812 / -0.9%	1503488250 / 1547528561 / -2.8%	0.95 / 0.93 / +2.0%
clickbench_q29/datafusion:vortex-file-compressed	36478814 / 36507141 / -0.1%	90066493 / 89592143 / +0.5%	0.41 / 0.41 / -0.6%
clickbench_q30/datafusion:vortex-file-compressed	144263980 / 147486678 / -2.2%	232012772 / 232080344 / -0.0%	0.62 / 0.64 / -2.2%
clickbench_q31/datafusion:vortex-file-compressed	180472378 / 177228706 / +1.8%	319012349 / 321380874 / -0.7%	0.57 / 0.55 / +2.6%
clickbench_q32/datafusion:vortex-file-compressed	808964639 / 813995548 / -0.6%	934320172 / 933974638 / +0.0%	0.87 / 0.87 / -0.7%
clickbench_q33/datafusion:vortex-file-compressed	990028926 / 1005846867 / -1.6%	1171381424 / 1187314479 / -1.3%	0.85 / 0.85 / -0.2%
clickbench_q34/datafusion:vortex-file-compressed	975092229 / 1008361582 / -3.3%	1159797053 / 1176826701 / -1.4%	0.84 / 0.86 / -1.9%
clickbench_q35/datafusion:vortex-file-compressed	147409881 / 150239586 / -1.9%	223096755 / 219875751 / +1.5%	0.66 / 0.68 / -3.3%
clickbench_q36/datafusion:vortex-file-compressed	55950008 / 56774988 / -1.5%	114588291 / 111504229 / +2.8%	0.49 / 0.51 / -4.1%
clickbench_q37/datafusion:vortex-file-compressed	28402320 / 28650790 / -0.9%	79649247 / 77384864 / +2.9%	0.36 / 0.37 / -3.7%
clickbench_q38/datafusion:vortex-file-compressed	15527246 / 15618468 / -0.6%	67613044 / 66069843 / +2.3%	0.23 / 0.24 / -2.9%
clickbench_q39/datafusion:vortex-file-compressed	110308307 / 113344349 / -2.7%	179376702 / 180838025 / -0.8%	0.61 / 0.63 / -1.9%
clickbench_q40/datafusion:vortex-file-compressed	12837188 / 12962429 / -1.0%	61637796 / 63299094 / -2.6%	0.21 / 0.20 / +1.7%
clickbench_q41/datafusion:vortex-file-compressed	13017362 / 12371520 / +5.2%	58730054 / 62085438 / -5.4%	0.22 / 0.20 / +11.2%
clickbench_q42/datafusion:vortex-file-compressed	13459490 / 13675023 / -1.6%	59132439 / 58314039 / +1.4%	0.23 / 0.23 / -2.9%

datafusion / parquet / ns (0.989x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet	1858758 / 2025688 / -8.2%	84510327 / 86489275 / -2.3%	0.02 / 0.02 / -6.1%
clickbench_q01/datafusion:parquet	17763678 / 17015640 / +4.4%	127123388 / 126131431 / +0.8%	0.14 / 0.13 / +3.6%
clickbench_q02/datafusion:parquet	29744474 / 33326429 / -10.7% 🟢	144752131 / 146278144 / -1.0%	0.21 / 0.23 / -9.8%
clickbench_q03/datafusion:parquet	25102300 / 27662066 / -9.3%	139060409 / 136549857 / +1.8%	0.18 / 0.20 / -10.9%
clickbench_q04/datafusion:parquet	169533121 / 169932304 / -0.2%	311156961 / 305848845 / +1.7%	0.54 / 0.56 / -1.9%
clickbench_q05/datafusion:parquet	235331956 / 233888038 / +0.6%	370854010 / 375997422 / -1.4%	0.63 / 0.62 / +2.0%
clickbench_q06/datafusion:parquet	1935959 / 1883067 / +2.8%	86482406 / 85697389 / +0.9%	0.02 / 0.02 / +1.9%
clickbench_q07/datafusion:parquet	17845620 / 18518230 / -3.6%	126917046 / 126712719 / +0.2%	0.14 / 0.15 / -3.8%
clickbench_q08/datafusion:parquet	226592278 / 229840046 / -1.4%	382605028 / 389926952 / -1.9%	0.59 / 0.59 / +0.5%
clickbench_q09/datafusion:parquet	359662188 / 361802874 / -0.6%	509816053 / 513682846 / -0.8%	0.71 / 0.70 / +0.2%
clickbench_q10/datafusion:parquet	76390590 / 75578746 / +1.1%	201322103 / 203559874 / -1.1%	0.38 / 0.37 / +2.2%
clickbench_q11/datafusion:parquet	90754699 / 89445501 / +1.5%	221128596 / 224275302 / -1.4%	0.41 / 0.40 / +2.9%
clickbench_q12/datafusion:parquet	240555346 / 237586886 / +1.2%	387544269 / 379107479 / +2.2%	0.62 / 0.63 / -1.0%
clickbench_q13/datafusion:parquet	390917070 / 385978936 / +1.3%	551628572 / 558787160 / -1.3%	0.71 / 0.69 / +2.6%
clickbench_q14/datafusion:parquet	255674366 / 252409026 / +1.3%	401681257 / 409912860 / -2.0%	0.64 / 0.62 / +3.4%
clickbench_q15/datafusion:parquet	192259522 / 190211228 / +1.1%	333688419 / 334117620 / -0.1%	0.58 / 0.57 / +1.2%
clickbench_q16/datafusion:parquet	477845848 / 482836482 / -1.0%	647189367 / 645713905 / +0.2%	0.74 / 0.75 / -1.3%
clickbench_q17/datafusion:parquet	476532724 / 472652275 / +0.8%	643148122 / 640070625 / +0.5%	0.74 / 0.74 / +0.3%
clickbench_q18/datafusion:parquet	898059798 / 912762279 / -1.6%	1091829626 / 1104001376 / -1.1%	0.82 / 0.83 / -0.5%
clickbench_q19/datafusion:parquet	24208575 / 22480215 / +7.7%	136093442 / 132714532 / +2.5%	0.18 / 0.17 / +5.0%
clickbench_q20/datafusion:parquet	447682616 / 450129166 / -0.5%	611714973 / 616408689 / -0.8%	0.73 / 0.73 / +0.2%
clickbench_q21/datafusion:parquet	481578935 / 488806563 / -1.5%	668749714 / 658319743 / +1.6%	0.72 / 0.74 / -3.0%
clickbench_q22/datafusion:parquet	635947648 / 640485483 / -0.7%	872831896 / 855826291 / +2.0%	0.73 / 0.75 / -2.6%
clickbench_q23/datafusion:parquet	2809463437 / 2818787069 / -0.3%	3236777351 / 3238998451 / -0.1%	0.87 / 0.87 / -0.3%
clickbench_q24/datafusion:parquet	47981489 / 49202166 / -2.5%	160390827 / 157561220 / +1.8%	0.30 / 0.31 / -4.2%
clickbench_q25/datafusion:parquet	88153854 / 93836074 / -6.1%	217082619 / 214039161 / +1.4%	0.41 / 0.44 / -7.4%
clickbench_q26/datafusion:parquet	47196947 / 49595980 / -4.8%	159361296 / 158928810 / +0.3%	0.30 / 0.31 / -5.1%
clickbench_q27/datafusion:parquet	529879856 / 527280530 / +0.5%	699957681 / 681733727 / +2.7%	0.76 / 0.77 / -2.1%
clickbench_q28/datafusion:parquet	1525141006 / 1519094218 / +0.4%	1660142006 / 1630467573 / +1.8%	0.92 / 0.93 / -1.4%
clickbench_q29/datafusion:parquet	39723686 / 40581051 / -2.1%	159063398 / 161420774 / -1.5%	0.25 / 0.25 / -0.7%
clickbench_q30/datafusion:parquet	232156607 / 229678210 / +1.1%	397975159 / 399138158 / -0.3%	0.58 / 0.58 / +1.4%
clickbench_q31/datafusion:parquet	266330074 / 270975791 / -1.7%	453783163 / 461345438 / -1.6%	0.59 / 0.59 / -0.1%
clickbench_q32/datafusion:parquet	837552150 / 847802268 / -1.2%	1026438041 / 1028222963 / -0.2%	0.82 / 0.82 / -1.0%
clickbench_q33/datafusion:parquet	1079922126 / 1101488761 / -2.0%	1289810393 / 1297605718 / -0.6%	0.84 / 0.85 / -1.4%
clickbench_q34/datafusion:parquet	1096795294 / 1085850456 / +1.0%	1294817553 / 1297367205 / -0.2%	0.85 / 0.84 / +1.2%
clickbench_q35/datafusion:parquet	160634393 / 162529516 / -1.2%	300822909 / 296876356 / +1.3%	0.53 / 0.55 / -2.5%
clickbench_q36/datafusion:parquet	106766175 / 107322740 / -0.5%	229627662 / 225795137 / +1.7%	0.46 / 0.48 / -2.2%
clickbench_q37/datafusion:parquet	49054340 / 49206862 / -0.3%	154360837 / 154197644 / +0.1%	0.32 / 0.32 / -0.4%
clickbench_q38/datafusion:parquet	65574830 / 63681271 / +3.0%	177807838 / 180797951 / -1.7%	0.37 / 0.35 / +4.7%
clickbench_q39/datafusion:parquet	204435564 / 203322842 / +0.5%	331181103 / 332406447 / -0.4%	0.62 / 0.61 / +0.9%
clickbench_q40/datafusion:parquet	26667762 / 26618794 / +0.2%	136883898 / 138076429 / -0.9%	0.19 / 0.19 / +1.1%
clickbench_q41/datafusion:parquet	25959260 / 27251246 / -4.7%	133878749 / 130994434 / +2.2%	0.19 / 0.21 / -6.8%
clickbench_q42/datafusion:parquet	24871134 / 26721524 / -6.9%	127770666 / 125819721 / +1.6%	0.19 / 0.21 / -8.3%

duckdb / vortex-file-compressed / ns (1.009x ➖, 0↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed	15556770 / 12539184 / +24.1% 🔴	71125134 / 65280685 / +9.0%	0.22 / 0.19 / +13.9%
clickbench_q01/duckdb:vortex-file-compressed	18705400 / 18431530 / +1.5%	101785897 / 108701186 / -6.4%	0.18 / 0.17 / +8.4%
clickbench_q02/duckdb:vortex-file-compressed	21230079 / 22053986 / -3.7%	127110774 / 120477667 / +5.5%	0.17 / 0.18 / -8.8%
clickbench_q03/duckdb:vortex-file-compressed	34338216 / 32704390 / +5.0%	103769649 / 105682324 / -1.8%	0.33 / 0.31 / +6.9%
clickbench_q04/duckdb:vortex-file-compressed	132275209 / 132993908 / -0.5%	211060769 / 211669520 / -0.3%	0.63 / 0.63 / -0.3%
clickbench_q05/duckdb:vortex-file-compressed	157293044 / 159682492 / -1.5%	243676458 / 241129116 / +1.1%	0.65 / 0.66 / -2.5%
clickbench_q06/duckdb:vortex-file-compressed	19681931 / 20734682 / -5.1%	99232785 / 103700352 / -4.3%	0.20 / 0.20 / -0.8%
clickbench_q07/duckdb:vortex-file-compressed	21427258 / 21543434 / -0.5%	97048636 / 96180978 / +0.9%	0.22 / 0.22 / -1.4%
clickbench_q08/duckdb:vortex-file-compressed	169502576 / 170236908 / -0.4%	286964518 / 293955293 / -2.4%	0.59 / 0.58 / +2.0%
clickbench_q09/duckdb:vortex-file-compressed	206770858 / 211033197 / -2.0%	333743697 / 324347644 / +2.9%	0.62 / 0.65 / -4.8%
clickbench_q10/duckdb:vortex-file-compressed	62931808 / 64438540 / -2.3%	176354466 / 178526959 / -1.2%	0.36 / 0.36 / -1.1%
clickbench_q11/duckdb:vortex-file-compressed	67936594 / 66584841 / +2.0%	183446405 / 181134239 / +1.3%	0.37 / 0.37 / +0.7%
clickbench_q12/duckdb:vortex-file-compressed	178415242 / 180011829 / -0.9%	297541441 / 294965124 / +0.9%	0.60 / 0.61 / -1.7%
clickbench_q13/duckdb:vortex-file-compressed	326876748 / 328631922 / -0.5%	449714308 / 451671133 / -0.4%	0.73 / 0.73 / -0.1%
clickbench_q14/duckdb:vortex-file-compressed	192548412 / 191214354 / +0.7%	292375223 / 306560045 / -4.6%	0.66 / 0.62 / +5.6%
clickbench_q15/duckdb:vortex-file-compressed	186184523 / 188355092 / -1.2%	271716463 / 292270101 / -7.0%	0.69 / 0.64 / +6.3%
clickbench_q16/duckdb:vortex-file-compressed	372199880 / 380630036 / -2.2%	486021246 / 484724442 / +0.3%	0.77 / 0.79 / -2.5%
clickbench_q17/duckdb:vortex-file-compressed	368508586 / 367687588 / +0.2%	476343014 / 488608140 / -2.5%	0.77 / 0.75 / +2.8%
clickbench_q18/duckdb:vortex-file-compressed	741665966 / 738523805 / +0.4%	890671120 / 852561341 / +4.5%	0.83 / 0.87 / -3.9%
clickbench_q19/duckdb:vortex-file-compressed	26256193 / 27200374 / -3.5%	124062609 / 109285814 / +13.5% 🔴	0.21 / 0.25 / -15.0%
clickbench_q20/duckdb:vortex-file-compressed	242482556 / 244953730 / -1.0%	439269095 / 439931544 / -0.2%	0.55 / 0.56 / -0.9%
clickbench_q21/duckdb:vortex-file-compressed	358715738 / 353200242 / +1.6%	626153882 / 648697620 / -3.5%	0.57 / 0.54 / +5.2%
clickbench_q22/duckdb:vortex-file-compressed	543924290 / 546549054 / -0.5%	939329733 / 947680173 / -0.9%	0.58 / 0.58 / +0.4%
clickbench_q23/duckdb:vortex-file-compressed	105633570 / 114897694 / -8.1%	218023523 / 227398290 / -4.1%	0.48 / 0.51 / -4.1%
clickbench_q24/duckdb:vortex-file-compressed	42939150 / 40665334 / +5.6%	92178518 / 86787993 / +6.2%	0.47 / 0.47 / -0.6%
clickbench_q25/duckdb:vortex-file-compressed	56863323 / 57839292 / -1.7%	135085059 / 140855463 / -4.1%	0.42 / 0.41 / +2.5%
clickbench_q26/duckdb:vortex-file-compressed	38098772 / 32670068 / +16.6% 🔴	91681649 / 84435947 / +8.6%	0.42 / 0.39 / +7.4%
clickbench_q27/duckdb:vortex-file-compressed	248512697 / 250391190 / -0.8%	512507413 / 523169878 / -2.0%	0.48 / 0.48 / +1.3%
clickbench_q28/duckdb:vortex-file-compressed	1534190805 / 1319592298 / +16.3% 🔴	1555266589 / 1467420393 / +6.0%	0.99 / 0.90 / +9.7%
clickbench_q29/duckdb:vortex-file-compressed	33527389 / 29938536 / +12.0% 🔴	120552569 / 112665544 / +7.0%	0.28 / 0.27 / +4.7%
clickbench_q30/duckdb:vortex-file-compressed	140285129 / 144104107 / -2.7%	269530196 / 264710627 / +1.8%	0.52 / 0.54 / -4.4%
clickbench_q31/duckdb:vortex-file-compressed	299767752 / 295333888 / +1.5%	492569683 / 499627544 / -1.4%	0.61 / 0.59 / +3.0%
clickbench_q32/duckdb:vortex-file-compressed	928274636 / 919612980 / +0.9%	1025938581 / 1040859347 / -1.4%	0.90 / 0.88 / +2.4%
clickbench_q33/duckdb:vortex-file-compressed	1053641218 / 1052149172 / +0.1%	1297764322 / 1318162454 / -1.5%	0.81 / 0.80 / +1.7%
clickbench_q34/duckdb:vortex-file-compressed	996060032 / 1080723312 / -7.8%	1356629926 / 1144915135 / +18.5% 🔴	0.73 / 0.94 / -22.2%
clickbench_q35/duckdb:vortex-file-compressed	211439890 / 208661320 / +1.3%	280328502 / 288630526 / -2.9%	0.75 / 0.72 / +4.3%
clickbench_q36/duckdb:vortex-file-compressed	28206637 / 27920356 / +1.0%	118195357 / 103095602 / +14.6% 🔴	0.24 / 0.27 / -11.9%
clickbench_q37/duckdb:vortex-file-compressed	18425652 / 17795399 / +3.5%	83831422 / 102064868 / -17.9% 🟢	0.22 / 0.17 / +26.1%
clickbench_q38/duckdb:vortex-file-compressed	22151238 / 23433474 / -5.5%	103086275 / 105128324 / -1.9%	0.21 / 0.22 / -3.6%
clickbench_q39/duckdb:vortex-file-compressed	44848986 / 43375265 / +3.4%	137813122 / 148919150 / -7.5%	0.33 / 0.29 / +11.7%
clickbench_q40/duckdb:vortex-file-compressed	16671821 / 17451997 / -4.5%	74089031 / 88990672 / -16.7% 🟢	0.23 / 0.20 / +14.7%
clickbench_q41/duckdb:vortex-file-compressed	18953840 / 17979055 / +5.4%	96717383 / 93834483 / +3.1%	0.20 / 0.19 / +2.3%
clickbench_q42/duckdb:vortex-file-compressed	18444432 / 18236870 / +1.1%	86958836 / 94494831 / -8.0%	0.21 / 0.19 / +9.9%

duckdb / parquet / ns (0.998x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet	16188214 / 15759544 / +2.7%	43716952 / 43184672 / +1.2%	0.37 / 0.36 / +1.5%
clickbench_q01/duckdb:parquet	16674886 / 17551626 / -5.0%	36480357 / 35388850 / +3.1%	0.46 / 0.50 / -7.8%
clickbench_q02/duckdb:parquet	24049078 / 25651034 / -6.2%	60607443 / 62003714 / -2.3%	0.40 / 0.41 / -4.1%
clickbench_q03/duckdb:parquet	29592984 / 31856806 / -7.1%	87270054 / 85196065 / +2.4%	0.34 / 0.37 / -9.3%
clickbench_q04/duckdb:parquet	132140256 / 138905352 / -4.9%	189905774 / 173014262 / +9.8%	0.70 / 0.80 / -13.3%
clickbench_q05/duckdb:parquet	183334332 / 196102224 / -6.5%	254586062 / 259111174 / -1.7%	0.72 / 0.76 / -4.8%
clickbench_q06/duckdb:parquet	25329150 / 24120008 / +5.0%	48616081 / 51696909 / -6.0%	0.52 / 0.47 / +11.7%
clickbench_q07/duckdb:parquet	21820568 / 19194835 / +13.7% 🔴	41690588 / 41920021 / -0.5%	0.52 / 0.46 / +14.3%
clickbench_q08/duckdb:parquet	162100060 / 163441565 / -0.8%	262515791 / 251563046 / +4.4%	0.62 / 0.65 / -5.0%
clickbench_q09/duckdb:parquet	227793146 / 230394086 / -1.1%	309854624 / 328884858 / -5.8%	0.74 / 0.70 / +4.9%
clickbench_q10/duckdb:parquet	64031380 / 66617079 / -3.9%	112875313 / 112489433 / +0.3%	0.57 / 0.59 / -4.2%
clickbench_q11/duckdb:parquet	70992784 / 71716396 / -1.0%	129273443 / 131296172 / -1.5%	0.55 / 0.55 / +0.5%
clickbench_q12/duckdb:parquet	183295115 / 175851198 / +4.2%	272670495 / 272692841 / -0.0%	0.67 / 0.64 / +4.2%
clickbench_q13/duckdb:parquet	308136492 / 318642339 / -3.3%	429264785 / 441990063 / -2.9%	0.72 / 0.72 / -0.4%
clickbench_q14/duckdb:parquet	199316203 / 191758098 / +3.9%	284652769 / 293428647 / -3.0%	0.70 / 0.65 / +7.1%
clickbench_q15/duckdb:parquet	187032980 / 183548696 / +1.9%	232523849 / 238525142 / -2.5%	0.80 / 0.77 / +4.5%
clickbench_q16/duckdb:parquet	360975952 / 352016774 / +2.5%	452847558 / 504896742 / -10.3% 🟢	0.80 / 0.70 / +14.3%
clickbench_q17/duckdb:parquet	352848838 / 365757117 / -3.5%	470928063 / 455826903 / +3.3%	0.75 / 0.80 / -6.6%
clickbench_q18/duckdb:parquet	687591802 / 694370579 / -1.0%	858867311 / 890493915 / -3.6%	0.80 / 0.78 / +2.7%
clickbench_q19/duckdb:parquet	23372760 / 22391662 / +4.4%	66376661 / 69955740 / -5.1%	0.35 / 0.32 / +10.0%
clickbench_q20/duckdb:parquet	271504921 / 267087576 / +1.7%	463291595 / 470012106 / -1.4%	0.59 / 0.57 / +3.1%
clickbench_q21/duckdb:parquet	327436958 / 328584576 / -0.3%	610719585 / 621250961 / -1.7%	0.54 / 0.53 / +1.4%
clickbench_q22/duckdb:parquet	476664390 / 481958828 / -1.1%	766646130 / 774466917 / -1.0%	0.62 / 0.62 / -0.1%
clickbench_q23/duckdb:parquet	265098931 / 252695294 / +4.9%	309336256 / 302424032 / +2.3%	0.86 / 0.84 / +2.6%
clickbench_q24/duckdb:parquet	73329828 / 79453410 / -7.7%	128734680 / 134320032 / -4.2%	0.57 / 0.59 / -3.7%
clickbench_q25/duckdb:parquet	74797936 / 75530102 / -1.0%	174467508 / 177128459 / -1.5%	0.43 / 0.43 / +0.5%
clickbench_q26/duckdb:parquet	55567398 / 60052673 / -7.5%	101225664 / 99122635 / +2.1%	0.55 / 0.61 / -9.4%
clickbench_q27/duckdb:parquet	272995319 / 273639814 / -0.2%	517689128 / 510884811 / +1.3%	0.53 / 0.54 / -1.5%
clickbench_q28/duckdb:parquet	1741096526 / 1683277650 / +3.4%	2155525068 / 2101366501 / +2.6%	0.81 / 0.80 / +0.8%
clickbench_q29/duckdb:parquet	28368156 / 31018458 / -8.5%	60429150 / 59314229 / +1.9%	0.47 / 0.52 / -10.2%
clickbench_q30/duckdb:parquet	177755558 / 180027044 / -1.3%	342315674 / 331965770 / +3.1%	0.52 / 0.54 / -4.2%
clickbench_q31/duckdb:parquet	313374242 / 291173069 / +7.6%	587931761 / 539266708 / +9.0%	0.53 / 0.54 / -1.3%
clickbench_q32/duckdb:parquet	910306776 / 903207976 / +0.8%	984318678 / 1009606804 / -2.5%	0.92 / 0.89 / +3.4%
clickbench_q33/duckdb:parquet	799417548 / 786595816 / +1.6%	980297010 / 966981500 / +1.4%	0.82 / 0.81 / +0.2%
clickbench_q34/duckdb:parquet	804998468 / 801939149 / +0.4%	1135578587 / 1001160024 / +13.4% 🔴	0.71 / 0.80 / -11.5%
clickbench_q35/duckdb:parquet	209742966 / 208345420 / +0.7%	241593042 / 250852410 / -3.7%	0.87 / 0.83 / +4.5%
clickbench_q36/duckdb:parquet	51504582 / 50871958 / +1.2%	74140734 / 72330926 / +2.5%	0.69 / 0.70 / -1.2%
clickbench_q37/duckdb:parquet	38466648 / 36677413 / +4.9%	58408133 / 59313677 / -1.5%	0.66 / 0.62 / +6.5%
clickbench_q38/duckdb:parquet	39380474 / 39851452 / -1.2%	58390365 / 59009102 / -1.0%	0.67 / 0.68 / -0.1%
clickbench_q39/duckdb:parquet	91093083 / 89134510 / +2.2%	111230127 / 114157716 / -2.6%	0.82 / 0.78 / +4.9%
clickbench_q40/duckdb:parquet	20686826 / 20005004 / +3.4%	42610185 / 41087708 / +3.7%	0.49 / 0.49 / -0.3%
clickbench_q41/duckdb:parquet	22130992 / 20673250 / +7.1%	44991606 / 44294817 / +1.6%	0.49 / 0.47 / +5.4%
clickbench_q42/duckdb:parquet	24303682 / 26244192 / -7.4%	46288654 / 44924593 / +3.0%	0.53 / 0.58 / -10.1%

File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)

File	Scale	Format	Base	Change	%
duckdb.db	1.0	vortex-compact	268.00 KB	268.00 KB	-100.0%
hits_0.vortex	1.0	vortex-compact	58.85 MB	58.85 MB	-100.0%
hits_1.vortex	1.0	vortex-compact	90.68 MB	90.68 MB	-100.0%
hits_10.vortex	1.0	vortex-compact	49.45 MB	49.45 MB	-100.0%
hits_11.vortex	1.0	vortex-compact	56.08 MB	56.08 MB	-100.0%
hits_12.vortex	1.0	vortex-compact	69.83 MB	69.83 MB	-100.0%
hits_13.vortex	1.0	vortex-compact	69.21 MB	69.21 MB	-100.0%
hits_14.vortex	1.0	vortex-compact	74.85 MB	74.85 MB	-100.0%
hits_15.vortex	1.0	vortex-compact	48.38 MB	48.38 MB	-100.0%
hits_16.vortex	1.0	vortex-compact	49.53 MB	49.53 MB	-100.0%
hits_17.vortex	1.0	vortex-compact	58.76 MB	58.76 MB	-100.0%
hits_18.vortex	1.0	vortex-compact	64.85 MB	64.85 MB	-100.0%
hits_19.vortex	1.0	vortex-compact	49.69 MB	49.69 MB	-100.0%
hits_2.vortex	1.0	vortex-compact	129.13 MB	129.13 MB	-100.0%
hits_20.vortex	1.0	vortex-compact	38.33 MB	38.33 MB	-100.0%
hits_21.vortex	1.0	vortex-compact	51.96 MB	51.96 MB	-100.0%
hits_22.vortex	1.0	vortex-compact	46.20 MB	46.20 MB	-100.0%
hits_23.vortex	1.0	vortex-compact	46.11 MB	46.11 MB	-100.0%
hits_24.vortex	1.0	vortex-compact	45.09 MB	45.09 MB	-100.0%
hits_25.vortex	1.0	vortex-compact	73.50 MB	73.50 MB	-100.0%
hits_26.vortex	1.0	vortex-compact	71.96 MB	71.96 MB	-100.0%
hits_27.vortex	1.0	vortex-compact	69.84 MB	69.84 MB	-100.0%
hits_28.vortex	1.0	vortex-compact	70.83 MB	70.83 MB	-100.0%
hits_29.vortex	1.0	vortex-compact	36.65 MB	36.65 MB	-100.0%
hits_3.vortex	1.0	vortex-compact	95.04 MB	95.04 MB	-100.0%
hits_30.vortex	1.0	vortex-compact	58.55 MB	58.55 MB	-100.0%
hits_31.vortex	1.0	vortex-compact	55.74 MB	55.74 MB	-100.0%
hits_32.vortex	1.0	vortex-compact	44.58 MB	44.58 MB	-100.0%
hits_33.vortex	1.0	vortex-compact	35.89 MB	35.89 MB	-100.0%
hits_34.vortex	1.0	vortex-compact	58.21 MB	58.21 MB	-100.0%
hits_35.vortex	1.0	vortex-compact	75.31 MB	75.31 MB	-100.0%
hits_36.vortex	1.0	vortex-compact	49.18 MB	49.18 MB	-100.0%
hits_37.vortex	1.0	vortex-compact	54.73 MB	54.73 MB	-100.0%
hits_38.vortex	1.0	vortex-compact	63.35 MB	63.35 MB	-100.0%
hits_39.vortex	1.0	vortex-compact	50.06 MB	50.06 MB	-100.0%
hits_4.vortex	1.0	vortex-compact	71.92 MB	71.92 MB	-100.0%
hits_40.vortex	1.0	vortex-compact	77.39 MB	77.39 MB	-100.0%
hits_41.vortex	1.0	vortex-compact	166.03 MB	166.03 MB	-100.0%
hits_42.vortex	1.0	vortex-compact	164.50 MB	164.50 MB	-100.0%
hits_43.vortex	1.0	vortex-compact	169.18 MB	169.18 MB	-100.0%
hits_44.vortex	1.0	vortex-compact	133.23 MB	133.23 MB	-100.0%
hits_45.vortex	1.0	vortex-compact	75.77 MB	75.77 MB	-100.0%
hits_46.vortex	1.0	vortex-compact	42.24 MB	42.24 MB	-100.0%
hits_47.vortex	1.0	vortex-compact	18.19 MB	18.19 MB	-100.0%
hits_48.vortex	1.0	vortex-compact	17.82 MB	17.82 MB	-100.0%
hits_49.vortex	1.0	vortex-compact	50.97 MB	50.97 MB	-100.0%
hits_5.vortex	1.0	vortex-compact	63.30 MB	63.30 MB	-100.0%
hits_50.vortex	1.0	vortex-compact	114.17 MB	114.17 MB	-100.0%
hits_51.vortex	1.0	vortex-compact	168.31 MB	168.31 MB	-100.0%
hits_52.vortex	1.0	vortex-compact	65.05 MB	65.05 MB	-100.0%
hits_53.vortex	1.0	vortex-compact	60.02 MB	60.02 MB	-100.0%
hits_54.vortex	1.0	vortex-compact	117.55 MB	117.55 MB	-100.0%
hits_55.vortex	1.0	vortex-compact	92.51 MB	92.51 MB	-100.0%
hits_56.vortex	1.0	vortex-compact	78.57 MB	78.57 MB	-100.0%
hits_57.vortex	1.0	vortex-compact	83.69 MB	83.69 MB	-100.0%
hits_58.vortex	1.0	vortex-compact	61.21 MB	61.21 MB	-100.0%
hits_59.vortex	1.0	vortex-compact	66.65 MB	66.65 MB	-100.0%
hits_6.vortex	1.0	vortex-compact	63.55 MB	63.55 MB	-100.0%
hits_60.vortex	1.0	vortex-compact	64.89 MB	64.89 MB	-100.0%
hits_61.vortex	1.0	vortex-compact	57.70 MB	57.70 MB	-100.0%
hits_62.vortex	1.0	vortex-compact	75.42 MB	75.42 MB	-100.0%
hits_63.vortex	1.0	vortex-compact	46.41 MB	46.41 MB	-100.0%
hits_64.vortex	1.0	vortex-compact	54.06 MB	54.06 MB	-100.0%
hits_65.vortex	1.0	vortex-compact	129.38 MB	129.38 MB	-100.0%
hits_66.vortex	1.0	vortex-compact	53.49 MB	53.49 MB	-100.0%
hits_67.vortex	1.0	vortex-compact	114.42 MB	114.42 MB	-100.0%
hits_68.vortex	1.0	vortex-compact	76.65 MB	76.65 MB	-100.0%
hits_69.vortex	1.0	vortex-compact	80.97 MB	80.97 MB	-100.0%
hits_7.vortex	1.0	vortex-compact	64.16 MB	64.16 MB	-100.0%
hits_70.vortex	1.0	vortex-compact	61.81 MB	61.81 MB	-100.0%
hits_71.vortex	1.0	vortex-compact	69.93 MB	69.93 MB	-100.0%
hits_72.vortex	1.0	vortex-compact	52.70 MB	52.70 MB	-100.0%
hits_73.vortex	1.0	vortex-compact	70.85 MB	70.85 MB	-100.0%
hits_74.vortex	1.0	vortex-compact	71.84 MB	71.84 MB	-100.0%
hits_75.vortex	1.0	vortex-compact	45.09 MB	45.09 MB	-100.0%
hits_76.vortex	1.0	vortex-compact	77.07 MB	77.07 MB	-100.0%
hits_77.vortex	1.0	vortex-compact	118.44 MB	118.44 MB	-100.0%
hits_78.vortex	1.0	vortex-compact	97.82 MB	97.82 MB	-100.0%
hits_79.vortex	1.0	vortex-compact	86.14 MB	86.14 MB	-100.0%
hits_8.vortex	1.0	vortex-compact	63.37 MB	63.37 MB	-100.0%
hits_80.vortex	1.0	vortex-compact	68.64 MB	68.64 MB	-100.0%
hits_81.vortex	1.0	vortex-compact	65.92 MB	65.92 MB	-100.0%
hits_82.vortex	1.0	vortex-compact	67.40 MB	67.40 MB	-100.0%
hits_83.vortex	1.0	vortex-compact	53.58 MB	53.58 MB	-100.0%
hits_84.vortex	1.0	vortex-compact	74.18 MB	74.18 MB	-100.0%
hits_85.vortex	1.0	vortex-compact	52.83 MB	52.83 MB	-100.0%
hits_86.vortex	1.0	vortex-compact	49.09 MB	49.09 MB	-100.0%
hits_87.vortex	1.0	vortex-compact	118.83 MB	118.83 MB	-100.0%
hits_88.vortex	1.0	vortex-compact	73.49 MB	73.49 MB	-100.0%
hits_89.vortex	1.0	vortex-compact	114.07 MB	114.07 MB	-100.0%
hits_9.vortex	1.0	vortex-compact	66.29 MB	66.29 MB	-100.0%
hits_90.vortex	1.0	vortex-compact	82.06 MB	82.06 MB	-100.0%
hits_91.vortex	1.0	vortex-compact	61.21 MB	61.21 MB	-100.0%
hits_92.vortex	1.0	vortex-compact	94.37 MB	94.37 MB	-100.0%
hits_93.vortex	1.0	vortex-compact	59.89 MB	59.89 MB	-100.0%
hits_94.vortex	1.0	vortex-compact	90.87 MB	90.87 MB	-100.0%
hits_95.vortex	1.0	vortex-compact	58.17 MB	58.17 MB	-100.0%
hits_96.vortex	1.0	vortex-compact	91.72 MB	91.72 MB	-100.0%
hits_97.vortex	1.0	vortex-compact	69.55 MB	69.55 MB	-100.0%
hits_98.vortex	1.0	vortex-compact	73.12 MB	73.12 MB	-100.0%
hits_99.vortex	1.0	vortex-compact	77.61 MB	77.61 MB	-100.0%

Totals:

vortex-compact: 7.11 GB → 0 B (-100.0%)
vortex-file-compressed: 11.03 GB → 11.03 GB (0.0%)

github-actions · 2026-08-25T10:48:15Z

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 6554a829 vs base 17bd9e27
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (-4.5%, environment too noisy confidence) · DuckDB No clear signal (+6.3%, environment too noisy confidence)
Vortex (geomean): hot 1.024x ➖ · cold 1.022x ➖
Parquet (geomean): hot 1.016x ➖ · cold 1.017x ➖
Shifts: Parquet (control) +1.6% · Median polish +1.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.987x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	240248110 / 246352939 / -2.5%	688166543 / 672550287 / +2.3%	0.35 / 0.37 / -4.7%
tpch_q02/datafusion:vortex-file-compressed	457239443 / 401170181 / +14.0%	671943873 / 787935893 / -14.7%	0.68 / 0.51 / +33.7%
tpch_q03/datafusion:vortex-file-compressed	345426078 / 327165850 / +5.6%	884371505 / 787793539 / +12.3%	0.39 / 0.42 / -5.9%
tpch_q04/datafusion:vortex-file-compressed	160693320 / 187420575 / -14.3%	379831444 / 725191028 / -47.6% 🟢	0.42 / 0.26 / +63.7%
tpch_q05/datafusion:vortex-file-compressed	335465371 / 388263638 / -13.6%	660919712 / 631118016 / +4.7%	0.51 / 0.62 / -17.5%
tpch_q06/datafusion:vortex-file-compressed	241432382 / 247045709 / -2.3%	413833636 / 401511947 / +3.1%	0.58 / 0.62 / -5.2%
tpch_q07/datafusion:vortex-file-compressed	367856518 / 338312940 / +8.7%	507980182 / 494266526 / +2.8%	0.72 / 0.68 / +5.8%
tpch_q08/datafusion:vortex-file-compressed	554175898 / 494205596 / +12.1%	1603282388 / 810546468 / +97.8% 🔴	0.35 / 0.61 / -43.3%
tpch_q09/datafusion:vortex-file-compressed	285346002 / 383439424 / -25.6%	501876012 / 629349806 / -20.3%	0.57 / 0.61 / -6.7%
tpch_q10/datafusion:vortex-file-compressed	340664427 / 336802441 / +1.1%	472233672 / 475612916 / -0.7%	0.72 / 0.71 / +1.9%
tpch_q11/datafusion:vortex-file-compressed	290506424 / 260821267 / +11.4%	415679496 / 427101427 / -2.7%	0.70 / 0.61 / +14.4%
tpch_q12/datafusion:vortex-file-compressed	305189667 / 376600559 / -19.0%	481445562 / 695722002 / -30.8% 🟢	0.63 / 0.54 / +17.1%
tpch_q13/datafusion:vortex-file-compressed	105066866 / 112850029 / -6.9%	422649896 / 322277942 / +31.1% 🔴	0.25 / 0.35 / -29.0%
tpch_q14/datafusion:vortex-file-compressed	182504547 / 161742069 / +12.8%	338987759 / 342151209 / -0.9%	0.54 / 0.47 / +13.9%
tpch_q15/datafusion:vortex-file-compressed	284775824 / 320255001 / -11.1%	515338518 / 570707767 / -9.7%	0.55 / 0.56 / -1.5%
tpch_q16/datafusion:vortex-file-compressed	206585799 / 226495969 / -8.8%	377686337 / 341971703 / +10.4%	0.55 / 0.66 / -17.4%
tpch_q17/datafusion:vortex-file-compressed	271499117 / 341638567 / -20.5%	496024790 / 517677290 / -4.2%	0.55 / 0.66 / -17.1%
tpch_q18/datafusion:vortex-file-compressed	497723620 / 263564502 / +88.8% 🔴	460746066 / 509475203 / -9.6%	1.08 / 0.52 / +108.8%
tpch_q19/datafusion:vortex-file-compressed	333127065 / 321141247 / +3.7%	577654589 / 525588378 / +9.9%	0.58 / 0.61 / -5.6%
tpch_q20/datafusion:vortex-file-compressed	373575031 / 377003360 / -0.9%	542691212 / 552295026 / -1.7%	0.69 / 0.68 / +0.8%
tpch_q21/datafusion:vortex-file-compressed	435902977 / 513808502 / -15.2%	919925217 / 596946328 / +54.1% 🔴	0.47 / 0.86 / -44.9%
tpch_q22/datafusion:vortex-file-compressed	133840957 / 140697880 / -4.9%	364941402 / 360000137 / +1.4%	0.37 / 0.39 / -6.2%

datafusion / parquet / ns (1.033x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	216787809 / 214990324 / +0.8%	608003847 / 700708408 / -13.2%	0.36 / 0.31 / +16.2%
tpch_q02/datafusion:parquet	306190778 / 267676853 / +14.4%	522467048 / 488815216 / +6.9%	0.59 / 0.55 / +7.0%
tpch_q03/datafusion:parquet	305272059 / 290257089 / +5.2%	789275342 / 712358168 / +10.8%	0.39 / 0.41 / -5.1%
tpch_q04/datafusion:parquet	141877185 / 146028638 / -2.8%	363054271 / 362307330 / +0.2%	0.39 / 0.40 / -3.0%
tpch_q05/datafusion:parquet	358214856 / 369822768 / -3.1%	513589979 / 613469977 / -16.3%	0.70 / 0.60 / +15.7%
tpch_q06/datafusion:parquet	134008526 / 139445657 / -3.9%	259370282 / 271716480 / -4.5%	0.52 / 0.51 / +0.7%
tpch_q07/datafusion:parquet	358781808 / 359411113 / -0.2%	491201912 / 491342730 / -0.0%	0.73 / 0.73 / -0.1%
tpch_q08/datafusion:parquet	428999777 / 427628451 / +0.3%	579258312 / 550814432 / +5.2%	0.74 / 0.78 / -4.6%
tpch_q09/datafusion:parquet	477232993 / 456714005 / +4.5%	701562203 / 613254407 / +14.4%	0.68 / 0.74 / -8.7%
tpch_q10/datafusion:parquet	413126461 / 429372132 / -3.8%	560520289 / 534780298 / +4.8%	0.74 / 0.80 / -8.2%
tpch_q11/datafusion:parquet	275674645 / 277394257 / -0.6%	471317099 / 440273350 / +7.1%	0.58 / 0.63 / -7.2%
tpch_q12/datafusion:parquet	215191135 / 206262033 / +4.3%	484397187 / 445619333 / +8.7%	0.44 / 0.46 / -4.0%
tpch_q13/datafusion:parquet	447846242 / 448616162 / -0.2%	593884404 / 628743037 / -5.5%	0.75 / 0.71 / +5.7%
tpch_q14/datafusion:parquet	164915402 / 180029413 / -8.4%	312733411 / 347015026 / -9.9%	0.53 / 0.52 / +1.6%
tpch_q15/datafusion:parquet	298880968 / 277354589 / +7.8%	520763889 / 468264490 / +11.2%	0.57 / 0.59 / -3.1%
tpch_q16/datafusion:parquet	118699739 / 114044810 / +4.1%	328074753 / 279452412 / +17.4%	0.36 / 0.41 / -11.3%
tpch_q17/datafusion:parquet	312759595 / 284372999 / +10.0%	428814537 / 453391682 / -5.4%	0.73 / 0.63 / +16.3%
tpch_q18/datafusion:parquet	455003346 / 473867641 / -4.0%	601606803 / 685840816 / -12.3%	0.76 / 0.69 / +9.5%
tpch_q19/datafusion:parquet	203185199 / 172959250 / +17.5%	412401854 / 327704022 / +25.8%	0.49 / 0.53 / -6.7%
tpch_q20/datafusion:parquet	266392131 / 257868632 / +3.3%	486400506 / 446814644 / +8.9%	0.55 / 0.58 / -5.1%
tpch_q21/datafusion:parquet	462786072 / 390377258 / +18.5%	564685289 / 577729692 / -2.3%	0.82 / 0.68 / +21.3%
tpch_q22/datafusion:parquet	196032476 / 170384652 / +15.1%	441070221 / 370718935 / +19.0%	0.44 / 0.46 / -3.3%

duckdb / vortex-file-compressed / ns (1.062x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	211217507 / 208309011 / +1.4%	294840656 / 264705485 / +11.4%	0.72 / 0.79 / -9.0%
tpch_q02/duckdb:vortex-file-compressed	390964054 / 370750717 / +5.5%	418969528 / 428735523 / -2.3%	0.93 / 0.86 / +7.9%
tpch_q03/duckdb:vortex-file-compressed	423541011 / 403174307 / +5.1%	514089875 / 560817604 / -8.3%	0.82 / 0.72 / +14.6%
tpch_q04/duckdb:vortex-file-compressed	286157740 / 281362512 / +1.7%	359709635 / 350422970 / +2.7%	0.80 / 0.80 / -0.9%
tpch_q05/duckdb:vortex-file-compressed	592866754 / 363268622 / +63.2% 🔴	619851919 / 418926364 / +48.0% 🔴	0.96 / 0.87 / +10.3%
tpch_q06/duckdb:vortex-file-compressed	285154702 / 263764719 / +8.1%	347525130 / 334786616 / +3.8%	0.82 / 0.79 / +4.1%
tpch_q07/duckdb:vortex-file-compressed	477564228 / 440275367 / +8.5%	585189652 / 507803004 / +15.2%	0.82 / 0.87 / -5.9%
tpch_q08/duckdb:vortex-file-compressed	554588301 / 540206040 / +2.7%	612199490 / 531959609 / +15.1%	0.91 / 1.02 / -10.8%
tpch_q09/duckdb:vortex-file-compressed	455845628 / 449170644 / +1.5%	511926154 / 558183878 / -8.3%	0.89 / 0.80 / +10.7%
tpch_q10/duckdb:vortex-file-compressed	451927800 / 435006479 / +3.9%	481993761 / 489111253 / -1.5%	0.94 / 0.89 / +5.4%
tpch_q11/duckdb:vortex-file-compressed	168229591 / 153295416 / +9.7%	220340796 / 173820262 / +26.8%	0.76 / 0.88 / -13.4%
tpch_q12/duckdb:vortex-file-compressed	401739462 / 387966302 / +3.6%	456073494 / 482717395 / -5.5%	0.88 / 0.80 / +9.6%
tpch_q13/duckdb:vortex-file-compressed	287531405 / 293267819 / -2.0%	296656597 / 603446980 / -50.8% 🟢	0.97 / 0.49 / +99.4%
tpch_q14/duckdb:vortex-file-compressed	233747436 / 270122879 / -13.5%	298262990 / 293348010 / +1.7%	0.78 / 0.92 / -14.9%
tpch_q15/duckdb:vortex-file-compressed	150644596 / 165285386 / -8.9%	230935566 / 194416819 / +18.8%	0.65 / 0.85 / -23.3%
tpch_q16/duckdb:vortex-file-compressed	188491963 / 196954998 / -4.3%	241562217 / 236105443 / +2.3%	0.78 / 0.83 / -6.5%
tpch_q17/duckdb:vortex-file-compressed	366444802 / 380133756 / -3.6%	428012594 / 446436965 / -4.1%	0.86 / 0.85 / +0.5%
tpch_q18/duckdb:vortex-file-compressed	331147297 / 306929942 / +7.9%	454597601 / 356245594 / +27.6%	0.73 / 0.86 / -15.5%
tpch_q19/duckdb:vortex-file-compressed	345539197 / 330027957 / +4.7%	417666172 / 435614042 / -4.1%	0.83 / 0.76 / +9.2%
tpch_q20/duckdb:vortex-file-compressed	514113542 / 370346334 / +38.8% 🔴	599489776 / 431334951 / +39.0% 🔴	0.86 / 0.86 / -0.1%
tpch_q21/duckdb:vortex-file-compressed	691085979 / 583990337 / +18.3%	743407136 / 673849582 / +10.3%	0.93 / 0.87 / +7.3%
tpch_q22/duckdb:vortex-file-compressed	117537589 / 110939509 / +5.9%	160927135 / 172826612 / -6.9%	0.73 / 0.64 / +13.8%

duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	318978594 / 343826424 / -7.2%	495299570 / 388429629 / +27.5%	0.64 / 0.89 / -27.2%
tpch_q02/duckdb:parquet	678960203 / 681702858 / -0.4%	714440822 / 612375392 / +16.7%	0.95 / 1.11 / -14.6%
tpch_q03/duckdb:parquet	801965466 / 820065023 / -2.2%	809008052 / 855580920 / -5.4%	0.99 / 0.96 / +3.4%
tpch_q04/duckdb:parquet	469724908 / 478695305 / -1.9%	629074953 / 510499139 / +23.2%	0.75 / 0.94 / -20.4%
tpch_q05/duckdb:parquet	905300015 / 1049145397 / -13.7%	938818835 / 995316998 / -5.7%	0.96 / 1.05 / -8.5%
tpch_q06/duckdb:parquet	316291087 / 327934491 / -3.6%	256831113 / 331863913 / -22.6%	1.23 / 0.99 / +24.6%
tpch_q07/duckdb:parquet	926555742 / 864143778 / +7.2%	925875303 / 846019874 / +9.4%	1.00 / 1.02 / -2.0%
tpch_q08/duckdb:parquet	1084156623 / 1098708524 / -1.3%	1117639423 / 1131704729 / -1.2%	0.97 / 0.97 / -0.1%
tpch_q09/duckdb:parquet	1063268051 / 1068460646 / -0.5%	1135826939 / 1143230050 / -0.6%	0.94 / 0.93 / +0.2%
tpch_q10/duckdb:parquet	1021117792 / 1013933854 / +0.7%	1089394626 / 1034486227 / +5.3%	0.94 / 0.98 / -4.4%
tpch_q11/duckdb:parquet	452474465 / 410670435 / +10.2%	480982700 / 464699969 / +3.5%	0.94 / 0.88 / +6.4%
tpch_q12/duckdb:parquet	563686826 / 554412817 / +1.7%	592653834 / 638119012 / -7.1%	0.95 / 0.87 / +9.5%
tpch_q13/duckdb:parquet	843463201 / 835194716 / +1.0%	878463805 / 897351755 / -2.1%	0.96 / 0.93 / +3.2%
tpch_q14/duckdb:parquet	535498223 / 530929019 / +0.9%	648620265 / 485284311 / +33.7% 🔴	0.83 / 1.09 / -24.5%
tpch_q15/duckdb:parquet	379823009 / 365184129 / +4.0%	402365207 / 471534924 / -14.7%	0.94 / 0.77 / +21.9%
tpch_q16/duckdb:parquet	517364625 / 528761523 / -2.2%	529969872 / 535664439 / -1.1%	0.98 / 0.99 / -1.1%
tpch_q17/duckdb:parquet	518241611 / 482845487 / +7.3%	608115830 / 549686881 / +10.6%	0.85 / 0.88 / -3.0%
tpch_q18/duckdb:parquet	673021235 / 664649784 / +1.3%	682420785 / 707954704 / -3.6%	0.99 / 0.94 / +5.0%
tpch_q19/duckdb:parquet	603615418 / 568634451 / +6.2%	561662510 / 647080268 / -13.2%	1.07 / 0.88 / +22.3%
tpch_q20/duckdb:parquet	897668437 / 904881526 / -0.8%	924435443 / 924126667 / +0.0%	0.97 / 0.98 / -0.8%
tpch_q21/duckdb:parquet	769633524 / 787760579 / -2.3%	791490682 / 805627074 / -1.8%	0.97 / 0.98 / -0.6%
tpch_q22/duckdb:parquet	439319493 / 455155895 / -3.5%	438475115 / 501872130 / -12.6%	1.00 / 0.91 / +10.5%

joseph-isaacs · 2026-08-25T13:00:02Z

+pub fn reader_initialize(
+    file: &mut OpenFileReader,
+    global: &GlobalState,
+    mut ordered: bool,


move ordered into global

joseph-isaacs · 2026-08-25T13:06:17Z

+
+query I
+SELECT id FROM '${WORK_DIR}/chunk-offset.vortex' LIMIT 1;


comment????

github-actions · 2026-08-25T13:12:57Z

Benchmarks: String Encoding 📖

Commits: PR 6554a829 vs base 17bd9e27

vortex / vortex-file-compressed / ms (1.004x ➖, 0↑ 0↓)

name	ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst	48.526791 / 48.575839 / -0.1%
read/clickbench/URL/shard-0/onpair-12	37.342597 / 38.017365 / -1.8%
read/tpch/l_comment/fsst	96.999077 / 96.458862 / +0.6%
read/tpch/l_comment/onpair-12	110.763516 / 107.643914 / +2.9%
write/clickbench/URL/shard-0/fsst	866.217659 / 868.769656 / -0.3%
write/clickbench/URL/shard-0/onpair-12	2045.45325 / 2037.84467 / +0.4%
write/tpch/l_comment/fsst	3099.40494 / 3081.93447 / +0.6%
write/tpch/l_comment/onpair-12	3982.24619 / 3946.09877 / +0.9%

vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)

name	% (PR / base / %diff)
size/clickbench/URL/shard-0/fsst	47.4687942 / 47.4687942 / +0.0%
size/clickbench/URL/shard-0/onpair-12	29.7508863 / 29.7508863 / +0.0%
size/tpch/l_comment/fsst	30.5060597 / 30.5060597 / +0.0%
size/tpch/l_comment/onpair-12	23.2389616 / 23.2389616 / +0.0%

github-actions · 2026-08-25T13:24:36Z

Benchmarks: Random Access 📖

Commits: PR 6554a829 vs base 17bd9e27
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: random-access No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 1.004x ➖
Parquet (geomean): hot 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk	1474530 / 1505340 / -2.0%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer	609483 / 604367 / +0.8%
random-access/feature-vectors/uniform/vortex-tokio-local-disk	2634192 / 2647858 / -0.5%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer	3089234 / 3057460 / +1.0%
random-access/nested-lists/correlated/vortex-tokio-local-disk	282622 / 284515 / -0.7%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer	351918 / 349278 / +0.8%
random-access/nested-lists/uniform/vortex-tokio-local-disk	1474252 / 1484567 / -0.7%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer	1638412 / 1572248 / +4.2%
random-access/nested-structs/correlated/vortex-tokio-local-disk	324632 / 318332 / +2.0%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer	471678 / 467959 / +0.8%
random-access/nested-structs/uniform/vortex-tokio-local-disk	1023025 / 1100929 / -7.1%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer	1210419 / 1185040 / +2.1%
random-access/taxi/correlated/vortex-tokio-local-disk	897963 / 868729 / +3.4%
random-access/taxi/correlated/vortex-tokio-local-disk-footer	1353121 / 1355361 / -0.2%
random-access/taxi/uniform/vortex-tokio-local-disk	4052169 / 3989245 / +1.6%
random-access/taxi/uniform/vortex-tokio-local-disk-footer	4768090 / 4755986 / +0.3%
random-access/vortex-tokio-local-disk	523593 / 528296 / -0.9%
random-access/vortex-tokio-local-disk-footer	943735 / 912050 / +3.5%

random-access / parquet / ns (1.000x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk	9053793199 / 8923651827 / +1.5%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer	9049564845 / 8971992359 / +0.9%
random-access/feature-vectors/uniform/parquet-tokio-local-disk	8995759087 / 8976632125 / +0.2%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer	9125426591 / 9103417426 / +0.2%
random-access/nested-lists/correlated/parquet-tokio-local-disk	137070633 / 139466673 / -1.7%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer	135819863 / 136099625 / -0.2%
random-access/nested-lists/uniform/parquet-tokio-local-disk	135200442 / 134384123 / +0.6%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer	136451696 / 134907734 / +1.1%
random-access/nested-structs/correlated/parquet-tokio-local-disk	20062041 / 20568297 / -2.5%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer	19202904 / 19246510 / -0.2%
random-access/nested-structs/uniform/parquet-tokio-local-disk	19356663 / 19314853 / +0.2%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer	18972060 / 19372814 / -2.1%
random-access/parquet-tokio-local-disk	183060693 / 182334299 / +0.4%
random-access/parquet-tokio-local-disk-footer	181078496 / 181094924 / -0.0%
random-access/taxi/correlated/parquet-tokio-local-disk	274505435 / 273898703 / +0.2%
random-access/taxi/correlated/parquet-tokio-local-disk-footer	271419446 / 272605796 / -0.4%
random-access/taxi/uniform/parquet-tokio-local-disk	289281875 / 286283024 / +1.0%
random-access/taxi/uniform/parquet-tokio-local-disk-footer	290709934 / 287889257 / +1.0%

random-access / lance / ns (1.005x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk	347257 / 350409 / -0.9%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer	1206331 / 1103736 / +9.3%
random-access/feature-vectors/uniform/lance-tokio-local-disk	1117946 / 1080226 / +3.5%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer	1846118 / 1836184 / +0.5%
random-access/lance-tokio-local-disk	632700 / 638675 / -0.9%
random-access/lance-tokio-local-disk-footer	1359787 / 1371020 / -0.8%
random-access/nested-lists/correlated/lance-tokio-local-disk	188687 / 188462 / +0.1%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer	575812 / 580829 / -0.9%
random-access/nested-lists/uniform/lance-tokio-local-disk	913839 / 896340 / +2.0%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer	1308537 / 1328139 / -1.5%
random-access/nested-structs/correlated/lance-tokio-local-disk	312534 / 309992 / +0.8%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer	453735 / 463704 / -2.1%
random-access/nested-structs/uniform/lance-tokio-local-disk	2451519 / 2427372 / +1.0%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer	2570464 / 2536151 / +1.4%
random-access/taxi/correlated/lance-tokio-local-disk	950295 / 962628 / -1.3%
random-access/taxi/correlated/lance-tokio-local-disk-footer	1860939 / 1873975 / -0.7%
random-access/taxi/uniform/lance-tokio-local-disk	9945148 / 10037511 / -0.9%
random-access/taxi/uniform/lance-tokio-local-disk-footer	10677447 / 10560842 / +1.1%

test

6554a82

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>

myrrc added changelog/fix A bug fix ext/duckdb Relates to the DuckDB integration action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Aug 25, 2026

myrrc enabled auto-merge (squash) August 25, 2026 10:33

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 25, 2026

myrrc disabled auto-merge August 25, 2026 10:34

myrrc enabled auto-merge (squash) August 25, 2026 10:49

myrrc requested a review from joseph-isaacs August 25, 2026 10:49

joseph-isaacs reviewed Aug 25, 2026

View reviewed changes

joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 25, 2026

github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 25, 2026

joseph-isaacs reviewed Aug 25, 2026

View reviewed changes


		query I
		SELECT id FROM '${WORK_DIR}/chunk-offset.vortex' LIMIT 1;

Uh oh!

Conversation

myrrc commented Aug 25, 2026

Uh oh!

codspeed-hq Bot commented Aug 25, 2026

Merging this PR will regress 3 benchmarks

Performance Changes

Footnotes

Uh oh!

github-actions Bot commented Aug 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions Bot commented Aug 25, 2026

Benchmarks: PolarSignals Profiling 📖

Uh oh!

github-actions Bot commented Aug 25, 2026

Benchmarks: FineWeb NVMe 📖

Uh oh!

github-actions Bot commented Aug 25, 2026

Benchmarks: TPC-H SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Aug 25, 2026

Benchmarks: Clickbench Sorted on NVME 📖

Uh oh!

github-actions Bot commented Aug 25, 2026

Benchmarks: TPC-DS SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Aug 25, 2026

Benchmarks: TPC-H SF=10 on NVME 📖

Uh oh!

github-actions Bot commented Aug 25, 2026

Benchmarks: Statistical and Population Genetics 📖

Uh oh!

github-actions Bot commented Aug 25, 2026

Benchmarks: FineWeb S3 📖

Uh oh!

github-actions Bot commented Aug 25, 2026

Benchmarks: Clickbench on NVME 📖

Uh oh!

github-actions Bot commented Aug 25, 2026

Benchmarks: TPC-H SF=1 on S3 📖

Uh oh!

joseph-isaacs Aug 25, 2026

Choose a reason for hiding this comment

Uh oh!

joseph-isaacs Aug 25, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions Bot commented Aug 25, 2026

Benchmarks: String Encoding 📖

Uh oh!

github-actions Bot commented Aug 25, 2026

Benchmarks: Random Access 📖

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

github-actions Bot commented Aug 25, 2026 •

edited

Loading