Skip to content

Add BlockedFoR: a frame of reference per 1024 values - #9609

Draft
joseph-isaacs wants to merge 7 commits into
developfrom
claude/array-compression-sampling-qqbhm7
Draft

Add BlockedFoR: a frame of reference per 1024 values#9609
joseph-isaacs wants to merge 7 commits into
developfrom
claude/array-compression-sampling-qqbhm7

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Summary

FoR subtracts one minimum from a whole array, so the single bit width BitPacking then picks is driven by the spread of the entire array. Data that stays tightly clustered locally but drifts over the array — sorted keys, timestamps, counters, FSST/list offset vectors — pays for that global spread on every value.

BlockedFoR stores one reference per 1024-value block (the FastLanes chunk size, so a block lines up exactly with a bit-packing chunk). The residual bit width is then set by the widest block rather than by the array. The references live in a child array, which the cascading compressor compresses in turn, so the overhead is 8 bytes per 1024 values before that child is itself compressed.

This PR is additive and opt-in. ALL_SCHEMES is unchanged from develop, no golden snapshot changes, and no default write path can select the new encoding. Nothing here alters compressed output or query performance as merged; it lands the encoding so it can be evaluated and, if it earns its place, promoted later.

Changes

encodings/fastlanes/src/blocked_for/ — the new fastlanes.blockedfor encoding.

  • BlockedFoRData::encode splits into 1024-value blocks and subtracts each block's minimum. Nulls encode as a zero residual, exactly as FoR does, so they decode back to their block's reference instead of wrapping out of the primitive range.
  • A < 1024 block offset in metadata makes slicing exact without re-encoding, mirroring how BitPacked handles the same problem: a slice keeps the blocks it overlaps and records where inside the first one it starts.
  • block_summary is a single linear pass returning the widest per-block range and whether every block minimum is already zero. The scheme uses it to decide.
  • Serde, statistics, validity, canonicalization and slicing follow the existing FoR vtable layout. New golden metadata file at encodings/fastlanes/goldenfiles/blockedfor.metadata.

vortex-btrblocks/src/schemes/integer/blocked_for.rsBlockedFoRScheme, deliberately not in ALL_SCHEMES.

An encoding must belong to an enabled edition before the writer will serialize it, and fastlanes.blockedfor is a preview member. A feature flag cannot express "this session's editions permit this encoding" — vortex-file/unstable_encodings enables vortex-btrblocks/unstable_encodings without enabling vortex/unstable_encodings, which is what gates the preview edition — so the scheme is opted into explicitly instead:

BtrBlocksCompressorBuilder::default()
    .with_new_scheme(&BlockedFoRScheme)
    .build()

That keeps the invariant that matters: no default write path can produce an array the file writer cannot serialize. Paths that build a WriteStrategyBuilder directly (vortex-ffi, vortex-python, vortex-tui, the CUDA writers) leave the encoding policy unset, so nothing would filter a scheme that slipped into the default set. Pinned by default_schemes_exclude_blocked_for.

The scheme produces only BlockedFoR and returns Skip wherever a single global reference is the better shape — single-block arrays, block-constant arrays, and data whose blocks span the same range as the array. FoRScheme competes for those on its own estimate. Declaring one produced encoding rather than two also keeps retain_allowed_encodings correct: a policy permitting fastlanes.for but not fastlanes.blockedfor drops only the blocked scheme and keeps frame of reference, pinned by retain_allowed_encodings_keeps_global_for_without_blocked.

vortex/src/editions/preview/v2026_08.rsfastlanes.blockedfor joins the new PREVIEW_2026_08_0 edition, following how fastlanes.delta landed, and DEFAULT_PREVIEW_EDITION advances to it.

What this buys, measured

Compressed array bytes at 131072-row chunks, with vortex-btrblocks's plain scheme set (no pco, zstd, or unstable_encodings) plus BlockedFoRScheme:

dataset overall on the columns that changed
TPC-H lineitem sf=0.1 4.17% l_orderkey 18.3%, l_comment 6.8%
ClickBench hits (1M rows) 0.22% 2.53% over 44 columns
NYC taxi 2023-11 0.18% 0.99% over 4 columns

Chunk size dominates — the bigger the compression unit, the more a single global reference costs. On lineitem: 2.56% at 8192 rows, 4.89% at 65536, 5.77% at 1M. Compression time was a wash (−5.7% on lineitem, −7.1% on ClickBench, i.e. noise-level).

With unstable_encodings on, Delta wins these shapes. After #9602 priced its bases and tail padding correctly, Delta beats the blocked scheme wherever both apply — every unstable__* golden case is unchanged by adding BlockedFoRScheme. So the numbers above describe the default scheme set; that is the honest scope of the win today.

Because the scheme is out of the default set, the standard benchmark suites cannot exercise it: nothing opts it in, so a bench-* run on this PR measures a build that compresses byte-identically to develop. The numbers above come from a purpose-built harness that adds the scheme explicitly.

Known cost, and what is not done

FoR's filter push-down does not apply to this encoding. Filtering renumbers rows, which breaks the row-to-block mapping, so a Filter over a BlockedFoR array materializes it rather than staying encoded. Any caller opting the scheme in trades that for the size win, and it is not benchmarked here.

Also out of scope: no fused unpack path (decode adds a separate reference-addition pass instead of folding into unchecked_unfor_pack the way FoR does), no CUDA kernel, and no specialized compare/is_sorted/is_constant/cast kernels — those decompress first. Promotion to a core edition, and with it selection by default, is a separate decision.

Testing

encodings/fastlanes/src/blocked_for/tests.rs covers round-trips across integer ptypes, nulls (including all-null blocks), non-block-aligned lengths, single-block arrays, slicing at and across block boundaries, serde, and the property the encoding exists for — blocked_references_narrow_the_bit_width asserts 7 bits blocked vs 24 global on the same data, independent of feature flags.

In vortex-btrblocks: test_blocked_for_compressed (drifting data selects it when opted in), test_blocked_for_falls_back_to_global_for (no local clustering leaves it to FoR), default_schemes_exclude_blocked_for, and retain_allowed_encodings_keeps_global_for_without_blocked.

Checks run: cargo test -p vortex-btrblocks -p vortex-fastlanes across default, pco, --all-features, and --no-default-features; cargo test -p vortex --lib editions; cargo test -p vortex-file -p vortex-layout; cargo clippy --all-targets over default, pco, zstd, --all-features, and --no-default-features; cargo +nightly fmt --all. I could not run a workspace-wide build — lance-encoding fails on a missing protoc in this container, unrelated to this change.

@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 25, 2026 — with Claude
FoR subtracts one minimum from a whole array, so the single bit width
BitPacking then picks is driven by the spread of the entire array. Data
that stays tightly clustered locally but drifts over the array — sorted
keys, timestamps, counters, offset vectors — pays for that spread on
every value.

BlockedFoR stores one reference per 1024-value block (the FastLanes
chunk size), so the residual bit width is set by the widest block
instead. The references live in a child array, which the cascading
compressor compresses in turn; a `offset` in metadata (< 1024) keeps
slicing exact, mirroring BitPacked.

BlockedFoRScheme replaces FoRScheme in ALL_SCHEMES, and falls back to
plain FoR whenever per-block references buy no bits: single-block
arrays, block-constant arrays, and data whose blocks span the same
range as the array. The CUDA preset keeps FoR, which has a GPU decode
kernel.

Filter push-down does not apply to this encoding: filtering renumbers
rows, which breaks the row-to-block mapping. Arrays that fall back to
FoR keep it.

Measured on compressed array bytes at 131072-row chunks:
  TPC-H lineitem sf=0.1  4.17% smaller (l_orderkey 18.3%, l_comment 6.8%)
  ClickBench hits 1M     2.53% over the 44 columns that changed
  NYC taxi 2023-11       0.99% over the 4 columns that changed

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs force-pushed the claude/array-compression-sampling-qqbhm7 branch from e73811d to e3dfefe Compare August 25, 2026 13:19
Regenerated the golden snapshots against the merged code: develop's
delta estimate fix (#9602) and BlockedFoR both target the same shapes,
so the unstable snapshots now match develop and only the default-feature
ones change.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. and removed action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. labels Aug 25, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 25, 2026
@joseph-isaacs joseph-isaacs added changelog/feature A new feature action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. labels Aug 25, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 25, 2026
@codspeed-hq

codspeed-hq Bot commented Aug 25, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 0.75%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 3 improved benchmarks
❌ 1 regressed benchmark
✅ 2093 untouched benchmarks
⏩ 106 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime arrow_checked_add_u32_neon[16384] 13.6 µs 20.3 µs -33.13%
WallTime words_gather_scalar_avx2[65536] 9.4 µs 8.2 µs +14.01%
WallTime mul_u32_nonnull_avx512 6.3 µs 5.6 µs +12.87%
Simulation cold_misaligned[(16, 64)] 389.9 µs 345.8 µs +12.76%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing claude/array-compression-sampling-qqbhm7 (ee07a98) with develop (253137f)

Open in CodSpeed

Footnotes

  1. 106 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions

github-actions Bot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done ee07a98 tpch-nvme-10 1 Explore Profiling Data
🟢 Done ee07a98 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done ee07a98 appian-nvme 1 Explore Profiling Data
🟢 Done ee07a98 statpopgen 1 Explore Profiling Data
🟢 Done ee07a98 tpch-nvme 1 Explore Profiling Data
🟢 Done ee07a98 tpcds-nvme 1 Explore Profiling Data
🟢 Done ee07a98 tpch-s3 1 Explore Profiling Data
🟢 Done ee07a98 compress-bench 1 Explore Profiling Data
🟢 Done ee07a98 random-access-bench 1 Explore Profiling Data
🟢 Done ee07a98 clickbench-nvme 1 Explore Profiling Data
🟢 Done ee07a98 tpch-s3-10 1 Explore Profiling Data
🟢 Done ee07a98 polarsignals 1 Explore Profiling Data
🟢 Done ee07a98 fineweb-s3 1 Explore Profiling Data
🟢 Done ee07a98 fineweb 1 Explore Profiling Data
🟢 Done ee07a98 string-bench 1 Explore Profiling Data
Previous Runs (5)
Status Commit Job Attempt Link
🟢 Done 59730f8 clickbench-nvme 1 Explore Profiling Data
🟢 Done 59730f8 compress-bench 1 Explore Profiling Data
🟢 Done 59730f8 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 59730f8 string-bench 1 Explore Profiling Data
🟢 Done 59730f8 random-access-bench 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR ee07a98a vs base 65285d66


vortex / vortex-file-compressed / ms (1.000x ➖, 0↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 53.138271 / 53.279656 / -0.3%
read/clickbench/URL/shard-0/onpair-12 37.077976 / 37.737935 / -1.7%
read/tpch/l_comment/fsst 111.220606 / 112.293323 / -1.0%
read/tpch/l_comment/onpair-12 109.922559 / 110.265145 / -0.3%
write/clickbench/URL/shard-0/fsst 883.881577 / 886.751871 / -0.3%
write/clickbench/URL/shard-0/onpair-12 2126.40099 / 2067.15527 / +2.9%
write/tpch/l_comment/fsst 3175.94898 / 3204.85196 / -0.9%
write/tpch/l_comment/onpair-12 4175.56338 / 4094.86269 / +2.0%
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 46.3396437 / 46.3396054 / +0.0%
size/clickbench/URL/shard-0/onpair-12 29.7417128 / 29.7416746 / +0.0%
size/tpch/l_comment/fsst 26.8917714 / 26.8917553 / +0.0%
size/tpch/l_comment/onpair-12 22.6667905 / 22.6667744 / +0.0%

@github-actions

github-actions Bot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR ee07a98a vs base 65285d66
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: random-access No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 1.003x ➖
Parquet (geomean): hot 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 332806 / 321479 / +3.5%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 616839 / 602346 / +2.4%
random-access/feature-vectors/uniform/vortex-tokio-local-disk 2652271 / 2607132 / +1.7%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 3076661 / 3081429 / -0.2%
random-access/nested-lists/correlated/vortex-tokio-local-disk 300955 / 290002 / +3.8%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 368300 / 365644 / +0.7%
random-access/nested-lists/uniform/vortex-tokio-local-disk 1632210 / 1670157 / -2.3%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 1765884 / 1761298 / +0.3%
random-access/nested-structs/correlated/vortex-tokio-local-disk 340662 / 323577 / +5.3%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 453331 / 475029 / -4.6%
random-access/nested-structs/uniform/vortex-tokio-local-disk 1060775 / 1079345 / -1.7%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1214486 / 1217800 / -0.3%
random-access/taxi/correlated/vortex-tokio-local-disk 929007 / 911010 / +2.0%
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1377986 / 1410642 / -2.3%
random-access/taxi/uniform/vortex-tokio-local-disk 4084119 / 4019648 / +1.6%
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4826764 / 4828142 / -0.0%
random-access/vortex-tokio-local-disk 586876 / 605800 / -3.1%
random-access/vortex-tokio-local-disk-footer 988753 / 1000596 / -1.2%
random-access / parquet / ns (1.004x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8970308817 / 8919083718 / +0.6%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 9190537599 / 9004712026 / +2.1%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 9013290690 / 9065566702 / -0.6%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 9090066557 / 8939328224 / +1.7%
random-access/nested-lists/correlated/parquet-tokio-local-disk 138217850 / 138641498 / -0.3%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 138045762 / 134491977 / +2.6%
random-access/nested-lists/uniform/parquet-tokio-local-disk 137301670 / 134238157 / +2.3%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 134873057 / 135920343 / -0.8%
random-access/nested-structs/correlated/parquet-tokio-local-disk 19979782 / 20494535 / -2.5%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 19244159 / 19195372 / +0.3%
random-access/nested-structs/uniform/parquet-tokio-local-disk 19066764 / 18883799 / +1.0%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 19666407 / 19525956 / +0.7%
random-access/parquet-tokio-local-disk 182633527 / 182987194 / -0.2%
random-access/parquet-tokio-local-disk-footer 181135816 / 180376484 / +0.4%
random-access/taxi/correlated/parquet-tokio-local-disk 274167891 / 271975110 / +0.8%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 269916497 / 270153424 / -0.1%
random-access/taxi/uniform/parquet-tokio-local-disk 289422262 / 287449347 / +0.7%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 288096839 / 290228304 / -0.7%
random-access / lance / ns (0.798x ✅, 1↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 361238 / 21947703 / -98.4% 🟢
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1136769 / 1110735 / +2.3%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1085464 / 1109867 / -2.2%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1896932 / 1844045 / +2.9%
random-access/lance-tokio-local-disk 643911 / 623584 / +3.3%
random-access/lance-tokio-local-disk-footer 1373698 / 1368702 / +0.4%
random-access/nested-lists/correlated/lance-tokio-local-disk 185951 / 187431 / -0.8%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 592433 / 581950 / +1.8%
random-access/nested-lists/uniform/lance-tokio-local-disk 915459 / 898416 / +1.9%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1317397 / 1320028 / -0.2%
random-access/nested-structs/correlated/lance-tokio-local-disk 316762 / 316510 / +0.1%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 451326 / 458690 / -1.6%
random-access/nested-structs/uniform/lance-tokio-local-disk 2443924 / 2423709 / +0.8%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2536360 / 2593259 / -2.2%
random-access/taxi/correlated/lance-tokio-local-disk 947974 / 950017 / -0.2%
random-access/taxi/correlated/lance-tokio-local-disk-footer 1860987 / 1880181 / -1.0%
random-access/taxi/uniform/lance-tokio-local-disk 9923555 / 10102254 / -1.8%
random-access/taxi/uniform/lance-tokio-local-disk-footer 10546215 / 10526463 / +0.2%

@github-actions

github-actions Bot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR ee07a98a vs base 479bd98a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -5.3%
Engines: DataFusion No clear signal (-11.0%, low confidence) · DuckDB No clear signal (+0.7%, environment too noisy confidence)
Vortex (geomean): hot 0.969x ➖ · cold 0.958x ➖
Parquet (geomean): hot 1.024x ➖ · cold 0.996x ➖
Shifts: Parquet (control) +2.4% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.909x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 223914347 / 534361192 / -58.1% 🟢 505984710 / 977925243 / -48.3% 🟢 0.44 / 0.55 / -19.0%
clickbench-sorted_q24/datafusion:vortex-file-compressed 26025562 / 28711954 / -9.4% 93112847 / 86077626 / +8.2% 0.28 / 0.33 / -16.2%
clickbench-sorted_q26/datafusion:vortex-file-compressed 26959078 / 25725570 / +4.8% 92961454 / 94972973 / -2.1% 0.29 / 0.27 / +7.1%
clickbench-sorted_q36/datafusion:vortex-file-compressed 52915914 / 52061320 / +1.6% 122927023 / 127368819 / -3.5% 0.43 / 0.41 / +5.3%
clickbench-sorted_q37/datafusion:vortex-file-compressed 40013752 / 39955588 / +0.1% 110144228 / 107959495 / +2.0% 0.36 / 0.37 / -1.8%
clickbench-sorted_q38/datafusion:vortex-file-compressed 51016374 / 53077622 / -3.9% 113532325 / 114861954 / -1.2% 0.45 / 0.46 / -2.8%
clickbench-sorted_q39/datafusion:vortex-file-compressed 125303702 / 124553605 / +0.6% 204067598 / 203002433 / +0.5% 0.61 / 0.61 / +0.1%
clickbench-sorted_q40/datafusion:vortex-file-compressed 20927130 / 20886411 / +0.2% 80501062 / 77254389 / +4.2% 0.26 / 0.27 / -3.8%
clickbench-sorted_q41/datafusion:vortex-file-compressed 20670290 / 20647507 / +0.1% 81859013 / 76217147 / +7.4% 0.25 / 0.27 / -6.8%
clickbench-sorted_q42/datafusion:vortex-file-compressed 15831199 / 16211655 / -2.3% 66666737 / 65904680 / +1.2% 0.24 / 0.25 / -3.5%
datafusion / vortex-compact / ns (0.929x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 228641354 / 467902797 / -51.1% 🟢 448864622 / 790968256 / -43.3% 🟢 0.51 / 0.59 / -13.9%
clickbench-sorted_q24/datafusion:vortex-compact 59335320 / 56619467 / +4.8% 108778633 / 115440820 / -5.8% 0.55 / 0.49 / +11.2%
clickbench-sorted_q26/datafusion:vortex-compact 55133726 / 58075996 / -5.1% 113473323 / 114952803 / -1.3% 0.49 / 0.51 / -3.8%
clickbench-sorted_q36/datafusion:vortex-compact 57276820 / 56788742 / +0.9% 133939739 / 133922467 / +0.0% 0.43 / 0.42 / +0.8%
clickbench-sorted_q37/datafusion:vortex-compact 48650725 / 48654634 / -0.0% 118511078 / 120608386 / -1.7% 0.41 / 0.40 / +1.8%
clickbench-sorted_q38/datafusion:vortex-compact 44164348 / 44486682 / -0.7% 117820187 / 112315654 / +4.9% 0.37 / 0.40 / -5.4%
clickbench-sorted_q39/datafusion:vortex-compact 105535736 / 107812326 / -2.1% 187517380 / 179496094 / +4.5% 0.56 / 0.60 / -6.3%
clickbench-sorted_q40/datafusion:vortex-compact 28011333 / 27653007 / +1.3% 79890724 / 81528877 / -2.0% 0.35 / 0.34 / +3.4%
clickbench-sorted_q41/datafusion:vortex-compact 22577784 / 22684890 / -0.5% 78634468 / 76583232 / +2.7% 0.29 / 0.30 / -3.1%
clickbench-sorted_q42/datafusion:vortex-compact 15770306 / 15778900 / -0.1% 64509548 / 68806336 / -6.2% 0.24 / 0.23 / +6.6%
datafusion / parquet / ns (1.032x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 2903492688 / 2896509000 / +0.2% 3485220499 / 3406530824 / +2.3% 0.83 / 0.85 / -2.0%
clickbench-sorted_q24/datafusion:parquet 33438973 / 32196501 / +3.9% 149480962 / 151764626 / -1.5% 0.22 / 0.21 / +5.4%
clickbench-sorted_q26/datafusion:parquet 34309606 / 33312542 / +3.0% 157114447 / 157280665 / -0.1% 0.22 / 0.21 / +3.1%
clickbench-sorted_q36/datafusion:parquet 168961720 / 165010870 / +2.4% 309617639 / 306587733 / +1.0% 0.55 / 0.54 / +1.4%
clickbench-sorted_q37/datafusion:parquet 103915055 / 100954597 / +2.9% 225776935 / 229175715 / -1.5% 0.46 / 0.44 / +4.5%
clickbench-sorted_q38/datafusion:parquet 155185602 / 154644261 / +0.4% 286243804 / 295114786 / -3.0% 0.54 / 0.52 / +3.5%
clickbench-sorted_q39/datafusion:parquet 292145531 / 293485545 / -0.5% 433540768 / 457094374 / -5.2% 0.67 / 0.64 / +5.0%
clickbench-sorted_q40/datafusion:parquet 66414839 / 58808577 / +12.9% 🔴 194898278 / 192746989 / +1.1% 0.34 / 0.31 / +11.7%
clickbench-sorted_q41/datafusion:parquet 62706396 / 58713826 / +6.8% 191260125 / 185226739 / +3.3% 0.33 / 0.32 / +3.4%
clickbench-sorted_q42/datafusion:parquet 34489457 / 34112716 / +1.1% 148058536 / 146950366 / +0.8% 0.23 / 0.23 / +0.3%
duckdb / vortex-file-compressed / ns (1.032x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 118099054 / 114969496 / +2.7% 186602392 / 190247712 / -1.9% 0.63 / 0.60 / +4.7%
clickbench-sorted_q24/duckdb:vortex-file-compressed 30312306 / 26925702 / +12.6% 🔴 74073045 / 77527715 / -4.5% 0.41 / 0.35 / +17.8%
clickbench-sorted_q26/duckdb:vortex-file-compressed 30353403 / 27391564 / +10.8% 🔴 73507917 / 77199564 / -4.8% 0.41 / 0.35 / +16.4%
clickbench-sorted_q36/duckdb:vortex-file-compressed 72909816 / 74061852 / -1.6% 196657972 / 186265199 / +5.6% 0.37 / 0.40 / -6.8%
clickbench-sorted_q37/duckdb:vortex-file-compressed 61764231 / 61849096 / -0.1% 159807457 / 165766552 / -3.6% 0.39 / 0.37 / +3.6%
clickbench-sorted_q38/duckdb:vortex-file-compressed 74612070 / 79393430 / -6.0% 174294148 / 177125900 / -1.6% 0.43 / 0.45 / -4.5%
clickbench-sorted_q39/duckdb:vortex-file-compressed 177471603 / 169122400 / +4.9% 264092445 / 285905899 / -7.6% 0.67 / 0.59 / +13.6%
clickbench-sorted_q40/duckdb:vortex-file-compressed 33837426 / 32581667 / +3.9% 114396583 / 110628401 / +3.4% 0.30 / 0.29 / +0.4%
clickbench-sorted_q41/duckdb:vortex-file-compressed 33231878 / 32825961 / +1.2% 117695885 / 114893764 / +2.4% 0.28 / 0.29 / -1.2%
clickbench-sorted_q42/duckdb:vortex-file-compressed 30602875 / 29063176 / +5.3% 107094926 / 116310723 / -7.9% 0.29 / 0.25 / +14.4%
duckdb / vortex-compact / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 127488993 / 116225819 / +9.7% 185334033 / 203493756 / -8.9% 0.69 / 0.57 / +20.4%
clickbench-sorted_q24/duckdb:vortex-compact 32505226 / 31193766 / +4.2% 80061479 / 93870082 / -14.7% 🟢 0.41 / 0.33 / +22.2%
clickbench-sorted_q26/duckdb:vortex-compact 30568854 / 29060502 / +5.2% 89184422 / 93344187 / -4.5% 0.34 / 0.31 / +10.1%
clickbench-sorted_q36/duckdb:vortex-compact 72984766 / 75750106 / -3.7% 195520325 / 213546545 / -8.4% 0.37 / 0.35 / +5.2%
clickbench-sorted_q37/duckdb:vortex-compact 61874546 / 62639898 / -1.2% 173722197 / 196119673 / -11.4% 🟢 0.36 / 0.32 / +11.5%
clickbench-sorted_q38/duckdb:vortex-compact 65658290 / 65264929 / +0.6% 174738044 / 180178065 / -3.0% 0.38 / 0.36 / +3.7%
clickbench-sorted_q39/duckdb:vortex-compact 124273640 / 125206370 / -0.7% 267245318 / 254760907 / +4.9% 0.47 / 0.49 / -5.4%
clickbench-sorted_q40/duckdb:vortex-compact 35677468 / 33205967 / +7.4% 124670576 / 126583916 / -1.5% 0.29 / 0.26 / +9.1%
clickbench-sorted_q41/duckdb:vortex-compact 35261702 / 35084886 / +0.5% 128549346 / 123450755 / +4.1% 0.27 / 0.28 / -3.5%
clickbench-sorted_q42/duckdb:vortex-compact 25011336 / 27200740 / -8.0% 109926454 / 101990169 / +7.8% 0.23 / 0.27 / -14.7%
duckdb / parquet / ns (1.015x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 216812731 / 236550034 / -8.3% 269159855 / 276419036 / -2.6% 0.81 / 0.86 / -5.9%
clickbench-sorted_q24/duckdb:parquet 33684904 / 35893048 / -6.2% 65554336 / 65522875 / +0.0% 0.51 / 0.55 / -6.2%
clickbench-sorted_q26/duckdb:parquet 32432330 / 25103884 / +29.2% 🔴 43511964 / 48146024 / -9.6% 0.75 / 0.52 / +43.0%
clickbench-sorted_q36/duckdb:parquet 72183865 / 71387892 / +1.1% 101339303 / 102196844 / -0.8% 0.71 / 0.70 / +2.0%
clickbench-sorted_q37/duckdb:parquet 59439930 / 58865670 / +1.0% 93707728 / 89446672 / +4.8% 0.63 / 0.66 / -3.6%
clickbench-sorted_q38/duckdb:parquet 61353954 / 62152878 / -1.3% 92747321 / 92057012 / +0.7% 0.66 / 0.68 / -2.0%
clickbench-sorted_q39/duckdb:parquet 109707903 / 107395832 / +2.2% 163440293 / 155539660 / +5.1% 0.67 / 0.69 / -2.8%
clickbench-sorted_q40/duckdb:parquet 29263171 / 29379860 / -0.4% 69267178 / 71414867 / -3.0% 0.42 / 0.41 / +2.7%
clickbench-sorted_q41/duckdb:parquet 29770560 / 29136530 / +2.2% 63480967 / 63337082 / +0.2% 0.47 / 0.46 / +1.9%
clickbench-sorted_q42/duckdb:parquet 20493632 / 20502173 / -0.0% 46593374 / 46358038 / +0.5% 0.44 / 0.44 / -0.5%

File Size Changes (200 files changed, +0.0% overall, 98↑ 102↓)
File Scale Format Base HEAD Change %
hits_061.vortex 1.0 vortex-compact 123.76 MB 125.70 MB +1.95 MB +1.6%
hits_078.vortex 1.0 vortex-compact 96.96 MB 98.20 MB +1.24 MB +1.3%
hits_087.vortex 1.0 vortex-compact 123.71 MB 125.21 MB +1.50 MB +1.2%
hits_038.vortex 1.0 vortex-file-compressed 188.96 MB 191.22 MB +2.26 MB +1.2%
hits_090.vortex 1.0 vortex-file-compressed 191.60 MB 193.86 MB +2.27 MB +1.2%
hits_064.vortex 1.0 vortex-file-compressed 189.86 MB 191.96 MB +2.10 MB +1.1%
hits_065.vortex 1.0 vortex-compact 124.89 MB 126.01 MB +1.12 MB +0.9%
hits_027.vortex 1.0 vortex-file-compressed 188.78 MB 190.38 MB +1.60 MB +0.8%
hits_026.vortex 1.0 vortex-compact 97.89 MB 98.70 MB +825.02 KB +0.8%
hits_060.vortex 1.0 vortex-file-compressed 192.29 MB 193.77 MB +1.49 MB +0.8%
hits_060.vortex 1.0 vortex-compact 140.08 MB 141.15 MB +1.07 MB +0.8%
hits_076.vortex 1.0 vortex-compact 124.32 MB 125.27 MB +965.05 KB +0.8%
hits_044.vortex 1.0 vortex-file-compressed 198.52 MB 199.96 MB +1.44 MB +0.7%
hits_030.vortex 1.0 vortex-compact 98.22 MB 98.91 MB +706.55 KB +0.7%
hits_010.vortex 1.0 vortex-compact 122.95 MB 123.71 MB +780.46 KB +0.6%
hits_050.vortex 1.0 vortex-compact 125.01 MB 125.68 MB +691.26 KB +0.5%
hits_028.vortex 1.0 vortex-file-compressed 150.92 MB 151.70 MB +795.28 KB +0.5%
hits_070.vortex 1.0 vortex-file-compressed 198.19 MB 199.18 MB +1013.74 KB +0.5%
hits_055.vortex 1.0 vortex-compact 152.47 MB 153.21 MB +752.58 KB +0.5%
hits_098.vortex 1.0 vortex-compact 103.79 MB 104.28 MB +498.16 KB +0.5%
hits_064.vortex 1.0 vortex-compact 140.01 MB 140.64 MB +649.38 KB +0.5%
hits_082.vortex 1.0 vortex-file-compressed 138.69 MB 139.30 MB +632.50 KB +0.4%
hits_041.vortex 1.0 vortex-compact 98.13 MB 98.56 MB +445.38 KB +0.4%
hits_089.vortex 1.0 vortex-compact 99.17 MB 99.60 MB +443.68 KB +0.4%
hits_014.vortex 1.0 vortex-compact 133.71 MB 134.28 MB +580.12 KB +0.4%
hits_068.vortex 1.0 vortex-compact 111.92 MB 112.38 MB +476.43 KB +0.4%
hits_037.vortex 1.0 vortex-compact 132.47 MB 133.01 MB +548.59 KB +0.4%
hits_040.vortex 1.0 vortex-compact 110.09 MB 110.51 MB +434.38 KB +0.4%
hits_017.vortex 1.0 vortex-file-compressed 145.79 MB 146.34 MB +556.49 KB +0.4%
hits_005.vortex 1.0 vortex-compact 115.81 MB 116.24 MB +438.04 KB +0.4%
hits_087.vortex 1.0 vortex-file-compressed 159.93 MB 160.50 MB +584.99 KB +0.4%
hits_070.vortex 1.0 vortex-compact 152.89 MB 153.42 MB +547.92 KB +0.3%
hits_084.vortex 1.0 vortex-file-compressed 153.52 MB 154.04 MB +529.48 KB +0.3%
hits_015.vortex 1.0 vortex-compact 98.19 MB 98.52 MB +338.09 KB +0.3%
hits_024.vortex 1.0 vortex-compact 124.60 MB 124.99 MB +395.41 KB +0.3%
hits_043.vortex 1.0 vortex-compact 94.35 MB 94.64 MB +291.77 KB +0.3%
hits_062.vortex 1.0 vortex-file-compressed 169.45 MB 169.92 MB +478.80 KB +0.3%
hits_074.vortex 1.0 vortex-file-compressed 198.51 MB 199.01 MB +511.23 KB +0.3%
hits_055.vortex 1.0 vortex-file-compressed 198.91 MB 199.37 MB +465.92 KB +0.2%
hits_005.vortex 1.0 vortex-file-compressed 166.39 MB 166.74 MB +358.41 KB +0.2%
hits_006.vortex 1.0 vortex-compact 96.32 MB 96.51 MB +199.43 KB +0.2%
hits_067.vortex 1.0 vortex-compact 98.71 MB 98.89 MB +184.27 KB +0.2%
hits_046.vortex 1.0 vortex-compact 74.86 MB 74.99 MB +137.03 KB +0.2%
hits_008.vortex 1.0 vortex-compact 106.04 MB 106.23 MB +187.19 KB +0.2%
hits_045.vortex 1.0 vortex-compact 106.03 MB 106.21 MB +185.12 KB +0.2%
hits_088.vortex 1.0 vortex-compact 133.87 MB 134.08 MB +215.00 KB +0.2%
hits_083.vortex 1.0 vortex-file-compressed 155.97 MB 156.15 MB +186.98 KB +0.1%
hits_066.vortex 1.0 vortex-compact 117.38 MB 117.52 MB +138.27 KB +0.1%
hits_073.vortex 1.0 vortex-compact 134.17 MB 134.32 MB +148.89 KB +0.1%
hits_066.vortex 1.0 vortex-file-compressed 162.37 MB 162.54 MB +171.80 KB +0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.76 MB 130.89 MB +137.47 KB +0.1%
hits_007.vortex 1.0 vortex-compact 153.55 MB 153.70 MB +155.62 KB +0.1%
hits_034.vortex 1.0 vortex-compact 133.36 MB 133.49 MB +135.02 KB +0.1%
hits_085.vortex 1.0 vortex-file-compressed 198.93 MB 199.12 MB +194.95 KB +0.1%
hits_040.vortex 1.0 vortex-file-compressed 142.64 MB 142.77 MB +137.64 KB +0.1%
hits_018.vortex 1.0 vortex-file-compressed 198.76 MB 198.94 MB +183.62 KB +0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.75 MB 130.87 MB +120.65 KB +0.1%
hits_054.vortex 1.0 vortex-file-compressed 145.93 MB 146.05 MB +126.93 KB +0.1%
hits_052.vortex 1.0 vortex-file-compressed 129.99 MB 130.09 MB +106.71 KB +0.1%
hits_016.vortex 1.0 vortex-compact 127.48 MB 127.58 MB +102.72 KB +0.1%
hits_079.vortex 1.0 vortex-file-compressed 179.74 MB 179.87 MB +131.02 KB +0.1%
hits_075.vortex 1.0 vortex-compact 137.84 MB 137.94 MB +99.98 KB +0.1%
hits_002.vortex 1.0 vortex-file-compressed 159.96 MB 160.07 MB +114.70 KB +0.1%
hits_074.vortex 1.0 vortex-compact 152.90 MB 153.01 MB +109.61 KB +0.1%
hits_042.vortex 1.0 vortex-file-compressed 200.49 MB 200.63 MB +142.38 KB +0.1%
hits_086.vortex 1.0 vortex-file-compressed 191.04 MB 191.17 MB +129.84 KB +0.1%
hits_081.vortex 1.0 vortex-file-compressed 199.32 MB 199.45 MB +128.36 KB +0.1%
hits_033.vortex 1.0 vortex-file-compressed 199.40 MB 199.52 MB +124.96 KB +0.1%
hits_098.vortex 1.0 vortex-file-compressed 136.70 MB 136.78 MB +83.98 KB +0.1%
hits_092.vortex 1.0 vortex-file-compressed 198.92 MB 199.03 MB +114.52 KB +0.1%
hits_014.vortex 1.0 vortex-file-compressed 171.33 MB 171.42 MB +93.60 KB +0.1%
hits_079.vortex 1.0 vortex-compact 128.07 MB 128.14 MB +69.02 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 139.63 MB 139.69 MB +66.47 KB +0.0%
hits_049.vortex 1.0 vortex-file-compressed 190.33 MB 190.42 MB +89.95 KB +0.0%
hits_018.vortex 1.0 vortex-compact 153.68 MB 153.75 MB +72.34 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 146.04 MB 146.10 MB +57.91 KB +0.0%
hits_044.vortex 1.0 vortex-compact 153.69 MB 153.75 MB +57.26 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.20 MB 126.24 MB +43.93 KB +0.0%
hits_038.vortex 1.0 vortex-compact 139.52 MB 139.57 MB +46.38 KB +0.0%
hits_054.vortex 1.0 vortex-compact 112.18 MB 112.22 MB +36.10 KB +0.0%
hits_086.vortex 1.0 vortex-compact 140.77 MB 140.81 MB +44.66 KB +0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.28 MB 102.31 MB +31.06 KB +0.0%
hits_029.vortex 1.0 vortex-compact 153.44 MB 153.48 MB +43.70 KB +0.0%
hits_027.vortex 1.0 vortex-compact 139.19 MB 139.23 MB +39.41 KB +0.0%
hits_025.vortex 1.0 vortex-compact 133.44 MB 133.48 MB +36.23 KB +0.0%
hits_097.vortex 1.0 vortex-compact 141.26 MB 141.30 MB +37.25 KB +0.0%
hits_002.vortex 1.0 vortex-compact 124.13 MB 124.16 MB +31.97 KB +0.0%
hits_065.vortex 1.0 vortex-file-compressed 160.21 MB 160.25 MB +37.17 KB +0.0%
hits_095.vortex 1.0 vortex-file-compressed 153.41 MB 153.43 MB +28.84 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 170.51 MB 170.53 MB +28.29 KB +0.0%
hits_000.vortex 1.0 vortex-file-compressed 130.65 MB 130.68 MB +21.40 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 135.68 MB 135.69 MB +15.32 KB +0.0%
hits_031.vortex 1.0 vortex-compact 111.66 MB 111.67 MB +10.02 KB +0.0%
hits_011.vortex 1.0 vortex-compact 152.65 MB 152.66 MB +13.34 KB +0.0%
hits_042.vortex 1.0 vortex-compact 136.25 MB 136.26 MB +10.52 KB +0.0%
hits_095.vortex 1.0 vortex-compact 110.59 MB 110.59 MB +8.48 KB +0.0%
hits_057.vortex 1.0 vortex-file-compressed 159.26 MB 159.26 MB +6.25 KB +0.0%
hits_049.vortex 1.0 vortex-compact 140.47 MB 140.47 MB +1.64 KB +0.0%
hits_089.vortex 1.0 vortex-file-compressed 130.54 MB 130.53 MB 952 B -0.0%
hits_051.vortex 1.0 vortex-compact 133.98 MB 133.98 MB 1.19 KB -0.0%
hits_082.vortex 1.0 vortex-compact 105.76 MB 105.76 MB 2.82 KB -0.0%
hits_048.vortex 1.0 vortex-file-compressed 198.86 MB 198.85 MB 13.12 KB -0.0%
hits_021.vortex 1.0 vortex-compact 110.61 MB 110.60 MB 8.36 KB -0.0%
hits_009.vortex 1.0 vortex-compact 75.21 MB 75.20 MB 5.98 KB -0.0%
hits_030.vortex 1.0 vortex-file-compressed 130.85 MB 130.84 MB 12.04 KB -0.0%
hits_094.vortex 1.0 vortex-compact 110.74 MB 110.73 MB 12.12 KB -0.0%
hits_069.vortex 1.0 vortex-compact 99.81 MB 99.80 MB 11.73 KB -0.0%
hits_092.vortex 1.0 vortex-compact 153.34 MB 153.33 MB 18.11 KB -0.0%
hits_019.vortex 1.0 vortex-compact 106.62 MB 106.61 MB 13.85 KB -0.0%
hits_063.vortex 1.0 vortex-compact 98.15 MB 98.14 MB 14.39 KB -0.0%
hits_032.vortex 1.0 vortex-compact 110.60 MB 110.58 MB 17.72 KB -0.0%
hits_077.vortex 1.0 vortex-compact 134.09 MB 134.06 MB 23.19 KB -0.0%
hits_036.vortex 1.0 vortex-file-compressed 170.71 MB 170.68 MB 33.25 KB -0.0%
hits_047.vortex 1.0 vortex-compact 110.48 MB 110.45 MB 24.17 KB -0.0%
hits_059.vortex 1.0 vortex-compact 152.88 MB 152.84 MB 34.09 KB -0.0%
hits_045.vortex 1.0 vortex-file-compressed 138.72 MB 138.68 MB 31.77 KB -0.0%
hits_084.vortex 1.0 vortex-compact 110.68 MB 110.65 MB 26.27 KB -0.0%
hits_062.vortex 1.0 vortex-compact 132.58 MB 132.55 MB 32.84 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 125.80 MB 125.76 MB 35.26 KB -0.0%
hits_037.vortex 1.0 vortex-file-compressed 176.53 MB 176.48 MB 51.10 KB -0.0%
hits_073.vortex 1.0 vortex-file-compressed 171.93 MB 171.88 MB 58.29 KB -0.0%
hits_094.vortex 1.0 vortex-file-compressed 157.33 MB 157.28 MB 53.91 KB -0.0%
hits_081.vortex 1.0 vortex-compact 153.64 MB 153.59 MB 52.89 KB -0.0%
hits_072.vortex 1.0 vortex-file-compressed 101.72 MB 101.68 MB 35.16 KB -0.0%
hits_032.vortex 1.0 vortex-file-compressed 153.76 MB 153.71 MB 53.49 KB -0.0%
hits_036.vortex 1.0 vortex-compact 133.34 MB 133.29 MB 46.43 KB -0.0%
hits_022.vortex 1.0 vortex-file-compressed 198.39 MB 198.32 MB 69.80 KB -0.0%
hits_010.vortex 1.0 vortex-file-compressed 168.20 MB 168.14 MB 59.95 KB -0.0%
hits_023.vortex 1.0 vortex-compact 142.75 MB 142.69 MB 54.78 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 160.05 MB 159.99 MB 62.55 KB -0.0%
hits_022.vortex 1.0 vortex-compact 153.05 MB 152.99 MB 64.45 KB -0.0%
hits_007.vortex 1.0 vortex-file-compressed 199.51 MB 199.41 MB 101.58 KB -0.0%
hits_071.vortex 1.0 vortex-file-compressed 139.50 MB 139.43 MB 73.16 KB -0.1%
hits_067.vortex 1.0 vortex-file-compressed 130.93 MB 130.86 MB 69.30 KB -0.1%
hits_025.vortex 1.0 vortex-file-compressed 171.29 MB 171.19 MB 94.73 KB -0.1%
hits_047.vortex 1.0 vortex-file-compressed 153.67 MB 153.59 MB 87.21 KB -0.1%
hits_058.vortex 1.0 vortex-compact 111.03 MB 110.97 MB 64.66 KB -0.1%
hits_031.vortex 1.0 vortex-file-compressed 158.54 MB 158.45 MB 97.93 KB -0.1%
hits_075.vortex 1.0 vortex-file-compressed 188.50 MB 188.39 MB 116.95 KB -0.1%
hits_003.vortex 1.0 vortex-compact 104.50 MB 104.43 MB 65.81 KB -0.1%
hits_034.vortex 1.0 vortex-file-compressed 180.93 MB 180.81 MB 125.28 KB -0.1%
hits_099.vortex 1.0 vortex-compact 133.39 MB 133.29 MB 95.60 KB -0.1%
hits_068.vortex 1.0 vortex-file-compressed 159.48 MB 159.37 MB 115.07 KB -0.1%
hits_057.vortex 1.0 vortex-compact 111.94 MB 111.85 MB 84.02 KB -0.1%
hits_096.vortex 1.0 vortex-compact 153.16 MB 153.05 MB 116.88 KB -0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.19 MB 130.08 MB 105.56 KB -0.1%
hits_096.vortex 1.0 vortex-file-compressed 198.82 MB 198.65 MB 173.51 KB -0.1%
hits_013.vortex 1.0 vortex-file-compressed 160.34 MB 160.20 MB 140.00 KB -0.1%
hits_015.vortex 1.0 vortex-file-compressed 130.35 MB 130.23 MB 117.62 KB -0.1%
hits_056.vortex 1.0 vortex-compact 100.88 MB 100.78 MB 99.68 KB -0.1%
hits_029.vortex 1.0 vortex-file-compressed 198.18 MB 197.98 MB 201.34 KB -0.1%
hits_035.vortex 1.0 vortex-compact 75.98 MB 75.90 MB 77.66 KB -0.1%
hits_033.vortex 1.0 vortex-compact 153.60 MB 153.45 MB 157.48 KB -0.1%
hits_061.vortex 1.0 vortex-file-compressed 159.93 MB 159.77 MB 165.45 KB -0.1%
hits_077.vortex 1.0 vortex-file-compressed 171.78 MB 171.60 MB 179.82 KB -0.1%
hits_039.vortex 1.0 vortex-compact 124.50 MB 124.37 MB 132.79 KB -0.1%
hits_076.vortex 1.0 vortex-file-compressed 159.94 MB 159.77 MB 172.41 KB -0.1%
hits_069.vortex 1.0 vortex-file-compressed 141.71 MB 141.56 MB 156.57 KB -0.1%
hits_083.vortex 1.0 vortex-compact 109.99 MB 109.87 MB 123.30 KB -0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.62 MB 100.50 MB 113.27 KB -0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.36 MB 130.22 MB 146.90 KB -0.1%
hits_000.vortex 1.0 vortex-compact 98.36 MB 98.24 MB 113.57 KB -0.1%
hits_085.vortex 1.0 vortex-compact 153.48 MB 153.28 MB 204.83 KB -0.1%
hits_048.vortex 1.0 vortex-compact 153.47 MB 153.26 MB 212.29 KB -0.1%
hits_097.vortex 1.0 vortex-file-compressed 191.87 MB 191.61 MB 266.20 KB -0.1%
hits_004.vortex 1.0 vortex-compact 98.11 MB 97.95 MB 156.20 KB -0.2%
hits_016.vortex 1.0 vortex-file-compressed 179.69 MB 179.37 MB 331.73 KB -0.2%
hits_009.vortex 1.0 vortex-file-compressed 100.75 MB 100.56 MB 191.62 KB -0.2%
hits_026.vortex 1.0 vortex-file-compressed 130.54 MB 130.30 MB 248.89 KB -0.2%
hits_051.vortex 1.0 vortex-file-compressed 171.93 MB 171.59 MB 341.59 KB -0.2%
hits_090.vortex 1.0 vortex-compact 141.47 MB 141.19 MB 295.03 KB -0.2%
hits_011.vortex 1.0 vortex-file-compressed 199.16 MB 198.73 MB 445.90 KB -0.2%
hits_053.vortex 1.0 vortex-file-compressed 189.28 MB 188.83 MB 459.35 KB -0.2%
hits_004.vortex 1.0 vortex-file-compressed 130.38 MB 130.08 MB 316.89 KB -0.2%
hits_008.vortex 1.0 vortex-file-compressed 139.06 MB 138.71 MB 354.77 KB -0.2%
hits_028.vortex 1.0 vortex-compact 115.62 MB 115.33 MB 295.32 KB -0.2%
hits_024.vortex 1.0 vortex-file-compressed 160.01 MB 159.58 MB 447.23 KB -0.3%
hits_072.vortex 1.0 vortex-compact 75.84 MB 75.60 MB 238.76 KB -0.3%
hits_021.vortex 1.0 vortex-file-compressed 153.92 MB 153.42 MB 509.77 KB -0.3%
hits_056.vortex 1.0 vortex-file-compressed 134.94 MB 134.50 MB 449.23 KB -0.3%
hits_020.vortex 1.0 vortex-compact 112.08 MB 111.68 MB 415.30 KB -0.4%
hits_020.vortex 1.0 vortex-file-compressed 159.71 MB 159.10 MB 619.89 KB -0.4%
hits_053.vortex 1.0 vortex-compact 138.96 MB 138.43 MB 542.45 KB -0.4%
hits_088.vortex 1.0 vortex-file-compressed 172.45 MB 171.78 MB 691.62 KB -0.4%
hits_058.vortex 1.0 vortex-file-compressed 155.00 MB 154.30 MB 710.27 KB -0.4%
hits_071.vortex 1.0 vortex-compact 106.16 MB 105.66 MB 512.36 KB -0.5%
hits_006.vortex 1.0 vortex-file-compressed 125.67 MB 125.06 MB 621.23 KB -0.5%
hits_017.vortex 1.0 vortex-compact 112.25 MB 111.64 MB 620.61 KB -0.5%
hits_091.vortex 1.0 vortex-compact 112.45 MB 111.82 MB 642.52 KB -0.6%
hits_093.vortex 1.0 vortex-compact 98.57 MB 97.94 MB 644.62 KB -0.6%
hits_059.vortex 1.0 vortex-file-compressed 198.49 MB 197.18 MB 1.31 MB -0.7%
hits_050.vortex 1.0 vortex-file-compressed 160.04 MB 158.97 MB 1.08 MB -0.7%
hits_023.vortex 1.0 vortex-file-compressed 195.87 MB 194.31 MB 1.55 MB -0.8%
hits_012.vortex 1.0 vortex-compact 139.93 MB 138.80 MB 1.13 MB -0.8%
hits_012.vortex 1.0 vortex-file-compressed 191.92 MB 189.94 MB 1.98 MB -1.0%
hits_001.vortex 1.0 vortex-compact 140.47 MB 138.98 MB 1.49 MB -1.1%
hits_013.vortex 1.0 vortex-compact 125.64 MB 123.93 MB 1.71 MB -1.4%
hits_080.vortex 1.0 vortex-compact 96.34 MB 94.65 MB 1.69 MB -1.8%
hits_052.vortex 1.0 vortex-compact 99.05 MB 97.08 MB 1.97 MB -2.0%
hits_001.vortex 1.0 vortex-file-compressed 192.31 MB 188.09 MB 4.22 MB -2.2%

Totals:

  • vortex-compact: 11.93 GB → 11.93 GB (+0.0%)
  • vortex-file-compressed: 15.88 GB → 15.88 GB (-0.0%)

Two defects, one root cause: BlockedFoRScheme was registered in place of
FoRScheme and declared both encodings as its output.

An encoding must belong to an enabled edition before the writer will
serialize it, and fastlanes.blockedfor belonged to none. Where the file
writer configures an encoding policy, retain_allowed_encodings saw a
scheme producing a forbidden encoding and dropped it -- taking global
FoR with it, because no other scheme produced it. Integer columns that
would have used a frame of reference fell back to plain bit-packing, so
ClickBench files grew 0.6% overall (152 of 200 larger). Where no policy
was configured, nothing filtered the scheme and the write failed
outright with "Array encoding fastlanes.blockedfor not permitted by
ctx", which is what the SQL logic tests hit.

BlockedFoRScheme now produces only BlockedFoR and skips wherever a
single global reference is the better shape, so FoRScheme rejoins
ALL_SCHEMES and competes for those arrays on its own estimate. An
encoding policy that forbids blockedfor now drops just the blocked
scheme and keeps frame of reference, pinned by
retain_allowed_encodings_keeps_global_for_without_blocked.

fastlanes.blockedfor joins the new PREVIEW_2026_08_0 edition, following
fastlanes.delta. Preview is only enabled with unstable_encodings, so the
scheme is gated behind that feature -- selecting an encoding the writer
cannot serialize fails the write. Under that feature Delta already wins
these shapes after #9602, so every golden snapshot now matches develop
apart from one compact list case that shifts delta -> pco and shrinks.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
The only use of the import is a test that is itself gated, so building
without default features warned on an unused import.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@github-actions

github-actions Bot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR ee07a98a vs base 479bd98a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-0.3%, environment too noisy confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.006x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.010x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 28448702 / 27384748 / +3.9% 85539986 / 83121366 / +2.9% 0.33 / 0.33 / +0.9%
tpcds_q02/datafusion:vortex-file-compressed 53552738 / 52145956 / +2.7% 102691381 / 105082563 / -2.3% 0.52 / 0.50 / +5.1%
tpcds_q03/datafusion:vortex-file-compressed 15273773 / 14756198 / +3.5% 65075280 / 64997109 / +0.1% 0.23 / 0.23 / +3.4%
tpcds_q04/datafusion:vortex-file-compressed 218816900 / 206670174 / +5.9% 282950441 / 284959986 / -0.7% 0.77 / 0.73 / +6.6%
tpcds_q05/datafusion:vortex-file-compressed 63456792 / 61802562 / +2.7% 126626631 / 122202497 / +3.6% 0.50 / 0.51 / -0.9%
tpcds_q06/datafusion:vortex-file-compressed 26651091 / 26170829 / +1.8% 81356211 / 78342880 / +3.8% 0.33 / 0.33 / -1.9%
tpcds_q07/datafusion:vortex-file-compressed 44047454 / 44337876 / -0.7% 102688051 / 101109369 / +1.6% 0.43 / 0.44 / -2.2%
tpcds_q08/datafusion:vortex-file-compressed 34291864 / 34601372 / -0.9% 91633930 / 87640531 / +4.6% 0.37 / 0.39 / -5.2%
tpcds_q09/datafusion:vortex-file-compressed 25859912 / 26902998 / -3.9% 68182390 / 66265857 / +2.9% 0.38 / 0.41 / -6.6%
tpcds_q10/datafusion:vortex-file-compressed 36574230 / 37722278 / -3.0% 84757062 / 84985670 / -0.3% 0.43 / 0.44 / -2.8%
tpcds_q11/datafusion:vortex-file-compressed 114500050 / 117132408 / -2.2% 182893312 / 187933095 / -2.7% 0.63 / 0.62 / +0.4%
tpcds_q12/datafusion:vortex-file-compressed 21815169 / 22595520 / -3.5% 70148569 / 66731781 / +5.1% 0.31 / 0.34 / -8.2%
tpcds_q13/datafusion:vortex-file-compressed 44045362 / 44741081 / -1.6% 96503901 / 95620559 / +0.9% 0.46 / 0.47 / -2.5%
tpcds_q14/datafusion:vortex-file-compressed 192866754 / 196970850 / -2.1% 270194357 / 264853400 / +2.0% 0.71 / 0.74 / -4.0%
tpcds_q15/datafusion:vortex-file-compressed 30509333 / 30450599 / +0.2% 82896776 / 79927227 / +3.7% 0.37 / 0.38 / -3.4%
tpcds_q16/datafusion:vortex-file-compressed 25689215 / 24666301 / +4.1% 73292293 / 73877417 / -0.8% 0.35 / 0.33 / +5.0%
tpcds_q17/datafusion:vortex-file-compressed 72345028 / 71376615 / +1.4% 140074696 / 143773201 / -2.6% 0.52 / 0.50 / +4.0%
tpcds_q18/datafusion:vortex-file-compressed 86750887 / 85705686 / +1.2% 145815398 / 148059458 / -1.5% 0.59 / 0.58 / +2.8%
tpcds_q19/datafusion:vortex-file-compressed 23306518 / 23060715 / +1.1% 72853466 / 71413685 / +2.0% 0.32 / 0.32 / -0.9%
tpcds_q20/datafusion:vortex-file-compressed 27693236 / 26401060 / +4.9% 78759404 / 75007575 / +5.0% 0.35 / 0.35 / -0.1%
tpcds_q21/datafusion:vortex-file-compressed 30490156 / 30631678 / -0.5% 85167925 / 92519308 / -7.9% 0.36 / 0.33 / +8.1%
tpcds_q22/datafusion:vortex-file-compressed 105194966 / 121633138 / -13.5% 🟢 191536685 / 192196182 / -0.3% 0.55 / 0.63 / -13.2%
tpcds_q23/datafusion:vortex-file-compressed 123141766 / 128171531 / -3.9% 193831693 / 191080206 / +1.4% 0.64 / 0.67 / -5.3%
tpcds_q24/datafusion:vortex-file-compressed 96685364 / 94679168 / +2.1% 168036988 / 165461893 / +1.6% 0.58 / 0.57 / +0.6%
tpcds_q25/datafusion:vortex-file-compressed 71834370 / 73925617 / -2.8% 149559086 / 143808971 / +4.0% 0.48 / 0.51 / -6.6%
tpcds_q26/datafusion:vortex-file-compressed 39014014 / 38308745 / +1.8% 89575900 / 84801624 / +5.6% 0.44 / 0.45 / -3.6%
tpcds_q27/datafusion:vortex-file-compressed 91468438 / 91340511 / +0.1% 165092839 / 165111007 / -0.0% 0.55 / 0.55 / +0.2%
tpcds_q28/datafusion:vortex-file-compressed 23867062 / 24473826 / -2.5% 74137653 / 66079553 / +12.2% 🔴 0.32 / 0.37 / -13.1%
tpcds_q29/datafusion:vortex-file-compressed 69972004 / 69214850 / +1.1% 138631351 / 135379359 / +2.4% 0.50 / 0.51 / -1.3%
tpcds_q30/datafusion:vortex-file-compressed 31935779 / 32280056 / -1.1% 77165505 / 75472075 / +2.2% 0.41 / 0.43 / -3.2%
tpcds_q31/datafusion:vortex-file-compressed 75182404 / 74788619 / +0.5% 141278530 / 140926298 / +0.2% 0.53 / 0.53 / +0.3%
tpcds_q32/datafusion:vortex-file-compressed 18750052 / 18854468 / -0.6% 63354984 / 62833581 / +0.8% 0.30 / 0.30 / -1.4%
tpcds_q33/datafusion:vortex-file-compressed 31436776 / 31720450 / -0.9% 88689111 / 89717726 / -1.1% 0.35 / 0.35 / +0.3%
tpcds_q34/datafusion:vortex-file-compressed 26511982 / 28011976 / -5.4% 80889718 / 76103298 / +6.3% 0.33 / 0.37 / -11.0%
tpcds_q35/datafusion:vortex-file-compressed 45022149 / 46256152 / -2.7% 96623538 / 93921936 / +2.9% 0.47 / 0.49 / -5.4%
tpcds_q36/datafusion:vortex-file-compressed 59375566 / 60162206 / -1.3% 133752994 / 131964158 / +1.4% 0.44 / 0.46 / -2.6%
tpcds_q37/datafusion:vortex-file-compressed 19013612 / 19822438 / -4.1% 64567045 / 60514658 / +6.7% 0.29 / 0.33 / -10.1%
tpcds_q38/datafusion:vortex-file-compressed 40734309 / 40823204 / -0.2% 97690074 / 94048161 / +3.9% 0.42 / 0.43 / -3.9%
tpcds_q39/datafusion:vortex-file-compressed 87479052 / 88649806 / -1.3% 152144394 / 145974354 / +4.2% 0.57 / 0.61 / -5.3%
tpcds_q40/datafusion:vortex-file-compressed 32517514 / 32313661 / +0.6% 90680170 / 87972597 / +3.1% 0.36 / 0.37 / -2.4%
tpcds_q41/datafusion:vortex-file-compressed 20915058 / 20317548 / +2.9% 53450752 / 50991138 / +4.8% 0.39 / 0.40 / -1.8%
tpcds_q42/datafusion:vortex-file-compressed 14313264 / 13930736 / +2.7% 57512524 / 56811916 / +1.2% 0.25 / 0.25 / +1.5%
tpcds_q43/datafusion:vortex-file-compressed 18909926 / 19116488 / -1.1% 65079339 / 66881714 / -2.7% 0.29 / 0.29 / +1.7%
tpcds_q44/datafusion:vortex-file-compressed 32973667 / 32829060 / +0.4% 89808950 / 82347068 / +9.1% 0.37 / 0.40 / -7.9%
tpcds_q45/datafusion:vortex-file-compressed 35054098 / 33088328 / +5.9% 83881004 / 82210135 / +2.0% 0.42 / 0.40 / +3.8%
tpcds_q46/datafusion:vortex-file-compressed 34341749 / 32753878 / +4.8% 100011561 / 96984084 / +3.1% 0.34 / 0.34 / +1.7%
tpcds_q47/datafusion:vortex-file-compressed 123502957 / 121926120 / +1.3% 198486637 / 198640725 / -0.1% 0.62 / 0.61 / +1.4%
tpcds_q48/datafusion:vortex-file-compressed 35373528 / 34827232 / +1.6% 80319739 / 83211707 / -3.5% 0.44 / 0.42 / +5.2%
tpcds_q49/datafusion:vortex-file-compressed 64157607 / 65228001 / -1.6% 126788207 / 127244922 / -0.4% 0.51 / 0.51 / -1.3%
tpcds_q50/datafusion:vortex-file-compressed 45302026 / 45752070 / -1.0% 101174911 / 97038241 / +4.3% 0.45 / 0.47 / -5.0%
tpcds_q51/datafusion:vortex-file-compressed 73160902 / 74731993 / -2.1% 139476503 / 135033827 / +3.3% 0.52 / 0.55 / -5.2%
tpcds_q52/datafusion:vortex-file-compressed 14616541 / 14756918 / -1.0% 60158413 / 59716161 / +0.7% 0.24 / 0.25 / -1.7%
tpcds_q53/datafusion:vortex-file-compressed 25384058 / 25033089 / +1.4% 78771206 / 77617373 / +1.5% 0.32 / 0.32 / -0.1%
tpcds_q54/datafusion:vortex-file-compressed 38234422 / 37247940 / +2.6% 90663612 / 90462276 / +0.2% 0.42 / 0.41 / +2.4%
tpcds_q55/datafusion:vortex-file-compressed 14050070 / 14509095 / -3.2% 57963766 / 59167961 / -2.0% 0.24 / 0.25 / -1.2%
tpcds_q56/datafusion:vortex-file-compressed 32190413 / 32751494 / -1.7% 88393140 / 88846006 / -0.5% 0.36 / 0.37 / -1.2%
tpcds_q57/datafusion:vortex-file-compressed 99488214 / 95721478 / +3.9% 160226596 / 161067718 / -0.5% 0.62 / 0.59 / +4.5%
tpcds_q58/datafusion:vortex-file-compressed 58625494 / 58414829 / +0.4% 126058872 / 123830821 / +1.8% 0.47 / 0.47 / -1.4%
tpcds_q59/datafusion:vortex-file-compressed 54038230 / 54351514 / -0.6% 108402975 / 106368867 / +1.9% 0.50 / 0.51 / -2.4%
tpcds_q60/datafusion:vortex-file-compressed 31828686 / 31705358 / +0.4% 87718396 / 89736627 / -2.2% 0.36 / 0.35 / +2.7%
tpcds_q61/datafusion:vortex-file-compressed 34819722 / 35594740 / -2.2% 87186264 / 85597998 / +1.9% 0.40 / 0.42 / -4.0%
tpcds_q62/datafusion:vortex-file-compressed 23259084 / 23354695 / -0.4% 67241725 / 68915445 / -2.4% 0.35 / 0.34 / +2.1%
tpcds_q63/datafusion:vortex-file-compressed 25361568 / 25113354 / +1.0% 75205707 / 74462695 / +1.0% 0.34 / 0.34 / -0.0%
tpcds_q64/datafusion:vortex-file-compressed 459852356 / 469006554 / -2.0% 570876686 / 577382814 / -1.1% 0.81 / 0.81 / -0.8%
tpcds_q65/datafusion:vortex-file-compressed 67491530 / 68071282 / -0.9% 131540674 / 124850331 / +5.4% 0.51 / 0.55 / -5.9%
tpcds_q66/datafusion:vortex-file-compressed 75460672 / 75674590 / -0.3% 141854680 / 137802077 / +2.9% 0.53 / 0.55 / -3.1%
tpcds_q67/datafusion:vortex-file-compressed 111467396 / 109385906 / +1.9% 189121111 / 184482271 / +2.5% 0.59 / 0.59 / -0.6%
tpcds_q68/datafusion:vortex-file-compressed 31980366 / 32883522 / -2.7% 99089436 / 98736677 / +0.4% 0.32 / 0.33 / -3.1%
tpcds_q69/datafusion:vortex-file-compressed 35596926 / 34625738 / +2.8% 79962484 / 78570912 / +1.8% 0.45 / 0.44 / +1.0%
tpcds_q70/datafusion:vortex-file-compressed 107462978 / 110108909 / -2.4% 170411911 / 163528383 / +4.2% 0.63 / 0.67 / -6.3%
tpcds_q71/datafusion:vortex-file-compressed 24655785 / 23792197 / +3.6% 74439050 / 71803654 / +3.7% 0.33 / 0.33 / -0.0%
tpcds_q72/datafusion:vortex-file-compressed 1462408164 / 1459874062 / +0.2% 1587831329 / 1569295306 / +1.2% 0.92 / 0.93 / -1.0%
tpcds_q73/datafusion:vortex-file-compressed 24202186 / 25480642 / -5.0% 76178753 / 75611760 / +0.7% 0.32 / 0.34 / -5.7%
tpcds_q74/datafusion:vortex-file-compressed 74278200 / 73842849 / +0.6% 137556612 / 135589136 / +1.5% 0.54 / 0.54 / -0.8%
tpcds_q75/datafusion:vortex-file-compressed 131641147 / 130456860 / +0.9% 212284647 / 204912733 / +3.6% 0.62 / 0.64 / -2.6%
tpcds_q76/datafusion:vortex-file-compressed 40619453 / 41245757 / -1.5% 94240170 / 93368922 / +0.9% 0.43 / 0.44 / -2.4%
tpcds_q77/datafusion:vortex-file-compressed 41577094 / 42536070 / -2.3% 99756170 / 101508540 / -1.7% 0.42 / 0.42 / -0.5%
tpcds_q78/datafusion:vortex-file-compressed 104485884 / 103695007 / +0.8% 173545370 / 173455898 / +0.1% 0.60 / 0.60 / +0.7%
tpcds_q79/datafusion:vortex-file-compressed 28769286 / 27785612 / +3.5% 83931261 / 86279748 / -2.7% 0.34 / 0.32 / +6.4%
tpcds_q80/datafusion:vortex-file-compressed 94125645 / 94864517 / -0.8% 181285902 / 182370789 / -0.6% 0.52 / 0.52 / -0.2%
tpcds_q81/datafusion:vortex-file-compressed 33238130 / 31867228 / +4.3% 79313972 / 76304442 / +3.9% 0.42 / 0.42 / +0.3%
tpcds_q82/datafusion:vortex-file-compressed 19819988 / 19484670 / +1.7% 63495450 / 66731933 / -4.8% 0.31 / 0.29 / +6.9%
tpcds_q83/datafusion:vortex-file-compressed 44277134 / 44919693 / -1.4% 89210589 / 87899362 / +1.5% 0.50 / 0.51 / -2.9%
tpcds_q84/datafusion:vortex-file-compressed 14414048 / 15538184 / -7.2% 53865336 / 49301724 / +9.3% 0.27 / 0.32 / -15.1%
tpcds_q85/datafusion:vortex-file-compressed 100089906 / 100497614 / -0.4% 164368987 / 165753605 / -0.8% 0.61 / 0.61 / +0.4%
tpcds_q86/datafusion:vortex-file-compressed 19082488 / 18908324 / +0.9% 61850132 / 61838672 / +0.0% 0.31 / 0.31 / +0.9%
tpcds_q87/datafusion:vortex-file-compressed 41865210 / 42074805 / -0.5% 97298721 / 102563292 / -5.1% 0.43 / 0.41 / +4.9%
tpcds_q88/datafusion:vortex-file-compressed 51616744 / 52163102 / -1.0% 112943682 / 115745520 / -2.4% 0.46 / 0.45 / +1.4%
tpcds_q89/datafusion:vortex-file-compressed 26938594 / 26868855 / +0.3% 76798833 / 79046521 / -2.8% 0.35 / 0.34 / +3.2%
tpcds_q90/datafusion:vortex-file-compressed 14640848 / 14906436 / -1.8% 55023223 / 54872589 / +0.3% 0.27 / 0.27 / -2.1%
tpcds_q91/datafusion:vortex-file-compressed 21044351 / 21198822 / -0.7% 59013510 / 59678701 / -1.1% 0.36 / 0.36 / +0.4%
tpcds_q92/datafusion:vortex-file-compressed 18471634 / 18033720 / +2.4% 59760952 / 64058343 / -6.7% 0.31 / 0.28 / +9.8%
tpcds_q93/datafusion:vortex-file-compressed 30739373 / 30867392 / -0.4% 84521253 / 81087981 / +4.2% 0.36 / 0.38 / -4.5%
tpcds_q94/datafusion:vortex-file-compressed 22858772 / 22450646 / +1.8% 67291352 / 65726255 / +2.4% 0.34 / 0.34 / -0.6%
tpcds_q95/datafusion:vortex-file-compressed 59233036 / 59636847 / -0.7% 119364899 / 120091494 / -0.6% 0.50 / 0.50 / -0.1%
tpcds_q96/datafusion:vortex-file-compressed 11562700 / 11500048 / +0.5% 52552559 / 49982314 / +5.1% 0.22 / 0.23 / -4.4%
tpcds_q97/datafusion:vortex-file-compressed 27126748 / 27151448 / -0.1% 81953931 / 82581912 / -0.8% 0.33 / 0.33 / +0.7%
tpcds_q98/datafusion:vortex-file-compressed 24119168 / 24171819 / -0.2% 76040020 / 78683976 / -3.4% 0.32 / 0.31 / +3.3%
tpcds_q99/datafusion:vortex-file-compressed 30149870 / 27738228 / +8.7% 73751317 / 70288275 / +4.9% 0.41 / 0.39 / +3.6%
datafusion / vortex-compact / ns (1.002x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 29410431 / 29324646 / +0.3% 75263498 / 76725008 / -1.9% 0.39 / 0.38 / +2.2%
tpcds_q02/datafusion:vortex-compact 60168471 / 59092312 / +1.8% 109563791 / 109369501 / +0.2% 0.55 / 0.54 / +1.6%
tpcds_q03/datafusion:vortex-compact 17778610 / 17612328 / +0.9% 69412016 / 64999170 / +6.8% 0.26 / 0.27 / -5.5%
tpcds_q04/datafusion:vortex-compact 248772472 / 244958682 / +1.6% 323157597 / 313911242 / +2.9% 0.77 / 0.78 / -1.3%
tpcds_q05/datafusion:vortex-compact 65076629 / 65692560 / -0.9% 130575772 / 124382849 / +5.0% 0.50 / 0.53 / -5.6%
tpcds_q06/datafusion:vortex-compact 29012698 / 29207156 / -0.7% 79391670 / 83534438 / -5.0% 0.37 / 0.35 / +4.5%
tpcds_q07/datafusion:vortex-compact 60946724 / 58529211 / +4.1% 109220219 / 111914670 / -2.4% 0.56 / 0.52 / +6.7%
tpcds_q08/datafusion:vortex-compact 40744666 / 41000149 / -0.6% 93762397 / 95580981 / -1.9% 0.43 / 0.43 / +1.3%
tpcds_q09/datafusion:vortex-compact 44251282 / 44854658 / -1.3% 85428909 / 87449234 / -2.3% 0.52 / 0.51 / +1.0%
tpcds_q10/datafusion:vortex-compact 52555354 / 53978480 / -2.6% 107837036 / 102246427 / +5.5% 0.49 / 0.53 / -7.7%
tpcds_q11/datafusion:vortex-compact 131866498 / 131665381 / +0.2% 205435215 / 197357250 / +4.1% 0.64 / 0.67 / -3.8%
tpcds_q12/datafusion:vortex-compact 25722880 / 26574001 / -3.2% 72511018 / 71872519 / +0.9% 0.35 / 0.37 / -4.1%
tpcds_q13/datafusion:vortex-compact 117253592 / 129636875 / -9.6% 164757490 / 160597316 / +2.6% 0.71 / 0.81 / -11.8%
tpcds_q14/datafusion:vortex-compact 215503458 / 213574756 / +0.9% 281352629 / 283294821 / -0.7% 0.77 / 0.75 / +1.6%
tpcds_q15/datafusion:vortex-compact 35227928 / 34655234 / +1.7% 82846484 / 76770793 / +7.9% 0.43 / 0.45 / -5.8%
tpcds_q16/datafusion:vortex-compact 33194635 / 32009244 / +3.7% 79631623 / 77072719 / +3.3% 0.42 / 0.42 / +0.4%
tpcds_q17/datafusion:vortex-compact 106765654 / 105047269 / +1.6% 167836890 / 168806036 / -0.6% 0.64 / 0.62 / +2.2%
tpcds_q18/datafusion:vortex-compact 98696479 / 98096565 / +0.6% 152287308 / 151340016 / +0.6% 0.65 / 0.65 / -0.0%
tpcds_q19/datafusion:vortex-compact 31762378 / 31530956 / +0.7% 85328899 / 79556040 / +7.3% 0.37 / 0.40 / -6.1%
tpcds_q20/datafusion:vortex-compact 31279210 / 31320225 / -0.1% 80514050 / 83018963 / -3.0% 0.39 / 0.38 / +3.0%
tpcds_q21/datafusion:vortex-compact 32947761 / 32248086 / +2.2% 88926482 / 88044250 / +1.0% 0.37 / 0.37 / +1.2%
tpcds_q22/datafusion:vortex-compact 112291567 / 124203416 / -9.6% 163152860 / 138523878 / +17.8% 🔴 0.69 / 0.90 / -23.2%
tpcds_q23/datafusion:vortex-compact 139155579 / 136553311 / +1.9% 208844654 / 201589808 / +3.6% 0.67 / 0.68 / -1.6%
tpcds_q24/datafusion:vortex-compact 109576568 / 110805392 / -1.1% 180115388 / 181309491 / -0.7% 0.61 / 0.61 / -0.5%
tpcds_q25/datafusion:vortex-compact 82445366 / 82357892 / +0.1% 157743613 / 158562818 / -0.5% 0.52 / 0.52 / +0.6%
tpcds_q26/datafusion:vortex-compact 51286762 / 51647180 / -0.7% 99202392 / 92958713 / +6.7% 0.52 / 0.56 / -6.9%
tpcds_q27/datafusion:vortex-compact 118237188 / 117283141 / +0.8% 191919921 / 187656882 / +2.3% 0.62 / 0.62 / -1.4%
tpcds_q28/datafusion:vortex-compact 64144743 / 64002308 / +0.2% 110433416 / 104331570 / +5.8% 0.58 / 0.61 / -5.3%
tpcds_q29/datafusion:vortex-compact 82024154 / 79590962 / +3.1% 153563603 / 149428913 / +2.8% 0.53 / 0.53 / +0.3%
tpcds_q30/datafusion:vortex-compact 37024016 / 38102861 / -2.8% 80186024 / 79878795 / +0.4% 0.46 / 0.48 / -3.2%
tpcds_q31/datafusion:vortex-compact 96970348 / 98662564 / -1.7% 166375421 / 164739814 / +1.0% 0.58 / 0.60 / -2.7%
tpcds_q32/datafusion:vortex-compact 22953271 / 22706346 / +1.1% 67407663 / 69627240 / -3.2% 0.34 / 0.33 / +4.4%
tpcds_q33/datafusion:vortex-compact 37874408 / 38108454 / -0.6% 94865364 / 101741674 / -6.8% 0.40 / 0.37 / +6.6%
tpcds_q34/datafusion:vortex-compact 38931681 / 38639864 / +0.8% 88963421 / 90042510 / -1.2% 0.44 / 0.43 / +2.0%
tpcds_q35/datafusion:vortex-compact 58892261 / 59971944 / -1.8% 113775265 / 111091685 / +2.4% 0.52 / 0.54 / -4.1%
tpcds_q36/datafusion:vortex-compact 72881044 / 72459374 / +0.6% 149670580 / 143411641 / +4.4% 0.49 / 0.51 / -3.6%
tpcds_q37/datafusion:vortex-compact 24268523 / 24875648 / -2.4% 71415601 / 72157566 / -1.0% 0.34 / 0.34 / -1.4%
tpcds_q38/datafusion:vortex-compact 48521881 / 49127264 / -1.2% 109629912 / 112828950 / -2.8% 0.44 / 0.44 / +1.6%
tpcds_q39/datafusion:vortex-compact 91814224 / 91113597 / +0.8% 147763128 / 151757087 / -2.6% 0.62 / 0.60 / +3.5%
tpcds_q40/datafusion:vortex-compact 35800780 / 35722113 / +0.2% 93393693 / 92308837 / +1.2% 0.38 / 0.39 / -0.9%
tpcds_q41/datafusion:vortex-compact 23707156 / 25359657 / -6.5% 54317382 / 53489635 / +1.5% 0.44 / 0.47 / -7.9%
tpcds_q42/datafusion:vortex-compact 17230003 / 17144699 / +0.5% 64465588 / 60195492 / +7.1% 0.27 / 0.28 / -6.2%
tpcds_q43/datafusion:vortex-compact 24300866 / 24407054 / -0.4% 71682314 / 70118681 / +2.2% 0.34 / 0.35 / -2.6%
tpcds_q44/datafusion:vortex-compact 45688178 / 44739304 / +2.1% 100116976 / 99306322 / +0.8% 0.46 / 0.45 / +1.3%
tpcds_q45/datafusion:vortex-compact 38315682 / 37824566 / +1.3% 88985035 / 85483798 / +4.1% 0.43 / 0.44 / -2.7%
tpcds_q46/datafusion:vortex-compact 46085522 / 46668756 / -1.2% 105583947 / 103279605 / +2.2% 0.44 / 0.45 / -3.4%
tpcds_q47/datafusion:vortex-compact 136150446 / 134573909 / +1.2% 213638524 / 209091048 / +2.2% 0.64 / 0.64 / -1.0%
tpcds_q48/datafusion:vortex-compact 98487700 / 91694460 / +7.4% 130358428 / 131193030 / -0.6% 0.76 / 0.70 / +8.1%
tpcds_q49/datafusion:vortex-compact 80045103 / 78374612 / +2.1% 143261567 / 142280944 / +0.7% 0.56 / 0.55 / +1.4%
tpcds_q50/datafusion:vortex-compact 54875534 / 54128776 / +1.4% 106771648 / 102662759 / +4.0% 0.51 / 0.53 / -2.5%
tpcds_q51/datafusion:vortex-compact 77331184 / 79396658 / -2.6% 141145198 / 138635061 / +1.8% 0.55 / 0.57 / -4.3%
tpcds_q52/datafusion:vortex-compact 19019084 / 17237142 / +10.3% 🔴 65315838 / 61122188 / +6.9% 0.29 / 0.28 / +3.3%
tpcds_q53/datafusion:vortex-compact 29608869 / 27934824 / +6.0% 79224235 / 76576559 / +3.5% 0.37 / 0.36 / +2.5%
tpcds_q54/datafusion:vortex-compact 46972974 / 45602665 / +3.0% 102939144 / 99829999 / +3.1% 0.46 / 0.46 / -0.1%
tpcds_q55/datafusion:vortex-compact 17746762 / 18766138 / -5.4% 62995540 / 58371929 / +7.9% 0.28 / 0.32 / -12.4%
tpcds_q56/datafusion:vortex-compact 36934888 / 36874562 / +0.2% 98687546 / 96725831 / +2.0% 0.37 / 0.38 / -1.8%
tpcds_q57/datafusion:vortex-compact 106712308 / 107199366 / -0.5% 173175822 / 175558447 / -1.4% 0.62 / 0.61 / +0.9%
tpcds_q58/datafusion:vortex-compact 65061364 / 66184454 / -1.7% 126786922 / 128722175 / -1.5% 0.51 / 0.51 / -0.2%
tpcds_q59/datafusion:vortex-compact 64557780 / 64473086 / +0.1% 115354026 / 116033171 / -0.6% 0.56 / 0.56 / +0.7%
tpcds_q60/datafusion:vortex-compact 36964486 / 38599857 / -4.2% 99557095 / 97657898 / +1.9% 0.37 / 0.40 / -6.1%
tpcds_q61/datafusion:vortex-compact 48547010 / 48550250 / -0.0% 100896267 / 100983338 / -0.1% 0.48 / 0.48 / +0.1%
tpcds_q62/datafusion:vortex-compact 26468077 / 25498879 / +3.8% 69502222 / 69511538 / -0.0% 0.38 / 0.37 / +3.8%
tpcds_q63/datafusion:vortex-compact 30220711 / 28021577 / +7.8% 81825766 / 75941015 / +7.7% 0.37 / 0.37 / +0.1%
tpcds_q64/datafusion:vortex-compact 524828614 / 523236222 / +0.3% 620645310 / 602681784 / +3.0% 0.85 / 0.87 / -2.6%
tpcds_q65/datafusion:vortex-compact 80268807 / 81729752 / -1.8% 134864616 / 133532774 / +1.0% 0.60 / 0.61 / -2.8%
tpcds_q66/datafusion:vortex-compact 80214104 / 80298258 / -0.1% 140750517 / 141862599 / -0.8% 0.57 / 0.57 / +0.7%
tpcds_q67/datafusion:vortex-compact 116133029 / 116836545 / -0.6% 191722224 / 203311614 / -5.7% 0.61 / 0.57 / +5.4%
tpcds_q68/datafusion:vortex-compact 45484265 / 48268442 / -5.8% 110526009 / 113955248 / -3.0% 0.41 / 0.42 / -2.8%
tpcds_q69/datafusion:vortex-compact 53907897 / 54832250 / -1.7% 98149320 / 102312707 / -4.1% 0.55 / 0.54 / +2.5%
tpcds_q70/datafusion:vortex-compact 116105870 / 113597216 / +2.2% 170452641 / 172753850 / -1.3% 0.68 / 0.66 / +3.6%
tpcds_q71/datafusion:vortex-compact 31713895 / 30697307 / +3.3% 84809036 / 78569487 / +7.9% 0.37 / 0.39 / -4.3%
tpcds_q72/datafusion:vortex-compact 1467043746 / 1469275333 / -0.2% 1565827842 / 1558119351 / +0.5% 0.94 / 0.94 / -0.6%
tpcds_q73/datafusion:vortex-compact 34872204 / 35785928 / -2.6% 92432041 / 86228283 / +7.2% 0.38 / 0.42 / -9.1%
tpcds_q74/datafusion:vortex-compact 85497680 / 84307687 / +1.4% 146359477 / 149471646 / -2.1% 0.58 / 0.56 / +3.6%
tpcds_q75/datafusion:vortex-compact 142656360 / 145707936 / -2.1% 223430759 / 216163236 / +3.4% 0.64 / 0.67 / -5.3%
tpcds_q76/datafusion:vortex-compact 46772022 / 46601026 / +0.4% 99990244 / 96766388 / +3.3% 0.47 / 0.48 / -2.9%
tpcds_q77/datafusion:vortex-compact 49786616 / 49678927 / +0.2% 104238992 / 103961352 / +0.3% 0.48 / 0.48 / -0.1%
tpcds_q78/datafusion:vortex-compact 119261978 / 121472216 / -1.8% 181891496 / 186864190 / -2.7% 0.66 / 0.65 / +0.9%
tpcds_q79/datafusion:vortex-compact 39306666 / 39456904 / -0.4% 94168364 / 89219466 / +5.5% 0.42 / 0.44 / -5.6%
tpcds_q80/datafusion:vortex-compact 99491340 / 99013039 / +0.5% 187375367 / 187553946 / -0.1% 0.53 / 0.53 / +0.6%
tpcds_q81/datafusion:vortex-compact 36701978 / 35954568 / +2.1% 87007450 / 82552303 / +5.4% 0.42 / 0.44 / -3.1%
tpcds_q82/datafusion:vortex-compact 23948382 / 24292892 / -1.4% 74453857 / 75024222 / -0.8% 0.32 / 0.32 / -0.7%
tpcds_q83/datafusion:vortex-compact 44786712 / 43574720 / +2.8% 90031862 / 88389741 / +1.9% 0.50 / 0.49 / +0.9%
tpcds_q84/datafusion:vortex-compact 16680494 / 16085396 / +3.7% 50367210 / 49289436 / +2.2% 0.33 / 0.33 / +1.5%
tpcds_q85/datafusion:vortex-compact 155971270 / 148562554 / +5.0% 219691383 / 216153187 / +1.6% 0.71 / 0.69 / +3.3%
tpcds_q86/datafusion:vortex-compact 21568856 / 21209495 / +1.7% 68147092 / 63097307 / +8.0% 0.32 / 0.34 / -5.8%
tpcds_q87/datafusion:vortex-compact 50316918 / 48730878 / +3.3% 105987314 / 106959135 / -0.9% 0.47 / 0.46 / +4.2%
tpcds_q88/datafusion:vortex-compact 82267652 / 82652351 / -0.5% 142207608 / 144226782 / -1.4% 0.58 / 0.57 / +0.9%
tpcds_q89/datafusion:vortex-compact 32387882 / 32968414 / -1.8% 84559243 / 82068881 / +3.0% 0.38 / 0.40 / -4.7%
tpcds_q90/datafusion:vortex-compact 16674375 / 16863314 / -1.1% 55275617 / 57136114 / -3.3% 0.30 / 0.30 / +2.2%
tpcds_q91/datafusion:vortex-compact 43944426 / 43472602 / +1.1% 85812633 / 85261726 / +0.6% 0.51 / 0.51 / +0.4%
tpcds_q92/datafusion:vortex-compact 20153684 / 20900314 / -3.6% 63891415 / 61701159 / +3.5% 0.32 / 0.34 / -6.9%
tpcds_q93/datafusion:vortex-compact 37313804 / 37893927 / -1.5% 91559999 / 85969132 / +6.5% 0.41 / 0.44 / -7.5%
tpcds_q94/datafusion:vortex-compact 32020118 / 29093678 / +10.1% 🔴 73371874 / 69097940 / +6.2% 0.44 / 0.42 / +3.6%
tpcds_q95/datafusion:vortex-compact 68246138 / 67275314 / +1.4% 130589280 / 128631744 / +1.5% 0.52 / 0.52 / -0.1%
tpcds_q96/datafusion:vortex-compact 17435436 / 17456591 / -0.1% 57771249 / 58057628 / -0.5% 0.30 / 0.30 / +0.4%
tpcds_q97/datafusion:vortex-compact 33447396 / 33835377 / -1.1% 87874733 / 84747610 / +3.7% 0.38 / 0.40 / -4.7%
tpcds_q98/datafusion:vortex-compact 28984546 / 29725208 / -2.5% 84612623 / 84901790 / -0.3% 0.34 / 0.35 / -2.2%
tpcds_q99/datafusion:vortex-compact 31873811 / 31725976 / +0.5% 80727011 / 76328856 / +5.8% 0.39 / 0.42 / -5.0%
datafusion / parquet / ns (1.005x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 30093166 / 30616665 / -1.7% 77983643 / 73496005 / +6.1% 0.39 / 0.42 / -7.4%
tpcds_q02/datafusion:parquet 53985347 / 54150418 / -0.3% 98246154 / 98762029 / -0.5% 0.55 / 0.55 / +0.2%
tpcds_q03/datafusion:parquet 18684419 / 19434184 / -3.9% 61605819 / 58697323 / +5.0% 0.30 / 0.33 / -8.4%
tpcds_q04/datafusion:parquet 331679612 / 353636918 / -6.2% 430384366 / 408740164 / +5.3% 0.77 / 0.87 / -10.9%
tpcds_q05/datafusion:parquet 81000696 / 82883972 / -2.3% 145401809 / 142042123 / +2.4% 0.56 / 0.58 / -4.5%
tpcds_q06/datafusion:parquet 30174624 / 30053418 / +0.4% 81895058 / 80995630 / +1.1% 0.37 / 0.37 / -0.7%
tpcds_q07/datafusion:parquet 96293207 / 94889617 / +1.5% 156790005 / 155442393 / +0.9% 0.61 / 0.61 / +0.6%
tpcds_q08/datafusion:parquet 38000018 / 39095078 / -2.8% 85541035 / 85221509 / +0.4% 0.44 / 0.46 / -3.2%
tpcds_q09/datafusion:parquet 34127775 / 34881544 / -2.2% 94292145 / 99370284 / -5.1% 0.36 / 0.35 / +3.1%
tpcds_q10/datafusion:parquet 87389857 / 90240410 / -3.2% 138317142 / 137940771 / +0.3% 0.63 / 0.65 / -3.4%
tpcds_q11/datafusion:parquet 159952344 / 166807206 / -4.1% 225284342 / 221207809 / +1.8% 0.71 / 0.75 / -5.8%
tpcds_q12/datafusion:parquet 28228300 / 26469068 / +6.6% 65954767 / 64963068 / +1.5% 0.43 / 0.41 / +5.0%
tpcds_q13/datafusion:parquet 97641328 / 95988798 / +1.7% 163507615 / 165666612 / -1.3% 0.60 / 0.58 / +3.1%
tpcds_q14/datafusion:parquet 255785328 / 273433428 / -6.5% 354959218 / 349116246 / +1.7% 0.72 / 0.78 / -8.0%
tpcds_q15/datafusion:parquet 38413494 / 36974047 / +3.9% 80677800 / 79819723 / +1.1% 0.48 / 0.46 / +2.8%
tpcds_q16/datafusion:parquet 48478176 / 45670424 / +6.1% 90199250 / 91363892 / -1.3% 0.54 / 0.50 / +7.5%
tpcds_q17/datafusion:parquet 106410334 / 104351864 / +2.0% 173483930 / 167431427 / +3.6% 0.61 / 0.62 / -1.6%
tpcds_q18/datafusion:parquet 126032718 / 130903033 / -3.7% 179183748 / 181386664 / -1.2% 0.70 / 0.72 / -2.5%
tpcds_q19/datafusion:parquet 30493384 / 29655396 / +2.8% 81279006 / 77604179 / +4.7% 0.38 / 0.38 / -1.8%
tpcds_q20/datafusion:parquet 29730233 / 30671844 / -3.1% 71007401 / 66128781 / +7.4% 0.42 / 0.46 / -9.7%
tpcds_q21/datafusion:parquet 23246803 / 23413324 / -0.7% 67428651 / 59287498 / +13.7% 🔴 0.34 / 0.39 / -12.7%
tpcds_q22/datafusion:parquet 126339892 / 108598251 / +16.3% 🔴 216403336 / 212258489 / +2.0% 0.58 / 0.51 / +14.1%
tpcds_q23/datafusion:parquet 162778027 / 161509525 / +0.8% 237232091 / 241242751 / -1.7% 0.69 / 0.67 / +2.5%
tpcds_q24/datafusion:parquet 132998468 / 132254505 / +0.6% 201067815 / 200184261 / +0.4% 0.66 / 0.66 / +0.1%
tpcds_q25/datafusion:parquet 105679846 / 104235012 / +1.4% 180057476 / 181472535 / -0.8% 0.59 / 0.57 / +2.2%
tpcds_q26/datafusion:parquet 84919564 / 83671535 / +1.5% 136956914 / 143202155 / -4.4% 0.62 / 0.58 / +6.1%
tpcds_q27/datafusion:parquet 151404030 / 149176970 / +1.5% 238426974 / 235313811 / +1.3% 0.64 / 0.63 / +0.2%
tpcds_q28/datafusion:parquet 35589796 / 35293418 / +0.8% 93609768 / 95723871 / -2.2% 0.38 / 0.37 / +3.1%
tpcds_q29/datafusion:parquet 108335236 / 107178964 / +1.1% 176204560 / 173773714 / +1.4% 0.61 / 0.62 / -0.3%
tpcds_q30/datafusion:parquet 43912028 / 44566502 / -1.5% 91028942 / 92690432 / -1.8% 0.48 / 0.48 / +0.3%
tpcds_q31/datafusion:parquet 89837170 / 90180280 / -0.4% 143941052 / 142286637 / +1.2% 0.62 / 0.63 / -1.5%
tpcds_q32/datafusion:parquet 25056006 / 25070048 / -0.1% 68955816 / 62034987 / +11.2% 🔴 0.36 / 0.40 / -10.1%
tpcds_q33/datafusion:parquet 41586826 / 41908630 / -0.8% 87843176 / 92715875 / -5.3% 0.47 / 0.45 / +4.7%
tpcds_q34/datafusion:parquet 30738192 / 30210818 / +1.7% 71090782 / 72408767 / -1.8% 0.43 / 0.42 / +3.6%
tpcds_q35/datafusion:parquet 92520613 / 92675967 / -0.2% 147681361 / 142794573 / +3.4% 0.63 / 0.65 / -3.5%
tpcds_q36/datafusion:parquet 64821139 / 64361475 / +0.7% 141231593 / 144759159 / -2.4% 0.46 / 0.44 / +3.2%
tpcds_q37/datafusion:parquet 25598040 / 26217798 / -2.4% 66782026 / 66566569 / +0.3% 0.38 / 0.39 / -2.7%
tpcds_q38/datafusion:parquet 56381790 / 54712912 / +3.1% 107991246 / 105070819 / +2.8% 0.52 / 0.52 / +0.3%
tpcds_q39/datafusion:parquet 76914589 / 77106015 / -0.2% 128006380 / 128667905 / -0.5% 0.60 / 0.60 / +0.3%
tpcds_q40/datafusion:parquet 33056826 / 33028370 / +0.1% 82763464 / 79740730 / +3.8% 0.40 / 0.41 / -3.6%
tpcds_q41/datafusion:parquet 22340930 / 21731714 / +2.8% 49208993 / 51067962 / -3.6% 0.45 / 0.43 / +6.7%
tpcds_q42/datafusion:parquet 17288383 / 16053494 / +7.7% 54196562 / 54846749 / -1.2% 0.32 / 0.29 / +9.0%
tpcds_q43/datafusion:parquet 23081698 / 23222304 / -0.6% 62816981 / 64837539 / -3.1% 0.37 / 0.36 / +2.6%
tpcds_q44/datafusion:parquet 37320954 / 39485266 / -5.5% 98184815 / 93682206 / +4.8% 0.38 / 0.42 / -9.8%
tpcds_q45/datafusion:parquet 46572069 / 45612396 / +2.1% 96724136 / 94407473 / +2.5% 0.48 / 0.48 / -0.3%
tpcds_q46/datafusion:parquet 39424726 / 40835755 / -3.5% 98623725 / 98996004 / -0.4% 0.40 / 0.41 / -3.1%
tpcds_q47/datafusion:parquet 141449866 / 141347694 / +0.1% 210961077 / 209585329 / +0.7% 0.67 / 0.67 / -0.6%
tpcds_q48/datafusion:parquet 86965272 / 86142006 / +1.0% 136873988 / 136390087 / +0.4% 0.64 / 0.63 / +0.6%
tpcds_q49/datafusion:parquet 74236750 / 71036230 / +4.5% 139962437 / 142870170 / -2.0% 0.53 / 0.50 / +6.7%
tpcds_q50/datafusion:parquet 72784356 / 70196460 / +3.7% 121080576 / 119357601 / +1.4% 0.60 / 0.59 / +2.2%
tpcds_q51/datafusion:parquet 78630426 / 78916224 / -0.4% 139283824 / 137332695 / +1.4% 0.56 / 0.57 / -1.8%
tpcds_q52/datafusion:parquet 16177386 / 17591048 / -8.0% 58789908 / 57424995 / +2.4% 0.28 / 0.31 / -10.2%
tpcds_q53/datafusion:parquet 25341776 / 27096822 / -6.5% 67101430 / 69838747 / -3.9% 0.38 / 0.39 / -2.7%
tpcds_q54/datafusion:parquet 44179492 / 44832280 / -1.5% 93418739 / 93865481 / -0.5% 0.47 / 0.48 / -1.0%
tpcds_q55/datafusion:parquet 17906592 / 16761818 / +6.8% 55744610 / 56472776 / -1.3% 0.32 / 0.30 / +8.2%
tpcds_q56/datafusion:parquet 38839318 / 39657929 / -2.1% 94186545 / 93546541 / +0.7% 0.41 / 0.42 / -2.7%
tpcds_q57/datafusion:parquet 124245862 / 122673674 / +1.3% 177034464 / 177360173 / -0.2% 0.70 / 0.69 / +1.5%
tpcds_q58/datafusion:parquet 82591959 / 79952832 / +3.3% 138972907 / 143675493 / -3.3% 0.59 / 0.56 / +6.8%
tpcds_q59/datafusion:parquet 71065536 / 71294935 / -0.3% 120561235 / 120977779 / -0.3% 0.59 / 0.59 / +0.0%
tpcds_q60/datafusion:parquet 37469621 / 35943518 / +4.2% 91667618 / 91500219 / +0.2% 0.41 / 0.39 / +4.1%
tpcds_q61/datafusion:parquet 45820488 / 47869958 / -4.3% 102665304 / 104017412 / -1.3% 0.45 / 0.46 / -3.0%
tpcds_q62/datafusion:parquet 33145752 / 28683486 / +15.6% 🔴 73854667 / 69907507 / +5.6% 0.45 / 0.41 / +9.4%
tpcds_q63/datafusion:parquet 25805532 / 27325844 / -5.6% 68063460 / 66346102 / +2.6% 0.38 / 0.41 / -7.9%
tpcds_q64/datafusion:parquet 350249854 / 347169882 / +0.9% 439818748 / 444003035 / -0.9% 0.80 / 0.78 / +1.8%
tpcds_q65/datafusion:parquet 46039528 / 45824434 / +0.5% 102833507 / 103392406 / -0.5% 0.45 / 0.44 / +1.0%
tpcds_q66/datafusion:parquet 85153941 / 83652768 / +1.8% 128865480 / 127024297 / +1.4% 0.66 / 0.66 / +0.3%
tpcds_q67/datafusion:parquet 134958740 / 133623734 / +1.0% 203863998 / 204880961 / -0.5% 0.66 / 0.65 / +1.5%
tpcds_q68/datafusion:parquet 39291899 / 39855668 / -1.4% 98253535 / 95942446 / +2.4% 0.40 / 0.42 / -3.7%
tpcds_q69/datafusion:parquet 88533043 / 84451298 / +4.8% 136030890 / 131293879 / +3.6% 0.65 / 0.64 / +1.2%
tpcds_q70/datafusion:parquet 43580833 / 42509606 / +2.5% 96331970 / 89378247 / +7.8% 0.45 / 0.48 / -4.9%
tpcds_q71/datafusion:parquet 28471356 / 26623035 / +6.9% 78137899 / 75440850 / +3.6% 0.36 / 0.35 / +3.3%
tpcds_q72/datafusion:parquet 435046581 / 437666574 / -0.6% 527309391 / 538948864 / -2.2% 0.83 / 0.81 / +1.6%
tpcds_q73/datafusion:parquet 29937000 / 29601848 / +1.1% 72664043 / 70585053 / +2.9% 0.41 / 0.42 / -1.8%
tpcds_q74/datafusion:parquet 96667666 / 96354617 / +0.3% 156163467 / 154791669 / +0.9% 0.62 / 0.62 / -0.6%
tpcds_q75/datafusion:parquet 160006220 / 157707136 / +1.5% 235105571 / 238320825 / -1.3% 0.68 / 0.66 / +2.8%
tpcds_q76/datafusion:parquet 57483643 / 55763886 / +3.1% 108164400 / 103904313 / +4.1% 0.53 / 0.54 / -1.0%
tpcds_q77/datafusion:parquet 54805561 / 53929027 / +1.6% 107033752 / 106190213 / +0.8% 0.51 / 0.51 / +0.8%
tpcds_q78/datafusion:parquet 115271437 / 113885792 / +1.2% 202565237 / 201974542 / +0.3% 0.57 / 0.56 / +0.9%
tpcds_q79/datafusion:parquet 33653373 / 33653854 / -0.0% 82340584 / 80094634 / +2.8% 0.41 / 0.42 / -2.7%
tpcds_q80/datafusion:parquet 92815924 / 94109820 / -1.4% 183486958 / 183112531 / +0.2% 0.51 / 0.51 / -1.6%
tpcds_q81/datafusion:parquet 39641259 / 39425996 / +0.5% 91621596 / 90350499 / +1.4% 0.43 / 0.44 / -0.8%
tpcds_q82/datafusion:parquet 24283334 / 24455878 / -0.7% 69317261 / 64037991 / +8.2% 0.35 / 0.38 / -8.3%
tpcds_q83/datafusion:parquet 56480343 / 55221372 / +2.3% 104514960 / 103126874 / +1.3% 0.54 / 0.54 / +0.9%
tpcds_q84/datafusion:parquet 45974362 / 46160388 / -0.4% 87621393 / 89244373 / -1.8% 0.52 / 0.52 / +1.4%
tpcds_q85/datafusion:parquet 183037526 / 182823614 / +0.1% 263305743 / 262346033 / +0.4% 0.70 / 0.70 / -0.2%
tpcds_q86/datafusion:parquet 23406368 / 23664379 / -1.1% 59910058 / 59259672 / +1.1% 0.39 / 0.40 / -2.2%
tpcds_q87/datafusion:parquet 58961000 / 58583515 / +0.6% 111565904 / 111408290 / +0.1% 0.53 / 0.53 / +0.5%
tpcds_q88/datafusion:parquet 56873806 / 56580303 / +0.5% 115893190 / 112476196 / +3.0% 0.49 / 0.50 / -2.4%
tpcds_q89/datafusion:parquet 29480465 / 28132092 / +4.8% 72828348 / 73038085 / -0.3% 0.40 / 0.39 / +5.1%
tpcds_q90/datafusion:parquet 19177640 / 19457628 / -1.4% 57145145 / 57590901 / -0.8% 0.34 / 0.34 / -0.7%
tpcds_q91/datafusion:parquet 63392078 / 63103272 / +0.5% 102648538 / 106539992 / -3.7% 0.62 / 0.59 / +4.3%
tpcds_q92/datafusion:parquet 23898324 / 24350470 / -1.9% 65823641 / 66431564 / -0.9% 0.36 / 0.37 / -1.0%
tpcds_q93/datafusion:parquet 33008112 / 34731207 / -5.0% 91775455 / 89275018 / +2.8% 0.36 / 0.39 / -7.6%
tpcds_q94/datafusion:parquet 31963366 / 31028630 / +3.0% 75287780 / 75346557 / -0.1% 0.42 / 0.41 / +3.1%
tpcds_q95/datafusion:parquet 85706487 / 84945710 / +0.9% 143033487 / 145403956 / -1.6% 0.60 / 0.58 / +2.6%
tpcds_q96/datafusion:parquet 16706125 / 16532234 / +1.1% 56388348 / 52635874 / +7.1% 0.30 / 0.31 / -5.7%
tpcds_q97/datafusion:parquet 37722407 / 37884869 / -0.4% 84431112 / 87364743 / -3.4% 0.45 / 0.43 / +3.0%
tpcds_q98/datafusion:parquet 27048736 / 27690736 / -2.3% 75591192 / 73189051 / +3.3% 0.36 / 0.38 / -5.4%
tpcds_q99/datafusion:parquet 34638397 / 32673985 / +6.0% 68672654 / 70043034 / -2.0% 0.50 / 0.47 / +8.1%
duckdb / vortex-file-compressed / ns (0.993x ➖, 4↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 24592534 / 25670807 / -4.2% 45098108 / 40311824 / +11.9% 🔴 0.55 / 0.64 / -14.4%
tpcds_q02/duckdb:vortex-file-compressed 28045283 / 26928593 / +4.1% 42339185 / 48885481 / -13.4% 🟢 0.66 / 0.55 / +20.2%
tpcds_q03/duckdb:vortex-file-compressed 20464680 / 19331450 / +5.9% 40164351 / 42536402 / -5.6% 0.51 / 0.45 / +12.1%
tpcds_q04/duckdb:vortex-file-compressed 92536412 / 94713280 / -2.3% 126582141 / 124496083 / +1.7% 0.73 / 0.76 / -3.9%
tpcds_q05/duckdb:vortex-file-compressed 33299074 / 32633901 / +2.0% 56646129 / 61095583 / -7.3% 0.59 / 0.53 / +10.1%
tpcds_q06/duckdb:vortex-file-compressed 45458212 / 44712393 / +1.7% 73708147 / 71635401 / +2.9% 0.62 / 0.62 / -1.2%
tpcds_q07/duckdb:vortex-file-compressed 29657924 / 31227118 / -5.0% 60082462 / 58447688 / +2.8% 0.49 / 0.53 / -7.6%
tpcds_q08/duckdb:vortex-file-compressed 35737812 / 35418190 / +0.9% 61512393 / 59042185 / +4.2% 0.58 / 0.60 / -3.1%
tpcds_q09/duckdb:vortex-file-compressed 17308335 / 17075961 / +1.4% 57076811 / 49129765 / +16.2% 🔴 0.30 / 0.35 / -12.8%
tpcds_q10/duckdb:vortex-file-compressed 52713194 / 52920844 / -0.4% 79131055 / 82481390 / -4.1% 0.67 / 0.64 / +3.8%
tpcds_q11/duckdb:vortex-file-compressed 75838420 / 73390115 / +3.3% 101209784 / 99769496 / +1.4% 0.75 / 0.74 / +1.9%
tpcds_q12/duckdb:vortex-file-compressed 18589257 / 19379436 / -4.1% 35209852 / 35597655 / -1.1% 0.53 / 0.54 / -3.0%
tpcds_q13/duckdb:vortex-file-compressed 40401374 / 38847118 / +4.0% 71663563 / 67638895 / +6.0% 0.56 / 0.57 / -1.8%
tpcds_q14/duckdb:vortex-file-compressed 109601838 / 103973648 / +5.4% 150850585 / 147070469 / +2.6% 0.73 / 0.71 / +2.8%
tpcds_q15/duckdb:vortex-file-compressed 32681334 / 33556803 / -2.6% 59282336 / 48629986 / +21.9% 🔴 0.55 / 0.69 / -20.1%
tpcds_q16/duckdb:vortex-file-compressed 31358561 / 33486673 / -6.4% 50675943 / 52930216 / -4.3% 0.62 / 0.63 / -2.2%
tpcds_q17/duckdb:vortex-file-compressed 49189833 / 50291142 / -2.2% 86586495 / 88473301 / -2.1% 0.57 / 0.57 / -0.1%
tpcds_q18/duckdb:vortex-file-compressed 46798300 / 47404019 / -1.3% 68643578 / 72476974 / -5.3% 0.68 / 0.65 / +4.2%
tpcds_q19/duckdb:vortex-file-compressed 40156204 / 39038989 / +2.9% 65790859 / 63540812 / +3.5% 0.61 / 0.61 / -0.7%
tpcds_q20/duckdb:vortex-file-compressed 17133727 / 19490949 / -12.1% 🟢 34393154 / 36290193 / -5.2% 0.50 / 0.54 / -7.2%
tpcds_q21/duckdb:vortex-file-compressed 20942476 / 20420826 / +2.6% 54950796 / 54446810 / +0.9% 0.38 / 0.38 / +1.6%
tpcds_q22/duckdb:vortex-file-compressed 66573980 / 67561502 / -1.5% 97282993 / 101376873 / -4.0% 0.68 / 0.67 / +2.7%
tpcds_q23/duckdb:vortex-file-compressed 72969287 / 70289176 / +3.8% 114997120 / 118548304 / -3.0% 0.63 / 0.59 / +7.0%
tpcds_q24/duckdb:vortex-file-compressed 49507872 / 54076389 / -8.4% 82805933 / 81336703 / +1.8% 0.60 / 0.66 / -10.1%
tpcds_q25/duckdb:vortex-file-compressed 43293720 / 44874890 / -3.5% 78130507 / 75515999 / +3.5% 0.55 / 0.59 / -6.8%
tpcds_q26/duckdb:vortex-file-compressed 26002794 / 23800246 / +9.3% 47847807 / 44683414 / +7.1% 0.54 / 0.53 / +2.0%
tpcds_q27/duckdb:vortex-file-compressed 30669283 / 31765890 / -3.5% 62270584 / 65907488 / -5.5% 0.49 / 0.48 / +2.2%
tpcds_q28/duckdb:vortex-file-compressed 13162472 / 12408365 / +6.1% 28348624 / 27280302 / +3.9% 0.46 / 0.45 / +2.1%
tpcds_q29/duckdb:vortex-file-compressed 49456497 / 53158361 / -7.0% 92601809 / 90902995 / +1.9% 0.53 / 0.58 / -8.7%
tpcds_q30/duckdb:vortex-file-compressed 32042537 / 33975626 / -5.7% 55446761 / 54668761 / +1.4% 0.58 / 0.62 / -7.0%
tpcds_q31/duckdb:vortex-file-compressed 32504254 / 32801851 / -0.9% 63881524 / 59102639 / +8.1% 0.51 / 0.55 / -8.3%
tpcds_q32/duckdb:vortex-file-compressed 17423204 / 17136640 / +1.7% 33159847 / 39134551 / -15.3% 🟢 0.53 / 0.44 / +20.0%
tpcds_q33/duckdb:vortex-file-compressed 30242570 / 29188663 / +3.6% 59034013 / 61090363 / -3.4% 0.51 / 0.48 / +7.2%
tpcds_q34/duckdb:vortex-file-compressed 26811388 / 25459419 / +5.3% 47437324 / 44827675 / +5.8% 0.57 / 0.57 / -0.5%
tpcds_q35/duckdb:vortex-file-compressed 76747994 / 78916885 / -2.7% 113661849 / 111317534 / +2.1% 0.68 / 0.71 / -4.8%
tpcds_q36/duckdb:vortex-file-compressed 27783006 / 27683124 / +0.4% 59943246 / 59342444 / +1.0% 0.46 / 0.47 / -0.6%
tpcds_q37/duckdb:vortex-file-compressed 25322288 / 25736570 / -1.6% 50369956 / 51277074 / -1.8% 0.50 / 0.50 / +0.2%
tpcds_q38/duckdb:vortex-file-compressed 38222732 / 37787411 / +1.2% 59380265 / 57311063 / +3.6% 0.64 / 0.66 / -2.4%
tpcds_q39/duckdb:vortex-file-compressed 34467764 / 40222944 / -14.3% 🟢 68467628 / 66569306 / +2.9% 0.50 / 0.60 / -16.7%
tpcds_q40/duckdb:vortex-file-compressed 23622386 / 22216762 / +6.3% 36987388 / 39596773 / -6.6% 0.64 / 0.56 / +13.8%
tpcds_q41/duckdb:vortex-file-compressed 9349470 / 10218676 / -8.5% 18923916 / 20589698 / -8.1% 0.49 / 0.50 / -0.5%
tpcds_q42/duckdb:vortex-file-compressed 15926594 / 15961689 / -0.2% 39973508 / 40416459 / -1.1% 0.40 / 0.39 / +0.9%
tpcds_q43/duckdb:vortex-file-compressed 20791450 / 19256541 / +8.0% 41495992 / 41628739 / -0.3% 0.50 / 0.46 / +8.3%
tpcds_q44/duckdb:vortex-file-compressed 26135972 / 25502148 / +2.5% 63863892 / 67687645 / -5.6% 0.41 / 0.38 / +8.6%
tpcds_q45/duckdb:vortex-file-compressed 35902278 / 36398268 / -1.4% 49896296 / 50521130 / -1.2% 0.72 / 0.72 / -0.1%
tpcds_q46/duckdb:vortex-file-compressed 32080304 / 35642216 / -10.0% 68659575 / 66215833 / +3.7% 0.47 / 0.54 / -13.2%
tpcds_q47/duckdb:vortex-file-compressed 52638100 / 58127304 / -9.4% 80402845 / 86972394 / -7.6% 0.65 / 0.67 / -2.0%
tpcds_q48/duckdb:vortex-file-compressed 35736078 / 34613452 / +3.2% 68668095 / 66334940 / +3.5% 0.52 / 0.52 / -0.3%
tpcds_q49/duckdb:vortex-file-compressed 33811948 / 33492292 / +1.0% 70083482 / 70238318 / -0.2% 0.48 / 0.48 / +1.2%
tpcds_q50/duckdb:vortex-file-compressed 31058875 / 31471511 / -1.3% 60095506 / 61892853 / -2.9% 0.52 / 0.51 / +1.6%
tpcds_q51/duckdb:vortex-file-compressed 99403340 / 131012205 / -24.1% 🟢 118176660 / 125909416 / -6.1% 0.84 / 1.04 / -19.2%
tpcds_q52/duckdb:vortex-file-compressed 15821430 / 16542021 / -4.4% 39343671 / 40053340 / -1.8% 0.40 / 0.41 / -2.6%
tpcds_q53/duckdb:vortex-file-compressed 25839310 / 25229477 / +2.4% 51146419 / 53541832 / -4.5% 0.51 / 0.47 / +7.2%
tpcds_q54/duckdb:vortex-file-compressed 35879210 / 34774780 / +3.2% 65243304 / 66069934 / -1.3% 0.55 / 0.53 / +4.5%
tpcds_q55/duckdb:vortex-file-compressed 15983120 / 16430534 / -2.7% 39475683 / 41106771 / -4.0% 0.40 / 0.40 / +1.3%
tpcds_q56/duckdb:vortex-file-compressed 30027388 / 30030218 / -0.0% 59820295 / 59885569 / -0.1% 0.50 / 0.50 / +0.1%
tpcds_q57/duckdb:vortex-file-compressed 41140711 / 39444209 / +4.3% 60829379 / 59643294 / +2.0% 0.68 / 0.66 / +2.3%
tpcds_q58/duckdb:vortex-file-compressed 34715430 / 31971401 / +8.6% 59047749 / 57607694 / +2.5% 0.59 / 0.55 / +5.9%
tpcds_q59/duckdb:vortex-file-compressed 38307306 / 37940823 / +1.0% 60302862 / 59620826 / +1.1% 0.64 / 0.64 / -0.2%
tpcds_q60/duckdb:vortex-file-compressed 30881452 / 31111748 / -0.7% 60646285 / 60643792 / +0.0% 0.51 / 0.51 / -0.7%
tpcds_q61/duckdb:vortex-file-compressed 36344292 / 36453436 / -0.3% 81919525 / 78042605 / +5.0% 0.44 / 0.47 / -5.0%
tpcds_q62/duckdb:vortex-file-compressed 19716198 / 16756338 / +17.7% 🔴 35627563 / 36351731 / -2.0% 0.55 / 0.46 / +20.1%
tpcds_q63/duckdb:vortex-file-compressed 24214710 / 23232643 / +4.2% 52100192 / 50642460 / +2.9% 0.46 / 0.46 / +1.3%
tpcds_q64/duckdb:vortex-file-compressed 110404196 / 114653092 / -3.7% 148916728 / 150014540 / -0.7% 0.74 / 0.76 / -3.0%
tpcds_q65/duckdb:vortex-file-compressed 25551190 / 26192862 / -2.4% 47488312 / 48225172 / -1.5% 0.54 / 0.54 / -0.9%
tpcds_q66/duckdb:vortex-file-compressed 38371784 / 39297288 / -2.4% 66233197 / 67822804 / -2.3% 0.58 / 0.58 / -0.0%
tpcds_q67/duckdb:vortex-file-compressed 125567867 / 127590220 / -1.6% 152531828 / 158921815 / -4.0% 0.82 / 0.80 / +2.5%
tpcds_q68/duckdb:vortex-file-compressed 30344634 / 32038549 / -5.3% 63788709 / 61691771 / +3.4% 0.48 / 0.52 / -8.4%
tpcds_q69/duckdb:vortex-file-compressed 50881712 / 54078472 / -5.9% 85926745 / 92667416 / -7.3% 0.59 / 0.58 / +1.5%
tpcds_q70/duckdb:vortex-file-compressed 37621464 / 35123360 / +7.1% 66687804 / 68842370 / -3.1% 0.56 / 0.51 / +10.6%
tpcds_q71/duckdb:vortex-file-compressed 23459736 / 23652096 / -0.8% 53546618 / 57488990 / -6.9% 0.44 / 0.41 / +6.5%
tpcds_q72/duckdb:vortex-file-compressed 145021966 / 146570090 / -1.1% 189265743 / 185615547 / +2.0% 0.77 / 0.79 / -3.0%
tpcds_q73/duckdb:vortex-file-compressed 25349181 / 24686974 / +2.7% 47740055 / 45335371 / +5.3% 0.53 / 0.54 / -2.5%
tpcds_q74/duckdb:vortex-file-compressed 49219000 / 49868066 / -1.3% 82296238 / 81949281 / +0.4% 0.60 / 0.61 / -1.7%
tpcds_q75/duckdb:vortex-file-compressed 51632160 / 49625816 / +4.0% 84529116 / 86292800 / -2.0% 0.61 / 0.58 / +6.2%
tpcds_q76/duckdb:vortex-file-compressed 23522214 / 23969856 / -1.9% 52421416 / 55536065 / -5.6% 0.45 / 0.43 / +4.0%
tpcds_q77/duckdb:vortex-file-compressed 29212218 / 27705062 / +5.4% 55204896 / 53249997 / +3.7% 0.53 / 0.52 / +1.7%
tpcds_q78/duckdb:vortex-file-compressed 70565188 / 76371274 / -7.6% 103761043 / 99018253 / +4.8% 0.68 / 0.77 / -11.8%
tpcds_q79/duckdb:vortex-file-compressed 27862476 / 28004793 / -0.5% 58042139 / 55687441 / +4.2% 0.48 / 0.50 / -4.5%
tpcds_q80/duckdb:vortex-file-compressed 50251020 / 49855231 / +0.8% 88561296 / 84953560 / +4.2% 0.57 / 0.59 / -3.3%
tpcds_q81/duckdb:vortex-file-compressed 38978519 / 40333900 / -3.4% 58837044 / 56174650 / +4.7% 0.66 / 0.72 / -7.7%
tpcds_q82/duckdb:vortex-file-compressed 50830464 / 52960372 / -4.0% 82364064 / 79442310 / +3.7% 0.62 / 0.67 / -7.4%
tpcds_q83/duckdb:vortex-file-compressed 33993047 / 31544826 / +7.8% 43442529 / 43881744 / -1.0% 0.78 / 0.72 / +8.9%
tpcds_q84/duckdb:vortex-file-compressed 24397526 / 25593336 / -4.7% 39502040 / 40217587 / -1.8% 0.62 / 0.64 / -2.9%
tpcds_q85/duckdb:vortex-file-compressed 50689612 / 50082068 / +1.2% 71662330 / 76239959 / -6.0% 0.71 / 0.66 / +7.7%
tpcds_q86/duckdb:vortex-file-compressed 21028416 / 20263268 / +3.8% 37662749 / 37619262 / +0.1% 0.56 / 0.54 / +3.7%
tpcds_q87/duckdb:vortex-file-compressed 42217579 / 40499478 / +4.2% 63017182 / 65965732 / -4.5% 0.67 / 0.61 / +9.1%
tpcds_q88/duckdb:vortex-file-compressed 60241202 / 61958574 / -2.8% 120021993 / 119663838 / +0.3% 0.50 / 0.52 / -3.1%
tpcds_q89/duckdb:vortex-file-compressed 26262648 / 22622844 / +16.1% 🔴 54961592 / 50351493 / +9.2% 0.48 / 0.45 / +6.4%
tpcds_q90/duckdb:vortex-file-compressed 15605470 / 15602786 / +0.0% 36996879 / 29063767 / +27.3% 🔴 0.42 / 0.54 / -21.4%
tpcds_q91/duckdb:vortex-file-compressed 27233917 / 29743964 / -8.4% 43622301 / 43116150 / +1.2% 0.62 / 0.69 / -9.5%
tpcds_q92/duckdb:vortex-file-compressed 22338466 / 22317592 / +0.1% 40131582 / 41679603 / -3.7% 0.56 / 0.54 / +4.0%
tpcds_q93/duckdb:vortex-file-compressed 28384495 / 28619424 / -0.8% 48048493 / 54398750 / -11.7% 🟢 0.59 / 0.53 / +12.3%
tpcds_q94/duckdb:vortex-file-compressed 29865846 / 31128460 / -4.1% 52156920 / 54636293 / -4.5% 0.57 / 0.57 / +0.5%
tpcds_q95/duckdb:vortex-file-compressed 139715427 / 145626276 / -4.1% 148259225 / 158746152 / -6.6% 0.94 / 0.92 / +2.7%
tpcds_q96/duckdb:vortex-file-compressed 16129050 / 16466592 / -2.0% 36822655 / 37444484 / -1.7% 0.44 / 0.44 / -0.4%
tpcds_q97/duckdb:vortex-file-compressed 40718296 / 40634030 / +0.2% 69540473 / 58597505 / +18.7% 🔴 0.59 / 0.69 / -15.6%
tpcds_q98/duckdb:vortex-file-compressed 21166086 / 23519360 / -10.0% 🟢 49541870 / 48008622 / +3.2% 0.43 / 0.49 / -12.8%
tpcds_q99/duckdb:vortex-file-compressed 24675430 / 25813273 / -4.4% 45907224 / 42596422 / +7.8% 0.54 / 0.61 / -11.3%
duckdb / vortex-compact / ns (1.003x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 28676342 / 27492860 / +4.3% 45924565 / 52853426 / -13.1% 🟢 0.62 / 0.52 / +20.0%
tpcds_q02/duckdb:vortex-compact 30206858 / 30870240 / -2.1% 49694669 / 51956596 / -4.4% 0.61 / 0.59 / +2.3%
tpcds_q03/duckdb:vortex-compact 43690141 / 44013550 / -0.7% 66232809 / 69412337 / -4.6% 0.66 / 0.63 / +4.0%
tpcds_q04/duckdb:vortex-compact 101193772 / 100772966 / +0.4% 135976751 / 140802337 / -3.4% 0.74 / 0.72 / +4.0%
tpcds_q05/duckdb:vortex-compact 44691451 / 42624672 / +4.8% 71306193 / 68992906 / +3.4% 0.63 / 0.62 / +1.4%
tpcds_q06/duckdb:vortex-compact 57129399 / 56083766 / +1.9% 84821079 / 80037581 / +6.0% 0.67 / 0.70 / -3.9%
tpcds_q07/duckdb:vortex-compact 62136545 / 61126727 / +1.7% 81332523 / 93076882 / -12.6% 🟢 0.76 / 0.66 / +16.3%
tpcds_q08/duckdb:vortex-compact 95705482 / 95315364 / +0.4% 120048813 / 120824145 / -0.6% 0.80 / 0.79 / +1.1%
tpcds_q09/duckdb:vortex-compact 23931144 / 29986847 / -20.2% 🟢 71459415 / 69577343 / +2.7% 0.33 / 0.43 / -22.3%
tpcds_q10/duckdb:vortex-compact 90888557 / 88873246 / +2.3% 112964776 / 117496000 / -3.9% 0.80 / 0.76 / +6.4%
tpcds_q11/duckdb:vortex-compact 81430844 / 79223996 / +2.8% 104220421 / 105887090 / -1.6% 0.78 / 0.75 / +4.4%
tpcds_q12/duckdb:vortex-compact 20521020 / 21256760 / -3.5% 37492539 / 37954047 / -1.2% 0.55 / 0.56 / -2.3%
tpcds_q13/duckdb:vortex-compact 76281344 / 77144644 / -1.1% 111705549 / 104216021 / +7.2% 0.68 / 0.74 / -7.7%
tpcds_q14/duckdb:vortex-compact 128928742 / 127901654 / +0.8% 175798223 / 179772173 / -2.2% 0.73 / 0.71 / +3.1%
tpcds_q15/duckdb:vortex-compact 40533238 / 41914575 / -3.3% 55437216 / 56709878 / -2.2% 0.73 / 0.74 / -1.1%
tpcds_q16/duckdb:vortex-compact 43568451 / 43979597 / -0.9% 70640222 / 68718079 / +2.8% 0.62 / 0.64 / -3.6%
tpcds_q17/duckdb:vortex-compact 84762076 / 83639508 / +1.3% 120859378 / 113368285 / +6.6% 0.70 / 0.74 / -4.9%
tpcds_q18/duckdb:vortex-compact 65786324 / 65538234 / +0.4% 80876518 / 91824846 / -11.9% 🟢 0.81 / 0.71 / +14.0%
tpcds_q19/duckdb:vortex-compact 65094631 / 63496230 / +2.5% 88669195 / 88733217 / -0.1% 0.73 / 0.72 / +2.6%
tpcds_q20/duckdb:vortex-compact 21712192 / 21645456 / +0.3% 38152622 / 40715075 / -6.3% 0.57 / 0.53 / +7.0%
tpcds_q21/duckdb:vortex-compact 22972338 / 20148322 / +14.0% 🔴 57950021 / 60550762 / -4.3% 0.40 / 0.33 / +19.1%
tpcds_q22/duckdb:vortex-compact 69718346 / 71497245 / -2.5% 111960994 / 98392771 / +13.8% 🔴 0.62 / 0.73 / -14.3%
tpcds_q23/duckdb:vortex-compact 86969341 / 88372199 / -1.6% 133463832 / 135091997 / -1.2% 0.65 / 0.65 / -0.4%
tpcds_q24/duckdb:vortex-compact 74313722 / 76041289 / -2.3% 103390773 / 100508755 / +2.9% 0.72 / 0.76 / -5.0%
tpcds_q25/duckdb:vortex-compact 79853423 / 78473859 / +1.8% 117776314 / 104533398 / +12.7% 🔴 0.68 / 0.75 / -9.7%
tpcds_q26/duckdb:vortex-compact 46697256 / 46914892 / -0.5% 70122973 / 66447673 / +5.5% 0.67 / 0.71 / -5.7%
tpcds_q27/duckdb:vortex-compact 68086094 / 68034155 / +0.1% 99355018 / 96256789 / +3.2% 0.69 / 0.71 / -3.0%
tpcds_q28/duckdb:vortex-compact 22551014 / 21633532 / +4.2% 41510697 / 39789296 / +4.3% 0.54 / 0.54 / -0.1%
tpcds_q29/duckdb:vortex-compact 85871934 / 84973182 / +1.1% 109878621 / 113810432 / -3.5% 0.78 / 0.75 / +4.7%
tpcds_q30/duckdb:vortex-compact 34651763 / 36933141 / -6.2% 58432403 / 59123789 / -1.2% 0.59 / 0.62 / -5.1%
tpcds_q31/duckdb:vortex-compact 43844390 / 45327293 / -3.3% 67191529 / 66644549 / +0.8% 0.65 / 0.68 / -4.1%
tpcds_q32/duckdb:vortex-compact 24582793 / 23992927 / +2.5% 42227062 / 46059358 / -8.3% 0.58 / 0.52 / +11.8%
tpcds_q33/duckdb:vortex-compact 42713823 / 43704178 / -2.3% 70863560 / 77752065 / -8.9% 0.60 / 0.56 / +7.2%
tpcds_q34/duckdb:vortex-compact 47854170 / 48447154 / -1.2% 74422135 / 69055923 / +7.8% 0.64 / 0.70 / -8.3%
tpcds_q35/duckdb:vortex-compact 108029674 / 107920198 / +0.1% 135723563 / 142968294 / -5.1% 0.80 / 0.75 / +5.4%
tpcds_q36/duckdb:vortex-compact 44963187 / 42308134 / +6.3% 69197736 / 74180942 / -6.7% 0.65 / 0.57 / +13.9%
tpcds_q37/duckdb:vortex-compact 28636630 / 28089572 / +1.9% 64236665 / 63663427 / +0.9% 0.45 / 0.44 / +1.0%
tpcds_q38/duckdb:vortex-compact 49191385 / 48156320 / +2.1% 73617837 / 70029892 / +5.1% 0.67 / 0.69 / -2.8%
tpcds_q39/duckdb:vortex-compact 33120540 / 37854016 / -12.5% 🟢 84840663 / 75831646 / +11.9% 🔴 0.39 / 0.50 / -21.8%
tpcds_q40/duckdb:vortex-compact 28132060 / 26864864 / +4.7% 46044534 / 44429514 / +3.6% 0.61 / 0.60 / +1.0%
tpcds_q41/duckdb:vortex-compact 10926914 / 11217504 / -2.6% 20789385 / 25081934 / -17.1% 🟢 0.53 / 0.45 / +17.5%
tpcds_q42/duckdb:vortex-compact 24456801 / 22811216 / +7.2% 47013692 / 53456775 / -12.1% 🟢 0.52 / 0.43 / +21.9%
tpcds_q43/duckdb:vortex-compact 34517716 / 33990482 / +1.6% 53465083 / 53408641 / +0.1% 0.65 / 0.64 / +1.4%
tpcds_q44/duckdb:vortex-compact 36688653 / 33438178 / +9.7% 74604459 / 71368439 / +4.5% 0.49 / 0.47 / +5.0%
tpcds_q45/duckdb:vortex-compact 41792073 / 45121382 / -7.4% 61837556 / 63452754 / -2.5% 0.68 / 0.71 / -5.0%
tpcds_q46/duckdb:vortex-compact 61096340 / 59679592 / +2.4% 86969570 / 78674244 / +10.5% 🔴 0.70 / 0.76 / -7.4%
tpcds_q47/duckdb:vortex-compact 66572166 / 69456092 / -4.2% 99641084 / 96196110 / +3.6% 0.67 / 0.72 / -7.5%
tpcds_q48/duckdb:vortex-compact 69742984 / 67799895 / +2.9% 96581198 / 98903315 / -2.3% 0.72 / 0.69 / +5.3%
tpcds_q49/duckdb:vortex-compact 46743454 / 44358180 / +5.4% 89155067 / 81949402 / +8.8% 0.52 / 0.54 / -3.1%
tpcds_q50/duckdb:vortex-compact 57102530 / 54424796 / +4.9% 97317282 / 76084422 / +27.9% 🔴 0.59 / 0.72 / -18.0%
tpcds_q51/duckdb:vortex-compact 100072454 / 100789172 / -0.7% 128258632 / 131608279 / -2.5% 0.78 / 0.77 / +1.9%
tpcds_q52/duckdb:vortex-compact 23287066 / 25773612 / -9.6% 46072308 / 46234373 / -0.4% 0.51 / 0.56 / -9.3%
tpcds_q53/duckdb:vortex-compact 39846730 / 40113549 / -0.7% 63843527 / 63828839 / +0.0% 0.62 / 0.63 / -0.7%
tpcds_q54/duckdb:vortex-compact 47672754 / 47726905 / -0.1% 78037431 / 81084093 / -3.8% 0.61 / 0.59 / +3.8%
tpcds_q55/duckdb:vortex-compact 24028976 / 23959976 / +0.3% 47788363 / 47438448 / +0.7% 0.50 / 0.51 / -0.4%
tpcds_q56/duckdb:vortex-compact 46525294 / 44894423 / +3.6% 76966177 / 81278895 / -5.3% 0.60 / 0.55 / +9.4%
tpcds_q57/duckdb:vortex-compact 49397234 / 47910642 / +3.1% 67552340 / 64600682 / +4.6% 0.73 / 0.74 / -1.4%
tpcds_q58/duckdb:vortex-compact 42165668 / 39388324 / +7.1% 70039858 / 70381287 / -0.5% 0.60 / 0.56 / +7.6%
tpcds_q59/duckdb:vortex-compact 48442860 / 48012834 / +0.9% 68246762 / 66153722 / +3.2% 0.71 / 0.73 / -2.2%
tpcds_q60/duckdb:vortex-compact 45934766 / 48240376 / -4.8% 76285191 / 75746634 / +0.7% 0.60 / 0.64 / -5.5%
tpcds_q61/duckdb:vortex-compact 66076372 / 68295148 / -3.2% 96492414 / 104634188 / -7.8% 0.68 / 0.65 / +4.9%
tpcds_q62/duckdb:vortex-compact 23182808 / 23705630 / -2.2% 36302548 / 37976817 / -4.4% 0.64 / 0.62 / +2.3%
tpcds_q63/duckdb:vortex-compact 40119652 / 38932991 / +3.0% 70309315 / 65295689 / +7.7% 0.57 / 0.60 / -4.3%
tpcds_q64/duckdb:vortex-compact 162669746 / 163693281 / -0.6% 200348579 / 210226787 / -4.7% 0.81 / 0.78 / +4.3%
tpcds_q65/duckdb:vortex-compact 37118222 / 34859432 / +6.5% 56809010 / 58529637 / -2.9% 0.65 / 0.60 / +9.7%
tpcds_q66/duckdb:vortex-compact 47409101 / 44875382 / +5.6% 75955096 / 82007563 / -7.4% 0.62 / 0.55 / +14.1%
tpcds_q67/duckdb:vortex-compact 141955505 / 143754112 / -1.3% 166651747 / 172547784 / -3.4% 0.85 / 0.83 / +2.2%
tpcds_q68/duckdb:vortex-compact 61670908 / 61466220 / +0.3% 88705339 / 82309619 / +7.8% 0.70 / 0.75 / -6.9%
tpcds_q69/duckdb:vortex-compact 89831558 / 90846801 / -1.1% 120745257 / 121475654 / -0.6% 0.74 / 0.75 / -0.5%
tpcds_q70/duckdb:vortex-compact 65043840 / 67035802 / -3.0% 87235871 / 98156609 / -11.1% 🟢 0.75 / 0.68 / +9.2%
tpcds_q71/duckdb:vortex-compact 43520886 / 41608401 / +4.6% 67382970 / 68682744 / -1.9% 0.65 / 0.61 / +6.6%
tpcds_q72/duckdb:vortex-compact 165122808 / 163272750 / +1.1% 232134868 / 216650296 / +7.1% 0.71 / 0.75 / -5.6%
tpcds_q73/duckdb:vortex-compact 44977286 / 46600922 / -3.5% 66847342 / 76162687 / -12.2% 🟢 0.67 / 0.61 / +10.0%
tpcds_q74/duckdb:vortex-compact 58280190 / 61607826 / -5.4% 91187123 / 83485226 / +9.2% 0.64 / 0.74 / -13.4%
tpcds_q75/duckdb:vortex-compact 63000552 / 61907497 / +1.8% 102063553 / 97095157 / +5.1% 0.62 / 0.64 / -3.2%
tpcds_q76/duckdb:vortex-compact 31447812 / 32833285 / -4.2% 65072833 / 67016103 / -2.9% 0.48 / 0.49 / -1.4%
tpcds_q77/duckdb:vortex-compact 43275096 / 43051455 / +0.5% 68767657 / 78955242 / -12.9% 🟢 0.63 / 0.55 / +15.4%
tpcds_q78/duckdb:vortex-compact 85715742 / 82987591 / +3.3% 115231872 / 106755335 / +7.9% 0.74 / 0.78 / -4.3%
tpcds_q79/duckdb:vortex-compact 81512873 / 80882130 / +0.8% 105063778 / 100782680 / +4.2% 0.78 / 0.80 / -3.3%
tpcds_q80/duckdb:vortex-compact 72177910 / 68811318 / +4.9% 102073196 / 100422704 / +1.6% 0.71 / 0.69 / +3.2%
tpcds_q81/duckdb:vortex-compact 40462130 / 39868554 / +1.5% 59584822 / 63729745 / -6.5% 0.68 / 0.63 / +8.5%
tpcds_q82/duckdb:vortex-compact 60856420 / 56463088 / +7.8% 87798293 / 87819737 / -0.0% 0.69 / 0.64 / +7.8%
tpcds_q83/duckdb:vortex-compact 47824320 / 45035252 / +6.2% 55049262 / 58147519 / -5.3% 0.87 / 0.77 / +12.2%
tpcds_q84/duckdb:vortex-compact 26435492 / 26698354 / -1.0% 45755149 / 46482817 / -1.6% 0.58 / 0.57 / +0.6%
tpcds_q85/duckdb:vortex-compact 73210550 / 73414417 / -0.3% 101145339 / 101591142 / -0.4% 0.72 / 0.72 / +0.2%
tpcds_q86/duckdb:vortex-compact 19879405 / 21499154 / -7.5% 37474931 / 39097448 / -4.1% 0.53 / 0.55 / -3.5%
tpcds_q87/duckdb:vortex-compact 57271380 / 55062966 / +4.0% 77757188 / 73002922 / +6.5% 0.74 / 0.75 / -2.3%
tpcds_q88/duckdb:vortex-compact 117710837 / 118672050 / -0.8% 177977092 / 182059772 / -2.2% 0.66 / 0.65 / +1.5%
tpcds_q89/duckdb:vortex-compact 37786175 / 39101540 / -3.4% 70713282 / 64600445 / +9.5% 0.53 / 0.61 / -11.7%
tpcds_q90/duckdb:vortex-compact 21600418 / 20652768 / +4.6% 33967961 / 37454744 / -9.3% 0.64 / 0.55 / +15.3%
tpcds_q91/duckdb:vortex-compact 67889261 / 65779762 / +3.2% 87727206 / 88820450 / -1.2% 0.77 / 0.74 / +4.5%
tpcds_q92/duckdb:vortex-compact 41057762 / 38517290 / +6.6% 52780527 / 58942567 / -10.5% 🟢 0.78 / 0.65 / +19.0%
tpcds_q93/duckdb:vortex-compact 36661400 / 35480658 / +3.3% 59821504 / 61475609 / -2.7% 0.61 / 0.58 / +6.2%
tpcds_q94/duckdb:vortex-compact 38659264 / 38999683 / -0.9% 60047778 / 56878337 / +5.6% 0.64 / 0.69 / -6.1%
tpcds_q95/duckdb:vortex-compact 147431582 / 152900700 / -3.6% 175511885 / 174868061 / +0.4% 0.84 / 0.87 / -3.9%
tpcds_q96/duckdb:vortex-compact 38944134 / 37707184 / +3.3% 57516089 / 54396373 / +5.7% 0.68 / 0.69 / -2.3%
tpcds_q97/duckdb:vortex-compact 48160908 / 49207276 / -2.1% 63835554 / 72630946 / -12.1% 🟢 0.75 / 0.68 / +11.4%
tpcds_q98/duckdb:vortex-compact 31347419 / 32663154 / -4.0% 60146287 / 60885002 / -1.2% 0.52 / 0.54 / -2.8%
tpcds_q99/duckdb:vortex-compact 28050474 / 28223417 / -0.6% 46794760 / 45591431 / +2.6% 0.60 / 0.62 / -3.2%
duckdb / parquet / ns (1.001x ➖, 3↑ 7↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 31712048 / 31915234 / -0.6% 46584255 / 47883873 / -2.7% 0.68 / 0.67 / +2.1%
tpcds_q02/duckdb:parquet 27535936 / 22382584 / +23.0% 🔴 36543334 / 33046287 / +10.6% 🔴 0.75 / 0.68 / +11.3%
tpcds_q03/duckdb:parquet 14253171 / 14548204 / -2.0% 24227007 / 24056469 / +0.7% 0.59 / 0.60 / -2.7%
tpcds_q04/duckdb:parquet 192534747 / 196933118 / -2.2% 204091955 / 208453927 / -2.1% 0.94 / 0.94 / -0.1%
tpcds_q05/duckdb:parquet 33017518 / 33609520 / -1.8% 44441633 / 40139911 / +10.7% 🔴 0.74 / 0.84 / -11.3%
tpcds_q06/duckdb:parquet 36798094 / 35176058 / +4.6% 56320028 / 55871440 / +0.8% 0.65 / 0.63 / +3.8%
tpcds_q07/duckdb:parquet 21688492 / 22387209 / -3.1% 33827675 / 35033263 / -3.4% 0.64 / 0.64 / +0.3%
tpcds_q08/duckdb:parquet 33317368 / 32728518 / +1.8% 49728782 / 47357345 / +5.0% 0.67 / 0.69 / -3.1%
tpcds_q09/duckdb:parquet 31052728 / 30926638 / +0.4% 38153537 / 38849892 / -1.8% 0.81 / 0.80 / +2.2%
tpcds_q10/duckdb:parquet 42396002 / 41076403 / +3.2% 60159928 / 59797985 / +0.6% 0.70 / 0.69 / +2.6%
tpcds_q11/duckdb:parquet 103129820 / 101267736 / +1.8% 115444794 / 120118678 / -3.9% 0.89 / 0.84 / +6.0%
tpcds_q12/duckdb:parquet 17697854 / 17644064 / +0.3% 27858437 / 27294302 / +2.1% 0.64 / 0.65 / -1.7%
tpcds_q13/duckdb:parquet 35090642 / 34203920 / +2.6% 49964857 / 51105082 / -2.2% 0.70 / 0.67 / +4.9%
tpcds_q14/duckdb:parquet 104754158 / 101220604 / +3.5% 120104583 / 123759761 / -3.0% 0.87 / 0.82 / +6.6%
tpcds_q15/duckdb:parquet 35906154 / 35418393 / +1.4% 48938449 / 48374861 / +1.2% 0.73 / 0.73 / +0.2%
tpcds_q16/duckdb:parquet 27261015 / 27453153 / -0.7% 42835175 / 42131813 / +1.7% 0.64 / 0.65 / -2.3%
tpcds_q17/duckdb:parquet 45415788 / 44677236 / +1.7% 59247229 / 57969729 / +2.2% 0.77 / 0.77 / -0.5%
tpcds_q18/duckdb:parquet 56364606 / 57321668 / -1.7% 80073265 / 75263894 / +6.4% 0.70 / 0.76 / -7.6%
tpcds_q19/duckdb:parquet 33290714 / 35079130 / -5.1% 45735536 / 47697614 / -4.1% 0.73 / 0.74 / -1.0%
tpcds_q20/duckdb:parquet 20835912 / 18819004 / +10.7% 🔴 32292564 / 31243162 / +3.4% 0.65 / 0.60 / +7.1%
tpcds_q21/duckdb:parquet 14619202 / 13644732 / +7.1% 24897371 / 25256741 / -1.4% 0.59 / 0.54 / +8.7%
tpcds_q22/duckdb:parquet 48665995 / 57267000 / -15.0% 🟢 81406198 / 55602444 / +46.4% 🔴 0.60 / 1.03 / -42.0%
tpcds_q23/duckdb:parquet 67660677 / 69456216 / -2.6% 81688857 / 87938301 / -7.1% 0.83 / 0.79 / +4.9%
tpcds_q24/duckdb:parquet 50764045 / 48882947 / +3.8% 71033141 / 69397438 / +2.4% 0.71 / 0.70 / +1.5%
tpcds_q25/duckdb:parquet 41413538 / 42417995 / -2.4% 62453519 / 60892812 / +2.6% 0.66 / 0.70 / -4.8%
tpcds_q26/duckdb:parquet 44457950 / 44722048 / -0.6% 57016593 / 58346724 / -2.3% 0.78 / 0.77 / +1.7%
tpcds_q27/duckdb:parquet 54457580 / 58733244 / -7.3% 72050958 / 73724627 / -2.3% 0.76 / 0.80 / -5.1%
tpcds_q28/duckdb:parquet 29873329 / 30164342 / -1.0% 43678378 / 37618051 / +16.1% 🔴 0.68 / 0.80 / -14.7%
tpcds_q29/duckdb:parquet 42953386 / 43374288 / -1.0% 55895693 / 56691805 / -1.4% 0.77 / 0.77 / +0.4%
tpcds_q30/duckdb:parquet 44630471 / 43609410 / +2.3% 59788657 / 60463346 / -1.1% 0.75 / 0.72 / +3.5%
tpcds_q31/duckdb:parquet 28801447 / 28798190 / +0.0% 41635688 / 39717028 / +4.8% 0.69 / 0.73 / -4.6%
tpcds_q32/duckdb:parquet 15115857 / 14991404 / +0.8% 27191204 / 26927568 / +1.0% 0.56 / 0.56 / -0.1%
tpcds_q33/duckdb:parquet 23141246 / 24940143 / -7.2% 41156157 / 39294935 / +4.7% 0.56 / 0.63 / -11.4%
tpcds_q34/duckdb:parquet 22091130 / 22021603 / +0.3% 34108785 / 34520569 / -1.2% 0.65 / 0.64 / +1.5%
tpcds_q35/duckdb:parquet 66309402 / 67543276 / -1.8% 86563439 / 88893281 / -2.6% 0.77 / 0.76 / +0.8%
tpcds_q36/duckdb:parquet 22365759 / 22352328 / +0.1% 37399393 / 39836256 / -6.1% 0.60 / 0.56 / +6.6%
tpcds_q37/duckdb:parquet 17092760 / 18832124 / -9.2% 30088518 / 30232710 / -0.5% 0.57 / 0.62 / -8.8%
tpcds_q38/duckdb:parquet 41025010 / 40489850 / +1.3% 51349392 / 52436422 / -2.1% 0.80 / 0.77 / +3.5%
tpcds_q39/duckdb:parquet 38387686 / 38829410 / -1.1% 48807050 / 50414118 / -3.2% 0.79 / 0.77 / +2.1%
tpcds_q40/duckdb:parquet 22699116 / 22801452 / -0.4% 35722243 / 31579349 / +13.1% 🔴 0.64 / 0.72 / -12.0%
tpcds_q41/duckdb:parquet 11000826 / 10877868 / +1.1% 22204408 / 20590521 / +7.8% 0.50 / 0.53 / -6.2%
tpcds_q42/duckdb:parquet 13211278 / 12448389 / +6.1% 24278831 / 22971874 / +5.7% 0.54 / 0.54 / +0.4%
tpcds_q43/duckdb:parquet 14935352 / 15002066 / -0.4% 25734235 / 26211245 / -1.8% 0.58 / 0.57 / +1.4%
tpcds_q44/duckdb:parquet 25496300 / 25285323 / +0.8% 37708691 / 39370739 / -4.2% 0.68 / 0.64 / +5.3%
tpcds_q45/duckdb:parquet 33381206 / 32801237 / +1.8% 44478056 / 45520658 / -2.3% 0.75 / 0.72 / +4.2%
tpcds_q46/duckdb:parquet 49223450 / 51250868 / -4.0% 67532252 / 64597558 / +4.5% 0.73 / 0.79 / -8.1%
tpcds_q47/duckdb:parquet 47436650 / 51181284 / -7.3% 62056537 / 60678539 / +2.3% 0.76 / 0.84 / -9.4%
tpcds_q48/duckdb:parquet 35392075 / 30637709 / +15.5% 🔴 50220461 / 44305375 / +13.4% 🔴 0.70 / 0.69 / +1.9%
tpcds_q49/duckdb:parquet 29815744 / 28043857 / +6.3% 44461687 / 44693614 / -0.5% 0.67 / 0.63 / +6.9%
tpcds_q50/duckdb:parquet 24948920 / 24701970 / +1.0% 38389836 / 38206259 / +0.5% 0.65 / 0.65 / +0.5%
tpcds_q51/duckdb:parquet 95068510 / 92870274 / +2.4% 143719385 / 111622039 / +28.8% 🔴 0.66 / 0.83 / -20.5%
tpcds_q52/duckdb:parquet 12218319 / 12284872 / -0.5% 23039005 / 23988767 / -4.0% 0.53 / 0.51 / +3.6%
tpcds_q53/duckdb:parquet 16795133 / 18559564 / -9.5% 29964862 / 31183498 / -3.9% 0.56 / 0.60 / -5.8%
tpcds_q54/duckdb:parquet 29679646 / 30503571 / -2.7% 46725526 / 48691629 / -4.0% 0.64 / 0.63 / +1.4%
tpcds_q55/duckdb:parquet 13528385 / 11945679 / +13.2% 🔴 23585067 / 23178279 / +1.8% 0.57 / 0.52 / +11.3%
tpcds_q56/duckdb:parquet 25907304 / 25595896 / +1.2% 40782340 / 38946341 / +4.7% 0.64 / 0.66 / -3.3%
tpcds_q57/duckdb:parquet 43287648 / 43135357 / +0.4% 58175825 / 55388343 / +5.0% 0.74 / 0.78 / -4.5%
tpcds_q58/duckdb:parquet 27258407 / 28328241 / -3.8% 45091295 / 38715898 / +16.5% 🔴 0.60 / 0.73 / -17.4%
tpcds_q59/duckdb:parquet 36295782 / 29836038 / +21.7% 🔴 52829938 / 41735731 / +26.6% 🔴 0.69 / 0.71 / -3.9%
tpcds_q60/duckdb:parquet 25665367 / 26617123 / -3.6% 39586377 / 41087168 / -3.7% 0.65 / 0.65 / +0.1%
tpcds_q61/duckdb:parquet 31186764 / 31364068 / -0.6% 43029436 / 43273246 / -0.6% 0.72 / 0.72 / -0.0%
tpcds_q62/duckdb:parquet 15021668 / 14484432 / +3.7% 25421445 / 22400502 / +13.5% 🔴 0.59 / 0.65 / -8.6%
tpcds_q63/duckdb:parquet 17213462 / 15899915 / +8.3% 29508159 / 30108309 / -2.0% 0.58 / 0.53 / +10.5%
tpcds_q64/duckdb:parquet 79463540 / 80468507 / -1.2% 100786521 / 106287592 / -5.2% 0.79 / 0.76 / +4.1%
tpcds_q65/duckdb:parquet 23785806 / 21470544 / +10.8% 🔴 36927319 / 38335509 / -3.7% 0.64 / 0.56 / +15.0%
tpcds_q66/duckdb:parquet 35573326 / 35101604 / +1.3% 47000215 / 48416345 / -2.9% 0.76 / 0.72 / +4.4%
tpcds_q67/duckdb:parquet 126657460 / 126193710 / +0.4% 152494040 / 143437817 / +6.3% 0.83 / 0.88 / -5.6%
tpcds_q68/duckdb:parquet 38751268 / 39380054 / -1.6% 57028352 / 60511945 / -5.8% 0.68 / 0.65 / +4.4%
tpcds_q69/duckdb:parquet 41061545 / 42695502 / -3.8% 60728305 / 59925863 / +1.3% 0.68 / 0.71 / -5.1%
tpcds_q70/duckdb:parquet 27957256 / 30757952 / -9.1% 47165307 / 43195743 / +9.2% 0.59 / 0.71 / -16.8%
tpcds_q71/duckdb:parquet 22298184 / 21514312 / +3.6% 34995801 / 34438361 / +1.6% 0.64 / 0.62 / +2.0%
tpcds_q72/duckdb:parquet 151311821 / 161814470 / -6.5% 139700443 / 186989278 / -25.3% 🟢 1.08 / 0.87 / +25.2%
tpcds_q73/duckdb:parquet 18414472 / 19018388 / -3.2% 30148788 / 30287534 / -0.5% 0.61 / 0.63 / -2.7%
tpcds_q74/duckdb:parquet 144424540 / 144803460 / -0.3% 162296636 / 162477943 / -0.1% 0.89 / 0.89 / -0.2%
tpcds_q75/duckdb:parquet 61821152 / 60316216 / +2.5% 78601152 / 81895615 / -4.0% 0.79 / 0.74 / +6.8%
tpcds_q76/duckdb:parquet 19961348 / 20697266 / -3.6% 31051387 / 31820666 / -2.4% 0.64 / 0.65 / -1.2%
tpcds_q77/duckdb:parquet 26328752 / 25540122 / +3.1% 39278278 / 39754221 / -1.2% 0.67 / 0.64 / +4.3%
tpcds_q78/duckdb:parquet 77886698 / 78136140 / -0.3% 91002198 / 91385603 / -0.4% 0.86 / 0.86 / +0.1%
tpcds_q79/duckdb:parquet 27857647 / 27692226 / +0.6% 43591683 / 43885731 / -0.7% 0.64 / 0.63 / +1.3%
tpcds_q80/duckdb:parquet 48137734 / 49310980 / -2.4% 63571452 / 61913378 / +2.7% 0.76 / 0.80 / -4.9%
tpcds_q81/duckdb:parquet 41233632 / 39912086 / +3.3% 56278202 / 59328912 / -5.1% 0.73 / 0.67 / +8.9%
tpcds_q82/duckdb:parquet 18985842 / 18990740 / -0.0% 33688294 / 32801289 / +2.7% 0.56 / 0.58 / -2.7%
tpcds_q83/duckdb:parquet 22674932 / 22734525 / -0.3% 33718055 / 32217955 / +4.7% 0.67 / 0.71 / -4.7%
tpcds_q84/duckdb:parquet 24172460 / 23688664 / +2.0% 35628854 / 34536816 / +3.2% 0.68 / 0.69 / -1.1%
tpcds_q85/duckdb:parquet 47329246 / 48207890 / -1.8% 66064147 / 66376184 / -0.5% 0.72 / 0.73 / -1.4%
tpcds_q86/duckdb:parquet 15379476 / 14962618 / +2.8% 25190651 / 28197322 / -10.7% 🟢 0.61 / 0.53 / +15.1%
tpcds_q87/duckdb:parquet 43308182 / 43332492 / -0.1% 53637971 / 54582404 / -1.7% 0.81 / 0.79 / +1.7%
tpcds_q88/duckdb:parquet 42750258 / 42714402 / +0.1% 53279503 / 51519109 / +3.4% 0.80 / 0.83 / -3.2%
tpcds_q89/duckdb:parquet 18228742 / 20672215 / -11.8% 🟢 35693629 / 32542827 / +9.7% 0.51 / 0.64 / -19.6%
tpcds_q90/duckdb:parquet 9806636 / 10396944 / -5.7% 20872823 / 22813925 / -8.5% 0.47 / 0.46 / +3.1%
tpcds_q91/duckdb:parquet 27548604 / 27540082 / +0.0% 41697813 / 41473031 / +0.5% 0.66 / 0.66 / -0.5%
tpcds_q92/duckdb:parquet 15173746 / 15678302 / -3.2% 28033266 / 27567923 / +1.7% 0.54 / 0.57 / -4.8%
tpcds_q93/duckdb:parquet 35055166 / 31206060 / +12.3% 🔴 50878240 / 49731626 / +2.3% 0.69 / 0.63 / +9.8%
tpcds_q94/duckdb:parquet 21418424 / 21940395 / -2.4% 35855569 / 35158211 / +2.0% 0.60 / 0.62 / -4.3%
tpcds_q95/duckdb:parquet 138002440 / 136969336 / +0.8% 147840171 / 151828140 / -2.6% 0.93 / 0.90 / +3.5%
tpcds_q96/duckdb:parquet 9566931 / 11255546 / -15.0% 🟢 16522141 / 18289819 / -9.7% 0.58 / 0.62 / -5.9%
tpcds_q97/duckdb:parquet 38912174 / 39612004 / -1.8% 52468624 / 51400308 / +2.1% 0.74 / 0.77 / -3.8%
tpcds_q98/duckdb:parquet 21687460 / 21468974 / +1.0% 34923961 / 35328688 / -1.1% 0.62 / 0.61 / +2.2%
tpcds_q99/duckdb:parquet 23717358 / 23874391 / -0.7% 32080978 / 32579508 / -1.5% 0.74 / 0.73 / +0.9%

File Size Changes (48 files changed, +0.0% overall, 48↑ 0↓)
File Scale Format Base HEAD Change %
income_band.vortex 1.0 vortex-compact 5.31 KB 5.35 KB +40 B +0.7%
income_band.vortex 1.0 vortex-file-compressed 5.52 KB 5.56 KB +40 B +0.7%
reason.vortex 1.0 vortex-compact 5.96 KB 6.00 KB +40 B +0.7%
reason.vortex 1.0 vortex-file-compressed 7.66 KB 7.70 KB +40 B +0.5%
household_demographics.vortex 1.0 vortex-compact 9.90 KB 9.93 KB +32 B +0.3%
ship_mode.vortex 1.0 vortex-compact 10.74 KB 10.77 KB +32 B +0.3%
ship_mode.vortex 1.0 vortex-file-compressed 13.32 KB 13.35 KB +32 B +0.2%
household_demographics.vortex 1.0 vortex-file-compressed 16.16 KB 16.19 KB +32 B +0.2%
warehouse.vortex 1.0 vortex-compact 21.88 KB 21.92 KB +40 B +0.2%
warehouse.vortex 1.0 vortex-file-compressed 23.83 KB 23.87 KB +40 B +0.2%
web_page.vortex 1.0 vortex-compact 24.09 KB 24.12 KB +32 B +0.1%
web_page.vortex 1.0 vortex-file-compressed 29.62 KB 29.65 KB +32 B +0.1%
web_site.vortex 1.0 vortex-compact 41.37 KB 41.40 KB +32 B +0.1%
store.vortex 1.0 vortex-compact 42.16 KB 42.20 KB +32 B +0.1%
call_center.vortex 1.0 vortex-compact 46.28 KB 46.31 KB +32 B +0.1%
store.vortex 1.0 vortex-file-compressed 48.17 KB 48.20 KB +32 B +0.1%
promotion.vortex 1.0 vortex-compact 49.62 KB 49.65 KB +32 B +0.1%
call_center.vortex 1.0 vortex-file-compressed 52.57 KB 52.61 KB +32 B +0.1%
web_site.vortex 1.0 vortex-file-compressed 53.90 KB 53.93 KB +32 B +0.1%
promotion.vortex 1.0 vortex-file-compressed 59.25 KB 59.28 KB +32 B +0.1%
time_dim.vortex 1.0 vortex-compact 95.41 KB 95.44 KB +32 B +0.0%
date_dim.vortex 1.0 vortex-compact 136.00 KB 136.04 KB +32 B +0.0%
catalog_page.vortex 1.0 vortex-compact 361.51 KB 361.54 KB +32 B +0.0%
time_dim.vortex 1.0 vortex-file-compressed 404.69 KB 404.72 KB +32 B +0.0%
customer_demographics.vortex 1.0 vortex-compact 422.35 KB 422.38 KB +32 B +0.0%
catalog_page.vortex 1.0 vortex-file-compressed 545.87 KB 545.90 KB +32 B +0.0%
date_dim.vortex 1.0 vortex-file-compressed 576.00 KB 576.03 KB +32 B +0.0%
customer_address.vortex 1.0 vortex-compact 638.37 KB 638.40 KB +32 B +0.0%
customer_address.vortex 1.0 vortex-file-compressed 898.45 KB 898.48 KB +32 B +0.0%
item.vortex 1.0 vortex-compact 998.12 KB 998.16 KB +32 B +0.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.18 MB 1.18 MB +32 B +0.0%
item.vortex 1.0 vortex-file-compressed 1.62 MB 1.62 MB +32 B +0.0%
web_returns.vortex 1.0 vortex-compact 2.99 MB 2.99 MB +32 B +0.0%
customer.vortex 1.0 vortex-compact 3.29 MB 3.29 MB +32 B +0.0%
web_returns.vortex 1.0 vortex-file-compressed 3.44 MB 3.44 MB +32 B +0.0%
customer.vortex 1.0 vortex-file-compressed 4.18 MB 4.18 MB +32 B +0.0%
catalog_returns.vortex 1.0 vortex-compact 6.04 MB 6.04 MB +32 B +0.0%
catalog_returns.vortex 1.0 vortex-file-compressed 7.14 MB 7.14 MB +32 B +0.0%
store_returns.vortex 1.0 vortex-compact 9.36 MB 9.36 MB +32 B +0.0%
store_returns.vortex 1.0 vortex-file-compressed 10.93 MB 10.93 MB +32 B +0.0%
inventory.vortex 1.0 vortex-compact 16.06 MB 16.06 MB +40 B +0.0%
inventory.vortex 1.0 vortex-file-compressed 36.61 MB 36.61 MB +40 B +0.0%
web_sales.vortex 1.0 vortex-compact 29.43 MB 29.43 MB +32 B +0.0%
web_sales.vortex 1.0 vortex-file-compressed 33.42 MB 33.42 MB +32 B +0.0%
catalog_sales.vortex 1.0 vortex-compact 59.44 MB 59.44 MB +32 B +0.0%
store_sales.vortex 1.0 vortex-compact 78.09 MB 78.09 MB +40 B +0.0%
catalog_sales.vortex 1.0 vortex-file-compressed 68.32 MB 68.32 MB +32 B +0.0%
store_sales.vortex 1.0 vortex-file-compressed 96.22 MB 96.22 MB +32 B +0.0%

Totals:

  • vortex-compact: 207.80 MB → 207.80 MB (+0.0%)
  • vortex-file-compressed: 265.99 MB → 265.99 MB (+0.0%)

@joseph-isaacs joseph-isaacs added the action/bench-string Run only the string encoding benchmark on this PR label Aug 25, 2026
joseph-isaacs and others added 3 commits August 25, 2026 14:25
Gating the scheme on `unstable_encodings` did not close the hole it was
meant to. That feature is per-crate: `vortex-file/unstable_encodings`
turns on `vortex-btrblocks/unstable_encodings` without turning on
`vortex/unstable_encodings`, and only the latter enables the preview
edition. The scheme was therefore reachable in builds where
`fastlanes.blockedfor` was not writable.

Whether that surfaced depended on the write path. `VortexWriteOptions`
derives an encoding policy from the session's editions, so there the
scheme was filtered out. Paths that build a `WriteStrategyBuilder`
directly -- vortex-ffi, vortex-python, vortex-tui, the CUDA writers --
leave that policy unset, nothing filters the scheme, and the write fails
with "Array encoding fastlanes.blockedfor not permitted by ctx".

A feature flag cannot express "this session's editions permit this
encoding", so stop trying: BlockedFoRScheme leaves ALL_SCHEMES and is
opted into explicitly by callers that have also enabled the preview
edition. No default write path can now select an encoding its session
cannot serialize, pinned by default_schemes_exclude_blocked_for.

This restores ALL_SCHEMES to develop's contents exactly, so the only
remaining golden change is compact__list_of_int_runs, which is stale on
develop: develop's own code produces the pco offsets recorded here, as a
worktree run at 5049e41 confirms.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Workspace-wide clippy unifies features, so vortex-btrblocks builds with
pco enabled but not unstable_encodings. In that combination both users
of the ArrayRef import were compiled out and the import was left unused,
failing the clippy-default lint.

Inlining the helper into the test that uses it leaves ArrayRef with a
single user, gated the same way, so no feature combination strands it.
Verified with clippy over default, pco, zstd, all-features, and
no-default-features.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. and removed action/bench-string Run only the string encoding benchmark on this PR labels Aug 25, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 25, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR ee07a98a vs base 479bd98a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+1.6%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 1.014x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.024x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.008x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 7253272 / 8687457 / -16.5% 🟢 36887081 / 31970111 / +15.4% 🔴 0.20 / 0.27 / -27.6%
fineweb_q01/datafusion:vortex-file-compressed 32633386 / 30621842 / +6.6% 97631661 / 90871693 / +7.4% 0.33 / 0.34 / -0.8%
fineweb_q02/datafusion:vortex-file-compressed 35442656 / 31876622 / +11.2% 🔴 100436275 / 91061685 / +10.3% 🔴 0.35 / 0.35 / +0.8%
fineweb_q03/datafusion:vortex-file-compressed 44219818 / 44749628 / -1.2% 190007751 / 169816452 / +11.9% 🔴 0.23 / 0.26 / -11.7%
fineweb_q04/datafusion:vortex-file-compressed 209847212 / 208061112 / +0.9% 339659127 / 327383920 / +3.7% 0.62 / 0.64 / -2.8%
fineweb_q05/datafusion:vortex-file-compressed 155241142 / 150722490 / +3.0% 279346039 / 264653975 / +5.6% 0.56 / 0.57 / -2.4%
fineweb_q06/datafusion:vortex-file-compressed 39553576 / 39133161 / +1.1% 191165159 / 176024585 / +8.6% 0.21 / 0.22 / -6.9%
fineweb_q07/datafusion:vortex-file-compressed 37312281 / 38082450 / -2.0% 179444641 / 174246980 / +3.0% 0.21 / 0.22 / -4.9%
fineweb_q08/datafusion:vortex-file-compressed 20320068 / 19093760 / +6.4% 77481423 / 79028672 / -2.0% 0.26 / 0.24 / +8.5%
datafusion / vortex-compact / ns (0.982x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 8459570 / 8828746 / -4.2% 36058008 / 35841019 / +0.6% 0.23 / 0.25 / -4.8%
fineweb_q01/datafusion:vortex-compact 99035908 / 102001844 / -2.9% 164964809 / 159443199 / +3.5% 0.60 / 0.64 / -6.2%
fineweb_q02/datafusion:vortex-compact 103786991 / 102371406 / +1.4% 169006701 / 173391680 / -2.5% 0.61 / 0.59 / +4.0%
fineweb_q03/datafusion:vortex-compact 530612372 / 532147872 / -0.3% 621271090 / 616841622 / +0.7% 0.85 / 0.86 / -1.0%
fineweb_q04/datafusion:vortex-compact 568267720 / 613582703 / -7.4% 657717824 / 667562628 / -1.5% 0.86 / 0.92 / -6.0%
fineweb_q05/datafusion:vortex-compact 506840984 / 507909850 / -0.2% 628029552 / 614843233 / +2.1% 0.81 / 0.83 / -2.3%
fineweb_q06/datafusion:vortex-compact 288048745 / 285719625 / +0.8% 401116604 / 421824886 / -4.9% 0.72 / 0.68 / +6.0%
fineweb_q07/datafusion:vortex-compact 297044928 / 297585192 / -0.2% 426314996 / 418948187 / +1.8% 0.70 / 0.71 / -1.9%
fineweb_q08/datafusion:vortex-compact 17278176 / 17782919 / -2.8% 69620884 / 67092621 / +3.8% 0.25 / 0.27 / -6.4%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 8652884 / 8884806 / -2.6% 50003774 / 48623004 / +2.8% 0.17 / 0.18 / -5.3%
fineweb_q01/datafusion:parquet 197524265 / 197099456 / +0.2% 329914872 / 325232391 / +1.4% 0.60 / 0.61 / -1.2%
fineweb_q02/datafusion:parquet 196007612 / 200458834 / -2.2% 337985474 / 327537090 / +3.2% 0.58 / 0.61 / -5.2%
fineweb_q03/datafusion:parquet 190054535 / 189811785 / +0.1% 286637038 / 280717272 / +2.1% 0.66 / 0.68 / -1.9%
fineweb_q04/datafusion:parquet 210225392 / 206170928 / +2.0% 303888324 / 303240724 / +0.2% 0.69 / 0.68 / +1.7%
fineweb_q05/datafusion:parquet 206471004 / 207963654 / -0.7% 298882654 / 297369379 / +0.5% 0.69 / 0.70 / -1.2%
fineweb_q06/datafusion:parquet 197246920 / 197123455 / +0.1% 333681500 / 325027167 / +2.7% 0.59 / 0.61 / -2.5%
fineweb_q07/datafusion:parquet 191371860 / 190576646 / +0.4% 290387964 / 274508937 / +5.8% 0.66 / 0.69 / -5.1%
fineweb_q08/datafusion:parquet 188134543 / 188586944 / -0.2% 283191639 / 271069622 / +4.5% 0.66 / 0.70 / -4.5%
duckdb / vortex-file-compressed / ns (0.996x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 3418864 / 3888838 / -12.1% 🟢 15109447 / 12928556 / +16.9% 🔴 0.23 / 0.30 / -24.8%
fineweb_q01/duckdb:vortex-file-compressed 40409862 / 41772572 / -3.3% 144084287 / 138828574 / +3.8% 0.28 / 0.30 / -6.8%
fineweb_q02/duckdb:vortex-file-compressed 46467249 / 49974806 / -7.0% 116995115 / 129697107 / -9.8% 0.40 / 0.39 / +3.1%
fineweb_q03/duckdb:vortex-file-compressed 65485982 / 68673105 / -4.6% 196013103 / 239658651 / -18.2% 🟢 0.33 / 0.29 / +16.6%
fineweb_q04/duckdb:vortex-file-compressed 281653128 / 274900424 / +2.5% 402354041 / 396523579 / +1.5% 0.70 / 0.69 / +1.0%
fineweb_q05/duckdb:vortex-file-compressed 219837066 / 217877536 / +0.9% 313892359 / 332746057 / -5.7% 0.70 / 0.65 / +7.0%
fineweb_q06/duckdb:vortex-file-compressed 76425214 / 66212885 / +15.4% 🔴 298614084 / 260387780 / +14.7% 🔴 0.26 / 0.25 / +0.6%
fineweb_q07/duckdb:vortex-file-compressed 61625436 / 62403056 / -1.2% 219166880 / 189769112 / +15.5% 🔴 0.28 / 0.33 / -14.5%
fineweb_q08/duckdb:vortex-file-compressed 28428942 / 26244384 / +8.3% 96098991 / 101594687 / -5.4% 0.30 / 0.26 / +14.5%
duckdb / vortex-compact / ns (1.042x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 4808419 / 3813959 / +26.1% 🔴 15433187 / 16476886 / -6.3% 0.31 / 0.23 / +34.6%
fineweb_q01/duckdb:vortex-compact 102679572 / 104471678 / -1.7% 211188046 / 198572222 / +6.4% 0.49 / 0.53 / -7.6%
fineweb_q02/duckdb:vortex-compact 119528348 / 111707048 / +7.0% 225095306 / 240728968 / -6.5% 0.53 / 0.46 / +14.4%
fineweb_q03/duckdb:vortex-compact 423664987 / 434621390 / -2.5% 587072899 / 556905029 / +5.4% 0.72 / 0.78 / -7.5%
fineweb_q04/duckdb:vortex-compact 454834242 / 431395224 / +5.4% 577740710 / 595162703 / -2.9% 0.79 / 0.72 / +8.6%
fineweb_q05/duckdb:vortex-compact 416799796 / 409235832 / +1.8% 548584613 / 542043374 / +1.2% 0.76 / 0.75 / +0.6%
fineweb_q06/duckdb:vortex-compact 239167836 / 232098100 / +3.0% 412332696 / 432653325 / -4.7% 0.58 / 0.54 / +8.1%
fineweb_q07/duckdb:vortex-compact 235515062 / 244260315 / -3.6% 361945371 / 391634412 / -7.6% 0.65 / 0.62 / +4.3%
fineweb_q08/duckdb:vortex-compact 24558545 / 23308955 / +5.4% 83816836 / 89437652 / -6.3% 0.29 / 0.26 / +12.4%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 34393930 / 35820971 / -4.0% 41347136 / 36257293 / +14.0% 🔴 0.83 / 0.99 / -15.8%
fineweb_q01/duckdb:parquet 75508779 / 76137790 / -0.8% 107638849 / 108744310 / -1.0% 0.70 / 0.70 / +0.2%
fineweb_q02/duckdb:parquet 77995462 / 77102575 / +1.2% 103804331 / 108001666 / -3.9% 0.75 / 0.71 / +5.2%
fineweb_q03/duckdb:parquet 205989976 / 206875982 / -0.4% 436692261 / 414506928 / +5.4% 0.47 / 0.50 / -5.5%
fineweb_q04/duckdb:parquet 236057853 / 233995196 / +0.9% 409319862 / 437598769 / -6.5% 0.58 / 0.53 / +7.9%
fineweb_q05/duckdb:parquet 203930462 / 204216038 / -0.1% 406587395 / 407183776 / -0.1% 0.50 / 0.50 / +0.0%
fineweb_q06/duckdb:parquet 146317641 / 143091959 / +2.3% 280732862 / 277271705 / +1.2% 0.52 / 0.52 / +1.0%
fineweb_q07/duckdb:parquet 145591445 / 146611630 / -0.7% 351184419 / 323693556 / +8.5% 0.41 / 0.45 / -8.5%
fineweb_q08/duckdb:parquet 38009852 / 36371680 / +4.5% 40150380 / 38928917 / +3.1% 0.95 / 0.93 / +1.3%

File Size Changes (2 files changed, +0.0% overall, 2↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB +32 B +0.0%
sample.vortex 1.0 vortex-file-compressed 1.42 GB 1.42 GB +32 B +0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (+0.0%)
  • vortex-file-compressed: 1.42 GB → 1.42 GB (+0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR ee07a98a vs base 479bd98a
Vortex (geomean): hot 0.995x ➖ · cold 0.994x ➖


datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 102196671 / 99100134 / +3.1% 197672451 / 204782167 / -3.5% 0.52 / 0.48 / +6.8%
polarsignals_q01/datafusion:vortex-file-compressed 158172082 / 160288932 / -1.3% 270667364 / 276445886 / -2.1% 0.58 / 0.58 / +0.8%
polarsignals_q02/datafusion:vortex-file-compressed 21806344 / 21880836 / -0.3% 82591855 / 89204547 / -7.4% 0.26 / 0.25 / +7.6%
polarsignals_q03/datafusion:vortex-file-compressed 160108333 / 161295174 / -0.7% 276581756 / 275650332 / +0.3% 0.58 / 0.59 / -1.1%
polarsignals_q04/datafusion:vortex-file-compressed 10941536 / 10375430 / +5.5% 83915651 / 78284665 / +7.2% 0.13 / 0.13 / -1.6%
polarsignals_q05/datafusion:vortex-file-compressed 13297469 / 13734498 / -3.2% 88038733 / 86953829 / +1.2% 0.15 / 0.16 / -4.4%
polarsignals_q06/datafusion:vortex-file-compressed 23469730 / 24137538 / -2.8% 95686446 / 95013300 / +0.7% 0.25 / 0.25 / -3.5%
polarsignals_q07/datafusion:vortex-file-compressed 12402306 / 11903304 / +4.2% 82647132 / 85610491 / -3.5% 0.15 / 0.14 / +7.9%
polarsignals_q08/datafusion:vortex-file-compressed 272348137 / 274427128 / -0.8% 384956323 / 382420010 / +0.7% 0.71 / 0.72 / -1.4%
polarsignals_q09/datafusion:vortex-file-compressed 13279712 / 14434180 / -8.0% 78294867 / 77778292 / +0.7% 0.17 / 0.19 / -8.6%

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 631.61 MB 631.61 MB +32 B +0.0%

Totals:

  • vortex-file-compressed: 631.61 MB → 631.61 MB (+0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR ee07a98a vs base 479bd98a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.3%
Engines: DataFusion No clear signal (+2.2%, environment too noisy confidence) · DuckDB No clear signal (-17.6%, environment too noisy confidence)
Vortex (geomean): hot 0.919x ➖ · cold 0.958x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.952x ➖
Shifts: Parquet (control) +0.2% · Median polish -1.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.823x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 34094144 / 40110308 / -15.0% 143814112 / 168631056 / -14.7% 0.24 / 0.24 / -0.3%
fineweb_q01/datafusion:vortex-file-compressed 391227244 / 779505958 / -49.8% 🟢 729403941 / 818210494 / -10.9% 0.54 / 0.95 / -43.7%
fineweb_q02/datafusion:vortex-file-compressed 413684156 / 496509460 / -16.7% 396802590 / 528660331 / -24.9% 1.04 / 0.94 / +11.0%
fineweb_q03/datafusion:vortex-file-compressed 462144653 / 516321329 / -10.5% 687522264 / 717318203 / -4.2% 0.67 / 0.72 / -6.6%
fineweb_q04/datafusion:vortex-file-compressed 658331714 / 670009548 / -1.7% 442853471 / 592657963 / -25.3% 1.49 / 1.13 / +31.5%
fineweb_q05/datafusion:vortex-file-compressed 600801859 / 602274876 / -0.2% 517965184 / 474538057 / +9.2% 1.16 / 1.27 / -8.6%
fineweb_q06/datafusion:vortex-file-compressed 649579146 / 737269113 / -11.9% 674848554 / 1029196725 / -34.4% 🟢 0.96 / 0.72 / +34.4%
fineweb_q07/datafusion:vortex-file-compressed 438362053 / 490015026 / -10.5% 472382483 / 494312735 / -4.4% 0.93 / 0.99 / -6.4%
fineweb_q08/datafusion:vortex-file-compressed 182872394 / 259078397 / -29.4% 351649244 / 305849599 / +15.0% 0.52 / 0.85 / -38.6%
datafusion / vortex-compact / ns (1.023x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 47175674 / 36647340 / +28.7% 124561920 / 148974702 / -16.4% 0.38 / 0.25 / +54.0%
fineweb_q01/datafusion:vortex-compact 522103130 / 681204274 / -23.4% 999018114 / 1061368569 / -5.9% 0.52 / 0.64 / -18.6%
fineweb_q02/datafusion:vortex-compact 456020598 / 494550638 / -7.8% 451081170 / 500906368 / -9.9% 1.01 / 0.99 / +2.4%
fineweb_q03/datafusion:vortex-compact 771273093 / 782075934 / -1.4% 1070289120 / 1014732946 / +5.5% 0.72 / 0.77 / -6.5%
fineweb_q04/datafusion:vortex-compact 958494673 / 981587250 / -2.4% 927747051 / 784511816 / +18.3% 1.03 / 1.25 / -17.4%
fineweb_q05/datafusion:vortex-compact 880164581 / 844581568 / +4.2% 718626454 / 735800413 / -2.3% 1.22 / 1.15 / +6.7%
fineweb_q06/datafusion:vortex-compact 680539192 / 725260864 / -6.2% 801681610 / 772384488 / +3.8% 0.85 / 0.94 / -9.6%
fineweb_q07/datafusion:vortex-compact 645791199 / 582344654 / +10.9% 555292471 / 580144757 / -4.3% 1.16 / 1.00 / +15.9%
fineweb_q08/datafusion:vortex-compact 303994080 / 234757967 / +29.5% 289252617 / 246529573 / +17.3% 1.05 / 0.95 / +10.4%
datafusion / parquet / ns (0.898x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 501222949 / 579484604 / -13.5% 960054732 / 1105295188 / -13.1% 0.52 / 0.52 / -0.4%
fineweb_q01/datafusion:parquet 986347086 / 987729948 / -0.1% 1272796743 / 1179993842 / +7.9% 0.77 / 0.84 / -7.4%
fineweb_q02/datafusion:parquet 834082209 / 1013144053 / -17.7% 937328584 / 1033275999 / -9.3% 0.89 / 0.98 / -9.2%
fineweb_q03/datafusion:parquet 944043169 / 1086862184 / -13.1% 945799861 / 1123524925 / -15.8% 1.00 / 0.97 / +3.2%
fineweb_q04/datafusion:parquet 881619164 / 984154558 / -10.4% 964815086 / 980843911 / -1.6% 0.91 / 1.00 / -8.9%
fineweb_q05/datafusion:parquet 922327234 / 990210944 / -6.9% 897427106 / 1057272514 / -15.1% 1.03 / 0.94 / +9.7%
fineweb_q06/datafusion:parquet 989268737 / 1053548260 / -6.1% 1247350227 / 1144312427 / +9.0% 0.79 / 0.92 / -13.9%
fineweb_q07/datafusion:parquet 870414982 / 999998915 / -13.0% 1115699741 / 1133079626 / -1.5% 0.78 / 0.88 / -11.6%
fineweb_q08/datafusion:parquet 948841496 / 1048509826 / -9.5% 951502845 / 1007545906 / -5.6% 1.00 / 1.04 / -4.2%
duckdb / vortex-file-compressed / ns (0.910x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 59101986 / 73931478 / -20.1% 87203995 / 76454697 / +14.1% 0.68 / 0.97 / -29.9%
fineweb_q01/duckdb:vortex-file-compressed 545776049 / 699690034 / -22.0% 689419077 / 990221387 / -30.4% 🟢 0.79 / 0.71 / +12.0%
fineweb_q02/duckdb:vortex-file-compressed 707479918 / 732071463 / -3.4% 825198861 / 832414634 / -0.9% 0.86 / 0.88 / -2.5%
fineweb_q03/duckdb:vortex-file-compressed 1441047120 / 1536392740 / -6.2% 1640308196 / 1857234205 / -11.7% 0.88 / 0.83 / +6.2%
fineweb_q04/duckdb:vortex-file-compressed 1605774597 / 1638620644 / -2.0% 1736476229 / 1617624183 / +7.3% 0.92 / 1.01 / -8.7%
fineweb_q05/duckdb:vortex-file-compressed 1494633856 / 1494673640 / -0.0% 1567674611 / 1480266425 / +5.9% 0.95 / 1.01 / -5.6%
fineweb_q06/duckdb:vortex-file-compressed 1669529712 / 2278248290 / -26.7% 1765970210 / 1654410727 / +6.7% 0.95 / 1.38 / -31.3%
fineweb_q07/duckdb:vortex-file-compressed 1484199360 / 1462927828 / +1.5% 1545825170 / 1534573845 / +0.7% 0.96 / 0.95 / +0.7%
fineweb_q08/duckdb:vortex-file-compressed 627252762 / 604219278 / +3.8% 739676203 / 705437163 / +4.9% 0.85 / 0.86 / -1.0%
duckdb / vortex-compact / ns (0.932x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 69433938 / 74074640 / -6.3% 97497906 / 97153337 / +0.4% 0.71 / 0.76 / -6.6%
fineweb_q01/duckdb:vortex-compact 511999634 / 914393036 / -44.0% 🟢 738560537 / 936704295 / -21.2% 0.69 / 0.98 / -29.0%
fineweb_q02/duckdb:vortex-compact 681094374 / 689549394 / -1.2% 734426561 / 763461009 / -3.8% 0.93 / 0.90 / +2.7%
fineweb_q03/duckdb:vortex-compact 1856249648 / 1923901430 / -3.5% 2008448593 / 2153566336 / -6.7% 0.92 / 0.89 / +3.5%
fineweb_q04/duckdb:vortex-compact 1861392097 / 1886711780 / -1.3% 1964967056 / 2057725842 / -4.5% 0.95 / 0.92 / +3.3%
fineweb_q05/duckdb:vortex-compact 1653151919 / 1761132070 / -6.1% 1654938193 / 1761859311 / -6.1% 1.00 / 1.00 / -0.1%
fineweb_q06/duckdb:vortex-compact 1715785299 / 1615556647 / +6.2% 1701461743 / 1624860251 / +4.7% 1.01 / 0.99 / +1.4%
fineweb_q07/duckdb:vortex-compact 1547455840 / 1406979420 / +10.0% 1447583064 / 1414401733 / +2.3% 1.07 / 0.99 / +7.5%
fineweb_q08/duckdb:vortex-compact 556490933 / 570021170 / -2.4% 623317792 / 577833411 / +7.9% 0.89 / 0.99 / -9.5%
duckdb / parquet / ns (1.117x ➖, 1↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 5238751144 / 2879442046 / +81.9% 🔴 572693470 / 548728575 / +4.4% 9.15 / 5.25 / +74.3%
fineweb_q01/duckdb:parquet 5344819284 / 5344384799 / +0.0% 643788596 / 682294596 / -5.6% 8.30 / 7.83 / +6.0%
fineweb_q02/duckdb:parquet 5281808516 / 5303144090 / -0.4% 613325698 / 662068254 / -7.4% 8.61 / 8.01 / +7.5%
fineweb_q03/duckdb:parquet 5346920255 / 5371413978 / -0.5% 1181350815 / 1278281121 / -7.6% 4.53 / 4.20 / +7.7%
fineweb_q04/duckdb:parquet 5245396856 / 3180214894 / +64.9% 🔴 855193341 / 903964795 / -5.4% 6.13 / 3.52 / +74.3%
fineweb_q05/duckdb:parquet 5305206335 / 927362688 / +472.1% 🔴 844324659 / 1109835023 / -23.9% 6.28 / 0.84 / +652.0%
fineweb_q06/duckdb:parquet 5397093168 / 3433007357 / +57.2% 🔴 1520469584 / 1424157894 / +6.8% 3.55 / 2.41 / +47.3%
fineweb_q07/duckdb:parquet 5323158980 / 5337586662 / -0.3% 979516919 / 959865052 / +2.0% 5.43 / 5.56 / -2.3%
fineweb_q08/duckdb:parquet 535256264 / 5260400730 / -89.8% 🟢 557401995 / 544902410 / +2.3% 0.96 / 9.65 / -90.1%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR ee07a98a vs base 65285d66
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 0.996x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.006x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1890592 / 1862454 / +1.5% 40212692 / 37244378 / +8.0% 0.05 / 0.05 / -6.0%
clickbench_q01/datafusion:vortex-file-compressed 12865884 / 12602474 / +2.1% 58391404 / 59586036 / -2.0% 0.22 / 0.21 / +4.2%
clickbench_q02/datafusion:vortex-file-compressed 26273262 / 27369706 / -4.0% 74405290 / 74082330 / +0.4% 0.35 / 0.37 / -4.4%
clickbench_q03/datafusion:vortex-file-compressed 26766606 / 26715093 / +0.2% 97400229 / 95394396 / +2.1% 0.27 / 0.28 / -1.9%
clickbench_q04/datafusion:vortex-file-compressed 161183670 / 162548274 / -0.8% 232036265 / 233504537 / -0.6% 0.69 / 0.70 / -0.2%
clickbench_q05/datafusion:vortex-file-compressed 218696936 / 220605346 / -0.9% 307595330 / 285233704 / +7.8% 0.71 / 0.77 / -8.1%
clickbench_q06/datafusion:vortex-file-compressed 1867495 / 1847627 / +1.1% 41239196 / 39080150 / +5.5% 0.05 / 0.05 / -4.2%
clickbench_q07/datafusion:vortex-file-compressed 19370962 / 18758332 / +3.3% 68105055 / 66732075 / +2.1% 0.28 / 0.28 / +1.2%
clickbench_q08/datafusion:vortex-file-compressed 220399714 / 226749358 / -2.8% 304185795 / 301230683 / +1.0% 0.72 / 0.75 / -3.7%
clickbench_q09/datafusion:vortex-file-compressed 339394413 / 352544396 / -3.7% 430647515 / 434427308 / -0.9% 0.79 / 0.81 / -2.9%
clickbench_q10/datafusion:vortex-file-compressed 68231941 / 68547170 / -0.5% 136365384 / 132495535 / +2.9% 0.50 / 0.52 / -3.3%
clickbench_q11/datafusion:vortex-file-compressed 87238728 / 88340953 / -1.2% 151049543 / 147296219 / +2.5% 0.58 / 0.60 / -3.7%
clickbench_q12/datafusion:vortex-file-compressed 197874200 / 194077346 / +2.0% 289185501 / 281873189 / +2.6% 0.68 / 0.69 / -0.6%
clickbench_q13/datafusion:vortex-file-compressed 354986289 / 345630338 / +2.7% 453071924 / 456905555 / -0.8% 0.78 / 0.76 / +3.6%
clickbench_q14/datafusion:vortex-file-compressed 203419330 / 204070404 / -0.3% 293230281 / 304624087 / -3.7% 0.69 / 0.67 / +3.6%
clickbench_q15/datafusion:vortex-file-compressed 181830386 / 186319348 / -2.4% 265781991 / 262532642 / +1.2% 0.68 / 0.71 / -3.6%
clickbench_q16/datafusion:vortex-file-compressed 473483902 / 466773463 / +1.4% 585368677 / 578433499 / +1.2% 0.81 / 0.81 / +0.2%
clickbench_q17/datafusion:vortex-file-compressed 470447793 / 470083844 / +0.1% 570545043 / 578634445 / -1.4% 0.82 / 0.81 / +1.5%
clickbench_q18/datafusion:vortex-file-compressed 897193552 / 909446009 / -1.3% 1007241205 / 1032294685 / -2.4% 0.89 / 0.88 / +1.1%
clickbench_q19/datafusion:vortex-file-compressed 17780953 / 17585692 / +1.1% 88630170 / 86615353 / +2.3% 0.20 / 0.20 / -1.2%
clickbench_q20/datafusion:vortex-file-compressed 183096020 / 184383628 / -0.7% 387675853 / 384930009 / +0.7% 0.47 / 0.48 / -1.4%
clickbench_q21/datafusion:vortex-file-compressed 260355086 / 256151470 / +1.6% 481232484 / 473503277 / +1.6% 0.54 / 0.54 / +0.0%
clickbench_q22/datafusion:vortex-file-compressed 340225599 / 336401174 / +1.1% 607037673 / 611990060 / -0.8% 0.56 / 0.55 / +2.0%
clickbench_q23/datafusion:vortex-file-compressed 619356799 / 610339410 / +1.5% 924185137 / 873133547 / +5.8% 0.67 / 0.70 / -4.1%
clickbench_q24/datafusion:vortex-file-compressed 43709845 / 43794364 / -0.2% 119060166 / 118810567 / +0.2% 0.37 / 0.37 / -0.4%
clickbench_q25/datafusion:vortex-file-compressed 57025023 / 55413250 / +2.9% 127309321 / 123532469 / +3.1% 0.45 / 0.45 / -0.1%
clickbench_q26/datafusion:vortex-file-compressed 42990274 / 42809894 / +0.4% 118953090 / 118462960 / +0.4% 0.36 / 0.36 / +0.0%
clickbench_q27/datafusion:vortex-file-compressed 269795657 / 270030160 / -0.1% 448329459 / 451134172 / -0.6% 0.60 / 0.60 / +0.5%
clickbench_q28/datafusion:vortex-file-compressed 1425317322 / 1431263479 / -0.4% 1554118482 / 1547436089 / +0.4% 0.92 / 0.92 / -0.8%
clickbench_q29/datafusion:vortex-file-compressed 39558670 / 39609956 / -0.1% 92031923 / 93476545 / -1.5% 0.43 / 0.42 / +1.4%
clickbench_q30/datafusion:vortex-file-compressed 174235284 / 171441052 / +1.6% 249698656 / 258430117 / -3.4% 0.70 / 0.66 / +5.2%
clickbench_q31/datafusion:vortex-file-compressed 198687278 / 195854672 / +1.4% 325961338 / 330081982 / -1.2% 0.61 / 0.59 / +2.7%
clickbench_q32/datafusion:vortex-file-compressed 830303638 / 823978062 / +0.8% 954525580 / 953654021 / +0.1% 0.87 / 0.86 / +0.7%
clickbench_q33/datafusion:vortex-file-compressed 1031458204 / 1001443274 / +3.0% 1190934439 / 1184744894 / +0.5% 0.87 / 0.85 / +2.5%
clickbench_q34/datafusion:vortex-file-compressed 1009885096 / 1006083990 / +0.4% 1173912011 / 1192681570 / -1.6% 0.86 / 0.84 / +2.0%
clickbench_q35/datafusion:vortex-file-compressed 151841694 / 152545066 / -0.5% 222811902 / 221399789 / +0.6% 0.68 / 0.69 / -1.1%
clickbench_q36/datafusion:vortex-file-compressed 57144010 / 57464014 / -0.6% 117055368 / 118117529 / -0.9% 0.49 / 0.49 / +0.3%
clickbench_q37/datafusion:vortex-file-compressed 29279360 / 29212016 / +0.2% 80983556 / 78070513 / +3.7% 0.36 / 0.37 / -3.4%
clickbench_q38/datafusion:vortex-file-compressed 15751502 / 15231694 / +3.4% 70545571 / 69761703 / +1.1% 0.22 / 0.22 / +2.3%
clickbench_q39/datafusion:vortex-file-compressed 113537720 / 112886916 / +0.6% 181334238 / 181211723 / +0.1% 0.63 / 0.62 / +0.5%
clickbench_q40/datafusion:vortex-file-compressed 13045093 / 13362404 / -2.4% 65540441 / 62412059 / +5.0% 0.20 / 0.21 / -7.0%
clickbench_q41/datafusion:vortex-file-compressed 12752745 / 12287119 / +3.8% 61991087 / 62786986 / -1.3% 0.21 / 0.20 / +5.1%
clickbench_q42/datafusion:vortex-file-compressed 13951852 / 13817339 / +1.0% 64275657 / 59695199 / +7.7% 0.22 / 0.23 / -6.2%
datafusion / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1984162 / 1839015 / +7.9% 35930429 / 36790136 / -2.3% 0.06 / 0.05 / +10.5%
clickbench_q01/datafusion:vortex-compact 14591283 / 15267755 / -4.4% 60706360 / 58325387 / +4.1% 0.24 / 0.26 / -8.2%
clickbench_q02/datafusion:vortex-compact 57115981 / 56783820 / +0.6% 102111520 / 101432736 / +0.7% 0.56 / 0.56 / -0.1%
clickbench_q03/datafusion:vortex-compact 34797140 / 34361108 / +1.3% 85846317 / 83293022 / +3.1% 0.41 / 0.41 / -1.7%
clickbench_q04/datafusion:vortex-compact 161144474 / 158534798 / +1.6% 227154596 / 237050324 / -4.2% 0.71 / 0.67 / +6.1%
clickbench_q05/datafusion:vortex-compact 237175227 / 236642860 / +0.2% 310377929 / 301853625 / +2.8% 0.76 / 0.78 / -2.5%
clickbench_q06/datafusion:vortex-compact 1872296 / 1862756 / +0.5% 39450708 / 39619767 / -0.4% 0.05 / 0.05 / +0.9%
clickbench_q07/datafusion:vortex-compact 25082710 / 25023832 / +0.2% 69852318 / 68418482 / +2.1% 0.36 / 0.37 / -1.8%
clickbench_q08/datafusion:vortex-compact 246586726 / 248139181 / -0.6% 316866542 / 304051157 / +4.2% 0.78 / 0.82 / -4.6%
clickbench_q09/datafusion:vortex-compact 396637971 / 391966350 / +1.2% 464248921 / 452046791 / +2.7% 0.85 / 0.87 / -1.5%
clickbench_q10/datafusion:vortex-compact 116909282 / 117155428 / -0.2% 166962277 / 170068156 / -1.8% 0.70 / 0.69 / +1.6%
clickbench_q11/datafusion:vortex-compact 157914272 / 157277703 / +0.4% 208307049 / 205912953 / +1.2% 0.76 / 0.76 / -0.7%
clickbench_q12/datafusion:vortex-compact 219602802 / 219853102 / -0.1% 303722602 / 308331416 / -1.5% 0.72 / 0.71 / +1.4%
clickbench_q13/datafusion:vortex-compact 386159146 / 394130370 / -2.0% 486790884 / 471613813 / +3.2% 0.79 / 0.84 / -5.1%
clickbench_q14/datafusion:vortex-compact 245920798 / 236925202 / +3.8% 311405044 / 311952869 / -0.2% 0.79 / 0.76 / +4.0%
clickbench_q15/datafusion:vortex-compact 186655544 / 183523656 / +1.7% 254087184 / 266303483 / -4.6% 0.73 / 0.69 / +6.6%
clickbench_q16/datafusion:vortex-compact 507032253 / 515395428 / -1.6% 584186891 / 595016777 / -1.8% 0.87 / 0.87 / +0.2%
clickbench_q17/datafusion:vortex-compact 508354253 / 499697326 / +1.7% 584974759 / 587075745 / -0.4% 0.87 / 0.85 / +2.1%
clickbench_q18/datafusion:vortex-compact 921728260 / 909435611 / +1.4% 991402149 / 990093878 / +0.1% 0.93 / 0.92 / +1.2%
clickbench_q19/datafusion:vortex-compact 24198387 / 24268822 / -0.3% 73619145 / 74753832 / -1.5% 0.33 / 0.32 / +1.2%
clickbench_q20/datafusion:vortex-compact 228869192 / 228588066 / +0.1% 361307032 / 362518865 / -0.3% 0.63 / 0.63 / +0.5%
clickbench_q21/datafusion:vortex-compact 341449608 / 341315110 / +0.0% 499565215 / 497084876 / +0.5% 0.68 / 0.69 / -0.5%
clickbench_q22/datafusion:vortex-compact 572186430 / 574573568 / -0.4% 712625887 / 711332371 / +0.2% 0.80 / 0.81 / -0.6%
clickbench_q23/datafusion:vortex-compact 1690861373 / 1733828998 / -2.5% 1806524184 / 1955414590 / -7.6% 0.94 / 0.89 / +5.6%
clickbench_q24/datafusion:vortex-compact 73545578 / 74530466 / -1.3% 130925736 / 134619526 / -2.7% 0.56 / 0.55 / +1.5%
clickbench_q25/datafusion:vortex-compact 106363437 / 107046640 / -0.6% 169990615 / 161706109 / +5.1% 0.63 / 0.66 / -5.5%
clickbench_q26/datafusion:vortex-compact 72881495 / 74218086 / -1.8% 134842940 / 134125535 / +0.5% 0.54 / 0.55 / -2.3%
clickbench_q27/datafusion:vortex-compact 316633628 / 319041247 / -0.8% 473404610 / 471636458 / +0.4% 0.67 / 0.68 / -1.1%
clickbench_q28/datafusion:vortex-compact 1548279770 / 1551080120 / -0.2% 1640162713 / 1629767033 / +0.6% 0.94 / 0.95 / -0.8%
clickbench_q29/datafusion:vortex-compact 65497218 / 65306805 / +0.3% 111128824 / 110964518 / +0.1% 0.59 / 0.59 / +0.1%
clickbench_q30/datafusion:vortex-compact 271849566 / 263695284 / +3.1% 328097416 / 336133005 / -2.4% 0.83 / 0.78 / +5.6%
clickbench_q31/datafusion:vortex-compact 284727005 / 283338756 / +0.5% 381851776 / 375942939 / +1.6% 0.75 / 0.75 / -1.1%
clickbench_q32/datafusion:vortex-compact 828985981 / 837850232 / -1.1% 950110318 / 952401992 / -0.2% 0.87 / 0.88 / -0.8%
clickbench_q33/datafusion:vortex-compact 1038381044 / 1032311160 / +0.6% 1197246258 / 1231727525 / -2.8% 0.87 / 0.84 / +3.5%
clickbench_q34/datafusion:vortex-compact 1023838666 / 1023068268 / +0.1% 1182274692 / 1168790824 / +1.2% 0.87 / 0.88 / -1.1%
clickbench_q35/datafusion:vortex-compact 168085822 / 162466889 / +3.5% 229122371 / 228028976 / +0.5% 0.73 / 0.71 / +3.0%
clickbench_q36/datafusion:vortex-compact 58627160 / 59135206 / -0.9% 115712939 / 114753510 / +0.8% 0.51 / 0.52 / -1.7%
clickbench_q37/datafusion:vortex-compact 29788250 / 30051037 / -0.9% 80163916 / 78953374 / +1.5% 0.37 / 0.38 / -2.4%
clickbench_q38/datafusion:vortex-compact 17980179 / 17363909 / +3.5% 70609280 / 70486859 / +0.2% 0.25 / 0.25 / +3.4%
clickbench_q39/datafusion:vortex-compact 115484618 / 116590303 / -0.9% 184349770 / 180872960 / +1.9% 0.63 / 0.64 / -2.8%
clickbench_q40/datafusion:vortex-compact 15909859 / 16066970 / -1.0% 64158906 / 60078242 / +6.8% 0.25 / 0.27 / -7.3%
clickbench_q41/datafusion:vortex-compact 16515702 / 17936726 / -7.9% 65620277 / 64566872 / +1.6% 0.25 / 0.28 / -9.4%
clickbench_q42/datafusion:vortex-compact 13977496 / 13736760 / +1.8% 61473510 / 58142766 / +5.7% 0.23 / 0.24 / -3.8%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1976328 / 1921161 / +2.9% 89419387 / 88158425 / +1.4% 0.02 / 0.02 / +1.4%
clickbench_q01/datafusion:parquet 17020547 / 18494058 / -8.0% 125985433 / 123844603 / +1.7% 0.14 / 0.15 / -9.5%
clickbench_q02/datafusion:parquet 31239243 / 32975887 / -5.3% 149514829 / 146245135 / +2.2% 0.21 / 0.23 / -7.3%
clickbench_q03/datafusion:parquet 27865581 / 27190301 / +2.5% 146898106 / 144189943 / +1.9% 0.19 / 0.19 / +0.6%
clickbench_q04/datafusion:parquet 170662055 / 169140949 / +0.9% 311480902 / 308649615 / +0.9% 0.55 / 0.55 / -0.0%
clickbench_q05/datafusion:parquet 238669116 / 237445106 / +0.5% 376434138 / 380354294 / -1.0% 0.63 / 0.62 / +1.6%
clickbench_q06/datafusion:parquet 1951966 / 1900495 / +2.7% 89863790 / 86197283 / +4.3% 0.02 / 0.02 / -1.5%
clickbench_q07/datafusion:parquet 18901576 / 19326822 / -2.2% 128701861 / 127412171 / +1.0% 0.15 / 0.15 / -3.2%
clickbench_q08/datafusion:parquet 232623946 / 228547554 / +1.8% 386663095 / 385548560 / +0.3% 0.60 / 0.59 / +1.5%
clickbench_q09/datafusion:parquet 365878574 / 356076498 / +2.8% 513719969 / 496842043 / +3.4% 0.71 / 0.72 / -0.6%
clickbench_q10/datafusion:parquet 74205352 / 72181574 / +2.8% 207204956 / 201843863 / +2.7% 0.36 / 0.36 / +0.1%
clickbench_q11/datafusion:parquet 89495586 / 88753974 / +0.8% 220856742 / 225968194 / -2.3% 0.41 / 0.39 / +3.2%
clickbench_q12/datafusion:parquet 239661108 / 240164628 / -0.2% 387945872 / 380819385 / +1.9% 0.62 / 0.63 / -2.0%
clickbench_q13/datafusion:parquet 401744414 / 394323492 / +1.9% 565125311 / 569165634 / -0.7% 0.71 / 0.69 / +2.6%
clickbench_q14/datafusion:parquet 256579612 / 249821376 / +2.7% 410298865 / 407673696 / +0.6% 0.63 / 0.61 / +2.0%
clickbench_q15/datafusion:parquet 195069016 / 195530940 / -0.2% 344093247 / 339818483 / +1.3% 0.57 / 0.58 / -1.5%
clickbench_q16/datafusion:parquet 479711560 / 483039326 / -0.7% 651746281 / 651453873 / +0.0% 0.74 / 0.74 / -0.7%
clickbench_q17/datafusion:parquet 475612302 / 475459658 / +0.0% 651157165 / 641720751 / +1.5% 0.73 / 0.74 / -1.4%
clickbench_q18/datafusion:parquet 918813432 / 910637270 / +0.9% 1114547974 / 1084699688 / +2.8% 0.82 / 0.84 / -1.8%
clickbench_q19/datafusion:parquet 23198166 / 23390077 / -0.8% 137838388 / 136337380 / +1.1% 0.17 / 0.17 / -1.9%
clickbench_q20/datafusion:parquet 446607094 / 455662012 / -2.0% 617168847 / 620900748 / -0.6% 0.72 / 0.73 / -1.4%
clickbench_q21/datafusion:parquet 497163284 / 476882174 / +4.3% 688712325 / 670231488 / +2.8% 0.72 / 0.71 / +1.5%
clickbench_q22/datafusion:parquet 641717716 / 637946430 / +0.6% 861463088 / 873441472 / -1.4% 0.74 / 0.73 / +2.0%
clickbench_q23/datafusion:parquet 2813754336 / 2805022134 / +0.3% 3217567784 / 3191131263 / +0.8% 0.87 / 0.88 / -0.5%
clickbench_q24/datafusion:parquet 47964106 / 50996262 / -5.9% 163604298 / 156803520 / +4.3% 0.29 / 0.33 / -9.9%
clickbench_q25/datafusion:parquet 89062722 / 89168537 / -0.1% 213991839 / 209260377 / +2.3% 0.42 / 0.43 / -2.3%
clickbench_q26/datafusion:parquet 49308032 / 50247532 / -1.9% 161885772 / 157903192 / +2.5% 0.30 / 0.32 / -4.3%
clickbench_q27/datafusion:parquet 525088978 / 525041816 / +0.0% 710859148 / 707836636 / +0.4% 0.74 / 0.74 / -0.4%
clickbench_q28/datafusion:parquet 1509712514 / 1531436015 / -1.4% 1703323997 / 1646923381 / +3.4% 0.89 / 0.93 / -4.7%
clickbench_q29/datafusion:parquet 40887509 / 39821346 / +2.7% 162812425 / 161221075 / +1.0% 0.25 / 0.25 / +1.7%
clickbench_q30/datafusion:parquet 235893347 / 232450162 / +1.5% 418760556 / 402350687 / +4.1% 0.56 / 0.58 / -2.5%
clickbench_q31/datafusion:parquet 265988362 / 270842884 / -1.8% 461858917 / 459702453 / +0.5% 0.58 / 0.59 / -2.3%
clickbench_q32/datafusion:parquet 831878355 / 842086699 / -1.2% 1037006376 / 1033293286 / +0.4% 0.80 / 0.81 / -1.6%
clickbench_q33/datafusion:parquet 1089929184 / 1077835770 / +1.1% 1325358440 / 1338723727 / -1.0% 0.82 / 0.81 / +2.1%
clickbench_q34/datafusion:parquet 1082543392 / 1081591149 / +0.1% 1297427496 / 1288007699 / +0.7% 0.83 / 0.84 / -0.6%
clickbench_q35/datafusion:parquet 161727426 / 160205894 / +0.9% 301571205 / 293359390 / +2.8% 0.54 / 0.55 / -1.8%
clickbench_q36/datafusion:parquet 107822906 / 107108510 / +0.7% 238113615 / 231810193 / +2.7% 0.45 / 0.46 / -2.0%
clickbench_q37/datafusion:parquet 49635106 / 48813188 / +1.7% 165995047 / 154770433 / +7.3% 0.30 / 0.32 / -5.2%
clickbench_q38/datafusion:parquet 66747540 / 66304231 / +0.7% 178719451 / 186285710 / -4.1% 0.37 / 0.36 / +4.9%
clickbench_q39/datafusion:parquet 203998512 / 204585884 / -0.3% 340949905 / 332288685 / +2.6% 0.60 / 0.62 / -2.8%
clickbench_q40/datafusion:parquet 26181790 / 26518108 / -1.3% 141114092 / 134981121 / +4.5% 0.19 / 0.20 / -5.6%
clickbench_q41/datafusion:parquet 26135813 / 26148414 / -0.0% 134020687 / 129943419 / +3.1% 0.20 / 0.20 / -3.1%
clickbench_q42/datafusion:parquet 26160387 / 26387867 / -0.9% 136163134 / 126157033 / +7.9% 0.19 / 0.21 / -8.1%
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 13942840 / 14963858 / -6.8% 71528228 / 75564055 / -5.3% 0.19 / 0.20 / -1.6%
clickbench_q01/duckdb:vortex-file-compressed 20350502 / 19475396 / +4.5% 94707131 / 94856651 / -0.2% 0.21 / 0.21 / +4.7%
clickbench_q02/duckdb:vortex-file-compressed 21960008 / 22185872 / -1.0% 114281219 / 108204173 / +5.6% 0.19 / 0.21 / -6.3%
clickbench_q03/duckdb:vortex-file-compressed 31925101 / 33914332 / -5.9% 106153342 / 108521205 / -2.2% 0.30 / 0.31 / -3.8%
clickbench_q04/duckdb:vortex-file-compressed 132215236 / 133907732 / -1.3% 213602837 / 210475628 / +1.5% 0.62 / 0.64 / -2.7%
clickbench_q05/duckdb:vortex-file-compressed 157045778 / 157385743 / -0.2% 238816423 / 243642873 / -2.0% 0.66 / 0.65 / +1.8%
clickbench_q06/duckdb:vortex-file-compressed 22819499 / 19510629 / +17.0% 🔴 99923750 / 103235217 / -3.2% 0.23 / 0.19 / +20.8%
clickbench_q07/duckdb:vortex-file-compressed 24481113 / 21312850 / +14.9% 🔴 104108446 / 112789440 / -7.7% 0.24 / 0.19 / +24.4%
clickbench_q08/duckdb:vortex-file-compressed 172738698 / 171988748 / +0.4% 290754816 / 301001412 / -3.4% 0.59 / 0.57 / +4.0%
clickbench_q09/duckdb:vortex-file-compressed 213367667 / 212553322 / +0.4% 327815883 / 335363143 / -2.3% 0.65 / 0.63 / +2.7%
clickbench_q10/duckdb:vortex-file-compressed 72928192 / 76224780 / -4.3% 182359224 / 186600654 / -2.3% 0.40 / 0.41 / -2.1%
clickbench_q11/duckdb:vortex-file-compressed 94890257 / 98069736 / -3.2% 191474258 / 202842065 / -5.6% 0.50 / 0.48 / +2.5%
clickbench_q12/duckdb:vortex-file-compressed 180129040 / 174997876 / +2.9% 290952115 / 294660833 / -1.3% 0.62 / 0.59 / +4.2%
clickbench_q13/duckdb:vortex-file-compressed 324877377 / 324146852 / +0.2% 466590997 / 462114482 / +1.0% 0.70 / 0.70 / -0.7%
clickbench_q14/duckdb:vortex-file-compressed 194331113 / 193962670 / +0.2% 298139998 / 316825685 / -5.9% 0.65 / 0.61 / +6.5%
clickbench_q15/duckdb:vortex-file-compressed 192676660 / 188518800 / +2.2% 287322182 / 291478907 / -1.4% 0.67 / 0.65 / +3.7%
clickbench_q16/duckdb:vortex-file-compressed 378374613 / 371634816 / +1.8% 492480324 / 506253162 / -2.7% 0.77 / 0.73 / +4.7%
clickbench_q17/duckdb:vortex-file-compressed 368112287 / 371476785 / -0.9% 488948398 / 470429562 / +3.9% 0.75 / 0.79 / -4.7%
clickbench_q18/duckdb:vortex-file-compressed 750953383 / 734445297 / +2.2% 871489271 / 909187531 / -4.1% 0.86 / 0.81 / +6.7%
clickbench_q19/duckdb:vortex-file-compressed 28087206 / 27657914 / +1.6% 106082761 / 125760433 / -15.6% 🟢 0.26 / 0.22 / +20.4%
clickbench_q20/duckdb:vortex-file-compressed 245155178 / 239367939 / +2.4% 437079241 / 449054711 / -2.7% 0.56 / 0.53 / +5.2%
clickbench_q21/duckdb:vortex-file-compressed 373020968 / 372676160 / +0.1% 644069927 / 656875137 / -1.9% 0.58 / 0.57 / +2.1%
clickbench_q22/duckdb:vortex-file-compressed 563531992 / 566097750 / -0.5% 946181454 / 956142003 / -1.0% 0.60 / 0.59 / +0.6%
clickbench_q23/duckdb:vortex-file-compressed 124293662 / 128715622 / -3.4% 235629458 / 234835460 / +0.3% 0.53 / 0.55 / -3.8%
clickbench_q24/duckdb:vortex-file-compressed 40581026 / 40469306 / +0.3% 96200266 / 98751505 / -2.6% 0.42 / 0.41 / +2.9%
clickbench_q25/duckdb:vortex-file-compressed 61468752 / 61858124 / -0.6% 145331013 / 148697401 / -2.3% 0.42 / 0.42 / +1.7%
clickbench_q26/duckdb:vortex-file-compressed 35478556 / 35166352 / +0.9% 92359891 / 92205001 / +0.2% 0.38 / 0.38 / +0.7%
clickbench_q27/duckdb:vortex-file-compressed 248143514 / 244445986 / +1.5% 500736773 / 528322405 / -5.2% 0.50 / 0.46 / +7.1%
clickbench_q28/duckdb:vortex-file-compressed 1203183488 / 1181491121 / +1.8% 1500287945 / 1521147557 / -1.4% 0.80 / 0.78 / +3.3%
clickbench_q29/duckdb:vortex-file-compressed 30386426 / 31512120 / -3.6% 111217717 / 112278326 / -0.9% 0.27 / 0.28 / -2.7%
clickbench_q30/duckdb:vortex-file-compressed 169970362 / 165858412 / +2.5% 284035736 / 295660046 / -3.9% 0.60 / 0.56 / +6.7%
clickbench_q31/duckdb:vortex-file-compressed 313661642 / 317167137 / -1.1% 508030048 / 506187852 / +0.4% 0.62 / 0.63 / -1.5%
clickbench_q32/duckdb:vortex-file-compressed 924155966 / 923481232 / +0.1% 1067701763 / 1074947684 / -0.7% 0.87 / 0.86 / +0.8%
clickbench_q33/duckdb:vortex-file-compressed 1054793432 / 1044550363 / +1.0% 1086723113 / 1285542558 / -15.5% 🟢 0.97 / 0.81 / +19.5%
clickbench_q34/duckdb:vortex-file-compressed 1081845062 / 1074123808 / +0.7% 1370902019 / 1374787806 / -0.3% 0.79 / 0.78 / +1.0%
clickbench_q35/duckdb:vortex-file-compressed 210812390 / 209782228 / +0.5% 302655457 / 306761713 / -1.3% 0.70 / 0.68 / +1.9%
clickbench_q36/duckdb:vortex-file-compressed 30742227 / 31662666 / -2.9% 105695938 / 110626943 / -4.5% 0.29 / 0.29 / +1.6%
clickbench_q37/duckdb:vortex-file-compressed 19330863 / 20383456 / -5.2% 70901523 / 93561022 / -24.2% 🟢 0.27 / 0.22 / +25.1%
clickbench_q38/duckdb:vortex-file-compressed 23130133 / 23231182 / -0.4% 91318934 / 97350211 / -6.2% 0.25 / 0.24 / +6.1%
clickbench_q39/duckdb:vortex-file-compressed 47849820 / 47535227 / +0.7% 127389249 / 116503621 / +9.3% 0.38 / 0.41 / -7.9%
clickbench_q40/duckdb:vortex-file-compressed 17746356 / 16645019 / +6.6% 85297795 / 80432335 / +6.0% 0.21 / 0.21 / +0.5%
clickbench_q41/duckdb:vortex-file-compressed 18553946 / 18116364 / +2.4% 79759268 / 92864483 / -14.1% 🟢 0.23 / 0.20 / +19.2%
clickbench_q42/duckdb:vortex-file-compressed 19930412 / 19206840 / +3.8% 89960057 / 79114922 / +13.7% 🔴 0.22 / 0.24 / -8.7%
duckdb / vortex-compact / ns (1.005x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 15246779 / 15173200 / +0.5% 76840044 / 68502956 / +12.2% 🔴 0.20 / 0.22 / -10.4%
clickbench_q01/duckdb:vortex-compact 18850007 / 20545744 / -8.3% 103916159 / 98712551 / +5.3% 0.18 / 0.21 / -12.8%
clickbench_q02/duckdb:vortex-compact 35009343 / 35470476 / -1.3% 126395720 / 126398222 / -0.0% 0.28 / 0.28 / -1.3%
clickbench_q03/duckdb:vortex-compact 36044204 / 35463064 / +1.6% 97322584 / 101218960 / -3.8% 0.37 / 0.35 / +5.7%
clickbench_q04/duckdb:vortex-compact 138335872 / 140403656 / -1.5% 201481289 / 207611549 / -3.0% 0.69 / 0.68 / +1.5%
clickbench_q05/duckdb:vortex-compact 162621765 / 162041511 / +0.4% 249572880 / 252595995 / -1.2% 0.65 / 0.64 / +1.6%
clickbench_q06/duckdb:vortex-compact 21858458 / 21279056 / +2.7% 95113384 / 105738585 / -10.0% 🟢 0.23 / 0.20 / +14.2%
clickbench_q07/duckdb:vortex-compact 24818766 / 25614812 / -3.1% 104299095 / 109444011 / -4.7% 0.24 / 0.23 / +1.7%
clickbench_q08/duckdb:vortex-compact 187742960 / 185533228 / +1.2% 298190050 / 299379256 / -0.4% 0.63 / 0.62 / +1.6%
clickbench_q09/duckdb:vortex-compact 267934778 / 267598284 / +0.1% 370134963 / 377630822 / -2.0% 0.72 / 0.71 / +2.2%
clickbench_q10/duckdb:vortex-compact 89349427 / 84997342 / +5.1% 201311569 / 214214765 / -6.0% 0.44 / 0.40 / +11.9%
clickbench_q11/duckdb:vortex-compact 109602412 / 110265644 / -0.6% 223725340 / 226760095 / -1.3% 0.49 / 0.49 / +0.7%
clickbench_q12/duckdb:vortex-compact 190979128 / 189854566 / +0.6% 309369321 / 300430232 / +3.0% 0.62 / 0.63 / -2.3%
clickbench_q13/duckdb:vortex-compact 347612270 / 351812364 / -1.2% 480773219 / 463365078 / +3.8% 0.72 / 0.76 / -4.8%
clickbench_q14/duckdb:vortex-compact 207471447 / 212463218 / -2.3% 312043004 / 325056181 / -4.0% 0.66 / 0.65 / +1.7%
clickbench_q15/duckdb:vortex-compact 196757217 / 192206650 / +2.4% 295798926 / 294015078 / +0.6% 0.67 / 0.65 / +1.8%
clickbench_q16/duckdb:vortex-compact 394918635 / 396885658 / -0.5% 512851126 / 503497145 / +1.9% 0.77 / 0.79 / -2.3%
clickbench_q17/duckdb:vortex-compact 391489242 / 383056982 / +2.2% 499798217 / 503614275 / -0.8% 0.78 / 0.76 / +3.0%
clickbench_q18/duckdb:vortex-compact 733128271 / 746074932 / -1.7% 856555165 / 851591662 / +0.6% 0.86 / 0.88 / -2.3%
clickbench_q19/duckdb:vortex-compact 26892288 / 27962949 / -3.8% 101170604 / 108018084 / -6.3% 0.27 / 0.26 / +2.7%
clickbench_q20/duckdb:vortex-compact 216201982 / 219634864 / -1.6% 385999607 / 385026218 / +0.3% 0.56 / 0.57 / -1.8%
clickbench_q21/duckdb:vortex-compact 367405708 / 356849846 / +3.0% 649796743 / 656150359 / -1.0% 0.57 / 0.54 / +4.0%
clickbench_q22/duckdb:vortex-compact 675902114 / 680821844 / -0.7% 1050525059 / 1080282022 / -2.8% 0.64 / 0.63 / +2.1%
clickbench_q23/duckdb:vortex-compact 195479614 / 189255722 / +3.3% 292704482 / 285077394 / +2.7% 0.67 / 0.66 / +0.6%
clickbench_q24/duckdb:vortex-compact 47318967 / 45354654 / +4.3% 106924571 / 108011397 / -1.0% 0.44 / 0.42 / +5.4%
clickbench_q25/duckdb:vortex-compact 81999260 / 84715322 / -3.2% 160267684 / 158794596 / +0.9% 0.51 / 0.53 / -4.1%
clickbench_q26/duckdb:vortex-compact 39868306 / 40755816 / -2.2% 98155260 / 93333069 / +5.2% 0.41 / 0.44 / -7.0%
clickbench_q27/duckdb:vortex-compact 402669474 / 398109148 / +1.1% 662821251 / 668934930 / -0.9% 0.61 / 0.60 / +2.1%
clickbench_q28/duckdb:vortex-compact 1148450078 / 1161590194 / -1.1% 1375178911 / 1379321450 / -0.3% 0.84 / 0.84 / -0.8%
clickbench_q29/duckdb:vortex-compact 41421420 / 40817932 / +1.5% 117819656 / 119379487 / -1.3% 0.35 / 0.34 / +2.8%
clickbench_q30/duckdb:vortex-compact 210059214 / 209795650 / +0.1% 331214131 / 334740584 / -1.1% 0.63 / 0.63 / +1.2%
clickbench_q31/duckdb:vortex-compact 325771468 / 329364053 / -1.1% 530263929 / 538909704 / -1.6% 0.61 / 0.61 / +0.5%
clickbench_q32/duckdb:vortex-compact 961709322 / 944696838 / +1.8% 1080612418 / 1089791103 / -0.8% 0.89 / 0.87 / +2.7%
clickbench_q33/duckdb:vortex-compact 1010351066 / 1015397981 / -0.5% 1052463057 / 1038040229 / +1.4% 0.96 / 0.98 / -1.9%
clickbench_q34/duckdb:vortex-compact 1039569312 / 867036978 / +19.9% 🔴 1284772000 / 1287367545 / -0.2% 0.81 / 0.67 / +20.1%
clickbench_q35/duckdb:vortex-compact 219582654 / 221804622 / -1.0% 310289524 / 298394467 / +4.0% 0.71 / 0.74 / -4.8%
clickbench_q36/duckdb:vortex-compact 31003060 / 29613682 / +4.7% 120403165 / 110736801 / +8.7% 0.26 / 0.27 / -3.7%
clickbench_q37/duckdb:vortex-compact 23851426 / 25016752 / -4.7% 102919370 / 109808652 / -6.3% 0.23 / 0.23 / +1.7%
clickbench_q38/duckdb:vortex-compact 24361034 / 23409226 / +4.1% 116575247 / 106532674 / +9.4% 0.21 / 0.22 / -4.9%
clickbench_q39/duckdb:vortex-compact 50335176 / 53104690 / -5.2% 146055355 / 143776069 / +1.6% 0.34 / 0.37 / -6.7%
clickbench_q40/duckdb:vortex-compact 20562774 / 20570660 / -0.0% 91162839 / 92241908 / -1.2% 0.23 / 0.22 / +1.1%
clickbench_q41/duckdb:vortex-compact 22698156 / 20921257 / +8.5% 86621750 / 99045928 / -12.5% 🟢 0.26 / 0.21 / +24.1%
clickbench_q42/duckdb:vortex-compact 19188864 / 18964200 / +1.2% 88472041 / 88205084 / +0.3% 0.22 / 0.22 / +0.9%
duckdb / parquet / ns (1.009x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 16571627 / 16489302 / +0.5% 44141516 / 40386797 / +9.3% 0.38 / 0.41 / -8.0%
clickbench_q01/duckdb:parquet 16462323 / 16921795 / -2.7% 36513409 / 35760109 / +2.1% 0.45 / 0.47 / -4.7%
clickbench_q02/duckdb:parquet 27536906 / 25845568 / +6.5% 58052524 / 57357504 / +1.2% 0.47 / 0.45 / +5.3%
clickbench_q03/duckdb:parquet 28747302 / 29066663 / -1.1% 91407623 / 86426961 / +5.8% 0.31 / 0.34 / -6.5%
clickbench_q04/duckdb:parquet 131344072 / 135931300 / -3.4% 186527020 / 204960914 / -9.0% 0.70 / 0.66 / +6.2%
clickbench_q05/duckdb:parquet 185892124 / 198929109 / -6.6% 263588578 / 255371561 / +3.2% 0.71 / 0.78 / -9.5%
clickbench_q06/duckdb:parquet 27587922 / 23528803 / +17.3% 🔴 46247278 / 51006454 / -9.3% 0.60 / 0.46 / +29.3%
clickbench_q07/duckdb:parquet 18282674 / 18398714 / -0.6% 38968782 / 43446518 / -10.3% 🟢 0.47 / 0.42 / +10.8%
clickbench_q08/duckdb:parquet 166801722 / 164102243 / +1.6% 250063453 / 259882348 / -3.8% 0.67 / 0.63 / +5.6%
clickbench_q09/duckdb:parquet 230050608 / 228612329 / +0.6% 300795417 / 301450382 / -0.2% 0.76 / 0.76 / +0.8%
clickbench_q10/duckdb:parquet 65066173 / 62080492 / +4.8% 114449045 / 116728048 / -2.0% 0.57 / 0.53 / +6.9%
clickbench_q11/duckdb:parquet 70224310 / 69753993 / +0.7% 128637739 / 132852063 / -3.2% 0.55 / 0.53 / +4.0%
clickbench_q12/duckdb:parquet 179514594 / 176340986 / +1.8% 267703064 / 268679735 / -0.4% 0.67 / 0.66 / +2.2%
clickbench_q13/duckdb:parquet 313652888 / 309889646 / +1.2% 429355604 / 427900564 / +0.3% 0.73 / 0.72 / +0.9%
clickbench_q14/duckdb:parquet 193023065 / 189847788 / +1.7% 286508763 / 287564301 / -0.4% 0.67 / 0.66 / +2.0%
clickbench_q15/duckdb:parquet 183606166 / 189619488 / -3.2% 233043752 / 227249908 / +2.5% 0.79 / 0.83 / -5.6%
clickbench_q16/duckdb:parquet 357257481 / 358389498 / -0.3% 480674723 / 467415931 / +2.8% 0.74 / 0.77 / -3.1%
clickbench_q17/duckdb:parquet 366177200 / 356632269 / +2.7% 448594044 / 460960465 / -2.7% 0.82 / 0.77 / +5.5%
clickbench_q18/duckdb:parquet 686074942 / 690545908 / -0.6% 895852252 / 888704141 / +0.8% 0.77 / 0.78 / -1.4%
clickbench_q19/duckdb:parquet 24900932 / 24026198 / +3.6% 70099877 / 68853397 / +1.8% 0.36 / 0.35 / +1.8%
clickbench_q20/duckdb:parquet 272339708 / 263310165 / +3.4% 467461089 / 456759314 / +2.3% 0.58 / 0.58 / +1.1%
clickbench_q21/duckdb:parquet 323697826 / 316034747 / +2.4% 606570534 / 624476039 / -2.9% 0.53 / 0.51 / +5.4%
clickbench_q22/duckdb:parquet 492025908 / 469302504 / +4.8% 759339730 / 773094690 / -1.8% 0.65 / 0.61 / +6.7%
clickbench_q23/duckdb:parquet 259991336 / 242267405 / +7.3% 308159109 / 325222840 / -5.2% 0.84 / 0.74 / +13.3%
clickbench_q24/duckdb:parquet 78177322 / 80629320 / -3.0% 126804592 / 121272748 / +4.6% 0.62 / 0.66 / -7.3%
clickbench_q25/duckdb:parquet 78144972 / 74171400 / +5.4% 187963858 / 181660900 / +3.5% 0.42 / 0.41 / +1.8%
clickbench_q26/duckdb:parquet 48935086 / 54580938 / -10.3% 🟢 92905893 / 101561669 / -8.5% 0.53 / 0.54 / -2.0%
clickbench_q27/duckdb:parquet 281658596 / 276910666 / +1.7% 505271103 / 519168248 / -2.7% 0.56 / 0.53 / +4.5%
clickbench_q28/duckdb:parquet 1753656275 / 1703672216 / +2.9% 2164124175 / 2161796346 / +0.1% 0.81 / 0.79 / +2.8%
clickbench_q29/duckdb:parquet 26782154 / 29599732 / -9.5% 61393478 / 58292421 / +5.3% 0.44 / 0.51 / -14.1%
clickbench_q30/duckdb:parquet 178226940 / 180511099 / -1.3% 321744129 / 335649453 / -4.1% 0.55 / 0.54 / +3.0%
clickbench_q31/duckdb:parquet 318332745 / 302761411 / +5.1% 599036802 / 551644194 / +8.6% 0.53 / 0.55 / -3.2%
clickbench_q32/duckdb:parquet 903157906 / 911564134 / -0.9% 1032499193 / 1023073282 / +0.9% 0.87 / 0.89 / -1.8%
clickbench_q33/duckdb:parquet 822645310 / 791584427 / +3.9% 961922097 / 957909025 / +0.4% 0.86 / 0.83 / +3.5%
clickbench_q34/duckdb:parquet 800758680 / 788794757 / +1.5% 1091672669 / 1120229403 / -2.5% 0.73 / 0.70 / +4.2%
clickbench_q35/duckdb:parquet 208180334 / 206503812 / +0.8% 249875649 / 244590909 / +2.2% 0.83 / 0.84 / -1.3%
clickbench_q36/duckdb:parquet 49987006 / 50335256 / -0.7% 76672350 / 73081469 / +4.9% 0.65 / 0.69 / -5.3%
clickbench_q37/duckdb:parquet 36711821 / 37504811 / -2.1% 57184049 / 60171288 / -5.0% 0.64 / 0.62 / +3.0%
clickbench_q38/duckdb:parquet 38078778 / 38140615 / -0.2% 68421757 / 60159834 / +13.7% 🔴 0.56 / 0.63 / -12.2%
clickbench_q39/duckdb:parquet 90081854 / 89496626 / +0.7% 111146852 / 115742259 / -4.0% 0.81 / 0.77 / +4.8%
clickbench_q40/duckdb:parquet 20727688 / 20280659 / +2.2% 43147791 / 44520923 / -3.1% 0.48 / 0.46 / +5.5%
clickbench_q41/duckdb:parquet 21621972 / 20676096 / +4.6% 41289196 / 42945249 / -3.9% 0.52 / 0.48 / +8.8%
clickbench_q42/duckdb:parquet 23393826 / 23636012 / -1.0% 44620083 / 46318639 / -3.7% 0.52 / 0.51 / +2.7%

File Size Changes (200 files changed, +0.0% overall, 200↑ 0↓)
File Scale Format Base HEAD Change %
hits_48.vortex 1.0 vortex-compact 17.82 MB 17.82 MB +32 B +0.0%
hits_47.vortex 1.0 vortex-compact 18.19 MB 18.19 MB +32 B +0.0%
hits_48.vortex 1.0 vortex-file-compressed 26.53 MB 26.53 MB +32 B +0.0%
hits_33.vortex 1.0 vortex-compact 35.89 MB 35.89 MB +32 B +0.0%
hits_29.vortex 1.0 vortex-compact 36.65 MB 36.65 MB +32 B +0.0%
hits_20.vortex 1.0 vortex-compact 38.33 MB 38.33 MB +32 B +0.0%
hits_47.vortex 1.0 vortex-file-compressed 39.89 MB 39.89 MB +32 B +0.0%
hits_46.vortex 1.0 vortex-compact 42.24 MB 42.24 MB +32 B +0.0%
hits_32.vortex 1.0 vortex-compact 44.58 MB 44.58 MB +32 B +0.0%
hits_24.vortex 1.0 vortex-compact 45.09 MB 45.09 MB +32 B +0.0%
hits_75.vortex 1.0 vortex-compact 45.09 MB 45.09 MB +32 B +0.0%
hits_23.vortex 1.0 vortex-compact 46.11 MB 46.11 MB +32 B +0.0%
hits_22.vortex 1.0 vortex-compact 46.20 MB 46.20 MB +32 B +0.0%
hits_63.vortex 1.0 vortex-compact 46.41 MB 46.41 MB +32 B +0.0%
hits_15.vortex 1.0 vortex-compact 48.38 MB 48.38 MB +32 B +0.0%
hits_86.vortex 1.0 vortex-compact 49.09 MB 49.09 MB +32 B +0.0%
hits_36.vortex 1.0 vortex-compact 49.18 MB 49.18 MB +32 B +0.0%
hits_10.vortex 1.0 vortex-compact 49.45 MB 49.45 MB +32 B +0.0%
hits_16.vortex 1.0 vortex-compact 49.53 MB 49.53 MB +32 B +0.0%
hits_19.vortex 1.0 vortex-compact 49.69 MB 49.69 MB +32 B +0.0%
hits_39.vortex 1.0 vortex-compact 50.06 MB 50.06 MB +32 B +0.0%
hits_49.vortex 1.0 vortex-compact 50.97 MB 50.97 MB +32 B +0.0%
hits_21.vortex 1.0 vortex-compact 51.96 MB 51.96 MB +32 B +0.0%
hits_72.vortex 1.0 vortex-compact 52.70 MB 52.70 MB +32 B +0.0%
hits_85.vortex 1.0 vortex-compact 52.83 MB 52.83 MB +32 B +0.0%
hits_66.vortex 1.0 vortex-compact 53.49 MB 53.49 MB +32 B +0.0%
hits_83.vortex 1.0 vortex-compact 53.58 MB 53.58 MB +32 B +0.0%
hits_64.vortex 1.0 vortex-compact 54.06 MB 54.06 MB +32 B +0.0%
hits_37.vortex 1.0 vortex-compact 54.73 MB 54.73 MB +32 B +0.0%
hits_31.vortex 1.0 vortex-compact 55.74 MB 55.74 MB +32 B +0.0%
hits_33.vortex 1.0 vortex-file-compressed 55.84 MB 55.84 MB +32 B +0.0%
hits_11.vortex 1.0 vortex-compact 56.08 MB 56.08 MB +32 B +0.0%
hits_61.vortex 1.0 vortex-compact 57.70 MB 57.70 MB +32 B +0.0%
hits_29.vortex 1.0 vortex-file-compressed 57.83 MB 57.83 MB +32 B +0.0%
hits_95.vortex 1.0 vortex-compact 58.17 MB 58.17 MB +32 B +0.0%
hits_34.vortex 1.0 vortex-compact 58.21 MB 58.21 MB +32 B +0.0%
hits_30.vortex 1.0 vortex-compact 58.55 MB 58.55 MB +32 B +0.0%
hits_17.vortex 1.0 vortex-compact 58.76 MB 58.76 MB +32 B +0.0%
hits_0.vortex 1.0 vortex-compact 58.85 MB 58.85 MB +32 B +0.0%
hits_93.vortex 1.0 vortex-compact 59.89 MB 59.89 MB +32 B +0.0%
hits_53.vortex 1.0 vortex-compact 60.02 MB 60.02 MB +32 B +0.0%
hits_91.vortex 1.0 vortex-compact 61.21 MB 61.21 MB +32 B +0.0%
hits_58.vortex 1.0 vortex-compact 61.21 MB 61.21 MB +32 B +0.0%
hits_20.vortex 1.0 vortex-file-compressed 61.26 MB 61.26 MB +32 B +0.0%
hits_75.vortex 1.0 vortex-file-compressed 61.68 MB 61.68 MB +32 B +0.0%
hits_70.vortex 1.0 vortex-compact 61.81 MB 61.81 MB +32 B +0.0%
hits_5.vortex 1.0 vortex-compact 63.30 MB 63.30 MB +32 B +0.0%
hits_38.vortex 1.0 vortex-compact 63.35 MB 63.35 MB +32 B +0.0%
hits_8.vortex 1.0 vortex-compact 63.37 MB 63.37 MB +32 B +0.0%
hits_6.vortex 1.0 vortex-compact 63.55 MB 63.55 MB +32 B +0.0%
hits_7.vortex 1.0 vortex-compact 64.16 MB 64.16 MB +32 B +0.0%
hits_18.vortex 1.0 vortex-compact 64.85 MB 64.85 MB +32 B +0.0%
hits_60.vortex 1.0 vortex-compact 64.89 MB 64.89 MB +32 B +0.0%
hits_52.vortex 1.0 vortex-compact 65.05 MB 65.05 MB +32 B +0.0%
hits_32.vortex 1.0 vortex-file-compressed 65.46 MB 65.46 MB +32 B +0.0%
hits_81.vortex 1.0 vortex-compact 65.92 MB 65.92 MB +32 B +0.0%
hits_9.vortex 1.0 vortex-compact 66.29 MB 66.29 MB +32 B +0.0%
hits_36.vortex 1.0 vortex-file-compressed 66.37 MB 66.37 MB +32 B +0.0%
hits_59.vortex 1.0 vortex-compact 66.65 MB 66.65 MB +32 B +0.0%
hits_86.vortex 1.0 vortex-file-compressed 67.09 MB 67.09 MB +32 B +0.0%
hits_63.vortex 1.0 vortex-file-compressed 67.27 MB 67.27 MB +32 B +0.0%
hits_82.vortex 1.0 vortex-compact 67.40 MB 67.40 MB +32 B +0.0%
hits_46.vortex 1.0 vortex-file-compressed 67.63 MB 67.63 MB +32 B +0.0%
hits_10.vortex 1.0 vortex-file-compressed 67.91 MB 67.91 MB +32 B +0.0%
hits_80.vortex 1.0 vortex-compact 68.64 MB 68.64 MB +32 B +0.0%
hits_13.vortex 1.0 vortex-compact 69.21 MB 69.21 MB +32 B +0.0%
hits_97.vortex 1.0 vortex-compact 69.55 MB 69.55 MB +32 B +0.0%
hits_12.vortex 1.0 vortex-compact 69.83 MB 69.83 MB +32 B +0.0%
hits_27.vortex 1.0 vortex-compact 69.84 MB 69.84 MB +32 B +0.0%
hits_71.vortex 1.0 vortex-compact 69.93 MB 69.93 MB +32 B +0.0%
hits_28.vortex 1.0 vortex-compact 70.83 MB 70.83 MB +32 B +0.0%
hits_73.vortex 1.0 vortex-compact 70.85 MB 70.85 MB +32 B +0.0%
hits_74.vortex 1.0 vortex-compact 71.84 MB 71.84 MB +32 B +0.0%
hits_4.vortex 1.0 vortex-compact 71.92 MB 71.92 MB +32 B +0.0%
hits_26.vortex 1.0 vortex-compact 71.96 MB 71.96 MB +32 B +0.0%
hits_19.vortex 1.0 vortex-file-compressed 72.19 MB 72.19 MB +32 B +0.0%
hits_98.vortex 1.0 vortex-compact 73.12 MB 73.12 MB +32 B +0.0%
hits_88.vortex 1.0 vortex-compact 73.49 MB 73.49 MB +32 B +0.0%
hits_25.vortex 1.0 vortex-compact 73.50 MB 73.50 MB +32 B +0.0%
hits_84.vortex 1.0 vortex-compact 74.18 MB 74.18 MB +32 B +0.0%
hits_49.vortex 1.0 vortex-file-compressed 74.57 MB 74.57 MB +32 B +0.0%
hits_24.vortex 1.0 vortex-file-compressed 74.68 MB 74.68 MB +32 B +0.0%
hits_14.vortex 1.0 vortex-compact 74.85 MB 74.85 MB +32 B +0.0%
hits_23.vortex 1.0 vortex-file-compressed 75.17 MB 75.17 MB +32 B +0.0%
hits_35.vortex 1.0 vortex-compact 75.31 MB 75.31 MB +32 B +0.0%
hits_62.vortex 1.0 vortex-compact 75.42 MB 75.42 MB +32 B +0.0%
hits_45.vortex 1.0 vortex-compact 75.77 MB 75.77 MB +32 B +0.0%
hits_22.vortex 1.0 vortex-file-compressed 75.93 MB 75.93 MB +32 B +0.0%
hits_68.vortex 1.0 vortex-compact 76.65 MB 76.65 MB +32 B +0.0%
hits_76.vortex 1.0 vortex-compact 77.07 MB 77.07 MB +32 B +0.0%
hits_40.vortex 1.0 vortex-compact 77.39 MB 77.39 MB +32 B +0.0%
hits_99.vortex 1.0 vortex-compact 77.61 MB 77.61 MB +32 B +0.0%
hits_39.vortex 1.0 vortex-file-compressed 78.11 MB 78.11 MB +32 B +0.0%
hits_11.vortex 1.0 vortex-file-compressed 78.50 MB 78.50 MB +32 B +0.0%
hits_56.vortex 1.0 vortex-compact 78.57 MB 78.57 MB +32 B +0.0%
hits_16.vortex 1.0 vortex-file-compressed 78.75 MB 78.75 MB +32 B +0.0%
hits_64.vortex 1.0 vortex-file-compressed 79.27 MB 79.27 MB +32 B +0.0%
hits_69.vortex 1.0 vortex-compact 80.97 MB 80.97 MB +32 B +0.0%
hits_90.vortex 1.0 vortex-compact 82.06 MB 82.06 MB +32 B +0.0%
hits_72.vortex 1.0 vortex-file-compressed 83.47 MB 83.47 MB +32 B +0.0%
hits_57.vortex 1.0 vortex-compact 83.69 MB 83.69 MB +32 B +0.0%
hits_37.vortex 1.0 vortex-file-compressed 84.35 MB 84.35 MB +32 B +0.0%
hits_53.vortex 1.0 vortex-file-compressed 84.98 MB 84.98 MB +32 B +0.0%
hits_30.vortex 1.0 vortex-file-compressed 85.22 MB 85.22 MB +32 B +0.0%
hits_79.vortex 1.0 vortex-compact 86.14 MB 86.14 MB +32 B +0.0%
hits_17.vortex 1.0 vortex-file-compressed 86.30 MB 86.30 MB +32 B +0.0%
hits_0.vortex 1.0 vortex-file-compressed 87.76 MB 87.76 MB +32 B +0.0%
hits_15.vortex 1.0 vortex-file-compressed 88.29 MB 88.29 MB +32 B +0.0%
hits_83.vortex 1.0 vortex-file-compressed 88.41 MB 88.41 MB +32 B +0.0%
hits_31.vortex 1.0 vortex-file-compressed 88.41 MB 88.41 MB +32 B +0.0%
hits_58.vortex 1.0 vortex-file-compressed 88.97 MB 88.97 MB +32 B +0.0%
hits_66.vortex 1.0 vortex-file-compressed 89.15 MB 89.15 MB +32 B +0.0%
hits_93.vortex 1.0 vortex-file-compressed 89.67 MB 89.67 MB +32 B +0.0%
hits_1.vortex 1.0 vortex-compact 90.68 MB 90.68 MB +32 B +0.0%
hits_94.vortex 1.0 vortex-compact 90.87 MB 90.87 MB +32 B +0.0%
hits_85.vortex 1.0 vortex-file-compressed 90.94 MB 90.94 MB +32 B +0.0%
hits_5.vortex 1.0 vortex-file-compressed 91.45 MB 91.45 MB +32 B +0.0%
hits_96.vortex 1.0 vortex-compact 91.72 MB 91.72 MB +32 B +0.0%
hits_8.vortex 1.0 vortex-file-compressed 91.74 MB 91.74 MB +32 B +0.0%
hits_6.vortex 1.0 vortex-file-compressed 91.88 MB 91.88 MB +32 B +0.0%
hits_70.vortex 1.0 vortex-file-compressed 92.23 MB 92.23 MB +32 B +0.0%
hits_21.vortex 1.0 vortex-file-compressed 92.25 MB 92.25 MB +32 B +0.0%
hits_7.vortex 1.0 vortex-file-compressed 92.45 MB 92.45 MB +32 B +0.0%
hits_55.vortex 1.0 vortex-compact 92.51 MB 92.51 MB +32 B +0.0%
hits_92.vortex 1.0 vortex-compact 94.37 MB 94.37 MB +32 B +0.0%
hits_3.vortex 1.0 vortex-compact 95.04 MB 95.04 MB +32 B +0.0%
hits_95.vortex 1.0 vortex-file-compressed 95.35 MB 95.35 MB +32 B +0.0%
hits_91.vortex 1.0 vortex-file-compressed 95.92 MB 95.92 MB +32 B +0.0%
hits_34.vortex 1.0 vortex-file-compressed 96.61 MB 96.61 MB +32 B +0.0%
hits_13.vortex 1.0 vortex-file-compressed 96.97 MB 96.97 MB +32 B +0.0%
hits_38.vortex 1.0 vortex-file-compressed 97.80 MB 97.80 MB +32 B +0.0%
hits_78.vortex 1.0 vortex-compact 97.82 MB 97.82 MB +32 B +0.0%
hits_82.vortex 1.0 vortex-file-compressed 97.92 MB 97.92 MB +32 B +0.0%
hits_9.vortex 1.0 vortex-file-compressed 98.22 MB 98.22 MB +32 B +0.0%
hits_12.vortex 1.0 vortex-file-compressed 99.10 MB 99.10 MB +32 B +0.0%
hits_81.vortex 1.0 vortex-file-compressed 99.37 MB 99.37 MB +32 B +0.0%
hits_61.vortex 1.0 vortex-file-compressed 100.54 MB 100.54 MB +32 B +0.0%
hits_59.vortex 1.0 vortex-file-compressed 100.65 MB 100.65 MB +32 B +0.0%
hits_71.vortex 1.0 vortex-file-compressed 100.95 MB 100.95 MB +32 B +0.0%
hits_60.vortex 1.0 vortex-file-compressed 102.40 MB 102.40 MB +32 B +0.0%
hits_52.vortex 1.0 vortex-file-compressed 102.95 MB 102.95 MB +32 B +0.0%
hits_18.vortex 1.0 vortex-file-compressed 103.45 MB 103.45 MB +32 B +0.0%
hits_80.vortex 1.0 vortex-file-compressed 104.26 MB 104.26 MB +32 B +0.0%
hits_97.vortex 1.0 vortex-file-compressed 106.36 MB 106.36 MB +32 B +0.0%
hits_4.vortex 1.0 vortex-file-compressed 107.60 MB 107.60 MB +32 B +0.0%
hits_26.vortex 1.0 vortex-file-compressed 108.66 MB 108.66 MB +32 B +0.0%
hits_73.vortex 1.0 vortex-file-compressed 108.93 MB 108.93 MB +32 B +0.0%
hits_14.vortex 1.0 vortex-file-compressed 109.62 MB 109.62 MB +32 B +0.0%
hits_88.vortex 1.0 vortex-file-compressed 109.95 MB 109.95 MB +32 B +0.0%
hits_25.vortex 1.0 vortex-file-compressed 112.13 MB 112.14 MB +32 B +0.0%
hits_76.vortex 1.0 vortex-file-compressed 112.83 MB 112.83 MB +32 B +0.0%
hits_35.vortex 1.0 vortex-file-compressed 113.91 MB 113.91 MB +32 B +0.0%
hits_89.vortex 1.0 vortex-compact 114.07 MB 114.07 MB +32 B +0.0%
hits_50.vortex 1.0 vortex-compact 114.17 MB 114.17 MB +32 B +0.0%
hits_67.vortex 1.0 vortex-compact 114.42 MB 114.42 MB +32 B +0.0%
hits_84.vortex 1.0 vortex-file-compressed 116.44 MB 116.44 MB +32 B +0.0%
hits_62.vortex 1.0 vortex-file-compressed 116.56 MB 116.56 MB +32 B +0.0%
hits_40.vortex 1.0 vortex-file-compressed 116.81 MB 116.81 MB +32 B +0.0%
hits_54.vortex 1.0 vortex-compact 117.55 MB 117.55 MB +32 B +0.0%
hits_98.vortex 1.0 vortex-file-compressed 117.63 MB 117.63 MB +32 B +0.0%
hits_28.vortex 1.0 vortex-file-compressed 118.35 MB 118.35 MB +32 B +0.0%
hits_77.vortex 1.0 vortex-compact 118.44 MB 118.44 MB +32 B +0.0%
hits_87.vortex 1.0 vortex-compact 118.83 MB 118.83 MB +32 B +0.0%
hits_74.vortex 1.0 vortex-file-compressed 118.88 MB 118.88 MB +32 B +0.0%
hits_45.vortex 1.0 vortex-file-compressed 121.13 MB 121.13 MB +32 B +0.0%
hits_27.vortex 1.0 vortex-file-compressed 121.54 MB 121.54 MB +32 B +0.0%
hits_68.vortex 1.0 vortex-file-compressed 121.95 MB 121.95 MB +32 B +0.0%
hits_99.vortex 1.0 vortex-file-compressed 122.33 MB 122.33 MB +32 B +0.0%
hits_56.vortex 1.0 vortex-file-compressed 122.41 MB 122.41 MB +32 B +0.0%
hits_69.vortex 1.0 vortex-file-compressed 122.65 MB 122.65 MB +32 B +0.0%
hits_57.vortex 1.0 vortex-file-compressed 127.67 MB 127.67 MB +32 B +0.0%
hits_2.vortex 1.0 vortex-compact 129.13 MB 129.13 MB +32 B +0.0%
hits_65.vortex 1.0 vortex-compact 129.38 MB 129.38 MB +32 B +0.0%
hits_44.vortex 1.0 vortex-compact 133.23 MB 133.23 MB +32 B +0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.00 MB 135.00 MB +32 B +0.0%
hits_94.vortex 1.0 vortex-file-compressed 137.84 MB 137.84 MB +32 B +0.0%
hits_1.vortex 1.0 vortex-file-compressed 137.87 MB 137.87 MB +32 B +0.0%
hits_90.vortex 1.0 vortex-file-compressed 141.48 MB 141.48 MB +32 B +0.0%
hits_3.vortex 1.0 vortex-file-compressed 141.50 MB 141.50 MB +32 B +0.0%
hits_79.vortex 1.0 vortex-file-compressed 143.47 MB 143.47 MB +32 B +0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.58 MB 146.58 MB +32 B +0.0%
hits_78.vortex 1.0 vortex-file-compressed 163.88 MB 163.88 MB +32 B +0.0%
hits_42.vortex 1.0 vortex-compact 164.50 MB 164.50 MB +32 B +0.0%
hits_41.vortex 1.0 vortex-compact 166.03 MB 166.03 MB +32 B +0.0%
hits_55.vortex 1.0 vortex-file-compressed 168.11 MB 168.11 MB +32 B +0.0%
hits_51.vortex 1.0 vortex-compact 168.31 MB 168.31 MB +32 B +0.0%
hits_77.vortex 1.0 vortex-file-compressed 168.86 MB 168.86 MB +32 B +0.0%
hits_43.vortex 1.0 vortex-compact 169.18 MB 169.18 MB +32 B +0.0%
hits_87.vortex 1.0 vortex-file-compressed 172.75 MB 172.75 MB +32 B +0.0%
hits_50.vortex 1.0 vortex-file-compressed 178.87 MB 178.87 MB +32 B +0.0%
hits_67.vortex 1.0 vortex-file-compressed 183.95 MB 183.95 MB +32 B +0.0%
hits_65.vortex 1.0 vortex-file-compressed 184.24 MB 184.24 MB +32 B +0.0%
hits_89.vortex 1.0 vortex-file-compressed 184.80 MB 184.80 MB +32 B +0.0%
hits_2.vortex 1.0 vortex-file-compressed 186.82 MB 186.82 MB +32 B +0.0%
hits_44.vortex 1.0 vortex-file-compressed 187.12 MB 187.12 MB +32 B +0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.18 MB 221.18 MB +32 B +0.0%
hits_42.vortex 1.0 vortex-file-compressed 223.02 MB 223.02 MB +32 B +0.0%
hits_41.vortex 1.0 vortex-file-compressed 223.98 MB 223.98 MB +32 B +0.0%
hits_43.vortex 1.0 vortex-file-compressed 227.63 MB 227.63 MB +32 B +0.0%
hits_51.vortex 1.0 vortex-file-compressed 279.37 MB 279.37 MB +32 B +0.0%

Totals:

  • vortex-compact: 7.11 GB → 7.11 GB (+0.0%)
  • vortex-file-compressed: 10.90 GB → 10.90 GB (+0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR ee07a98a vs base 479bd98a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.3%
Engines: DataFusion No clear signal (-4.6%, environment too noisy confidence) · DuckDB No clear signal (+7.6%, environment too noisy confidence)
Vortex (geomean): hot 0.977x ➖ · cold 0.926x ➖
Parquet (geomean): hot 0.964x ➖ · cold 0.928x ➖
Shifts: Parquet (control) -3.6% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.930x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 575237516 / 558937197 / +2.9% 1466127410 / 1600174219 / -8.4% 0.39 / 0.35 / +12.3%
tpch_q02/datafusion:vortex-compact 555053024 / 540661591 / +2.7% 1350235368 / 1218798766 / +10.8% 0.41 / 0.44 / -7.3%
tpch_q03/datafusion:vortex-compact 434319288 / 451946893 / -3.9% 1825794224 / 1904365601 / -4.1% 0.24 / 0.24 / +0.2%
tpch_q04/datafusion:vortex-compact 243582018 / 287444806 / -15.3% 619906874 / 823818598 / -24.8% 0.39 / 0.35 / +12.6%
tpch_q05/datafusion:vortex-compact 650020699 / 625897328 / +3.9% 1024880950 / 938123828 / +9.2% 0.63 / 0.67 / -4.9%
tpch_q06/datafusion:vortex-compact 261630770 / 359378630 / -27.2% 493440164 / 515146901 / -4.2% 0.53 / 0.70 / -24.0%
tpch_q07/datafusion:vortex-compact 646479719 / 661270645 / -2.2% 841601886 / 869898981 / -3.3% 0.77 / 0.76 / +1.1%
tpch_q08/datafusion:vortex-compact 802972736 / 828565443 / -3.1% 976387455 / 1293738624 / -24.5% 0.82 / 0.64 / +28.4%
tpch_q09/datafusion:vortex-compact 856746905 / 881644327 / -2.8% 1303420510 / 1163320944 / +12.0% 0.66 / 0.76 / -13.3%
tpch_q10/datafusion:vortex-compact 595706238 / 610824498 / -2.5% 1022879957 / 899622529 / +13.7% 0.58 / 0.68 / -14.2%
tpch_q11/datafusion:vortex-compact 363428439 / 328069930 / +10.8% 830112253 / 791020074 / +4.9% 0.44 / 0.41 / +5.6%
tpch_q12/datafusion:vortex-compact 520779551 / 697084088 / -25.3% 1064319444 / 963616281 / +10.5% 0.49 / 0.72 / -32.4%
tpch_q13/datafusion:vortex-compact 249211565 / 250197994 / -0.4% 796405769 / 824142659 / -3.4% 0.31 / 0.30 / +3.1%
tpch_q14/datafusion:vortex-compact 507143944 / 248811725 / +103.8% 🔴 562371050 / 487960257 / +15.2% 0.90 / 0.51 / +76.9%
tpch_q15/datafusion:vortex-compact 580357908 / 502188980 / +15.6% 984302716 / 682878562 / +44.1% 🔴 0.59 / 0.74 / -19.8%
tpch_q16/datafusion:vortex-compact 286696140 / 283219102 / +1.2% 465703133 / 460995910 / +1.0% 0.62 / 0.61 / +0.2%
tpch_q17/datafusion:vortex-compact 701759231 / 2324190534 / -69.8% 🟢 866808943 / 1649618073 / -47.5% 🟢 0.81 / 1.41 / -42.5%
tpch_q18/datafusion:vortex-compact 850672926 / 1006753327 / -15.5% 1099945880 / 1658698948 / -33.7% 🟢 0.77 / 0.61 / +27.4%
tpch_q19/datafusion:vortex-compact 550767275 / 491195222 / +12.1% 652126142 / 703022396 / -7.2% 0.84 / 0.70 / +20.9%
tpch_q20/datafusion:vortex-compact 569255375 / 787034873 / -27.7% 817694425 / 757806673 / +7.9% 0.70 / 1.04 / -33.0%
tpch_q21/datafusion:vortex-compact 908722183 / 953393100 / -4.7% 1188979644 / 1461217559 / -18.6% 0.76 / 0.65 / +17.1%
tpch_q22/datafusion:vortex-compact 280913040 / 314882267 / -10.8% 555792260 / 734574814 / -24.3% 0.51 / 0.43 / +17.9%
datafusion / parquet / ns (0.974x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 417106375 / 416784227 / +0.1% 801285460 / 1106275999 / -27.6% 0.52 / 0.38 / +38.2%
tpch_q02/datafusion:parquet 623926976 / 689370939 / -9.5% 1177086257 / 1191485451 / -1.2% 0.53 / 0.58 / -8.4%
tpch_q03/datafusion:parquet 600059696 / 571242279 / +5.0% 1122423225 / 1261452256 / -11.0% 0.53 / 0.45 / +18.1%
tpch_q04/datafusion:parquet 415973436 / 341082153 / +22.0% 558191946 / 590312721 / -5.4% 0.75 / 0.58 / +29.0%
tpch_q05/datafusion:parquet 760351518 / 748305913 / +1.6% 1228077289 / 1070435042 / +14.7% 0.62 / 0.70 / -11.4%
tpch_q06/datafusion:parquet 226040933 / 362564249 / -37.7% 🟢 388972935 / 588331026 / -33.9% 🟢 0.58 / 0.62 / -5.7%
tpch_q07/datafusion:parquet 842264992 / 3249353681 / -74.1% 🟢 1119883641 / 2974888720 / -62.4% 🟢 0.75 / 1.09 / -31.1%
tpch_q08/datafusion:parquet 1098437353 / 994564318 / +10.4% 1372813334 / 1456186241 / -5.7% 0.80 / 0.68 / +17.2%
tpch_q09/datafusion:parquet 1199125668 / 1682629082 / -28.7% 1514616750 / 1658210266 / -8.7% 0.79 / 1.01 / -22.0%
tpch_q10/datafusion:parquet 1681996266 / 1799222770 / -6.5% 2444038648 / 3016828747 / -19.0% 0.69 / 0.60 / +15.4%
tpch_q11/datafusion:parquet 470911554 / 465416881 / +1.2% 857972157 / 746076743 / +15.0% 0.55 / 0.62 / -12.0%
tpch_q12/datafusion:parquet 1601198024 / 455426064 / +251.6% 🔴 1425433418 / 742009703 / +92.1% 🔴 1.12 / 0.61 / +83.0%
tpch_q13/datafusion:parquet 628368842 / 616732340 / +1.9% 1192399108 / 1154787005 / +3.3% 0.53 / 0.53 / -1.3%
tpch_q14/datafusion:parquet 633850723 / 453307294 / +39.8% 🔴 1430653627 / 576264224 / +148.3% 🔴 0.44 / 0.79 / -43.7%
tpch_q15/datafusion:parquet 557740488 / 667679383 / -16.5% 707943869 / 864496583 / -18.1% 0.79 / 0.77 / +2.0%
tpch_q16/datafusion:parquet 275062730 / 312790331 / -12.1% 475137519 / 577340686 / -17.7% 0.58 / 0.54 / +6.9%
tpch_q17/datafusion:parquet 794446476 / 782532716 / +1.5% 914142855 / 969285090 / -5.7% 0.87 / 0.81 / +7.6%
tpch_q18/datafusion:parquet 1264951411 / 1147922153 / +10.2% 1455778571 / 1533230877 / -5.1% 0.87 / 0.75 / +16.1%
tpch_q19/datafusion:parquet 532521787 / 489226703 / +8.8% 818759970 / 639239957 / +28.1% 0.65 / 0.77 / -15.0%
tpch_q20/datafusion:parquet 793666862 / 788928296 / +0.6% 980140631 / 1040279909 / -5.8% 0.81 / 0.76 / +6.8%
tpch_q21/datafusion:parquet 1286141486 / 1442988165 / -10.9% 1884431314 / 1511224691 / +24.7% 0.68 / 0.95 / -28.5%
tpch_q22/datafusion:parquet 679030590 / 684091936 / -0.7% 996782453 / 1178474281 / -15.4% 0.68 / 0.58 / +17.4%
duckdb / vortex-compact / ns (1.027x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 800728266 / 863081683 / -7.2% 1220751272 / 1908382093 / -36.0% 🟢 0.66 / 0.45 / +45.0%
tpch_q02/duckdb:vortex-compact 494624143 / 519304996 / -4.8% 645512687 / 920413181 / -29.9% 0.77 / 0.56 / +35.8%
tpch_q03/duckdb:vortex-compact 945071414 / 1119668550 / -15.6% 1263724790 / 2091752081 / -39.6% 🟢 0.75 / 0.54 / +39.7%
tpch_q04/duckdb:vortex-compact 745076523 / 700500491 / +6.4% 927809150 / 973429778 / -4.7% 0.80 / 0.72 / +11.6%
tpch_q05/duckdb:vortex-compact 1069799055 / 944949332 / +13.2% 1284796803 / 1221131811 / +5.2% 0.83 / 0.77 / +7.6%
tpch_q06/duckdb:vortex-compact 973807564 / 975484577 / -0.2% 976913604 / 955934700 / +2.2% 1.00 / 1.02 / -2.3%
tpch_q07/duckdb:vortex-compact 1349784058 / 1248350194 / +8.1% 1305775045 / 1496724404 / -12.8% 1.03 / 0.83 / +23.9%
tpch_q08/duckdb:vortex-compact 1280443455 / 1212895510 / +5.6% 1361236172 / 1505000882 / -9.6% 0.94 / 0.81 / +16.7%
tpch_q09/duckdb:vortex-compact 1549993737 / 1610824993 / -3.8% 1741223758 / 1903318019 / -8.5% 0.89 / 0.85 / +5.2%
tpch_q10/duckdb:vortex-compact 1341387753 / 1273329400 / +5.3% 1666690474 / 1745428692 / -4.5% 0.80 / 0.73 / +10.3%
tpch_q11/duckdb:vortex-compact 354803644 / 341019922 / +4.0% 585590903 / 622451831 / -5.9% 0.61 / 0.55 / +10.6%
tpch_q12/duckdb:vortex-compact 1735392555 / 1572227399 / +10.4% 1809350512 / 1999841084 / -9.5% 0.96 / 0.79 / +22.0%
tpch_q13/duckdb:vortex-compact 849989532 / 850238270 / -0.0% 1341352952 / 1704692992 / -21.3% 0.63 / 0.50 / +27.1%
tpch_q14/duckdb:vortex-compact 725282148 / 655212012 / +10.7% 828017248 / 762887346 / +8.5% 0.88 / 0.86 / +2.0%
tpch_q15/duckdb:vortex-compact 698640292 / 799155542 / -12.6% 755413157 / 782169927 / -3.4% 0.92 / 1.02 / -9.5%
tpch_q16/duckdb:vortex-compact 286940510 / 272477943 / +5.3% 368943131 / 351770895 / +4.9% 0.78 / 0.77 / +0.4%
tpch_q17/duckdb:vortex-compact 1269047890 / 1167385227 / +8.7% 1320594433 / 1227369952 / +7.6% 0.96 / 0.95 / +1.0%
tpch_q18/duckdb:vortex-compact 1094365951 / 939370127 / +16.5% 1054725992 / 1060320238 / -0.5% 1.04 / 0.89 / +17.1%
tpch_q19/duckdb:vortex-compact 1022297215 / 1001536860 / +2.1% 1200662301 / 1448283018 / -17.1% 0.85 / 0.69 / +23.1%
tpch_q20/duckdb:vortex-compact 1446007813 / 1375109100 / +5.2% 1669177303 / 1579966514 / +5.6% 0.87 / 0.87 / -0.5%
tpch_q21/duckdb:vortex-compact 2188467159 / 2098443765 / +4.3% 2074335556 / 2135492867 / -2.9% 1.06 / 0.98 / +7.4%
tpch_q22/duckdb:vortex-compact 268410226 / 258390575 / +3.9% 380495557 / 411502635 / -7.5% 0.71 / 0.63 / +12.3%
duckdb / parquet / ns (0.954x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 395927588 / 609154351 / -35.0% 🟢 427167095 / 1560018360 / -72.6% 🟢 0.93 / 0.39 / +137.4%
tpch_q02/duckdb:parquet 824161463 / 841634565 / -2.1% 996507810 / 1933976442 / -48.5% 🟢 0.83 / 0.44 / +90.0%
tpch_q03/duckdb:parquet 1167008203 / 1006010051 / +16.0% 2194801764 / 2180741799 / +0.6% 0.53 / 0.46 / +15.3%
tpch_q04/duckdb:parquet 667930853 / 690667859 / -3.3% 749732866 / 1249965631 / -40.0% 🟢 0.89 / 0.55 / +61.2%
tpch_q05/duckdb:parquet 1175907109 / 1183831989 / -0.7% 1306126070 / 1522883148 / -14.2% 0.90 / 0.78 / +15.8%
tpch_q06/duckdb:parquet 378275388 / 356903001 / +6.0% 656828559 / 447885026 / +46.7% 🔴 0.58 / 0.80 / -27.7%
tpch_q07/duckdb:parquet 978773822 / 1034952456 / -5.4% 1240963041 / 1512660609 / -18.0% 0.79 / 0.68 / +15.3%
tpch_q08/duckdb:parquet 1385686291 / 1387199211 / -0.1% 1912113642 / 1736847040 / +10.1% 0.72 / 0.80 / -9.3%
tpch_q09/duckdb:parquet 1438354078 / 1334891798 / +7.8% 1575558990 / 1482123836 / +6.3% 0.91 / 0.90 / +1.4%
tpch_q10/duckdb:parquet 2405823763 / 2564793705 / -6.2% 3872718098 / 3390008123 / +14.2% 0.62 / 0.76 / -17.9%
tpch_q11/duckdb:parquet 494337117 / 492498429 / +0.4% 514313416 / 536932096 / -4.2% 0.96 / 0.92 / +4.8%
tpch_q12/duckdb:parquet 639389666 / 713855563 / -10.4% 896843641 / 809828819 / +10.7% 0.71 / 0.88 / -19.1%
tpch_q13/duckdb:parquet 993673674 / 970987289 / +2.3% 1315291030 / 1524697462 / -13.7% 0.76 / 0.64 / +18.6%
tpch_q14/duckdb:parquet 762689119 / 743728419 / +2.5% 785477693 / 828709264 / -5.2% 0.97 / 0.90 / +8.2%
tpch_q15/duckdb:parquet 471037900 / 498477246 / -5.5% 487084663 / 647755880 / -24.8% 0.97 / 0.77 / +25.7%
tpch_q16/duckdb:parquet 682713147 / 719449833 / -5.1% 621670511 / 653846364 / -4.9% 1.10 / 1.10 / -0.2%
tpch_q17/duckdb:parquet 651115223 / 780436014 / -16.6% 776958439 / 1100857013 / -29.4% 0.84 / 0.71 / +18.2%
tpch_q18/duckdb:parquet 916352905 / 907607002 / +1.0% 1348932630 / 1148593717 / +17.4% 0.68 / 0.79 / -14.0%
tpch_q19/duckdb:parquet 825679296 / 891667931 / -7.4% 852073701 / 877732418 / -2.9% 0.97 / 1.02 / -4.6%
tpch_q20/duckdb:parquet 1183267589 / 1265920495 / -6.5% 1385321576 / 1592835025 / -13.0% 0.85 / 0.79 / +7.5%
tpch_q21/duckdb:parquet 1038216572 / 1306744763 / -20.5% 2154759976 / 1729622233 / +24.6% 0.48 / 0.76 / -36.2%
tpch_q22/duckdb:parquet 921257038 / 914549193 / +0.7% 1163598286 / 1017718954 / +14.3% 0.79 / 0.90 / -11.9%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR ee07a98a vs base 479bd98a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -5.3%
Engines: DataFusion No clear signal (-9.1%, environment too noisy confidence) · DuckDB No clear signal (-1.3%, environment too noisy confidence)
Vortex (geomean): hot 1.022x ➖ · cold 1.018x ➖
Parquet (geomean): hot 1.079x ➖ · cold 1.087x ➖
Shifts: Parquet (control) +7.9% · Median polish +1.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.991x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 287056679 / 235403315 / +21.9% 913105680 / 719028562 / +27.0% 0.31 / 0.33 / -4.0%
tpch_q02/datafusion:vortex-file-compressed 498635215 / 451909566 / +10.3% 921695332 / 789772842 / +16.7% 0.54 / 0.57 / -5.5%
tpch_q03/datafusion:vortex-file-compressed 348486163 / 331211968 / +5.2% 1095945432 / 1135119139 / -3.5% 0.32 / 0.29 / +9.0%
tpch_q04/datafusion:vortex-file-compressed 201508314 / 189365660 / +6.4% 538362895 / 618724686 / -13.0% 0.37 / 0.31 / +22.3%
tpch_q05/datafusion:vortex-file-compressed 460404025 / 344777357 / +33.5% 🔴 638547814 / 598124374 / +6.8% 0.72 / 0.58 / +25.1%
tpch_q06/datafusion:vortex-file-compressed 242077921 / 277500598 / -12.8% 448232751 / 411243126 / +9.0% 0.54 / 0.67 / -20.0%
tpch_q07/datafusion:vortex-file-compressed 397143560 / 510241590 / -22.2% 525081232 / 563409574 / -6.8% 0.76 / 0.91 / -16.5%
tpch_q08/datafusion:vortex-file-compressed 552402960 / 433738248 / +27.4% 847090339 / 631742220 / +34.1% 🔴 0.65 / 0.69 / -5.0%
tpch_q09/datafusion:vortex-file-compressed 574827802 / 4080659180 / -85.9% 🟢 798082602 / 1359055627 / -41.3% 🟢 0.72 / 3.00 / -76.0%
tpch_q10/datafusion:vortex-file-compressed 366410779 / 335414906 / +9.2% 513166072 / 531137807 / -3.4% 0.71 / 0.63 / +13.1%
tpch_q11/datafusion:vortex-file-compressed 292512055 / 294214790 / -0.6% 469483143 / 425284734 / +10.4% 0.62 / 0.69 / -9.9%
tpch_q12/datafusion:vortex-file-compressed 330087591 / 309370738 / +6.7% 946406033 / 538636904 / +75.7% 🔴 0.35 / 0.57 / -39.3%
tpch_q13/datafusion:vortex-file-compressed 114942188 / 95622098 / +20.2% 469162042 / 364434036 / +28.7% 0.24 / 0.26 / -6.6%
tpch_q14/datafusion:vortex-file-compressed 214229603 / 196415421 / +9.1% 345332216 / 349693461 / -1.2% 0.62 / 0.56 / +10.4%
tpch_q15/datafusion:vortex-file-compressed 324560723 / 299374222 / +8.4% 496645210 / 509007809 / -2.4% 0.65 / 0.59 / +11.1%
tpch_q16/datafusion:vortex-file-compressed 243251713 / 239885974 / +1.4% 396372814 / 394209942 / +0.5% 0.61 / 0.61 / +0.8%
tpch_q17/datafusion:vortex-file-compressed 345080824 / 519764561 / -33.6% 🟢 538110909 / 773935096 / -30.5% 🟢 0.64 / 0.67 / -4.5%
tpch_q18/datafusion:vortex-file-compressed 266010147 / 217910076 / +22.1% 586655517 / 423545958 / +38.5% 🔴 0.45 / 0.51 / -11.9%
tpch_q19/datafusion:vortex-file-compressed 462596128 / 329183571 / +40.5% 🔴 550686245 / 490543631 / +12.3% 0.84 / 0.67 / +25.2%
tpch_q20/datafusion:vortex-file-compressed 367678719 / 332227837 / +10.7% 503370292 / 483071408 / +4.2% 0.73 / 0.69 / +6.2%
tpch_q21/datafusion:vortex-file-compressed 582717024 / 419367953 / +39.0% 🔴 702327529 / 629758524 / +11.5% 0.83 / 0.67 / +24.6%
tpch_q22/datafusion:vortex-file-compressed 189547116 / 164769419 / +15.0% 363310385 / 386507234 / -6.0% 0.52 / 0.43 / +22.4%
datafusion / vortex-compact / ns (1.039x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 259299248 / 249469939 / +3.9% 748765396 / 780287803 / -4.0% 0.35 / 0.32 / +8.3%
tpch_q02/datafusion:vortex-compact 523955489 / 428116023 / +22.4% 727116253 / 1181253470 / -38.4% 🟢 0.72 / 0.36 / +98.8%
tpch_q03/datafusion:vortex-compact 324974803 / 333154209 / -2.5% 763624983 / 819897786 / -6.9% 0.43 / 0.41 / +4.7%
tpch_q04/datafusion:vortex-compact 162269002 / 196535429 / -17.4% 411475449 / 429946780 / -4.3% 0.39 / 0.46 / -13.7%
tpch_q05/datafusion:vortex-compact 337892398 / 425192329 / -20.5% 741388964 / 577590535 / +28.4% 0.46 / 0.74 / -38.1%
tpch_q06/datafusion:vortex-compact 287597257 / 262955731 / +9.4% 426417999 / 445951986 / -4.4% 0.67 / 0.59 / +14.4%
tpch_q07/datafusion:vortex-compact 434378412 / 356645576 / +21.8% 535830960 / 543535710 / -1.4% 0.81 / 0.66 / +23.5%
tpch_q08/datafusion:vortex-compact 507761445 / 703202917 / -27.8% 902855901 / 728293964 / +24.0% 0.56 / 0.97 / -41.8%
tpch_q09/datafusion:vortex-compact 312609824 / 359182295 / -13.0% 522601348 / 860999842 / -39.3% 🟢 0.60 / 0.42 / +43.4%
tpch_q10/datafusion:vortex-compact 334155702 / 337537373 / -1.0% 545056889 / 555312889 / -1.8% 0.61 / 0.61 / +0.9%
tpch_q11/datafusion:vortex-compact 276731286 / 325074950 / -14.9% 478011230 / 476997232 / +0.2% 0.58 / 0.68 / -15.1%
tpch_q12/datafusion:vortex-compact 356140862 / 299427108 / +18.9% 627805526 / 590911452 / +6.2% 0.57 / 0.51 / +12.0%
tpch_q13/datafusion:vortex-compact 104538152 / 194497563 / -46.3% 🟢 322610390 / 475121340 / -32.1% 🟢 0.32 / 0.41 / -20.8%
tpch_q14/datafusion:vortex-compact 188140041 / 164010083 / +14.7% 343992470 / 349021748 / -1.4% 0.55 / 0.47 / +16.4%
tpch_q15/datafusion:vortex-compact 300292469 / 311613782 / -3.6% 582433057 / 534077829 / +9.1% 0.52 / 0.58 / -11.6%
tpch_q16/datafusion:vortex-compact 201304087 / 193874255 / +3.8% 387256851 / 402372589 / -3.8% 0.52 / 0.48 / +7.9%
tpch_q17/datafusion:vortex-compact 1040694241 / 278020025 / +274.3% 🔴 1058684048 / 458634160 / +130.8% 🔴 0.98 / 0.61 / +62.2%
tpch_q18/datafusion:vortex-compact 317363109 / 225960010 / +40.5% 🔴 596038798 / 466279452 / +27.8% 0.53 / 0.48 / +9.9%
tpch_q19/datafusion:vortex-compact 476889429 / 438313268 / +8.8% 681974112 / 632836966 / +7.8% 0.70 / 0.69 / +1.0%
tpch_q20/datafusion:vortex-compact 343191884 / 324922138 / +5.6% 510088379 / 493102765 / +3.4% 0.67 / 0.66 / +2.1%
tpch_q21/datafusion:vortex-compact 443511125 / 471704427 / -6.0% 649506514 / 703433495 / -7.7% 0.68 / 0.67 / +1.8%
tpch_q22/datafusion:vortex-compact 142293267 / 147888719 / -3.8% 440113522 / 397204993 / +10.8% 0.32 / 0.37 / -13.2%
datafusion / parquet / ns (1.117x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 222085237 / 212477515 / +4.5% 661191730 / 611485792 / +8.1% 0.34 / 0.35 / -3.3%
tpch_q02/datafusion:parquet 313203702 / 316925239 / -1.2% 817236977 / 581439543 / +40.6% 🔴 0.38 / 0.55 / -29.7%
tpch_q03/datafusion:parquet 324344250 / 305025635 / +6.3% 1042494087 / 644250447 / +61.8% 🔴 0.31 / 0.47 / -34.3%
tpch_q04/datafusion:parquet 201757775 / 179756237 / +12.2% 466010207 / 379005297 / +23.0% 0.43 / 0.47 / -8.7%
tpch_q05/datafusion:parquet 387554072 / 409795102 / -5.4% 511817652 / 518676556 / -1.3% 0.76 / 0.79 / -4.2%
tpch_q06/datafusion:parquet 140152923 / 141611207 / -1.0% 334645624 / 278166339 / +20.3% 0.42 / 0.51 / -17.7%
tpch_q07/datafusion:parquet 391714286 / 360702611 / +8.6% 614534646 / 534733963 / +14.9% 0.64 / 0.67 / -5.5%
tpch_q08/datafusion:parquet 618139135 / 440625631 / +40.3% 🔴 643100261 / 529051837 / +21.6% 0.96 / 0.83 / +15.4%
tpch_q09/datafusion:parquet 599572645 / 443120865 / +35.3% 🔴 751906126 / 692171169 / +8.6% 0.80 / 0.64 / +24.6%
tpch_q10/datafusion:parquet 439069864 / 437400918 / +0.4% 566508086 / 567795767 / -0.2% 0.78 / 0.77 / +0.6%
tpch_q11/datafusion:parquet 275344351 / 268019991 / +2.7% 524598193 / 440905483 / +19.0% 0.52 / 0.61 / -13.7%
tpch_q12/datafusion:parquet 244347205 / 197147076 / +23.9% 504056930 / 474244556 / +6.3% 0.48 / 0.42 / +16.6%
tpch_q13/datafusion:parquet 447869669 / 448163285 / -0.1% 611836306 / 666112893 / -8.1% 0.73 / 0.67 / +8.8%
tpch_q14/datafusion:parquet 222751077 / 179856264 / +23.8% 363384168 / 365580148 / -0.6% 0.61 / 0.49 / +24.6%
tpch_q15/datafusion:parquet 311534152 / 313877907 / -0.7% 534754364 / 523895415 / +2.1% 0.58 / 0.60 / -2.8%
tpch_q16/datafusion:parquet 148538019 / 123247983 / +20.5% 342729800 / 392048834 / -12.6% 0.43 / 0.31 / +37.9%
tpch_q17/datafusion:parquet 373349158 / 304756354 / +22.5% 661404451 / 437721294 / +51.1% 🔴 0.56 / 0.70 / -18.9%
tpch_q18/datafusion:parquet 487997284 / 432600368 / +12.8% 629709758 / 594022921 / +6.0% 0.77 / 0.73 / +6.4%
tpch_q19/datafusion:parquet 246390442 / 177645501 / +38.7% 🔴 367749608 / 320318953 / +14.8% 0.67 / 0.55 / +20.8%
tpch_q20/datafusion:parquet 303648626 / 304055654 / -0.1% 539749495 / 629447620 / -14.3% 0.56 / 0.48 / +16.5%
tpch_q21/datafusion:parquet 515762596 / 445039232 / +15.9% 693184377 / 560753842 / +23.6% 0.74 / 0.79 / -6.2%
tpch_q22/datafusion:parquet 197500980 / 173436921 / +13.9% 482707557 / 337185221 / +43.2% 🔴 0.41 / 0.51 / -20.5%
duckdb / vortex-file-compressed / ns (1.090x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 223304673 / 203876595 / +9.5% 354772945 / 267925758 / +32.4% 🔴 0.63 / 0.76 / -17.3%
tpch_q02/duckdb:vortex-file-compressed 457894013 / 407195312 / +12.5% 982486453 / 479839768 / +104.8% 🔴 0.47 / 0.85 / -45.1%
tpch_q03/duckdb:vortex-file-compressed 765614896 / 448470961 / +70.7% 🔴 801235083 / 876273426 / -8.6% 0.96 / 0.51 / +86.7%
tpch_q04/duckdb:vortex-file-compressed 281215537 / 313616118 / -10.3% 468502882 / 348344036 / +34.5% 🔴 0.60 / 0.90 / -33.3%
tpch_q05/duckdb:vortex-file-compressed 394947412 / 426094189 / -7.3% 899392652 / 448891031 / +100.4% 🔴 0.44 / 0.95 / -53.7%
tpch_q06/duckdb:vortex-file-compressed 266584517 / 256296262 / +4.0% 329166248 / 318388784 / +3.4% 0.81 / 0.80 / +0.6%
tpch_q07/duckdb:vortex-file-compressed 440153517 / 441810204 / -0.4% 566572587 / 495198523 / +14.4% 0.78 / 0.89 / -12.9%
tpch_q08/duckdb:vortex-file-compressed 555145885 / 541793719 / +2.5% 1022963275 / 707422582 / +44.6% 🔴 0.54 / 0.77 / -29.1%
tpch_q09/duckdb:vortex-file-compressed 671475073 / 490225974 / +37.0% 🔴 594843343 / 740262910 / -19.6% 1.13 / 0.66 / +70.5%
tpch_q10/duckdb:vortex-file-compressed 426480273 / 523004665 / -18.5% 471379762 / 608956575 / -22.6% 0.90 / 0.86 / +5.3%
tpch_q11/duckdb:vortex-file-compressed 141713455 / 143093546 / -1.0% 170517928 / 197094035 / -13.5% 0.83 / 0.73 / +14.5%
tpch_q12/duckdb:vortex-file-compressed 691628977 / 463644179 / +49.2% 🔴 674883758 / 470629982 / +43.4% 🔴 1.02 / 0.99 / +4.0%
tpch_q13/duckdb:vortex-file-compressed 326567868 / 302974251 / +7.8% 369944693 / 404817545 / -8.6% 0.88 / 0.75 / +17.9%
tpch_q14/duckdb:vortex-file-compressed 246160324 / 232774556 / +5.8% 324915822 / 498753384 / -34.9% 🟢 0.76 / 0.47 / +62.3%
tpch_q15/duckdb:vortex-file-compressed 145966221 / 152315302 / -4.2% 199186567 / 231834081 / -14.1% 0.73 / 0.66 / +11.5%
tpch_q16/duckdb:vortex-file-compressed 202032817 / 198143323 / +2.0% 226561787 / 230821632 / -1.8% 0.89 / 0.86 / +3.9%
tpch_q17/duckdb:vortex-file-compressed 429704775 / 384713707 / +11.7% 458543755 / 469400949 / -2.3% 0.94 / 0.82 / +14.3%
tpch_q18/duckdb:vortex-file-compressed 312043580 / 304568219 / +2.5% 366861776 / 384800003 / -4.7% 0.85 / 0.79 / +7.5%
tpch_q19/duckdb:vortex-file-compressed 378669120 / 341579180 / +10.9% 432652101 / 428637078 / +0.9% 0.88 / 0.80 / +9.8%
tpch_q20/duckdb:vortex-file-compressed 434262141 / 433244519 / +0.2% 546744020 / 553712572 / -1.3% 0.79 / 0.78 / +1.5%
tpch_q21/duckdb:vortex-file-compressed 938531277 / 643126068 / +45.9% 🔴 748281572 / 821706091 / -8.9% 1.25 / 0.78 / +60.3%
tpch_q22/duckdb:vortex-file-compressed 126588972 / 121049628 / +4.6% 230198177 / 167264144 / +37.6% 🔴 0.55 / 0.72 / -24.0%
duckdb / vortex-compact / ns (0.970x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 222968309 / 232815151 / -4.2% 435850119 / 511796886 / -14.8% 0.51 / 0.45 / +12.5%
tpch_q02/duckdb:vortex-compact 370509248 / 384274618 / -3.6% 434974035 / 415811560 / +4.6% 0.85 / 0.92 / -7.8%
tpch_q03/duckdb:vortex-compact 408673653 / 452762127 / -9.7% 635632114 / 782707910 / -18.8% 0.64 / 0.58 / +11.1%
tpch_q04/duckdb:vortex-compact 250619686 / 344383786 / -27.2% 441115980 / 355394392 / +24.1% 0.57 / 0.97 / -41.4%
tpch_q05/duckdb:vortex-compact 574323306 / 405823180 / +41.5% 🔴 647978884 / 814529354 / -20.4% 0.89 / 0.50 / +77.9%
tpch_q06/duckdb:vortex-compact 294752098 / 263607622 / +11.8% 297695478 / 326757463 / -8.9% 0.99 / 0.81 / +22.7%
tpch_q07/duckdb:vortex-compact 428924945 / 432681960 / -0.9% 473769601 / 498469489 / -5.0% 0.91 / 0.87 / +4.3%
tpch_q08/duckdb:vortex-compact 572283563 / 535260197 / +6.9% 710023504 / 604099064 / +17.5% 0.81 / 0.89 / -9.0%
tpch_q09/duckdb:vortex-compact 489115075 / 470545933 / +3.9% 496716518 / 539025005 / -7.8% 0.98 / 0.87 / +12.8%
tpch_q10/duckdb:vortex-compact 434206360 / 531530659 / -18.3% 554069915 / 498876845 / +11.1% 0.78 / 1.07 / -26.4%
tpch_q11/duckdb:vortex-compact 159148968 / 151898387 / +4.8% 174109306 / 166534106 / +4.5% 0.91 / 0.91 / +0.2%
tpch_q12/duckdb:vortex-compact 474898871 / 451790335 / +5.1% 613081132 / 559675883 / +9.5% 0.77 / 0.81 / -4.0%
tpch_q13/duckdb:vortex-compact 269430155 / 454223216 / -40.7% 🟢 315471533 / 362307309 / -12.9% 0.85 / 1.25 / -31.9%
tpch_q14/duckdb:vortex-compact 222738257 / 258555038 / -13.9% 322269176 / 361623366 / -10.9% 0.69 / 0.71 / -3.3%
tpch_q15/duckdb:vortex-compact 157364957 / 154781312 / +1.7% 208793257 / 255526941 / -18.3% 0.75 / 0.61 / +24.4%
tpch_q16/duckdb:vortex-compact 193517425 / 195779519 / -1.2% 228965019 / 411719226 / -44.4% 🟢 0.85 / 0.48 / +77.7%
tpch_q17/duckdb:vortex-compact 389636651 / 532449530 / -26.8% 548308643 / 553093040 / -0.9% 0.71 / 0.96 / -26.2%
tpch_q18/duckdb:vortex-compact 359569942 / 304978683 / +17.9% 386623579 / 387546638 / -0.2% 0.93 / 0.79 / +18.2%
tpch_q19/duckdb:vortex-compact 358008766 / 357660496 / +0.1% 449980999 / 465598304 / -3.4% 0.80 / 0.77 / +3.6%
tpch_q20/duckdb:vortex-compact 434463371 / 450342548 / -3.5% 500790048 / 526951216 / -5.0% 0.87 / 0.85 / +1.5%
tpch_q21/duckdb:vortex-compact 672775902 / 599980391 / +12.1% 678507420 / 732603432 / -7.4% 0.99 / 0.82 / +21.1%
tpch_q22/duckdb:vortex-compact 159773586 / 140952405 / +13.4% 200284174 / 186551021 / +7.4% 0.80 / 0.76 / +5.6%
duckdb / parquet / ns (1.042x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 400064008 / 327794243 / +22.0% 513599628 / 365906925 / +40.4% 🔴 0.78 / 0.90 / -13.0%
tpch_q02/duckdb:parquet 712494280 / 720321397 / -1.1% 856866503 / 737470385 / +16.2% 0.83 / 0.98 / -14.9%
tpch_q03/duckdb:parquet 876613217 / 839142879 / +4.5% 1011557253 / 949908781 / +6.5% 0.87 / 0.88 / -1.9%
tpch_q04/duckdb:parquet 571756550 / 514034023 / +11.2% 496767101 / 642878764 / -22.7% 1.15 / 0.80 / +43.9%
tpch_q05/duckdb:parquet 1045592147 / 1031299691 / +1.4% 1005490263 / 1176574716 / -14.5% 1.04 / 0.88 / +18.6%
tpch_q06/duckdb:parquet 355590525 / 363591140 / -2.2% 334227313 / 325493990 / +2.7% 1.06 / 1.12 / -4.8%
tpch_q07/duckdb:parquet 954908740 / 984158535 / -3.0% 1363744866 / 999701388 / +36.4% 🔴 0.70 / 0.98 / -28.9%
tpch_q08/duckdb:parquet 1247862748 / 1258492255 / -0.8% 1315176939 / 1106800640 / +18.8% 0.95 / 1.14 / -16.6%
tpch_q09/duckdb:parquet 1179248235 / 1122685457 / +5.0% 1144604786 / 1139198881 / +0.5% 1.03 / 0.99 / +4.5%
tpch_q10/duckdb:parquet 1120874053 / 1054507685 / +6.3% 1123183321 / 1137440418 / -1.3% 1.00 / 0.93 / +7.6%
tpch_q11/duckdb:parquet 510161376 / 486543912 / +4.9% 526612272 / 482193379 / +9.2% 0.97 / 1.01 / -4.0%
tpch_q12/duckdb:parquet 709913233 / 600126112 / +18.3% 919432395 / 725017050 / +26.8% 0.77 / 0.83 / -6.7%
tpch_q13/duckdb:parquet 847634816 / 889987684 / -4.8% 1189513489 / 1183604782 / +0.5% 0.71 / 0.75 / -5.2%
tpch_q14/duckdb:parquet 543972373 / 620756151 / -12.4% 619124555 / 641937680 / -3.6% 0.88 / 0.97 / -9.1%
tpch_q15/duckdb:parquet 406761165 / 403495662 / +0.8% 376980225 / 440012348 / -14.3% 1.08 / 0.92 / +17.7%
tpch_q16/duckdb:parquet 594764275 / 521187942 / +14.1% 660978208 / 559811710 / +18.1% 0.90 / 0.93 / -3.3%
tpch_q17/duckdb:parquet 561099014 / 519163246 / +8.1% 565926587 / 552740348 / +2.4% 0.99 / 0.94 / +5.6%
tpch_q18/duckdb:parquet 785739046 / 738297724 / +6.4% 698303348 / 694706467 / +0.5% 1.13 / 1.06 / +5.9%
tpch_q19/duckdb:parquet 670821942 / 634080419 / +5.8% 732199147 / 852708097 / -14.1% 0.92 / 0.74 / +23.2%
tpch_q20/duckdb:parquet 931012658 / 906669452 / +2.7% 927076390 / 867659052 / +6.8% 1.00 / 1.04 / -3.9%
tpch_q21/duckdb:parquet 845072217 / 826892261 / +2.2% 809778408 / 763602183 / +6.0% 1.04 / 1.08 / -3.6%
tpch_q22/duckdb:parquet 497520382 / 459509430 / +8.3% 454818177 / 471295384 / -3.5% 1.09 / 0.97 / +12.2%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR ee07a98a vs base 479bd98a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+0.4%, environment too noisy confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 1.003x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.009x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 43348786 / 42932696 / +1.0% 101576364 / 97156005 / +4.5% 0.43 / 0.44 / -3.4%
tpch_q02/datafusion:vortex-file-compressed 24509539 / 24649116 / -0.6% 68458091 / 67542406 / +1.4% 0.36 / 0.36 / -1.9%
tpch_q03/datafusion:vortex-file-compressed 30625883 / 29535124 / +3.7% 90040359 / 91841164 / -2.0% 0.34 / 0.32 / +5.8%
tpch_q04/datafusion:vortex-file-compressed 15706578 / 16220376 / -3.2% 62375735 / 61450769 / +1.5% 0.25 / 0.26 / -4.6%
tpch_q05/datafusion:vortex-file-compressed 49932720 / 50510930 / -1.1% 116973773 / 117453969 / -0.4% 0.43 / 0.43 / -0.7%
tpch_q06/datafusion:vortex-file-compressed 8549567 / 8169309 / +4.7% 52968283 / 54213772 / -2.3% 0.16 / 0.15 / +7.1%
tpch_q07/datafusion:vortex-file-compressed 54653919 / 54748664 / -0.2% 121986612 / 123420555 / -1.2% 0.45 / 0.44 / +1.0%
tpch_q08/datafusion:vortex-file-compressed 45437963 / 45432711 / +0.0% 109909006 / 111625951 / -1.5% 0.41 / 0.41 / +1.6%
tpch_q09/datafusion:vortex-file-compressed 55071465 / 55506037 / -0.8% 127314392 / 130161652 / -2.2% 0.43 / 0.43 / +1.4%
tpch_q10/datafusion:vortex-file-compressed 29565262 / 29225091 / +1.2% 93319944 / 101125504 / -7.7% 0.32 / 0.29 / +9.6%
tpch_q11/datafusion:vortex-file-compressed 17601381 / 17875087 / -1.5% 61133099 / 58598543 / +4.3% 0.29 / 0.31 / -5.6%
tpch_q12/datafusion:vortex-file-compressed 26690928 / 26524267 / +0.6% 73960068 / 76284851 / -3.0% 0.36 / 0.35 / +3.8%
tpch_q13/datafusion:vortex-file-compressed 24408502 / 25106391 / -2.8% 72123270 / 73509282 / -1.9% 0.34 / 0.34 / -0.9%
tpch_q14/datafusion:vortex-file-compressed 16919452 / 16218220 / +4.3% 68771996 / 68935298 / -0.2% 0.25 / 0.24 / +4.6%
tpch_q15/datafusion:vortex-file-compressed 21139977 / 21131161 / +0.0% 80754935 / 75352331 / +7.2% 0.26 / 0.28 / -6.7%
tpch_q16/datafusion:vortex-file-compressed 24834548 / 24616856 / +0.9% 75253850 / 73240651 / +2.7% 0.33 / 0.34 / -1.8%
tpch_q17/datafusion:vortex-file-compressed 55187447 / 54520669 / +1.2% 118757153 / 122120552 / -2.8% 0.46 / 0.45 / +4.1%
tpch_q18/datafusion:vortex-file-compressed 67896769 / 67454026 / +0.7% 125020810 / 123651909 / +1.1% 0.54 / 0.55 / -0.4%
tpch_q19/datafusion:vortex-file-compressed 16221008 / 15852712 / +2.3% 66396087 / 66389288 / +0.0% 0.24 / 0.24 / +2.3%
tpch_q20/datafusion:vortex-file-compressed 30937502 / 31082040 / -0.5% 84690154 / 86506332 / -2.1% 0.37 / 0.36 / +1.7%
tpch_q21/datafusion:vortex-file-compressed 60395387 / 59154306 / +2.1% 137548343 / 140993322 / -2.4% 0.44 / 0.42 / +4.7%
tpch_q22/datafusion:vortex-file-compressed 12675816 / 13358102 / -5.1% 53663602 / 51113131 / +5.0% 0.24 / 0.26 / -9.6%
datafusion / vortex-compact / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 47976736 / 49377285 / -2.8% 109290260 / 113128267 / -3.4% 0.44 / 0.44 / +0.6%
tpch_q02/datafusion:vortex-compact 29338426 / 29242147 / +0.3% 70700715 / 74523061 / -5.1% 0.41 / 0.39 / +5.8%
tpch_q03/datafusion:vortex-compact 31425514 / 31537566 / -0.4% 90803077 / 84639333 / +7.3% 0.35 / 0.37 / -7.1%
tpch_q04/datafusion:vortex-compact 18962552 / 18922379 / +0.2% 65075032 / 68478028 / -5.0% 0.29 / 0.28 / +5.5%
tpch_q05/datafusion:vortex-compact 51457061 / 53468147 / -3.8% 123864780 / 117204009 / +5.7% 0.42 / 0.46 / -8.9%
tpch_q06/datafusion:vortex-compact 9689529 / 9866011 / -1.8% 54553469 / 55277755 / -1.3% 0.18 / 0.18 / -0.5%
tpch_q07/datafusion:vortex-compact 57831039 / 57903858 / -0.1% 125654067 / 125860287 / -0.2% 0.46 / 0.46 / +0.0%
tpch_q08/datafusion:vortex-compact 49219054 / 49225750 / -0.0% 112737423 / 117313025 / -3.9% 0.44 / 0.42 / +4.0%
tpch_q09/datafusion:vortex-compact 58731603 / 59188402 / -0.8% 129718252 / 125271079 / +3.6% 0.45 / 0.47 / -4.2%
tpch_q10/datafusion:vortex-compact 33901379 / 33953894 / -0.2% 98070399 / 98056616 / +0.0% 0.35 / 0.35 / -0.2%
tpch_q11/datafusion:vortex-compact 20356289 / 20387222 / -0.2% 62666309 / 60626020 / +3.4% 0.32 / 0.34 / -3.4%
tpch_q12/datafusion:vortex-compact 32372451 / 32031231 / +1.1% 80693408 / 75094792 / +7.5% 0.40 / 0.43 / -5.9%
tpch_q13/datafusion:vortex-compact 27559597 / 28021376 / -1.6% 72703267 / 73531474 / -1.1% 0.38 / 0.38 / -0.5%
tpch_q14/datafusion:vortex-compact 18053481 / 17394062 / +3.8% 74306972 / 71186692 / +4.4% 0.24 / 0.24 / -0.6%
tpch_q15/datafusion:vortex-compact 26234140 / 26138300 / +0.4% 79330880 / 82499967 / -3.8% 0.33 / 0.32 / +4.4%
tpch_q16/datafusion:vortex-compact 30239813 / 30620350 / -1.2% 79804791 / 78440391 / +1.7% 0.38 / 0.39 / -2.9%
tpch_q17/datafusion:vortex-compact 56295011 / 56153161 / +0.3% 121690154 / 120867486 / +0.7% 0.46 / 0.46 / -0.4%
tpch_q18/datafusion:vortex-compact 69784870 / 68878449 / +1.3% 127260007 / 127951850 / -0.5% 0.55 / 0.54 / +1.9%
tpch_q19/datafusion:vortex-compact 32950522 / 34097882 / -3.4% 86772675 / 84232698 / +3.0% 0.38 / 0.40 / -6.2%
tpch_q20/datafusion:vortex-compact 34066427 / 35340793 / -3.6% 87064468 / 84865596 / +2.6% 0.39 / 0.42 / -6.0%
tpch_q21/datafusion:vortex-compact 64454828 / 65203087 / -1.1% 140314472 / 140030414 / +0.2% 0.46 / 0.47 / -1.3%
tpch_q22/datafusion:vortex-compact 14905800 / 14692077 / +1.5% 58713061 / 54471395 / +7.8% 0.25 / 0.27 / -5.9%
datafusion / parquet / ns (0.995x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 108979168 / 108537227 / +0.4% 141269702 / 142788801 / -1.1% 0.77 / 0.76 / +1.5%
tpch_q02/datafusion:parquet 68533169 / 69082604 / -0.8% 121121604 / 121345547 / -0.2% 0.57 / 0.57 / -0.6%
tpch_q03/datafusion:parquet 97684936 / 94937727 / +2.9% 161247638 / 151101056 / +6.7% 0.61 / 0.63 / -3.6%
tpch_q04/datafusion:parquet 49033729 / 52408666 / -6.4% 103923065 / 99506697 / +4.4% 0.47 / 0.53 / -10.4%
tpch_q05/datafusion:parquet 129262292 / 126725629 / +2.0% 198713996 / 199247416 / -0.3% 0.65 / 0.64 / +2.3%
tpch_q06/datafusion:parquet 48331818 / 38219370 / +26.5% 🔴 94070255 / 87392927 / +7.6% 0.51 / 0.44 / +17.5%
tpch_q07/datafusion:parquet 131757599 / 124592296 / +5.8% 211446633 / 192895074 / +9.6% 0.62 / 0.65 / -3.5%
tpch_q08/datafusion:parquet 117148739 / 118550093 / -1.2% 197489441 / 189290582 / +4.3% 0.59 / 0.63 / -5.3%
tpch_q09/datafusion:parquet 159181987 / 150093452 / +6.1% 229708694 / 232069473 / -1.0% 0.69 / 0.65 / +7.1%
tpch_q10/datafusion:parquet 114635801 / 114450106 / +0.2% 198246435 / 180608879 / +9.8% 0.58 / 0.63 / -8.7%
tpch_q11/datafusion:parquet 50635172 / 50487361 / +0.3% 105245158 / 100644146 / +4.6% 0.48 / 0.50 / -4.1%
tpch_q12/datafusion:parquet 102145590 / 106327019 / -3.9% 139828094 / 154408272 / -9.4% 0.73 / 0.69 / +6.1%
tpch_q13/datafusion:parquet 216638649 / 219002366 / -1.1% 261900607 / 266557361 / -1.7% 0.83 / 0.82 / +0.7%
tpch_q14/datafusion:parquet 45279523 / 45452810 / -0.4% 107001793 / 98545877 / +8.6% 0.42 / 0.46 / -8.3%
tpch_q15/datafusion:parquet 64056838 / 69011236 / -7.2% 120487302 / 116663853 / +3.3% 0.53 / 0.59 / -10.1%
tpch_q16/datafusion:parquet 48465781 / 49486881 / -2.1% 104214418 / 103283130 / +0.9% 0.47 / 0.48 / -2.9%
tpch_q17/datafusion:parquet 148278643 / 151258842 / -2.0% 226066638 / 220130100 / +2.7% 0.66 / 0.69 / -4.5%
tpch_q18/datafusion:parquet 171397103 / 176271241 / -2.8% 232439747 / 240287575 / -3.3% 0.74 / 0.73 / +0.5%
tpch_q19/datafusion:parquet 68306540 / 86587531 / -21.1% 🟢 138293233 / 149692596 / -7.6% 0.49 / 0.58 / -14.6%
tpch_q20/datafusion:parquet 84752768 / 84262653 / +0.6% 151030397 / 147730448 / +2.2% 0.56 / 0.57 / -1.6%
tpch_q21/datafusion:parquet 167497751 / 167661138 / -0.1% 227196932 / 229604874 / -1.0% 0.74 / 0.73 / +1.0%
tpch_q22/datafusion:parquet 55838802 / 56005332 / -0.3% 99003124 / 97895464 / +1.1% 0.56 / 0.57 / -1.4%
duckdb / vortex-file-compressed / ns (0.976x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 23454858 / 25233786 / -7.0% 59557519 / 68804985 / -13.4% 🟢 0.39 / 0.37 / +7.4%
tpch_q02/duckdb:vortex-file-compressed 29532276 / 29164532 / +1.3% 55331495 / 52116068 / +6.2% 0.53 / 0.56 / -4.6%
tpch_q03/duckdb:vortex-file-compressed 35534373 / 35892194 / -1.0% 83619536 / 88544489 / -5.6% 0.42 / 0.41 / +4.8%
tpch_q04/duckdb:vortex-file-compressed 31996851 / 33351606 / -4.1% 72714450 / 70270943 / +3.5% 0.44 / 0.47 / -7.3%
tpch_q05/duckdb:vortex-file-compressed 40114231 / 41479122 / -3.3% 88489338 / 80504126 / +9.9% 0.45 / 0.52 / -12.0%
tpch_q06/duckdb:vortex-file-compressed 9039712 / 10131814 / -10.8% 🟢 37511067 / 39855541 / -5.9% 0.24 / 0.25 / -5.2%
tpch_q07/duckdb:vortex-file-compressed 40331815 / 39245111 / +2.8% 81848232 / 87854318 / -6.8% 0.49 / 0.45 / +10.3%
tpch_q08/duckdb:vortex-file-compressed 48221511 / 49396585 / -2.4% 89029024 / 98168015 / -9.3% 0.54 / 0.50 / +7.6%
tpch_q09/duckdb:vortex-file-compressed 59367052 / 59654455 / -0.5% 106727822 / 102646431 / +4.0% 0.56 / 0.58 / -4.3%
tpch_q10/duckdb:vortex-file-compressed 48091437 / 50350500 / -4.5% 84390793 / 93303551 / -9.6% 0.57 / 0.54 / +5.6%
tpch_q11/duckdb:vortex-file-compressed 16525431 / 17746871 / -6.9% 40530401 / 37034977 / +9.4% 0.41 / 0.48 / -14.9%
tpch_q12/duckdb:vortex-file-compressed 26150677 / 26548880 / -1.5% 64556579 / 65229488 / -1.0% 0.41 / 0.41 / -0.5%
tpch_q13/duckdb:vortex-file-compressed 43748823 / 43956114 / -0.5% 121991395 / 114650508 / +6.4% 0.36 / 0.38 / -6.5%
tpch_q14/duckdb:vortex-file-compressed 21410643 / 21364158 / +0.2% 58787093 / 54753893 / +7.4% 0.36 / 0.39 / -6.7%
tpch_q15/duckdb:vortex-file-compressed 17394753 / 17922009 / -2.9% 53335477 / 56595087 / -5.8% 0.33 / 0.32 / +3.0%
tpch_q16/duckdb:vortex-file-compressed 30009520 / 30093326 / -0.3% 47146264 / 45929072 / +2.7% 0.64 / 0.66 / -2.9%
tpch_q17/duckdb:vortex-file-compressed 33346291 / 33661605 / -0.9% 88190134 / 94430789 / -6.6% 0.38 / 0.36 / +6.1%
tpch_q18/duckdb:vortex-file-compressed 51149811 / 50049102 / +2.2% 83310841 / 77731341 / +7.2% 0.61 / 0.64 / -4.6%
tpch_q19/duckdb:vortex-file-compressed 34962724 / 36522598 / -4.3% 73593691 / 63493608 / +15.9% 🔴 0.48 / 0.58 / -17.4%
tpch_q20/duckdb:vortex-file-compressed 35123306 / 35228712 / -0.3% 86196610 / 85410461 / +0.9% 0.41 / 0.41 / -1.2%
tpch_q21/duckdb:vortex-file-compressed 117113776 / 117905137 / -0.7% 158812605 / 166923090 / -4.9% 0.74 / 0.71 / +4.4%
tpch_q22/duckdb:vortex-file-compressed 20044922 / 21213143 / -5.5% 41072728 / 43750509 / -6.1% 0.49 / 0.48 / +0.7%
duckdb / vortex-compact / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 28734194 / 26960965 / +6.6% 68439103 / 71652807 / -4.5% 0.42 / 0.38 / +11.6%
tpch_q02/duckdb:vortex-compact 36716262 / 35616009 / +3.1% 62189750 / 56816652 / +9.5% 0.59 / 0.63 / -5.8%
tpch_q03/duckdb:vortex-compact 37309220 / 36770392 / +1.5% 95596938 / 78462665 / +21.8% 🔴 0.39 / 0.47 / -16.7%
tpch_q04/duckdb:vortex-compact 34819476 / 34289734 / +1.5% 79270620 / 79624720 / -0.4% 0.44 / 0.43 / +2.0%
tpch_q05/duckdb:vortex-compact 42738530 / 43631376 / -2.0% 96217867 / 92144564 / +4.4% 0.44 / 0.47 / -6.2%
tpch_q06/duckdb:vortex-compact 9753076 / 10655215 / -8.5% 46520155 / 46739441 / -0.5% 0.21 / 0.23 / -8.0%
tpch_q07/duckdb:vortex-compact 44203818 / 43653372 / +1.3% 86246441 / 94558621 / -8.8% 0.51 / 0.46 / +11.0%
tpch_q08/duckdb:vortex-compact 51164219 / 50931207 / +0.5% 97547217 / 96395199 / +1.2% 0.52 / 0.53 / -0.7%
tpch_q09/duckdb:vortex-compact 58603577 / 61570479 / -4.8% 113827210 / 109071617 / +4.4% 0.51 / 0.56 / -8.8%
tpch_q10/duckdb:vortex-compact 56164009 / 54487184 / +3.1% 99364741 / 98713105 / +0.7% 0.57 / 0.55 / +2.4%
tpch_q11/duckdb:vortex-compact 19385836 / 20664966 / -6.2% 40439132 / 38712160 / +4.5% 0.48 / 0.53 / -10.2%
tpch_q12/duckdb:vortex-compact 31526869 / 31042708 / +1.6% 74503084 / 75734440 / -1.6% 0.42 / 0.41 / +3.2%
tpch_q13/duckdb:vortex-compact 42814735 / 43527020 / -1.6% 141809267 / 158983245 / -10.8% 🟢 0.30 / 0.27 / +10.3%
tpch_q14/duckdb:vortex-compact 25569787 / 24367339 / +4.9% 67860715 / 66431180 / +2.2% 0.38 / 0.37 / +2.7%
tpch_q15/duckdb:vortex-compact 19600619 / 19327764 / +1.4% 71654122 / 66535224 / +7.7% 0.27 / 0.29 / -5.8%
tpch_q16/duckdb:vortex-compact 33797242 / 33861405 / -0.2% 48448680 / 50797775 / -4.6% 0.70 / 0.67 / +4.6%
tpch_q17/duckdb:vortex-compact 37851175 / 38281474 / -1.1% 96144477 / 93192994 / +3.2% 0.39 / 0.41 / -4.2%
tpch_q18/duckdb:vortex-compact 52588944 / 52291785 / +0.6% 80878244 / 89169185 / -9.3% 0.65 / 0.59 / +10.9%
tpch_q19/duckdb:vortex-compact 38705671 / 39131367 / -1.1% 80181318 / 74597171 / +7.5% 0.48 / 0.52 / -8.0%
tpch_q20/duckdb:vortex-compact 38891946 / 39102143 / -0.5% 87235283 / 93887059 / -7.1% 0.45 / 0.42 / +7.0%
tpch_q21/duckdb:vortex-compact 121152446 / 122091169 / -0.8% 170880257 / 167960980 / +1.7% 0.71 / 0.73 / -2.5%
tpch_q22/duckdb:vortex-compact 21722787 / 22241583 / -2.3% 43781075 / 43969148 / -0.4% 0.50 / 0.51 / -1.9%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 81748971 / 82023880 / -0.3% 93387382 / 93283018 / +0.1% 0.88 / 0.88 / -0.4%
tpch_q02/duckdb:parquet 46118699 / 45926517 / +0.4% 60123070 / 61288872 / -1.9% 0.77 / 0.75 / +2.4%
tpch_q03/duckdb:parquet 81099081 / 80933978 / +0.2% 101050124 / 100550540 / +0.5% 0.80 / 0.80 / -0.3%
tpch_q04/duckdb:parquet 58644807 / 57924971 / +1.2% 78282118 / 75595184 / +3.6% 0.75 / 0.77 / -2.2%
tpch_q05/duckdb:parquet 79151014 / 79082417 / +0.1% 100256193 / 102215524 / -1.9% 0.79 / 0.77 / +2.0%
tpch_q06/duckdb:parquet 24915229 / 25313243 / -1.6% 33752199 / 32876612 / +2.7% 0.74 / 0.77 / -4.1%
tpch_q07/duckdb:parquet 80732134 / 80228801 / +0.6% 99891498 / 101841005 / -1.9% 0.81 / 0.79 / +2.6%
tpch_q08/duckdb:parquet 96908351 / 96635118 / +0.3% 122226876 / 125071318 / -2.3% 0.79 / 0.77 / +2.6%
tpch_q09/duckdb:parquet 149284401 / 147862416 / +1.0% 170512394 / 171481576 / -0.6% 0.88 / 0.86 / +1.5%
tpch_q10/duckdb:parquet 141246981 / 140930432 / +0.2% 166010471 / 163935327 / +1.3% 0.85 / 0.86 / -1.0%
tpch_q11/duckdb:parquet 25517735 / 25389210 / +0.5% 35706783 / 35240992 / +1.3% 0.71 / 0.72 / -0.8%
tpch_q12/duckdb:parquet 53350197 / 53892997 / -1.0% 68095299 / 69122754 / -1.5% 0.78 / 0.78 / +0.5%
tpch_q13/duckdb:parquet 287711043 / 285849772 / +0.7% 301617366 / 304611477 / -1.0% 0.95 / 0.94 / +1.7%
tpch_q14/duckdb:parquet 56299611 / 56312472 / -0.0% 72671030 / 72842590 / -0.2% 0.77 / 0.77 / +0.2%
tpch_q15/duckdb:parquet 30776061 / 30884575 / -0.4% 44338370 / 44217893 / +0.3% 0.69 / 0.70 / -0.6%
tpch_q16/duckdb:parquet 66864848 / 66202959 / +1.0% 82484001 / 87275053 / -5.5% 0.81 / 0.76 / +6.9%
tpch_q17/duckdb:parquet 58586219 / 58297013 / +0.5% 80746302 / 76025275 / +6.2% 0.73 / 0.77 / -5.4%
tpch_q18/duckdb:parquet 128374429 / 129378033 / -0.8% 147000018 / 141806268 / +3.7% 0.87 / 0.91 / -4.3%
tpch_q19/duckdb:parquet 77953473 / 78268038 / -0.4% 95016859 / 96894528 / -1.9% 0.82 / 0.81 / +1.6%
tpch_q20/duckdb:parquet 77906092 / 79315996 / -1.8% 103512625 / 102869382 / +0.6% 0.75 / 0.77 / -2.4%
tpch_q21/duckdb:parquet 191011985 / 190151718 / +0.5% 208737387 / 204114079 / +2.3% 0.92 / 0.93 / -1.8%
tpch_q22/duckdb:parquet 63399235 / 63883104 / -0.8% 77580751 / 77868864 / -0.4% 0.82 / 0.82 / -0.4%

File Size Changes (16 files changed, +0.0% overall, 16↑ 0↓)
File Scale Format Base HEAD Change %
region.vortex 1.0 vortex-compact 5.87 KB 5.91 KB +40 B +0.7%
region.vortex 1.0 vortex-file-compressed 6.69 KB 6.73 KB +40 B +0.6%
nation.vortex 1.0 vortex-compact 7.68 KB 7.72 KB +40 B +0.5%
nation.vortex 1.0 vortex-file-compressed 10.72 KB 10.75 KB +32 B +0.3%
supplier.vortex 1.0 vortex-compact 495.77 KB 495.81 KB +40 B +0.0%
supplier.vortex 1.0 vortex-file-compressed 580.33 KB 580.37 KB +40 B +0.0%
part.vortex 1.0 vortex-compact 3.55 MB 3.55 MB +32 B +0.0%
part.vortex 1.0 vortex-file-compressed 4.85 MB 4.85 MB +32 B +0.0%
customer.vortex 1.0 vortex-compact 7.40 MB 7.40 MB +32 B +0.0%
customer.vortex 1.0 vortex-file-compressed 8.35 MB 8.35 MB +32 B +0.0%
partsupp.vortex 1.0 vortex-compact 20.29 MB 20.29 MB +40 B +0.0%
partsupp.vortex 1.0 vortex-file-compressed 23.60 MB 23.60 MB +40 B +0.0%
orders.vortex 1.0 vortex-compact 31.72 MB 31.72 MB +32 B +0.0%
orders.vortex 1.0 vortex-file-compressed 35.92 MB 35.92 MB +32 B +0.0%
lineitem.vortex 1.0 vortex-compact 125.99 MB 125.99 MB +32 B +0.0%
lineitem.vortex 1.0 vortex-file-compressed 155.88 MB 155.88 MB +32 B +0.0%

Totals:

  • vortex-compact: 189.71 MB → 189.71 MB (+0.0%)
  • vortex-file-compressed: 229.43 MB → 229.43 MB (+0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR ee07a98a vs base 479bd98a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.8%
Engines: DuckDB No clear signal (-3.8%, low confidence)
Vortex (geomean): hot 0.962x ➖ · cold 0.987x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.001x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (0.974x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 15482357 / 16011316 / -3.3% 26308252 / 26248782 / +0.2% 0.59 / 0.61 / -3.5%
statpopgen_q01/duckdb:vortex-file-compressed 14476716 / 14182132 / +2.1% 23233398 / 21804026 / +6.6% 0.62 / 0.65 / -4.2%
statpopgen_q02/duckdb:vortex-file-compressed 597979750 / 619359901 / -3.5% 706965562 / 684384724 / +3.3% 0.85 / 0.90 / -6.5%
statpopgen_q03/duckdb:vortex-file-compressed 1349808196 / 1954449418 / -30.9% 🟢 1396579645 / 1866613317 / -25.2% 🟢 0.97 / 1.05 / -7.7%
statpopgen_q04/duckdb:vortex-file-compressed 1342066948 / 1477497382 / -9.2% 1337863075 / 1369591222 / -2.3% 1.00 / 1.08 / -7.0%
statpopgen_q05/duckdb:vortex-file-compressed 676555688 / 610323558 / +10.9% 🔴 662549832 / 670872637 / -1.2% 1.02 / 0.91 / +12.2%
statpopgen_q06/duckdb:vortex-file-compressed 2176849017 / 1834482035 / +18.7% 🔴 1797705032 / 1808561210 / -0.6% 1.21 / 1.01 / +19.4%
statpopgen_q07/duckdb:vortex-file-compressed 354862875 / 359497580 / -1.3% 461082179 / 473501588 / -2.6% 0.77 / 0.76 / +1.4%
statpopgen_q08/duckdb:vortex-file-compressed 377552900 / 390182483 / -3.2% 421401601 / 445652464 / -5.4% 0.90 / 0.88 / +2.3%
statpopgen_q09/duckdb:vortex-file-compressed 1053583166 / 1095000360 / -3.8% 1439407718 / 1097510650 / +31.2% 🔴 0.73 / 1.00 / -26.6%
statpopgen_q10/duckdb:vortex-file-compressed 3817750846 / 3694284008 / +3.3% 3231574445 / 2956422967 / +9.3% 1.18 / 1.25 / -5.5%
duckdb / vortex-compact / ns (0.950x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 14976910 / 15651292 / -4.3% 28132163 / 27664632 / +1.7% 0.53 / 0.57 / -5.9%
statpopgen_q01/duckdb:vortex-compact 13817473 / 13963329 / -1.0% 22163042 / 22184763 / -0.1% 0.62 / 0.63 / -0.9%
statpopgen_q02/duckdb:vortex-compact 684574663 / 656822544 / +4.2% 690152007 / 701325695 / -1.6% 0.99 / 0.94 / +5.9%
statpopgen_q03/duckdb:vortex-compact 1441060713 / 1411824629 / +2.1% 1795353710 / 1944430186 / -7.7% 0.80 / 0.73 / +10.5%
statpopgen_q04/duckdb:vortex-compact 1437504465 / 1924224571 / -25.3% 🟢 1368331886 / 1872446502 / -26.9% 🟢 1.05 / 1.03 / +2.2%
statpopgen_q05/duckdb:vortex-compact 693335361 / 682390947 / +1.6% 700021797 / 701496468 / -0.2% 0.99 / 0.97 / +1.8%
statpopgen_q06/duckdb:vortex-compact 2197689775 / 2127946119 / +3.3% 1801737298 / 1748197643 / +3.1% 1.22 / 1.22 / +0.2%
statpopgen_q07/duckdb:vortex-compact 1306280880 / 1302947298 / +0.3% 1368751803 / 1357798786 / +0.8% 0.95 / 0.96 / -0.5%
statpopgen_q08/duckdb:vortex-compact 1343386200 / 1356621491 / -1.0% 1398746291 / 1372803861 / +1.9% 0.96 / 0.99 / -2.8%
statpopgen_q09/duckdb:vortex-compact 1112826664 / 1296832506 / -14.2% 🟢 1101838114 / 1099664553 / +0.2% 1.01 / 1.18 / -14.4%
statpopgen_q10/duckdb:vortex-compact 3101428734 / 3687825292 / -15.9% 🟢 3165495817 / 3149260200 / +0.5% 0.98 / 1.17 / -16.3%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 376956578 / 376285162 / +0.2% 377741115 / 377670912 / +0.0% 1.00 / 1.00 / +0.2%
statpopgen_q01/duckdb:parquet 467719618 / 468930798 / -0.3% 475572309 / 474001717 / +0.3% 0.98 / 0.99 / -0.6%
statpopgen_q02/duckdb:parquet 776723744 / 773171090 / +0.5% 814477229 / 814688791 / -0.0% 0.95 / 0.95 / +0.5%
statpopgen_q03/duckdb:parquet 1060177794 / 1055379540 / +0.5% 1134963057 / 1124132955 / +1.0% 0.93 / 0.94 / -0.5%
statpopgen_q04/duckdb:parquet 1047433220 / 1049850336 / -0.2% 1087143760 / 1110341267 / -2.1% 0.96 / 0.95 / +1.9%
statpopgen_q05/duckdb:parquet 767587007 / 770460788 / -0.4% 801879881 / 803481635 / -0.2% 0.96 / 0.96 / -0.2%
statpopgen_q06/duckdb:parquet 1015322365 / 1016495214 / -0.1% 1068604233 / 1058712057 / +0.9% 0.95 / 0.96 / -1.0%
statpopgen_q07/duckdb:parquet 945663740 / 956071740 / -1.1% 1127469147 / 1130417610 / -0.3% 0.84 / 0.85 / -0.8%
statpopgen_q08/duckdb:parquet 957733424 / 963917241 / -0.6% 1151365479 / 1143095938 / +0.7% 0.83 / 0.84 / -1.4%
statpopgen_q09/duckdb:parquet 1009177876 / 999057193 / +1.0% 1070613943 / 1046662633 / +2.3% 0.94 / 0.95 / -1.2%
statpopgen_q10/duckdb:parquet 1645747186 / 1652064640 / -0.4% 1669549867 / 1697163493 / -1.6% 0.99 / 0.97 / +1.3%

File Size Changes (2 files changed, +0.0% overall, 2↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.57 MB 960.57 MB +32 B +0.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.55 GB 1.55 GB +32 B +0.0%

Totals:

  • vortex-compact: 960.83 MB → 960.83 MB (+0.0%)
  • vortex-file-compressed: 1.55 GB → 1.55 GB (+0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR ee07a98a vs base 479bd98a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.005x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 101885649 / 98373333 / +3.6% 160124143 / 159545368 / +0.4% 0.64 / 0.62 / +3.2%
appian_q02/datafusion:vortex-compact 475902384 / 478575127 / -0.6% 587821403 / 570504340 / +3.0% 0.81 / 0.84 / -3.5%
appian_q03/datafusion:vortex-compact 276512380 / 276122350 / +0.1% 414155180 / 411335559 / +0.7% 0.67 / 0.67 / -0.5%
appian_q04/datafusion:vortex-compact 13527811004 / 13527116903 / +0.0% 13608408308 / 13711072467 / -0.7% 0.99 / 0.99 / +0.8%
appian_q05/datafusion:vortex-compact 220388588 / 221320415 / -0.4% 291222095 / 295320432 / -1.4% 0.76 / 0.75 / +1.0%
appian_q06/datafusion:vortex-compact 260744449 / 259937446 / +0.3% 331413793 / 327356848 / +1.2% 0.79 / 0.79 / -0.9%
appian_q07/datafusion:vortex-compact 344435339 / 343961366 / +0.1% 436774397 / 440540459 / -0.9% 0.79 / 0.78 / +1.0%
appian_q08/datafusion:vortex-compact 1347169146 / 1357072705 / -0.7% 1487109874 / 1470416935 / +1.1% 0.91 / 0.92 / -1.8%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 131219906 / 130543714 / +0.5% 181581748 / 194944112 / -6.9% 0.72 / 0.67 / +7.9%
appian_q02/datafusion:parquet 580091322 / 580439671 / -0.1% 669702563 / 675799857 / -0.9% 0.87 / 0.86 / +0.8%
appian_q03/datafusion:parquet 298715073 / 298451462 / +0.1% 434461219 / 431452527 / +0.7% 0.69 / 0.69 / -0.6%
appian_q04/datafusion:parquet 13682355823 / 13673818292 / +0.1% 13786075038 / 13757150109 / +0.2% 0.99 / 0.99 / -0.1%
appian_q05/datafusion:parquet 303369893 / 301856544 / +0.5% 377693648 / 373075852 / +1.2% 0.80 / 0.81 / -0.7%
appian_q06/datafusion:parquet 294345152 / 294973033 / -0.2% 374795324 / 367904326 / +1.9% 0.79 / 0.80 / -2.0%
appian_q07/datafusion:parquet 421901618 / 422329390 / -0.1% 536051295 / 527259020 / +1.7% 0.79 / 0.80 / -1.7%
appian_q08/datafusion:parquet 1485442349 / 1512744246 / -1.8% 1643931509 / 1633066240 / +0.7% 0.90 / 0.93 / -2.5%
duckdb / vortex-compact / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 151952167 / 151781314 / +0.1% 205525488 / 205343948 / +0.1% 0.74 / 0.74 / +0.0%
appian_q02/duckdb:vortex-compact 418638354 / 413284986 / +1.3% 477944557 / 468052123 / +2.1% 0.88 / 0.88 / -0.8%
appian_q03/duckdb:vortex-compact 256887342 / 253716545 / +1.2% 305686062 / 299563059 / +2.0% 0.84 / 0.85 / -0.8%
appian_q04/duckdb:vortex-compact 1559972087 / 1560213709 / -0.0% 1623905418 / 1612882637 / +0.7% 0.96 / 0.97 / -0.7%
appian_q05/duckdb:vortex-compact 241921021 / 249698697 / -3.1% 301950818 / 305775346 / -1.3% 0.80 / 0.82 / -1.9%
appian_q06/duckdb:vortex-compact 997510380 / 1011213683 / -1.4% 1096927512 / 1088958307 / +0.7% 0.91 / 0.93 / -2.1%
appian_q07/duckdb:vortex-compact 295727446 / 299514921 / -1.3% 353644687 / 348425122 / +1.5% 0.84 / 0.86 / -2.7%
appian_q08/duckdb:vortex-compact 913005477 / 916167414 / -0.3% 993684584 / 1011211815 / -1.7% 0.92 / 0.91 / +1.4%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 157339636 / 157790456 / -0.3% 180569184 / 184793469 / -2.3% 0.87 / 0.85 / +2.0%
appian_q02/duckdb:parquet 362528310 / 361682279 / +0.2% 380391322 / 373754510 / +1.8% 0.95 / 0.97 / -1.5%
appian_q03/duckdb:parquet 221233182 / 220023161 / +0.5% 249997313 / 251696221 / -0.7% 0.88 / 0.87 / +1.2%
appian_q04/duckdb:parquet 1459516675 / 1479942989 / -1.4% 1527407313 / 1550755337 / -1.5% 0.96 / 0.95 / +0.1%
appian_q05/duckdb:parquet 247897891 / 248507697 / -0.2% 264766674 / 285792506 / -7.4% 0.94 / 0.87 / +7.7%
appian_q06/duckdb:parquet 966606257 / 978891306 / -1.3% 972137069 / 996956999 / -2.5% 0.99 / 0.98 / +1.3%
appian_q07/duckdb:parquet 265828839 / 266460701 / -0.2% 289754203 / 278252264 / +4.1% 0.92 / 0.96 / -4.2%
appian_q08/duckdb:parquet 780932993 / 784415804 / -0.4% 833491852 / 787496583 / +5.8% 0.94 / 1.00 / -5.9%

File Size Changes (19 files changed, -63.4% overall, 9↑ 10↓)
File Scale Format Base HEAD Change %
orderitemnovelty_update.vortex 1.0 vortex-compact 2.58 KB 2.61 KB +32 B +1.2%
productview.vortex 1.0 vortex-compact 16.79 KB 16.82 KB +32 B +0.2%
categoryview.vortex 1.0 vortex-compact 17.59 KB 17.62 KB +32 B +0.2%
customerview.vortex 1.0 vortex-compact 10.58 MB 10.58 MB +32 B +0.0%
taxrecordview.vortex 1.0 vortex-compact 17.32 MB 17.32 MB +32 B +0.0%
addressview.vortex 1.0 vortex-compact 24.50 MB 24.50 MB +32 B +0.0%
creditcardview.vortex 1.0 vortex-compact 32.19 MB 32.19 MB +40 B +0.0%
orderview.vortex 1.0 vortex-compact 31.01 MB 31.01 MB +32 B +0.0%
orderitemview.vortex 1.0 vortex-compact 155.96 MB 155.96 MB +32 B +0.0%
addressview.vortex 1.0 vortex-file-compressed 32.07 MB 0 B 32.07 MB -100.0%
categoryview.vortex 1.0 vortex-file-compressed 18.98 KB 0 B 18.98 KB -100.0%
creditcardview.vortex 1.0 vortex-file-compressed 55.15 MB 0 B 55.15 MB -100.0%
customerview.vortex 1.0 vortex-file-compressed 18.63 MB 0 B 18.63 MB -100.0%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
orderitemnovelty_update.vortex 1.0 vortex-file-compressed 2.58 KB 0 B 2.58 KB -100.0%
orderitemview.vortex 1.0 vortex-file-compressed 265.14 MB 0 B 265.14 MB -100.0%
orderview.vortex 1.0 vortex-file-compressed 77.65 MB 0 B 77.65 MB -100.0%
productview.vortex 1.0 vortex-file-compressed 18.96 KB 0 B 18.96 KB -100.0%
taxrecordview.vortex 1.0 vortex-file-compressed 21.91 MB 0 B 21.91 MB -100.0%

Totals:

  • vortex-compact: 271.86 MB → 271.86 MB (+0.0%)
  • vortex-file-compressed: 470.85 MB → 0 B (-100.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR ee07a98a vs base 65285d66


vortex / vortex-file-compressed / ns (0.985x ➖, 2↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 1250757465 / 1247968655 / +0.2%
compress time/Bimbo 4933231237 / 4886843484 / +0.9%
compress time/CMSprovider 3956331634 / 4081226735 / -3.1%
compress time/Euro2016 511041967 / 489954481 / +4.3%
compress time/Food 423387492 / 435109324 / -2.7%
compress time/HashTags 921179517 / 907006430 / +1.6%
compress time/TPC-H l_comment canonical 1161646795 / 1171774240 / -0.9%
compress time/TPC-H l_comment chunked 1129446009 / 1220803727 / -7.5%
compress time/taxi 575624342 / 580796786 / -0.9%
compress time/wide table cols=100 chunks=1 rows=1000 8349286 / 8396933 / -0.6%
compress time/wide table cols=100 chunks=50 rows=1000 8463179 / 8397488 / +0.8%
compress time/wide table cols=1000 chunks=1 rows=1000 86243263 / 84026975 / +2.6%
compress time/wide table cols=1000 chunks=50 rows=1000 87294349 / 83542596 / +4.5%
compress time/wide table cols=10000 chunks=1 rows=1000 967915096 / 1000683179 / -3.3%
compress time/wide table cols=10000 chunks=50 rows=1000 977743620 / 1003515835 / -2.6%
decompress time/Arade 25510576 / 25564462 / -0.2%
decompress time/Bimbo 96351229 / 97468890 / -1.1%
decompress time/CMSprovider 76579591 / 75034538 / +2.1%
decompress time/Euro2016 16216370 / 15895461 / +2.0%
decompress time/Food 7067464 / 7236813 / -2.3%
decompress time/HashTags 106395609 / 107234034 / -0.8%
decompress time/TPC-H l_comment canonical 33916639 / 34801711 / -2.5%
decompress time/TPC-H l_comment chunked 34108898 / 34821708 / -2.0%
decompress time/taxi 14518648 / 14907116 / -2.6%
decompress time/wide table cols=100 chunks=1 rows=1000 2295096 / 2323904 / -1.2%
decompress time/wide table cols=100 chunks=50 rows=1000 2308034 / 2311996 / -0.2%
decompress time/wide table cols=1000 chunks=1 rows=1000 22380523 / 23142346 / -3.3%
decompress time/wide table cols=1000 chunks=50 rows=1000 22503645 / 22875217 / -1.6%
decompress time/wide table cols=10000 chunks=1 rows=1000 267805258 / 299445907 / -10.6% 🟢
decompress time/wide table cols=10000 chunks=50 rows=1000 260862387 / 300040931 / -13.1% 🟢
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 144460924 / 144460892 / +0.0%
vortex-file-compressed size/Bimbo 461842852 / 461842820 / +0.0%
vortex-file-compressed size/CMSprovider 415192404 / 415192372 / +0.0%
vortex-file-compressed size/Euro2016 157674348 / 157674972 / -0.0%
vortex-file-compressed size/Food 41581568 / 41581536 / +0.0%
vortex-file-compressed size/HashTags 177840260 / 177840236 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical 163453328 / 163453296 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked 163453328 / 163453296 / +0.0%
vortex-file-compressed size/taxi 51475132 / 51475100 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932696 / 932656 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932696 / 932656 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309896 / 9309856 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309896 / 9309856 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117896 / 93117856 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117896 / 93117856 / +0.0%
vortex / vortex-file-compressed / ratio (0.993x ➖, 1↑ 0↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.42249836 / 0.422368688 / +0.0%
vortex:parquet-zstd ratio compress time/Bimbo 0.346194191 / 0.346392761 / -0.1%
vortex:parquet-zstd ratio compress time/CMSprovider 0.509421944 / 0.524645456 / -2.9%
vortex:parquet-zstd ratio compress time/Euro2016 0.339319087 / 0.326573267 / +3.9%
vortex:parquet-zstd ratio compress time/Food 0.467984448 / 0.483817177 / -3.3%
vortex:parquet-zstd ratio compress time/HashTags 0.378083 / 0.376920572 / +0.3%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.317303043 / 0.320833609 / -1.1%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.307235564 / 0.334205329 / -8.1%
vortex:parquet-zstd ratio compress time/taxi 0.41593879 / 0.431387478 / -3.6%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.3407444 / 1.33301388 / +0.6%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.36615264 / 1.32478528 / +3.1%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.14407894 / 1.10100885 / +3.9%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.16493317 / 1.10355949 / +5.6%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.24244092 / 1.2565509 / -1.1%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.24608203 / 1.26702309 / -1.7%
vortex:parquet-zstd ratio decompress time/Arade 0.0357925695 / 0.0359116788 / -0.3%
vortex:parquet-zstd ratio decompress time/Bimbo 0.0499722383 / 0.0505055716 / -1.1%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0396278133 / 0.0385341829 / +2.8%
vortex:parquet-zstd ratio decompress time/Euro2016 0.0374680502 / 0.0368521373 / +1.7%
vortex:parquet-zstd ratio decompress time/Food 0.0316235597 / 0.0324189624 / -2.5%
vortex:parquet-zstd ratio decompress time/HashTags 0.152363745 / 0.154794163 / -1.6%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0503070756 / 0.0514529138 / -2.2%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0509475634 / 0.0515923343 / -1.2%
vortex:parquet-zstd ratio decompress time/taxi 0.0508321574 / 0.0525693301 / -3.3%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.965120044 / 0.949931552 / +1.6%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.967805023 / 0.943146754 / +2.6%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.81557904 / 0.82245957 / -0.8%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.819651976 / 0.816937082 / +0.3%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.897838207 / 0.992728105 / -9.6%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.863438469 / 0.987798137 / -12.6% 🟢
vortex:parquet-zstd size/Arade 0.559895068 / 0.559894944 / +0.0%
vortex:parquet-zstd size/Bimbo 1.20109774 / 1.20109766 / +0.0%
vortex:parquet-zstd size/CMSprovider 1.10164056 / 1.10164048 / +0.0%
vortex:parquet-zstd size/Euro2016 1.28216067 / 1.28216574 / -0.0%
vortex:parquet-zstd size/Food 1.16476612 / 1.16476522 / +0.0%
vortex:parquet-zstd size/HashTags 1.33202759 / 1.33202741 / +0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.03217445 / 1.03217425 / +0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.03217445 / 1.03217425 / +0.0%
vortex:parquet-zstd size/taxi 0.931109758 / 0.931109179 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00031317 / 1.00027027 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00031317 / 1.00027027 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.998486916 / 0.998482626 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.998486916 / 0.998482626 / +0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.99869039 / 0.998689961 / +0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.99869039 / 0.998689961 / +0.0%
vortex / parquet / ns (0.995x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2960384186 / 2954690277 / +0.2%
parquet_rs-zstd compress time/Bimbo 14249896043 / 14107810639 / +1.0%
parquet_rs-zstd compress time/CMSprovider 7766315689 / 7779018545 / -0.2%
parquet_rs-zstd compress time/Euro2016 1506080813 / 1500289615 / +0.4%
parquet_rs-zstd compress time/Food 904704192 / 899325912 / +0.6%
parquet_rs-zstd compress time/HashTags 2436447863 / 2406359580 / +1.3%
parquet_rs-zstd compress time/TPC-H l_comment canonical 3661001121 / 3652280202 / +0.2%
parquet_rs-zstd compress time/TPC-H l_comment chunked 3676156483 / 3652855360 / +0.6%
parquet_rs-zstd compress time/taxi 1383915989 / 1346345955 / +2.8%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6227351 / 6299209 / -1.1%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6194900 / 6338754 / -2.3%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 75382266 / 76318165 / -1.2%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 74935070 / 75702848 / -1.0%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 779043157 / 796372974 / -2.2%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 784654299 / 792026480 / -0.9%
parquet_rs-zstd decompress time/Arade 712733854 / 711870423 / +0.1%
parquet_rs-zstd decompress time/Bimbo 1928095125 / 1929864111 / -0.1%
parquet_rs-zstd decompress time/CMSprovider 1932470772 / 1947220165 / -0.8%
parquet_rs-zstd decompress time/Euro2016 432805281 / 431330777 / +0.3%
parquet_rs-zstd decompress time/Food 223487301 / 223227780 / +0.1%
parquet_rs-zstd decompress time/HashTags 698300040 / 692752439 / +0.8%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 674192220 / 676379790 / -0.3%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 669490271 / 674939571 / -0.8%
parquet_rs-zstd decompress time/taxi 285619355 / 283570591 / +0.7%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2378042 / 2446391 / -2.8%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2384813 / 2451364 / -2.7%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 27441268 / 28137974 / -2.5%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 27455122 / 28001198 / -2.0%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 298277859 / 301639397 / -1.1%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 302120413 / 303747213 / -0.5%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376885545 / 376885545 / +0.0%
parquet size/Euro2016 122975499 / 122975499 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133510943 / 133510943 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR ee07a98a vs base 479bd98a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+1.7%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 1.008x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.991x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 336644682 / 326799382 / +3.0% 476553587 / 475298156 / +0.3% 0.71 / 0.69 / +2.7%
tpch_q02/datafusion:vortex-file-compressed 99272905 / 98584607 / +0.7% 178419131 / 184866213 / -3.5% 0.56 / 0.53 / +4.3%
tpch_q03/datafusion:vortex-file-compressed 150442414 / 150392090 / +0.0% 284110919 / 282139190 / +0.7% 0.53 / 0.53 / -0.7%
tpch_q04/datafusion:vortex-file-compressed 65156193 / 66207638 / -1.6% 137088712 / 130866808 / +4.8% 0.48 / 0.51 / -6.1%
tpch_q05/datafusion:vortex-file-compressed 273031119 / 267930800 / +1.9% 395002473 / 462836721 / -14.7% 🟢 0.69 / 0.58 / +19.4%
tpch_q06/datafusion:vortex-file-compressed 24341811 / 24116942 / +0.9% 145910139 / 150771053 / -3.2% 0.17 / 0.16 / +4.3%
tpch_q07/datafusion:vortex-file-compressed 346176837 / 342554558 / +1.1% 500923712 / 479949842 / +4.4% 0.69 / 0.71 / -3.2%
tpch_q08/datafusion:vortex-file-compressed 278254738 / 271171756 / +2.6% 437224644 / 428847109 / +2.0% 0.64 / 0.63 / +0.6%
tpch_q09/datafusion:vortex-file-compressed 460406811 / 461201608 / -0.2% 616573295 / 611685883 / +0.8% 0.75 / 0.75 / -1.0%
tpch_q10/datafusion:vortex-file-compressed 166905495 / 166927984 / -0.0% 299383916 / 295537338 / +1.3% 0.56 / 0.56 / -1.3%
tpch_q11/datafusion:vortex-file-compressed 71560685 / 71220217 / +0.5% 129909620 / 131437270 / -1.2% 0.55 / 0.54 / +1.7%
tpch_q12/datafusion:vortex-file-compressed 81232315 / 80491793 / +0.9% 164975185 / 170975625 / -3.5% 0.49 / 0.47 / +4.6%
tpch_q13/datafusion:vortex-file-compressed 115673472 / 115238132 / +0.4% 182047614 / 189202166 / -3.8% 0.64 / 0.61 / +4.3%
tpch_q14/datafusion:vortex-file-compressed 41055045 / 40018707 / +2.6% 177988841 / 170983471 / +4.1% 0.23 / 0.23 / -1.4%
tpch_q15/datafusion:vortex-file-compressed 69457720 / 70576509 / -1.6% 199208703 / 194232654 / +2.6% 0.35 / 0.36 / -4.0%
tpch_q16/datafusion:vortex-file-compressed 65148713 / 63837042 / +2.1% 136538628 / 131305100 / +4.0% 0.48 / 0.49 / -1.9%
tpch_q17/datafusion:vortex-file-compressed 409258358 / 417878862 / -2.1% 506576816 / 504518041 / +0.4% 0.81 / 0.83 / -2.5%
tpch_q18/datafusion:vortex-file-compressed 630845422 / 627578988 / +0.5% 798381241 / 784805947 / +1.7% 0.79 / 0.80 / -1.2%
tpch_q19/datafusion:vortex-file-compressed 53590625 / 53924263 / -0.6% 178101504 / 175933548 / +1.2% 0.30 / 0.31 / -1.8%
tpch_q20/datafusion:vortex-file-compressed 129727718 / 128953411 / +0.6% 260036138 / 249594021 / +4.2% 0.50 / 0.52 / -3.4%
tpch_q21/datafusion:vortex-file-compressed 448900603 / 429979850 / +4.4% 572542529 / 562357886 / +1.8% 0.78 / 0.76 / +2.5%
tpch_q22/datafusion:vortex-file-compressed 39211334 / 39795277 / -1.5% 103370221 / 98414375 / +5.0% 0.38 / 0.40 / -6.2%
datafusion / vortex-compact / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 359352436 / 369287141 / -2.7% 471959795 / 474875930 / -0.6% 0.76 / 0.78 / -2.1%
tpch_q02/datafusion:vortex-compact 102588444 / 104258584 / -1.6% 182130055 / 176669586 / +3.1% 0.56 / 0.59 / -4.6%
tpch_q03/datafusion:vortex-compact 155091010 / 156619094 / -1.0% 269104138 / 272144588 / -1.1% 0.58 / 0.58 / +0.1%
tpch_q04/datafusion:vortex-compact 84787908 / 84572840 / +0.3% 162476897 / 161890910 / +0.4% 0.52 / 0.52 / -0.1%
tpch_q05/datafusion:vortex-compact 271439696 / 258709747 / +4.9% 441149102 / 423213547 / +4.2% 0.62 / 0.61 / +0.7%
tpch_q06/datafusion:vortex-compact 40048387 / 40862124 / -2.0% 123633225 / 130191700 / -5.0% 0.32 / 0.31 / +3.2%
tpch_q07/datafusion:vortex-compact 355240364 / 356220549 / -0.3% 469537602 / 482001918 / -2.6% 0.76 / 0.74 / +2.4%
tpch_q08/datafusion:vortex-compact 286166538 / 276447557 / +3.5% 428606805 / 395545455 / +8.4% 0.67 / 0.70 / -4.5%
tpch_q09/datafusion:vortex-compact 459845942 / 453521829 / +1.4% 605895719 / 611378946 / -0.9% 0.76 / 0.74 / +2.3%
tpch_q10/datafusion:vortex-compact 185588875 / 185456898 / +0.1% 309501933 / 310374173 / -0.3% 0.60 / 0.60 / +0.4%
tpch_q11/datafusion:vortex-compact 71838474 / 72746472 / -1.2% 130297993 / 130395268 / -0.1% 0.55 / 0.56 / -1.2%
tpch_q12/datafusion:vortex-compact 125583919 / 125920157 / -0.3% 191513130 / 191554500 / -0.0% 0.66 / 0.66 / -0.2%
tpch_q13/datafusion:vortex-compact 141623526 / 142594758 / -0.7% 200382131 / 195864653 / +2.3% 0.71 / 0.73 / -2.9%
tpch_q14/datafusion:vortex-compact 55483554 / 55137795 / +0.6% 155223263 / 150299342 / +3.3% 0.36 / 0.37 / -2.6%
tpch_q15/datafusion:vortex-compact 110558064 / 108889765 / +1.5% 207973908 / 220013343 / -5.5% 0.53 / 0.49 / +7.4%
tpch_q16/datafusion:vortex-compact 71591222 / 69999774 / +2.3% 136558172 / 132877206 / +2.8% 0.52 / 0.53 / -0.5%
tpch_q17/datafusion:vortex-compact 416237748 / 413094464 / +0.8% 503735727 / 491703015 / +2.4% 0.83 / 0.84 / -1.6%
tpch_q18/datafusion:vortex-compact 631297496 / 626040631 / +0.8% 783192098 / 763645916 / +2.6% 0.81 / 0.82 / -1.7%
tpch_q19/datafusion:vortex-compact 158684135 / 155512591 / +2.0% 213422660 / 215768337 / -1.1% 0.74 / 0.72 / +3.2%
tpch_q20/datafusion:vortex-compact 146547092 / 145737268 / +0.6% 245057598 / 249914018 / -1.9% 0.60 / 0.58 / +2.5%
tpch_q21/datafusion:vortex-compact 473575585 / 479494068 / -1.2% 600012285 / 583357008 / +2.9% 0.79 / 0.82 / -4.0%
tpch_q22/datafusion:vortex-compact 45651865 / 44573914 / +2.4% 103158263 / 102901376 / +0.2% 0.44 / 0.43 / +2.2%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 319395258 / 322759552 / -1.0% 409374696 / 417982403 / -2.1% 0.78 / 0.77 / +1.0%
tpch_q02/datafusion:parquet 223850342 / 220687247 / +1.4% 289178207 / 287609664 / +0.5% 0.77 / 0.77 / +0.9%
tpch_q03/datafusion:parquet 225135122 / 226338231 / -0.5% 358218301 / 350237571 / +2.3% 0.63 / 0.65 / -2.7%
tpch_q04/datafusion:parquet 95227734 / 96169954 / -1.0% 189038237 / 195869132 / -3.5% 0.50 / 0.49 / +2.6%
tpch_q05/datafusion:parquet 354860760 / 355222387 / -0.1% 518535765 / 528209269 / -1.8% 0.68 / 0.67 / +1.8%
tpch_q06/datafusion:parquet 63524066 / 63641384 / -0.2% 173694598 / 168787003 / +2.9% 0.37 / 0.38 / -3.0%
tpch_q07/datafusion:parquet 486282715 / 489389355 / -0.6% 669783293 / 669184989 / +0.1% 0.73 / 0.73 / -0.7%
tpch_q08/datafusion:parquet 396745817 / 395050144 / +0.4% 558390160 / 558810500 / -0.1% 0.71 / 0.71 / +0.5%
tpch_q09/datafusion:parquet 655881360 / 654829345 / +0.2% 851650488 / 843529691 / +1.0% 0.77 / 0.78 / -0.8%
tpch_q10/datafusion:parquet 520606341 / 512652624 / +1.6% 691144547 / 690273570 / +0.1% 0.75 / 0.74 / +1.4%
tpch_q11/datafusion:parquet 139088099 / 139477241 / -0.3% 212724187 / 218887232 / -2.8% 0.65 / 0.64 / +2.6%
tpch_q12/datafusion:parquet 143801445 / 143271522 / +0.4% 252795617 / 252450983 / +0.1% 0.57 / 0.57 / +0.2%
tpch_q13/datafusion:parquet 337060113 / 340100038 / -0.9% 432546517 / 422966297 / +2.3% 0.78 / 0.80 / -3.1%
tpch_q14/datafusion:parquet 115987243 / 115765833 / +0.2% 245684495 / 245338248 / +0.1% 0.47 / 0.47 / +0.1%
tpch_q15/datafusion:parquet 178318432 / 175478098 / +1.6% 293489641 / 291202271 / +0.8% 0.61 / 0.60 / +0.8%
tpch_q16/datafusion:parquet 134019826 / 127728334 / +4.9% 208678426 / 206277248 / +1.2% 0.64 / 0.62 / +3.7%
tpch_q17/datafusion:parquet 488973801 / 486573654 / +0.5% 617452538 / 613491081 / +0.6% 0.79 / 0.79 / -0.2%
tpch_q18/datafusion:parquet 684006044 / 700667165 / -2.4% 828209077 / 840582893 / -1.5% 0.83 / 0.83 / -0.9%
tpch_q19/datafusion:parquet 184870537 / 185623692 / -0.4% 320397222 / 320561744 / -0.1% 0.58 / 0.58 / -0.4%
tpch_q20/datafusion:parquet 289780126 / 281308520 / +3.0% 426792114 / 424232772 / +0.6% 0.68 / 0.66 / +2.4%
tpch_q21/datafusion:parquet 539708913 / 535937561 / +0.7% 689015891 / 681561746 / +1.1% 0.78 / 0.79 / -0.4%
tpch_q22/datafusion:parquet 237930740 / 241852235 / -1.6% 315477564 / 313504187 / +0.6% 0.75 / 0.77 / -2.2%
duckdb / vortex-file-compressed / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 99379438 / 99514917 / -0.1% 193645783 / 188236365 / +2.9% 0.51 / 0.53 / -2.9%
tpch_q02/duckdb:vortex-file-compressed 67503030 / 66722199 / +1.2% 119657956 / 108085693 / +10.7% 🔴 0.56 / 0.62 / -8.6%
tpch_q03/duckdb:vortex-file-compressed 134630308 / 138011799 / -2.5% 250155852 / 246244942 / +1.6% 0.54 / 0.56 / -4.0%
tpch_q04/duckdb:vortex-file-compressed 173377375 / 171949525 / +0.8% 261290963 / 249414113 / +4.8% 0.66 / 0.69 / -3.8%
tpch_q05/duckdb:vortex-file-compressed 142932053 / 139275058 / +2.6% 260945981 / 264921161 / -1.5% 0.55 / 0.53 / +4.2%
tpch_q06/duckdb:vortex-file-compressed 36893064 / 37139871 / -0.7% 136098028 / 140904067 / -3.4% 0.27 / 0.26 / +2.8%
tpch_q07/duckdb:vortex-file-compressed 126974347 / 128677839 / -1.3% 267546226 / 265348824 / +0.8% 0.47 / 0.48 / -2.1%
tpch_q08/duckdb:vortex-file-compressed 174588828 / 174745137 / -0.1% 282897992 / 290005184 / -2.5% 0.62 / 0.60 / +2.4%
tpch_q09/duckdb:vortex-file-compressed 309037185 / 306454465 / +0.8% 425828718 / 443134209 / -3.9% 0.73 / 0.69 / +4.9%
tpch_q10/duckdb:vortex-file-compressed 220956948 / 211233473 / +4.6% 374496378 / 327342896 / +14.4% 🔴 0.59 / 0.65 / -8.6%
tpch_q11/duckdb:vortex-file-compressed 38439314 / 39417855 / -2.5% 90529683 / 94780680 / -4.5% 0.42 / 0.42 / +2.1%
tpch_q12/duckdb:vortex-file-compressed 112053802 / 109658325 / +2.2% 193972081 / 197830929 / -2.0% 0.58 / 0.55 / +4.2%
tpch_q13/duckdb:vortex-file-compressed 197209872 / 194736476 / +1.3% 293208023 / 305754185 / -4.1% 0.67 / 0.64 / +5.6%
tpch_q14/duckdb:vortex-file-compressed 57362057 / 56320394 / +1.8% 202871474 / 181237425 / +11.9% 🔴 0.28 / 0.31 / -9.0%
tpch_q15/duckdb:vortex-file-compressed 80827447 / 83281859 / -2.9% 183040034 / 191718504 / -4.5% 0.44 / 0.43 / +1.7%
tpch_q16/duckdb:vortex-file-compressed 89542633 / 87286022 / +2.6% 127440660 / 120171894 / +6.0% 0.70 / 0.73 / -3.3%
tpch_q17/duckdb:vortex-file-compressed 109567504 / 103640095 / +5.7% 257071357 / 254528721 / +1.0% 0.43 / 0.41 / +4.7%
tpch_q18/duckdb:vortex-file-compressed 279649725 / 255805929 / +9.3% 336315092 / 341516036 / -1.5% 0.83 / 0.75 / +11.0%
tpch_q19/duckdb:vortex-file-compressed 85608195 / 83809650 / +2.1% 223586135 / 206738078 / +8.1% 0.38 / 0.41 / -5.6%
tpch_q20/duckdb:vortex-file-compressed 142403440 / 139235877 / +2.3% 256258085 / 266879408 / -4.0% 0.56 / 0.52 / +6.5%
tpch_q21/duckdb:vortex-file-compressed 489461022 / 494370147 / -1.0% 553824590 / 546674383 / +1.3% 0.88 / 0.90 / -2.3%
tpch_q22/duckdb:vortex-file-compressed 72554449 / 74947532 / -3.2% 136678847 / 129398090 / +5.6% 0.53 / 0.58 / -8.3%
duckdb / vortex-compact / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 121464337 / 123584810 / -1.7% 226200944 / 231047983 / -2.1% 0.54 / 0.53 / +0.4%
tpch_q02/duckdb:vortex-compact 72332679 / 74466993 / -2.9% 120360178 / 127303544 / -5.5% 0.60 / 0.58 / +2.7%
tpch_q03/duckdb:vortex-compact 127995243 / 129722467 / -1.3% 247024945 / 239214128 / +3.3% 0.52 / 0.54 / -4.5%
tpch_q04/duckdb:vortex-compact 171312781 / 174284235 / -1.7% 259155078 / 256124295 / +1.2% 0.66 / 0.68 / -2.9%
tpch_q05/duckdb:vortex-compact 152202386 / 148908641 / +2.2% 300175058 / 278890715 / +7.6% 0.51 / 0.53 / -5.0%
tpch_q06/duckdb:vortex-compact 43401436 / 41442751 / +4.7% 128215780 / 142865972 / -10.3% 🟢 0.34 / 0.29 / +16.7%
tpch_q07/duckdb:vortex-compact 138816905 / 137043786 / +1.3% 285551432 / 256807973 / +11.2% 🔴 0.49 / 0.53 / -8.9%
tpch_q08/duckdb:vortex-compact 187964454 / 187437987 / +0.3% 308307571 / 305422143 / +0.9% 0.61 / 0.61 / -0.7%
tpch_q09/duckdb:vortex-compact 323224185 / 313939145 / +3.0% 448947654 / 453787387 / -1.1% 0.72 / 0.69 / +4.1%
tpch_q10/duckdb:vortex-compact 227926858 / 221778155 / +2.8% 399222349 / 384809152 / +3.7% 0.57 / 0.58 / -0.9%
tpch_q11/duckdb:vortex-compact 41702027 / 41390240 / +0.8% 120355369 / 127933988 / -5.9% 0.35 / 0.32 / +7.1%
tpch_q12/duckdb:vortex-compact 121774885 / 124881260 / -2.5% 216574083 / 233799780 / -7.4% 0.56 / 0.53 / +5.3%
tpch_q13/duckdb:vortex-compact 204834484 / 200761452 / +2.0% 304440955 / 311158760 / -2.2% 0.67 / 0.65 / +4.3%
tpch_q14/duckdb:vortex-compact 61470595 / 59089900 / +4.0% 173111090 / 167073059 / +3.6% 0.36 / 0.35 / +0.4%
tpch_q15/duckdb:vortex-compact 91185710 / 87662159 / +4.0% 217753543 / 188251402 / +15.7% 🔴 0.42 / 0.47 / -10.1%
tpch_q16/duckdb:vortex-compact 89905523 / 92186824 / -2.5% 134061037 / 132523396 / +1.2% 0.67 / 0.70 / -3.6%
tpch_q17/duckdb:vortex-compact 111843719 / 110295240 / +1.4% 264703531 / 253007900 / +4.6% 0.42 / 0.44 / -3.1%
tpch_q18/duckdb:vortex-compact 275370523 / 265887592 / +3.6% 342434213 / 340366302 / +0.6% 0.80 / 0.78 / +2.9%
tpch_q19/duckdb:vortex-compact 95088215 / 90310753 / +5.3% 219684570 / 204564368 / +7.4% 0.43 / 0.44 / -2.0%
tpch_q20/duckdb:vortex-compact 155202666 / 154189692 / +0.7% 277901591 / 283899244 / -2.1% 0.56 / 0.54 / +2.8%
tpch_q21/duckdb:vortex-compact 489090892 / 497603030 / -1.7% 584391562 / 589586832 / -0.9% 0.84 / 0.84 / -0.8%
tpch_q22/duckdb:vortex-compact 75602520 / 82569913 / -8.4% 133529314 / 136055738 / -1.9% 0.57 / 0.61 / -6.7%
duckdb / parquet / ns (0.991x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 97722774 / 111117557 / -12.1% 🟢 196722541 / 190421416 / +3.3% 0.50 / 0.58 / -14.9%
tpch_q02/duckdb:parquet 99406000 / 99997390 / -0.6% 119164085 / 119450695 / -0.2% 0.83 / 0.84 / -0.4%
tpch_q03/duckdb:parquet 164010448 / 167421823 / -2.0% 222379456 / 224532764 / -1.0% 0.74 / 0.75 / -1.1%
tpch_q04/duckdb:parquet 118352845 / 121110953 / -2.3% 152224986 / 154659722 / -1.6% 0.78 / 0.78 / -0.7%
tpch_q05/duckdb:parquet 188808978 / 189657465 / -0.4% 264795241 / 253444609 / +4.5% 0.71 / 0.75 / -4.7%
tpch_q06/duckdb:parquet 58444535 / 55763580 / +4.8% 90139251 / 91758636 / -1.8% 0.65 / 0.61 / +6.7%
tpch_q07/duckdb:parquet 141083145 / 146498567 / -3.7% 218993440 / 231078467 / -5.2% 0.64 / 0.63 / +1.6%
tpch_q08/duckdb:parquet 215618244 / 218624796 / -1.4% 306542578 / 295528853 / +3.7% 0.70 / 0.74 / -4.9%
tpch_q09/duckdb:parquet 343673695 / 348350008 / -1.3% 432888396 / 433425287 / -0.1% 0.79 / 0.80 / -1.2%
tpch_q10/duckdb:parquet 650593634 / 655617138 / -0.8% 733449356 / 728682651 / +0.7% 0.89 / 0.90 / -1.4%
tpch_q11/duckdb:parquet 41737270 / 41912944 / -0.4% 53183825 / 54374722 / -2.2% 0.78 / 0.77 / +1.8%
tpch_q12/duckdb:parquet 119454183 / 118073116 / +1.2% 148208579 / 150929675 / -1.8% 0.81 / 0.78 / +3.0%
tpch_q13/duckdb:parquet 399948686 / 399542048 / +0.1% 443260499 / 423377191 / +4.7% 0.90 / 0.94 / -4.4%
tpch_q14/duckdb:parquet 151217306 / 151586092 / -0.2% 214164875 / 214024704 / +0.1% 0.71 / 0.71 / -0.3%
tpch_q15/duckdb:parquet 77770054 / 77611176 / +0.2% 122285021 / 131235773 / -6.8% 0.64 / 0.59 / +7.5%
tpch_q16/duckdb:parquet 155126350 / 155764685 / -0.4% 171561007 / 175498360 / -2.2% 0.90 / 0.89 / +1.9%
tpch_q17/duckdb:parquet 114900029 / 123169769 / -6.7% 193867902 / 199163912 / -2.7% 0.59 / 0.62 / -4.2%
tpch_q18/duckdb:parquet 314119428 / 300713728 / +4.5% 278199606 / 303590743 / -8.4% 1.13 / 0.99 / +14.0%
tpch_q19/duckdb:parquet 234233190 / 221863980 / +5.6% 304587781 / 335468416 / -9.2% 0.77 / 0.66 / +16.3%
tpch_q20/duckdb:parquet 191319905 / 198354991 / -3.5% 270901685 / 258909335 / +4.6% 0.71 / 0.77 / -7.8%
tpch_q21/duckdb:parquet 441124773 / 430379795 / +2.5% 484364142 / 476688727 / +1.6% 0.91 / 0.90 / +0.9%
tpch_q22/duckdb:parquet 336225192 / 336772940 / -0.2% 355289784 / 429118246 / -17.2% 🟢 0.95 / 0.78 / +20.6%

File Size Changes (16 files changed, +0.0% overall, 16↑ 0↓)
File Scale Format Base HEAD Change %
region.vortex 10.0 vortex-compact 5.87 KB 5.91 KB +40 B +0.7%
region.vortex 10.0 vortex-file-compressed 6.69 KB 6.73 KB +40 B +0.6%
nation.vortex 10.0 vortex-compact 7.68 KB 7.72 KB +40 B +0.5%
nation.vortex 10.0 vortex-file-compressed 10.72 KB 10.75 KB +32 B +0.3%
supplier.vortex 10.0 vortex-compact 4.73 MB 4.73 MB +40 B +0.0%
supplier.vortex 10.0 vortex-file-compressed 5.40 MB 5.40 MB +40 B +0.0%
part.vortex 10.0 vortex-compact 35.89 MB 35.89 MB +32 B +0.0%
part.vortex 10.0 vortex-file-compressed 48.42 MB 48.42 MB +32 B +0.0%
customer.vortex 10.0 vortex-compact 74.00 MB 74.00 MB +32 B +0.0%
customer.vortex 10.0 vortex-file-compressed 82.86 MB 82.86 MB +32 B +0.0%
partsupp.vortex 10.0 vortex-compact 203.66 MB 203.66 MB +40 B +0.0%
partsupp.vortex 10.0 vortex-file-compressed 238.44 MB 238.44 MB +40 B +0.0%
orders.vortex 10.0 vortex-compact 344.29 MB 344.29 MB +32 B +0.0%
orders.vortex 10.0 vortex-file-compressed 390.32 MB 390.32 MB +32 B +0.0%
lineitem.vortex 10.0 vortex-compact 1.28 GB 1.28 GB +32 B +0.0%
lineitem.vortex 10.0 vortex-file-compressed 1.56 GB 1.56 GB +32 B +0.0%

Totals:

  • vortex-compact: 1.92 GB → 1.92 GB (+0.0%)
  • vortex-file-compressed: 2.31 GB → 2.31 GB (+0.0%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants