Skip to content

docs(g2): S2a decision — retire the X5-scale load benchmark#154

Merged
brownjuly2003-code merged 1 commit into
mainfrom
docs/g2-s2a-x5-benchmark-decision
Jul 5, 2026
Merged

docs(g2): S2a decision — retire the X5-scale load benchmark#154
brownjuly2003-code merged 1 commit into
mainfrom
docs/g2-s2a-x5-benchmark-decision

Conversation

@brownjuly2003-code

Copy link
Copy Markdown
Owner

What

S2a of the G2 closeout plan: the binding decision on the fate of the "45.8M rows" load/benchmark subsystem, written as a mechanical execution spec for S2b (full X5 removal).

Decision: retire the at-scale benchmark as historical; keep the infrastructure/dv2/load-test/ harness alive and gating at synthetic kitchen-seed scale; build no bulk generator.

  • Rationale: legend-fit (generator-spec pins demo value away from order volume; ~2,800 orders/day makes 45.8M line items absurd), no CI/runbook consumer (the DV2 bench is a manual Mac-only kind-cluster job; CI's load-test.yml is the unrelated API-tier gate), honesty (numbers become unreproducible once the dataset is gone), cost (a Mac-only multi-day generator to keep one headline).
  • Contains: file-disposition table for every load-test/benchmark path from the audit, ready-made replacement text for run-bench.sh/job.yaml/READMEs, a full ready-made rewrite of docs/dv2-multi-branch/load-test-baseline.md, and two dependency discoveries the audit's file list missed (test_dv2_postgres_ingestion.py is the only PostgresVaultWriter coverage and imports the x5 package; test_dv2_supplier_reference.py pins hash equality against x5 mappers).
  • Docs-only; no code touched. This is a process document — S2b deletes it in its final commit so the S8 grep -ri x5 gate passes.

Verification

  • Read at 63a585f: load-test infra, baseline doc, x5 loader package, dbt/spec/domain/schema/demo-evidence references, CI workflows, importers of the x5 package and pg_vault_writer.
  • Verified docs/benchmark*.md, queries/*.sql, apply.sh, dataflow.html are already X5-free (dispositioned as no-action).

🤖 Generated with Claude Code

…ness at seed scale

Resolves the G2 audit's open question on the 45.8M load/benchmark
dependency: no synthetic bulk generator; the at-scale capture is retired
as historical, the load-test harness stays gating against the synthetic
kitchen seed. Contains the mechanical file-disposition list for S2b,
ready-made comment/doc replacements, and the dependency map the audit's
file list missed (pg-ingestion + supplier-reference test imports).

Process document: S2b deletes this file in its final commit so the S8
grep gate (x5-clean outside CHANGELOG) passes.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Jul 5, 2026

Copy link
Copy Markdown

DORA Metrics

  • Window: last 30 days
  • Branch: main
  • Deployment frequency: 87 total / 20.3 per week
  • Lead time for changes: avg 0.55h / median 0.0h
  • Change failure rate: 58.62% (51/87)
  • MTTR: n/a across 0 incident(s)

MTTR note: No failed mainline CI runs in the selected window.

@brownjuly2003-code brownjuly2003-code merged commit 88e6113 into main Jul 5, 2026
19 checks passed
@brownjuly2003-code brownjuly2003-code deleted the docs/g2-s2a-x5-benchmark-decision branch July 5, 2026 20:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants