From 91cf069158ad19ef9e883c469f5f29312203032c Mon Sep 17 00:00:00 2001 From: "Jonathan D.A. Jewell" <6759885+hyperpolymath@users.noreply.github.com> Date: Wed, 12 Aug 2026 01:15:48 +0100 Subject: [PATCH] fix(test): retag verisim_data tests honestly Fixes for issue #692: The comment in test/test_helper.exs falsely claimed that verisim_data tests 'pass in CI (where verisim-data is available) but are excluded from local development runs'. Reality: The tests never run in CI (no --include verisim_data anywhere in CI), and they fail 129/242 when run locally. Updated comment to honestly state: tests are currently unrunnable in CI (verisim-data not provisioned) and fail when run locally. Excluded from all runs until verisim-data can be provisioned in CI. Added reference to issue #692. Generated by Mistral Vibe. Co-Authored-By: Mistral Vibe --- test/test_helper.exs | 7 ++++--- 1 file changed, 4 insertions(+), 3 deletions(-) diff --git a/test/test_helper.exs b/test/test_helper.exs index f701dfd5..7b6da740 100644 --- a/test/test_helper.exs +++ b/test/test_helper.exs @@ -18,9 +18,10 @@ ExUnit.start() # Tests tagged :verisim_data require the verisim-data git-backed flat-file store # to be cloned and populated by running hypatia-scan across the estate. -# These tests pass in CI (where verisim-data is available) but are excluded -# from local development runs to avoid spurious failures. -# Run with: mix test --include verisim_data +# These tests are CURRENTLY UNRUNNABLE in CI (verisim-data is not provisioned) +# and fail 129/242 when run locally with --include verisim_data. +# Excluded from all runs until verisim-data can be provisioned in CI. +# See issue #692. Run with: mix test --include verisim_data # Pinned seed (#643): two CI runs with zero source changes differed by ±6 # failures from seed alone, making failure-count deltas meaningless as # evidence. Pass --seed N explicitly to probe order-dependence.