Skip to content

storage: make origin backends shard-local#444

Merged
jveski merged 35 commits into
mainfrom
storage-stack/05-shard-local-origins
Jul 14, 2026
Merged

storage: make origin backends shard-local#444
jveski merged 35 commits into
mainfrom
storage-stack/05-shard-local-origins

Conversation

@jveski

@jveski jveski commented Jul 10, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor
  • make origin backend registries, fetch limiters, and connection pools shard-local
  • remove worker-local origin rings and dispatch origin fetches through each shard's network handle
  • keep selected backends alive for in-flight fetches across removal or replacement

jveski added 27 commits July 10, 2026 19:08
@jveski
unbounded-storage: remove unused crypto dependencies
174aa67
@jveski
unbounded-storage: avoid boxing eviction checks
1b31cfa
@jveski
unbounded-storage: remove unused admission sketch
57fed29
@jveski
unbounded-storage: simplify write singleflight
3c31427
@jveski
unbounded-storage: avoid allocating for btree checksums
374c49a
@jveski
unbounded-storage: update btree mirror in place
d863eff
@jveski
unbounded-storage: simplify checksum implementation
0705a99
@jveski
unbounded-storage: remove unused engine settings
3c6c2ef
@jveski
unbounded-storage: remove unused write depth hint
9deea9d
@jveski
unbounded-storage: fold eviction metadata into SIEVE
0fdfe22
@jveski
unbounded-storage: remove worker-local origin rings
8dade42
@jveski
unbounded-storage: remove legacy routing API
fd5fbe0
@jveski
unbounded-storage: enforce shard-local backends
e4aef69
@jveski
unbounded-storage: unify disk registry entries
7f582c4
@jveski
unbounded-storage: remove redundant peer map
a44f94b
@jveski
unbounded-storage: make backend registry shard-local
9f16c96
@jveski
unbounded-storage: flatten disk channel snapshots
df110d3
@jveski
unbounded-storage: share routing across caches
a482360
@jveski
unbounded-storage: make fetch limiter shard-local
001a71f
@jveski
unbounded-storage: deduplicate backing registration
9d1531f
@jveski
unbounded-storage: remove unused pool group
7fa2271
@jveski
unbounded-storage: remove unused io facade
aa0d4a2
@jveski
unbounded-storage: simplify origin connection pool
bb8dbe5
@jveski
unbounded-storage: remove multi-registry disk layer
9efdb4c
@jveski
unbounded-storage: remove legacy p2p request types
175cd8f
@jveski
unbounded-storage: remove unused shard context
bcb618e
@jveski
unbounded-storage: remove borrowed origin dispatch
c2d739b
@jveski jveski mentioned this pull request Jul 10, 2026
Open
@jveski

jveski commented Jul 10, 2026

Copy link
Copy Markdown
Contributor Author

AI review: This comment was generated by an AI agent, not by the PR author.

No blocking issues found in this PR's incremental diff.

Base automatically changed from storage-stack/04-runtime-cleanup to main July 13, 2026 19:20
@jveski

jveski commented Jul 14, 2026

Copy link
Copy Markdown
Contributor Author

@copilot resolve the merge conflicts in this pull request

Copilot AI commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

@copilot resolve the merge conflicts in this pull request

Resolved in 5d1fb30 - merged main and kept the BackendRegistry-only import in cmd/unbounded-storage/src/main.rs (the OriginRing import from main is stale there since this PR removes it). Verified with cargo check --all-targets.

@jveski jveski marked this pull request as ready for review July 14, 2026 16:52
@jveski jveski requested a review from a team July 14, 2026 16:52
@jveski jveski enabled auto-merge July 14, 2026 16:52
cchildress
cchildress reviewed Jul 14, 2026
View reviewed changes
Comment thread cmd/unbounded-storage/src/backend/fake.rs Outdated
Copilot AI requested a review from cchildress July 14, 2026 18:11
@jveski jveski added this pull request to the merge queue Jul 14, 2026
Merged via the queue into main with commit f584dad Jul 14, 2026
23 checks passed
@jveski jveski deleted the storage-stack/05-shard-local-origins branch July 14, 2026 19:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot Copilot left review comments
@phealy phealy phealy approved these changes
@cchildress cchildress cchildress approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@jveski @phealy @cchildress