Skip to content

ci: dispatch the SEA-via-kernel integration leg behind kernel labels#403

Draft
mani-mathur-arch wants to merge 1 commit into
mani/sea-kernel-nightly-e2efrom
mani/sea-kernel-c2-dispatch
Draft

ci: dispatch the SEA-via-kernel integration leg behind kernel labels#403
mani-mathur-arch wants to merge 1 commit into
mani/sea-kernel-nightly-e2efrom
mani/sea-kernel-c2-dispatch

Conversation

@mani-mathur-arch

@mani-mathur-arch mani-mathur-arch commented Jul 14, 2026

Copy link
Copy Markdown
Collaborator

What

Extend the databricks-driver-test dispatch so the Go integration suite can run against the SEA-via-kernel backend, selected by label — the analogue of the existing Thrift labels, not a copy.

Label Backend Proxy mode
integration-test Thrift replay
integration-test-full Thrift passthrough
integration-test-kernel sea (kernel) passthrough

How

  • The label resolves both proxy_mode and a new go_mode (thrift vs sea).
  • go_mode rides in the repository_dispatch client_payload. The receiver in driver-test reads it to decide whether to build the kernel static lib and run the databricks_kernel-tagged leg. Thrift labels send go_mode: thrift and are unchanged.
  • The kernel label is passthrough, not replay: the sea leg has no committed recordings to replay yet, so there is no sea replay label until those are captured.
  • The new label is added to the on-new-commit label-drop list and the skip-stub guidance.
  • The required merge-queue gate stays Thrift-only (go_mode pinned to thrift): the kernel leg is previewable on demand but not a required gate until the SEA backend ships in a released driver.

Two-repo change

Driver-side half. The receiver-side half (read go_mode, kernel build prerequisites, thread DATABRICKS_GO_MODE, guard sea+replay) is a separate PR in databricks-driver-test. The runner + harness already handle DATABRICKS_GO_MODE=sea end-to-end.

Testing

  • Workflow YAML validated; label resolution dry-run: integration-test→thrift/replay, integration-test-full→thrift/passthrough, integration-test-kernel→sea/passthrough.
  • Isaac Review clean (0 critical / 0 major / 0 minor).

Stacked on #402.

This pull request and its description were written by Isaac.

@mani-mathur-arch mani-mathur-arch force-pushed the mani/sea-kernel-c2-dispatch branch from 5f940a0 to 90122c9 Compare July 14, 2026 17:01
@mani-mathur-arch mani-mathur-arch force-pushed the mani/sea-kernel-nightly-e2e branch from 2a43d24 to ebedfc7 Compare July 14, 2026 18:43
@mani-mathur-arch mani-mathur-arch force-pushed the mani/sea-kernel-c2-dispatch branch from 90122c9 to 2a9715b Compare July 14, 2026 18:43
@mani-mathur-arch mani-mathur-arch force-pushed the mani/sea-kernel-nightly-e2e branch from ebedfc7 to 23de162 Compare July 14, 2026 18:49
@mani-mathur-arch mani-mathur-arch force-pushed the mani/sea-kernel-c2-dispatch branch from 2a9715b to 21a18d7 Compare July 14, 2026 18:49
Extend the driver-test dispatch so the Go integration suite can run against the
SEA-via-kernel backend, selected by label — the analogue of the existing Thrift
labels, not a copy. Adds one kernel-namespaced label:

  - integration-test-kernel  → sea backend, passthrough (real warehouse)

The label resolves both proxy_mode and a new go_mode (thrift vs sea), and go_mode
rides in the repository_dispatch client_payload. databricks-driver-test reads it to
decide whether to build the kernel static lib and run the tagged (databricks_kernel)
leg; the Thrift labels send go_mode=thrift and are unchanged. The new label is added
to the on-new-commit label-drop list and the skip-stub guidance.

The kernel label is passthrough (not replay): the sea leg has no committed
recordings to replay yet, so there is no sea replay label until those are captured.
The required merge-queue gate stays Thrift-only (go_mode pinned to thrift): the
kernel leg is previewable on demand but not a required gate until the SEA backend
ships in a released driver.

Co-authored-by: Isaac
Signed-off-by: Mani Kaustubh Mathur <mani.mathur@databricks.com>
@mani-mathur-arch mani-mathur-arch force-pushed the mani/sea-kernel-nightly-e2e branch from 23de162 to fb098a1 Compare July 14, 2026 18:53
@mani-mathur-arch mani-mathur-arch force-pushed the mani/sea-kernel-c2-dispatch branch from 21a18d7 to c9ff45d Compare July 14, 2026 18:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant