Skip to content

improve CI build times (WIP) #2322

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
peterj wants to merge 2 commits into
base: main
Choose a base branch
from
+120 −48
Open

improve CI build times (WIP) #2322

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
31e52d9
wip
peterj Jul 23, 2026
a7ddbd1
Merge branch 'main' into peterj/cimprove
peterj Jul 27, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 0 additions & 4 deletions .github/actions/initialize-environment/action.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,10 +5,6 @@ description: Initialization steps for kagent actions
runs:
using: "composite"
steps:
- name: Cancel Previous Actions
uses: styfle/cancel-workflow-action@85880fa0301c86cca9da44039ee3bb12d3bedbfa # 0.12.1
with:
access_token: ${{ github.token }}
- name: Free disk space
shell: bash
run: |
Expand Down
55 changes: 33 additions & 22 deletions .github/workflows/ci.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@ env:
# Consistent builder configuration
BUILDX_BUILDER_NAME: kagent-builder-v0.23.0
BUILDX_VERSION: v0.23.0
BUILD_PLATFORMS: ${{ github.event_name == 'pull_request' && 'linux/amd64' || 'linux/amd64,linux/arm64' }}
jobs:
setup:
runs-on: ubuntu-latest
Expand Down Expand Up @@ -84,15 +85,13 @@ jobs:
BUILDX_BUILDER_NAME: ${{ env.BUILDX_BUILDER_NAME }}
KAGENT_HELM_EXTRA_ARGS: --cleanup-on-fail=false
DOCKER_BUILD_ARGS: >-
--cache-from=type=gha,scope=${{ needs.setup.outputs.cache-key }}-e2e
--cache-from=type=gha,scope=${{ env.CACHE_KEY_PREFIX }}-main-e2e
--cache-to=type=gha,scope=${{ needs.setup.outputs.cache-key }}-e2e,mode=max
--platform=linux/amd64
--push
CI_CACHE_KEY_PREFIX: ${{ needs.setup.outputs.cache-key }}-e2e
CI_CACHE_MAIN_KEY_PREFIX: ${{ env.CACHE_KEY_PREFIX }}-main
run: |
echo "Cache key: ${{ needs.setup.outputs.cache-key }}"
make helm-install
make push-test-agent push-test-skill
make -j2 ci-e2e-install
kubectl rollout status deployment/kagent-controller -n kagent --timeout=120s
kubectl wait --for=condition=Ready pod -l app.kubernetes.io/component=controller -n kagent --timeout=120s
kubectl wait --for=condition=Ready agents.kagent.dev -n kagent --all --timeout=60s || kubectl get po -n kagent -o wide ||:
Expand Down Expand Up @@ -121,6 +120,7 @@ jobs:
OPENAI_API_KEY: fake
KAGENT_HELM_EXTRA_ARGS: >-
--set 'rbac.namespaces={kagent}'
--set ui.replicas=0
run: |
# Upgrade helm to use namespace-scoped RBAC
make helm-install-provider
Expand Down Expand Up @@ -202,10 +202,10 @@ jobs:
BUILDX_BUILDER_NAME: ${{ env.BUILDX_BUILDER_NAME }}
KAGENT_HELM_EXTRA_ARGS: --cleanup-on-fail=false
DOCKER_BUILD_ARGS: >-
--cache-from=type=gha,scope=${{ needs.setup.outputs.cache-key }}-e2e
--cache-from=type=gha,scope=${{ env.CACHE_KEY_PREFIX }}-main-e2e
--platform=linux/amd64
--push
CI_CACHE_KEY_PREFIX: ${{ needs.setup.outputs.cache-key }}-upgrade
CI_CACHE_MAIN_KEY_PREFIX: ${{ env.CACHE_KEY_PREFIX }}-main
run: |
make run-upgrade-tests UPGRADE_FROM_VERSION="${{ steps.prep.outputs.version }}"
- name: fail print info
Expand Down Expand Up @@ -251,10 +251,10 @@ jobs:
BUILDX_BUILDER_NAME: ${{ env.BUILDX_BUILDER_NAME }}
KAGENT_HELM_EXTRA_ARGS: --cleanup-on-fail=false
DOCKER_BUILD_ARGS: >-
--cache-from=type=gha,scope=${{ needs.setup.outputs.cache-key }}-e2e
--cache-from=type=gha,scope=${{ env.CACHE_KEY_PREFIX }}-main-e2e
--platform=linux/amd64
--push
CI_CACHE_KEY_PREFIX: ${{ needs.setup.outputs.cache-key }}-rolling-upgrade
CI_CACHE_MAIN_KEY_PREFIX: ${{ env.CACHE_KEY_PREFIX }}-main
run: |
make run-rolling-upgrade-tests UPGRADE_FROM_VERSION="${{ steps.prep.outputs.version }}"
- name: fail print info
Expand Down Expand Up @@ -351,7 +351,8 @@ jobs:
working-directory: ./ui
run: npm run test:vitest

# This job builds the Docker images for the controller, UI, app, and CLI on arm64.
# The controller target also builds its runtime and sandbox image dependencies.
# Pull requests validate amd64; main and release pushes validate both platforms.
build:
needs: setup
env:
Expand All @@ -361,13 +362,7 @@ jobs:
image:
- controller
- ui
- app
- cli
- golang-adk
- golang-adk-full
- skills-init
- acp-sandbox-hermes
- acp-sandbox-openclaw
- acp-sandbox-claude
runs-on: ubuntu-latest
services:
Expand All @@ -379,31 +374,47 @@ jobs:
- name: Checkout repository
uses: actions/checkout@v6
- name: Set up QEMU
if: contains(env.BUILD_PLATFORMS, 'linux/arm64')
uses: docker/setup-qemu-action@v4
with:
platforms: linux/amd64,linux/arm64
platforms: ${{ env.BUILD_PLATFORMS }}
Comment thread
peterj marked this conversation as resolved.
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v4
with:
name: ${{ env.BUILDX_BUILDER_NAME }}
platforms: linux/amd64,linux/arm64
platforms: ${{ env.BUILD_PLATFORMS }}
version: ${{ env.BUILDX_VERSION }}
use: "true"
driver-opts: network=host
- name: Run make build
env:
BUILDX_BUILDER_NAME: ${{ env.BUILDX_BUILDER_NAME }}
DOCKER_BUILD_ARGS: >-
--cache-from=type=gha,scope=${{ needs.setup.outputs.cache-key }}-${{ matrix.image }}
--cache-from=type=gha,scope=${{ env.CACHE_KEY_PREFIX }}-main-${{ matrix.image }}
--cache-to=type=gha,scope=${{ needs.setup.outputs.cache-key }}-${{ matrix.image }},mode=max
--platform=linux/amd64,linux/arm64
--platform=${{ env.BUILD_PLATFORMS }}
--push
CI_CACHE_KEY_PREFIX: ${{ needs.setup.outputs.cache-key }}
CI_CACHE_MAIN_KEY_PREFIX: ${{ env.CACHE_KEY_PREFIX }}-main
DOCKER_REPO: "${{ github.repository_owner }}/kagent"
DOCKER_BUILDER: "docker buildx build"
run: make build-${{ matrix.image }}
working-directory: ./

cli-build:
runs-on: ubuntu-latest
steps:
- name: Checkout repository
uses: actions/checkout@v6

- name: Set up Go
uses: actions/setup-go@v7
with:
go-version-file: go/go.mod
cache: true
cache-dependency-path: go/go.sum

- name: Build CLI binaries
run: make -C go -j5 build

go-lint:
runs-on: ubuntu-latest
steps:
Expand Down
Loading
Loading