edge-cli

edge-cli is the unified Go command-line entry point for the Edge-Computing-LLM GitHub organization.

It coordinates two current layers:

• k3s-nvidia-edge: infrastructure for a local Linux + k3s + NVIDIA GPU host.
• llm-observability-stack: LLMOps workloads, Helm charts, Open WebUI, Ollama, OpenTelemetry, Prometheus, Grafana, and related services.

The CLI is intentionally NVIDIA-only. It does not include AMD, Intel, Apple Silicon, or CPU-only accelerator abstractions.

Why this exists

The organization has separate repositories for infrastructure and LLMOps workloads. edge-cli provides one installable control plane so operators can run preflight checks, installs, validation, status, logs, and safe uninstall flows without treating each repository as a disconnected CLI application.

Future repositories can be added as new Go modules under internal/modules.

Install

Build from source:

go mod tidy
go build -o edge ./cmd/edge
sudo install -m 0755 edge /usr/local/bin/edge
edge version

Configuration

Default config path:

~/.edge-cli/config.yaml

Create it:

edge config init
edge config show

Default configuration:

repos:
  k3sNvidiaEdge: /media/waqasm86/External1/Waqas-Projects/Project-Edge-Computing-LLM/k3s-nvidia-edge
  llmObservabilityStack: /media/waqasm86/External1/Waqas-Projects/Project-Edge-Computing-LLM/llm-observability-stack
cluster:
  kubeconfig: ""
  defaultNamespace: llm-observability
gpu:
  vendor: nvidia

Repository paths can also be overridden per command:

edge install infra --repo-path /path/to/k3s-nvidia-edge --yes
edge install observability --repo-path /path/to/llm-observability-stack --yes

Basic Commands

edge doctor
edge status
edge install infra --yes
edge validate infra
edge install observability --yes
edge validate observability
edge install all --yes
edge logs
edge repo list
edge repo doctor

Full Install

edge doctor
edge install all --yes
edge status

edge install all runs:

1. Infra diagnostics.
2. Linux/k3s/NVIDIA GPU infrastructure install.
3. Infra validation and CUDA validation pod.
4. llm-observability-stack Helm install.
5. Observability validation.
6. Next command and URL hints.

Infra Layer

edge install infra uses the local k3s-nvidia-edge project as the infrastructure source. It validates the repo path, checks Linux and NVIDIA preconditions, installs required host packages and NVIDIA Container Toolkit when not skipped, installs k3s when missing, installs the GPU Operator through the bundled Helm chart by default, and validates GPU readiness with a CUDA pod.

Useful commands:

edge install infra --yes
edge install infra --skip-k3s-install --yes
edge install infra --skip-toolkit-install --yes
edge validate infra
edge uninstall infra --yes

Observability Layer

edge install observability uses the local llm-observability-stack chart. It validates the infra layer first, builds Helm dependencies, installs the chart, waits for Ollama, Open WebUI, and OpenTelemetry Collector, then runs validation.

Useful commands:

edge install observability --profile geforce-940m-k3s --yes
edge install observability --values custom.yaml --set ollama.enabled=true --yes
edge validate observability
edge logs --tail 200
edge uninstall observability --yes --keep-namespace

Safe Uninstall

Uninstall commands require --yes. Observability uninstall does not delete user data outside Kubernetes resources. Use --keep-namespace to retain the namespace. Infra uninstall keeps k3s unless --k3s is explicitly set.

edge uninstall observability --yes --keep-namespace
edge uninstall infra --yes
edge uninstall all --yes

Troubleshooting

Run the broad checks first:

edge doctor
edge repo doctor
edge status

Common issues:

• Missing nvidia-smi: install or repair the NVIDIA driver on the host.
• Missing runtimeclass/nvidia: validate the GPU Operator and NVIDIA Container Toolkit setup with edge validate infra.
• Helm release missing: run edge install observability --yes.
• Pods not ready: run edge logs and inspect the namespace with kubectl get pods -n llm-observability -o wide.

Development

go test ./...
go build -o edge ./cmd/edge

The project is 100% Go. It does not create Bash scripts. External platform commands such as kubectl, helm, apt-get, systemctl, k3s, and nvidia-smi are executed through Go's os/exec.

Documentation

• Architecture
• Command reference
• Configuration
• Troubleshooting
• Contributing
• Security