⎈ Kubernetes (Helm)
For GKE, EKS, AKS, and self-managed K8s.
helm repo add pebble https://charts.gopebble.com
helm install pebble-sonar pebble/sonar \
--set gpuVendor=nvidia \
--set inferenceEngine=vllm
- Add the Pebble Helm repository and update.
- Install the Sonar chart, pointing at your inference engine (vLLM, SGLang, or TensorRT-LLM).
- Pebble auto-discovers GPU nodes via the NVIDIA / ROCm device plugins.
- Verify with
kubectl get pods -n pebble-system; metrics show in Grafana within ~60 seconds.
K8s 1.26+NVIDIA + AMDvLLM · SGLang · TRT-LLM
A Slurm (Ansible)
For on-prem HPC clusters and bare-metal AI factories.
ansible-galaxy collection install pebble.flex
ansible-playbook -i hosts.ini \
pebble.flex.deploy.yml
- Install the Ansible collection from Galaxy.
- Provide your Slurm controller and compute node inventory.
- The playbook deploys Pebble agents and the SLA-cliff profiler on every GPU node.
- First curtailment signal arrives within minutes of activation.
Slurm 22+RHEL / UbuntuSystemD
D Docker / standalone
For local benchmarks and single-node validation.
docker run --gpus all \
-e PEBBLE_MODE=sonar \
-v /var/run/dcgm:/dcgm \
gopebble/agent:latest
- Pull the Pebble agent image.
- Mount your DCGM (NVIDIA) or rocm-smi (AMD) socket so the agent can read GPU telemetry.
- Run for ~10 minutes against a representative workload to see your efficiency-knee profile.
Docker 24+DCGM · rocm-smi