2 Commits

Author	SHA1	Message	Date
Hermes Agent service account	aff792a061	feat(llm-inference): move astro-orbiter monitoring to GitOps (values.yaml + dashboards.yaml) ... - Prometheus scrape configs for node/gpu/llama-server exporters on astro-orbiter now declared in cluster/applications/monitoring/values.yaml (additionalScrapeConfigs), applied via ArgoCD sync instead of an imperative kubectl secret patch from the Ansible role. - Grafana dashboard for astro-orbiter LLM inference added as a ConfigMap in cluster/applications/monitoring/dashboards.yaml (grafana_dashboard=1 sidecar label), replacing the role's ad-hoc kubectl apply of a rendered Jinja template. - ansible/roles/llm-inference/tasks/monitoring.yml: removed the kubectl get/patch/apply tasks and orphaned grafana-llm-dashboard.json.j2 template; role now only stands up node_exporter + nvidia_gpu_exporter and verifies they're reachable — cluster-facing config lives in Git. - host_vars/vars.yml + inventory.yml: finalize astro-orbiter as the llama.cpp/RTX 3090 host (jarvis user, ssh key), drop stale Ollama/AMD vars and ollama_server inventory group superseded by the ATX rebuild.	2026-08-05 09:43:54 -05:00
Hermes Agent service account	423891001c	feat(llm-inference): Phase 7 — Prometheus monitoring + Grafana dashboard ... - Phase 7 task file: monitoring.yml - node_exporter (port 9100) via apt, systemd managed - nvidia_gpu_exporter v1.2.2 (port 9835) — GPU util, VRAM, temp, power - Patches kube-prometheus additionalScrapeConfigs secret with 3 new jobs: node-astro-orbiter, gpu-astro-orbiter, vllm-astro-orbiter - Deploys Grafana dashboard ConfigMap via kubectl apply - Grafana dashboard (11 panels): - Row 1: GPU util %, VRAM used, GPU temp gauge - Row 2: GPU power draw, vLLM token throughput, request queue depth - Row 3: vLLM e2e latency p50/p95/p99, KV cache utilization % - Row 4: System CPU %, memory, root disk gauge - defaults/main.yml: llm_gpu_exporter_version, llm_gpu_exporter_port - handlers/main.yml: restart nvidia-gpu-exporter	2026-08-03 11:53:36 -05:00