rblundon pushed to main at rblundon/homelab 2026-08-06 10:39:54 -05:00
b741f9b20b llm-inference-multimodel: repoint qwen shadow slot to Qwen2.5-14B-Instruct-1M (base Qwen disqualified, n_ctx_train=32768)
rblundon pushed to main at rblundon/homelab 2026-08-06 09:38:42 -05:00
a3c1342837 llm-inference-multimodel: reset qwen shadow unit to disabled by default -- model disqualified (n_ctx_train=32768, not 64K+), leaving enabled would crash-loop on next playbook run
rblundon pushed to main at rblundon/homelab 2026-08-06 09:24:50 -05:00
d4ff2681ac llm-inference-multimodel: fix qwen unit -- llama.cpp requires --flash-attn <on|off|auto>, not bare flag
rblundon pushed to main at rblundon/homelab 2026-08-06 09:10:15 -05:00
75cb93f25c llm-inference-multimodel: enable Qwen2.5-14B shadow instance (port 8002) for shadow-test window
rblundon pushed to main at rblundon/homelab 2026-08-06 09:08:46 -05:00
d10255297c llm-inference-multimodel: add Qwen2.5-14B shadow instance (port 8002, gated off — VRAM co-residency not yet confirmed)
rblundon pushed to main at rblundon/homelab 2026-08-05 17:25:33 -05:00
79edb8f4e1 llm-inference-multimodel: log Run 2 validation PASS (tool-calling + hallucination), preserve procedure doc
rblundon pushed to main at rblundon/homelab 2026-08-05 17:13:40 -05:00
5dc76a8348 llm-inference-multimodel: fix tool-calling support (jinja template + gpu-layers=20 for VRAM fit)
rblundon pushed to main at rblundon/homelab 2026-08-05 16:34:22 -05:00
a76ad3195c llm-inference-multimodel: fix verify.yml losing Gemma-stop gate when run with --tags verify
rblundon pushed to main at rblundon/homelab 2026-08-05 16:28:43 -05:00
73ef806dd6 llm-inference-multimodel: stop pre-existing Gemma service before Phase 4 starts new instances
rblundon pushed to main at rblundon/homelab 2026-08-05 16:22:02 -05:00
628dae06a8 llm-inference-multimodel: fix Phase 2 unexpectedly restarting both services
c3755aa29e llm-inference-multimodel: role + day1 playbook (phase 0 discover approved)
Compare 2 commits »
rblundon created branch master in rblundon/homelab 2026-08-05 15:53:40 -05:00
rblundon pushed to master at rblundon/homelab 2026-08-05 15:53:40 -05:00
c3755aa29e llm-inference-multimodel: role + day1 playbook (phase 0 discover approved)
rblundon pushed to main at rblundon/homelab 2026-08-05 12:14:19 -05:00
782cbe33d1 llm-inference: size ctx-size/parallel for aux task offload
rblundon pushed to main at rblundon/homelab 2026-08-05 09:44:01 -05:00
aff792a061 feat(llm-inference): move astro-orbiter monitoring to GitOps (values.yaml + dashboards.yaml)
aa8e229e64 fix(llm-inference): switch serve phase from vLLM+bitsandbytes to llama.cpp+GGUF
22a020e4c7 fix(llm-inference): bitsandbytes int4 OOM — pending switch to llama.cpp+GGUF
e879cf73d3 fix(llm-inference): gpu_exporter version 1.2.2 → 1.13.1 (correct release tag)
423891001c feat(llm-inference): Phase 7 — Prometheus monitoring + Grafana dashboard
Compare 6 commits »
rblundon pushed to main at rblundon/homelab 2026-08-01 22:15:18 -05:00
265d3f8fd6 jmri: remove one-shot xpra migration task (idempotency fix)
rblundon pushed to main at rblundon/homelab 2026-08-01 22:09:27 -05:00
b61d19cb91 jmri: add udev rule for LCC buffer (Microchip CDC -> jmri-lcc)
rblundon pushed to main at rblundon/homelab 2026-08-01 21:58:49 -05:00
00be18b1f1 jmri: move udev symlinks to /dev/jmri-* (flat, JMRI-enumerable)
rblundon pushed to main at rblundon/homelab 2026-08-01 21:55:50 -05:00
6c7ec507ef jmri: fix NCE udev rule — FTDI FT232 (ttyUSB), not Microchip CDC (ttyACM)
rblundon pushed to main at rblundon/homelab 2026-08-01 21:18:14 -05:00
63b0bc72fe jmri: deploy udev rules for stable /dev/jmri/* symlinks
rblundon pushed to main at rblundon/homelab 2026-08-01 21:07:39 -05:00
02af5d26dc jmri: fix xpra remove task idempotency (skip if already from upstream repo)