Hermes Agent service account 782cbe33d1 llm-inference: size ctx-size/parallel for aux task offload ...

Previous ctx-size=8192/parallel=4 gave 2048 tokens/slot, too small for
context compression inputs (observed live rejection at 3826 tokens).

Measured VRAM on astro-orbiter (RTX 3090 24GB): weights ~17GB resident,
~294KiB/token pool-wide for KV cache+buffers at prior sizing.

New: ctx-size=16384, parallel=2 -> 8192 tokens/slot (matches model's
native n_ctx_train max). Projected VRAM ~21.8GB, ~2.7GB headroom.

Applied directly via ansible-playbook (Semaphore currently broken --
fix tracked separately).

2026-08-05 12:14:11 -05:00

..

~/_out

ansible vm creation (depreciated)

2025-11-21 05:48:43 -08:00

group_vars

feat(llm-inference): Day 1 playbook for RTX 3090 vLLM stack on astro-orbiter

2026-08-03 11:51:34 -05:00

host_vars

feat(llm-inference): move astro-orbiter monitoring to GitOps (values.yaml + dashboards.yaml)

2026-08-05 09:43:54 -05:00

inventory

feat: create pipeline directory structure (terraform, n8n, netbox, docs)

2026-02-25 20:51:26 -06:00

playbooks

feat(llm-inference): Day 1 playbook for RTX 3090 vLLM stack on astro-orbiter

2026-08-03 11:51:34 -05:00

roles

llm-inference: size ctx-size/parallel for aux task offload

2026-08-05 12:14:11 -05:00

scripts

chore: archive deprecated Ansible content (OpenShift, Fastpass, FreeIPA, k8s)

2026-02-25 20:44:49 -06:00

tasks

refactor: move shared Ansible tasks to ansible/tasks/

2026-02-25 20:51:02 -06:00

templates

Move ansible to it's own directory structure

2025-07-30 12:41:18 -05:00

ansible.cfg

feat(llm-inference): Day 1 playbook for RTX 3090 vLLM stack on astro-orbiter

2026-08-03 11:51:34 -05:00

create_jarvis_user.yml

refactor: consolidate all roles into ansible/roles/ and update ansible.cfg

2026-05-26 22:22:08 -05:00

DNS_MANAGEMENT_REFACTOR.md

Sync 11-19

2025-11-19 09:36:59 -08:00

inventory.yml

feat(llm-inference): move astro-orbiter monitoring to GitOps (values.yaml + dashboards.yaml)

2026-08-05 09:43:54 -05:00

mk

Sync 11-19

2025-11-19 09:36:59 -08:00

requirements.yml

fix(add_service_route): use FQDN for lightning-lane + add technitium collection

2026-05-30 23:43:57 -05:00