Hermes Agent service account ad70b3439c feat(llm): add nomic-embed-text-v1.5-Q4_K_M to astro-orbiter router ...

OpenViking Phase 1b (t_34b96e83) — Ryan-approved implementation.

Changes:
- roles/llm-inference-multimodel/templates/llama-server-router-preset.ini.j2:
  Add [nomic-embed-text-v1.5] section with embedding=true, n-gpu-layers=99,
  ctx-size=8192, load-on-startup=true, sleep-idle-seconds=-1. No flash-attn
  or KV cache params (embedding models use bidirectional forward pass, not
  autoregressive KV cache). Var: llm_router_nomic_ctx_size.

- roles/llm-inference-multimodel/defaults/main.yml:
  Add llm_router_nomic_ctx_size: 8192.

- host_vars/astro-orbiter/vars.yml:
  Add nomic-embed-text-v1.5-Q4_K_M.gguf to llm_staged_models list
  (size_bytes: 84106624, source: nomic-ai/nomic-embed-text-v1.5-GGUF).
  Update VRAM note to reflect 5 registered models (nomic adds ~84MB,
  negligible given sleep-idle-seconds=-1 / load-on-startup=true pinning).

- playbooks/day2_add_nomic_embed.yml:
  New day2 playbook following the coder-alias pattern:
  Phase 1: idempotent GGUF download (exact size check)
  Phase 2: redeploy preset INI
  Phase 3: redeploy + restart systemd unit
  Phase 4: /v1/models gate (all 5 models present)
  Phase 5: /v1/embeddings smoke test (vector returned, not empty)

VRAM: ~84MB, always pinned. No impact on generative model LRU behavior.
peter-parker Helm values already point at :8002 for the embedding endpoint.

2026-08-13 23:18:27 -05:00

..

templates

sync all

2025-09-26 11:55:32 -05:00

add_dhcp_reservation.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

add_dns_entry.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

add_service_route.yml

Revert "fix(playbooks): replace effectivelywild.technitium_dns collection with ansible.builtin.uri"

2026-06-07 16:39:07 -05:00

add_technitium_dns_entry.yml.backup

Sync 11-19

2025-11-19 09:36:59 -08:00

configure_proxmox_oidc.yml

ansible for proxmox config

2026-03-09 22:36:42 -05:00

configure_unbound.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

create_vm_from_clone.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

create_vm.yml

ansible vm creation (depreciated)

2025-11-21 05:48:43 -08:00

day0_baseline.yml

chore(playbooks): switch day0_baseline.yml to new day0-baseline role

2026-05-28 22:06:49 -05:00

day0_expand_root_lv.yml

feat(day0): promote expand_root_lv to a canonical day0 step

2026-05-30 23:08:35 -05:00

day0_linux_baseline.yml

feat(ansible): add linux-baseline role and day0_linux_baseline playbook

2026-05-29 20:40:04 -05:00

day0_provision.yml

feat(day0): promote expand_root_lv to a canonical day0 step

2026-05-30 23:08:35 -05:00

day1_configure_netbox_catalog.yml

deploy hermes

2026-05-25 20:21:24 -05:00

day1_deploy_authentik.yml

gitea and authentik

2026-05-16 16:22:14 -05:00

day1_deploy_gitea.yml

Deploy gites

2026-05-07 22:07:53 -05:00

day1_deploy_hermes.yml

deply hermes VM

2026-05-26 11:48:23 -05:00

day1_deploy_honcho.yml

feat(day0): promote expand_root_lv to a canonical day0 step

2026-05-30 23:08:35 -05:00

day1_deploy_jmri.yml

feat: add JMRI headless server role and main-street-station host

2026-07-18 19:35:01 -05:00

day1_deploy_llm_inference_multimodel.yml

feat(llm-inference-multimodel): codify Phi-3.5-mini + Llama-3.1-8B GGUF staging (t_730f9584)

2026-08-12 22:19:34 -05:00

day1_deploy_llm_inference.yml

feat(llm-inference): Day 1 playbook for RTX 3090 vLLM stack on astro-orbiter

2026-08-03 11:51:34 -05:00

day1_deploy_llm_router_shadow.yml

feat(llm-inference): add llama.cpp router mode shadow deployment

2026-08-12 20:23:00 -05:00

day1_deploy_nextcloud.yml

deploy nextcloud

2026-04-18 00:36:40 -05:00

day1_deploy_ollama.yml

deploy hermes

2026-05-25 20:21:24 -05:00

day1_deploy_semaphore.yml

feat(semaphore): rewrite role with rootful Podman Quadlet + PostgreSQL

2026-05-29 21:34:22 -05:00

day1_deploy_traefik.yml

Deploy gites

2026-05-07 22:07:53 -05:00

day1_docker.yml

deploy hermes

2026-05-25 20:21:24 -05:00

day2_add_coder_alias.yml

Add Qwen2.5-Coder-14B-Instruct-4bit to astro-orbiter router (t_55c164f5)

2026-08-13 09:07:02 -05:00

day2_add_nomic_embed.yml

feat(llm): add nomic-embed-text-v1.5-Q4_K_M to astro-orbiter router

2026-08-13 23:18:27 -05:00

day2_add_phi_alias.yml

feat(llm-router): switch to --models-preset mode; add Phi-3.5-mini-instruct-8bit alias (t_9adf0889)

2026-08-12 22:58:12 -05:00

day2_bump_router_models_max.yml

feat(llm-inference-multimodel): bump router --models-max 1->4 on astro-orbiter (t_33acbb2e)

2026-08-12 22:26:49 -05:00

day2_cutover_qwen_to_router.yml

feat: add day2_cutover_qwen_to_router.yml playbook (t_cd0d5388)

2026-08-12 20:41:11 -05:00

day2_install_node_exporter.yml

add grafana dashboards

2026-05-19 21:12:54 -05:00

del_dns_entry.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

deploy_n8n_server.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

deploy_ntp_servers.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

deploy_step_ca.yml

deploy step

2026-03-14 22:15:28 -05:00

enroll_step_ca_client.yml

redeploy authentic policies as code.

2026-03-21 14:00:37 -05:00

install_monitoring.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

install_talosctl.yml

redeploy authentic policies as code.

2026-03-21 14:00:37 -05:00

monitoring.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

node_explorer.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

populate_cloud_init.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

prometheus_grafana_server.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

proxmox_clone_vm.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

proxmox_create_vm.yml

ansible vm creation (depreciated)

2025-11-21 05:48:43 -08:00

proxmox_start_vm.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

set_hostname.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

test_connectivity.yml

added test playbook

2026-03-22 23:47:47 -05:00

test_step_ca.yml

update test file

2026-03-19 16:44:59 -05:00

test-dns-cname.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

test.yml

Sync 11-19

2025-11-19 09:36:59 -08:00

update_traefik_routes.yml

ansible for authentik deployment.

2026-03-08 20:30:51 -05:00

update-linux-os.yml

Sync 11-19

2025-11-19 09:36:59 -08:00