feat(astro-orbiter): bump Qwen3.8-27B ctx-size 32768->131072 (128K) [t_441470b9]
This commit is contained in:
38
ansible/playbooks/day2_qwen38_ctx128k.yml
Normal file
38
ansible/playbooks/day2_qwen38_ctx128k.yml
Normal file
@@ -0,0 +1,38 @@
|
||||
---
|
||||
# ------------------------------------------------------------------------------
|
||||
# Playbook: day2_qwen38_ctx128k.yml
|
||||
# Purpose: Bump Qwen3.8-27B-Q4_K_M ctx-size from 32768 to 131072 (128K)
|
||||
# on astro-orbiter's production router (port 8002).
|
||||
#
|
||||
# What this playbook does:
|
||||
# 1. Renders the updated llama-server-router-preset.ini.j2 (now with
|
||||
# llm_router_qwen38_ctx_size: 131072) to /opt/llama-server-router-preset.ini.
|
||||
# 2. Restarts llama-server-router.service.
|
||||
# 3. Verifies the router loads Qwen3.8-27B at ctx=131072 in status.args.
|
||||
#
|
||||
# Context:
|
||||
# - Empirical VRAM test (t_4455a44c): 131072 ctx = 20,282 MiB Qwen3.8
|
||||
# + 558 MiB nomic-embed = ~20.8GB total; ~3.2GB headroom on 24GB RTX 3090.
|
||||
# Co-resident with nomic-embed: comfortably fits.
|
||||
# - Ryan approved this deployment.
|
||||
# - Semaphore SSH gap for astro-orbiter still applies (t_730f9584 / t_33acbb2e);
|
||||
# running direct CLI Ansible per standing exception.
|
||||
#
|
||||
# Run:
|
||||
# cd /home/hermes/git/homelab/ansible
|
||||
# env -u ANSIBLE_VAULT_PASSWORD_FILE ansible-playbook \
|
||||
# -i inventory.yml \
|
||||
# playbooks/day2_qwen38_ctx128k.yml
|
||||
#
|
||||
# Task reference: t_441470b9 — War Machine, 2026-08-16
|
||||
# ------------------------------------------------------------------------------
|
||||
- name: Bump Qwen3.8-27B ctx-size to 131072 on astro-orbiter
|
||||
hosts: astro-orbiter
|
||||
become: true
|
||||
vars:
|
||||
llm_router_preset_enabled: true
|
||||
llm_router_qwen38_ctx_size: 131072
|
||||
|
||||
roles:
|
||||
- role: llm-inference-multimodel
|
||||
tags: [preset, systemd, verify]
|
||||
Reference in New Issue
Block a user