dda6b91330
- nvidia-driver-595-open (already installed 2026-08-03, idempotent) - Python venv + vLLM 0.26.0 (already installed, idempotent) - Gemma 2 27B model download via HuggingFace hub - systemd vllm-serve.service on port 8000 - Hermes provider integration on carousel-of-progress - vault_hf_token added to group_vars/all/vault - ansible.cfg: vault_password_file set to absolute path - inventory: astro_orbiter group added Run with: env -u ANSIBLE_VAULT_PASSWORD_FILE ansible-playbook -i inventory.yml playbooks/day1_deploy_llm_inference.yml
46 lines
1.4 KiB
YAML
46 lines
1.4 KiB
YAML
---
|
|
# ------------------------------------------------------------------------------
|
|
# FILE: roles/llm-inference/tasks/foundation.yml
|
|
# DESCRIPTION: Phase 1 — Foundation.
|
|
# - Asserts vault secret is defined
|
|
# - Adds jarvis user to nvidia GPU groups
|
|
# - Creates HuggingFace cache directory
|
|
# - Creates venv parent directory
|
|
# NOTE: NVIDIA driver install (Phase 2) already performed manually on
|
|
# 2026-08-03 (nvidia-driver-595-open, DKMS built, nvidia-smi verified).
|
|
# Phase 2 tasks are idempotent and will no-op on astro-orbiter.
|
|
# ------------------------------------------------------------------------------
|
|
|
|
- name: Assert HuggingFace token is defined in vault
|
|
ansible.builtin.assert:
|
|
that:
|
|
- vault_hf_token is defined
|
|
- vault_hf_token | length > 0
|
|
fail_msg: >
|
|
vault_hf_token is not defined. Add it to group_vars/all/vault:
|
|
vault_hf_token: "hf_xxxxxxxxxxxxxxxxxxxx"
|
|
|
|
- name: Add jarvis user to nvidia GPU groups
|
|
ansible.builtin.user:
|
|
name: jarvis
|
|
groups:
|
|
- video
|
|
- render
|
|
append: true
|
|
|
|
- name: Create HuggingFace cache directory
|
|
ansible.builtin.file:
|
|
path: "{{ llm_hf_cache_dir }}"
|
|
state: directory
|
|
owner: jarvis
|
|
group: jarvis
|
|
mode: "0755"
|
|
|
|
- name: Create venv parent directory
|
|
ansible.builtin.file:
|
|
path: "{{ llm_venv_path | dirname }}"
|
|
state: directory
|
|
owner: jarvis
|
|
group: jarvis
|
|
mode: "0755"
|