rblundon
6112b6daea
- Create roles/paperclip-docker with full Docker Compose stack deployment - Template OpenCode v1.2.24 config (provider structure) with Gemma-4-26B model - Integrate vLLM endpoint (localhost:8000) with vault-injected API key auth - Wire secrets from ansible vault: vllm_api_key, cloudflare_token, paperclip auth secrets - Add pre-deployment checks (PostgreSQL, nginx, certbot cert management) - Implement idempotent stack lifecycle (containers, volumes, networking) - Deploy to RTX 3090 via muppet-vision.wdw-labs.cloud with nginx SSL termination Paperclip now serves as CEO reasoning engine with local Gemma inference, accessible to Hermes platform agents via OpenCode adapter on shared vLLM.
23 lines
507 B
Django/Jinja
23 lines
507 B
Django/Jinja
{
|
|
"$schema": "https://opencode.ai/config.json",
|
|
"provider": {
|
|
"vllm": {
|
|
"npm": "@ai-sdk/openai-compatible",
|
|
"name": "vLLM (Local)",
|
|
"models": {
|
|
"gemma-4-26b": {
|
|
"id": "Gemma-4-26B-A4B-it-AWQ",
|
|
"name": "Gemma 4 26B (Local AWQ)"
|
|
}
|
|
},
|
|
"options": {
|
|
"baseURL": "{{ vllm_endpoint }}/v1",
|
|
"headers": {
|
|
"Authorization": "Bearer {{ vault_vllm_api_key }}"
|
|
}
|
|
}
|
|
}
|
|
},
|
|
"model": "vllm/gemma-4-26b"
|
|
}
|