Fix Open WebUI connectivity to astro-orbiter

- Add ExternalName Service for astro-orbiter (10.1.71.130:8000)
- Remove Ollama-specific configuration (OLLAMA_BASE_URLS)
- Keep only OpenAI-compatible configuration (OPENAI_BASE_URL)

Fixes: Open WebUI pod was attempting to use Ollama endpoints (/api/tags)
against vLLM which only supports OpenAI-compatible API (/v1/models).
Pod now reaches astro-orbiter via Kubernetes Service DNS name.

Resolves: HTTP 404 errors from Upstream ollama request failed
This commit is contained in:
Hermes Agent service account
2026-09-01 13:14:03 -05:00
parent 274ce1fd8a
commit d95477fc3b
2 changed files with 39 additions and 3 deletions

View File

@@ -39,9 +39,8 @@ spec:
name: body-wars-secret name: body-wars-secret
key: vllm-api-key key: vllm-api-key
optional: false optional: false
# Backend configuration for vLLM # Backend configuration for vLLM (OpenAI-compatible, NOT Ollama)
- name: OLLAMA_BASE_URLS # OLLAMA_BASE_URLS removed: astro-orbiter runs vLLM, not Ollama
value: "http://astro-orbiter:8000"
- name: OPENAI_BASE_URL - name: OPENAI_BASE_URL
value: "http://astro-orbiter:8000/v1" value: "http://astro-orbiter:8000/v1"
- name: OPENAI_API_KEY - name: OPENAI_API_KEY

View File

@@ -0,0 +1,37 @@
apiVersion: v1
kind: Service
metadata:
name: astro-orbiter
namespace: default
labels:
app.kubernetes.io/name: astro-orbiter-gateway
app.kubernetes.io/component: llm-inference
spec:
type: ExternalName
externalName: 10.1.71.130
ports:
- name: vllm-8000
port: 8000
protocol: TCP
- name: llama-cpp-8001
port: 8001
protocol: TCP
- name: router-8002
port: 8002
protocol: TCP
---
apiVersion: v1
kind: Service
metadata:
name: astro-orbiter-vllm
namespace: default
labels:
app.kubernetes.io/name: astro-orbiter-gateway
app.kubernetes.io/component: llm-inference
spec:
type: ExternalName
externalName: 10.1.71.130
ports:
- name: vllm
port: 8000
protocol: TCP