Fix Open WebUI connectivity to astro-orbiter
- Add ExternalName Service for astro-orbiter (10.1.71.130:8000) - Remove Ollama-specific configuration (OLLAMA_BASE_URLS) - Keep only OpenAI-compatible configuration (OPENAI_BASE_URL) Fixes: Open WebUI pod was attempting to use Ollama endpoints (/api/tags) against vLLM which only supports OpenAI-compatible API (/v1/models). Pod now reaches astro-orbiter via Kubernetes Service DNS name. Resolves: HTTP 404 errors from Upstream ollama request failed
This commit is contained in:
@@ -39,9 +39,8 @@ spec:
|
|||||||
name: body-wars-secret
|
name: body-wars-secret
|
||||||
key: vllm-api-key
|
key: vllm-api-key
|
||||||
optional: false
|
optional: false
|
||||||
# Backend configuration for vLLM
|
# Backend configuration for vLLM (OpenAI-compatible, NOT Ollama)
|
||||||
- name: OLLAMA_BASE_URLS
|
# OLLAMA_BASE_URLS removed: astro-orbiter runs vLLM, not Ollama
|
||||||
value: "http://astro-orbiter:8000"
|
|
||||||
- name: OPENAI_BASE_URL
|
- name: OPENAI_BASE_URL
|
||||||
value: "http://astro-orbiter:8000/v1"
|
value: "http://astro-orbiter:8000/v1"
|
||||||
- name: OPENAI_API_KEY
|
- name: OPENAI_API_KEY
|
||||||
|
|||||||
@@ -0,0 +1,37 @@
|
|||||||
|
apiVersion: v1
|
||||||
|
kind: Service
|
||||||
|
metadata:
|
||||||
|
name: astro-orbiter
|
||||||
|
namespace: default
|
||||||
|
labels:
|
||||||
|
app.kubernetes.io/name: astro-orbiter-gateway
|
||||||
|
app.kubernetes.io/component: llm-inference
|
||||||
|
spec:
|
||||||
|
type: ExternalName
|
||||||
|
externalName: 10.1.71.130
|
||||||
|
ports:
|
||||||
|
- name: vllm-8000
|
||||||
|
port: 8000
|
||||||
|
protocol: TCP
|
||||||
|
- name: llama-cpp-8001
|
||||||
|
port: 8001
|
||||||
|
protocol: TCP
|
||||||
|
- name: router-8002
|
||||||
|
port: 8002
|
||||||
|
protocol: TCP
|
||||||
|
---
|
||||||
|
apiVersion: v1
|
||||||
|
kind: Service
|
||||||
|
metadata:
|
||||||
|
name: astro-orbiter-vllm
|
||||||
|
namespace: default
|
||||||
|
labels:
|
||||||
|
app.kubernetes.io/name: astro-orbiter-gateway
|
||||||
|
app.kubernetes.io/component: llm-inference
|
||||||
|
spec:
|
||||||
|
type: ExternalName
|
||||||
|
externalName: 10.1.71.130
|
||||||
|
ports:
|
||||||
|
- name: vllm
|
||||||
|
port: 8000
|
||||||
|
protocol: TCP
|
||||||
Reference in New Issue
Block a user