d95477fc3b
- Add ExternalName Service for astro-orbiter (10.1.71.130:8000) - Remove Ollama-specific configuration (OLLAMA_BASE_URLS) - Keep only OpenAI-compatible configuration (OPENAI_BASE_URL) Fixes: Open WebUI pod was attempting to use Ollama endpoints (/api/tags) against vLLM which only supports OpenAI-compatible API (/v1/models). Pod now reaches astro-orbiter via Kubernetes Service DNS name. Resolves: HTTP 404 errors from Upstream ollama request failed
38 lines
729 B
YAML
38 lines
729 B
YAML
apiVersion: v1
|
|
kind: Service
|
|
metadata:
|
|
name: astro-orbiter
|
|
namespace: default
|
|
labels:
|
|
app.kubernetes.io/name: astro-orbiter-gateway
|
|
app.kubernetes.io/component: llm-inference
|
|
spec:
|
|
type: ExternalName
|
|
externalName: 10.1.71.130
|
|
ports:
|
|
- name: vllm-8000
|
|
port: 8000
|
|
protocol: TCP
|
|
- name: llama-cpp-8001
|
|
port: 8001
|
|
protocol: TCP
|
|
- name: router-8002
|
|
port: 8002
|
|
protocol: TCP
|
|
---
|
|
apiVersion: v1
|
|
kind: Service
|
|
metadata:
|
|
name: astro-orbiter-vllm
|
|
namespace: default
|
|
labels:
|
|
app.kubernetes.io/name: astro-orbiter-gateway
|
|
app.kubernetes.io/component: llm-inference
|
|
spec:
|
|
type: ExternalName
|
|
externalName: 10.1.71.130
|
|
ports:
|
|
- name: vllm
|
|
port: 8000
|
|
protocol: TCP
|