Set OPENAI_API_BASE_URL (config.py default) to our local vLLM endpoint. Open WebUI was using hardcoded 'https://api.openai.com/v1' for model discovery.
2.7 KiB
2.7 KiB
Set OPENAI_API_BASE_URL (config.py default) to our local vLLM endpoint. Open WebUI was using hardcoded 'https://api.openai.com/v1' for model discovery.