feat(ai): Update Ollama and Open WebUI configurations
Ollama: - Replace Tinyauth middleware with Authelia + local-only - Enable NVIDIA GPU support Open WebUI: - Update RAG search engine to DuckDuckGo - Disable SSL verification for RAG web loader - Change default model to qwen2.5:3b - Remove Tinyauth middleware comment
This commit is contained in:
parent
249903825b
commit
ffff392aa0
2 changed files with 12 additions and 18 deletions
|
|
@ -20,17 +20,14 @@ services:
|
||||||
- homelab
|
- homelab
|
||||||
|
|
||||||
# GPU Support (NVIDIA GTX 1070)
|
# GPU Support (NVIDIA GTX 1070)
|
||||||
# Uncomment the deploy section below to enable GPU acceleration
|
runtime: nvidia
|
||||||
# Prerequisites:
|
deploy:
|
||||||
# 1. Install NVIDIA Container Toolkit on host
|
resources:
|
||||||
# 2. Configure Docker to use nvidia runtime
|
reservations:
|
||||||
# deploy:
|
devices:
|
||||||
# resources:
|
- driver: nvidia
|
||||||
# reservations:
|
count: 1
|
||||||
# devices:
|
capabilities: [gpu]
|
||||||
# - driver: nvidia
|
|
||||||
# count: 1
|
|
||||||
# capabilities: [gpu]
|
|
||||||
|
|
||||||
labels:
|
labels:
|
||||||
# Traefik (API only, no web UI)
|
# Traefik (API only, no web UI)
|
||||||
|
|
@ -44,7 +41,7 @@ services:
|
||||||
traefik.http.services.ollama.loadbalancer.server.port: 11434
|
traefik.http.services.ollama.loadbalancer.server.port: 11434
|
||||||
|
|
||||||
# SSO Protection for API and restrict to local network
|
# SSO Protection for API and restrict to local network
|
||||||
traefik.http.routers.ollama.middlewares: tinyauth,local-only
|
traefik.http.routers.ollama.middlewares: local-only@docker,authelia@docker
|
||||||
|
|
||||||
# Homarr Discovery
|
# Homarr Discovery
|
||||||
homarr.name: Ollama (LLM)
|
homarr.name: Ollama (LLM)
|
||||||
|
|
|
||||||
|
|
@ -19,13 +19,11 @@ services:
|
||||||
|
|
||||||
# Enable RAG (Retrieval-Augmented Generation)
|
# Enable RAG (Retrieval-Augmented Generation)
|
||||||
- ENABLE_RAG_WEB_SEARCH=true
|
- ENABLE_RAG_WEB_SEARCH=true
|
||||||
- RAG_WEB_SEARCH_ENGINE=searxng
|
- RAG_WEB_SEARCH_ENGINE=duckduckgo
|
||||||
|
- ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION=false
|
||||||
# Web search (optional, requires searxng)
|
|
||||||
- ENABLE_RAG_WEB_SEARCH=false
|
|
||||||
|
|
||||||
# Default model
|
# Default model
|
||||||
- DEFAULT_MODELS=qwen2.5-coder:7b
|
- DEFAULT_MODELS=qwen2.5:3b
|
||||||
|
|
||||||
networks:
|
networks:
|
||||||
- homelab
|
- homelab
|
||||||
|
|
@ -43,7 +41,6 @@ services:
|
||||||
|
|
||||||
# No SSO - Open WebUI has its own auth system
|
# No SSO - Open WebUI has its own auth system
|
||||||
# Uncomment to add SSO protection:
|
# Uncomment to add SSO protection:
|
||||||
# traefik.http.routers.open-webui.middlewares: tinyauth
|
|
||||||
|
|
||||||
# Homarr Discovery
|
# Homarr Discovery
|
||||||
homarr.name: Open WebUI (AI Chat)
|
homarr.name: Open WebUI (AI Chat)
|
||||||
|
|
|
||||||
Loading…
Reference in a new issue