feat: Add SearXNG module and update infrastructure
- Introduced a new SearXNG module with configuration for Kubernetes deployment, service, and ingress. - Updated existing Terraform app modules to include SearXNG in both dev-01 and prod-01 environments. - Added necessary variables and secrets for SearXNG in the respective Terraform files. - Updated Dockerfiles for llama.cpp and ollama to use latest versions. - Enhanced security and hardening defaults in Kubernetes deployments. - Improved documentation for Copilot instructions and Terraform workflows.
This commit is contained in:
@@ -12,10 +12,12 @@
|
||||
build:
|
||||
dockerfile: "{{ lookup('file', 'dockerfiles/Dockerfile.ollama.rocm') }}"
|
||||
env:
|
||||
OLLAMA_CONTEXT_SIZE: 65536
|
||||
OLLAMA_NUM_THREADS: 6
|
||||
OLLAMA_NUM_PARALLEL: 1
|
||||
OLLAMA_CONTEXT_LENGTH: 4096
|
||||
OLLAMA_NUM_THREADS: 10
|
||||
OLLAMA_NUM_PARALLEL: 2
|
||||
OLLAMA_FLASH_ATTENTION: 1
|
||||
OLLAMA_KV_CACHE: "true"
|
||||
HSA_OVERRIDE_GFX_VERSION: "11.0.0"
|
||||
ports:
|
||||
- "0.0.0.0:{{ ollama_port | default(11434) }}:11434/tcp"
|
||||
volumes:
|
||||
|
||||
Reference in New Issue
Block a user