feat: Add SearXNG module and update infrastructure
- Introduced a new SearXNG module with configuration for Kubernetes deployment, service, and ingress. - Updated existing Terraform app modules to include SearXNG in both dev-01 and prod-01 environments. - Added necessary variables and secrets for SearXNG in the respective Terraform files. - Updated Dockerfiles for llama.cpp and ollama to use latest versions. - Enhanced security and hardening defaults in Kubernetes deployments. - Improved documentation for Copilot instructions and Terraform workflows.
This commit is contained in:
@@ -16,13 +16,17 @@
|
||||
OLLAMA_NUM_THREADS: 6
|
||||
OLLAMA_NUM_PARALLEL: 1
|
||||
OLLAMA_KV_CACHE: "true"
|
||||
OLLAMA_VULKAN: 1
|
||||
GGML_VK_VISIBLE_DEVICES: 0,1,2
|
||||
OLLAMA_NUM_GPU: 99
|
||||
ports:
|
||||
- "0.0.0.0:{{ ollama_port | default(11434) }}:11434/tcp"
|
||||
volumes:
|
||||
- "{{ ollama_home }}/data:/home/worker/.ollama:Z"
|
||||
device:
|
||||
- "nvidia.com/gpu=all"
|
||||
|
||||
- "/dev/kfd:/dev/kfd:rw"
|
||||
- "/dev/dri:/dev/dri:rw"
|
||||
tasks:
|
||||
- name: Setup Pods
|
||||
ansible.builtin.include_tasks:
|
||||
|
||||
Reference in New Issue
Block a user