alexandre.pires
e9e28a5ca8
- Created model files for Qwen3.5 with different context lengths. - Added a new Ansible host variable file for CI server configuration. - Updated GPU server host variables to include Ollama models and model files. - Enhanced playbooks for Podman to manage Ollama models, including copying model files and checking existing models. - Introduced a new playbook for setting up Qwen3.6 with specific configurations. - Updated Windows SSH tasks to improve security and configuration management. - Added a Python utility to parse Ollama model names from command output. - Modified Terraform configurations to include new DNS entries and proxy settings. - Improved Nginx proxy configurations with timeout settings.
11 lines
325 B
Docker
11 lines
325 B
Docker
FROM ghcr.io/ggml-org/llama.cpp:server-cuda
|
|
|
|
ARG UID=1000
|
|
ARG GID=1000
|
|
RUN groupadd --system --gid ${GID} worker && \
|
|
useradd --system --gid ${GID} --uid ${UID} --home /home/worker worker && \
|
|
mkdir -p /home/worker && chown worker:worker /home/worker
|
|
|
|
WORKDIR /home/worker
|
|
USER worker
|
|
ENTRYPOINT ["/app/llama-server"] |