rickub
docker-agent-cookbook/work-with-llama-cpppublic Fork
⑂ 87164b1
Branches
main View all branches → View all tags →
Commits
⬇ Clone ▾
git clone https://git.rickub.com/docker-agent-cookbook/work-with-llama-cpp.git
git clone ssh://git@rickub.com/docker-agent-cookbook/work-with-llama-cpp.git

Host key fingerprint (ed25519): SHA256:iycHnxEyq0Q7uyVpB7JlznP0G7JrTPXLYRcAU5CSLhc — verify it before your first connect.

Download ZIP

🛟 Updated.

k33g committed 2026-09-14T13:54:14+02:00 Browse files
87164b1 parent: cc81569
modified README.md +0 -3
@@ -18,10 +18,8 @@ llama serve -hf JetBrains/Mellum2-12B-A2.5B-Instruct-GGUF-Q4_K_M:Q4_K_M
1818 ```
1919
2020 ![01-llamacpp](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/01-llamacpp.png)
21-
2221 ![02-llamacpp](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/02-llamacpp.png)
2322
24-
2523 ### Check the `llama.cpp server`
2624
2725 ```bash
@@ -85,6 +83,5 @@ docker agent run agent.yaml
8583 ```
8684 > or `docker-agent run agent.yaml` depending your installation
8785
88-
8986 ![03-docker-agent](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/03-docker-agent.png)
9087 ![04-docker-agent](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/04-docker-agent.png)
@@ -18,10 +18,8 @@ llama serve -hf JetBrains/Mellum2-12B-A2.5B-Instruct-GGUF-Q4_K_M:Q4_K_M
18 ```18 ```
19 19
20 ![01-llamacpp](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/01-llamacpp.png)20 ![01-llamacpp](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/01-llamacpp.png)
21-
22 ![02-llamacpp](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/02-llamacpp.png)21 ![02-llamacpp](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/02-llamacpp.png)
23 22
24-
25 ### Check the `llama.cpp server`23 ### Check the `llama.cpp server`
26 24
27 ```bash25 ```bash
@@ -85,6 +83,5 @@ docker agent run agent.yaml
85 ```83 ```
86 > or `docker-agent run agent.yaml` depending your installation84 > or `docker-agent run agent.yaml` depending your installation
87 85
88-
89 ![03-docker-agent](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/03-docker-agent.png)86 ![03-docker-agent](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/03-docker-agent.png)
90 ![04-docker-agent](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/04-docker-agent.png)87 ![04-docker-agent](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/04-docker-agent.png)