rickub
docker-agent-cookbook/work-with-llama-cpppublic Fork
⑂ 4a30f5f
Branches
main View all branches → View all tags →
Commits
⬇ Clone ▾
git clone https://git.rickub.com/docker-agent-cookbook/work-with-llama-cpp.git
git clone ssh://git@rickub.com/docker-agent-cookbook/work-with-llama-cpp.git

Host key fingerprint (ed25519): SHA256:iycHnxEyq0Q7uyVpB7JlznP0G7JrTPXLYRcAU5CSLhc — verify it before your first connect.

Download ZIP

🛟 Updated.

k33g committed 2026-09-14T13:57:42+02:00 Browse files
4a30f5f parent: 87164b1
modified README.md +6 -2
@@ -10,7 +10,7 @@
1010 curl -LsSf https://llama.app/install.sh | sh
1111 ```
1212
13-### Start `llama.cpp` and download a model
13+#### Start `llama.cpp` and download a model
1414
1515 Run this:
1616 ```bash
@@ -20,7 +20,7 @@ llama serve -hf JetBrains/Mellum2-12B-A2.5B-Instruct-GGUF-Q4_K_M:Q4_K_M
2020 ![01-llamacpp](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/01-llamacpp.png)
2121 ![02-llamacpp](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/02-llamacpp.png)
2222
23-### Check the `llama.cpp server`
23+#### Check the `llama.cpp server`
2424
2525 ```bash
2626 # Server health
@@ -42,6 +42,10 @@ curl http://localhost:8080/v1/chat/completions \
4242 # {"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","content":"Hello!"}}], ...
4343 ```
4444
45+## Install Docker Agent
46+
47+> 🚧 work in progress
48+
4549 ## Create a Docker Agent configuration
4650
4751 **`agent.yaml`**:
@@ -10,7 +10,7 @@
10 curl -LsSf https://llama.app/install.sh | sh10 curl -LsSf https://llama.app/install.sh | sh
11 ```11 ```
12 12
13-### Start `llama.cpp` and download a model13+#### Start `llama.cpp` and download a model
14 14
15 Run this:15 Run this:
16 ```bash16 ```bash
@@ -20,7 +20,7 @@ llama serve -hf JetBrains/Mellum2-12B-A2.5B-Instruct-GGUF-Q4_K_M:Q4_K_M
20 ![01-llamacpp](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/01-llamacpp.png)20 ![01-llamacpp](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/01-llamacpp.png)
21 ![02-llamacpp](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/02-llamacpp.png)21 ![02-llamacpp](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/02-llamacpp.png)
22 22
23-### Check the `llama.cpp server`23+#### Check the `llama.cpp server`
24 24
25 ```bash25 ```bash
26 # Server health26 # Server health
@@ -42,6 +42,10 @@ curl http://localhost:8080/v1/chat/completions \
42 # {"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","content":"Hello!"}}], ...42 # {"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","content":"Hello!"}}], ...
43 ```43 ```
44 44
45+## Install Docker Agent
46+
47+> 🚧 work in progress
48+
45 ## Create a Docker Agent configuration49 ## Create a Docker Agent configuration
46 50
47 **`agent.yaml`**:51 **`agent.yaml`**: