rickub
docker-agent-cookbook/work-with-llama-cpppublic Fork
⑂ dc51f7c
Branches
main View all branches → View all tags →
Commits
⬇ Clone ▾
git clone https://git.rickub.com/docker-agent-cookbook/work-with-llama-cpp.git
git clone ssh://git@rickub.com/docker-agent-cookbook/work-with-llama-cpp.git

Host key fingerprint (ed25519): SHA256:iycHnxEyq0Q7uyVpB7JlznP0G7JrTPXLYRcAU5CSLhc — verify it before your first connect.

Download ZIP

🛟 Updated.

k33g committed 2026-09-15T10:31:08+02:00 Browse files
dc51f7c parent: 4a30f5f
modified .gitignore +2 -1
@@ -1,2 +1,3 @@
11 tmp
2-
2+demo-kotlin
3+blog
@@ -1,2 +1,3 @@
1 tmp1 tmp
2-2+demo-kotlin
3+blog
modified README.md +4 -1
@@ -1,6 +1,5 @@
11 # [Docker Agent] Work with `llama.cpp`
22
3-
43 ## Prerequisites
54
65 ### Install `llama.cpp`
@@ -42,6 +41,8 @@ curl http://localhost:8080/v1/chat/completions \
4241 # {"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","content":"Hello!"}}], ...
4342 ```
4443
44+
45+
4546 ## Install Docker Agent
4647
4748 > 🚧 work in progress
@@ -54,6 +55,7 @@ providers:
5455 llamacpp:
5556 api_type: openai_chatcompletions
5657 base_url: http://localhost:8080/v1
58+ #base_url: http://host.docker.internal:8080/v1
5759
5860 models:
5961 mellum2:
@@ -89,3 +91,4 @@ docker agent run agent.yaml
8991
9092 ![03-docker-agent](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/03-docker-agent.png)
9193 ![04-docker-agent](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/04-docker-agent.png)
94+
@@ -1,6 +1,5 @@
1 # [Docker Agent] Work with `llama.cpp`1 # [Docker Agent] Work with `llama.cpp`
2 2
3-
4 ## Prerequisites3 ## Prerequisites
5 4
6 ### Install `llama.cpp`5 ### Install `llama.cpp`
@@ -42,6 +41,8 @@ curl http://localhost:8080/v1/chat/completions \
42 # {"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","content":"Hello!"}}], ...41 # {"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","content":"Hello!"}}], ...
43 ```42 ```
44 43
44+
45+
45 ## Install Docker Agent46 ## Install Docker Agent
46 47
47 > 🚧 work in progress48 > 🚧 work in progress
@@ -54,6 +55,7 @@ providers:
54 llamacpp:55 llamacpp:
55 api_type: openai_chatcompletions56 api_type: openai_chatcompletions
56 base_url: http://localhost:8080/v157 base_url: http://localhost:8080/v1
58+ #base_url: http://host.docker.internal:8080/v1
57 59
58 models:60 models:
59 mellum2:61 mellum2:
@@ -89,3 +91,4 @@ docker agent run agent.yaml
89 91
90 ![03-docker-agent](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/03-docker-agent.png)92 ![03-docker-agent](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/03-docker-agent.png)
91 ![04-docker-agent](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/04-docker-agent.png)93 ![04-docker-agent](/docker-agent-cookbook/work-with-llama-cpp/raw/main/assets/04-docker-agent.png)
94+