mini-me on Kronk

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37

# mini-me on Kronk

`agent.kronk.yaml` runs mini-me on [Kronk](https://www.kronkai.com), the Go inference server of Ardan Labs, with `mradermacher/Qwopus3.5-4B-Coder.Q8_0`, a Qwen3.5 4B coder that thinks before it answers. Version française : [README.fr.md](README.fr.md).

## Run it

```bash
kronk model pull mradermacher/Qwopus3.5-4B-Coder.Q8_0
kronk server start                       # 127.0.0.1:11435
cd demos/kronk
../../mm -config agent.kronk.yaml
```

The banner should say `provider: kronk` and `ctx: 131072 (/v1/kronk/models)`.

A smaller model also works, Qwen3.5 2B. Kronk serves it under another id than the one it was pulled with:

```bash
kronk model pull unsloth/Qwen3.5-2B-GGUF:Q4_K_M --local   # with the server stopped
```

```yaml
model: unsloth/Qwen3.5-2B-Q4_K_M    # the id GET /v1/models gives
```

From a Docker sandbox, start Kronk on the host with `kronk server start --api-host 0.0.0.0:11435` and allow `localhost:11435` in the sandbox policy: `mm` falls back to `host.docker.internal:11435` by itself.

## What was checked (2026-11-11, Kronk 1.33.2, from an sbx sandbox)

- A turn with tool calls: the agent ran `wc -l`, created a file with `bash`, then read it back.
- `/unload`: `unloaded …`, then `… was not loaded: nothing to unload`.
- `mm init --provider kronk --check` wrote a file with the window (131072), the GGUF's sampling and the template's reasoning switch read from Kronk, and the model answered.
- Seen once: the model ended a turn with its answer in its reasoning and an empty text (`⚠ empty answer`). This comes from the model, not from Kronk.

Not checked live: a real download through `autoPull` (the stream was read on an installed model only), a compaction, and a protected Kronk (`KRONK_TOKEN`).

See [How to run mini-me on Kronk](../../docs/en/how-to/run-with-kronk.md).