bots-garden/houlapublic Fork
⑂ v0.0.0
Commits
⬇ Clone ▾
git clone https://git.rickub.com/bots-garden/houla.git
git clone ssh://git@rickub.com/bots-garden/houla.git

Host key fingerprint (ed25519): SHA256:iycHnxEyq0Q7uyVpB7JlznP0G7JrTPXLYRcAU5CSLhc — verify it before your first connect.

Download ZIP
🛟 Updated. 1dfc968Unverified · on v0.0.0 · k33g · 4h ago
llama-cpp-olala-context.md · 9 lines · 597 Bmarkdown
Blame HistoryOpen raw

llama.cpp (OVHai Olala fork)

llama-server and llama-cli on the PATH come from the OVHai fork of llama.cpp
(/opt/llama-cpp-olala, commit in /opt/llama-cpp-olala/REVISION), CPU only.
They load olala GGUF models, which upstream llama.cpp cannot.

  • Serve: llama-server -m <file.gguf> -t <threads> -fa 1 -nr -ctk q8_0 -ctv q8_0 -c 32768 -np 4 --host 0.0.0.0 --port 8080
  • In this project, prefer scripts/olala.sh up|serve|stop|status (downloads the model if needed).
  • Recommended sampling: temperature=0.8, top_p=0.9, top_k=40; reasoning_effort: disabled, low, medium, high.
1
2
3
4
5
6
7
8
9
# llama.cpp (OVHai Olala fork)

`llama-server` and `llama-cli` on the PATH come from the OVHai fork of llama.cpp
(`/opt/llama-cpp-olala`, commit in `/opt/llama-cpp-olala/REVISION`), CPU only.
They load `olala` GGUF models, which upstream llama.cpp cannot.

- Serve: `llama-server -m <file.gguf> -t <threads> -fa 1 -nr -ctk q8_0 -ctv q8_0 -c 32768 -np 4 --host 0.0.0.0 --port 8080`
- In this project, prefer `scripts/olala.sh up|serve|stop|status` (downloads the model if needed).
- Recommended sampling: `temperature=0.8`, `top_p=0.9`, `top_k=40`; `reasoning_effort`: disabled, low, medium, high.