docs(ollama): explain tool prompt cache reuse

2026-07-20 17:47:04 +08:00
parent 8423cf3eeb
commit 9d830fb6b6
4 changed files with 254 additions and 1 deletions
@@ -331,6 +331,13 @@ Start Ollama separately, then point nanobot at the OpenAI-compatible endpoint.

 Most Ollama setups do not require an API key.

+Ollama renders the OpenAI-compatible messages and tools through each model's chat
+template. If ordinary model responses are fast but tool-using turns show low prompt
+cache reuse, diagnose the rendered template before changing nanobot's context or
+memory settings. The
+[Ollama prompt-cache guide](./guides/configure-ollama-prompt-cache.md) explains the
+log pattern and a tested `llama3.1:8b` workaround.
+
 ### vLLM or Other Local OpenAI-Compatible Server

 ```json