[IMPLEMENTATION] Claw Code + Ollama Local Inference — WORKING #347

New Issue

ezra · 2026-04-02T17:10:55Z

ezra commented

2026-04-02 17:10:55 +00:00

[IMPLEMENTATION] Claw Code + Ollama — Local First Achieved

Status: ✅ WORKING ON LIGHTBRO
Priority: Critical path for migration
Tested: 2026-04-02

SUMMARY

Successfully integrated Claw Code with Ollama local inference:

✅ Claw Code binary: 11MB (built)
✅ Ollama provider: Working
✅ Local inference: No API costs
✅ Models: 0.5B to 7.5B+ supported

The Key:

export ANTHROPIC_API_KEY="ollama"
export ANTHROPIC_BASE_URL="http://localhost:11434"

Result: Claw Code talks to Ollama's OpenAI-compatible API.

VERIFICATION

Test Command:

rusty-claude-cli --model qwen2.5:1.5b prompt "You are Bilbo Baggins. Say hello:"

Output:

Hello, I am Bilbo Baggins! A hobbit of the Shire. How may I assist you today?

Time: ~25s (local 1.5B model)
Cost: $0 (local inference)
Memory: Minimal (Ollama managed)

CODE CHANGES

Modified: claw-code/rust/crates/api/src/provider.rs

Added ollama() provider method
Added "ollama" to from_env() match

Build:

cd /root/wizards/substrate/claw-code/rust
cargo build --release

NEXT: BILBO AB TEST

With Ollama working, Bilbo AB test can proceed:

Create Bilbo Claw wrapper
Test personality preservation
Measure vs Python Bilbo
GO/NO-GO decision

Linked: #337 (migration epic), #343 (burn down)

# [IMPLEMENTATION] Claw Code + Ollama — Local First Achieved **Status:** ✅ WORKING ON LIGHTBRO **Priority:** Critical path for migration **Tested:** 2026-04-02 --- ## SUMMARY Successfully integrated Claw Code with Ollama local inference: - ✅ Claw Code binary: 11MB (built) - ✅ Ollama provider: Working - ✅ Local inference: No API costs - ✅ Models: 0.5B to 7.5B+ supported **The Key:** ```bash export ANTHROPIC_API_KEY="ollama" export ANTHROPIC_BASE_URL="http://localhost:11434" ``` **Result:** Claw Code talks to Ollama's OpenAI-compatible API. --- ## VERIFICATION **Test Command:** ```bash rusty-claude-cli --model qwen2.5:1.5b prompt "You are Bilbo Baggins. Say hello:" ``` **Output:** ``` Hello, I am Bilbo Baggins! A hobbit of the Shire. How may I assist you today? ``` **Time:** ~25s (local 1.5B model) **Cost:** $0 (local inference) **Memory:** Minimal (Ollama managed) --- ## CODE CHANGES **Modified:** `claw-code/rust/crates/api/src/provider.rs` - Added `ollama()` provider method - Added "ollama" to `from_env()` match **Build:** ```bash cd /root/wizards/substrate/claw-code/rust cargo build --release ``` --- ## NEXT: BILBO AB TEST With Ollama working, Bilbo AB test can proceed: 1. Create Bilbo Claw wrapper 2. Test personality preservation 3. Measure vs Python Bilbo 4. GO/NO-GO decision --- Linked: #337 (migration epic), #343 (burn down)

Rockachopa was assigned by ezra

2026-04-02 17:10:55 +00:00

ezra referenced this issue

2026-04-02 18:32:11 +00:00

[RESEARCH] Gemma 4 Investigation — No Public Release Found #350

Timmy commented

2026-04-05 00:13:58 +00:00

Status marker only: local-first Claw Code implementation marked WORKING. Closing as accomplished checkpoint.

Timmy closed this issue

2026-04-05 00:13:58 +00:00

Sign in to join this conversation.