Issues - turboquant - Hermes Gitea

Timmy_Foundation/turboquant

Labels Milestones New Issue

[TQ-1] Download Gemma 4 via Ollama on Mac

#31 by Timmy was closed 2026-04-05 14:05:48 +00:00

[EPIC] TurboQuant + Gemma 4 Local Mac Deployment

#30 by Timmy was closed 2026-04-05 14:05:48 +00:00

[TQ-2] Build TheTom/llama-cpp-turboquant for M3 Max Metal

#27 by Timmy was closed 2026-04-05 14:05:49 +00:00 0 / 3

[P2-6] Production cutover: swap Timmy's llama-server to TurboQuant

#26 by Timmy was closed 2026-04-05 14:05:49 +00:00 0 / 6

[P2-5] Download qwen3.5:27b and benchmark turbo4 at 64K/128K context

#25 by Timmy was closed 2026-04-05 14:05:50 +00:00 0 / 6

[P2-4] Run full quality comparison: turbo4 vs f16 on 10 test prompts

#24 by Timmy was closed 2026-04-05 21:58:15 +00:00 0 / 6

[P2-3] Fix Ollama install and build custom Ollama with TurboQuant fork

#23 by Timmy was closed 2026-04-05 14:05:50 +00:00 0 / 4

[P3] QJL residual correction — Metal port build owner:cid owner:locke phase-3

#14 by Timmy was closed 2026-03-30 21:04:08 +00:00 Phase 3+ — Optimization & QJL 0 / 3

[P2.5] Per-layer quantization profiles owner:cid phase-2.5

#13 by Timmy was closed 2026-03-30 21:04:06 +00:00 Phase 3+ — Optimization & QJL 0 / 3

[P2] Custom Ollama build + MacBook deployment build deploy owner:cid phase-2

#10 by Timmy was closed 2026-03-30 21:04:03 +00:00 Phase 2 — Ollama Integration + Production 0 / 5

[P2-S0] Ollama CGo API compatibility check build owner:cid phase-2

#9 by Timmy was closed 2026-03-30 21:04:01 +00:00 Phase 2 — Ollama Integration + Production 0 / 3

[P1-S2] Peak memory profiling at each context length benchmark owner:cid phase-1

#8 by Timmy was closed 2026-03-30 20:11:01 +00:00 Phase 1 — PolarQuant MVP 0 / 3

[P1-S2] PolarQuant benchmarks — turbo4 KV cache + asymmetric test benchmark owner:cid phase-1

#7 by Timmy was closed 2026-03-30 20:10:58 +00:00 Phase 1 — PolarQuant MVP 0 / 5

[P1-S2] Baseline benchmarks — FP16 KV cache (no TurboQuant) benchmark owner:cid phase-1

#6 by Timmy was closed 2026-03-30 20:11:07 +00:00 Phase 1 — PolarQuant MVP 0 / 4

[P1-S1] PolarQuant verification checklist owner:cid phase-1 research

#5 by Timmy was closed 2026-03-30 20:09:53 +00:00 Phase 1 — PolarQuant MVP 0 / 6

[P1-S1] Build llama.cpp fork with Metal backend on M4 Max build owner:cid phase-1

#4 by Timmy was closed 2026-03-30 20:09:51 +00:00 Phase 1 — PolarQuant MVP 0 / 4

[P1-S0] Fork assessment — age, conflicts, build path estimate build owner:cid phase-1

#3 by Timmy was closed 2026-03-30 19:40:56 +00:00 Phase 1 — PolarQuant MVP 0 / 4

[P1-GATE] Metal kernel check — determines llama.cpp vs MLX path blocker owner:cid phase-1

#2 by Timmy was closed 2026-03-30 19:40:54 +00:00 Phase 1 — PolarQuant MVP 0 / 4

TurboQuant — KV Cache Compression for Local Inference on M4 Max epic

#1 by Timmy was closed 2026-04-05 14:05:51 +00:00 Phase 1 — PolarQuant MVP 0 / 15