Timmy_Foundation/timmy-home
16
0
Fork 0
Code Issues 176 Pull Requests Actions Packages Projects Releases Wiki Activity

[Saiyah] OmiCodex Implementation — Hermes BPS Native Codecs #233

New Issue
Open
opened 2026-04-01 15:15:38 +00:00 by ezra · 1 comment
ezra commented 2026-04-01 15:15:38 +00:00
Member
Copy Link

Part of Epic #232 — Saiyah Architecture

Objective

Implement OmiCodex protocol in Hermes Agent BPS — native codec disassembly with zero external API dependencies.

Tasks

  • Catalog existing codec usage in Hermes (ffmpeg, image processing, audio, documents)
  • Design OmiCodexEngine unified interface
  • Implement native codec handlers:
    • Audio: wav, mp3, ogg (via libav/ffmpeg bindings)
    • Video: mp4, webm (stream processing)
    • Image: png, jpg, webp (native libraries)
    • Documents: pdf, docx, txt (local parsers)
  • Replace cloud-dependent media tools with OmiCodex equivalents
  • Prove zero external calls during media operations (packet capture test)

Local Opus Component

NEW: Local inference for Opus-class reasoning (no API calls).

Tasks

  • Evaluate local Opus-equivalent options:
    • DeepSeek-V3/R1 (671B MoE, ~37B active)
    • QwQ-32B (reasoning specialist)
    • Llama 4 Scout/Maverick (multimodal)
    • Gemma 3 27B (efficient)
  • Benchmark on 16GB cloud VM (quantized: Q4_K_M, Q5_K_M)
  • Benchmark on Mac M3 Max (Metal GGUF)
  • Implement local inference bridge in Hermes
  • Validate: Opus-quality reasoning without API telemetry

Deliverables

  • tools/omicodex/ directory
  • OmiCodexEngine class
  • Integration test: media processing without internet
  • Documentation: OmiCodex Protocol v1

Hardware Context

  • 16GB cloud VMs (2x)
  • Mac M3 Max (local)
  • ffmpeg/libav available

Saiyah: No SDK. No telemetry. Just operational capacity.

Part of Epic #232 — Saiyah Architecture ## Objective Implement OmiCodex protocol in Hermes Agent BPS — native codec disassembly with zero external API dependencies. ## Tasks - [ ] Catalog existing codec usage in Hermes (ffmpeg, image processing, audio, documents) - [ ] Design OmiCodexEngine unified interface - [ ] Implement native codec handlers: - Audio: wav, mp3, ogg (via libav/ffmpeg bindings) - Video: mp4, webm (stream processing) - Image: png, jpg, webp (native libraries) - Documents: pdf, docx, txt (local parsers) - [ ] Replace cloud-dependent media tools with OmiCodex equivalents - [ ] Prove zero external calls during media operations (packet capture test) ## Local Opus Component **NEW**: Local inference for Opus-class reasoning (no API calls). ### Tasks - [ ] Evaluate local Opus-equivalent options: - DeepSeek-V3/R1 (671B MoE, ~37B active) - QwQ-32B (reasoning specialist) - Llama 4 Scout/Maverick (multimodal) - Gemma 3 27B (efficient) - [ ] Benchmark on 16GB cloud VM (quantized: Q4_K_M, Q5_K_M) - [ ] Benchmark on Mac M3 Max (Metal GGUF) - [ ] Implement local inference bridge in Hermes - [ ] Validate: Opus-quality reasoning without API telemetry ## Deliverables - `tools/omicodex/` directory - `OmiCodexEngine` class - Integration test: media processing without internet - Documentation: OmiCodex Protocol v1 ## Hardware Context - 16GB cloud VMs (2x) - Mac M3 Max (local) - ffmpeg/libav available --- *Saiyah: No SDK. No telemetry. Just operational capacity.*
ezra added the architecturesaiyah labels 2026-04-01 15:15:39 +00:00
ezra commented 2026-04-01 15:58:46 +00:00
Author
Member
Copy Link

Local Opus Sub-Task Added

Per Alexander directive: Opus goes local.

New Tasks

  • Evaluate DeepSeek-V3/R1, QwQ-32B, Llama 4, Gemma 3 for 16GB deployment
  • llama.cpp or vLLM backend setup
  • Quantization sweep: Q4_K_M, Q5_K_M, Q6_K
  • Benchmark against cloud Opus (quality vs latency)
  • Hermes integration: local model as first-class provider

Hardware Targets

  • 16GB cloud VMs (quantized)
  • Mac M3 Max (Metal GGUF)

Success: Opus-class reasoning without API call or telemetry.

## Local Opus Sub-Task Added Per Alexander directive: **Opus goes local**. ### New Tasks - [ ] Evaluate DeepSeek-V3/R1, QwQ-32B, Llama 4, Gemma 3 for 16GB deployment - [ ] llama.cpp or vLLM backend setup - [ ] Quantization sweep: Q4_K_M, Q5_K_M, Q6_K - [ ] Benchmark against cloud Opus (quality vs latency) - [ ] Hermes integration: local model as first-class provider ### Hardware Targets - 16GB cloud VMs (quantized) - Mac M3 Max (Metal GGUF) **Success**: Opus-class reasoning without API call or telemetry.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
alembic
The Alchemical Vessel - Kimi-powered transformation
 architecture
Auto-created architecture label
 assigned-claw-code
Queued for Code Claw (qwen/openrouter)
 assigned-kimi
Dispatched to Kimi via OpenClaw
 auth-needed
auth-needed
 bizzalo
bizzalo
 blocker
blocker
 claw
Claw Code runtime (Rust)
 claw-code-done
Code Claw completed this task
 claw-code-in-progress
Code Claw is actively working
 deadline-7am
deadline-7am
 epic
Parent tracking issue
 golden_bilbo
Bilbo at peak performance - max churn, fast responses
 harness-engineering
Auto-created harness-engineering label
 intel
Competitive intelligence
 kimi-done
Kimi completed this task
 kimi-in-progress
Kimi is actively working on this
 morning-report
morning-report
 runtime
Runtime abstraction layer
 saiyah
Auto-created saiyah label
 study
Learning from external source code
 substratum
The dissolution engine - runtime layer
 substratum:invoke
Trigger Substratum execution
 urgent
urgent
 velocity-engine
Auto-generated by velocity engine
No Label architecture saiyah
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
KimiClaw Rockachopa Timmy allegro antigravity bezalel claude claw-code codex-agent ezra gemini google grok groq hermes kimi manus perplexity
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/timmy-home#233
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?