Timmy_Foundation/hermes-agent
15
0
Fork 0
Code Issues 249 Pull Requests 128 Actions 202 Packages Projects Releases Wiki Activity

feat: evaluate Qwen3.5:35B as local model option (#288) #482

Closed
Rockachopa wants to merge 214 commits from queue/288-1776129201 into main
pull from: queue/288-1776129201
merge into: Timmy_Foundation:main
Conversation 1 Commits 214 Files Changed 219 +169
Rockachopa commented 2026-04-14 01:27:25 +00:00
Owner
Copy Link

Fixes #288

Evaluation of Qwen3.5-35B-A3B (MoE, 35B total / 3B active) for local deployment as privacy-sensitive tier under Vitalik's Secure LLM Architecture (Epic #281).

Verdict: APPROVED -- 8.8/10 weighted security score

Highlights:

  • Data locality (10/10): all inference local via Ollama, zero exfiltration
  • No API keys (10/10), no telemetry (10/10)
  • Privacy filter elimination (9/10): PII never leaves machine
  • MoE: 35B quality at 3B inference speed, 128K context, Apache 2.0
  • VRAM: 20GB at Q4 (fits M2 Ultra, M4 Pro, RTX 4090, RunPod L40S)
  • Integration: ollama pull qwen3.5:35b -> config.yaml privacy_model

Scripts: scripts/evaluate_qwen35.py + tests/test_evaluate_qwen35.py (9 tests)

Fixes #288 Evaluation of Qwen3.5-35B-A3B (MoE, 35B total / 3B active) for local deployment as privacy-sensitive tier under Vitalik's Secure LLM Architecture (Epic #281). **Verdict: APPROVED -- 8.8/10 weighted security score** Highlights: - Data locality (10/10): all inference local via Ollama, zero exfiltration - No API keys (10/10), no telemetry (10/10) - Privacy filter elimination (9/10): PII never leaves machine - MoE: 35B quality at 3B inference speed, 128K context, Apache 2.0 - VRAM: 20GB at Q4 (fits M2 Ultra, M4 Pro, RTX 4090, RunPod L40S) - Integration: `ollama pull qwen3.5:35b` -> config.yaml privacy_model Scripts: `scripts/evaluate_qwen35.py` + `tests/test_evaluate_qwen35.py` (9 tests)
Rockachopa added 1 commit 2026-04-14 01:27:26 +00:00
feat: evaluate Qwen3.5:35B as local model option (#288)\n\nPart of Epic #281. Verdict: APPROVED 8.8/10 security.\nMoE 35B/3B active, 128K ctx, Apache 2.0, perfect data locality.\n\nCloses #288
Some checks failed
Forge CI / smoke-and-build (pull_request) Failing after 1m2s
Details
95e6646a50
Rockachopa commented 2026-04-14 01:33:01 +00:00
Author
Owner
Copy Link

Superseded by q/288-1776129480.

Superseded by q/288-1776129480.
Rockachopa closed this pull request 2026-04-14 01:33:02 +00:00
Some checks failed
Forge CI / smoke-and-build (pull_request) Failing after 1m2s
Details

Pull request closed

Please reopen this pull request to perform a merge.
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
CI
Continuous integration, runners, workflow issues
 QA
Quality assurance, testing, production audit
 assigned-claw-code
Queued for Code Claw (qwen/openrouter)
 assigned-kimi
Task assigned to KimiClaw for processing
 audit-finding
batch-pipeline
batch-pipeline label
 blocked
Blocked by external dependency or merge conflict
 bug
claw-code-done
Code Claw completed this task
 claw-code-in-progress
Code Claw is actively working
 critical
duplicate
Duplicate of another issue
 epic
Epic - large feature with multiple sub-tasks
 epic:memory
Unified Memory Architecture epic
 gaming
Gaming agent capabilities
 infra
Infrastructure, VPS, DNS, deployment
 kimi-done
KimiClaw has completed this task
 kimi-in-progress
KimiClaw is actively working on this
 mcp
MCP (Model Context Protocol) tools & servers
 morrowind
Morrowind Agent gameplay & MCP integration
 needs-review
PR or issue requires reviewer sign-off before merge/close
 ops
p0-critical
p1-important
phase:1-activate
Phase 1: Activate existing systems
 phase:2-operational
Phase 2: Operational memory bridge
 phase:3-episodic
Phase 3: Proactive episodic recall
 phase:4-hygiene
Phase 4: Memory hygiene and quality
 phase:5-integration
Phase 5: Integration and testing
 poka-yoke
research
security
Security hardening, vulnerability fixes
 shared-infra
Shared infrastructure across projects (Playground + LPM)
 stale
No activity, pending triage or closure
 throughput-10x
throughput-10x label
 token-masterplan
token-masterplan label
 tool-evaluation
velocity-engine
Auto-generated by velocity engine
 wont-fix
Closed as intentionally not fixing — explicit descope
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Rockachopa Timmy allegro antigravity bezalel claude claw-code codex-agent ezra gemini google grok hermes kimi manus perplexity sonnet
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/hermes-agent#482
Delete Branch "queue/288-1776129201"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?