Timmy_Foundation/hermes-agent
15
0
Fork 0
Code Issues 191 Pull Requests 37 Actions 131 Packages Projects Releases Wiki Activity

[Vitalik-Security] Benchmark Qwen3.5:35B reasoning vs hermes4:14b #503

New Issue
Open
opened 2026-04-14 01:35:48 +00:00 by Rockachopa · 0 comments
Rockachopa commented 2026-04-14 01:35:48 +00:00
Owner
Copy Link

Follow-up to #288. Evaluation noted '3B active params may be weaker on complex reasoning.' Need: run MMLU/HumanEval/GSM8K against qwen3.5:35b Q4, compare vs hermes4:14b and gemma4, determine if 3B-active MoE is sufficient for two-factor confirmation role. Part of Epic #281.

Follow-up to #288. Evaluation noted '3B active params may be weaker on complex reasoning.' Need: run MMLU/HumanEval/GSM8K against qwen3.5:35b Q4, compare vs hermes4:14b and gemma4, determine if 3B-active MoE is sufficient for two-factor confirmation role. Part of Epic #281.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
CI
Continuous integration, runners, workflow issues
 QA
Quality assurance, testing, production audit
 assigned-claw-code
Queued for Code Claw (qwen/openrouter)
 assigned-kimi
Task assigned to KimiClaw for processing
 audit-finding
batch-pipeline
batch-pipeline label
 blocked
Blocked by external dependency or merge conflict
 bug
claw-code-done
Code Claw completed this task
 claw-code-in-progress
Code Claw is actively working
 critical
duplicate
Duplicate of another issue
 epic
Epic - large feature with multiple sub-tasks
 epic:memory
Unified Memory Architecture epic
 gaming
Gaming agent capabilities
 infra
Infrastructure, VPS, DNS, deployment
 kimi-done
KimiClaw has completed this task
 kimi-in-progress
KimiClaw is actively working on this
 mcp
MCP (Model Context Protocol) tools & servers
 morrowind
Morrowind Agent gameplay & MCP integration
 needs-review
PR or issue requires reviewer sign-off before merge/close
 ops
p0-critical
p1-important
phase:1-activate
Phase 1: Activate existing systems
 phase:2-operational
Phase 2: Operational memory bridge
 phase:3-episodic
Phase 3: Proactive episodic recall
 phase:4-hygiene
Phase 4: Memory hygiene and quality
 phase:5-integration
Phase 5: Integration and testing
 poka-yoke
research
security
Security hardening, vulnerability fixes
 shared-infra
Shared infrastructure across projects (Playground + LPM)
 stale
No activity, pending triage or closure
 throughput-10x
throughput-10x label
 token-masterplan
token-masterplan label
 tool-evaluation
velocity-engine
Auto-generated by velocity engine
 wont-fix
Closed as intentionally not fixing — explicit descope
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Rockachopa Timmy allegro antigravity bezalel claude claw-code codex-agent ezra gemini google grok hermes kimi manus perplexity sonnet
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/hermes-agent#503
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?