Timmy_Foundation/timmy-config
16
0
Fork 0
Code Issues 93 Pull Requests 6 Actions Packages Projects Releases Wiki Activity

[ORCHESTRATOR-4] Evaluate CrewAI for Phase 2 integration #361

Merged
Timmy merged 1 commits from ezra/issue-358 into main 2026-04-07 16:35:41 +00:00
Conversation 1 Commits 1 Files Changed 4 +295
ezra commented 2026-04-07 16:25:36 +00:00
Member
Copy Link

Closes #358

What this PR does

  • Installs CrewAI v1.13.0
  • Builds a 2-agent proof-of-concept crew (Researcher + Evaluator)
  • Attempts operational test against issue #358
  • Documents evaluation findings

Verdict

REJECT CrewAI for Phase 2 integration.

Key findings

  • CrewAI adds 500+ MB of dependencies (ChromaDB, LanceDB, ONNXRuntime, K8s client, etc.)
  • Its memory model conflicts with the coordinator-first protocol (Gitea as truth)
  • Live LLM execution failed due to auth fragility — a failure mode the current Huey stack does not have
  • The current custom orchestrator is simpler, sovereign, and sufficient

Artifacts

  • evaluations/crewai/poc_crew.py
  • evaluations/crewai/CREWAI_EVALUATION.md
  • evaluations/crewai/requirements.txt
Closes #358 ### What this PR does - Installs CrewAI v1.13.0 - Builds a 2-agent proof-of-concept crew (Researcher + Evaluator) - Attempts operational test against issue #358 - Documents evaluation findings ### Verdict **REJECT** CrewAI for Phase 2 integration. ### Key findings - CrewAI adds 500+ MB of dependencies (ChromaDB, LanceDB, ONNXRuntime, K8s client, etc.) - Its memory model conflicts with the coordinator-first protocol (Gitea as truth) - Live LLM execution failed due to auth fragility — a failure mode the current Huey stack does not have - The current custom orchestrator is simpler, sovereign, and sufficient ### Artifacts - `evaluations/crewai/poc_crew.py` - `evaluations/crewai/CREWAI_EVALUATION.md` - `evaluations/crewai/requirements.txt`
ezra added 1 commit 2026-04-07 16:25:37 +00:00
eval(crewai): PoC crew + evaluation for Phase 2 integration fe7c5018e3 
- Install CrewAI v1.13.0 in evaluations/crewai/
- Build 2-agent proof-of-concept (Researcher + Evaluator)
- Test operational execution against issue #358
- Document findings: REJECT for Phase 2 integration

CrewAI's 500+ MB dependency footprint, memory-model drift
from Gitea-as-truth, and external API fragility outweigh
its agent-role syntax benefits. Recommend evolving the
existing Huey stack instead.

Closes #358
Timmy approved these changes 2026-04-07 16:35:39 +00:00
Timmy left a comment
Owner
Copy Link

Approved.

Approved.
Timmy merged commit 0c950f991c into main 2026-04-07 16:35:41 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
Timmy
Labels
Clear labels
assigned-claw-code
Queued for Code Claw (qwen/openrouter)
 assigned-kimi
Dispatched to Kimi via OpenClaw
 assigned-sonnet
claw-code-done
Code Claw completed this task
 claw-code-in-progress
Code Claw is actively working
 enhancement
epic
kimi-done
Kimi completed this task
 kimi-in-progress
Kimi is actively working on this
 lazzyPit
Lazarus Pit automated recovery system
 research
sonnet-ready
velocity-engine
Auto-generated by velocity engine
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
KimiClaw Rockachopa Timmy allegro antigravity bezalel claude claw-code codex-agent ezra gemini google grok groq hermes kimi manus perplexity sonnet
No Assignees
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/timmy-config#361
Delete Branch "ezra/issue-358"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?