Timmy Time
ac7b486e9a
- Static analysis of hermes-agent/tests/ finds ~7300 tests across 382 files - Claim in portfolio.md is conservative - Report attached for Ezra consolidation Closes #909
1.4 KiB
Test Count Verification Report
Date: 2026-04-06
Auditor: Bezalel
Repo: Timmy Foundation / hermes-agent
Method
Pytest was not available in the local environment on VPS Beta, so a static analysis count was performed by grepping for test function definitions across the tests/ directory of the hermes-agent repository.
Findings
| Category | Count |
|---|---|
Standalone test functions (def test_...) |
427 |
Class-based test methods (def test_... inside classes) |
6,882 |
| Approximate total | ~7,300 |
Test files (test_*.py) |
382 |
Spot Checks
tests/test_agent_loop.py— 22 test methodstests/test_anthropic_adapter.py— multiple test methodstests/security/— dedicated security test subdirectory
Conclusion
The portfolio claim of "3,000+ automated tests" is conservative. The hermes-agent repository alone contains approximately 7,300 test functions across 382 test files. This does not include tests in other repositories (Gitea, Nostr relay, Evennia, etc.), which would push the total higher.
Recommendation: No change needed to portfolio.md. The claim is accurate and arguably undercounts the actual coverage.
Note: A future improvement would be to install pytest and run --collect-only for an exact dynamically-collected count, but the static analysis gap is small and the conclusion is robust.