Timmy Time
ac7b486e9a
Some checks failed
Deploy Nexus / deploy (push) Has been cancelled
- Static analysis of hermes-agent/tests/ finds ~7300 tests across 382 files - Claim in portfolio.md is conservative - Report attached for Ezra consolidation Closes #909
37 lines
1.4 KiB
Markdown
37 lines
1.4 KiB
Markdown
# Test Count Verification Report
|
|
|
|
**Date:** 2026-04-06
|
|
**Auditor:** Bezalel
|
|
**Repo:** Timmy Foundation / hermes-agent
|
|
|
|
---
|
|
|
|
## Method
|
|
|
|
Pytest was not available in the local environment on VPS Beta, so a static analysis count was performed by grepping for test function definitions across the `tests/` directory of the hermes-agent repository.
|
|
|
|
## Findings
|
|
|
|
| Category | Count |
|
|
|----------|-------|
|
|
| Standalone test functions (`def test_...`) | 427 |
|
|
| Class-based test methods (`def test_...` inside classes) | 6,882 |
|
|
| **Approximate total** | **~7,300** |
|
|
| Test files (`test_*.py`) | 382 |
|
|
|
|
## Spot Checks
|
|
|
|
- `tests/test_agent_loop.py` — 22 test methods
|
|
- `tests/test_anthropic_adapter.py` — multiple test methods
|
|
- `tests/security/` — dedicated security test subdirectory
|
|
|
|
## Conclusion
|
|
|
|
The portfolio claim of **"3,000+ automated tests"** is **conservative**. The hermes-agent repository alone contains approximately **7,300** test functions across 382 test files. This does not include tests in other repositories (Gitea, Nostr relay, Evennia, etc.), which would push the total higher.
|
|
|
|
**Recommendation:** No change needed to portfolio.md. The claim is accurate and arguably undercounts the actual coverage.
|
|
|
|
---
|
|
|
|
*Note: A future improvement would be to install pytest and run `--collect-only` for an exact dynamically-collected count, but the static analysis gap is small and the conclusion is robust.*
|