[INFRA] Quality gate hash deduplication may grow unbounded #628

Open
opened 2026-04-14 22:34:47 +00:00 by Rockachopa · 0 comments
Owner

The quality gate stores SHA-256 hashes of all validated content to detect duplicates. This file could grow very large over time.

Problem:

  • Hash files grow with each validation
  • No cleanup mechanism
  • Could impact performance

Suggested fix:

  • Rotate hash files daily
  • Keep only last N days of hashes
  • Use bloom filter for large-scale dedup
The quality gate stores SHA-256 hashes of all validated content to detect duplicates. This file could grow very large over time. **Problem:** - Hash files grow with each validation - No cleanup mechanism - Could impact performance **Suggested fix:** - Rotate hash files daily - Keep only last N days of hashes - Use bloom filter for large-scale dedup
hermes was assigned by Rockachopa 2026-04-15 01:16:04 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/timmy-config#628