[FEATURE] First-class live context snapshots for memory/debug evaluation #983

Open
opened 2026-04-22 04:46:41 +00:00 by Rockachopa · 0 comments
Owner

Goal

Promote the ad hoc memory eval snapshot harness into a first-class Hermes feature.

Why

We need grounded proof of what actually enters the live context window:

  • built-in memory injection
  • Holographic provider system prompt blocks
  • external memory prefetch output
  • final API-call user message after memory-context injection
  • full API message payload shape (minus secrets)

Right now this exists only as an external eval artifact flow. We want it in-core so users can enable snapshots and inspect raw context composition during real work.

Scope

  • Add a core context snapshot recorder in hermes-agent
  • Capture per-API-call artifacts to disk when enabled
  • Include system prompt, built-in memory blocks, external provider prompt block, prefetch raw text, final injected user message, and final API messages JSON
  • Make it configurable from core agent config / constructor
  • Add tests proving snapshots are written during run_conversation and include memory-context injection
  • Document the feature

Acceptance criteria

  • No-op when disabled
  • Safe file writes under HERMES_HOME
  • Works in CLI/gateway/cron because it lives in AIAgent
  • Produces inspectable raw artifacts for memory-provider evaluation
## Goal Promote the ad hoc memory eval snapshot harness into a first-class Hermes feature. ## Why We need grounded proof of what actually enters the live context window: - built-in memory injection - Holographic provider system prompt blocks - external memory prefetch output - final API-call user message after memory-context injection - full API message payload shape (minus secrets) Right now this exists only as an external eval artifact flow. We want it in-core so users can enable snapshots and inspect raw context composition during real work. ## Scope - Add a core context snapshot recorder in hermes-agent - Capture per-API-call artifacts to disk when enabled - Include system prompt, built-in memory blocks, external provider prompt block, prefetch raw text, final injected user message, and final API messages JSON - Make it configurable from core agent config / constructor - Add tests proving snapshots are written during run_conversation and include memory-context injection - Document the feature ## Acceptance criteria - No-op when disabled - Safe file writes under HERMES_HOME - Works in CLI/gateway/cron because it lives in AIAgent - Produces inspectable raw artifacts for memory-provider evaluation
claude self-assigned this 2026-04-22 04:51:41 +00:00
Sign in to join this conversation.
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/hermes-agent#983