Developer guide stubs expanded to full documentation: - trajectory-format.md: 56→233 lines (JSONL format, ShareGPT example, normalization rules, reasoning markup, replay code) - session-storage.md: 66→388 lines (SQLite schema, migration table, FTS5 search syntax, lineage queries, Python API examples) - context-compression-and-caching.md: 72→321 lines (dual compression system, config defaults, 4-phase algorithm, before/after example, prompt caching mechanics, cache-aware patterns) - tools-runtime.md: 65→246 lines (registry API, dispatch flow, availability checking, error wrapping, approval flow) - prompt-assembly.md: 89→246 lines (concrete assembled prompt example, SOUL.md injection, context file discovery table) User-facing pages expanded: - docker.md: 62→224 lines (volumes, env forwarding, docker-compose, resource limits, troubleshooting) - updating.md: 79→167 lines (update behavior, version checking, rollback instructions, Nix users) - skins.md: 80→206 lines (all color/spinner/branding keys, built-in skin descriptions, full custom skin YAML template) Hub pages improved: - integrations/index.md: 25→82 lines (web search backends table, TTS/browser providers, quick config example) - features/overview.md: added Integrations section with 6 missing links Specific fixes: - configuration.md: removed duplicate Gateway Streaming section - mcp.md: removed internal "PR work" language - plugins.md: added inline minimal plugin example (self-contained) 13 files changed, ~1700 lines added. Docusaurus build verified clean.
9.7 KiB
sidebar_position, title, description
| sidebar_position | title | description |
|---|---|---|
| 9 | Tools Runtime | Runtime behavior of the tool registry, toolsets, dispatch, and terminal environments |
Tools Runtime
Hermes tools are self-registering functions grouped into toolsets and executed through a central registry/dispatch system.
Primary files:
tools/registry.pymodel_tools.pytoolsets.pytools/terminal_tool.pytools/environments/*
Tool registration model
Each tool module calls registry.register(...) at import time.
model_tools.py is responsible for importing/discovering tool modules and building the schema list used by the model.
How registry.register() works
Every tool file in tools/ calls registry.register() at module level to declare itself. The function signature is:
registry.register(
name="terminal", # Unique tool name (used in API schemas)
toolset="terminal", # Toolset this tool belongs to
schema={...}, # OpenAI function-calling schema (description, parameters)
handler=handle_terminal, # The function that executes when the tool is called
check_fn=check_terminal, # Optional: returns True/False for availability
requires_env=["SOME_VAR"], # Optional: env vars needed (for UI display)
is_async=False, # Whether the handler is an async coroutine
description="Run commands", # Human-readable description
emoji="💻", # Emoji for spinner/progress display
)
Each call creates a ToolEntry stored in the singleton ToolRegistry._tools dict keyed by tool name. If a name collision occurs across toolsets, a warning is logged and the later registration wins.
Discovery: _discover_tools()
When model_tools.py is imported, it calls _discover_tools() which imports every tool module in order:
_modules = [
"tools.web_tools",
"tools.terminal_tool",
"tools.file_tools",
"tools.vision_tools",
"tools.mixture_of_agents_tool",
"tools.image_generation_tool",
"tools.skills_tool",
"tools.browser_tool",
"tools.cronjob_tools",
"tools.rl_training_tool",
"tools.tts_tool",
"tools.todo_tool",
"tools.memory_tool",
"tools.session_search_tool",
"tools.clarify_tool",
"tools.code_execution_tool",
"tools.delegate_tool",
"tools.process_registry",
"tools.send_message_tool",
"tools.honcho_tools",
"tools.homeassistant_tool",
]
Each import triggers the module's registry.register() calls. Errors in optional tools (e.g., missing fal_client for image generation) are caught and logged — they don't prevent other tools from loading.
After core tool discovery, MCP tools and plugin tools are also discovered:
- MCP tools —
tools.mcp_tool.discover_mcp_tools()reads MCP server config and registers tools from external servers. - Plugin tools —
hermes_cli.plugins.discover_plugins()loads user/project/pip plugins that may register additional tools.
Tool availability checking (check_fn)
Each tool can optionally provide a check_fn — a callable that returns True when the tool is available and False otherwise. Typical checks include:
- API key present — e.g.,
lambda: bool(os.environ.get("SERP_API_KEY"))for web search - Service running — e.g., checking if the Honcho server is configured
- Binary installed — e.g., verifying
playwrightis available for browser tools
When registry.get_definitions() builds the schema list for the model, it runs each tool's check_fn():
# Simplified from registry.py
if entry.check_fn:
try:
available = bool(entry.check_fn())
except Exception:
available = False # Exceptions = unavailable
if not available:
continue # Skip this tool entirely
Key behaviors:
- Check results are cached per-call — if multiple tools share the same
check_fn, it only runs once. - Exceptions in
check_fn()are treated as "unavailable" (fail-safe). - The
is_toolset_available()method checks whether a toolset'scheck_fnpasses, used for UI display and toolset resolution.
Toolset resolution
Toolsets are named bundles of tools. Hermes resolves them through:
- explicit enabled/disabled toolset lists
- platform presets (
hermes-cli,hermes-telegram, etc.) - dynamic MCP toolsets
- curated special-purpose sets like
hermes-acp
How get_tool_definitions() filters tools
The main entry point is model_tools.get_tool_definitions(enabled_toolsets, disabled_toolsets, quiet_mode):
-
If
enabled_toolsetsis provided — only tools from those toolsets are included. Each toolset name is resolved viaresolve_toolset()which expands composite toolsets into individual tool names. -
If
disabled_toolsetsis provided — start with ALL toolsets, then subtract the disabled ones. -
If neither — include all known toolsets.
-
Registry filtering — the resolved tool name set is passed to
registry.get_definitions(), which appliescheck_fnfiltering and returns OpenAI-format schemas. -
Dynamic schema patching — after filtering,
execute_codeandbrowser_navigateschemas are dynamically adjusted to only reference tools that actually passed filtering (prevents model hallucination of unavailable tools).
Legacy toolset names
Old toolset names with _tools suffixes (e.g., web_tools, terminal_tools) are mapped to their modern tool names via _LEGACY_TOOLSET_MAP for backward compatibility.
Dispatch
At runtime, tools are dispatched through the central registry, with agent-loop exceptions for some agent-level tools such as memory/todo/session-search handling.
Dispatch flow: model tool_call → handler execution
When the model returns a tool_call, the flow is:
Model response with tool_call
↓
run_agent.py agent loop
↓
model_tools.handle_function_call(name, args, task_id, user_task)
↓
[Agent-loop tools?] → handled directly by agent loop (todo, memory, session_search, delegate_task)
↓
[Plugin pre-hook] → invoke_hook("pre_tool_call", ...)
↓
registry.dispatch(name, args, **kwargs)
↓
Look up ToolEntry by name
↓
[Async handler?] → bridge via _run_async()
[Sync handler?] → call directly
↓
Return result string (or JSON error)
↓
[Plugin post-hook] → invoke_hook("post_tool_call", ...)
Error wrapping
All tool execution is wrapped in error handling at two levels:
-
registry.dispatch()— catches any exception from the handler and returns{"error": "Tool execution failed: ExceptionType: message"}as JSON. -
handle_function_call()— wraps the entire dispatch in a secondary try/except that returns{"error": "Error executing tool_name: message"}.
This ensures the model always receives a well-formed JSON string, never an unhandled exception.
Agent-loop tools
Four tools are intercepted before registry dispatch because they need agent-level state (TodoStore, MemoryStore, etc.):
todo— planning/task trackingmemory— persistent memory writessession_search— cross-session recalldelegate_task— spawns subagent sessions
These tools' schemas are still registered in the registry (for get_tool_definitions), but their handlers return a stub error if dispatch somehow reaches them directly.
Async bridging
When a tool handler is async, _run_async() bridges it to the sync dispatch path:
- CLI path (no running loop) — uses a persistent event loop to keep cached async clients alive
- Gateway path (running loop) — spins up a disposable thread with
asyncio.run() - Worker threads (parallel tools) — uses per-thread persistent loops stored in thread-local storage
The DANGEROUS_PATTERNS approval flow
The terminal tool integrates a dangerous-command approval system defined in tools/approval.py:
-
Pattern detection —
DANGEROUS_PATTERNSis a list of(regex, description)tuples covering destructive operations:- Recursive deletes (
rm -rf) - Filesystem formatting (
mkfs,dd) - SQL destructive operations (
DROP TABLE,DELETE FROMwithoutWHERE) - System config overwrites (
> /etc/) - Service manipulation (
systemctl stop) - Remote code execution (
curl | sh) - Fork bombs, process kills, etc.
- Recursive deletes (
-
Detection — before executing any terminal command,
detect_dangerous_command(command)checks against all patterns. -
Approval prompt — if a match is found:
- CLI mode — an interactive prompt asks the user to approve, deny, or allow permanently
- Gateway mode — an async approval callback sends the request to the messaging platform
- Smart approval — optionally, an auxiliary LLM can auto-approve low-risk commands that match patterns (e.g.,
rm -rf node_modules/is safe but matches "recursive delete")
-
Session state — approvals are tracked per-session. Once you approve "recursive delete" for a session, subsequent
rm -rfcommands don't re-prompt. -
Permanent allowlist — the "allow permanently" option writes the pattern to
config.yaml'scommand_allowlist, persisting across sessions.
Terminal/runtime environments
The terminal system supports multiple backends:
- local
- docker
- ssh
- singularity
- modal
- daytona
It also supports:
- per-task cwd overrides
- background process management
- PTY mode
- approval callbacks for dangerous commands
Concurrency
Tool calls may execute sequentially or concurrently depending on the tool mix and interaction requirements.