Rockachopa/Timmy-time-dashboard
1
0
Fork 2
Code Issues 7 Pull Requests Actions Packages Projects Releases Wiki Activity

Define GBNF grammar for constrained game-command decoding #968

New Issue
Closed
opened 2026-03-22 18:45:50 +00:00 by perplexity · 0 comments
perplexity commented 2026-03-22 18:45:50 +00:00
Collaborator
Copy Link

Parent

  • #963 — [Study] Solving the Perception Bottleneck

Objective

Create a GBNF grammar file that constrains LLM output to valid Morrowind game commands, eliminating parsing failures and hallucinated actions.

Scope

  • Write morrowind_commands.gbnf grammar covering:
    • move_to <target> — navigation commands
    • interact <object/npc> — interaction
    • attack <target> — combat
    • use_item <item> — item usage
    • cast_spell <spell> [target] — magic
    • wait <duration> — idle/rest
    • dialogue_choose <option_index> — conversation choices
    • navigate_menu <action> — UI navigation
  • Integrate grammar loading: load_gbnf("morrowind_commands.gbnf")
  • Pass grammar to all LLM .generate() calls via grammar=self.command_grammar
  • Ensure compatibility with both llama.cpp and MLX backends
  • Test: verify 100% of LLM outputs parse into valid commands

Key Design Notes

  • GBNF constrains token generation at decode time — no post-processing needed
  • max_tokens=40 is sufficient for any single command
  • Grammar should be extensible as new command types are added

References

  • Paper §GBNF Grammar (pp. 8-9)
  • Paper §Heartbeat Loop Pseudocode (pp. 16-17)
## Parent - #963 — [Study] Solving the Perception Bottleneck ## Objective Create a GBNF grammar file that constrains LLM output to valid Morrowind game commands, eliminating parsing failures and hallucinated actions. ## Scope - Write `morrowind_commands.gbnf` grammar covering: - `move_to <target>` — navigation commands - `interact <object/npc>` — interaction - `attack <target>` — combat - `use_item <item>` — item usage - `cast_spell <spell> [target]` — magic - `wait <duration>` — idle/rest - `dialogue_choose <option_index>` — conversation choices - `navigate_menu <action>` — UI navigation - Integrate grammar loading: `load_gbnf("morrowind_commands.gbnf")` - Pass grammar to all LLM `.generate()` calls via `grammar=self.command_grammar` - Ensure compatibility with both llama.cpp and MLX backends - Test: verify 100% of LLM outputs parse into valid commands ## Key Design Notes - GBNF constrains token generation at decode time — no post-processing needed - `max_tokens=40` is sufficient for any single command - Grammar should be extensible as new command types are added ## References - Paper §GBNF Grammar (pp. 8-9) - Paper §Heartbeat Loop Pseudocode (pp. 16-17)
claude was assigned by Rockachopa 2026-03-22 23:30:50 +00:00
claude added the harnessmorrowindp1-important labels 2026-03-23 13:54:07 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
222-epic
Workshop: Timmy as Presence (Epic #222)
 actionable
Has a concrete code/config task extracted
 assigned-claude
Issue currently assigned to Claude agent — do not assign to another agent
 assigned-gemini
Issue currently assigned to Gemini agent — do not assign to another agent
 assigned-groq
assigned-kimi
Issue currently assigned to Kimi agent — do not assign to another agent
 assigned-manus
Issue currently assigned to Manus agent — do not assign to another agent
 claude-ready
consolidation
Part of a consolidation epic
 deprioritized
Keep open but not blocking P0 work
 deprioritized
Keep open but not blocking P0 work
 duplicate
Duplicate of another issue
 gemini-review
Auto-generated by Gemini, needs relevance review
 groq-ready
harness
Core product: agent framework, heartbeat, inference, memory
 heartbeat
Harness: Agent heartbeat loop
 inference
Harness: Inference and model routing
 infrastructure
Supporting stage: dashboard, CI/CD, deployment, DNS
 kimi-ready
Scoped and ready for Kimi to pick up
 memory-session
Harness: Memory and session crystallization
 morrowind
Harness: Morrowind embodiment
 needs-design
Needs architectural design before implementation
 needs-extraction
Philosophy with unextracted engineering work
 p0-critical
Priority 0: Must fix now
 p1-important
Priority 1: Important, next sprint
 p2-backlog
Priority 2: Backlog, do when time permits
 philosophy
Philosophical foundation — informs architecture decisions
 rejected-direction
Closed: rejected or superseded direction
 seed:know-purpose
Three Seeds: KNOW YOUR PURPOSE
 seed:serve-real
Three Seeds: SERVE THE REAL
 seed:tell-truth
Three Seeds: TELL THE TRUTH
 sovereignty
Harness: Sovereignty stack
No Label harness morrowind p1-important
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Timmy claude grok groq kimi manus perplexity Rockachopa
No Assignees claude
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Rockachopa/Timmy-time-dashboard#968
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?