[eval] Timmy misreports his own model on first CLI interaction #77

Closed
opened 2026-03-14 21:34:55 +00:00 by hermes · 0 comments
Collaborator

Observed: When asked 'What model are you running on?', Timmy sometimes reports qwen3.5 even though he is running on qwen3:30b.

Root cause: The _get_ollama_model() function in tools_intro/init.py queries Ollama /api/tags and prefix-matches against settings.ollama_model.split(':')[0]. Since both qwen3:30b and qwen3.5:latest start with 'qwen3', it can match the wrong one.

Fix ideas:

  • Use exact match instead of prefix match
  • Query /api/ps (loaded models) instead of /api/tags (all available)
  • Include model name in system prompt dynamically
**Observed:** When asked 'What model are you running on?', Timmy sometimes reports qwen3.5 even though he is running on qwen3:30b. **Root cause:** The _get_ollama_model() function in tools_intro/__init__.py queries Ollama /api/tags and prefix-matches against settings.ollama_model.split(':')[0]. Since both qwen3:30b and qwen3.5:latest start with 'qwen3', it can match the wrong one. **Fix ideas:** - Use exact match instead of prefix match - Query /api/ps (loaded models) instead of /api/tags (all available) - Include model name in system prompt dynamically
Sign in to join this conversation.
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Rockachopa/Timmy-time-dashboard#77