stackchain/timmy-talking-turd
1
0
Fork 0
Code Issues 41 Pull Requests 6 Actions Packages Projects Releases 15 Wiki Activity

EPIC: Specialist Bristol classifier & calibration #4

New Issue
Open
opened 2026-08-19 01:58:58 +00:00 by timmy · 31 comments
timmy commented 2026-08-19 01:58:58 +00:00
Owner
Copy Link

EPIC: Specialist Bristol classifier & calibration

Goal

Replace generic-VLM guesses with a compact specialist model for stool presence, Bristol type, broad color, quality, and abstention.

Milestone

M2 — Consented Dataset & Specialist Model

Acceptance criteria

  • Held-out evaluation is split by contributor and device.
  • Release gates report macro-F1, precision at coverage, calibration, and abstention.
  • The runtime emits only the strict Timmy schema.

Risk/uncertainty

Risk Impact Mitigation
Generic vision accuracy is inadequate Wrong prefill Calibrated abstention, confirmed labels, specialist model
Medical imagery leaks Severe trust harm Metadata stripping, no body logging, bounded retention, deletion tests
Scope turns diagnostic Safety/regulatory risk Observable-field boundary and deterministic symptom path

Child tickets

  • #29 — Build contributor-held-out evaluation harness and calibration report
  • #30 — Train frozen-encoder baseline with stool/not-stool and Type 1–7 heads
  • #31 — Fine-tune specialist visual classifier with color and quality heads
  • #32 — Calibrate confidence and define the production abstention policy
  • #33 — Export the candidate to ONNX and benchmark CPU, GPU, and device targets

Definition of done

  • Child tickets closed or explicitly deferred with rationale
  • Acceptance evidence linked
  • Full test suite green
  • Human gate used only where labeled
# EPIC: Specialist Bristol classifier & calibration ## Goal Replace generic-VLM guesses with a compact specialist model for stool presence, Bristol type, broad color, quality, and abstention. ## Milestone **M2 — Consented Dataset & Specialist Model** ## Acceptance criteria - [ ] Held-out evaluation is split by contributor and device. - [ ] Release gates report macro-F1, precision at coverage, calibration, and abstention. - [ ] The runtime emits only the strict Timmy schema. ## Risk/uncertainty | Risk | Impact | Mitigation | |---|---|---| | Generic vision accuracy is inadequate | Wrong prefill | Calibrated abstention, confirmed labels, specialist model | | Medical imagery leaks | Severe trust harm | Metadata stripping, no body logging, bounded retention, deletion tests | | Scope turns diagnostic | Safety/regulatory risk | Observable-field boundary and deterministic symptom path | ## Child tickets - [ ] #29 — Build contributor-held-out evaluation harness and calibration report - [ ] #30 — Train frozen-encoder baseline with stool/not-stool and Type 1–7 heads - [ ] #31 — Fine-tune specialist visual classifier with color and quality heads - [ ] #32 — Calibrate confidence and define the production abstention policy - [ ] #33 — Export the candidate to ONNX and benchmark CPU, GPU, and device targets ## Definition of done - [ ] Child tickets closed or explicitly deferred with rationale - [ ] Acceptance evidence linked - [ ] Full test suite green - [ ] Human gate used only where labeled
timmy added this to the M2 — Consented Dataset & Specialist Model milestone 2026-08-19 01:58:58 +00:00
timmy added the
type/epic
type/research
priority/P0
area/model
 labels 2026-08-19 01:58:58 +00:00
timmy self-assigned this 2026-08-19 01:58:58 +00:00
rockachopa commented 2026-08-19 08:00:31 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 6.0h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 6.0h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-19 14:00:47 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 12.0h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 12.0h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-19 21:01:49 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 19.0h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 19.0h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-20 04:49:56 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 26.8h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 26.8h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-20 12:16:34 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 34.3h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 34.3h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-20 19:00:25 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 41.0h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 41.0h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-21 02:32:59 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 48.6h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 48.6h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-21 09:54:24 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 55.9h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 55.9h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-21 16:02:26 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 62.1h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 62.1h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-21 23:22:07 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 69.4h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 69.4h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-22 05:24:29 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 75.4h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 75.4h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-22 11:47:25 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 81.8h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 81.8h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-22 19:00:51 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 89.0h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 89.0h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-23 02:31:02 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 96.5h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 96.5h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-23 09:39:24 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 103.7h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 103.7h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-23 17:34:41 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 111.6h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 111.6h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-24 00:01:06 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 118.0h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 118.0h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-24 07:28:55 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 125.5h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 125.5h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-24 13:39:33 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 131.7h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 131.7h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-24 21:07:08 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 139.1h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 139.1h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-25 03:27:53 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 145.5h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 145.5h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-25 09:33:20 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 151.6h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 151.6h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-25 15:49:03 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 157.8h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 157.8h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-25 22:00:51 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 164.0h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 164.0h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-26 04:04:29 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 170.1h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 170.1h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-26 10:52:47 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 176.9h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 176.9h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-26 17:29:34 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 183.5h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 183.5h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-27 00:39:45 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 190.7h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 190.7h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-27 07:34:26 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 197.6h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 197.6h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-27 15:10:15 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 205.2h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 205.2h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
rockachopa commented 2026-08-27 22:11:40 +00:00
Member
Copy Link

⏱ Escalation: this ticket has been assigned to timmy for 212.2h with no progress.

⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.

⏱ Escalation: this ticket has been assigned to timmy for 212.2h with no progress. ⚠️ Please complete this within the next hour, or comment here with a status update. If blocked, delegate by un-assigning and posting a note. I will DM you again on next hourly tick if unresolved.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
area/backend

Application API and storage

  
area/data

Dataset and provenance

  
area/frontend

PWA and interaction design

  
area/model

Vision model and inference

  
area/privacy

Privacy and consent

  
area/release

Release engineering and distribution

  
area/safety

Clinical safety boundary

  
blocked

Blocked on an explicit dependency or decision

  
human-gate

Requires explicit human approval

  
priority/P0

Release-critical

  
priority/P1

High priority

  
priority/P2

Planned

  
state:review

   
type/docs

Documentation and evidence

  
type/epic

Roadmap epic

  
type/feature

Product feature

  
type/ops

Infrastructure and operations

  
type/research

Research or evaluation

  
type/security

Security hardening

  
type/test

Verification and quality gate

No Label
area/backend
area/data
area/frontend
area/model
area/privacy
area/release
area/safety
blocked
human-gate
priority/P0
priority/P1
priority/P2
state:review
type/docs
type/epic
type/feature
type/ops
type/research
type/security
type/test
Milestone
Clear milestone
No items
No Milestone
M2 — Consented Dataset & Specialist Model
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
timmy
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: stackchain/timmy-talking-turd#4
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?