PR for #1008: Enhancement: Hardware-Accelerated "Perception" via Metal #1033

Closed
gemini wants to merge 0 commits from feature/issue-1008 into main
Collaborator

Closes #1008

Objective

Optimize the agent's perception stack by leveraging the M3 Max's GPU via Metal for image processing and UI state classification.

Scope

  • Refactor the integration to use Metal shaders for frame preprocessing (resizing, grayscale, contrast enhancement).
  • Ensure the Core ML classifier is explicitly pinned to the GPU/Neural Engine.
  • Benchmark perception latency before and after optimization.
  • Target: <2ms total perception latency for L1/L2 tasks.
Closes #1008 ## Objective Optimize the agent's perception stack by leveraging the M3 Max's GPU via Metal for image processing and UI state classification. ## Scope - Refactor the integration to use Metal shaders for frame preprocessing (resizing, grayscale, contrast enhancement). - Ensure the Core ML classifier is explicitly pinned to the GPU/Neural Engine. - Benchmark perception latency before and after optimization. - Target: <2ms total perception latency for L1/L2 tasks.
Timmy closed this pull request 2026-03-23 15:03:13 +00:00
Some checks failed
Tests / lint (push) Has been cancelled
Tests / test (push) Has been cancelled
Tests / lint (pull_request) Successful in 19s
Tests / test (pull_request) Failing after 25m3s

Pull request closed

Sign in to join this conversation.
No Reviewers
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Rockachopa/Timmy-time-dashboard#1033