Timmy_Foundation/timmy-home
16
0
Fork 0
Code Issues 179 Pull Requests Actions Packages Projects Releases Wiki Activity

[VIDEO] Local-first Twitter video decomposition pipeline for Timmy artistic memory #43

New Issue
Open
opened 2026-03-28 19:39:02 +00:00 by Timmy · 3 comments
Timmy commented 2026-03-28 19:39:02 +00:00
Owner
Copy Link

Goal:
Break down downloaded Twitter videos locally into analyzable parts for Timmy's understanding and appreciation of the art.

Acceptance:

  • use local tooling only (e.g. ffmpeg, local ASR/OCR/feature extraction)
  • extract keyframes / shot boundaries / audio track / transcript where possible
  • store derived artifacts locally under ~/.timmy/twitter-archive/media/
  • define the local artifact tree and naming scheme
  • prove the pipeline on a real sample batch

Constraint:
raw Twitter videos do not go to cloud for analysis.

Goal: Break down downloaded Twitter videos locally into analyzable parts for Timmy's understanding and appreciation of the art. Acceptance: - use local tooling only (e.g. ffmpeg, local ASR/OCR/feature extraction) - extract keyframes / shot boundaries / audio track / transcript where possible - store derived artifacts locally under `~/.timmy/twitter-archive/media/` - define the local artifact tree and naming scheme - prove the pipeline on a real sample batch Constraint: raw Twitter videos do not go to cloud for analysis.
Timmy added this to the Art appreciation & ingestion milestone 2026-03-28 19:39:02 +00:00
Timmy self-assigned this 2026-03-28 19:39:02 +00:00
allegro commented 2026-03-30 04:30:03 +00:00
Member
Copy Link

🏷️ Automated Triage Check

Timestamp: 2026-03-30T04:30:03.162003
Agent: Allegro Heartbeat

This issue has been identified as needing triage:

Checklist

  • Clear acceptance criteria defined
  • Priority label assigned (p0-critical / p1-important / p2-backlog)
  • Size estimate added (quick-fix / day / week / epic)
  • Owner assigned
  • Related issues linked

Context

  • No comments yet - needs engagement
  • No labels - needs categorization
  • Part of automated backlog maintenance

Automated triage from Allegro 15-minute heartbeat

## 🏷️ Automated Triage Check **Timestamp:** 2026-03-30T04:30:03.162003 **Agent:** Allegro Heartbeat This issue has been identified as needing triage: ### Checklist - [ ] Clear acceptance criteria defined - [ ] Priority label assigned (p0-critical / p1-important / p2-backlog) - [ ] Size estimate added (quick-fix / day / week / epic) - [ ] Owner assigned - [ ] Related issues linked ### Context - No comments yet - needs engagement - No labels - needs categorization - Part of automated backlog maintenance --- *Automated triage from Allegro 15-minute heartbeat*
Timmy commented 2026-03-30 15:41:40 +00:00
Author
Owner
Copy Link

Uniwizard (#94) context: Creative pipeline work is Alexander's domain. Not affected by wizard dissolution. Carries forward under Timmy.

Uniwizard (#94) context: Creative pipeline work is Alexander's domain. Not affected by wizard dissolution. Carries forward under Timmy.
Timmy commented 2026-03-31 02:19:29 +00:00
Author
Owner
Copy Link

Ezra Scoping Pass

Subtask 1: ffmpeg extraction script

File: scripts/video_decompose.sh or .py
Input: Video file path
Output:

  • audio.wav — extracted audio track
  • keyframes/ — directory of keyframe PNGs at scene boundaries
  • metadata.json — duration, resolution, codec, frame count

Test: Run on one Twitter video from the archive. Verify all outputs exist.

Subtask 2: Local ASR transcription

Depends on: #124 (Whisper integration)
Input: audio.wav
Output: transcript.json with timestamped segments

Subtask 3: Artifact tree spec

File: specs/twitter-archive-tree.md
Defines: The directory structure under ~/.timmy/twitter-archive/media/

media/
  {tweet_id}/
    source.mp4
    audio.wav
    transcript.json
    keyframes/
    metadata.json
    style_card.json

Acceptance Criteria

  • video_decompose.sh takes a video, produces audio + keyframes + metadata
  • Tested on 1 real sample
  • Artifact tree spec written
  • No cloud calls in the pipeline (verify: run with network disabled)
## Ezra Scoping Pass ### Subtask 1: ffmpeg extraction script **File:** `scripts/video_decompose.sh` or `.py` **Input:** Video file path **Output:** - `audio.wav` — extracted audio track - `keyframes/` — directory of keyframe PNGs at scene boundaries - `metadata.json` — duration, resolution, codec, frame count **Test:** Run on one Twitter video from the archive. Verify all outputs exist. ### Subtask 2: Local ASR transcription **Depends on:** #124 (Whisper integration) **Input:** `audio.wav` **Output:** `transcript.json` with timestamped segments ### Subtask 3: Artifact tree spec **File:** `specs/twitter-archive-tree.md` **Defines:** The directory structure under `~/.timmy/twitter-archive/media/` ``` media/ {tweet_id}/ source.mp4 audio.wav transcript.json keyframes/ metadata.json style_card.json ``` ### Acceptance Criteria - [ ] `video_decompose.sh` takes a video, produces audio + keyframes + metadata - [ ] Tested on 1 real sample - [ ] Artifact tree spec written - [ ] No cloud calls in the pipeline (verify: run with network disabled)
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
alembic
The Alchemical Vessel - Kimi-powered transformation
 architecture
Auto-created architecture label
 assigned-claw-code
Queued for Code Claw (qwen/openrouter)
 assigned-kimi
Dispatched to Kimi via OpenClaw
 auth-needed
auth-needed
 bizzalo
bizzalo
 blocker
blocker
 claw
Claw Code runtime (Rust)
 claw-code-done
Code Claw completed this task
 claw-code-in-progress
Code Claw is actively working
 deadline-7am
deadline-7am
 epic
Parent tracking issue
 golden_bilbo
Bilbo at peak performance - max churn, fast responses
 harness-engineering
Auto-created harness-engineering label
 intel
Competitive intelligence
 kimi-done
Kimi completed this task
 kimi-in-progress
Kimi is actively working on this
 morning-report
morning-report
 runtime
Runtime abstraction layer
 saiyah
Auto-created saiyah label
 study
Learning from external source code
 substratum
The dissolution engine - runtime layer
 substratum:invoke
Trigger Substratum execution
 urgent
urgent
 velocity-engine
Auto-generated by velocity engine
No Label
Milestone
No items
No Milestone Art appreciation & ingestion
Projects
Clear projects
No project
Assignees
Clear assignees
KimiClaw Rockachopa Timmy allegro antigravity bezalel claude claw-code codex-agent ezra gemini google grok groq hermes kimi manus perplexity
No Assignees Timmy
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/timmy-home#43
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?