Commit Graph

1 Commits

Author SHA1 Message Date
Alexander Whitestone
a2e61f6def feat: auto-generate scene descriptions from image/video assets (#689)
Some checks failed
Architecture Lint / Linter Tests (pull_request) Successful in 21s
Smoke Test / smoke (pull_request) Failing after 15s
Validate Config / YAML Lint (pull_request) Failing after 18s
Validate Config / JSON Validate (pull_request) Successful in 21s
Validate Config / Python Syntax & Import Check (pull_request) Failing after 1m3s
Validate Config / Python Test Suite (pull_request) Has been skipped
Validate Config / Shell Script Lint (pull_request) Failing after 1m11s
Validate Config / Cron Syntax Check (pull_request) Successful in 15s
Validate Config / Deploy Script Dry Run (pull_request) Successful in 14s
Validate Config / Playbook Schema Validation (pull_request) Successful in 27s
PR Checklist / pr-checklist (pull_request) Failing after 12m35s
Architecture Lint / Lint Repository (pull_request) Failing after 22s
scripts/generate_scenes_from_media.py:
  Scans assets dir for images/videos (jpg/png/mp4/mov/etc)
  Calls vision model (llava/gpt-4/claude) to describe scenes
  Outputs training pairs: image_path -> scene description
  Includes provenance: model, timestamp, source_session_id
  --assets dir, --output file, --model, --max, --dry-run
  JSON parsing with fallback for plain text responses

tests/test_generate_scenes_from_media.py: 12 tests
  find_media_files: images, videos, max limit, missing dir
  file_hash: consistent, different files
  generate_prompt: image vs video
  parse_description: JSON, plain text
  generate_training_pair: structure, video type

Usage:
  python3 scripts/generate_scenes_from_media.py --assets ~/assets/
  python3 scripts/generate_scenes_from_media.py --assets ~/assets/ --model gpt-4
  python3 scripts/generate_scenes_from_media.py --assets ~/assets/ --dry-run
2026-04-21 07:22:28 -04:00