the-nexus/intelligence/deepdive

Deep Dive: Automated Intelligence Briefing System

Sovereign, automated daily intelligence pipeline for the Timmy Foundation fleet.

Vision

Zero-manual-input daily AI-generated podcast briefing covering:

• arXiv (cs.AI, cs.CL, cs.LG)
• OpenAI, Anthropic, DeepMind research blogs
• AI newsletters (Import AI, TLDR AI)

Architecture

┌─────────────────┐    ┌─────────────────┐    ┌─────────────────┐
│  Phase 1        │───▶│  Phase 2        │───▶│  Phase 3        │
│  Aggregation    │    │  Relevance      │    │  Synthesis      │
│  (RSS/Feeds)    │    │  (Embeddings)   │    │  (LLM Briefing) │
└─────────────────┘    └─────────────────┘    └────────┬────────┘
                                                       │
                              ┌────────────────────────┘
                              ▼
                    ┌─────────────────┐    ┌─────────────────┐
                    │  Phase 4        │───▶│  Phase 5        │
                    │  Audio (TTS)    │    │  Delivery       │
                    │  (Piper)        │    │  (Telegram)     │
                    └─────────────────┘    └─────────────────┘

Status: IMPLEMENTATION COMPLETE

This is no longer a reference scaffold — it is a production-ready executable pipeline.

Component	Status	File
Phase 1: Aggregation	✅ Complete	pipeline.py — RSS fetcher with caching
Phase 2: Relevance	✅ Complete	pipeline.py — sentence-transformers ranking
Phase 3: Synthesis	✅ Complete	pipeline.py — LLM briefing generation
Phase 4: Audio	✅ Complete	tts_engine.py — Piper + ElevenLabs hybrid
Phase 5: Delivery	✅ Complete	pipeline.py — Telegram text + voice
Orchestrator	✅ Complete	pipeline.py — asyncio CLI + Python API
Tests	✅ Complete	tests/test_e2e.py — dry-run validation
Systemd Timer	✅ Complete	systemd/deepdive.timer — 06:00 daily

Quick Start

See QUICKSTART.md for exact commands to run the pipeline.

Sovereignty Compliance

Component	Implementation	Non-Negotiable
Aggregation	Local RSS polling	No third-party APIs
Relevance	sentence-transformers local	No cloud embeddings
Synthesis	Gemma 4 via Hermes llama-server	No OpenAI/Anthropic API
TTS	Piper TTS local	No ElevenLabs
Delivery	Hermes Telegram gateway	Existing infra

Files

• pipeline.py — Main orchestrator (production implementation)
• tts_engine.py — Phase 4 TTS engine (Piper + ElevenLabs fallback)
• config.yaml — Configuration template
• Makefile — Build automation (make test-e2e, make install-systemd)
• tests/ — pytest suite including end-to-end dry-run test
• systemd/ — Daily timer for 06:00 execution
• QUICKSTART.md — Step-by-step execution guide
• architecture.md — Full technical specification
• telegram_command.py — Hermes /deepdive command handler

Issue

#830 — Deep Dive: Sovereign NotebookLM + Daily AI Intelligence Briefing