74 lines
3.6 KiB
Markdown
74 lines
3.6 KiB
Markdown
# Deep Dive: Automated Intelligence Briefing System
|
|
|
|
Sovereign, automated daily intelligence pipeline for the Timmy Foundation fleet.
|
|
|
|
## Vision
|
|
|
|
Zero-manual-input daily AI-generated podcast briefing covering:
|
|
- arXiv (cs.AI, cs.CL, cs.LG)
|
|
- OpenAI, Anthropic, DeepMind research blogs
|
|
- AI newsletters (Import AI, TLDR AI)
|
|
|
|
## Architecture
|
|
|
|
```
|
|
┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐
|
|
│ Phase 1 │───▶│ Phase 2 │───▶│ Phase 3 │
|
|
│ Aggregation │ │ Relevance │ │ Synthesis │
|
|
│ (RSS/Feeds) │ │ (Embeddings) │ │ (LLM Briefing) │
|
|
└─────────────────┘ └─────────────────┘ └────────┬────────┘
|
|
│
|
|
┌────────────────────────┘
|
|
▼
|
|
┌─────────────────┐ ┌─────────────────┐
|
|
│ Phase 4 │───▶│ Phase 5 │
|
|
│ Audio (TTS) │ │ Delivery │
|
|
│ (Piper) │ │ (Telegram) │
|
|
└─────────────────┘ └─────────────────┘
|
|
```
|
|
|
|
## Status: IMPLEMENTATION COMPLETE
|
|
|
|
This is no longer a reference scaffold — it is a **production-ready executable pipeline**.
|
|
|
|
| Component | Status | File |
|
|
|-----------|--------|------|
|
|
| Phase 1: Aggregation | ✅ Complete | `pipeline.py` — RSS fetcher with caching |
|
|
| Phase 2: Relevance | ✅ Complete | `pipeline.py` — sentence-transformers ranking |
|
|
| Phase 3: Synthesis | ✅ Complete | `pipeline.py` — LLM briefing generation |
|
|
| Phase 4: Audio | ✅ Complete | `tts_engine.py` — Piper + ElevenLabs hybrid |
|
|
| Phase 5: Delivery | ✅ Complete | `pipeline.py` — Telegram text + voice |
|
|
| Orchestrator | ✅ Complete | `pipeline.py` — asyncio CLI + Python API |
|
|
| Tests | ✅ Complete | `tests/test_e2e.py` — dry-run validation |
|
|
| Systemd Timer | ✅ Complete | `systemd/deepdive.timer` — 06:00 daily |
|
|
|
|
## Quick Start
|
|
|
|
See [`QUICKSTART.md`](QUICKSTART.md) for exact commands to run the pipeline.
|
|
|
|
## Sovereignty Compliance
|
|
|
|
| Component | Implementation | Non-Negotiable |
|
|
|-----------|----------------|----------------|
|
|
| Aggregation | Local RSS polling | No third-party APIs |
|
|
| Relevance | sentence-transformers local | No cloud embeddings |
|
|
| Synthesis | Gemma 4 via Hermes llama-server | No OpenAI/Anthropic API |
|
|
| TTS | Piper TTS local | No ElevenLabs |
|
|
| Delivery | Hermes Telegram gateway | Existing infra |
|
|
|
|
## Files
|
|
|
|
- `pipeline.py` — Main orchestrator (production implementation)
|
|
- `tts_engine.py` — Phase 4 TTS engine (Piper + ElevenLabs fallback)
|
|
- `config.yaml` — Configuration template
|
|
- `Makefile` — Build automation (`make test-e2e`, `make install-systemd`)
|
|
- `tests/` — pytest suite including end-to-end dry-run test
|
|
- `systemd/` — Daily timer for 06:00 execution
|
|
- `QUICKSTART.md` — Step-by-step execution guide
|
|
- `architecture.md` — Full technical specification
|
|
- `telegram_command.py` — Hermes `/deepdive` command handler
|
|
|
|
## Issue
|
|
|
|
[#830](http://143.198.27.163:3000/Timmy_Foundation/the-nexus/issues/830) — Deep Dive: Sovereign NotebookLM + Daily AI Intelligence Briefing
|