feat(connectors): add sovereign personal archive connector pack foundation
- Add connectors/ directory with base infrastructure - Implement SourceEvent unified schema (source/account/thread/author/timestamp/content/attachments/raw_ref/hash/consent_scope) - Create BaseConnector abstract class with checkpoint/dedup/consent gates - Implement TwitterArchiveConnector for official Twitter/X data exports - Add run_connector.py CLI entry point - Add comprehensive test suite (13 tests, all passing) - Add connectors/README.md with usage docs - Add Makefile targets: test-connectors, run-connector, connectors-help - Reference parent EPIC #194 and issue #233 This is the foundational connector pack. Future work: Discord, Slack, WhatsApp, Notion, iMessage, Google.
This commit is contained in:
13
README.md
13
README.md
@@ -27,6 +27,11 @@ Before a session starts, queries knowledge store for relevant facts. Assembles c
|
||||
### Pipeline 3: Measure
|
||||
Tracks whether compounding is happening. Knowledge velocity, error reduction, hit rate, task completion. Daily report proves the loop works.
|
||||
|
||||
### Connector Pack (EPIC #233)
|
||||
Sovereign personal archive connectors: Twitter/X, Discord, Slack, WhatsApp, Notion, iMessage, Google.
|
||||
Connectors mirror local exports or explicit API tokens → normalize → redact → index → sync with provenance.
|
||||
See [`connectors/`](connectors/README.md) for the full connector suite and usage.
|
||||
|
||||
## Directory Structure
|
||||
|
||||
```
|
||||
@@ -40,6 +45,12 @@ Tracks whether compounding is happening. Knowledge velocity, error reduction, hi
|
||||
│ ├── bootstrapper.py # Pre-session context loader
|
||||
│ ├── measurer.py # Compounding metrics
|
||||
│ └── session_reader.py # JSONL parser
|
||||
├── connectors/ # Personal archive connectors (EPIC #233)
|
||||
│ ├── __init__.py
|
||||
│ ├── base.py
|
||||
│ ├── schema.py
|
||||
│ ├── twitter_archive.py
|
||||
│ └── README.md
|
||||
├── metrics/
|
||||
│ └── dashboard.md # Human-readable status
|
||||
└── templates/
|
||||
@@ -65,4 +76,4 @@ See [all issues](https://forge.alexanderwhitestone.com/Timmy_Foundation/compound
|
||||
- EPIC 1: Session Harvester (#2)
|
||||
- EPIC 2: Knowledge Store & Bootstrap (#3)
|
||||
- EPIC 3: Compounding Measurement (#4)
|
||||
- EPIC 4: Retroactive Harvest (#5)
|
||||
- EPIC 4: Retroactive Harvest (#5)
|
||||
Reference in New Issue
Block a user