Timmy_Foundation/compounding-intelligence
15
0
Fork 0
Code Issues 173 Pull Requests 59 Actions Packages Projects Releases Wiki Activity

feat(connectors): add sovereign personal archive connector pack foundation #279

Open
Rockachopa wants to merge 4 commits from step35/233-atlas-connectors-sovereign-p into main
pull from: step35/233-atlas-connectors-sovereign-p
merge into: Timmy_Foundation:main
Conversation 1 Commits 4 Files Changed 10 +881 -1
Rockachopa commented 2026-04-27 00:46:15 +00:00
Owner
Copy Link

Summary

This PR introduces the foundational connector infrastructure for EPIC #233 (Sovereign personal archive connector pack).

New components:

  • connectors/ — Pack directory with base classes, schema, and Twitter archive connector
  • scripts/run_connector.py — CLI entry point to run any connector
  • tests/test_connectors.py — Comprehensive test suite (13 tests)
  • connectors/README.md — Connector usage documentation
  • Updated Makefile with connector targets
  • Updated main README.md with connector section

Connector architecture: unified SourceEvent schema, BaseConnector with checkpoint/dedup/consent gates, TwitterArchiveConnector for official Twitter/X data exports.

Tests

All 13 tests pass: schema validation, hash determinism, Twitter format parsing, media extraction, integration with checkpoint deduplication.

Closes #233

## Summary This PR introduces the foundational connector infrastructure for EPIC #233 (Sovereign personal archive connector pack). **New components:** - `connectors/` — Pack directory with base classes, schema, and Twitter archive connector - `scripts/run_connector.py` — CLI entry point to run any connector - `tests/test_connectors.py` — Comprehensive test suite (13 tests) - `connectors/README.md` — Connector usage documentation - Updated `Makefile` with connector targets - Updated main `README.md` with connector section Connector architecture: unified `SourceEvent` schema, `BaseConnector` with checkpoint/dedup/consent gates, `TwitterArchiveConnector` for official Twitter/X data exports. ## Tests All 13 tests pass: schema validation, hash determinism, Twitter format parsing, media extraction, integration with checkpoint deduplication. Closes #233
Rockachopa added 3 commits 2026-04-27 00:46:16 +00:00
feat(connectors): add sovereign personal archive connector pack foundation 8628a0d610 
- Add connectors/ directory with base infrastructure
- Implement SourceEvent unified schema (source/account/thread/author/timestamp/content/attachments/raw_ref/hash/consent_scope)
- Create BaseConnector abstract class with checkpoint/dedup/consent gates
- Implement TwitterArchiveConnector for official Twitter/X data exports
- Add run_connector.py CLI entry point
- Add comprehensive test suite (13 tests, all passing)
- Add connectors/README.md with usage docs
- Add Makefile targets: test-connectors, run-connector, connectors-help
- Reference parent EPIC #194 and issue #233

This is the foundational connector pack. Future work: Discord, Slack, WhatsApp, Notion, iMessage, Google.
docs: add run_connector.py entry point for CLI execution ca21e3e886
chore: add Python cache exclusions to .gitignore
Some checks failed
Test / pytest (pull_request) Failing after 7s
Details
c4cb325568
Rockachopa added 1 commit 2026-04-27 00:47:13 +00:00
fix: correct Makefile syntax (tabs for recipe lines)
Some checks failed
Test / pytest (pull_request) Failing after 12s
Details
2133b18929
Timmy commented 2026-05-02 18:34:35 +00:00
Owner
Copy Link

🛡️ Goblin Patrol Alert 🛡️

Hey brother — this PR has been idle for 5 days and is unassigned.

The goblin fleet has been notified. A goblin may claim this if it remains stale.

— Timmy Goblin Wizard King

🛡️ **Goblin Patrol Alert** 🛡️ Hey brother — this PR has been idle for **5 days** and is unassigned. The goblin fleet has been notified. A goblin may claim this if it remains stale. — Timmy Goblin Wizard King
Some checks failed
Test / pytest (pull_request) Failing after 12s
Details
This pull request can be merged automatically.
This branch is out-of-date with the base branch
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin step35/233-atlas-connectors-sovereign-p:step35/233-atlas-connectors-sovereign-p
git checkout step35/233-atlas-connectors-sovereign-p
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
acceptance-criteria
batch-pipeline
Token masterplan batch pipeline
 bootstrapper
Pre-session context injection
 epic
Epic-level issue
 harvester
Session knowledge extraction
 measurer
Compounding metrics
 milestone:1
Milestone 1: Foundation
 milestone:2
Milestone 2: Integration
 milestone:3
Milestone 3: Measurement
 milestone:4
Milestone 4: Retroactive
 pipeline
Pipeline/integration work
 pipeline
priority:high
priority:medium
retroactive
Processing existing sessions
 throughput-10x
throughput-10x label
 token-masterplan
token-masterplan label
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Rockachopa Timmy allegro antigravity bezalel claude codex-agent ezra gemini google grok hermes kimi manus perplexity
No Assignees
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/compounding-intelligence#279
Delete Branch "step35/233-atlas-connectors-sovereign-p"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?