Rockachopa
8628a0d610
- Add connectors/ directory with base infrastructure - Implement SourceEvent unified schema (source/account/thread/author/timestamp/content/attachments/raw_ref/hash/consent_scope) - Create BaseConnector abstract class with checkpoint/dedup/consent gates - Implement TwitterArchiveConnector for official Twitter/X data exports - Add run_connector.py CLI entry point - Add comprehensive test suite (13 tests, all passing) - Add connectors/README.md with usage docs - Add Makefile targets: test-connectors, run-connector, connectors-help - Reference parent EPIC #194 and issue #233 This is the foundational connector pack. Future work: Discord, Slack, WhatsApp, Notion, iMessage, Google.
15 lines
395 B
Makefile
15 lines
395 B
Makefile
1|.PHONY: test
|
|
2|
|
|
3|test:
|
|
4| python3 -m pytest tests/test_ci_config.py scripts/test_*.py -v
|
|
5|
|
|
# Connector targets
|
|
test-connectors:
|
|
python3 -m pytest tests/test_connectors.py -v
|
|
|
|
run-connector:
|
|
python3 scripts/run_connector.py $(CONNECTOR) --source $(SOURCE) --output $(OUTPUT) [--limit $(LIMIT)] [--dry-run]
|
|
|
|
connectors-help:
|
|
python3 scripts/run_connector.py --help
|