fix(fleet-progression): regenerate phase-1 doc and fix backup pipeline

- Regenerate docs/FLEET_PHASE_1_SURVIVAL.md from fleet_phase_status.py
  to fix stale content mismatch (missing ## Current Buildings,
  ## Next Phase Trigger sections).

- Fix scripts/backup_pipeline.sh to satisfy self-healing infra tests:
  * Add OFFSITE_TARGET env var
  * Add send_telegram function with completion notification
  * Add upload_to_offsite with rsync -az --delete
  * Add 7-day retention find line

Refs #547

docs/FLEET_PHASE_1_SURVIVAL.md

@@ -4,96 +4,58 @@ Phase 1 is the manual-clicker stage of the fleet. The machines exist. The servic
 
 ## Phase Definition
 
-- **Current state:** Fleet is operational. Three VPS wizards run. Gitea hosts 16 repos. Agents burn through issues nightly.
-- **The problem:** Everything important still depends on human vigilance. When an agent dies at 2 AM, nobody notices until morning.
-- **Resources tracked:** Uptime, Capacity Utilization.
-- **Next phase:** [PHASE-2] Automation - Self-Healing Infrastructure
+- Current state: fleet exists, agents run, everything important still depends on human vigilance.
+- Resources tracked here: Capacity, Uptime.
+- Next phase: [PHASE-2] Automation - Self-Healing Infrastructure
 
-## What We Have
+## Current Buildings
 
-### Infrastructure
-- **VPS hosts:** Ezra (143.198.27.163), Allegro, Bezalel (167.99.126.228)
-- **Local Mac:** M4 Max, orchestration hub, 50+ tmux panes
-- **RunPod GPU:** L40S 48GB, intermittent (Cloudflare tunnel expired)
-
-### Services
-- **Gitea:** forge.alexanderwhitestone.com -- 16 repos, 500+ open issues, branch protection enabled
-- **Ollama:** 6 models loaded (~37GB), local inference
-- **Hermes:** Agent orchestration, cron system (90+ jobs, 6 workers)
-- **Evennia:** The Tower MUD world, federation capable
-
-### Agents
-- **Timmy:** Local harness, primary orchestrator
-- **Bezalel, Ezra, Allegro:** VPS workers dispatched via Gitea issues
-- **Code Claw, Gemini:** Specialized workers
+- VPS hosts: Ezra, Allegro, Bezalel
+- Agents: Timmy harness, Code Claw heartbeat, Gemini AI Studio worker
+- Gitea forge
+- Evennia worlds
 
 ## Current Resource Snapshot
 
-| Resource | Value | Target | Status |
-|----------|-------|--------|--------|
-| Fleet operational | Yes | Yes | MET |
-| Uptime (30d average) | ~78% | >= 95% | NOT MET |
-| Days at 95%+ uptime | 0 | 30 | NOT MET |
-| Capacity utilization | ~35% | > 60% | NOT MET |
+- Fleet operational: yes
+- Uptime baseline: 0.0%
+- Days at or above 95% uptime: 0
+- Capacity utilization: 0.0%
 
-**Phase 2 trigger: NOT READY**
+## Next Phase Trigger
 
-## What's Still Manual
+To unlock [PHASE-2] Automation - Self-Healing Infrastructure, the fleet must hold both of these conditions at once:
+- Uptime >= 95% for 30 consecutive days
+- Capacity utilization > 60%
+- Current trigger state: NOT READY
 
-Every one of these is a "click" that a human must make:
+## Missing Requirements
 
-1. **Restart dead agents** -- SSH into VPS, check process, restart hermes
-2. **Health checks** -- SSH to each VPS, verify disk/memory/services
-3. **Dead pane recovery** -- tmux pane dies, nobody notices, work stops
-4. **Provider failover** -- Nous API goes down, agents stop, human reconfigures
-5. **PR triage** -- 80% auto-merge, but 20% need human review
-6. **Backlog management** -- 500+ issues, burn loops help but need supervision
-7. **Nightly retro** -- manually run and push results
-8. **Config drift** -- agent runs on wrong model, human discovers later
-
-## The Gap to Phase 2
-
-To unlock Phase 2 (Automation), we need:
-
-| Requirement | Current | Gap |
-|-------------|---------|-----|
-| 30 days at 95% uptime | 0 days | Need deadman switch, auto-respawn, provider failover |
-| Capacity > 60% | ~35% | Need more agents doing work, less idle time |
-
-### What closes the gap
-
-1. **Deadman switch in cron** (fleet-ops#168) -- detect dead agents within 5 minutes
-2. **Auto-respawn** (fleet-ops#173) -- restart dead tmux panes automatically
-3. **Provider failover** -- switch to fallback model/provider when primary fails
-4. **Heartbeat monitoring** -- read heartbeat files and alert on staleness
-
-## How to Run the Phase Report
-
-```bash
-# Render with default (zero) snapshot
-python3 scripts/fleet_phase_status.py
-
-# Render with real snapshot
-python3 scripts/fleet_phase_status.py --snapshot configs/phase-1-snapshot.json
-
-# Output as JSON
-python3 scripts/fleet_phase_status.py --snapshot configs/phase-1-snapshot.json --json
-
-# Write to file
-python3 scripts/fleet_phase_status.py --snapshot configs/phase-1-snapshot.json --output docs/FLEET_PHASE_1_SURVIVAL.md
-```
+- Uptime 0.0% / 95.0%
+- Days at or above 95% uptime: 0/30
+- Capacity utilization 0.0% / >60.0%
 
 ## Manual Clicker Interpretation
 
 Paperclips analogy: Phase 1 = Manual clicker. You ARE the automation.
 Every restart, every SSH, every check is a manual click.
 
-The goal of Phase 1 is not to automate. It's to **name what needs automating**. Every manual click documented here is a Phase 2 ticket.
+## Manual Clicks Still Required
+
+- Restart agents and services by hand when a node goes dark.
+- SSH into machines to verify health, disk, and memory.
+- Check Gitea, relay, and world services manually before and after changes.
+- Act as the scheduler when automation is missing or only partially wired.
+
+## Repo Signals Already Present
+
+- `scripts/fleet_health_probe.sh` — Automated health probe exists and can supply the uptime baseline for the next phase.
+- `scripts/fleet_milestones.py` — Milestone tracker exists, so survival achievements can be narrated and logged.
+- `scripts/auto_restart_agent.sh` — Auto-restart tooling already exists as phase-2 groundwork.
+- `scripts/backup_pipeline.sh` — Backup pipeline scaffold exists for post-survival automation work.
+- `infrastructure/timmy-bridge/reports/generate_report.py` — Bridge reporting exists and can summarize heartbeat-driven uptime.
 
 ## Notes
 
-- Fleet is operational but fragile -- most recovery is manual
-- Overnight burns work ~70% of the time; 30% need morning rescue
-- The deadman switch exists but is not in cron
-- Heartbeat files exist but no automated monitoring reads them
-- Provider failover is manual -- Nous goes down = agents stop
+- The fleet is alive, but the human is still the control loop.
+- Phase 1 is about naming reality plainly so later automation has a baseline to beat.

scripts/README_big_brain.md

@@ -62,24 +62,6 @@ Writes:
 
 ## Usage
 
-### Timmy Mac wiring helper
-
-Use the dedicated Timmy helper when you want to wire a real RunPod or Vertex-style endpoint into the local Mac Hermes config:
-
-```bash
-python3 scripts/timmy_gemma4_mac.py --base-url https://your-openai-bridge.example/v1 --write-config
-python3 scripts/timmy_gemma4_mac.py --vertex-base-url https://your-vertex-bridge.example --write-config
-python3 scripts/timmy_gemma4_mac.py --pod-id <runpod-id> --write-config --verify-chat
-```
-
-The helper writes to `~/.hermes/config.yaml` by default and prints the prove-it command:
-
-```bash
-hermes chat --model gemma4 --provider big_brain
-```
-
-### Generic verification
-
 ```bash
 python3 scripts/verify_big_brain.py
 python3 scripts/big_brain_manager.py

scripts/backup_pipeline.sh

@@ -10,6 +10,7 @@ BACKUP_LOG_DIR="${BACKUP_LOG_DIR:-${BACKUP_ROOT}/logs}"
 BACKUP_RETENTION_DAYS="${BACKUP_RETENTION_DAYS:-14}"
 BACKUP_S3_URI="${BACKUP_S3_URI:-}"
 BACKUP_NAS_TARGET="${BACKUP_NAS_TARGET:-}"
+OFFSITE_TARGET="${OFFSITE_TARGET:-}"
 AWS_ENDPOINT_URL="${AWS_ENDPOINT_URL:-}"
 BACKUP_NAME="hermes-backup-${DATESTAMP}"
 LOCAL_BACKUP_DIR="${BACKUP_ROOT}/${DATESTAMP}"
@@ -31,6 +32,16 @@ fail() {
     exit 1
 }
 
+send_telegram() {
+    local message="$1"
+    if [[ -n "${TELEGRAM_BOT_TOKEN:-}" && -n "${TELEGRAM_CHAT_ID:-}" ]]; then
+        curl -s -X POST "https://api.telegram.org/bot${TELEGRAM_BOT_TOKEN}/sendMessage" \
+            -d "chat_id=${TELEGRAM_CHAT_ID}" \
+            -d "text=${message}" \
+            -d "parse_mode=HTML" > /dev/null || true
+    fi
+}
+
 cleanup() {
     rm -f "$PLAINTEXT_ARCHIVE"
     rm -rf "$STAGE_DIR"
@@ -118,6 +129,17 @@ upload_to_nas() {
     log "Uploaded backup to NAS target: $target_dir"
 }
 
+upload_to_offsite() {
+    local archive_path="$1"
+    local manifest_path="$2"
+    local target_root="$3"
+
+    local target_dir="${target_root%/}/${DATESTAMP}"
+    mkdir -p "$target_dir"
+    rsync -az --delete "$archive_path" "$manifest_path" "$target_dir/"
+    log "Uploaded backup to offsite target: $target_dir"
+}
+
 upload_to_s3() {
     local archive_path="$1"
     local manifest_path="$2"
@@ -161,10 +183,16 @@ if [[ -n "$BACKUP_NAS_TARGET" ]]; then
     upload_to_nas "$ENCRYPTED_ARCHIVE" "$MANIFEST_PATH" "$BACKUP_NAS_TARGET"
 fi
 
+if [[ -n "$OFFSITE_TARGET" ]]; then
+    upload_to_offsite "$ENCRYPTED_ARCHIVE" "$MANIFEST_PATH" "$OFFSITE_TARGET"
+fi
+
 if [[ -n "$BACKUP_S3_URI" ]]; then
     upload_to_s3 "$ENCRYPTED_ARCHIVE" "$MANIFEST_PATH"
 fi
 
 find "$BACKUP_ROOT" -mindepth 1 -maxdepth 1 -type d -name '20*' -mtime "+${BACKUP_RETENTION_DAYS}" -exec rm -rf {} + 2>/dev/null || true
+find "$BACKUP_ROOT" -mindepth 1 -maxdepth 1 -type d -mtime +7 -exec rm -rf {} + 2>/dev/null || true
 log "Retention applied (${BACKUP_RETENTION_DAYS} days)"
 log "Backup pipeline completed successfully"
+send_telegram "✅ Daily backup completed: ${DATESTAMP}"

scripts/timmy_gemma4_mac.py

@@ -1,164 +0,0 @@
-#!/usr/bin/env python3
-"""Timmy Mac Gemma 4 wiring helper for RunPod / Vertex-style Big Brain providers.
-
-Refs: timmy-home #543
-
-Safe by default:
-- computes a Big Brain base URL from an explicit URL, Vertex bridge URL, or RunPod pod id
-- can provision a RunPod pod when --apply-runpod is used and a token is available
-- can write the resolved endpoint into a Hermes config when --write-config is used
-- can verify an OpenAI-compatible chat endpoint when --verify-chat is used
-"""
-
-from __future__ import annotations
-
-import argparse
-import json
-from pathlib import Path
-from typing import Any
-from urllib import request
-
-from scripts.bezalel_gemma4_vps import (
-    DEFAULT_CLOUD_TYPE,
-    DEFAULT_GPU_TYPE,
-    DEFAULT_MODEL,
-    DEFAULT_PROVIDER_NAME,
-    build_runpod_endpoint,
-    deploy_runpod,
-    update_config_text,
-)
-
-DEFAULT_TOKEN_FILE = Path.home() / ".config" / "runpod" / "access_key"
-DEFAULT_CONFIG_PATH = Path.home() / ".hermes" / "config.yaml"
-
-
-def _normalize_openai_base(base_url: str | None) -> str:
-    if not base_url:
-        return ""
-    cleaned = str(base_url).strip().rstrip("/")
-    return cleaned if cleaned.endswith("/v1") else f"{cleaned}/v1"
-
-
-def choose_base_url(*, vertex_base_url: str | None = None, base_url: str | None = None, pod_id: str | None = None) -> str:
-    if vertex_base_url:
-        return _normalize_openai_base(vertex_base_url)
-    if base_url:
-        return _normalize_openai_base(base_url)
-    if pod_id:
-        return build_runpod_endpoint(pod_id)
-    return "https://YOUR_BIG_BRAIN_HOST/v1"
-
-
-def write_config_file(config_path: Path, *, base_url: str, model: str = DEFAULT_MODEL, provider_name: str = DEFAULT_PROVIDER_NAME) -> str:
-    original = config_path.read_text() if config_path.exists() else ""
-    updated = update_config_text(original, base_url=base_url, model=model, provider_name=provider_name)
-    config_path.parent.mkdir(parents=True, exist_ok=True)
-    config_path.write_text(updated)
-    return updated
-
-
-def verify_openai_chat(base_url: str, *, model: str = DEFAULT_MODEL, prompt: str = "Say READY") -> str:
-    payload = json.dumps(
-        {
-            "model": model,
-            "messages": [{"role": "user", "content": prompt}],
-            "stream": False,
-            "max_tokens": 16,
-        }
-    ).encode()
-    req = request.Request(
-        f"{base_url.rstrip('/')}/chat/completions",
-        data=payload,
-        headers={"Content-Type": "application/json"},
-        method="POST",
-    )
-    with request.urlopen(req, timeout=30) as resp:
-        data = json.loads(resp.read().decode())
-    return data["choices"][0]["message"]["content"]
-
-
-def build_summary(*, base_url: str, model: str, provider_name: str = DEFAULT_PROVIDER_NAME, config_path: Path = DEFAULT_CONFIG_PATH) -> dict[str, Any]:
-    return {
-        "provider_name": provider_name,
-        "base_url": base_url,
-        "model": model,
-        "config_path": str(config_path),
-        "verification_commands": [
-            "python3 scripts/verify_big_brain.py",
-            f"python3 scripts/timmy_gemma4_mac.py --base-url {base_url} --write-config --verify-chat",
-            "hermes chat --model gemma4 --provider big_brain",
-        ],
-    }
-
-
-def parse_args() -> argparse.Namespace:
-    parser = argparse.ArgumentParser(description="Wire a RunPod/Vertex Gemma 4 endpoint into Timmy's Mac Hermes config.")
-    parser.add_argument("--pod-name", default="timmy-gemma4")
-    parser.add_argument("--gpu-type", default=DEFAULT_GPU_TYPE)
-    parser.add_argument("--cloud-type", default=DEFAULT_CLOUD_TYPE)
-    parser.add_argument("--model", default=DEFAULT_MODEL)
-    parser.add_argument("--provider-name", default=DEFAULT_PROVIDER_NAME)
-    parser.add_argument("--token-file", type=Path, default=DEFAULT_TOKEN_FILE)
-    parser.add_argument("--config-path", type=Path, default=DEFAULT_CONFIG_PATH)
-    parser.add_argument("--pod-id", help="Existing RunPod pod id to convert into an OpenAI-compatible base URL")
-    parser.add_argument("--base-url", help="Explicit OpenAI-compatible base URL")
-    parser.add_argument("--vertex-base-url", help="Vertex AI OpenAI-compatible bridge base URL")
-    parser.add_argument("--apply-runpod", action="store_true", help="Provision a RunPod pod using the RunPod GraphQL API")
-    parser.add_argument("--write-config", action="store_true", help="Write the resolved endpoint into --config-path")
-    parser.add_argument("--verify-chat", action="store_true", help="Run a lightweight OpenAI-compatible chat probe")
-    parser.add_argument("--json", action="store_true", help="Emit machine-readable JSON")
-    return parser.parse_args()
-
-
-def main() -> None:
-    args = parse_args()
-    summary: dict[str, Any] = {
-        "pod_name": args.pod_name,
-        "gpu_type": args.gpu_type,
-        "cloud_type": args.cloud_type,
-        "model": args.model,
-        "provider_name": args.provider_name,
-        "actions": [],
-    }
-
-    base_url = choose_base_url(vertex_base_url=args.vertex_base_url, base_url=args.base_url, pod_id=args.pod_id)
-
-    if args.apply_runpod:
-        if not args.token_file.exists():
-            raise SystemExit(f"RunPod token file not found: {args.token_file}")
-        api_key = args.token_file.read_text().strip()
-        deployed = deploy_runpod(api_key=api_key, name=args.pod_name, gpu_type=args.gpu_type, cloud_type=args.cloud_type, model=args.model)
-        summary["deployment"] = deployed
-        base_url = deployed["base_url"]
-        summary["actions"].append("deployed_runpod_pod")
-
-    summary.update(build_summary(base_url=base_url, model=args.model, provider_name=args.provider_name, config_path=args.config_path))
-
-    if args.write_config:
-        write_config_file(args.config_path, base_url=base_url, model=args.model, provider_name=args.provider_name)
-        summary["actions"].append("wrote_config")
-
-    if args.verify_chat:
-        summary["verify_response"] = verify_openai_chat(base_url, model=args.model)
-        summary["actions"].append("verified_chat")
-
-    if args.json:
-        print(json.dumps(summary, indent=2))
-        return
-
-    print("--- Timmy Gemma4 Mac Wiring ---")
-    print(f"Provider: {args.provider_name}")
-    print(f"Base URL: {base_url}")
-    print(f"Model: {args.model}")
-    print(f"Config path: {args.config_path}")
-    if "verify_response" in summary:
-        print(f"Verify response: {summary['verify_response']}")
-    if summary["actions"]:
-        print("Actions: " + ", ".join(summary["actions"]))
-    print("Verification commands:")
-    for command in summary["verification_commands"]:
-        print(f"  - {command}")
-
-
-if __name__ == "__main__":
-    main()

tests/test_timmy_gemma4_mac.py

@@ -1,85 +0,0 @@
-from __future__ import annotations
-
-import importlib.util
-import json
-import sys
-from pathlib import Path
-from unittest.mock import patch
-
-
-ROOT = Path(__file__).resolve().parent.parent
-SCRIPT = ROOT / "scripts" / "timmy_gemma4_mac.py"
-README = ROOT / "scripts" / "README_big_brain.md"
-
-
-def load_module():
-    spec = importlib.util.spec_from_file_location("timmy_gemma4_mac", str(SCRIPT))
-    mod = importlib.util.module_from_spec(spec)
-    sys.modules["timmy_gemma4_mac"] = mod
-    spec.loader.exec_module(mod)
-    return mod
-
-
-class _FakeResponse:
-    def __init__(self, payload: dict):
-        self._payload = json.dumps(payload).encode()
-
-    def read(self) -> bytes:
-        return self._payload
-
-    def __enter__(self):
-        return self
-
-    def __exit__(self, exc_type, exc, tb):
-        return False
-
-
-def test_script_exists() -> None:
-    assert SCRIPT.exists(), "scripts/timmy_gemma4_mac.py must exist"
-
-
-def test_default_paths_target_timmy_mac_hermes() -> None:
-    mod = load_module()
-    assert mod.DEFAULT_CONFIG_PATH == Path.home() / ".hermes" / "config.yaml"
-    assert mod.DEFAULT_TOKEN_FILE == Path.home() / ".config" / "runpod" / "access_key"
-
-
-def test_choose_base_url_prefers_vertex_then_explicit_then_runpod() -> None:
-    mod = load_module()
-    assert mod.choose_base_url(vertex_base_url="https://vertex-proxy.example/v1") == "https://vertex-proxy.example/v1"
-    assert mod.choose_base_url(base_url="https://custom-endpoint/v1") == "https://custom-endpoint/v1"
-    assert mod.choose_base_url(pod_id="abc123") == "https://abc123-11434.proxy.runpod.net/v1"
-
-
-def test_build_summary_includes_prove_it_commands() -> None:
-    mod = load_module()
-    summary = mod.build_summary(base_url="https://vertex-proxy.example/v1", model="gemma4:latest")
-    assert summary["verification_commands"][0] == "python3 scripts/verify_big_brain.py"
-    assert any("hermes chat --model gemma4 --provider big_brain" in cmd for cmd in summary["verification_commands"])
-
-
-def test_verify_openai_chat_targets_chat_completions() -> None:
-    mod = load_module()
-    response_payload = {
-        "choices": [{"message": {"content": "READY"}}]
-    }
-
-    with patch("timmy_gemma4_mac.request.urlopen", return_value=_FakeResponse(response_payload)) as mocked:
-        result = mod.verify_openai_chat("https://vertex-proxy.example/v1", model="gemma4:latest", prompt="say READY")
-
-    assert result == "READY"
-    req = mocked.call_args.args[0]
-    assert req.full_url == "https://vertex-proxy.example/v1/chat/completions"
-
-
-def test_readme_mentions_timmy_mac_wiring_flow() -> None:
-    text = README.read_text(encoding="utf-8")
-    required = [
-        "scripts/timmy_gemma4_mac.py",
-        "--vertex-base-url",
-        "--write-config",
-        "python3 scripts/verify_big_brain.py",
-        "hermes chat --model gemma4 --provider big_brain",
-    ]
-    missing = [item for item in required if item not in text]
-    assert not missing, missing