Files
timmy-tower/artifacts/api-server/src/routes/bootstrap.ts

214 lines
7.2 KiB
TypeScript
Raw Normal View History

Task #5: Lightning-gated node bootstrap (proof-of-concept) Pay a Lightning invoice → Timmy auto-provisions a Bitcoin full node on DO. New: lib/db/src/schema/bootstrap-jobs.ts - bootstrap_jobs table: id, state, amountSats, paymentHash, paymentRequest, dropletId, nodeIp, tailscaleHostname, lnbitsUrl, sshPrivateKey, sshKeyDelivered (bool), errorMessage, createdAt, updatedAt - States: awaiting_payment | provisioning | ready | failed - Payment data stored inline (no FK to jobs/invoices tables — separate entity) - db:push applied to create table in Postgres New: artifacts/api-server/src/lib/provisioner.ts - ProvisionerService: stubs when DO_API_TOKEN absent, real otherwise - Stub mode: generates a real RSA 4096-bit SSH keypair via ssh-keygen, returns RFC 5737 test IP + fake Tailscale hostname after 2s delay - Real mode: upload SSH public key to DO → generate Tailscale auth key → create DO droplet with cloud-init user_data → poll for public IP (2 min) - buildCloudInitScript(): non-interactive bash that installs Docker + Tailscale + UFW + Bitcoin Knots via docker-compose; joins Tailscale if authkey provided - provision() designed as fire-and-forget (void); updates DB to ready/failed New: artifacts/api-server/src/routes/bootstrap.ts - POST /api/bootstrap: create job + LNbits invoice, return paymentRequest - GET /api/bootstrap/:id: poll-driven state machine * awaiting_payment: checks payment, fires provisioner on confirm * provisioning: returns progress message * ready: delivers credentials; SSH private key delivered once then cleared * failed: returns error message - Stub mode message includes the exact /dev/stub/pay URL for easy testing - nextSteps array guides user through post-provision setup Updated: artifacts/api-server/src/lib/pricing.ts - Added bootstrapFee field reading BOOTSTRAP_FEE_SATS env var (default 10000) - calculateBootstrapFeeSats() method Updated: artifacts/api-server/src/routes/index.ts - Mounts bootstrapRouter Updated: replit.md - Documents all 7 new env vars (DO_API_TOKEN, DO_REGION, DO_SIZE, etc.) - Full curl-based flow example with annotated response shape End-to-end verified in stub mode: POST → pay → provisioning → ready (SSH key) → second GET clears key and shows sshKeyNote
2026-03-18 18:47:48 +00:00
import { Router, type Request, type Response } from "express";
import { randomUUID } from "crypto";
import { db, bootstrapJobs, type BootstrapJob } from "@workspace/db";
Fix Task #5 review findings: race guard, full stack cloud-init, volume, node:crypto SSH 4 changes to address code review rejections: 1. Race condition fix (bootstrap.ts) - advanceBootstrapJob: WHERE now guards on AND state='awaiting_payment' - If UPDATE matches 0 rows, re-fetch current job (already advanced by another concurrent poll) instead of firing a second provisioner - Verified with 5-concurrent-poll test: only 1 "starting provisioning" log entry per job; all 5 responses show consistent state 2. Complete cloud-init to full Bitcoin + LND + LNbits stack (provisioner.ts) - Phase 1: packages, Docker, Tailscale, UFW, block volume mount - Phase 2: Bitcoin Core started; polls for RPC availability (max 5 min) - Phase 3: LND started; waits for REST API (max 6 min) - Phase 4: non-interactive LND wallet init via REST: POST /v1/genseed → POST /v1/initwallet with base64 password (no lncli, no interactive prompts, no expect) - Phase 5: waits for admin.macaroon to appear on mounted volume - Phase 6: LNbits started with LndRestWallet backend; mounts LND data dir so it reads tls.cert + admin.macaroon automatically - Phase 7: saves all credentials (RPC pass, LND wallet pass + seed mnemonic, LNbits URL) to chmod 600 /root/node-credentials.txt 3. DO block volume support (provisioner.ts) - Reads DO_VOLUME_SIZE_GB env var (0 = no volume, default) - createVolume(): POST /v2/volumes (ext4 filesystem, tagged timmy-node) - Passes volumeId in droplet create payload (attached at boot) - Cloud-init Phase 1 detects and mounts the volume automatically (lsblk scan → mkfs if unformatted → mount → /etc/fstab entry) 4. SSH keypair via node:crypto (no ssh-keygen) (provisioner.ts) - generateKeyPairSync('rsa', { modulusLength: 4096 }) - Public key: PKCS#1 DER → OpenSSH wire format via manual DER parser (pkcs1DerToSshPublicKey): reads SEQUENCE → n, e INTEGERs → ssh-rsa base64 string with proper mpint encoding (leading 0x00 for high bit) - Private key: PKCS#1 PEM (-----BEGIN RSA PRIVATE KEY-----) - Both stub and real paths use the same generateSshKeypair() function - Removes runtime dependency on host ssh-keygen binary entirely
2026-03-18 18:55:40 +00:00
import { eq, and } from "drizzle-orm";
Task #5: Lightning-gated node bootstrap (proof-of-concept) Pay a Lightning invoice → Timmy auto-provisions a Bitcoin full node on DO. New: lib/db/src/schema/bootstrap-jobs.ts - bootstrap_jobs table: id, state, amountSats, paymentHash, paymentRequest, dropletId, nodeIp, tailscaleHostname, lnbitsUrl, sshPrivateKey, sshKeyDelivered (bool), errorMessage, createdAt, updatedAt - States: awaiting_payment | provisioning | ready | failed - Payment data stored inline (no FK to jobs/invoices tables — separate entity) - db:push applied to create table in Postgres New: artifacts/api-server/src/lib/provisioner.ts - ProvisionerService: stubs when DO_API_TOKEN absent, real otherwise - Stub mode: generates a real RSA 4096-bit SSH keypair via ssh-keygen, returns RFC 5737 test IP + fake Tailscale hostname after 2s delay - Real mode: upload SSH public key to DO → generate Tailscale auth key → create DO droplet with cloud-init user_data → poll for public IP (2 min) - buildCloudInitScript(): non-interactive bash that installs Docker + Tailscale + UFW + Bitcoin Knots via docker-compose; joins Tailscale if authkey provided - provision() designed as fire-and-forget (void); updates DB to ready/failed New: artifacts/api-server/src/routes/bootstrap.ts - POST /api/bootstrap: create job + LNbits invoice, return paymentRequest - GET /api/bootstrap/:id: poll-driven state machine * awaiting_payment: checks payment, fires provisioner on confirm * provisioning: returns progress message * ready: delivers credentials; SSH private key delivered once then cleared * failed: returns error message - Stub mode message includes the exact /dev/stub/pay URL for easy testing - nextSteps array guides user through post-provision setup Updated: artifacts/api-server/src/lib/pricing.ts - Added bootstrapFee field reading BOOTSTRAP_FEE_SATS env var (default 10000) - calculateBootstrapFeeSats() method Updated: artifacts/api-server/src/routes/index.ts - Mounts bootstrapRouter Updated: replit.md - Documents all 7 new env vars (DO_API_TOKEN, DO_REGION, DO_SIZE, etc.) - Full curl-based flow example with annotated response shape End-to-end verified in stub mode: POST → pay → provisioning → ready (SSH key) → second GET clears key and shows sshKeyNote
2026-03-18 18:47:48 +00:00
import { lnbitsService } from "../lib/lnbits.js";
import { pricingService } from "../lib/pricing.js";
import { provisionerService } from "../lib/provisioner.js";
const router = Router();
async function getBootstrapJobById(id: string): Promise<BootstrapJob | null> {
const rows = await db
.select()
.from(bootstrapJobs)
.where(eq(bootstrapJobs.id, id))
.limit(1);
return rows[0] ?? null;
}
/**
* Advances the bootstrap job state machine on each poll.
*
* awaiting_payment (payment confirmed) provisioning
* (provisioner runs async and writes ready/failed to DB)
*
* Returns the refreshed job, or null if a DB read is needed.
*/
async function advanceBootstrapJob(job: BootstrapJob): Promise<BootstrapJob | null> {
if (job.state !== "awaiting_payment") return job;
const isPaid = await lnbitsService.checkInvoicePaid(job.paymentHash);
if (!isPaid) return job;
Fix Task #5 review findings: race guard, full stack cloud-init, volume, node:crypto SSH 4 changes to address code review rejections: 1. Race condition fix (bootstrap.ts) - advanceBootstrapJob: WHERE now guards on AND state='awaiting_payment' - If UPDATE matches 0 rows, re-fetch current job (already advanced by another concurrent poll) instead of firing a second provisioner - Verified with 5-concurrent-poll test: only 1 "starting provisioning" log entry per job; all 5 responses show consistent state 2. Complete cloud-init to full Bitcoin + LND + LNbits stack (provisioner.ts) - Phase 1: packages, Docker, Tailscale, UFW, block volume mount - Phase 2: Bitcoin Core started; polls for RPC availability (max 5 min) - Phase 3: LND started; waits for REST API (max 6 min) - Phase 4: non-interactive LND wallet init via REST: POST /v1/genseed → POST /v1/initwallet with base64 password (no lncli, no interactive prompts, no expect) - Phase 5: waits for admin.macaroon to appear on mounted volume - Phase 6: LNbits started with LndRestWallet backend; mounts LND data dir so it reads tls.cert + admin.macaroon automatically - Phase 7: saves all credentials (RPC pass, LND wallet pass + seed mnemonic, LNbits URL) to chmod 600 /root/node-credentials.txt 3. DO block volume support (provisioner.ts) - Reads DO_VOLUME_SIZE_GB env var (0 = no volume, default) - createVolume(): POST /v2/volumes (ext4 filesystem, tagged timmy-node) - Passes volumeId in droplet create payload (attached at boot) - Cloud-init Phase 1 detects and mounts the volume automatically (lsblk scan → mkfs if unformatted → mount → /etc/fstab entry) 4. SSH keypair via node:crypto (no ssh-keygen) (provisioner.ts) - generateKeyPairSync('rsa', { modulusLength: 4096 }) - Public key: PKCS#1 DER → OpenSSH wire format via manual DER parser (pkcs1DerToSshPublicKey): reads SEQUENCE → n, e INTEGERs → ssh-rsa base64 string with proper mpint encoding (leading 0x00 for high bit) - Private key: PKCS#1 PEM (-----BEGIN RSA PRIVATE KEY-----) - Both stub and real paths use the same generateSshKeypair() function - Removes runtime dependency on host ssh-keygen binary entirely
2026-03-18 18:55:40 +00:00
// Guard: only advance if still awaiting_payment — prevents duplicate provisioning
// on concurrent polls (each poll independently confirms payment).
Task #5: Lightning-gated node bootstrap (proof-of-concept) Pay a Lightning invoice → Timmy auto-provisions a Bitcoin full node on DO. New: lib/db/src/schema/bootstrap-jobs.ts - bootstrap_jobs table: id, state, amountSats, paymentHash, paymentRequest, dropletId, nodeIp, tailscaleHostname, lnbitsUrl, sshPrivateKey, sshKeyDelivered (bool), errorMessage, createdAt, updatedAt - States: awaiting_payment | provisioning | ready | failed - Payment data stored inline (no FK to jobs/invoices tables — separate entity) - db:push applied to create table in Postgres New: artifacts/api-server/src/lib/provisioner.ts - ProvisionerService: stubs when DO_API_TOKEN absent, real otherwise - Stub mode: generates a real RSA 4096-bit SSH keypair via ssh-keygen, returns RFC 5737 test IP + fake Tailscale hostname after 2s delay - Real mode: upload SSH public key to DO → generate Tailscale auth key → create DO droplet with cloud-init user_data → poll for public IP (2 min) - buildCloudInitScript(): non-interactive bash that installs Docker + Tailscale + UFW + Bitcoin Knots via docker-compose; joins Tailscale if authkey provided - provision() designed as fire-and-forget (void); updates DB to ready/failed New: artifacts/api-server/src/routes/bootstrap.ts - POST /api/bootstrap: create job + LNbits invoice, return paymentRequest - GET /api/bootstrap/:id: poll-driven state machine * awaiting_payment: checks payment, fires provisioner on confirm * provisioning: returns progress message * ready: delivers credentials; SSH private key delivered once then cleared * failed: returns error message - Stub mode message includes the exact /dev/stub/pay URL for easy testing - nextSteps array guides user through post-provision setup Updated: artifacts/api-server/src/lib/pricing.ts - Added bootstrapFee field reading BOOTSTRAP_FEE_SATS env var (default 10000) - calculateBootstrapFeeSats() method Updated: artifacts/api-server/src/routes/index.ts - Mounts bootstrapRouter Updated: replit.md - Documents all 7 new env vars (DO_API_TOKEN, DO_REGION, DO_SIZE, etc.) - Full curl-based flow example with annotated response shape End-to-end verified in stub mode: POST → pay → provisioning → ready (SSH key) → second GET clears key and shows sshKeyNote
2026-03-18 18:47:48 +00:00
const updated = await db
.update(bootstrapJobs)
.set({ state: "provisioning", updatedAt: new Date() })
Fix Task #5 review findings: race guard, full stack cloud-init, volume, node:crypto SSH 4 changes to address code review rejections: 1. Race condition fix (bootstrap.ts) - advanceBootstrapJob: WHERE now guards on AND state='awaiting_payment' - If UPDATE matches 0 rows, re-fetch current job (already advanced by another concurrent poll) instead of firing a second provisioner - Verified with 5-concurrent-poll test: only 1 "starting provisioning" log entry per job; all 5 responses show consistent state 2. Complete cloud-init to full Bitcoin + LND + LNbits stack (provisioner.ts) - Phase 1: packages, Docker, Tailscale, UFW, block volume mount - Phase 2: Bitcoin Core started; polls for RPC availability (max 5 min) - Phase 3: LND started; waits for REST API (max 6 min) - Phase 4: non-interactive LND wallet init via REST: POST /v1/genseed → POST /v1/initwallet with base64 password (no lncli, no interactive prompts, no expect) - Phase 5: waits for admin.macaroon to appear on mounted volume - Phase 6: LNbits started with LndRestWallet backend; mounts LND data dir so it reads tls.cert + admin.macaroon automatically - Phase 7: saves all credentials (RPC pass, LND wallet pass + seed mnemonic, LNbits URL) to chmod 600 /root/node-credentials.txt 3. DO block volume support (provisioner.ts) - Reads DO_VOLUME_SIZE_GB env var (0 = no volume, default) - createVolume(): POST /v2/volumes (ext4 filesystem, tagged timmy-node) - Passes volumeId in droplet create payload (attached at boot) - Cloud-init Phase 1 detects and mounts the volume automatically (lsblk scan → mkfs if unformatted → mount → /etc/fstab entry) 4. SSH keypair via node:crypto (no ssh-keygen) (provisioner.ts) - generateKeyPairSync('rsa', { modulusLength: 4096 }) - Public key: PKCS#1 DER → OpenSSH wire format via manual DER parser (pkcs1DerToSshPublicKey): reads SEQUENCE → n, e INTEGERs → ssh-rsa base64 string with proper mpint encoding (leading 0x00 for high bit) - Private key: PKCS#1 PEM (-----BEGIN RSA PRIVATE KEY-----) - Both stub and real paths use the same generateSshKeypair() function - Removes runtime dependency on host ssh-keygen binary entirely
2026-03-18 18:55:40 +00:00
.where(and(eq(bootstrapJobs.id, job.id), eq(bootstrapJobs.state, "awaiting_payment")))
Task #5: Lightning-gated node bootstrap (proof-of-concept) Pay a Lightning invoice → Timmy auto-provisions a Bitcoin full node on DO. New: lib/db/src/schema/bootstrap-jobs.ts - bootstrap_jobs table: id, state, amountSats, paymentHash, paymentRequest, dropletId, nodeIp, tailscaleHostname, lnbitsUrl, sshPrivateKey, sshKeyDelivered (bool), errorMessage, createdAt, updatedAt - States: awaiting_payment | provisioning | ready | failed - Payment data stored inline (no FK to jobs/invoices tables — separate entity) - db:push applied to create table in Postgres New: artifacts/api-server/src/lib/provisioner.ts - ProvisionerService: stubs when DO_API_TOKEN absent, real otherwise - Stub mode: generates a real RSA 4096-bit SSH keypair via ssh-keygen, returns RFC 5737 test IP + fake Tailscale hostname after 2s delay - Real mode: upload SSH public key to DO → generate Tailscale auth key → create DO droplet with cloud-init user_data → poll for public IP (2 min) - buildCloudInitScript(): non-interactive bash that installs Docker + Tailscale + UFW + Bitcoin Knots via docker-compose; joins Tailscale if authkey provided - provision() designed as fire-and-forget (void); updates DB to ready/failed New: artifacts/api-server/src/routes/bootstrap.ts - POST /api/bootstrap: create job + LNbits invoice, return paymentRequest - GET /api/bootstrap/:id: poll-driven state machine * awaiting_payment: checks payment, fires provisioner on confirm * provisioning: returns progress message * ready: delivers credentials; SSH private key delivered once then cleared * failed: returns error message - Stub mode message includes the exact /dev/stub/pay URL for easy testing - nextSteps array guides user through post-provision setup Updated: artifacts/api-server/src/lib/pricing.ts - Added bootstrapFee field reading BOOTSTRAP_FEE_SATS env var (default 10000) - calculateBootstrapFeeSats() method Updated: artifacts/api-server/src/routes/index.ts - Mounts bootstrapRouter Updated: replit.md - Documents all 7 new env vars (DO_API_TOKEN, DO_REGION, DO_SIZE, etc.) - Full curl-based flow example with annotated response shape End-to-end verified in stub mode: POST → pay → provisioning → ready (SSH key) → second GET clears key and shows sshKeyNote
2026-03-18 18:47:48 +00:00
.returning();
Fix Task #5 review findings: race guard, full stack cloud-init, volume, node:crypto SSH 4 changes to address code review rejections: 1. Race condition fix (bootstrap.ts) - advanceBootstrapJob: WHERE now guards on AND state='awaiting_payment' - If UPDATE matches 0 rows, re-fetch current job (already advanced by another concurrent poll) instead of firing a second provisioner - Verified with 5-concurrent-poll test: only 1 "starting provisioning" log entry per job; all 5 responses show consistent state 2. Complete cloud-init to full Bitcoin + LND + LNbits stack (provisioner.ts) - Phase 1: packages, Docker, Tailscale, UFW, block volume mount - Phase 2: Bitcoin Core started; polls for RPC availability (max 5 min) - Phase 3: LND started; waits for REST API (max 6 min) - Phase 4: non-interactive LND wallet init via REST: POST /v1/genseed → POST /v1/initwallet with base64 password (no lncli, no interactive prompts, no expect) - Phase 5: waits for admin.macaroon to appear on mounted volume - Phase 6: LNbits started with LndRestWallet backend; mounts LND data dir so it reads tls.cert + admin.macaroon automatically - Phase 7: saves all credentials (RPC pass, LND wallet pass + seed mnemonic, LNbits URL) to chmod 600 /root/node-credentials.txt 3. DO block volume support (provisioner.ts) - Reads DO_VOLUME_SIZE_GB env var (0 = no volume, default) - createVolume(): POST /v2/volumes (ext4 filesystem, tagged timmy-node) - Passes volumeId in droplet create payload (attached at boot) - Cloud-init Phase 1 detects and mounts the volume automatically (lsblk scan → mkfs if unformatted → mount → /etc/fstab entry) 4. SSH keypair via node:crypto (no ssh-keygen) (provisioner.ts) - generateKeyPairSync('rsa', { modulusLength: 4096 }) - Public key: PKCS#1 DER → OpenSSH wire format via manual DER parser (pkcs1DerToSshPublicKey): reads SEQUENCE → n, e INTEGERs → ssh-rsa base64 string with proper mpint encoding (leading 0x00 for high bit) - Private key: PKCS#1 PEM (-----BEGIN RSA PRIVATE KEY-----) - Both stub and real paths use the same generateSshKeypair() function - Removes runtime dependency on host ssh-keygen binary entirely
2026-03-18 18:55:40 +00:00
if (updated.length === 0) {
// Another concurrent request already advanced the state — just re-fetch.
return getBootstrapJobById(job.id);
}
Task #5: Lightning-gated node bootstrap (proof-of-concept) Pay a Lightning invoice → Timmy auto-provisions a Bitcoin full node on DO. New: lib/db/src/schema/bootstrap-jobs.ts - bootstrap_jobs table: id, state, amountSats, paymentHash, paymentRequest, dropletId, nodeIp, tailscaleHostname, lnbitsUrl, sshPrivateKey, sshKeyDelivered (bool), errorMessage, createdAt, updatedAt - States: awaiting_payment | provisioning | ready | failed - Payment data stored inline (no FK to jobs/invoices tables — separate entity) - db:push applied to create table in Postgres New: artifacts/api-server/src/lib/provisioner.ts - ProvisionerService: stubs when DO_API_TOKEN absent, real otherwise - Stub mode: generates a real RSA 4096-bit SSH keypair via ssh-keygen, returns RFC 5737 test IP + fake Tailscale hostname after 2s delay - Real mode: upload SSH public key to DO → generate Tailscale auth key → create DO droplet with cloud-init user_data → poll for public IP (2 min) - buildCloudInitScript(): non-interactive bash that installs Docker + Tailscale + UFW + Bitcoin Knots via docker-compose; joins Tailscale if authkey provided - provision() designed as fire-and-forget (void); updates DB to ready/failed New: artifacts/api-server/src/routes/bootstrap.ts - POST /api/bootstrap: create job + LNbits invoice, return paymentRequest - GET /api/bootstrap/:id: poll-driven state machine * awaiting_payment: checks payment, fires provisioner on confirm * provisioning: returns progress message * ready: delivers credentials; SSH private key delivered once then cleared * failed: returns error message - Stub mode message includes the exact /dev/stub/pay URL for easy testing - nextSteps array guides user through post-provision setup Updated: artifacts/api-server/src/lib/pricing.ts - Added bootstrapFee field reading BOOTSTRAP_FEE_SATS env var (default 10000) - calculateBootstrapFeeSats() method Updated: artifacts/api-server/src/routes/index.ts - Mounts bootstrapRouter Updated: replit.md - Documents all 7 new env vars (DO_API_TOKEN, DO_REGION, DO_SIZE, etc.) - Full curl-based flow example with annotated response shape End-to-end verified in stub mode: POST → pay → provisioning → ready (SSH key) → second GET clears key and shows sshKeyNote
2026-03-18 18:47:48 +00:00
console.log(`[bootstrap] Payment confirmed for ${job.id} — starting provisioning`);
// Fire-and-forget: provisioner updates DB when done
void provisionerService.provision(job.id);
return { ...job, state: "provisioning" };
}
/**
* POST /api/bootstrap
*
* Creates a bootstrap job and returns the Lightning invoice.
*/
router.post("/bootstrap", async (req: Request, res: Response) => {
try {
const fee = pricingService.calculateBootstrapFeeSats();
const jobId = randomUUID();
const invoice = await lnbitsService.createInvoice(
fee,
`Node bootstrap fee — job ${jobId}`,
);
await db.insert(bootstrapJobs).values({
id: jobId,
state: "awaiting_payment",
amountSats: fee,
paymentHash: invoice.paymentHash,
paymentRequest: invoice.paymentRequest,
});
res.status(201).json({
bootstrapJobId: jobId,
invoice: {
paymentRequest: invoice.paymentRequest,
amountSats: fee,
...(lnbitsService.stubMode ? { paymentHash: invoice.paymentHash } : {}),
},
stubMode: lnbitsService.stubMode || provisionerService.stubMode,
message: lnbitsService.stubMode
? `Stub mode: simulate payment with POST /api/dev/stub/pay/${invoice.paymentHash} then poll GET /api/bootstrap/:id`
: "Pay the invoice, then poll GET /api/bootstrap/:id for status",
});
} catch (err) {
const message = err instanceof Error ? err.message : "Failed to create bootstrap job";
res.status(500).json({ error: message });
}
});
/**
* GET /api/bootstrap/:id
*
* Polls status. Triggers provisioning once payment is confirmed.
* Returns credentials (SSH key delivered once, then cleared) when ready.
*/
router.get("/bootstrap/:id", async (req: Request, res: Response) => {
const { id } = req.params;
if (!id || typeof id !== "string") {
res.status(400).json({ error: "Invalid bootstrap job id" });
return;
}
try {
let job = await getBootstrapJobById(id);
if (!job) {
res.status(404).json({ error: "Bootstrap job not found" });
return;
}
const advanced = await advanceBootstrapJob(job);
if (advanced) job = advanced;
const base = {
bootstrapJobId: job.id,
state: job.state,
amountSats: job.amountSats,
createdAt: job.createdAt,
};
switch (job.state) {
case "awaiting_payment":
res.json({
...base,
invoice: {
paymentRequest: job.paymentRequest,
amountSats: job.amountSats,
...(lnbitsService.stubMode ? { paymentHash: job.paymentHash } : {}),
},
message: "Waiting for Lightning payment",
});
break;
case "provisioning":
res.json({
...base,
message: "Payment confirmed — provisioning your Bitcoin node. Poll again in ~30 s.",
});
break;
case "ready": {
// Atomic one-time SSH key delivery: only the request that wins the
// guarded UPDATE (WHERE ssh_key_delivered = false) delivers the key.
// Concurrent first-reads both see delivered=false in the pre-fetched
// job, but only one UPDATE matches — the other gets 0 rows and falls
// back to the "already delivered" note.
let sshPrivateKey: string | null = null;
let keyNote: string | null = null;
Task #5: Lightning-gated node bootstrap (proof-of-concept) Pay a Lightning invoice → Timmy auto-provisions a Bitcoin full node on DO. New: lib/db/src/schema/bootstrap-jobs.ts - bootstrap_jobs table: id, state, amountSats, paymentHash, paymentRequest, dropletId, nodeIp, tailscaleHostname, lnbitsUrl, sshPrivateKey, sshKeyDelivered (bool), errorMessage, createdAt, updatedAt - States: awaiting_payment | provisioning | ready | failed - Payment data stored inline (no FK to jobs/invoices tables — separate entity) - db:push applied to create table in Postgres New: artifacts/api-server/src/lib/provisioner.ts - ProvisionerService: stubs when DO_API_TOKEN absent, real otherwise - Stub mode: generates a real RSA 4096-bit SSH keypair via ssh-keygen, returns RFC 5737 test IP + fake Tailscale hostname after 2s delay - Real mode: upload SSH public key to DO → generate Tailscale auth key → create DO droplet with cloud-init user_data → poll for public IP (2 min) - buildCloudInitScript(): non-interactive bash that installs Docker + Tailscale + UFW + Bitcoin Knots via docker-compose; joins Tailscale if authkey provided - provision() designed as fire-and-forget (void); updates DB to ready/failed New: artifacts/api-server/src/routes/bootstrap.ts - POST /api/bootstrap: create job + LNbits invoice, return paymentRequest - GET /api/bootstrap/:id: poll-driven state machine * awaiting_payment: checks payment, fires provisioner on confirm * provisioning: returns progress message * ready: delivers credentials; SSH private key delivered once then cleared * failed: returns error message - Stub mode message includes the exact /dev/stub/pay URL for easy testing - nextSteps array guides user through post-provision setup Updated: artifacts/api-server/src/lib/pricing.ts - Added bootstrapFee field reading BOOTSTRAP_FEE_SATS env var (default 10000) - calculateBootstrapFeeSats() method Updated: artifacts/api-server/src/routes/index.ts - Mounts bootstrapRouter Updated: replit.md - Documents all 7 new env vars (DO_API_TOKEN, DO_REGION, DO_SIZE, etc.) - Full curl-based flow example with annotated response shape End-to-end verified in stub mode: POST → pay → provisioning → ready (SSH key) → second GET clears key and shows sshKeyNote
2026-03-18 18:47:48 +00:00
if (!job.sshKeyDelivered && job.sshPrivateKey) {
const won = await db
Task #5: Lightning-gated node bootstrap (proof-of-concept) Pay a Lightning invoice → Timmy auto-provisions a Bitcoin full node on DO. New: lib/db/src/schema/bootstrap-jobs.ts - bootstrap_jobs table: id, state, amountSats, paymentHash, paymentRequest, dropletId, nodeIp, tailscaleHostname, lnbitsUrl, sshPrivateKey, sshKeyDelivered (bool), errorMessage, createdAt, updatedAt - States: awaiting_payment | provisioning | ready | failed - Payment data stored inline (no FK to jobs/invoices tables — separate entity) - db:push applied to create table in Postgres New: artifacts/api-server/src/lib/provisioner.ts - ProvisionerService: stubs when DO_API_TOKEN absent, real otherwise - Stub mode: generates a real RSA 4096-bit SSH keypair via ssh-keygen, returns RFC 5737 test IP + fake Tailscale hostname after 2s delay - Real mode: upload SSH public key to DO → generate Tailscale auth key → create DO droplet with cloud-init user_data → poll for public IP (2 min) - buildCloudInitScript(): non-interactive bash that installs Docker + Tailscale + UFW + Bitcoin Knots via docker-compose; joins Tailscale if authkey provided - provision() designed as fire-and-forget (void); updates DB to ready/failed New: artifacts/api-server/src/routes/bootstrap.ts - POST /api/bootstrap: create job + LNbits invoice, return paymentRequest - GET /api/bootstrap/:id: poll-driven state machine * awaiting_payment: checks payment, fires provisioner on confirm * provisioning: returns progress message * ready: delivers credentials; SSH private key delivered once then cleared * failed: returns error message - Stub mode message includes the exact /dev/stub/pay URL for easy testing - nextSteps array guides user through post-provision setup Updated: artifacts/api-server/src/lib/pricing.ts - Added bootstrapFee field reading BOOTSTRAP_FEE_SATS env var (default 10000) - calculateBootstrapFeeSats() method Updated: artifacts/api-server/src/routes/index.ts - Mounts bootstrapRouter Updated: replit.md - Documents all 7 new env vars (DO_API_TOKEN, DO_REGION, DO_SIZE, etc.) - Full curl-based flow example with annotated response shape End-to-end verified in stub mode: POST → pay → provisioning → ready (SSH key) → second GET clears key and shows sshKeyNote
2026-03-18 18:47:48 +00:00
.update(bootstrapJobs)
.set({ sshKeyDelivered: true, sshPrivateKey: null, updatedAt: new Date() })
.where(and(eq(bootstrapJobs.id, job.id), eq(bootstrapJobs.sshKeyDelivered, false)))
.returning({ id: bootstrapJobs.id });
if (won.length > 0) {
// This request won the delivery race — return the key we pre-read.
sshPrivateKey = job.sshPrivateKey;
} else {
keyNote = "SSH private key was delivered on a concurrent request — check your records";
}
} else {
keyNote = "SSH private key was delivered on first retrieval — check your records";
Task #5: Lightning-gated node bootstrap (proof-of-concept) Pay a Lightning invoice → Timmy auto-provisions a Bitcoin full node on DO. New: lib/db/src/schema/bootstrap-jobs.ts - bootstrap_jobs table: id, state, amountSats, paymentHash, paymentRequest, dropletId, nodeIp, tailscaleHostname, lnbitsUrl, sshPrivateKey, sshKeyDelivered (bool), errorMessage, createdAt, updatedAt - States: awaiting_payment | provisioning | ready | failed - Payment data stored inline (no FK to jobs/invoices tables — separate entity) - db:push applied to create table in Postgres New: artifacts/api-server/src/lib/provisioner.ts - ProvisionerService: stubs when DO_API_TOKEN absent, real otherwise - Stub mode: generates a real RSA 4096-bit SSH keypair via ssh-keygen, returns RFC 5737 test IP + fake Tailscale hostname after 2s delay - Real mode: upload SSH public key to DO → generate Tailscale auth key → create DO droplet with cloud-init user_data → poll for public IP (2 min) - buildCloudInitScript(): non-interactive bash that installs Docker + Tailscale + UFW + Bitcoin Knots via docker-compose; joins Tailscale if authkey provided - provision() designed as fire-and-forget (void); updates DB to ready/failed New: artifacts/api-server/src/routes/bootstrap.ts - POST /api/bootstrap: create job + LNbits invoice, return paymentRequest - GET /api/bootstrap/:id: poll-driven state machine * awaiting_payment: checks payment, fires provisioner on confirm * provisioning: returns progress message * ready: delivers credentials; SSH private key delivered once then cleared * failed: returns error message - Stub mode message includes the exact /dev/stub/pay URL for easy testing - nextSteps array guides user through post-provision setup Updated: artifacts/api-server/src/lib/pricing.ts - Added bootstrapFee field reading BOOTSTRAP_FEE_SATS env var (default 10000) - calculateBootstrapFeeSats() method Updated: artifacts/api-server/src/routes/index.ts - Mounts bootstrapRouter Updated: replit.md - Documents all 7 new env vars (DO_API_TOKEN, DO_REGION, DO_SIZE, etc.) - Full curl-based flow example with annotated response shape End-to-end verified in stub mode: POST → pay → provisioning → ready (SSH key) → second GET clears key and shows sshKeyNote
2026-03-18 18:47:48 +00:00
}
res.json({
...base,
credentials: {
nodeIp: job.nodeIp,
tailscaleHostname: job.tailscaleHostname,
lnbitsUrl: job.lnbitsUrl,
sshPrivateKey,
...(keyNote ? { sshKeyNote: keyNote } : {}),
},
nextSteps: [
Fix Task #5 review findings: race guard, full stack cloud-init, volume, node:crypto SSH 4 changes to address code review rejections: 1. Race condition fix (bootstrap.ts) - advanceBootstrapJob: WHERE now guards on AND state='awaiting_payment' - If UPDATE matches 0 rows, re-fetch current job (already advanced by another concurrent poll) instead of firing a second provisioner - Verified with 5-concurrent-poll test: only 1 "starting provisioning" log entry per job; all 5 responses show consistent state 2. Complete cloud-init to full Bitcoin + LND + LNbits stack (provisioner.ts) - Phase 1: packages, Docker, Tailscale, UFW, block volume mount - Phase 2: Bitcoin Core started; polls for RPC availability (max 5 min) - Phase 3: LND started; waits for REST API (max 6 min) - Phase 4: non-interactive LND wallet init via REST: POST /v1/genseed → POST /v1/initwallet with base64 password (no lncli, no interactive prompts, no expect) - Phase 5: waits for admin.macaroon to appear on mounted volume - Phase 6: LNbits started with LndRestWallet backend; mounts LND data dir so it reads tls.cert + admin.macaroon automatically - Phase 7: saves all credentials (RPC pass, LND wallet pass + seed mnemonic, LNbits URL) to chmod 600 /root/node-credentials.txt 3. DO block volume support (provisioner.ts) - Reads DO_VOLUME_SIZE_GB env var (0 = no volume, default) - createVolume(): POST /v2/volumes (ext4 filesystem, tagged timmy-node) - Passes volumeId in droplet create payload (attached at boot) - Cloud-init Phase 1 detects and mounts the volume automatically (lsblk scan → mkfs if unformatted → mount → /etc/fstab entry) 4. SSH keypair via node:crypto (no ssh-keygen) (provisioner.ts) - generateKeyPairSync('rsa', { modulusLength: 4096 }) - Public key: PKCS#1 DER → OpenSSH wire format via manual DER parser (pkcs1DerToSshPublicKey): reads SEQUENCE → n, e INTEGERs → ssh-rsa base64 string with proper mpint encoding (leading 0x00 for high bit) - Private key: PKCS#1 PEM (-----BEGIN RSA PRIVATE KEY-----) - Both stub and real paths use the same generateSshKeypair() function - Removes runtime dependency on host ssh-keygen binary entirely
2026-03-18 18:58:40 +00:00
`SSH into your node using the private key above: ssh -i <key_file> root@${job.nodeIp ?? "<nodeIp>"}`,
"Read your node credentials: cat /root/node-credentials.txt",
"Monitor Bitcoin sync (takes 1-2 weeks to reach 100%): bash /opt/timmy-node/ops.sh sync",
Fix Task #5 review findings: race guard, full stack cloud-init, volume, node:crypto SSH 4 changes to address code review rejections: 1. Race condition fix (bootstrap.ts) - advanceBootstrapJob: WHERE now guards on AND state='awaiting_payment' - If UPDATE matches 0 rows, re-fetch current job (already advanced by another concurrent poll) instead of firing a second provisioner - Verified with 5-concurrent-poll test: only 1 "starting provisioning" log entry per job; all 5 responses show consistent state 2. Complete cloud-init to full Bitcoin + LND + LNbits stack (provisioner.ts) - Phase 1: packages, Docker, Tailscale, UFW, block volume mount - Phase 2: Bitcoin Core started; polls for RPC availability (max 5 min) - Phase 3: LND started; waits for REST API (max 6 min) - Phase 4: non-interactive LND wallet init via REST: POST /v1/genseed → POST /v1/initwallet with base64 password (no lncli, no interactive prompts, no expect) - Phase 5: waits for admin.macaroon to appear on mounted volume - Phase 6: LNbits started with LndRestWallet backend; mounts LND data dir so it reads tls.cert + admin.macaroon automatically - Phase 7: saves all credentials (RPC pass, LND wallet pass + seed mnemonic, LNbits URL) to chmod 600 /root/node-credentials.txt 3. DO block volume support (provisioner.ts) - Reads DO_VOLUME_SIZE_GB env var (0 = no volume, default) - createVolume(): POST /v2/volumes (ext4 filesystem, tagged timmy-node) - Passes volumeId in droplet create payload (attached at boot) - Cloud-init Phase 1 detects and mounts the volume automatically (lsblk scan → mkfs if unformatted → mount → /etc/fstab entry) 4. SSH keypair via node:crypto (no ssh-keygen) (provisioner.ts) - generateKeyPairSync('rsa', { modulusLength: 4096 }) - Public key: PKCS#1 DER → OpenSSH wire format via manual DER parser (pkcs1DerToSshPublicKey): reads SEQUENCE → n, e INTEGERs → ssh-rsa base64 string with proper mpint encoding (leading 0x00 for high bit) - Private key: PKCS#1 PEM (-----BEGIN RSA PRIVATE KEY-----) - Both stub and real paths use the same generateSshKeypair() function - Removes runtime dependency on host ssh-keygen binary entirely
2026-03-18 18:58:40 +00:00
"Once sync is complete, fund your LND wallet, then open LNbits to create your wallet and get the API key",
"Set LNBITS_URL and LNBITS_API_KEY in your Timmy deployment to enable payment processing",
Task #5: Lightning-gated node bootstrap (proof-of-concept) Pay a Lightning invoice → Timmy auto-provisions a Bitcoin full node on DO. New: lib/db/src/schema/bootstrap-jobs.ts - bootstrap_jobs table: id, state, amountSats, paymentHash, paymentRequest, dropletId, nodeIp, tailscaleHostname, lnbitsUrl, sshPrivateKey, sshKeyDelivered (bool), errorMessage, createdAt, updatedAt - States: awaiting_payment | provisioning | ready | failed - Payment data stored inline (no FK to jobs/invoices tables — separate entity) - db:push applied to create table in Postgres New: artifacts/api-server/src/lib/provisioner.ts - ProvisionerService: stubs when DO_API_TOKEN absent, real otherwise - Stub mode: generates a real RSA 4096-bit SSH keypair via ssh-keygen, returns RFC 5737 test IP + fake Tailscale hostname after 2s delay - Real mode: upload SSH public key to DO → generate Tailscale auth key → create DO droplet with cloud-init user_data → poll for public IP (2 min) - buildCloudInitScript(): non-interactive bash that installs Docker + Tailscale + UFW + Bitcoin Knots via docker-compose; joins Tailscale if authkey provided - provision() designed as fire-and-forget (void); updates DB to ready/failed New: artifacts/api-server/src/routes/bootstrap.ts - POST /api/bootstrap: create job + LNbits invoice, return paymentRequest - GET /api/bootstrap/:id: poll-driven state machine * awaiting_payment: checks payment, fires provisioner on confirm * provisioning: returns progress message * ready: delivers credentials; SSH private key delivered once then cleared * failed: returns error message - Stub mode message includes the exact /dev/stub/pay URL for easy testing - nextSteps array guides user through post-provision setup Updated: artifacts/api-server/src/lib/pricing.ts - Added bootstrapFee field reading BOOTSTRAP_FEE_SATS env var (default 10000) - calculateBootstrapFeeSats() method Updated: artifacts/api-server/src/routes/index.ts - Mounts bootstrapRouter Updated: replit.md - Documents all 7 new env vars (DO_API_TOKEN, DO_REGION, DO_SIZE, etc.) - Full curl-based flow example with annotated response shape End-to-end verified in stub mode: POST → pay → provisioning → ready (SSH key) → second GET clears key and shows sshKeyNote
2026-03-18 18:47:48 +00:00
],
stubMode: provisionerService.stubMode,
message: provisionerService.stubMode
? "Stub mode — these are fake credentials. Set DO_API_TOKEN for real provisioning."
: "Your node is being bootstrapped. Bitcoin sync has started.",
});
break;
}
case "failed":
res.json({
...base,
errorMessage: job.errorMessage,
message: "Provisioning failed. Contact the operator for a refund.",
});
break;
default:
res.json(base);
}
} catch (err) {
const message = err instanceof Error ? err.message : "Failed to fetch bootstrap job";
res.status(500).json({ error: message });
}
});
export default router;