Master overview (PHASE4_PRODUCTION_INFRASTRUCTURE.md) plus five detail docs (PRODUCTION_DEPLOYMENT, PRODUCTION_NETWORK_SECURITY, BACKUP_DR, OBSERVABILITY, CAPACITY_PLANNING), a master PRODUCTION_VALIDATION_CHECKLIST, and 12 runbooks (first deployment, normal deploy, rollback, Postgres restore, VM rebuild for both hosts, Docker TLS rotation, TLS renewal, owner recovery, stuck Lab cleanup, failed migration, backup failure, disk failure, Lab Host resource pressure). PRODUCTION_NETWORK_SECURITY.md prominently documents the one genuine architectural gap this phase surfaced: the Gateway's existing env.internal_ip mechanism for reaching a Lab container assumes Gateway and Lab share a Docker daemon, which breaks once Labs run on a genuinely separate rn-lab-host-01 VM. The network-policy half is built (a firewall allowance for Gateway->Lab-Host on a published port range); the application half (Provisioner/Gateway address handling) is an explicit, reviewed, NOT-YET-BUILT follow-up flagged there rather than silently decided. Updated LAB_ARCHITECTURE.md, ENGINEERING_SOP.md, README.md, and platform/README.md with Phase 4 pointers, consistent with how every prior phase updated these. Status: PHASE 4 BUILD COMPLETE / PRODUCTION DEPLOYMENT PENDING HARDWARE.
18 lines
738 B
Markdown
18 lines
738 B
Markdown
# Runbook: Normal Deploy
|
|
|
|
For a routine code change already merged to `main` on the canonical Gitea repo.
|
|
|
|
1. CI (`infra/ci/gitea-workflows/build-and-test.yml`) runs automatically: tests, image build/tag/push, staging deploy, staging smoke test.
|
|
2. Review the staging smoke test result and, ideally, poke around `https://staging.<domain>` yourself.
|
|
3. Promote to production (manual, deliberate):
|
|
|
|
```bash
|
|
cd infra/scripts
|
|
./deploy-production.sh sha-<12-char-sha> # or a release tag, e.g. v1.3.0
|
|
./production-smoke-test.sh
|
|
```
|
|
|
|
4. Watch Grafana (`/grafana/`) for 10-15 minutes — error rates, Postgres connections, Lab Host
|
|
memory — before considering the deploy "settled."
|
|
5. If anything looks wrong: `docs/RUNBOOK_ROLLBACK.md`.
|