Backup Strategies
The golden rule: backups you can't restore are art
Backups are the DR safety net: snapshots, point-in-time recovery, cross-region copies, immutability (ransomware/accident), retention policies, and restore verification. The discipline: test restores, not just backups.
What you will learn
- Choose snapshot vs PITR vs database-native backup
- Design retention + cross-region + immutability
- Automate restore verification
Backup types: VM/EBS snapshots, database PITR (WAL/binlog replay to a second), managed DB automated backups, object-storage copies/versioning. Strategy = schedule + retention tiers + cross-region copy + immutable vault. Proof = regular restore drills.
What is this?
Tools: AWS Backup (vaults, VTLs, cross-region copy, policies), EBS snapshots, RDS automated backups + PITR, Aurora, Azure Backup (Recovery Services vault, MARS agent, LRS/GRS/GZRS), GCP Cloud Backup and DR, AlloyDB/Cloud SQL backups, GCS versioning/Object holds. Concepts: retention (short daily, longer weekly/monthly, archive), cold tiers for cost, immutability (Object Lock / write-once) against ransomware and fat-finger deletes, restoration verification (recover to isolate and verify data), backup testing as part of CI/DR. 3-2-1 rule: 3 copies, 2 media, 1 offsite. Pitfalls: backing up to same region, relying on the provider backup that is delete-on-close, restore permissions missing.
Why do you need it?
- Backups are the last line of defense against accidental delete, corruption, and ransomware.
- Cross-region copies and immutability turn a data loss incident into a data retrieval.
- Restore drills find what 'we have backups' actually means.
- Audits across the industry hinge on 'we can restore from X' evidence.
Mental model
A safe-deposit box + copy in your own home: one is handy, one is off-site
3-2-1 backups
You need the copy at home (fast) and the one in the vault (catastrophe); a single copy at the bank is not a backup strategy, it's hope. Same for same-region-only snaps.
How it works
- Provider snapshots app/db storage at cadence.
- Retention policy keeps daily/weekly/monthly, archiving old to cold storage.
- Copy vault + snapshot cross-region on a schedule (or on write).
- Immutability protects copies for a duration.
- Restore drills restore a known dataset to isolation and verify.
Backup lifecycle.
Examples
AWS Backup plan (pseudo)
plan: "mcp-db-backups"selections: [ db-arn ]schedule: cron(0 2 * * ? *) # dailycompletion: 8lifecycle: cold: 7; delete_after: 90copy_action: destination_region: us-west-2 lifecycle: { cold: 30, delete_after: 365 }vault_lock: ON # immutable, hard stop deletionDaily vaulting, cold after a week, cross-region immutable copy — restore targets are unambiguous.
In production
- Managed DB PITR + daily vaulted snapshots with cross-region copy.
- Object storage versioning + lifecycle to cold, with write-object-lock on audit buckets.
- Monthly restore drill: restore to staging RDS, verify row counts/checksum, then delete.
Best practices
- 3-2-1: at least one copy off-site and ideally immutable.
- PITR beats HBI for DBs where minutes of data matter.
- Restore verification on schedule — the only honest backup test.
- Keep backup IAM scoped and documented (restore after DR = someone can actually run it).
- Audit backup coverage for every workload quarterly (new services often have none).
Common mistakes
- Snapshots in the same region only — the whole regional copy dies with the region.
- Retention battles cost: deleting early is how the one needed copy vanishes.
- No restore permissions/runbook: the backup exists, nobody can use it in a hurry.
- Trusting provider defaults (e.g., 'PITR enabled' without cross-region coverage).
Debugging tips
- Restore fails with permissions → the vault/role that can restore wasn't tested; verify in the drill.
- Backup bill ballooning → lifecycle/retention drift; check the cold tier for stale copies.
- Cross-region copy not appearing → region replication lag or the vault copy action misconfigured.
- Restore gives inconsistent DB → you backed up the volume without quiescing; use app-consistent backups or DB-native PITR.
Interview checkpoint
Quick quiz
The real proof a backup strategy works is:
Immutability in backups protects against: