Skip to content

Rollback Procedures

Overview

Emergency procedures for rolling back problematic releases. Target: < 1 hour to complete rollback.

Contents

  • rollback_checklist.md - Complete rollback procedure
  • emergency_hotfix.md - Rapid fix and re-release process
  • version_yanking.md - How to yank bad releases from distribution

When to Rollback

Severity 1: IMMEDIATE (< 15 minutes)

  • Plugin crashes DAW
  • Data corruption
  • Security vulnerability

Severity 2: URGENT (< 1 hour)

  • Major functionality broken
  • Unacceptable performance
  • Wide platform incompatibility

Severity 3: QUEUE (Next release)

  • Minor bugs
  • Cosmetic issues

Quick Rollback

# 1. SSH to update server
ssh deployer@updates.audiolab.com

# 2. Yank bad version
cd /var/www/releases
mv v2.1.3 quarantine/v2.1.3-yanked-$(date +%Y%m%d-%H%M%S)

# 3. Restore previous version
cp -r v2.1.2 v2.1.3
ln -sf v2.1.2 latest

# 4. Update manifest
cat > version.json << EOF
{
  "latest": "2.1.2",
  "yanked": ["2.1.3"]
}
EOF

# 5. Restart update service
sudo systemctl restart audiolab-update-server

User Notification

Subject: [URGENT] AudioLab v2.1.3 Rollback

We've discovered a critical issue in v2.1.3.

ACTION REQUIRED:
1. Uninstall v2.1.3
2. Download v2.1.2: https://audiolab.com/downloads/v2.1.2
3. Install v2.1.2

Fix coming within 48h.

Post-Rollback

Within 24h: - [ ] Root cause analysis - [ ] Fix developed and tested - [ ] Hotfix release (v2.1.4) - [ ] Post-mortem published

  • ../03_13_03_distribution_channels/ - Where to yank from
  • ../03_13_05_release_validation/ - Prevent future issues