Skip to main content

Resources

Technical Runbooks

Battle-tested operational procedures from our incident response team. Copy, paste, resolve.

Kubernetes
CrashLoopBackOff Recovery
10 min
  1. Check pod logs: kubectl logs <pod>
  2. Describe pod for events: kubectl describe pod <pod>
  3. Check OOM: look for "OOMKilled" in last state
  4. Fix: update resource limits or fix application error
  5. Verify: watch pod restart count stabilize
PostgreSQL
Replication Lag Recovery
15 min
  1. Check lag: SELECT pg_last_wal_replay_lsn()
  2. Identify cause: long-running queries, I/O bottleneck, network
  3. If I/O: increase WAL sender buffer, check IOPS
  4. If query: pg_terminate_backend() the blocker
  5. Monitor: check pg_stat_replication continuously
Security
AWS IAM Key Rotation
20 min
  1. Create new access key via IAM console or CLI
  2. Update all applications with new key
  3. Verify traffic flowing with new key (CloudTrail)
  4. Wait 24h to confirm no legacy usage
  5. Deactivate then delete old key
Incident Response
Production Outage Checklist
5 min
  1. Page on-call engineer (PagerDuty)
  2. Open incident channel in Slack
  3. Check dashboards: Grafana → service overview
  4. Check recent deploys: git log --since="2 hours ago"
  5. Communicate: update status page within 10 min
CI/CD
Failed Deployment Rollback
8 min
  1. Identify failed deploy: check CI pipeline logs
  2. Rollback: kubectl rollout undo deployment/<name>
  3. Verify: kubectl rollout status deployment/<name>
  4. Check: curl health endpoint, verify 200
  5. Post-mortem: tag failed commit, create issue
AWS
EBS Volume Full Recovery
12 min
  1. SSH/SSM into instance
  2. Find full volume: df -h, identify mount point
  3. Clear space: logs, tmp, old deploy artifacts
  4. If root vol: extend via AWS console → modify volume
  5. Resize filesystem: sudo growpart + resize2fs

Want a custom runbook for your stack?

Our engineers build bespoke incident playbooks as part of every retainer.

Get Custom Runbooks
500+
Companies Trust Us
99.99%
Uptime SLA
<15 min
Response Time
$4M+
Client Savings
"CloudLink saved us $200K in Black Friday downtime. Their response time is unmatched."
— Marcus T., CTO, FinTech Startup
Want Custom Runbooks for Your Stack?
Our engineers build bespoke incident playbooks as part of every engagement.
Get a DevOps Retainer
SOC2 CompliantAES-256 Encryption24/7 US Engineers
+1-800-CLOUDLINK [email protected] WhatsApp
30-day money-back guarantee No long-term contract Fix it or it's free