Lost Your State File? Terraform State Disaster Recovery and Production-Grade Backend Architecture
Overview 2 AM, my phone exploded. The ops channel for a ride-hailing project was flooding with alerts: RDS failover failed, EIP binding status abnormal, security group rules missing. After a long investigation, the root cause was someone manually modifying a security group rule through the console. Terraform’s state file was out of sync with the actual cloud state, and a routine terraform apply “corrected” the manually modified resources back to their old configuration—overwriting an emergency hotfix made on the production server....