This incident has been resolved. Functionality at our cloud provider has been restored. We sincerely thank you for your patience and we continue to actively monitor the situation.
Monitoring
Monitoring
We have noticed a significant decrease in 5xx errors. We will continue to monitor the situation.
Investigating
Investigating
We're experiencing 5xx elevated error rate due to AWS us-east-1 outage.
> Oct 20 10:03 AM PDT We continue to apply mitigation steps for network load balancer health and recovering connectivity for most AWS services. Lambda is experiencing function invocation errors because an internal subsystem was impacted by the network load balancer health checks. We are taking steps to recover this internal Lambda system. For EC2 launch instance failures, we are in the process of validating a fix and will deploy to the first AZ as soon as we have confidence we can do so safely. We will provide an update by 10:45 AM PDT.
Production down
Resolved
Resolved
This incident has been resolved. All systems are functional. Thank you for your patience.
Monitoring
Monitoring
We've an update from AWS. Systems are working as expected. We're monitoring.