Outbound load balancer issue

Incident Report for Mailprotector

Resolved

Around 9:00 am ET, IP addresses on the Amazon Web Services (AWS) back end began to point to expired destinations. The cause of the issue is undetermined because it occurred in the network layer of the AWS load balancers, not Mailprotector's infrastructure. Once the behavior was identified, the team manually pointed servers to the updated destinations until the load balancers were automatically updated.

The load balancer issue caused a tiny percentage of emails to stall on the way out to the internet. The load balancers are updated, and the team has not seen a destination change that would cause further issues.

Today's behavior is unrelated to last week's inbound mail delivery delays. However, the team is examining the situation and working with AWS to add monitors that would provide a more timely response to changes with the load balancers.

Posted Aug 15, 2022 - 10:00 EDT