A code change occurred during normal operations that introduced a bug affecting the perimeter servers' routing tables, causing addresses for active users to be removed. The issue was identified by our internal monitoring systems immediately, and our operations team was notified and rolled back the change. A repair procedure was then run on the routing tables. Upon completion, all services returned to normal operation, and the incident was resolved.

All inbound and outbound emails through the perimeter were rejected during the initial part of the incident. No emails were queued; therefore, senders will need to resend any emails that were rejected. The incident lasted 27 minutes from origin to complete resolution, but not all users were affected the entire time.

Email flow is critical to most businesses, and we understand the immediate impact that can have on you and your clients. This incident was caused by human error, and the team is reviewing process to prevent a similar occurrence. We appreciate the quick feedback from all partners that contacted us. Thank you.