Partial API Outage

Incident Report for Segment

Resolved

It's come to our attention that between November 3 at 12:20 pm PT and November 4 at 1:20am PT we had an outage that caused a loss of ~48.8% of server-side events, affecting all server-side integrations and data warehouses. We mitigated the root cause a week ago as soon as we found it, but we only learned the full impact it had on your data last night.

Roughly half of the server-side events that we received through our API during the affected window were unrecoverable. As such, this data did not reach your enabled server-side integrations, webhooks, Amazon S3 buckets, or warehouses. Warehouse data from cloud sources, and data in client-side integrated tools were both unaffected.

We've already sent an email to the affected customers, and we will have a full post-mortem forthcoming in the next few weeks. Please email friends@segment.com if you have any questions, and we'll do our best to make things right.

We know that as a Segment customer, you put the utmost faith in your data. As stewards of that data, we don't take that responsibility lightly. We will do better and do everything in our power to make things right.
Posted Nov 03, 2016 - 18:39 PDT