Database Performance Issues

We've now resolved the incident. Thanks for your patience.

We'll continue to capture more information as we continue through the day and provide a post-mortem within the next few days.

Database performance should be near-normal as we continue to see improvements to the issues following multiple methods of mitigation and adjustments to database configuration. We have enabled further monitoring and performance analytics as a benefit of this incident, and we'll continue to use those throughout to day for further analysis and planning to final resolution.

We have action items to review as a results of yesterday, and will be working through that list today along with analysis.

We'll provide an update to the current state of progress within 3 hours.

We've applied an improvement to the core issue, and are waiting for things to fully recover. We will continue to monitor the progress of the improvements to confirm things fully recover.

We'll provide an update during early business hours tomorrow after data collection and monitoring throughout tonight.

We are continuing to further understand the performance impacts as we work to continue mitigation. We have been able to put further mitigation and tooling in place to continue to improve monitoring and measure improvements.

We will post another update within 90 mins.

We are still seeing performance impacts within the database as we continue to work through and optimize areas of issue.

We will provide another update within 90 mins.

We continue to make performance enhancements to further mitigate the existing issues.

We will continue to provide updates here within the next 90 mins.

We continue to see performance issues as we work to continue optimizing. We will be continuing to roll out more optimizations and provide updates here as we see their effects.

We will post another update within the next 90 mins.

We continue to monitor and release performance improvements as we work to further mitigate the existing issues.

We will provide another update within 90 minutes.

Following a recent required upgrade, we are experience a performance issue within our database that is affecting lookups related to campaign sending. We are currently able to mitigate this issue by adjusting campaign sending to trigger every 5 minutes instead of every minute.

We continue to recon sources of the performance issues and will be pushing out updates to optimize query performance and scalability throughout the day. We will provide another update within the next 90 minutes.