All Pingdom services full restored. Second opinions and root cause analysis works and no further alert delays.
Post mortem to follow.
Oct 10, 14:04 UTC
The queue buildup in certain alerts has cleared up. After further analysis we're seeing that this only affected a select few unfortunate customers using our BeepManager alerting system. We saw 5-10 minute delays in these alerts.
All alerting is now processing in real time, second opinions and root cause analysis is being reenabled.
Oct 10, 13:52 UTC
Due to a severe outage we've logged more than 100.000 outages reported in just the last hour, this has caused delayed alerts for some customers and our root cause analysis functionality has been temporarily suspended.
We're monitoring and taking action to mitigate the issue now.
Oct 10, 13:39 UTC