At approximately 8:30AM PST we started to notice some instability in the webservers where the servers started to spike in their processes. At this time we haven't investigated the exact cause of the issue but were notified that it was occuring.
Our Pingdom monitoring services did not report any consistent downtime (checks are run every 5 minutes and there needs to be at least 2 reports of downtime where the servers took longer than 30 seconds to respond in order for us to be notified of the issue).It looks like the instability started and briefly recovered on it's own where we had one timeout and then a second timeout occurred 10 minutes later (with a "good" check in between). Because there was a "good" check in between the 10 minute window we weren't alerted to the issue.
We are still looking into what exactly caused the spike in HTTP processes at this time and will update this post when we have resolution.

No comments:
Post a Comment