Update - We believe performance has been restored, and site is fully operational, but we will continue to clear any previously blocked (or retry) jobs we discover in background job queues and monitor performance stats as they clear.
Apr 24, 2025 - 12:35 PDT
Update - Monitoring for further issues. Performance for new builds is normal. Waiting for dequeue metrics to fall below 50% normal before we lift "degraded performance" rating.
Apr 24, 2025 - 11:01 PDT
Update - We believe the issue is resolved. We are scaling infrastructure to clear any delayed background jobs, and monitoring to ensure latency stays within normal range.
Apr 24, 2025 - 10:25 PDT
Update - We are continuing to monitor for any further issues.
Apr 24, 2025 - 09:46 PDT
Monitoring - A fix has been implemented and we are monitoring the results.
Apr 24, 2025 - 09:15 PDT
Identified - The issue has been identified and a fix is being implemented.
Apr 24, 2025 - 08:54 PDT
Investigating - We are investigating elevated latency in our background jobs system. Some users have also reported receiving Timeout errors while trying to load web pages.
Apr 24, 2025 - 08:35 PDT