Resolved -
This issue was resolved over the weekend. We will continue to monitor for elevated latency in the modified queues.
Jul 20, 10:32 PDT
Update -
Latency remains elevated by about 30% for large repos. We are continuing to monitor and do what we can to mitigate until we can implement a longer-term solution.
Jul 17, 08:48 PDT
Update -
We are continuing to proactively monitor and clear the large repo queues.
We are working on a longer term solution over the weekend and will post about it in the postmortem for this issue when complete.
We will keep this incident open as long as we have large repo queues with above-average latency.
Jul 16, 11:25 PDT
Update -
We are continuing to monitor for any further issues.
Jul 15, 17:47 PDT
Update -
We have reduced traffic in affected queues by 75%. We still expect to clear the queue within about 1 hr. We will post updates here. If you think you may have been paused as a user with a large repo (>=5K source files) that has uploaded 3-10x normal daily uploads, please reach out to us at support@coveralls.io and we'll confirm and give you some next steps to avoid further pauses (see Usage Add-Ons at https://coveralls.io/pricing).
Jul 15, 11:14 PDT
Monitoring -
All systems fully functional. We have identified increased latency for large repos again and have proactively arrested sources of excess requests. We expect to restore normal latency within the hour.
Jul 15, 10:28 PDT