Coveralls is in Read Only mode while we work on updating the system. Sorry for the inconvenience.

VIGILANCE! Check this page Any time you notice a problem with coveralls

All Systems Operational

Coveralls.io Web Operational

Coveralls.io API Operational

GitHub Operational

Travis CI API Operational

Pusher Presence channels Operational

Pusher WebSocket client API Operational

Stripe API Operational

Operational

Degraded Performance

Partial Outage

Major Outage

Maintenance

System Metrics Month Week Day

Average Web/API Response Time

Fetching

Coverage Calculation Background Job Dequeue Time

Fetching

Past Incidents

Aug 13, 2022

No incidents reported today.

Aug 12, 2022

Server outage last night may have affected build times for <1% repos.

Resolved - We had a couple of servers lose comms last night for unknown reasons. Between 4pm-6pm two servers hit over 90% CPU Util until they lost comms. This means the jobs on those servers would have failed due to timeouts and been retried. This morning there were about 300 jobs still in queue, which represents a fraction of a percent of jobs processed yesterday. We think this translates to less than 1% repos affected, by which we mean repos with longer-than-average build times. If you think you were affected, let us know at support@coveralls.io and we can verify.

As of 8a this morning, all components operating as normal. So no further effects are expected.
Aug 12, 11:08 PDT

Aug 11, 2022

No incidents reported.

Aug 10, 2022

No incidents reported.

Aug 9, 2022

No incidents reported.

Aug 8, 2022

No incidents reported.

Aug 7, 2022

Infrastructure Maintenance

Completed - The scheduled maintenance has been completed.
Aug 7, 12:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 7, 11:00 PDT

Scheduled - We will be undergoing scheduled maintenance during this time. The Web app may enter read-only mode and the API may be inaccessible for short periods during this window.
Aug 6, 10:00 PDT

Migrated servers this weekend - New static IP addresses

Resolved - Closing this as it was intended to stay open for the week of Mon, Aug 1-Fri, Aug 5.
Aug 7, 07:26 PDT

Update - Keeping this incident open for another 24-48 hours in case users experience any of the issues below. If you're having any issues, please see the potential remedies below.
Aug 2, 07:53 PDT

Monitoring - We migrated the servers underlying our app again this weekend out of necessity.

All systems are fully operational, but for those of you who need to whitelist Coveralls IP addresses, the list is below.

Our DNS service is set up to make this change invisible to you, but for those of you who may be receiving 400 Bad Request errors back from Web or API requests, a guide to clearing the various caches involved in your chain of requests is also given below.

Finally, if you're experiencing these, or any other issues, we'd appreciate a heads up at support@coveralls.io.

New Coveralls IP addresses:

54.89.228.101/32
3.93.17.184/32
3.95.136.35/32
54.89.23.76/32
54.172.125.86/32
3.82.218.125/32
54.86.25.163/32
3.88.194.77/32
54.86.81.7/32
18.234.163.214/32
44.203.186.142/32

Guide to clearing cache in your chain of requests:

If you are receiving 400 Bad Request errors, we think the root cause is caching somewhere in the chain of requests. Please try clearing your local caches with the help of these resources:

1. How to clear browser cache in:
- Chrome: https://support.google.com/accounts/answer/32050
- Other Browsers: https://its.uiowa.edu/support/article/719

2. How to clear machine cache on:
- Windows: https://www.c-sharpcorner.com/article/how-to-clear-cache-in-windows--10/
- MacOS: https://mackeeper.com/blog/how-to-clear-cache-mac/

3. How to clear cache at CI services and on CI runners:
- Github Actions: https://github.community/t/how-to-clear-cache-in-github-actions/129038/8
- actions/cache: https://github.com/actions/cache
- Listing and deleting caches in your Actions workflows: https://github.blog/changelog/2022-06-27-list-and-delete-caches-in-your-actions-workflows/
- Github Actions Cache API: https://docs.github.com/en/rest/actions/cache
- Travis CI: https://docs.travis-ci.com/user/caching/#clearing-caches
- CircleCI: https://circleci.com/docs/caching
- Gitlab CI/CD: https://docs.gitlab.com/ee/ci/caching/
Aug 1, 07:46 PDT

Aug 6, 2022

No incidents reported.

Aug 5, 2022

No incidents reported.

Aug 4, 2022

No incidents reported.

Aug 3, 2022

No incidents reported.

Aug 2, 2022

Aug 1, 2022

Jul 31, 2022

Additional infrastructure maintenance

Completed - The scheduled maintenance has been completed.
Jul 31, 14:32 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jul 31, 10:30 PDT

Scheduled - We will be going through additional infrastructure maintenance during this period. Between these hours, the Coveralls Web UI may enter read-only mode and the Coveralls API may be unresponsive for short periods if time, typically less that 5-min.
Jul 31, 08:00 PDT

Infrastructure maintenance

Completed - The scheduled maintenance has been completed.
Jul 31, 00:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jul 30, 20:03 PDT

Scheduled - We will be undergoing some scheduled infrastructure maintenance during this time window. The coveralls.io website may be in read only mode, and the API unreachable for short periods during this window.
Jul 29, 16:45 PDT

Jul 30, 2022