ch1-lagoon outage
Incident Report for amazee.io
Postmortem

Our infrastructure provider published a post mortem on the issue we observed earlier this week : https://cloudscale-status.net/incident/59

On 2019-07-01 between 10:15 and 10:23 CEST, requests to our object storage had been answered with an HTTP error code 503. At the same time, I/O operations to bulk volumes were partially blocked as well. After 10:23 CEST, access to our bulk and object storage was fully restored.

The temporary unavailability lead to the issue that files in Drupal could not be delivered during the given time. Also newly started containers could not start because the registry was unavailable due to the partial block of access to the storage system.

Posted Jul 03, 2019 - 14:17 UTC

Resolved
This incident has been resolved.
Posted Jul 01, 2019 - 12:20 UTC
Monitoring
A fix has been implemented and we are monitoring the results.
Posted Jul 01, 2019 - 08:43 UTC
Identified
The issue has been identified and all affected sites are back online.

There is an ongoing issue with the file storage and image registry - https://cloudscale-status.net/incident/53

We're closely monitoring the situation and take action if needed.
Posted Jul 01, 2019 - 08:29 UTC
Investigating
We are currently investigating this issue.
Posted Jul 01, 2019 - 08:13 UTC