Resolved -
This incident has been resolved.
Feb 19, 09:04 CET
Monitoring -
The shutdown/start moved the instance to new hardware and it has fully recovered. We will monitor for a short while to ensure stability.
Feb 19, 08:33 CET
Identified -
The instance has become non-responsive via the AWS console, we have issued a shutdown and restart to move the instance to different compute hardware.
Feb 19, 08:32 CET
Investigating -
We are currently investigating this issue.
Feb 19, 08:30 CET
Resolved -
The issue has ben identified as a wrongly published Docker Image by RedHat: https://access.redhat.com/solutions/3885101 We restored the original Docker Image and restored the functionality of the database creation
Feb 12, 21:37 CET
Identified -
We're currently looking into Database creation issues on us1-lagoon. Our team is working on solving this issue.
Existing environments don't see any impact - New environments will run into long deployment times till the issue with the Database creation is fixed.
Feb 12, 17:42 CET
Resolved -
This incident has been resolved.
Feb 12, 13:15 CET
Monitoring -
All sites are back online. We will continue to do background checks. We've already requested a report from our upstream provider. More information can be found here - https://cloudscale-status.net/incident/39
Feb 12, 12:00 CET
Update -
We are continuing to work on a fix for this issue.
Feb 12, 11:49 CET
Update -
We still see several sites impacted by the outage earlier. Our team is looking into the issues. We will update the incident as more information becomes available.
API and Deployment Infrastructure is back Operational
Feb 12, 11:40 CET
Identified -
The issue has been identified and a fix is being implemented.
Feb 12, 11:16 CET
Update -
We are continuing to investigate this issue.
Feb 12, 11:06 CET
Update -
We're investigating the issues - Currently it looks like an upstream provider issue as several systems are affected.
Feb 12, 10:59 CET
Investigating -
We are currently investigating this issue.
Feb 12, 10:55 CET
Resolved -
All complete and everything is green.
Feb 7, 23:25 CET
Monitoring -
Maintenance is complete, we are ensuring stability of the build server now.
Feb 7, 23:13 CET
Identified -
We are performing emergency maintenance to the build server of ch1.lagoon. Project environments will not be affected, but builds will be queued for a short while.
Feb 7, 22:56 CET