status.amazee.io
Slow response times Lagoon API
Investigating - Since the resolution of the previous "Slow response times Lagoon API" issue (https://status.amazee.io/incidents/5lt5dj1f6xvy), we continue to see slow response times from the Lagoon API. We are investigating the cause. Delays are intermittent so please retry if you run into issues.
May 13, 23:53 UTC
Slow delivery of build logs
Identified - We've identified an issue with the delivery of build logs that in some cases takes more than 5-10 minutes.
We're working to reduce this delivery slowness.
Apr 20, 13:49 UTC

About This Site

Issues on amazee.io but nothing shown here?
Let us know on RocketChat or support@amazee.io, and we'll help you right away.

Documentation? Find everything at docs.amazee.io
What is amazee.io? | Imprint | Privacy Policy

General Degraded Performance
API Degraded Performance
Deployment Infrastructure Operational
Nameservers Operational
dev1.compact Operational
Lagoon Dashboard Degraded Performance
Lagoon Logs (Kibana) Operational
Australia Operational
au1.lagoon Operational
au2.lagoon Operational
Finland Operational
fi1.compact Operational
fi2.lagoon Operational
Germany Operational
de3.lagoon Operational
Japan Operational
jp1.compact Operational
Switzerland Operational
ch1.lagoon ? Operational
ch4.lagoon Operational
USA Operational
us1.lagoon Operational
us2.lagoon Operational
us3.lagoon Operational
United Kingdom Operational
uk3.lagoon Operational
on-premise servers Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Scheduled Maintenance
Regular Weekly Maintenance - US May 18, 08:00-12:00 UTC
We are conducting regular maintenance on our systems.
Posted on May 10, 20:00 UTC
Regular Weekly Maintenance - AU May 18, 11:00-15:00 UTC
We are conducting regular maintenance on our systems.
Posted on May 10, 20:00 UTC
Regular Weekly Maintenance - Europe May 18, 20:00 - May 19, 00:00 UTC
We are conducting regular maintenance on our systems.
Posted on May 10, 20:00 UTC
Regular Weekly Maintenance - Europe - Wednesday May 18, 20:00 - May 19, 00:00 UTC
We are conducting regular maintenance on our systems.
Posted on May 10, 20:00 UTC
Image Registry Maintenance May 21, 18:00 - May 22, 00:00 UTC
We will be upgrading our image registry, Harbor, to a new version. We expect very little downtime during the upgrade process.

Some projects may need to be redeployed by amazee.io as part of this process to ensure the newest images for these projects are available after the upgrade has completed.
Posted on May 17, 16:07 UTC
Regular Weekly Maintenance - US May 25, 08:00-12:00 UTC
We are conducting regular maintenance on our systems.
Posted on May 17, 20:00 UTC
Regular Weekly Maintenance - AU May 25, 11:00-15:00 UTC
We are conducting regular maintenance on our systems.
Posted on May 17, 20:00 UTC
Regular Weekly Maintenance - Europe May 25, 20:00 - May 26, 00:00 UTC
We are conducting regular maintenance on our systems.
Posted on May 17, 20:00 UTC
Regular Weekly Maintenance - Europe - Wednesday May 25, 20:00 - May 26, 00:00 UTC
We are conducting regular maintenance on our systems.
Posted on May 17, 20:00 UTC
Past Incidents
May 18, 2021

No incidents reported today.

May 17, 2021

No incidents reported.

May 16, 2021

No incidents reported.

May 15, 2021

No incidents reported.

May 14, 2021

No incidents reported.

May 13, 2021
Slow response times Lagoon API
Resolved - This incident has been resolved.
May 13, 15:41 UTC
Monitoring - We've identified some latency issues with the authentication system backend and implemented a fix, will continue to monitor general performance and look for further improvements.
May 13, 03:18 UTC
Investigating - Since the resolution of Storage Backend issues (https://status.amazee.io/incidents/r7ytznfz5t6x) we continue to see slow response times from the Lagoon API, we are investigating the cause. Delays are intermittent so please retry if you run into issues.
May 12, 23:16 UTC
May 12, 2021
Site unavailability due to Storage Backend issues
Resolved - This incident has been resolved. We'll follow up with a post mortem next week.
May 12, 20:53 UTC
Monitoring - The situation remains stable - We're monitoring the storage backend for issues and will take appropriate action if needed.
May 12, 08:36 UTC
Update - In order to reduce the load on the Storage Backend we scaled down the development environments on CH1. The environments will be automatically scaled up again as soon as the load of the Storage Backend allows us to do so.
If you need a specific development environments scaled up earlier, you can either trigger a deployment of the environment or contact the amazee.io support.
May 6, 11:00 UTC
Update - We are continuing to work on a fix for this issue.
May 6, 10:37 UTC
Identified - The issue has been identified and a fix is being implemented.
May 6, 10:01 UTC
Update - We are continuing to monitor for any further issues.
May 6, 09:28 UTC
Update - We see that a subset of sites is still impacted by the underlying storage issues. We're working on fixing the situation for those sites.
May 6, 09:07 UTC
Monitoring - We're continuing the work in the background - The situation is stable again. If you see issues with your sites feel free to get back to support via support@amazee.io or via Slack / Rocketchat
May 5, 13:31 UTC
Update - We're continuing to work on the situation - Some sites might see intermittent availability issues.
May 5, 09:59 UTC
Identified - We're still looking into this issue - The maintenance actions during yesterdays maintenance seem not to have solved the storage issues we were encountering.
May 5, 08:54 UTC
Update - We are continuing to monitor for any further issues.
May 5, 08:51 UTC
Update - We still see some sites having issues with the pressure on the storage backend. We're still working on resolving this issue fully.
May 5, 08:21 UTC
Monitoring - The situation remains stable - We're monitoring everything and started to adapt maintenance of tonight to accommodate further steps on the issue we observed today.
May 4, 11:53 UTC
Update - The situation is further stabilizing - We're working on a permanent fix for this.
May 4, 11:41 UTC
Update - We are continuing to work on a fix for this issue.
May 4, 10:54 UTC
Update - We are continuing to work on a fix for this issue.
May 4, 10:49 UTC
Update - We are continuing to work on a fix for this issue.
We've involved engineers from our Infrastructure provider to look into this issue together with our engineers.
May 4, 10:47 UTC
Update - We are continuing to work on a fix for this issue.
May 4, 08:48 UTC
Identified - The issue has been identified and a fix is being implemented.
May 4, 08:10 UTC
Investigating - We are currently investigating this issue.
May 4, 07:11 UTC
Regular Weekly Maintenance - Europe - Wednesday
Completed - The scheduled maintenance has been completed.
May 12, 00:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 11, 20:00 UTC
Scheduled - We are conducting regular maintenance on our systems.
May 3, 20:00 UTC
Regular Weekly Maintenance - Europe
Completed - The scheduled maintenance has been completed.
May 12, 00:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 11, 20:00 UTC
Scheduled - We are conducting regular maintenance on our systems.
May 3, 20:00 UTC
May 11, 2021
Regular Weekly Maintenance - AU
Completed - The scheduled maintenance has been completed.
May 11, 15:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 11, 11:00 UTC
Scheduled - We are conducting regular maintenance on our systems.
May 3, 20:00 UTC
Regular Weekly Maintenance - US
Completed - The scheduled maintenance has been completed.
May 11, 12:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 11, 08:00 UTC
Scheduled - We are conducting regular maintenance on our systems.
May 3, 20:00 UTC
May 10, 2021

No incidents reported.

May 9, 2021

No incidents reported.

May 8, 2021

No incidents reported.

May 7, 2021

No incidents reported.

May 6, 2021
May 5, 2021
Regular Weekly Maintenance - Europe
Completed - The scheduled maintenance has been completed.
May 5, 00:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 4, 20:00 UTC
Scheduled - We are conducting regular maintenance on our systems.
Apr 26, 20:00 UTC
May 4, 2021
Regular Weekly Maintenance - AU
Completed - The scheduled maintenance has been completed.
May 4, 15:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 4, 11:00 UTC
Scheduled - We are conducting regular maintenance on our systems.
Apr 26, 20:00 UTC
Regular Weekly Maintenance - US
Completed - The scheduled maintenance has been completed.
May 4, 12:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 4, 08:00 UTC
Scheduled - We are conducting regular maintenance on our systems.
Apr 26, 20:00 UTC
← Incident History Powered by Statuspage