status.amazee.io
All Systems Operational

About This Site

Issues on amazee.io but nothing shown here?
Let us know on RocketChat or support@amazee.io, and we'll help you right away.

Documentation? Find everything at docs.amazee.io
What is amazee.io? | Imprint | Privacy Policy

General Operational
API Operational
Deployment Infrastructure Operational
Nameservers Operational
dev1.compact Operational
Lagoon Dashboard Operational
Lagoon Logs (Kibana) Operational
Australia Operational
au1.lagoon Operational
au2.lagoon Operational
Finland Operational
fi1.compact Operational
fi2.lagoon Operational
Germany Operational
de3.lagoon Operational
Japan Operational
jp1.compact Operational
Switzerland Operational
ch1.lagoon ? Operational
ch4.lagoon Operational
USA Operational
us1.lagoon Operational
us2.lagoon Operational
us3.lagoon Operational
United Kingdom Operational
uk3.lagoon Operational
on-premise servers Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Scheduled Maintenance
Regular Weekly Maintenance - US Jun 15, 08:00-12:00 UTC
We are conducting regular maintenance on our systems.
Posted on Jun 7, 20:00 UTC
Regular Weekly Maintenance - AU Jun 15, 11:00-15:00 UTC
We are conducting regular maintenance on our systems.
Posted on Jun 7, 20:00 UTC
Regular Weekly Maintenance - Europe Jun 15, 20:00 - Jun 16, 00:00 UTC
We are conducting regular maintenance on our systems.
Posted on Jun 7, 20:00 UTC
Regular Weekly Maintenance - Europe - Wednesday Jun 16, 20:00 - Jun 17, 00:00 UTC
We are conducting regular maintenance on our systems.
Posted on Jun 7, 20:00 UTC
Past Incidents
Jun 14, 2021

No incidents reported today.

Jun 13, 2021

No incidents reported.

Jun 12, 2021

No incidents reported.

Jun 11, 2021
Resolved - This incident has been resolved.
Jun 11, 02:32 UTC
Identified - We've identified an issue with the delivery of build logs that in some cases takes more than 5-10 minutes.
We're working to reduce this delivery slowness.
Apr 20, 13:49 UTC
Resolved - This incident has been resolved.
Jun 11, 02:32 UTC
Investigating - Since the resolution of the previous "Slow response times Lagoon API" issue (https://status.amazee.io/incidents/5lt5dj1f6xvy), we continue to see slow response times from the Lagoon API. We are investigating the cause. Delays are intermittent so please retry if you run into issues.
May 13, 23:53 UTC
Resolved - AWS has restored network connectivity so all the services are back online.

Update from AWS:
"Starting at 1:18 PM PDT we experienced connectivity issues to some EC2 instances, increased API errors rates, and degraded performance for some EBS volumes within a single Availability Zone in the EU-CENTRAL-1 Region. At 4:26 PM PDT, network connectivity was restored and the majority of affected instances and EBS volumes began to recover. At 4:33 PM PDT, increased API error rates and latencies had also returned to normal levels. The issue has been resolved and the service is operating normally. The root cause of this issue was a failure of a control system which disabled multiple air handlers in the affected Availability Zone. These air handlers move cool air to the servers and equipment, and when they were disabled, ambient temperatures began to rise. Servers and networking equipment in the affected Availability Zone began to power-off when unsafe temperatures were reached."
Jun 11, 02:17 UTC
Update - Most of the services are back online - AWS is facing a loss of one of the Availability Zones in Frankfurt. Most of the workloads have been rescheduled. Certain workloads (e.g. Solr search servers) are bound to one zone and will remain unavailable.
Jun 10, 21:07 UTC
Identified - Appears to be caused by an AWS issue:

"1:24 PM PDT We are investigating connectivity issues for some EC2 instances in a single Availability Zone (euc1-az1) in the EU-CENTRAL-1 Region"
Jun 10, 20:50 UTC
Investigating - We are currently investigating an issue causing website outages in DE3.
Jun 10, 20:37 UTC
Jun 10, 2021
Jun 9, 2021
Completed - The scheduled maintenance has been completed.
Jun 9, 00:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 8, 20:00 UTC
Scheduled - We are conducting regular maintenance on our systems.
May 31, 20:00 UTC
Completed - The scheduled maintenance has been completed.
Jun 9, 00:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 8, 20:00 UTC
Scheduled - We are conducting regular maintenance on our systems.
May 31, 20:00 UTC
Jun 8, 2021
Completed - The scheduled maintenance has been completed.
Jun 8, 15:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 8, 11:00 UTC
Scheduled - We are conducting regular maintenance on our systems.
May 31, 20:00 UTC
Postmortem - Read details
Jun 9, 07:57 UTC
Resolved - This incident has been resolved. We'll follow up with the Post-Mortem as soon as the CDN Provider will publish it.
Jun 8, 14:35 UTC
Monitoring - Our CDN Provider implemented a fix, and we see the situation recovering - we'll be monitoring the situation.
Jun 8, 11:02 UTC
Update - We're working with our CDN Infrastructure provider to fix the issue. This issue currently impacts a lot of sites globally. Please also see the Fastly Status page for updates: https://status.fastly.com/incidents/vpk0ssybt3bj
Jun 8, 10:48 UTC
Identified - We're currently seeing most of the sites hosted on amazee.io impacted by CDN Issues - We're working closely together with our CDN provider to resolve the issue.

Traffic not going through the CDN is not affected by the outage.
Jun 8, 10:13 UTC
Investigating - We are currently investigating this issue.
Jun 8, 09:58 UTC
Completed - The scheduled maintenance has been completed.
Jun 8, 12:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 8, 08:01 UTC
Scheduled - We are conducting regular maintenance on our systems.
May 31, 20:00 UTC
Resolved - We're still looking into the root cause of the issue - There was an out of memory situation which caused containers being rescheduled on other compute nodes.
Jun 8, 10:14 UTC
Identified - The issue has been identified and a fix is being implemented.
Jun 8, 08:56 UTC
Update - We are continuing to investigate this issue.
Jun 8, 08:26 UTC
Investigating - We are currently investigating this issue.
Jun 8, 08:17 UTC
Jun 7, 2021

No incidents reported.

Jun 6, 2021

No incidents reported.

Jun 5, 2021
Resolved - This incident has been resolved.
Jun 5, 14:37 UTC
Update - We are continuing to investigate this issue.
Jun 4, 03:15 UTC
Investigating - Unidling of projects currently could be broken and we are investigating this issue. As a workaround, redeployment of the environment will bring the environment back.
Jun 4, 03:10 UTC
Jun 4, 2021
Jun 3, 2021

No incidents reported.

Jun 2, 2021
Completed - The scheduled maintenance has been completed.
Jun 2, 00:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 1, 20:01 UTC
Scheduled - We are conducting regular maintenance on our systems.
May 24, 20:00 UTC
Completed - The scheduled maintenance has been completed.
Jun 2, 00:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 1, 20:01 UTC
Scheduled - We are conducting regular maintenance on our systems.
May 24, 20:00 UTC
Jun 1, 2021
Completed - The scheduled maintenance has been completed.
Jun 1, 15:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 1, 11:00 UTC
Scheduled - We are conducting regular maintenance on our systems.
May 24, 20:00 UTC
Completed - The scheduled maintenance has been completed.
Jun 1, 12:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 1, 08:00 UTC
Scheduled - We are conducting regular maintenance on our systems.
May 24, 20:00 UTC
May 31, 2021
Resolved - This incident has been resolved.
May 31, 12:53 UTC
Monitoring - A fix has been implemented and we are monitoring the results.
May 31, 10:19 UTC
Update - We are continuing to investigate this issue.
May 31, 09:41 UTC
Investigating - We are currently investigating this issue.
May 31, 09:39 UTC