status.amazee.io
All Systems Operational

About This Site

Issues on amazee.io but nothing shown here?
Let us know on RocketChat or support@amazee.io, and we'll help you right away.

Documentation? Find everything at docs.amazee.io
What is amazee.io?

General Operational
API   Operational
Deployment Infrastructure   Operational
Nameservers   Operational
dev1.compact   Operational
Switzerland Operational
zh1.single   Operational
zh2.single   Operational
zh1.compact   Operational
zh2.cluster   Operational
zh2.compact   Operational
ch1.lagoon   ? Operational
USA Operational
us1.lagoon   Operational
South Africa Operational
sa1.compact   Operational
United Kingdom Operational
uk1.compact   Operational
uk2.compact   Operational
Germany Operational
de1.compact   Operational
Finland Operational
fi1.compact   Operational
Japan Operational
jp1.compact   Operational
on-premise servers   Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Scheduled Maintenance
Regular Weekly Maintenance - Europe Jan 22, 22:00 - Jan 23, 02:00 CET
We are conducting regular maintenance on our systems.
Posted on Jan 21, 12:40 CET
Past Incidents
Jan 22, 2019
Regular Weekly Maintenence - US
Completed - The scheduled maintenance has been completed.
Jan 22, 11:00 CET
Verifying - Verification is currently underway for the maintenance items.
Jan 22, 10:53 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 22, 10:00 CET
Scheduled - We are conducting regular maintenance on our systems.
Jan 21, 12:45 CET
Jan 21, 2019

No incidents reported.

Jan 20, 2019

No incidents reported.

Jan 19, 2019

No incidents reported.

Jan 18, 2019
Database Cluster Maintenance - CH1 Lagoon
Completed - Maintenance has been successfully completed.
Jan 18, 23:42 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 18, 22:00 CET
Scheduled - During debugging of the availability issues earlier today (https://status.amazee.io/incidents/8vlg0nj5h6tf) we found an issue that needs to fixed during a maintenance window. We intend to fix the leftovers of the issues we encountered today in a maintenance window starting after 22:00. Our team will monitor the work and mitigate issues if they come up.
Jan 18, 15:49 CET
Availability issues
Resolved - The issue has been mitigated. We'll follow up with maintenance on the database cluster later today - https://status.amazee.io/incidents/63xcr2hzd32k
Jan 18, 15:49 CET
Monitoring - A fix has been implemented and we are monitoring the results.
Jan 18, 14:37 CET
Identified - The issue has been identified and a fix is being implemented.
Jan 18, 13:13 CET
Investigating - We are currently investigating this issue.
Jan 18, 11:33 CET
Jan 17, 2019
ch1-lagoon - Scaling of production databases
Completed - The scheduled maintenance has been completed.
Jan 17, 23:00 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 17, 22:01 CET
Scheduled - We'll be performing a scaling operation on the production databases for sites running on ch1-lagoon. This operation should not cause any downtime due to the high availability setup of the unerlying database cluster. Our team will monitor the scaling operation.
Jan 17, 15:56 CET
Jan 16, 2019
intermittent availability issues ch1-lagoon
Resolved - This incident has been resolved.
Jan 16, 19:00 CET
Update - We observed a smaller downtime caused by one of the compute nodes today. As immediate step we took the node out of the cluster. During the scheduled maintenance all workloads on this node will be shifted to other compute nodes.
Jan 15, 16:39 CET
Monitoring - A fix has been implemented and we are monitoring the results.
Jan 15, 10:33 CET
Identified - Increased load may cause some containers to restart slowly as the cluster stabilizes.
We'll continue to mitigate the issue and will update as new information becomes available.
Jan 14, 19:43 CET
Update - We're still seeing some load issues. Our team continues to work on a mitigation for the availability issues observed.
Jan 14, 19:31 CET
Update - During investigation we've noticed increased load on the compute nodes. We're currently scaling the the infrastructure temporarily to handle increased load. This action can lead to short downtimes while the containers restart.

Further to this we identified an issue with our infrastructure provider which needs short maintenance action which should not cause any downtime. This action will be carried out at 21:00 CET.

Currently the systems look stable. Thus we're switching the status back to Operational. We'll be updating this issue as new information becomes available.
Jan 14, 18:38 CET
Investigating - We're currently investigating intermittent availability issues with sites hosted on ch1-lagoon
Jan 14, 16:26 CET
Regular Weekly Maintenance - Europe
Completed - The scheduled maintenance has been completed.
Jan 16, 02:01 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 15, 22:01 CET
Scheduled - We are conducting regular maintenance on our systems.
Jan 15, 20:27 CET
Regular Weekly Maintenance - Europe
Completed - The scheduled maintenance has been completed.
Jan 16, 02:01 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 15, 22:01 CET
Scheduled - We are conducting regular maintenance on our systems.
Jan 15, 16:35 CET
Jan 15, 2019
Maintenance us1-lagoon
Completed - The scheduled maintenance has been completed.
Jan 15, 14:00 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 15, 10:00 CET
Scheduled - We will be undergoing scheduled maintenance during this time.
Jan 15, 08:50 CET
Slow Deployments to legacy infrastructure
Resolved - This incident has been resolved. Based on our testing we see that deploy times are at normal levels again.
Jan 15, 10:32 CET
Identified - There seem to be networking issues between a few providers that lead to substantial packet loss and thus slowing down deployments. We're currently looking into those issues
Jan 14, 16:36 CET
Update - Current builds will run trough - we're stopping new builds as the deploy infrastructure will go trough a reboot.
Jan 14, 15:07 CET
Investigating - We're seeing slow deployments to the legacy infrastructure. Our team is already checking on the situation.
Jan 14, 15:05 CET
Jan 13, 2019

No incidents reported.

Jan 12, 2019

No incidents reported.

Jan 11, 2019
Drupal Infrastructure Changes
Resolved - This incident has been resolved.
Jan 11, 17:21 CET
Monitoring - Drupal Infrastructure announces a 24h brown out on the git:// protocol.

Planned warning outage for git://git.drupal.org starting in 40m, will be unavailable for 24h. If you have infrastructure using the git:// protocol, switch to https soon. git:// will be permanently discontinued later this month. (HTTP & SSH protocols for Git will not be affected.)

This is a precautionary brownout on the git:// protocol as the protocol will be sunsetted from the drupal.org infrastructure later this month.

Reference : https://twitter.com/drupal_infra/status/1083398465105903616
Jan 11, 12:56 CET
Jan 10, 2019

No incidents reported.

Jan 9, 2019
Regular Weekly Maintenance - Europe
Completed - The scheduled maintenance has been completed.
Jan 9, 02:00 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 8, 22:01 CET
Scheduled - We are conducting regular maintenance on our systems.
Jan 8, 21:56 CET
Jan 8, 2019
Scheduled Maintenance US1-Lagoon
Completed - The scheduled maintenance has been completed.
Jan 8, 11:42 CET
Verifying - Verification is currently underway for the maintenance items.
Jan 8, 11:13 CET
Update - Application router issues have been fixed.
Jan 8, 11:13 CET
Update - We see issues with the application routers at the moment. Our team is looking into it.
Jan 8, 11:05 CET
Update - Scheduled maintenance is still in progress. We will provide updates as necessary.
Jan 8, 11:03 CET
Update - Scheduled maintenance is still in progress. We will provide updates as necessary.
Jan 8, 10:57 CET
Update - Scheduled maintenance is still in progress. We will provide updates as necessary.
Jan 8, 10:49 CET
Update - Our team is looking into issues reported that the current maintenance proccess has impact on live sites.
Jan 8, 10:47 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 8, 10:38 CET
Scheduled - We will be undergoing scheduled maintenance during this time.
Jan 8, 10:37 CET
← Incident History Powered by Statuspage