status.amazee.io
All Systems Operational

About This Site

Issues on amazee.io but nothing shown here?
Let us know on Slack or support@amazee.io, and we'll help you right away.

Documentation? Find everything at docs.amazee.io
What is amazee.io?

General Operational
API   Operational
Deployment Infrastructure   Operational
Nameservers   Operational
dev1.compact   Operational
Switzerland Operational
zh1.single   Operational
zh2.single   Operational
zh1.compact   Operational
zh2.cluster   Operational
zh2.compact   Operational
ch1.lagoon   ? Operational
USA Operational
us2.compact   Operational
us1.lagoon   Operational
South Africa Operational
sa1.compact   Operational
United Kingdom Operational
uk1.compact   Operational
uk2.compact   Operational
Germany Operational
de1.compact   Operational
Finland Operational
fi1.compact   Operational
on-premise servers   Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Past Incidents
Sep 21, 2018

No incidents reported today.

Sep 20, 2018

No incidents reported.

Sep 19, 2018
Completed - The scheduled maintenance has been completed.
Sep 19, 02:00 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 18, 22:01 CEST
Scheduled - We will be undergoing scheduled maintenance during this time.
Sep 18, 19:16 CEST
Sep 17, 2018
Resolved - After implementing additional mitigations on an infrastructure level on last Friday, our monitoring has not encountered any instabilities anymore. We therefore conduct that the issues have been resolved.
Sep 17, 10:46 CEST
Update - We continued monitoring the instability issues in the last 24h. The implemented fix resolved most of the instabilities, but unfortunately there are still some small instabilities for a 20 seconds every couple of hours.
Therefore we conducted another all-hands meeting with all involved parties (amazee.io, Hosting Partner, Infrastructure Partner) and implemented some additional monitoring on the infrastructure.
This monitoring allowed us to learn which virtual machine is the root cause of the issue and we are investigating what exactly causes the issue on that machine.

We will update as soon as we know more or the instabilities are fully resolved.
Sep 14, 13:33 CEST
Update - We are continuing to monitor for any further issues.
Sep 13, 13:52 CEST
Update - During the course of the day we implemented a few changes on the infrastructure to further stabilize the situation. Since around 16:30 CEST the connection issues have ceased. We continue to monitor the situation closely.
Sep 12, 21:35 CEST
Update - Our engineers found some irregularities in the network stack today. We're restarting all machines during the maintenance window and check back with the infrastructure provider if the issues are gone. So far the situation should be more stable since the late afternoon as we started to implement another fix. We'll update this incident as soon as new information becomes available.

Currently we also plan to get call in a all hands meeting with all involved parties to discuss the issue at hand tomorrow morning September 12 - Morning CEST.
Sep 11, 23:10 CEST
Update - We're currently adding additional nodes to the cluster.
Sep 7, 15:01 CEST
Update - We implemented a fix and the situation looks stable now. We started planning adding more resources to the cluster before the weekend. We will update the ticket as soon as new information becomes available.
Sep 7, 00:32 CEST
Update - We're currently investigating issues on ch1-lagoon. We'll update as soon as new information will become available.
Sep 6, 22:56 CEST
Monitoring - A fix has been implemented and we are monitoring the results.
Sep 5, 17:32 CEST
Investigating - The fix implemented earlier didn't solve the issue. We're looking into the issue.
Sep 5, 13:14 CEST
Monitoring - A fix has been implemented and we are monitoring the results.
Sep 5, 11:46 CEST
Investigating - We're seeing services flapping on ch1-lagoon our engineers look into the issue.
Sep 5, 11:45 CEST
Sep 16, 2018

No incidents reported.

Sep 15, 2018
Completed - The scheduled maintenance has been completed.
Sep 15, 22:21 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 15, 22:00 CEST
Scheduled - Continuation of the maintenance window yesterday: We attempt another maintenance in solving the connectivity issue.

Some of our customers experience outbound network connectivity issues from de1-compact. After consulting with our upstream provider we saw that a restart restart of certain networking components on de1-compact is needed. This operation will cause short downtime during the restarts. Our engineers will be monitoring the changes and take action if needed.
Sep 15, 13:15 CEST
Completed - The scheduled maintenance has been completed.
Sep 15, 01:00 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 14, 22:00 CEST
Scheduled - Some of our customers experience outbound network connectivity issues from de1-compact. After consulting with our upstream provider we saw that a restart restart of certain networking components on de1-compact is needed. This operation will cause short downtime during the restarts. Our engineers will be monitoring the changes and take action if needed.
Sep 14, 14:48 CEST
Sep 14, 2018
Resolved - Fixed
Sep 14, 14:49 CEST
Identified - Issue identified and fix implemented
Sep 14, 14:05 CEST
Update - We are continuing to investigate this issue.
Sep 14, 14:01 CEST
Investigating - We're investigating some issues blocking de1 MySQL server
Sep 14, 14:00 CEST
Sep 12, 2018
Completed - The scheduled maintenance has been completed.
Sep 12, 02:01 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 11, 22:01 CEST
Scheduled - We are conducting regular maintenance on our systems.
Sep 11, 18:57 CEST
Sep 10, 2018

No incidents reported.

Sep 9, 2018

No incidents reported.

Sep 8, 2018

No incidents reported.