amazee.io Status

status.amazee.io

All Systems Operational

About This Site

Issues on amazee.io but nothing shown here?

Let us know on RocketChat or support@amazee.io, and we'll help you right away.

Documentation? Find everything at docs.amazee.io
What is amazee.io?

General Operational

API Operational

Deployment Infrastructure Operational

Nameservers Operational

dev1.compact Operational

Lagoon Dashboard Operational

Lagoon Logs (Kibana) Operational

Australia Operational

au1.lagoon Operational

Finland Operational

fi1.compact Operational

Germany Operational

de1.compact Operational

Japan Operational

jp1.compact Operational

South Africa Operational

sa1.compact Operational

Switzerland Operational

zh1.compact Operational

zh2.compact Operational

ch1.lagoon Operational

USA Operational

us1.lagoon Operational

United Kingdom Operational

uk1.compact Operational

uk2.compact Operational

on-premise servers Operational

Operational

Degraded Performance

Partial Outage

Major Outage

Maintenance

Scheduled Maintenance

Regular Weekly Maintenance - US Nov 26, 10:00-14:00 CET

We are conducting regular maintenance on our systems.
Posted on Nov 18, 11:00 CET

Regular Weekly Maintenance - AU Nov 26, 13:00-17:00 CET

We are conducting regular maintenance on our systems.
Posted on Nov 18, 14:00 CET

Regular Weekly Maintenance - Europe Nov 26, 22:00 - Nov 27, 02:00 CET

We are conducting regular maintenance on our systems.
Posted on Nov 18, 23:00 CET

Past Incidents

Nov 21, 2019

No incidents reported today.

Nov 20, 2019

Production Database Issues

Resolved - This incident has been resolved.
Nov 20, 18:03 CET

Update - The issues we were seeing on the database cluster have been solved. There are still some ongoing networking issues at our Infrastructure provider - Please see their statuspage for more information - https://cloudscale-status.net/
Nov 20, 17:09 CET

Identified - The issue has been identified and a fix is being implemented.
Nov 20, 16:44 CET

Investigating - We are currently investigating issues we are seeing with the production databases on CH1-Lagoon

According to the monitoring there's no impact on live sites.
Nov 20, 15:14 CET

Production Site Unavailability

Resolved - This incident has been resolved.
Nov 20, 16:45 CET

Investigating - We are currently investigating issues that only affect a subset of sites.
Nov 20, 16:22 CET

Regular Weekly Maintenance - Europe

Completed - The scheduled maintenance has been completed.
Nov 20, 02:00 CET

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 19, 22:00 CET

Scheduled - We are conducting regular maintenance on our systems.
Nov 11, 23:00 CET

Nov 19, 2019

Regular Weekly Maintenance - AU

Completed - The scheduled maintenance has been completed.
Nov 19, 17:01 CET

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 19, 13:00 CET

Scheduled - We are conducting regular maintenance on our systems.
Nov 11, 14:00 CET

Regular Weekly Maintenance - US

Completed - The scheduled maintenance has been completed.
Nov 19, 14:00 CET

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 19, 10:00 CET

Scheduled - We are conducting regular maintenance on our systems.
Nov 11, 11:00 CET

Nov 18, 2019

[Scheduled] Maintenance on uk2 Legacy Infrastructure

Completed - The scheduled maintenance has been completed.
Nov 18, 02:00 CET

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 18, 01:00 CET

Scheduled - Our infrastructure provider will be migrating these legacy services to a new node during this time.
Nov 13, 22:34 CET

Nov 17, 2019

No incidents reported.

Nov 16, 2019

CH1 Cluster Openshift Upgrade

Completed - The scheduled maintenance has been completed.
Nov 16, 02:01 CET

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 15, 22:00 CET

Update - As mentioned in the initial text. This is a provisional maintenance window. We will run trough this additional maintenance tonight and finish within the announced times.
Nov 15, 14:16 CET

Scheduled - We will be undergoing scheduled maintenance on CH1-lagoon to upgrade to the latest OpenShift version.

This is a provisional maintenance window - Depending on the progress made in the prior maintenance slots this window might not be needed. We'll update this Maintenance with information as they become available.
Nov 12, 19:33 CET

Nov 15, 2019

CH1-Lagoon : Provisioning of new Databases fail

Resolved - The situation has been resolved - All queued up database provisions will run trough within the next few minutes.
Nov 15, 13:39 CET

Identified - The issue has been identified and a fix is being implemented.
Nov 15, 13:19 CET

Investigating - We are currently investigating issues on newly provisioned Databases.

Currently provisioned databases don't see any impact only new environments are failing to provision due to this issue.
Nov 15, 12:55 CET

CH1-Lagoon - Deployments failing to start new containers

Resolved - This incident has been resolved.
Nov 15, 12:53 CET

Monitoring - The issue has been fixed - We're continuing to monitor the situation but everything works as expected again.
Nov 15, 09:57 CET

Identified - The issue has been identified and a fix is being implemented.
Nov 15, 09:36 CET

Investigating - We are currently investigating an issue where new deployments to CH1 seem to be not able to start the newly built containers.

New Deployments will fail - All sites are available online
Nov 15, 09:21 CET

CH1 Cluster Openshift Upgrade

Completed - The scheduled maintenance has been completed.
Nov 15, 02:00 CET

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 14, 22:00 CET

Scheduled - We will be undergoing scheduled maintenance on ch1-lagoon to upgrade to the latest OpenShift version.
Nov 12, 19:29 CET

Nov 14, 2019

Some sites failing to load

Resolved - This incident has been resolved - The main cause were that a few containers were stuck in creating state. We'll ensure that in the in the following maintenance windows this will be added to our post-maintenance check.
Nov 14, 10:45 CET

Monitoring - A fix has been implemented and we are monitoring the results.
Nov 14, 08:14 CET

Identified - The issue has been identified and a fix is being implemented.
Nov 14, 07:56 CET

Investigating - We are currently investigating this issue.
Nov 14, 07:33 CET

CH1 Cluster Openshift Upgrade

Completed - The scheduled maintenance has been completed.
Nov 14, 02:00 CET

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 13, 22:00 CET

Scheduled - We will be undergoing scheduled maintenance on ch1-lagoon to upgrade to the latest OpenShift version.
Nov 5, 18:10 CET

Nov 13, 2019

Regular Weekly Maintenance - Europe

Completed - The scheduled maintenance has been completed.
Nov 13, 02:00 CET

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 12, 22:00 CET

Scheduled - We are conducting regular maintenance on our systems.
Nov 4, 23:00 CET

Nov 12, 2019

Regular Weekly Maintenance - AU

Completed - The scheduled maintenance has been completed.
Nov 12, 17:00 CET

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 12, 13:00 CET

Scheduled - We are conducting regular maintenance on our systems.
Nov 4, 14:00 CET

Regular Weekly Maintenance - US

Completed - The scheduled maintenance has been completed.
Nov 12, 14:00 CET

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 12, 10:00 CET

Scheduled - We are conducting regular maintenance on our systems.
Nov 4, 11:00 CET

Nov 11, 2019

No incidents reported.

Nov 10, 2019

No incidents reported.

Nov 9, 2019

No incidents reported.

Nov 8, 2019

Website reachability issues

Resolved - This incident has been resolved.
Nov 8, 16:28 CET

Update - We are investigating and monitoring some networking issues related to our's provider maintenance
Nov 8, 14:47 CET

Monitoring - Our hosting provider is monitoring the infrastructure due to some network overload.
Nov 8, 12:53 CET

Investigating - Our monitoring shows some sites hosted on ch1.lagoon having issues being reached, we're investigating.
Nov 8, 12:36 CET

Nov 7, 2019

Website reachability issues

Resolved - This incident has been resolved.
Nov 7, 16:33 CET

Update - Our hosting provider is in the process of restarting part of their network equipment, this should solve the problems we're experiencing. During this time we expect short 5-10 second outages of the websites. We're actively monitoring the situation.
Nov 7, 15:31 CET

Monitoring - The situation has stabilized again, we're continuing to monitor the situation.
Nov 7, 14:57 CET

Update - Our hosting provider has put up their own statuspage: https://cloudscale-status.net/incident/78
We're actively coordinating with them to check the situation
Nov 7, 14:49 CET

Identified - We're experiencing another round of instabilities. We're in contact with our hosting provider to investigate where the problem could be.
Nov 7, 14:45 CET

Monitoring - All sites have recovered, we're actively monitoring the situation.
Nov 7, 14:40 CET

Update - We are continuing to investigate this issue.
Nov 7, 14:37 CET

Investigating - Our monitoring shows some sites hosted on ch1.lagoon having issues being reached, we're investigating.
Nov 7, 14:37 CET

Emergency Network Maintenance

Completed - The maintenance was completed early and without incident.
Nov 7, 00:10 CET

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 6, 23:00 CET

Scheduled - Our infrastructure provider in Switzerland will be performing emergency maintenance on all network switches. During this time, outage for sites of 1-2 minute may be expected.
Nov 6, 22:32 CET