We are aware of a potentially service impacting issue. Learn more
Coventry Network Maintenance (Resolved) Critical

Affecting System - COVENTRY

  • 18/09/2024 01:00 - 18/09/2024 07:01
  • Last Updated 17/09/2024 22:21

Scheduled Maintenance - Coventry Datacentre - Essential Network Maintenance

SGP Network (Resolved) Critical

Affecting System - SGP

  • 23/08/2024 10:22
  • Last Updated 23/08/2024 16:14

An ongoing ddos attack is impacting the Singapore network. We are working on resolving this at the earliest. 

Update: the issue is resolved, and we are closely monitoring the situation. 

Updated: Closing the network issue, services are restored and operating normally.

SPK-10 Hardware Upgrade (Resolved) Critical

Affecting System - SPK-10

  • 20/08/2024 22:00 - 20/08/2024 23:59
  • Last Updated 20/08/2024 22:28

SPK-10 is scheduled for a hardware upgrade at 22:00 GMT+4 20th August 2024.

Update: Hardware upgrade completed, raid resyncing.

SPK-10 Hardware Upgrade (Resolved) Critical

Affecting Other - SPK-10

  • 31/07/2024 22:30
  • Last Updated 06/08/2024 14:10

SPK-10 is scheduled for a hardware upgrade.

Update: SPK-10 is being shut down for hardware upgrades.

Update: SPK-10 hardware replacement completed. Raid resync in progress.

SPK-10 Stability (Resolved) Critical

Affecting System - SPK-10

  • 06/07/2024 14:38
  • Last Updated 12/07/2024 15:32

We are investigating an issue with SPK-10

Update: SPK-10 being rebooted, control panel actions will be unresponsive till the HN boots up.

Update: Issue has been resolved; monitoring.

Update: Issue has resurfaced, team is investigating.

SPK-10 Power Outage (Resolved) Critical

Affecting Other - SPK-10

  • 07/07/2024 09:37
  • Last Updated 07/07/2024 12:14

SPK-10 suffered a power outage and service has been restored. Currently monitoring the situation.

SGP-01 Inbound DDOS (Resolved) Critical

Affecting System - SGP-01

  • 22/05/2024 17:12
  • Last Updated 22/05/2024 18:45

Inbound DDoS SGP-01

Update: Resolved. Monitoring the situation.

SGP-01 Inbound DDOS (Resolved) Critical

Affecting System - SGP-01

  • 18/05/2024 15:45
  • Last Updated 18/05/2024 15:56

Inbound DDOS attack reported. The team is working on restoring access at the earliest.

Edit: Service has been restored.

SPK-10 RAID Degradation (Resolved) Critical

Affecting System - SPK-10

  • 26/04/2024 21:50
  • Last Updated 02/05/2024 13:05

Investigating RAID array degradation on SPK-10.

DR backup strategy has been activated.

SPK-10 Scheduled Activity - 29th Apr 8 PM GMT+4

Update: Server is brought down for a Scheduled Activity

Update 2: Server is back online, and VPSs are booting up.

Update 3: Performance impacted due to RAID rebuild, will update this notification once it is completed.

Update 4: RAID rebuild completed.

SPK-10 Outage (Resolved) Critical

Affecting System - SPK-10

  • 01/04/2024 17:22
  • Last Updated 01/04/2024 17:22

Investigating the outage.

Update: Service has been restored.

SPK-14 Outage (Resolved) Critical

Affecting System - SPK-14

  • 01/04/2024 17:20
  • Last Updated 01/04/2024 17:20

Server is rebooting for an urgent maintenance.

Update: server is back online.

 

SGP-01 Outage (Resolved) Critical

Affecting System - SGP-01

  • 25/03/2024 03:13
  • Last Updated 25/03/2024 03:16

We are aware of a system outage on SGP-01, and the team is investigating.

Issue has been resolved. Full RCA to be provided.

SPK-12 NVMe (Resolved) Critical

Affecting System - SPK-12

  • 24/03/2024 20:32
  • Last Updated 25/03/2024 03:13

One of our NVMe drives has experienced a failure. Our technical team is actively investigating the issue to restore services as quickly as possible. This NVMe drive is non hot-swap and replacing the drive will result in downtime. As a precautionary measure, some VPSs will be migrated to other hypervisors to ensure minimal disruption. We apologize for any inconvenience this may cause and appreciate your patience and understanding during this time. Rest assured, we are working diligently to resolve the issue and restore normal operations.

Migrating the VPS to other nodes allows you to avoid the necessary downtime needed to replace the physical NVMe drive, and the risk of losing your data. If you are unhappy with this operational migration, please do open a ticket and we will move you back to SPK-12 once the service is restored.

Backups of non-migrated/remaining servers on SPK-12 is now completed. SPK-12 will be scheduled for drive replacement.

Update: SPK-12 is currently down under maintenance.

Update 2: SPK-12 is currently up, rebuilding RAID.

Update 3: SPK-12 services are back to normal.

Thank you for your continued support.

SPK-10 Urgent Maintenance (Resolved) Critical

Affecting System - SPK-10

  • 24/01/2024 14:00 - 28/01/2024 12:12
  • Last Updated 24/01/2024 10:14

SPK-10 scheduled for urgent reboot - libvirtd bug

SPK-14 Investigation (Resolved) High

Affecting Other - SPK-14

  • 14/01/2024 17:45 - 20/01/2024 10:15
  • Last Updated 14/01/2024 17:46

We are investigating the reason of a recent downtime on SPK-14

SPK-14 Scheduled Maintenance (Resolved) Medium

Affecting Other - SPK-14

  • 09/01/2024 22:30 - 09/01/2024 23:00
  • Last Updated 09/01/2024 20:01

SPK-14 is scheduled for a maintenance for a kernel upgrade.

Update: maintenance is in progress.

Update: maintenance completed, server has been booted, and virtual machines are booting up.

SPK-12 Instability (Resolved) Critical

Affecting Other - SPK-12

  • 29/11/2023 20:15 - 02/12/2023 23:54
  • Last Updated 02/12/2023 20:55

The server SPK-12 has been showing signs of instability.

The team has brought the server down to perform a chassis swap.

The team has brought the server back online.

The server is currently online, but still showing signs of instability - the team is investigating the issue with the datacenter.

Course of action, replacement of RAM and possible rollback of bios. 

Planned activity: RAM replacement scheduled for 06:00 AM GMT+4, 1st December 2023 (30 minutes downtime) - impacted due to weather conditions.

Replanned for 2nd December 11 PM GMT+4. 

Activity In Progress 

RAM replacement has been completed.. The service is back online.