Dwebs Ltd - Service Status

Server web1 Migration

Chris - Dhosting Admin — Thu, 02 Sep 2010 08:01:42 +0000

On Saturday 4th September starting at 22:00 BST we will be migrating all websites on the current web1 server in London to a new server in Manchester. All customer’s should have received a notice detailing the procedure for the migration and a method to check to see if they are affected.

Update 04/09/2010 @ 22:00 - The backup process has started.

Update 05/09/2010 @ 01:30 - The backup process finished at 01:20 so we are running around 1hr 20mins behind schedule.

Update 05/09/2010 @ 04:00 - The migration is now complete.

Web1 Outage

Chris - Dhosting Admin — Thu, 27 May 2010 22:50:59 +0000

We are aware of an outage on Web1 in london. We are currently awaiting a hard reboot to be performed. ETA 20-30mins.

Update 1:05AM
The server returned to normal service at 1:01AM

Server Daedalus (Web2, Mail) Outage

Chris - Dhosting Admin — Wed, 21 Apr 2010 08:27:23 +0000

We are aware of an outage on server daedalus which hosts both email and a small number of websites. The server stopped responding at 09:10.

A hard reboot has been performed but the box has failed to return to normal operation. We are investigating further.

Update 09:36
Service was restored at 09:33 (The system performed a chkdsk due to the hard reboot)

Investigations are still continuing into why the box stopped responding.

web1.gbdns.net issues

Chris - Dhosting Admin — Wed, 24 Mar 2010 12:04:34 +0000

We are aware web1.gbdns.net has stopped responding to web requests. All though the box appears to be online it is no longer responding to RDP access requests. A ticket has been raised with the DC for the box to be hard rebooted. This will be done within 10mins.

The server is also the primary MySQL 4/5 server for our hosting cluster so all sites using MySQL will be offline until the reboot is completed.

Update 12:56
All services were restored at 12:37. At the moment the cause of the failure is not clear. No errors are in showing in the logs and the raid array is not displaying any issues. DNS requests were still be served by the server even when HTTP failed i.e. the server was active but we couldn’t login.

Kent Science Park Outage

Chris - Dhosting Admin — Wed, 09 Dec 2009 11:11:10 +0000

We are aware of an outage at KSP which is causing the majority of our services to be offline. We are awaiting an update on the issue.

Update 13:15
The current outage is being caused by a similar issue to the outage on the 24th November 2009.

Estimated time for a fix is 2PM GMT.

Update 14:15
Latest update from the DC

09/12/2009 @ 14:15: Power has been restored to the UPS units, although the two rooms have had to be split onto their own seperate systems. As a result the UPS are throwing a bypass not available problem. We have the UPS manufacturers onsite who are going to resolve this by removing the parallel cards from both sides.

Update 14:35
Power was restored at 14:34. All servers were online by 14:40.

A full RFO will be issued later today.

Kent Network Outage

Chris - Dhosting Admin — Tue, 24 Nov 2009 22:31:35 +0000

We are aware of an outage at Kent causing multiple servers to be offline. We are awaiting more info on the problem.

Update 25/11/2009 00:25:
We have received an update on this issue. The current outage is power related. We do not have an ETA on a fix at the moment.

Update 25/11/2009 04:00:
Power has been restored, all servers are now operational. A full RFO will be issued later on today.

Mail Server Upgrade

Chris - Dhosting Admin — Mon, 10 Aug 2009 14:30:22 +0000

We will be upgrading our primary mail server to SmarterMail v6 on 12/08/2009 between 00:15 and 00:45.

Expected downtime is between 5-10mins maximum. Full backups will be taken before the upgrade is started.

During the upgrade the backup mail servers will hold inbound email until the primary server is back online.

Update 00:35
The SmarterMail upgrade has now been completed, total downtime 8mins.

If you experience any problems please contact support by email or phone.

Server Reboots

Chris - Dhosting Admin — Fri, 12 Jun 2009 12:31:52 +0000

We need to reboot both web1 (sgc.gbdns.net) and web2 (daedalus.gbdns.net) to complete the latest round of Windows Updates.

Both servers will be rebooted on 14/06/2009 at 00:40 AM. This will take no more than 3-5mins per server.

All other servers within our hosting cluster were automatically rebooted in the early hours of the 10th June 2009.

Update 14/06/2009 00:50:
Both servers have been rebooted downtime was <4mins per server.

Server SGC (web1.gbdns.net) Network Issues

Chris - Dhosting Admin — Wed, 10 Jun 2009 11:17:58 +0000

Again web1.gbdns.net is experiencing network issues. After the last outage we made the secondary NIC interface live which is still responding so we believe the primary NIC is faulty.

IP’s are being moved from one NIC to the other at the moment and we are awaiting a VLAN update from the network provider.

Service should be restored within 5-10mins maximum.

Update 12:45
Service was fully restored at 12:39.

We do apologise for the length of the outage but we chose to fix the issue fully rather than partially fixing the issue and having another outage later on to fully fix the problem.

Server SGC (web1.gbdns.net) down

Chris - Dhosting Admin — Mon, 08 Jun 2009 21:44:09 +0000

We are currently investigating an outage of web1.gbdns.net.

This looks to be NIC related.

Update 22:48
A KVM was attached to the server, the primary NIC wasn’t passing any traffic in or out. Disabling / re-enabling the NIC didn’t solve the problem so we had to perform a reboot.

As precaution we are going to enable the secondary NIC interface in case the first fails again so we can access the server and solve the problem.