There has been a major failure of the cooling systems at the Thus owned data facility, iP-House in London Docklands. This has effected all providers within the building.

Temperatures climbed to 67 Degrees C before the cooling system could be restored.

Luckily our server in IP-House was able to withstand the heat and didn’t fail. No Outage was experienced.

The temperature of Server SGC is currently down to 46 Degrees C and should drop to around 41 Degrees C which is our normal operating temperature.

The delayed memory upgrade to server Atlantis will take place on Monday 18/06/2007 between 20:30 and 21:30 BST.

There will be a 5-10min outage for any sites hosted on this server.

Also our Primary POP3, SMTP & Webmail will be unavailable. mail will be collected by our secondary mail server during the outage.

If you need to access webmail during this outage please go to http://mail2.gbdns.net and login as normal.

We will be rebooting the following servers this evening (23/05/2007) at 1:00AM BST
sgc.gbdns.net
atlantis.gbdns.net

There will be a 3-5min period where all websites will not be accessible. This will not effect our E-Mail services.

WINDOW: Thursday 19th April 22:00 - 23:59 GMT
ESTIMATED DOWNTIME: 5 MINUTES
NETWORK IMPACT: PARTIAL
DESCRIPTION:

JTAC (Juniper Technical Assistance Center) have informed our network provider (Goscomb) that a new software release will most likely solve their current VRRP releated issues. As such, they are scheduling the above emergency maintenance period to upgrade each of their 2 core routers (one in IPH and one in THE).

The routers will be upgraded one at a time and will result in some network insta bility (due to the fact that VRRP is currently not working as expected). Each router upgrade is expected to last approximately 5 minutes at the most.

A snapshot of the current router OS and config will be taken prior to each upgrade and should any part of the process fail these snapshots will be restored.

We apologise for the short notice of this maintenance work.

Maintenance Window : 4th April 00:00 - 06:30

Extreme have recently made some upgrade recommendations following a complete internal review of our interconnection provider’s network at the start of the year. They have after careful consideration advised them that they should bring our software into line with the latest version for XOS capable devices in order to remove the possibility of the platform being hit by some service affecting bugs and also to allow for the future deployment of improved features.

The code has already been validated in our provider’s configuration by Extreme and they have performed testing in a lab environment.

- IPHouse (Expected Downtime 5 minutes)
This work maybe service effecting; both nodes within our cluster may go offline during this period. Our Linux server in Meridian gate will not be effected.

Some users may have noticed a performance issue when accessing our control panel and some websites today.

It appears after we fixed AWStats last night we may have found a corruption / drive issue. Currently server SGC is in the stopped state and is not acting as part of the NLB cluster.

We need to perform a full check disk which will involve shutting down the server and rebooting it into a prewindows state. A schedule is currently being created as we need to attach a KVM to the box.

When this is performed the following services will be affected
MSSQL - Customers without MSSQL load balancing will not be able to access their databases
MySQL 4 - The primary MySQL4 instance will be unreachable, all users are welcome of course to use the read-only slave (change the server to Atlantis)
DNS - ns3.gbdns.net will not be contactable
Control Panel - This will be offline as it only runs on server SGC

Everything else will be unaffected, most users will not notice any downtime but we will try and resolve this issue a.s.a.p.

We will be performing reboot of both windows servers within our cluster this evening. We will switch the load between the servers so there will be no downtime.

sgc.gbdns.net - 12:15AM
atlantis.gbdns.net - 1:15AM
prometheus.gbdns.net - N/A

Downtime for Mail, Web, FTP, MySQL5 will be 0mins

Downtime for MSSQL, MySQL4 will be 2-5mins