LON01 – 07/12/2015 – 23:00 till 03:00 – EasyXDSL – Maintenance

We have been advised by one of our interconnect providers that that they will be conducting a software upgrade on there core Junos router at Telehouse North between 23:00 and 03:00 on the 07/12/2015 from 23:00 – 03:00. This upgrade work will affect one of our fibre waves we use for DSL termination back in to our network at Goswell Road. DSL traffic traversing over this link will drop during the maintenance window, however should re-establish over an alternative link via Telehouse East which is unaffected.

The nature of these works include a reload of the Junos hardware at Telehouse North by our wave supplier and in theory should be the only disruption we see. Unfortunately sort disruptions like this will cause multiple DSL PPP session re-terminations as they flip back and forth between Telehouse North and Telehouse East as our network is designed to use the former where possible. Due this concern and avoiding any other unforeseen issues that will cause session drops during the maintenance windows, we will be manually shutting down the Telehouse North link at 22:00 on the night with the view of bringing it backup at 07:00 the following morning. This will limit the session drops to these times and provide a stable service throughout.

We apologize for any inconvenience this may cause.

UPDATE 01 – 21:50 We have removed LNS02 from the available pool. This should aid in services re-terminating quickly on LNS01.

UPDATE 02 – 22:00 We have shutdown our Telehouse North link, with traffic re-routing over to Telehouse East as expected

LON01 – 17/11/2015 – 13:50 – Leased Lines – *Vodafone incident* *Resolved*

We are currently aware of an issue affecting a number of on-net and off-net Vodafone based circuits.

We will continue to work with our suppliers and publish updates as they become available.

UPDATE 01 – 12:10
We have seen sessions restore, however are still pending an update from Vodafone.

UPDATE 02 – 12:40
Telecity have confirmed that this incident was caused by an isolated power issue. Telecity engineers are working to ensure the underlying issue is fully resolved. Until we receive confirmation from Telecity that all work has completed, previously affected services should be considered as at risk.

Further updates will be provided as they are made available from our suppliers.

UPDATE 03 – 14:57
We have been advised via another supplier of the following:

We are aware of an issue at Telecity Sovereign House. The issue has been confirmed to be a wide-spread power outage affecting the ground floor up to, and including the 4th floor. The power appears to be currently intermittently available and engineers are on site investigating the source of the problem. At this time, the DC are unable to advise the cause or why resilient systems failed to take over.

LON01 – 11/11/2015 – 23:00 till 03:00 – EasyXDSL – Emergency Maintenance *COMPLETE*

We have been advised this afternoon by one of our interconnect providers that that they will be conducting a software upgrade on there core Junos router at Telehouse North between 23:00 and 03:00 tonight. This upgrade work will affect one of our fibre waves we use for DSL termination back in to our network at Goswell Road. DSL traffic traversing over this link will drop during the maintenance window, however should re-establish over an alternative link via Telehouse East which is unaffected.

The nature of these works include a reload of the Junos hardware at Telehouse North by our wave supplier and in theory should be the only disruption we see. Unfortunately sort disruptions like this will cause multiple DSL PPP session re-terminations as they flip back and forth between Telehouse North & Telehouse East as our network is designed to use the former where possible. Due this concern and avoiding any other unforeseen issues that will cause session drops during the maintenance windows, we will be manually shutting down the Telehouse North link at 22:50 tonight with the view of bringing it backup at 07:00 tomorrow morning. This will limit the session drops to these times and provide a stable service throughout.

We apologise for any inconvenience this may cause.

UPDATE 01 – 18:45

We have reviewed the original manual switch over time and concluded it does not allow any contingency should this be required. We have therefor updated this to 22:00
UPDATE 02 – 07:10 – 12/11/2015

This work is complete.