Monthly Archives: July 2016

BT Wholesale incident – 21/07/2016

We reported this morning we where seeing issues with our DSL circuits, this has now escalated to issues within BT wholesale themselves affecting multiple services to providers across the UK.

We believe the same London datacenter that experienced issue yesterday is once again experiencing issues today however is now affecting other providers.

Services affected include DSL circuits dropping and not re-establishing, along with poor quality calls if they can be made / received.

Once again this is affecting providers across the UK and is not just limited to our selves, we are working with BT and other providers to assist BT in restoring services.

This is also affecting our phones and we advise clients to email support.

Once we know more we will provide an update. We apologise for any inconvenience caused.

UPDATE01 – 09:55
We are seeing call quality return to normal, however this has been officially confirmed as resolved. We are still seeing a number of DSL circuits down however.

UPDATE02 – 10:10
As advised in the previous post, we can confirm this is due to another power issue is London that has further affected BT wholesale.

UPDATE03- 10:15
Voice issues have returned and we are pushing BT wholesale for an update.

UPDATE04- 10:21
We have been advised the data centre affected is Telehouse North. We do not have any equipment of our own at Telehouse North, however key service providers do including BT which is why this issue is affecting so many providers and services. Telehouse North is a critical part of the UK infrastructure.

UPDATE05- 10:51
We have started to see all services restore, however no official conformation yet.

UPDATE06- 11:51
Services still remain stable and no further reports have been seen, however the incident has still not been closed off officially.

UPDATE07 – 12:45
This is the latest information we have received from BT about their issue: Due to a power incident at Telehouse North (London) IP Exchange Direct Access has been severely impacted since 07.45 this morning (21/07/2016).Service has been restored for all but a small subset of customers who are connected through a hardware card that requires replacing after the restoration of power. Local spares are being sought. There are still wider power restoration activities on going on site which is still expected to take until approx. 1pm BST. We will update with more information on the next update.

UPDATE08 – 13:07
No further issues have been seen and we are closing this incident for now. We will continue to monitor for the next 24 hours.

LON01 – EasyXDSL – 21/07/2016

We have been made aware of issues on BT wholesale Network whereby all customers connecting though London may experience drops in connectivity but then reconnect to our network via other gateways.

If you are experiencing issues reconnecting, please power down your equipment for a few minutes to clear any stuck sessions.

BT are investigating the issue and updates will be provided when we have them.

We apologies any inconvenience this may cause.

UPDATE01 – 09:29

We have discovered the data centre that experienced issues yesterday for BT in respect to power may also be suffering issues again this morning.

LON01 – EasyXDSL – 21/07/2016 – 22:30 – *Maintenance*

We have been advised by one of our fibre providers that that they will be conducting maintenance at Goswell Road between 23:00 and 03:00 on the 21/07/2016 from 23:00 – 03:00. This work will affect one of our fibre waves we use for DSL termination between Goswell Road and Telehouse North. To avoid any possible extended disruption we will be moving traffic away from this link at 22:00 on the day with the view of bringing it back in to service the following day once we have been advised the works are complete.

UPDATE01 – 22:30

After reviewing the maintenance window from our supplier again we have not been advised this time on a reload of any hardware. We have therefor agreed to leave traffic on this link. Should a reload occur then our network will act accordingly.