We are seeing a number of broadband circuit’s dropping PPP and some intermittent packet loss. We are currently investigating.
UPDATE01 – 15:00
We have raised a case with our wholesale suppler and have moved traffic from Telehouse North to Telehouse East to see if this improves things.
UPDATE02 – 16:00
PPP reconnections have reduced but we are still seeing packet loss spikes to a large number of connections.
UPDATE03 – 18:00
We are still working with our wholesale supplier to understand the root cause of the issue as we have eliminated our network.
UPDATE04 – 22:00
We have chased our wholesale supplier for an update. Traffic remains via Telehouse East. The packet loss we are seeing does not seem to be service affecting at this stage but of course it should not be there.
UPDATE05 – 12:00 (26/03/2021)
We have dispatched an engineer to swap out optics on our side of the link.
UPDATE06 – 13:00
We have escalated this within wholesale as the problem remains. We do apologise for the inconvenience this is causing. We are still pending an optics swap as well.
UPDATE07 – 16:30
We have had a response from our wholesale suppler to advise additional resources have been added to our case. We are also still pending an optic swap from Telehouse.
UPDATE – 17:00
We have provided example cases of circuits where we are not seeing the same issue. We also believe this is only affecting a specific type of traffic.
UPDATE09 – 17:30
We have reached out to our hardware vendor to see if there is additional diagnostic tools can be provided. We apologise for the continued delay in getting this resolved.
UPDATE10 – 20:15
Optics have been changed at Telehouse North. Unfortunately the Telehouse engineer was not given an update from ourselves prior to starting the work which sadly resulted in traffic being dropped. We are continuing to monitor the interface.
UPDATE11 – 20:35 (29/03/2021)
We have observed some stability restore to the network over the past 72 hours. However we are still concerned there may be an issue on both London core devices caused by a Memory Leak and are working towards a maintenance window to eliminate this. Further details will be posted of the maintenance and times / impact as new “events / post” So they are clearly seen.