Author: Adam Clark (Network Operations)

LON01 – EasyXDSL – 22/10/2015 – 13:39 – MTU Issue *Resolved*

We are aware of a MTU issue on our DSL network affecting lns01.dsl.structuredcommunications.co.uk. This is preventing JUMBO FRAMES from getting to this device and forcing DSL circuits that terminate on our network to obtain a lower MTU (1460-1462) Where end users CPEs and networks are not configured to handle fragmentation correctly this will manifest itself … Continue reading “LON01 – EasyXDSL – 22/10/2015 – 13:39 – MTU Issue *Resolved*”

We are aware of a MTU issue on our DSL network affecting lns01.dsl.structuredcommunications.co.uk. This is preventing JUMBO FRAMES from getting to this device and forcing DSL circuits that terminate on our network to obtain a lower MTU (1460-1462) Where end users CPEs and networks are not configured to handle fragmentation correctly this will manifest itself as access problems to various websites.

We are currently working to resolve the problem.

We apologise for any inconvenience this may cause.

UPDATE 01 – 13:56We have isolated the problem to a interconnecting VLAN between LNS01 & CORE02. The VLAN will need to be reconfigured, however this will drop all active DSL sessions that terminate on that device. We are looking at other work around at this time.

UPDATE 02 – 14:20 We have reconfigured the VLAN and interface which has resolved the issue with JUMBO frames and our carriers. Existing L2TP tunnels to our carriers LACs are still negotiated at a lower MTU. Any existing sessions and new session that join that tunnel will still have a lower than normal MTU.

UPDATE 03 – 16:00 Tunnels have been reset and sessions restored. MTUs are now being seen at 1500 again for ADSL.

LON01 – 14/10/2015 – 10:00 – CORE01 & CORE02 – Maintenance *COMPLETE*

At the above time today, we will be replacing 1 line card in each of the above cores with a newer revision to facilitate an update on LNS01 & LNS02. Any traffic on these cards will be re-routed to there backup counterpart . No outage is expected however a drop in call traffic may be … Continue reading “LON01 – 14/10/2015 – 10:00 – CORE01 & CORE02 – Maintenance *COMPLETE*”

At the above time today, we will be replacing 1 line card in each of the above cores with a newer revision to facilitate an update on LNS01 & LNS02.

Any traffic on these cards will be re-routed to there backup counterpart . No outage is expected however a drop in call traffic may be observed.This devices should be considered at risk until complete.

UPDATE01 – 09:55
Work has been undertaken to re-route traffic on CORE02. As expected we have seen a small drop in call traffic. We apologize for any inconvenience caused. Traffic will need to be re-routed, however will be done at a time when call levels are lower.

UPDATE01 – 11:30
Work has been completed on both cores and any primary services reconnected.

LON01 – 15/10/2015 – 20:00 – All Services – Planned Maintenance. *Complete*

We have been advised of planned network maintenance by one of our primary transit providers (Adapt) This work is due to retirement of access41.lon2 and the need to move the network equipment into new core cabinet within Goswell Road. We have been advised works will start at 20:00 and continue on until 04:00 on the … Continue reading “LON01 – 15/10/2015 – 20:00 – All Services – Planned Maintenance. *Complete*”

We have been advised of planned network maintenance by one of our primary transit providers (Adapt) This work is due to retirement of access41.lon2 and the need to move the network equipment into new core cabinet within Goswell Road.

We have been advised works will start at 20:00 and continue on until 04:00 on the 16th. We take multiple feeds from adapt for transit and have been advised of service disruption while these are physically relocated to the new device of up to 20 minutes. Although we take multiple redundant feeds, we have been advised of disruption due to network re-convergence on there side.

Our network is comprised of multiple redundant routes to different carriers. Should we loose our Adapt link for any reason then traffic will automatically re-route with minimal disruption.

This work wont affect phone services as these route in to our network via interdependent private interconnects unless you connect in to our network via a 3rd party connection. If this is the case you may need to restart your handsets after the maintenance works has been completed.

UPDATE01 – 16/10/2015
This work completed without issue from our supplier. Our network reacted as expected and re-routed traffic where required.

Easy xDSL – Multiple Exchange Outages *RESOLVED*

We have been made aware of multiple exchanges outages in Sussex affecting 20CN services across multiple providers. At this moment no ETA has been given and we are awaiting further information from our suppliers. We apologize for any inconvenience caused and will provide further updates as they become available. UPDATE 01 – 08:34 We have … Continue reading “Easy xDSL – Multiple Exchange Outages *RESOLVED*”

We have been made aware of multiple exchanges outages in Sussex affecting 20CN services across multiple providers. At this moment no ETA has been given and we are awaiting further information from our suppliers.

We apologize for any inconvenience caused and will provide further updates as they become available.

UPDATE 01 – 08:34
We have been advised that hardware at a patent exchange has been replaced and services should start to restore. Any client still having issues are advised to power cycle there equipment.

LON01 – EasyHTTP – 14/09/2015 – 20:00 – 20:30 – Maintenance *COMPLETE*

Between 20:00 & 20:30 we will be installing a new version of our mail server on EasyHTTP. IMAP, SMTP & POP will be unavailable during this maintenance window. UPDATE 01 – 20:19 This work is complete.

Between 20:00 & 20:30 we will be installing a new version of our mail server on EasyHTTP. IMAP, SMTP & POP will be unavailable during this maintenance window.

UPDATE 01 – 20:19

This work is complete.

TalkTalk Circuts – 15-07/2015 – 09:45 *RESOLVED*

Our network monitoring has alerted us to increased latency and packet loss on some Talk Talk EFM circuits. We have raised a fault with our supplier and are currently awaiting there response. UPDATE01 – 10:55 Our network monitoring is showing a reduction in packet loss and latency, however we have not had an official update. … Continue reading “TalkTalk Circuts – 15-07/2015 – 09:45 *RESOLVED*”

Our network monitoring has alerted us to increased latency and packet loss on some Talk Talk EFM circuits. We have raised a fault with our supplier and are currently awaiting there response.

UPDATE01 – 10:55
Our network monitoring is showing a reduction in packet loss and latency, however we have not had an official update.

UPDATE02 – 11:50
Our network monitoring is again showing latency increasing along with packet loss. We have chased for an update.

UPDATE03 – 13:13
Our supplier has advised this is being caused by an overloaded transit link due to windows updates. We have escalated this response to there management as this level of service should not be contended on a wholesale level. We are awaiting there response.

UPDATE04 – 15:00
Latency has returned back to normal and packet loss has gone. We are still awaiting an official clear and response to our escalation.

LON01 – EasyIPT – 13/07/2014 – 20:00 till 21:00 *Planned Maintenance* *COMPLETE*

We are aware some users have been seeing stuck SIP sessions today, whereby “BYE” messages have not been completely clearing down resulting in accounts hitting a concurrent call limit. A work around has been put in place for this until this evening when we can reload the core device to drop any sessions still in … Continue reading “LON01 – EasyIPT – 13/07/2014 – 20:00 till 21:00 *Planned Maintenance* *COMPLETE*”

We are aware some users have been seeing stuck SIP sessions today, whereby “BYE” messages have not been completely clearing down resulting in accounts hitting a concurrent call limit. A work around has been put in place for this until this evening when we can reload the core device to drop any sessions still in this state.

UPDATE01 – 20:05
This work has started and the server has been requested to reload.

UPDATE02 – 20:15
The server has reloaded and is accepting SIP requests, however is not processing any call routing.

UPDATE03 – 20:35
We have discovered that the Kamailio Proxy service has failed to start which is why calls are not being processed. We are working to restore the service.

UPDATE04 – 20:40
The service has been restored and test calls are now routing OK.

LON01 – 01/07/2015 – 20:00 – 21:00 – EasyBond – Maintenance *COMPLETE*

During this window we will be upgrading our bonded platform to the latest software version as per our software vendors recommendation. Customers on the platform may notice drops in service while this takes place. Any customer using the service with our EasyIPT VOIP solution may notice there handsets fail to register with status lights remaining … Continue reading “LON01 – 01/07/2015 – 20:00 – 21:00 – EasyBond – Maintenance *COMPLETE*”

During this window we will be upgrading our bonded platform to the latest software version as per our software vendors recommendation. Customers on the platform may notice drops in service while this takes place. Any customer using the service with our EasyIPT VOIP solution may notice there handsets fail to register with status lights remaining orange. If this occurs please power down all hardware for 5 minutes and power back up once the maintenance window is marked as complete.

UPDATE01 – 21:06
This work is complete.

LON01 – 26/06/2015 – 13:00 – CORE01.LON01 *EMERGENCY WORKS* COMPLETE*

Our network monitoring has alerted us to a intermittent fan failure on PSU 1 within CORE01.LON01. This device has redundant PSUs so no impact is expected. Engineers will attend this afternoon to swap out the failing power supply. Again no impact is expected to be seen, however the device will be marked as “at risk” … Continue reading “LON01 – 26/06/2015 – 13:00 – CORE01.LON01 *EMERGENCY WORKS* COMPLETE*”

Our network monitoring has alerted us to a intermittent fan failure on PSU 1 within CORE01.LON01. This device has redundant PSUs so no impact is expected.

Engineers will attend this afternoon to swap out the failing power supply. Again no impact is expected to be seen, however the device will be marked as “at risk” for the duration enginners are working on it.

Updates will be provided once available.

UPDATE01 – 14:00

This work has been completed without any issue.

LON01 – 26-06-2015 – 20:00 – 22:00 – Network Maintenance (CORE03.LON01) *COMPLETE*

In the above window we will be re-configuring BGP to provide a full IPv6 routing table to CORE03.LON01. No outage is expected, however as routing tables update within our network users may see routes change around our network.

In the above window we will be re-configuring BGP to provide a full IPv6 routing table to CORE03.LON01. No outage is expected, however as routing tables update within our network users may see routes change around our network.