Author: Adam Clark (Network Operations)

LON01 Data Centre – 17/02/2014 – 22:00 – Planned Power Maintenance (B Feed)

Following on from the power disruption back in March 2013 that affected our London Leve3 suite. We have been advised that our supplier is upgrading our suite to a Tier 4 specification This is a welcome upgrade and means that both our A&B power feeds will be fed from independent UPS rooms and independent generator … Continue reading “LON01 Data Centre – 17/02/2014 – 22:00 – Planned Power Maintenance (B Feed)”

Following on from the power disruption back in March 2013 that affected our London Leve3 suite. We have been advised that our supplier is upgrading our suite to a Tier 4 specification

This is a welcome upgrade and means that both our A&B power feeds will be fed from independent UPS rooms and independent generator banks.

Our core network and customer facing services (EasyHTTP, EasyIPT & EasyBOND) are fully power redundant and no service disruption is expected, however they will be classed as “at risk” for the 24 hours while the work is undertaken starting at 22:00 hours on the 17th Feb until 22:00 hours on the 18th Feb.

We will be attending site for the duration and taking the B feed out of service prior to the works in a controlled manor. Any customer services with only a single fed supply currently on B will be transferred to A prior to the work and returned once complete.

UPDATE 01 – 20:30 – 17/02/2014
Engineers have been onsite all day and prep work is now underway. Traffic is going to be transfered from AG-Primary to AG-Backup, this will cause a 30 second outage while devices transfer.

UPDATE 02 – 22:00 – 17/02/2014
An unexpected outage was seen for EasyBond circuits where an old version of the NOC came online due to ESXi01 not saving it’s startup configuration on shutdown. This has resulted in some stale sessions. Please power down your hardware for 20 minutes where power routers are in PPPOE mode or STATIC IP.

Ticket System – support.structuredcommunications.co.uk *RESOLVED*

We are aware of an issue with our ticket system whereby the main website is not loading. It’s also possible emailed tickets are not being processed. As we do not host the site internally due to diversity, we are investigating the issue with our 3rd party provider. If your query is urgent then please contact … Continue reading “Ticket System – support.structuredcommunications.co.uk *RESOLVED*”

We are aware of an issue with our ticket system whereby the main website is not loading. It’s also possible emailed tickets are not being processed.

As we do not host the site internally due to diversity, we are investigating the issue with our 3rd party provider.

If your query is urgent then please contact us via phone.

UPDATE 01 – 12:21
We have been advised the root cause has now been addressed and this was caused by a DNS lookup limitation which has been removed while a long time solution is found.

EasyHTTP – 30/01/2014 – 18:00 – Maintenance *CLOSED*

We have had reports of performance issues on EasyHTTP. Engineers are looking at the issue. Services may be restarted without warning after 20:00 UPDATE01 – 18:30 The performance issues seem isolated to MySQL driven websites. UPDATE02 – 23:15 Engineers have installed Microsoft Wincache 1.3.5.5.5 and enabled the extension for PHP5.4 Various updates to the my.ini … Continue reading “EasyHTTP – 30/01/2014 – 18:00 – Maintenance *CLOSED*”

We have had reports of performance issues on EasyHTTP.
Engineers are looking at the issue. Services may be restarted without warning after 20:00

UPDATE01 – 18:30
The performance issues seem isolated to MySQL driven websites.

UPDATE02 – 23:15
Engineers have installed Microsoft Wincache 1.3.5.5.5 and enabled the extension for PHP5.4
Various updates to the my.ini files have been made and a server reload has been completed.

Website loading times have seen a 100% improvement and are around 2.5seconds, which is in line with various Windows based platforms.

EasyIPT – VoIP Calls – Outbound Delay *RESOLVED*

We are aware of a fault where outbound calls are taking up to 30 seconds to connect. Engineers are currently investigating this and will update you as more information becomes available. UPDATE01 – 09:45 We are seeing outbound calls starting to connect as normal again. Inbound should also now be working. UPDATE01 – 10:30 We … Continue reading “EasyIPT – VoIP Calls – Outbound Delay *RESOLVED*”

We are aware of a fault where outbound calls are taking up to 30 seconds to connect. Engineers are currently investigating this and will update you as more information becomes available.

UPDATE01 – 09:45
We are seeing outbound calls starting to connect as normal again. Inbound should also now be working.

UPDATE01 – 10:30
We have requested further details from our wholesaler as to the cause of the issue.

EasyBond NS02 – 21:29 – 23/01/2014 *RESOLVED*

We are aware ns02.r01.lon.adapt.easybond.co.uk is not processing DNS lookup requests. We are currently looking in to the issue and will provide an update shortly. NS01 (ns01.r01.lon.adapt.easybond.co.uk) is operating normally so this should not be service effecting. UPDATE 01 – 21:45 This issue has been resolved by re-loading the IPTABLE rules.

We are aware ns02.r01.lon.adapt.easybond.co.uk is not processing DNS lookup requests. We are currently looking in to the issue and will provide an update shortly. NS01 (ns01.r01.lon.adapt.easybond.co.uk) is operating normally so this should not be service effecting.

UPDATE 01 – 21:45
This issue has been resolved by re-loading the IPTABLE rules.

xDSL connectivity – 16:30 – 17/01/2014 *RESOLVED*

We are aware of a wholesale issue currently affecting our xDSL customer base, manifesting itself as poor performance. Our Systems team are currently investigating. Further information will be provided as and when it becomes available. UPDATE01 – 17:38 – 17/01/2014 We have been advised that the cause of the issue has been a “flapping” port … Continue reading “xDSL connectivity – 16:30 – 17/01/2014 *RESOLVED*”

We are aware of a wholesale issue currently affecting our xDSL customer base, manifesting itself as poor performance.

Our Systems team are currently investigating. Further information will be provided as and when it becomes available.

UPDATE01 – 17:38 – 17/01/2014

We have been advised that the cause of the issue has been a “flapping” port between BT wholesale and our wholesale provider causing a loss in bandwidth. This has now been resolved however will have caused stale PPP sessions to occur. If you don’t have service can you please reboot all your hardware.

We apologise for any inconvenience caused.

UPDATE02 – 12:09 – 21/01/2014

An incident report has been made available for this issue. Major Incident Report – Enta Outage 17-01-2014

02 Wholesale LLU – Outage(s) 16/01/2014 *RESOLVED*

We are aware of a network wide issue affecting DSL sync and PPP sessions on some 02 wholesale LLU ADSL2+ circuits. Engineers are working to locate the fault. We will provide further updates once they are provided to us. We apologise for any inconvenience.

We are aware of a network wide issue affecting DSL sync and PPP sessions on some 02 wholesale LLU ADSL2+ circuits.

Engineers are working to locate the fault.

We will provide further updates once they are provided to us.

We apologise for any inconvenience.

Withdrawal of 02/BE* Wholesale LLU DSL services

The 02 Wholesale network which is used to provide some of our ADSL services is being switched off on the 27th February 2014 following last year’s acquisition of the 02 and BE* retail customer base by Sky. This news is unwelcome within the industry and requires a change in service we provide to you if … Continue reading “Withdrawal of 02/BE* Wholesale LLU DSL services”

The 02 Wholesale network which is used to provide some of our ADSL services is being switched off on the 27th February 2014 following last year’s acquisition of the 02 and BE* retail customer base by Sky.

This news is unwelcome within the industry and requires a change in service we provide to you if you are on an LLU package provided by Structured Communications. BT Wholesale has advised they are accepting migrations from the 02 Wholesale network in light of the recent industry news, This will automatically be arranged by Structured Communications for effected circuits prior to the 27th February 2014.

The current pricing structure and packages will be migrated like for like as will login credentials and IP address settings.

We are starting migrations on the 14th of January 2014 whereby you will experience a brief loss of service while the physical exchange work is completed. (30 minutes average maximum) We hope to have all affected circuits migrated by the 1st February 2014

If you have any questions, please don’t hesitate to contact us on 0203 301 4000

NOC: SSL Certificate – LON01 (EasyHTTP Service) *Complete*

Following on from our planned maintenance works on EasyHTTP we removed the SSL certificate securing the control panel. We have been unable to reinstall this. We have a backup for both IIS and Plesk. We have logged an issue with our software vendor to see if these can be re-installed. If not then we will … Continue reading “NOC: SSL Certificate – LON01 (EasyHTTP Service) *Complete*”

Following on from our planned maintenance works on EasyHTTP we removed the SSL certificate securing the control panel.

We have been unable to reinstall this. We have a backup for both IIS and Plesk. We have logged an issue with our software vendor to see if these can be re-installed. If not then we will simply install a new one.

UPDATE01 – 15:15 – 24/12/2013
A new SSL certificate has been ordered and will be installed shortly.

UPDATE02 – 16:00 – 24/12/2013
The new SSL certificate has just been issed by AlphaSSL and installed on the system. This Notice is closed

02 Wholesale LLU – Outage – 11:43 – 09/12/2013 *RESOLVED*

We have been advised of a fibre failure within the 02 Wholesale network. A case has been logged with our wholesale provider. We apologise for any inconvenience caused

We have been advised of a fibre failure within the 02 Wholesale network. A case has been logged with our wholesale provider.

We apologise for any inconvenience caused