We have observed a small number of broadband services suffering from intermittent connection problems between 19:46 and 20:46 this evening.
This issue has been tracked down to one of our wholesale suppliers who suffered a network outage that has since recovered. This has resulted in the affected connections not being able to reach our RADIUS servers for authentication and where simply being terminated on the local BTW RAS with a non route able IP address.
Users who do not have a connection are advised to reboot or power off there router for 20 minutes to recover any stuck sessions.
We apologies for the inconvenience and are awaiting an RFO.
We are aware a small percentage of outbound calls being made on our VoIP network are taking longer than normal to connect. We are aware of this issue and investigating .
UPDATE01 – 09:40
Calls have been re-routed over another carrier while we work to understand what is going on with calls on BTIPX
UPDATE02 – 10:06
Calls are being rejected due to changes made at BT in respect to number formatting. We are in the process of making changes to how we present numbers.
UPDATE03 – 13:00
New number scrips have been designed and put in to operation. Outbound calls are now routing correctly once again and this has been marked as closed.
No changes are required on existing customer systems however we will be changing how we configure new systems
On the 23rd February 2019 starting from 08:00 our UPS vendor Vertiv will be undertaking a planned upgrade to the system adding additional battery capacity to our Horsham facility.
Normally with this type of work the UPS would be placed on “bypass” however the nature of the works require a complete decommission of the system which will require a complete isolation and removal of power to feed “B”
Each cabinet is supplied with a redundant “A” supply. All of our critical services and client facing platforms are dual feed so no outages are expected however should be considered at risk until the completion of the works.
We will be contact clients with co-location who have devices that are not dual redundant.
UPDATE 01 – 08:00
Engineer’s are now on site. Work will start shortly.
UPDATE 02 – 08:30
Work has started and power isolated.
UPDATE 03 – 13.00
Work is now complete and redundancy restored.