Our network monitoring has alerted us to a loss of peering with one of our primary wholesale SIP carriers. Traffic has re-routed as expected and calls are flowing.
Our engineers are investigating.
UPDATE01 – 13:00
Our engineers have confirmed the fault is not within our network and have logged a priority 2 fault with our fibre provider as well as the affected wholesale SIP carrier.
Once we know more we will provide an update. At the moment this is not service affecting as traffic is automatically re-routing via alternative paths.
UPDATE02 – 14.05
Our network monitoring has alerted to further failures within this wholesale SIP carrier. The failures now extend to there SIP gateways resulting in us loosing all connectivity with them.
Further redundancy our side has automatically kicked in to re-route outbound calls around that carrier, however numbers provisioned via this carrier are offline. We have escalated this to a priority 1 fault with them.
UPDATE03 – 14.20
We are seeing endpoints at our supplier bounce up and down, We can therefor only conclude that there is a serious issue with our supplier.
UPDATE04 – 14.33
We have been provided a notice via our suppliers internal website that they have suffered “multiple failures at one of our data centers (THN)” There engineers are onsite trying to resolve the issues.
We will keep pressing for updates and update as we know more. We apologise for any inconvenience this may cause.
UPDATE05 – 15.18
Our network monitoring has advised that our end points have now come back in to service, however our private interconnect is still down and traffic is routing via the public internet. We are will awaiting official notification.
UPDATE06 – 15.24
We spoke to soon.. endpoints have stopped responding once again.
UPDATE07 – 16:51 We have observed a period of stability to our endpoints along with our interconnect also coming back in to service. Our management team have also been involved due to the lack of support from our supplier and we will be engaging with them Monday morning. We have still not had an official conformation and continue to chase.