Category: Planned Works

LON01 – 26-05-2015 – 20:00 – 20:15 – Network Maintenance (BGP Filters) *COMPLETE*

We will be installing 2 new internal outbound BGP route maps on CORE01.LON01 & CORE02.LON01 tonight between 20:00 – 20:15. This work is to further improve BGP security internally between cores. The new rules should not cause any BGP session resets or any loss of existing known routes from upstream peers, however we may reset … Continue reading “LON01 – 26-05-2015 – 20:00 – 20:15 – Network Maintenance (BGP Filters) *COMPLETE*”

We will be installing 2 new internal outbound BGP route maps on CORE01.LON01 & CORE02.LON01 tonight between 20:00 – 20:15.

This work is to further improve BGP security internally between cores.

The new rules should not cause any BGP session resets or any loss of existing known routes from upstream peers, however we may reset the sessions to ensure they are working correctly. This will cause traffic to re-route for a few moments before returning to normal.

UPDATE 01 – 20:20
This window has been extended until 21:00 due to a late start by engineers.

UPDATE 02 – 20:27
CORE01.LON01 has been updated and the filters tested without the need for a full session reset.

UPDATE 03 – 20:35
CORE02.LON01 has been updated and the filters tested without the need for a full session reset.

Network monitoring shows all routing tables have returned to normal however engineers will monitor for the next few hours to ensure all routing tables remain consistent between Cores.

UPDATE 04 – 21:30
The routing tables on both CORE01.LON01 and CORE02.LON01 have remained constant for the past hour and we are happy to fully close this maintenance window.

LON01 – 29-04-2015 – 20:00 – 02:00 – Network Maintenance *COMPLETE*

This work forms the final phase of network upgrades that have been undertaken recently to increase core capacity and allow for new L2TP services. During this window we will be moving the final interconnects to there new respective cores as well as undertaking a complete rebuild of the legacy core in order to transition this … Continue reading “LON01 – 29-04-2015 – 20:00 – 02:00 – Network Maintenance *COMPLETE*”

This work forms the final phase of network upgrades that have been undertaken recently to increase core capacity and allow for new L2TP services.

During this window we will be moving the final interconnects to there new respective cores as well as undertaking a complete rebuild of the legacy core in order to transition this to an Access device. Configuration for the interconnect migrations will be in place prior to the physical moves, however there will be disruption expected on the following peers due to routing table updates following on from the disconnections / re-connections which is expected to be around 30-60 seconds per event.

Adapt / Level3
Zen Internet
MDMX / Easynet

There will also be some changes made to our internal BGP sessions and filters due to the nature of the above works which will also result in disruption while tables are updated and BGP sessions established.

Once the above interconnects have been moved and tested, we will then be undertaking the rebuild to Access01. Unfortunately this work will result in several reboots of the device as well as some major configuration changes. This will require a longer downtime, however will be towards the end of the maintenance window.

The above works will affect all direct services (EasyIPT, EasyHTTP, EasyBond, EasyEFM, EasyLL) We apologize for any inconvenience this may cause.

UPDATE 01 – 23:30
Works have been completed with all the interconnects moved from the now “ACCESS01” device to there expected core devices. During the migration and build of our internal BGP sessions we did see an extended outage due to configuration. This was resolved within 45 minutes. We apologize for the unexpected extended disruption.

Due to limited remaining time and further planned disruption expected with the full rebuild of Access01 the decision was made to suspend that part of work and the device would be reviewed remotely to see if these changes could be done another way.

A full review will also be under taken over the next few days to confirm the changes made and any amendments required due to the unexpected configuration issues seen.

LON01 – 07-04-2015 – 20:00 – 20:15 – Network Maintenance *Complete*

This maintenance window consists of the works originally scheduled for the “26-03-2015 – 20:00 – 20:05” That where suspended. Original notice from the 26th: We will be shutting down our Frontier interconnect in preparation of moving the circuit from our current legacy access device to CORE01 as part of our ongoing network upgrade works. The … Continue reading “LON01 – 07-04-2015 – 20:00 – 20:15 – Network Maintenance *Complete*”

This maintenance window consists of the works originally scheduled for the “26-03-2015 – 20:00 – 20:05” That where suspended.

Original notice from the 26th:

We will be shutting down our Frontier interconnect in preparation of moving the circuit from our current legacy access device to CORE01 as part of our ongoing network upgrade works. The circuit will be physically moved on the 07/04/2015 while and engineer is on site and bought back in to service that evening outside of hours.

Call traffic will be routed away from this interconnect several hours prior to the works, However any calls still active on this link will drop once disconnected. Routing to Frontier will then be via one of our indirect peers after the disconnection. No further impact is expected after this.

Further to these works we will also now be moving our Zen interconnect from our current legacy access device to CORE02 in-line with the same ongoing network upgrade works. Any traffic that comes in to us via Zen will see a short 30 second outage while our routing tables update to reflect the removal. Traffic will then flow via one of our indirect peers after the disconnection. This link will be bought back in to service along side our Frontier link.

We apologize for any inconvenience caused.

UPDATE 01 – 20:07
Engineers have shut down both peers and traffic has re-converged without further incident.

LON01 – 26-03-2015 – 20:00 – 20:05 – Network Maintenance *COMPLETE*

We will be shutting down our Frontier interconnect in preparation of moving the circuit from our current legacy access device to CORE01 as part of our ongoing network upgrade works. The circuit will be physically moved on the 27/03/2015 while and engineer is on site and bought back in to service that evening outside of … Continue reading “LON01 – 26-03-2015 – 20:00 – 20:05 – Network Maintenance *COMPLETE*”

We will be shutting down our Frontier interconnect in preparation of moving the circuit from our current legacy access device to CORE01 as part of our ongoing network upgrade works. The circuit will be physically moved on the 27/03/2015 while and engineer is on site and bought back in to service that evening outside of hours.

Call traffic will be routed away from this interconnect several hours prior to the works, However any calls still active on this link will drop once disconnected. Routing to Frontier will then be via one of our indirect peers after the disconnection. No further impact is expected after this.

UPDATE 01 – 20:30

The subject maintenance this evening has been postponed. New dates will be announced in due course.
Apologies for any inconvenience caused.

UPDATE 02 – 05/04/2015

This work has been re-booked for Tuesday the 07th April 2015 at the same time. A new maintenance window will be created.

LON01 – 18-03-2015 – 20:00 – 20:05 – *VLANs 30 & 40 CRITICAL CHANGES + POWER* *COMPLETE*

In order to allow for extra IPv4 capacity in Rack03 to accommodate our new ESXi platform for VoIP we will be merging both Vlan30 & Vlan40 in to a single /25 subnet. Customers who have unmanaged co-location with us in the 95.87.104.192/26 range will need to update the following on there devices on the day: … Continue reading “LON01 – 18-03-2015 – 20:00 – 20:05 – *VLANs 30 & 40 CRITICAL CHANGES + POWER* *COMPLETE*”

In order to allow for extra IPv4 capacity in Rack03 to accommodate our new ESXi platform for VoIP we will be merging both Vlan30 & Vlan40 in to a single /25 subnet.

Customers who have unmanaged co-location with us in the 95.87.104.192/26 range will need to update the following on there devices on the day:

New gateway: 95.87.104.129
New subnet: 255.255.255.128

Once these changes are made, customers will loose access to there devices until we finalize the amended VLAN. We will be making these changes at 20:05 so would suggest customers make these changes as close to 20:00 as possible.

Please remember to commit these changes to memory once access has been re-gained as we will be moving power feeds / racks to reflect this around 21:00

LON01 – 18-03-2015 – 20:00 – 23:59 – Root DNS Server Relocation *COMPLETE*

We will be relocating both our ROOT name servers in the above window to another rack within our suite. This is to enable us to remove an old 10/100 line card and replace with a Fiber GBIC line card in our current Cisco Core in preparation for other upgrade works. Each server will be migrated … Continue reading “LON01 – 18-03-2015 – 20:00 – 23:59 – Root DNS Server Relocation *COMPLETE*”

We will be relocating both our ROOT name servers in the above window to another rack within our suite. This is to enable us to remove an old 10/100 line card and replace with a Fiber GBIC line card in our current Cisco Core in preparation for other upgrade works.

Each server will be migrated in turn to avoid any serious disruption, however there may be a few moments where both forwarding and reverse query’s are refused while the servers switch between primary and backup modes as they are taken on and offline.

LON01 – 18-03-2015 – 20:00 – 23:59 – Network Maintenance *COMPLETE*

As part of our upgrade plans which include our own DSL and leased line network, We will be adding 2 new Cisco 6509 devices in to our core network. This work involves bring up new BGP sessions and moving Fiber interconnects between core devices. No impact is expected to be seen while bring up new … Continue reading “LON01 – 18-03-2015 – 20:00 – 23:59 – Network Maintenance *COMPLETE*”

As part of our upgrade plans which include our own DSL and leased line network, We will be adding 2 new Cisco 6509 devices in to our core network. This work involves bring up new BGP sessions and moving Fiber interconnects between core devices.

No impact is expected to be seen while bring up new BGP sessions between devices, However routing changes and network instability will be seen for a short period while we relocate interconnects and re-coverage our routing tables to reflect the new interconnect locations.

This work forms only part of the full scope of works and other maintenance windows will be booked to relocate other interconnects and re-purpose existing core devices to access nodes.

UPDATE 01 – 23:55

Primary interconnects have been relocated, however we have not re-enabled the sessions due to a potential problem. Works will continue tomorrow in a limited fashion and they will be re-enabled outside of hours.

UPDATE 02 – 22/03/2015 – 20:51
Works to re-enable establish new internal BGP sessions is complete. Works to re-enable our external BGP sessions via these news cores is complete, However will require reconfiguration at a later date once CORE-2 is online.

LON01 – EasyIPT (Hosted01) – 06/03/2015 – 20:00 till 08/03/2015 – 22:00 *Planned Maintenance* *COMPLETE*

We will be upgrading our shared EasyIPT platform (Hosted VoIP) over the course of Friday the 05th March. This upgrade work involves the replacement of the current server to a much larger device with an upgrade of OS and PBX software. The new server will be built and bought online along side the current one. … Continue reading “LON01 – EasyIPT (Hosted01) – 06/03/2015 – 20:00 till 08/03/2015 – 22:00 *Planned Maintenance* *COMPLETE*”

We will be upgrading our shared EasyIPT platform (Hosted VoIP) over the course of Friday the 05th March. This upgrade work involves the replacement of the current server to a much larger device with an upgrade of OS and PBX software. The new server will be built and bought online along side the current one. Migration works will start after 20:00 hours on a client by client biases.

As part of the works, each shared session will now be given its own IPv4 address and trunk. This will eliminate the billing issues on call forwarding that have been an issue for some time.

The works also improve redundancy via a dual network topology setup to the main server and enables IPv6 going forward. This work is inline with our upgrade program and allows us to provide a truly unique setup and experience.

Once a client is migrated the site firewall rules and handsets will be updated to reflect the new session via our management network. No action is needed where this is in place. Any site operating outside of this will need to contact us or if you are using a 3rd party firewall with no VPN.

UPDATE 01 – 22:00 – 08/03/2015
Many of the systems have migrated without issue as expected however due to the volume of migrations we have been unable to complete them all within the time allotted. Migrations will continue over the course of Monday next week out of hours as based on the weekend work, there should be no service disruptions seen. The old server will then be disconnected at 22:00 on Tuesday the 10th March

LON01 – EasyIPT – 05/03/2014 – 20:00 till 21:00 *Planned Maintenance* *COMPLETE*

We will be making some changes to our core SIP soft-switch tonight to resolve the issues we have been seeing with some BTIPX calls. This will involve a reload of the session controller and will drop any active calls. This should only need to happen once. We apologize in advance for any inconvenience this may … Continue reading “LON01 – EasyIPT – 05/03/2014 – 20:00 till 21:00 *Planned Maintenance* *COMPLETE*”

We will be making some changes to our core SIP soft-switch tonight to resolve the issues we have been seeing with some BTIPX calls. This will involve a reload of the session controller and will drop any active calls. This should only need to happen once. We apologize in advance for any inconvenience this may cause.

LON01 – Rack00 *At Risk – Maintenance – 10-03-2015* *COMPLETE*

We have been advised that an engineer working on behalf of Level3 will be in our core rack Tuesday 10-03-2015 terminating our new 24 pair bulk fiber as part of our network upgrade (details to follow) No service impact is expected, however the engineer will be within a live rack environment upon fitment and testing.

We have been advised that an engineer working on behalf of Level3 will be in our core rack Tuesday 10-03-2015 terminating our new 24 pair bulk fiber as part of our network upgrade (details to follow) No service impact is expected, however the engineer will be within a live rack environment upon fitment and testing.