Network maintenance BIT-2B [Extended]

Network maintenance BIT-2B [Extended]

02-04-2019 00:00:00 - 02-04-2019 07:50:00

Urgency: Planned

Affected services:
- Customers with a network connection to switch "leaf-sw1.bit-2b"
- Customers with a network connection to switch "leaf-sw2.bit-2b"
- Customers with a network connection to switch "leaf-sw3.bit-2b"
- Customers with a network connection to switch "leaf-sw4.bit-2b"

Expected Impact:
- Disruption of network connection for a couple of minutes during reboot of switch
- Short disruption of service for a couple of seconds during activation of storm-control

Customer intervention required: No

Reference number: 161518

Contact: +31 (0)318 648 688, support@bit.nl

Summary:

Due to a bug in the firmware of leaf switches in BIT-2B, it is necessary to upgrade this firmware. During this maintenance all aforementioned switches will be rebooted. Customers with a redundant connection will see their network links go down and up in turn. Customers with a single network connection will be disconnected for a few minutes. "Storm-control" is also activated in this maintenance window. This is due to the network disruption of last Saturday March 9th.

Details:

The leaf switches in BIT-2B appear to have a bug where a process is slowly claiming more and more memory. Ultimately this will result in lack of memory and eventually downtime. A firmware upgrade is required to prevent this. This upgrade will result in network disruption of a few minutes per switch. To minimize impact for customers with a redundant network connection, the switches will be upgraded and restarted one by one. Customers with a single network connection in BIT-2B will not be connected for a few minutes during the switch reboot. On your invoice you can find whether you have a connection to one of the aforementioned switches.

During the same maintenance we will activate storm-control on the these switches. Activation of storm-control will also result in a short interruption of network traffic for a few seconds. Storm-control protects our network against incorrectly configured customer networks, when it floods our network with broadcast and multicast traffic. This is done with regards to the network outage of last Saturday March 9th.
Update placed at 02-04-2019, 02:15h
This maintenance is finished. All affected services have been restored. If you have any questions regarding this maintenance, please contact the Customer Care department by phone on +31 (0)318 648 688 or by email on support@bit.nl.
Update placed at 02-04-2019, 06:15h
Some redundant uplinks are experiencing issues at the moment. To resolve these issues maintenance work is resumed and the window has been extended to 07.00h. A more detailed update will follow when the maintenance if finished
Update placed at 02-04-2019, 07:33h
Because of continuous issues we have downgraded leaf-sw4.bit-2b to the previous firmware. leaf-sw3.bit-2b will be downgraded at this moment.
Update placed at 02-04-2019, 07:50h
We have downgraded leaf-sw3.bit-2b to the previous firmware. We will closely monitor our switches.