Storage incident Friday April 14th, published on www.bit.org

Storage incident Friday April 14th, published on www.bit.org

15-04-2023 01:42:04

On Friday April 14th at 11:55 hrs our Ceph storage cluster was hit by an incident. This resulted in a large number of services becoming unavailable. The website www.bit.nl was therefor as well unavailable.

This incident was reported on our fallback website www.bit.org. The incident notice and updates on it can be read here. The cause of the incident is still under investigation. A Reason For Outage (RFO) will be written on cause and incident timeline. As soon as this RFO becomes available, it will be published on this website. It is clear that the incident could only occur because at that moment extra capacity was being added to the cluster. Untill the root cause is known we will not add extra capacity and therefor there is no risk that the same incident will re-occur.