- 29-03-20DDoS
- 17-02-20Disruption loadbalanced services
- 06-02-20Disruption Cephfs
- 13-12-19Reduced availability switches BIT-2D
- 04-12-19CephFS storage issue
- 13-11-19Network disruption BIT-2D
- 20-10-19Outage storage systems
- 19-10-19Outage storage systems
- 19-10-19Storage shared hosting
- 15-10-19Fire suppression system BIT-2D activated
CephFS storage issue
04-12-2019 20:32:15
- 04-12-2019 21:00:00
Status:
resolved
Today at 20:20 hrs, one of the Meta Data Servers providing the CephFS shared storage experienced a crash. This has caused a temporary IO-stall on the filesystems of several minutes.
BIT engineers were alerted and are investigating the root cause.
Follow the incident on our website for updates concerning this incident.
Update: 20:52
We've hit the same bug as in november this year. Unfortunate as this is, we do have a little more information to take back to the Ceph developers in hope of finding a cause and fix for this bug.
The filesystems are back online and available. BIT engineers are checking the systems for normal functioning.
BIT engineers were alerted and are investigating the root cause.
Follow the incident on our website for updates concerning this incident.
Update: 20:52
We've hit the same bug as in november this year. Unfortunate as this is, we do have a little more information to take back to the Ceph developers in hope of finding a cause and fix for this bug.
The filesystems are back online and available. BIT engineers are checking the systems for normal functioning.