We have published a write up about the problem and the solution here: https://blog.selfnet.de/2024-09-17_postmortem.html

The Selfnet WLAN has been working again for a few minutes now, in which a faulty redundant system (the database) is first addressed individually without the redundancy.

According to several externally operated monitoring devices, the LAN network has been down for just over 2.5 hours so far.

https://atlas.ripe.net/probes/1005764/#tab-network https://atlas.ripe.net/probes/1005759/#tab-network https://atlas.ripe.net/probes/1005857/#tab-network

The outage today is not directly related to the planned reorganisation of Selfnet components. It may have been triggered by preparatory work.

The announced remodelling work has not yet been carried out and is scheduled to take place in the coming week.

In the Selfnet WLAN there are unfortunately still access problems with a central component to the database, which is why the WLAN continues to cause problems.

It is still not known what triggered the system. However, a system has been identified which, when added to the network, causes the entire network to fail. The logs from this device are to be analysed.

As you can see in the dashboard, Selfnet has had constant traffic again for about 2 hours. The LAN should be reasonably stable since then.

The Selfnet LAN has been working again for about 30 minutes by reducing redundancies in the network. Unfortunately, it has not yet been possible to solve the problem in the Selfnet WLAN.