RESOLVED: We have confirmed the recovery of our primary European node and services are being brought back online. Please expect intermittent response delays on the API as services return to full functionality.
Issue: We are investigating a major infrastructure outage affecting the DroneBL.org Website and RPC2 API for submissions/removals.
Investigation: On July 2nd, 2024, we were alerted to downtime affecting our primary website mirror. The capabilities of this host included the DroneBL.org administration interface, API and database from which our DNSBL zonefiles are generated.
We immediately engaged the server sponsor and escalated to the host. The issue was promptly attributed to a catastrophic hardware failure on the host, and a hardware replacement request was raised.
On July 5th, 2024, a separate incident took our primary DNSBL resolver out of service for over 72 hours. We confirmed that the issue was due to a NIC failure on the host/hypervisor, which was corrected by the provider on July 8th, 2024 after several incidents were declared.
On July 9th, 2024, our hardware replacement request was fulfilled, however, our container could not be immediately started due to Virtualization issues. A separate incident was declared, and the appropriate changes were made on July 10th, 2024.
We confirmed resolution of this issue on July 10th, 2024.
Last updated: July 2, 2024 at 1:24 AM UTC