{
  "is": "issue",
  "title": "OPAL7 MariaDB Server Offline",
  "body": "\u003cp\u003e\u003cem\u003eFixed\u003c/em\u003e - The MariaDB recovery is complete and by all indications customer sites should be working normally at this time. If you have a site hosted on opal7 and notice any problems then please contact our support team for further assistance. \n  \u003cspan class=\"faded\"\u003e(15:13 UTC — Dec 7)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eIdentified\u003c/em\u003e - At this time we are rebooting opal7. The recovery is nearly complete. \n  \u003cspan class=\"faded\"\u003e(14:29 UTC — Dec 7)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eIdentified\u003c/em\u003e - The restoration process is 80% complete. \n  \u003cspan class=\"faded\"\u003e(13:37 UTC — Dec 7)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eIdentified\u003c/em\u003e - Databases are still restoring. \n  \u003cspan class=\"faded\"\u003e(13:15 UTC — Dec 7)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eIdentified\u003c/em\u003e - Databases are continuing to be restored. We do not have an ETA on when the full restore will be finished but we\u0026rsquo;ll keep this post updated. \n  \u003cspan class=\"faded\"\u003e(12:11 UTC — Dec 7)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eIdentified\u003c/em\u003e - The recovery of MariaDB has been unsuccessful through all of the recovery methods. We will begin restoring the databases from latest backup.\u003c/p\u003e\n\u003cp\u003eThe latest backup was taken ~4 hours before the MariaDB server went offline. \n  \u003cspan class=\"faded\"\u003e(11:13 UTC — Dec 7)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eIdentified\u003c/em\u003e - The InnoDB transaction log has been corrupted. We\u0026rsquo;re working to restore service by running in recovery mode. \n  \u003cspan class=\"faded\"\u003e(10:54 UTC — Dec 7)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003eThe MariaDB server on OPAL7 has stopped responding to queries. We\u0026rsquo;re investigating this failure now. \n  \u003cspan class=\"faded\"\u003e(10:16 UTC — Dec 7)\u003c/span\u003e\n\n\u003c/p\u003e\n",
  "createdAt": "2024-12-07 10:16:00 +0000 UTC",
  "lastMod": "2024-12-07 10:16:00 +0000 UTC",
  "permalink": "https://opalstackstatus.com/issues/2024-12-07-opal7-mariadb-server-offline/",
  "severity": "down",
  "resolved": true,
  "informational": false,
  "resolvedAt": "2024-12-07 15:13:49",
  "affected": ["Shared: Phoenix (USA)"],
  "filename": "2024-12-07-opal7-mariadb-server-offline.md"
}