{
  "is": "issue",
  "title": "MariaDB down on opal10",
  "body": "\u003cp\u003e\u003cem\u003eFixed\u003c/em\u003e - The recovery is complete and the database service is back online. \n  \u003cspan class=\"faded\"\u003e(19:00 UTC — Jan 16)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eIdentified\u003c/em\u003e - We\u0026rsquo;ve been unable to recover the MariaDB service in-place, so we\u0026rsquo;re restoring the service from the most recent backup which was completed about 13 hours ago at 04:21 UTC.\u003c/p\u003e\n\u003cp\u003eThe estimated recovery time is 4 hours or less. We\u0026rsquo;ll update this post when more information is available. \n  \u003cspan class=\"faded\"\u003e(17:25 UTC — Jan 16)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eIdentified\u003c/em\u003e - The MariaDB InnoDB store on opal10 is corrupted. We\u0026rsquo;re still working to recover but do not have an ETA at this time. \n  \u003cspan class=\"faded\"\u003e(16:20 UTC — Jan 16)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003eAt this time the MariaDB service on opal10 is offline. We\u0026rsquo;re working to restore service and will update this post when more information is available. \n  \u003cspan class=\"faded\"\u003e(13:34 UTC — Jan 16)\u003c/span\u003e\n\n\u003c/p\u003e\n",
  "createdAt": "2025-01-16 13:34:02 +0000 UTC",
  "lastMod": "2025-01-16 13:34:02 +0000 UTC",
  "permalink": "https://opalstackstatus.com/issues/2025-01-16-mariadb-down-on-opal10/",
  "severity": "down",
  "resolved": true,
  "informational": false,
  "resolvedAt": "2025-01-16 19:00:43",
  "affected": ["Shared: Washington D.C. (USA)"],
  "filename": "2025-01-16-mariadb-down-on-opal10.md"
}