{
  "is": "issue",
  "title": "Incoming mail problems in Germany",
  "body": "\u003cp\u003e\u003cem\u003eFixed\u003c/em\u003e - The disk array rebuild is complete and the server has been stable since our last update. \n  \u003cspan class=\"faded\"\u003e(15:50 UTC — Feb 10)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eWatching\u003c/em\u003e - The DE mail service is back online at this time. The main issue was heavy load caused by the very high volume of deferred mail the resulted from the mail loop. This was exacerbated by the degraded disk array.\u003c/p\u003e\n\u003cp\u003eThe networking issue was unrelated but has been resolved.\u003c/p\u003e\n\u003cp\u003eThe disk array is still rebuilding but the server is operating normally. We\u0026rsquo;ll continue to monitor until the rebuild is complete. \n  \u003cspan class=\"faded\"\u003e(18:54 UTC — Feb 9)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eIdentified\u003c/em\u003e - There seems to be multiple issues related to the DE IMAP server:\u003c/p\u003e\n\u003col\u003e\n\u003cli\u003eA forwarding loop was causing delivery delays for the past few hours.\u003c/li\u003e\n\u003cli\u003eA degraded disk array was impacting system performance\u003c/li\u003e\n\u003cli\u003eA failed network switch is currently blocking network connectivity\u003c/li\u003e\n\u003c/ol\u003e\n\u003cp\u003eOur data center team is working on restoring connectivity at this time. \n  \u003cspan class=\"faded\"\u003e(15:50 UTC — Feb 9)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eInvestigating\u003c/em\u003e - The DE IMAP server is now offline for a filesystem check. \n  \u003cspan class=\"faded\"\u003e(15:16 UTC — Feb 9)\u003c/span\u003e\n\n\u003c/p\u003e\n\u003cp\u003eWe\u0026rsquo;re receiving reports of slow mail delivery in our German mail system. We\u0026rsquo;re looking into it at this time. \n  \u003cspan class=\"faded\"\u003e(14:18 UTC — Feb 9)\u003c/span\u003e\n\n\u003c/p\u003e\n",
  "createdAt": "2021-02-09 14:18:31 +0000 UTC",
  "lastMod": "2021-02-09 14:18:31 +0000 UTC",
  "permalink": "https://opalstackstatus.com/issues/2021-02-09-incoming-mail-problems-in-germany/",
  "severity": "down",
  "resolved": true,
  "informational": false,
  "resolvedAt": "2021-02-10 15:50:14",
  "affected": ["IMAP/POP3 (DE)", "MX (DE)"],
  "filename": "2021-02-09-incoming-mail-problems-in-germany.md"
}