<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <link rel="alternate" type="text/html" href="https://opalstackstatus.com/"/>
    <title>Control Panel on Opalstack Status</title>
    <link>https://opalstackstatus.com/affected/control-panel/</link>
    <description>Incident history</description>
    <generator>github.com/cstate</generator>
    <language>en</language>
    
    <lastBuildDate>2025-08-29T00:05:36+00:00</lastBuildDate>
    <updated>2025-08-29T00:05:36+00:00</updated>
    
    
    
      <atom:link href="https://opalstackstatus.com/affected/control-panel/index.xml" rel="self" type="application/rss+xml" />
    
    
      <item>
        <title>[Resolved] Control panel SSL certificate was expired</title>
        <link>https://opalstackstatus.com/issues/2025-08-29-control-panel-ssl-certificate-was-expired/</link>
        <pubDate>Fri, 29 Aug 2025 00:05:36 +0000</pubDate>
        <guid>https://opalstackstatus.com/issues/2025-08-29-control-panel-ssl-certificate-was-expired/</guid>
        <category>2025-08-29 00:05:36</category>
        <description>&lt;p&gt;About 1 hour ago the SSL certificate for the control panel expired due to an administrative error on our end. While the certificate was expired, web traffic and API requests to &lt;a href=&#34;https://my.opalstack.com/&#34;&gt;https://my.opalstack.com/&lt;/a&gt; were disrupted due to the invalid certificate.&lt;/p&gt;
&lt;p&gt;The problem has been corrected as of a few moments ago and all services are back online. Apologies for the trouble. 
  &lt;span class=&#34;faded&#34;&gt;(00:05 UTC — Aug 29)&lt;/span&gt;

&lt;/p&gt;</description>
        <content type="html">&lt;p&gt;About 1 hour ago the SSL certificate for the control panel expired due to an administrative error on our end. While the certificate was expired, web traffic and API requests to &lt;a href=&#34;https://my.opalstack.com/&#34;&gt;https://my.opalstack.com/&lt;/a&gt; were disrupted due to the invalid certificate.&lt;/p&gt;
&lt;p&gt;The problem has been corrected as of a few moments ago and all services are back online. Apologies for the trouble. 
  &lt;span class=&#34;faded&#34;&gt;(00:05 UTC — Aug 29)&lt;/span&gt;

&lt;/p&gt;
</content>
      </item>
    
      <item>
        <title>[Resolved] Control panel and API offline</title>
        <link>https://opalstackstatus.com/issues/2025-07-22-control-panel-and-api-offline/</link>
        <pubDate>Tue, 22 Jul 2025 23:16:00 +0000</pubDate>
        <guid>https://opalstackstatus.com/issues/2025-07-22-control-panel-and-api-offline/</guid>
        <category>2025-07-23 12:44:23</category>
        <description>&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - The control panel updated was completed approximately 9 hours ago, apologies for the late update. 
  &lt;span class=&#34;faded&#34;&gt;(12:44 UTC — Jul 23)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;The control panel at my.opalstack.com and related API are offline for scheduled maintenance. 
  &lt;span class=&#34;faded&#34;&gt;(23:16 UTC — Jul 22)&lt;/span&gt;

&lt;/p&gt;</description>
        <content type="html">&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - The control panel updated was completed approximately 9 hours ago, apologies for the late update. 
  &lt;span class=&#34;faded&#34;&gt;(12:44 UTC — Jul 23)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;The control panel at my.opalstack.com and related API are offline for scheduled maintenance. 
  &lt;span class=&#34;faded&#34;&gt;(23:16 UTC — Jul 22)&lt;/span&gt;

&lt;/p&gt;
</content>
      </item>
    
      <item>
        <title>[Resolved] Control panel delays for US email</title>
        <link>https://opalstackstatus.com/issues/2024-04-03-control-panel-delays-for-us-email/</link>
        <pubDate>Wed, 03 Apr 2024 19:46:00 +0000</pubDate>
        <guid>https://opalstackstatus.com/issues/2024-04-03-control-panel-delays-for-us-email/</guid>
        <category>2024-04-08 21:40:54</category>
        <description>&lt;p&gt;At the present time there is a backlog of mailbox and email address changes for the US email system that are waiting to be processed. We expect this backlog to be clear within the next 2-3 hours.&lt;/p&gt;
&lt;p&gt;There is no delay in mail delivery, this is only affecting changes to email objects made via our customer control panel. 
  &lt;span class=&#34;faded&#34;&gt;(19:46 UTC — Apr 3)&lt;/span&gt;

&lt;/p&gt;</description>
        <content type="html">&lt;p&gt;At the present time there is a backlog of mailbox and email address changes for the US email system that are waiting to be processed. We expect this backlog to be clear within the next 2-3 hours.&lt;/p&gt;
&lt;p&gt;There is no delay in mail delivery, this is only affecting changes to email objects made via our customer control panel. 
  &lt;span class=&#34;faded&#34;&gt;(19:46 UTC — Apr 3)&lt;/span&gt;

&lt;/p&gt;
</content>
      </item>
    
      <item>
        <title>[Resolved] Control panel processing delays</title>
        <link>https://opalstackstatus.com/issues/2024-03-18-control-panel-processing-delays/</link>
        <pubDate>Mon, 18 Mar 2024 18:25:06 +0000</pubDate>
        <guid>https://opalstackstatus.com/issues/2024-03-18-control-panel-processing-delays/</guid>
        <category>2024-03-18 22:04:27</category>
        <description>&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - The backlog of pending items is now clear. 
  &lt;span class=&#34;faded&#34;&gt;(22:04 UTC — Mar 18)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;At this time there is a log backlog of pending operations in the control panel. We&amp;rsquo;re working to clear the backlog and will update this post when the issue is resolved. 
  &lt;span class=&#34;faded&#34;&gt;(18:25 UTC — Mar 18)&lt;/span&gt;

&lt;/p&gt;</description>
        <content type="html">&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - The backlog of pending items is now clear. 
  &lt;span class=&#34;faded&#34;&gt;(22:04 UTC — Mar 18)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;At this time there is a log backlog of pending operations in the control panel. We&amp;rsquo;re working to clear the backlog and will update this post when the issue is resolved. 
  &lt;span class=&#34;faded&#34;&gt;(18:25 UTC — Mar 18)&lt;/span&gt;

&lt;/p&gt;
</content>
      </item>
    
      <item>
        <title>[Resolved] DNS issue for opalstack.com causing control panel delays and other issues</title>
        <link>https://opalstackstatus.com/issues/2024-03-12-dns-issue-for-opalstackcom-causing-control-panel-delays-and-other-issues/</link>
        <pubDate>Tue, 12 Mar 2024 14:24:00 +0000</pubDate>
        <guid>https://opalstackstatus.com/issues/2024-03-12-dns-issue-for-opalstackcom-causing-control-panel-delays-and-other-issues/</guid>
        <category>2024-03-12 15:46:09</category>
        <description>&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - DNS has propagated on our end and the backlog of pending control panel changes is now clear.&lt;/p&gt;
&lt;p&gt;If you have DNS problems like &amp;ldquo;host not found&amp;rdquo; when accessing any Opalstack systems then please try flushing your local DNS cache: &lt;a href=&#34;https://www.wikihow.com/Flush-DNS&#34;&gt;https://www.wikihow.com/Flush-DNS&lt;/a&gt;&lt;/p&gt;
&lt;p&gt;For further assistance please email the Opalstack support team. 
  &lt;span class=&#34;faded&#34;&gt;(15:46 UTC — Mar 12)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;&lt;em&gt;Watching&lt;/em&gt; - We&amp;rsquo;ve identified the problem as 2 name servers which were failing to return records for opalstack.com hostnames. We&amp;rsquo;ve removed those name servers from our pool and are monitoring while the DNS change propagates. 
  &lt;span class=&#34;faded&#34;&gt;(15:00 UTC — Mar 12)&lt;/span&gt;

&lt;/p&gt;</description>
        <content type="html">&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - DNS has propagated on our end and the backlog of pending control panel changes is now clear.&lt;/p&gt;
&lt;p&gt;If you have DNS problems like &amp;ldquo;host not found&amp;rdquo; when accessing any Opalstack systems then please try flushing your local DNS cache: &lt;a href=&#34;https://www.wikihow.com/Flush-DNS&#34;&gt;https://www.wikihow.com/Flush-DNS&lt;/a&gt;&lt;/p&gt;
&lt;p&gt;For further assistance please email the Opalstack support team. 
  &lt;span class=&#34;faded&#34;&gt;(15:46 UTC — Mar 12)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;&lt;em&gt;Watching&lt;/em&gt; - We&amp;rsquo;ve identified the problem as 2 name servers which were failing to return records for opalstack.com hostnames. We&amp;rsquo;ve removed those name servers from our pool and are monitoring while the DNS change propagates. 
  &lt;span class=&#34;faded&#34;&gt;(15:00 UTC — Mar 12)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;At this time there is a delay in processing new items and changes in the control panel at &lt;a href=&#34;https://my.opalstack.com/&#34;&gt;https://my.opalstack.com/&lt;/a&gt;. We&amp;rsquo;re looking into it and will follow up as soon as possible. 
  &lt;span class=&#34;faded&#34;&gt;(14:24 UTC — Mar 12)&lt;/span&gt;

&lt;/p&gt;
</content>
      </item>
    
      <item>
        <title>[Resolved] Dashboard disk usage stats incorrect</title>
        <link>https://opalstackstatus.com/issues/2022-09-16-dashboard-disk-usage-stats-incorrect/</link>
        <pubDate>Fri, 16 Sep 2022 15:52:03 +0000</pubDate>
        <guid>https://opalstackstatus.com/issues/2022-09-16-dashboard-disk-usage-stats-incorrect/</guid>
        <category>2022-09-16 17:39:08</category>
        <description>&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - A fix has been deployed. Dashboard usage charts will return to normal in 8 hours when the old data has rotated out. 
  &lt;span class=&#34;faded&#34;&gt;(17:39 UTC — Sep 16)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;There&amp;rsquo;s currently a problem with the display of disk usage statistics in the Opalstack dashboard which will cause customers to see reported usage much higher than their actual usage. We&amp;rsquo;re working on a fix at this time. 
  &lt;span class=&#34;faded&#34;&gt;(15:52 UTC — Sep 16)&lt;/span&gt;

&lt;/p&gt;</description>
        <content type="html">&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - A fix has been deployed. Dashboard usage charts will return to normal in 8 hours when the old data has rotated out. 
  &lt;span class=&#34;faded&#34;&gt;(17:39 UTC — Sep 16)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;There&amp;rsquo;s currently a problem with the display of disk usage statistics in the Opalstack dashboard which will cause customers to see reported usage much higher than their actual usage. We&amp;rsquo;re working on a fix at this time. 
  &lt;span class=&#34;faded&#34;&gt;(15:52 UTC — Sep 16)&lt;/span&gt;

&lt;/p&gt;
</content>
      </item>
    
      <item>
        <title>[Resolved] Dashboard control loop issue</title>
        <link>https://opalstackstatus.com/issues/2021-08-08-dashboard-control-loop-issue/</link>
        <pubDate>Sun, 08 Aug 2021 00:57:00 +0000</pubDate>
        <guid>https://opalstackstatus.com/issues/2021-08-08-dashboard-control-loop-issue/</guid>
        <category>2021-08-08 02:12:46</category>
        <description>&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - The dashboard and API are back online.&lt;/p&gt;
&lt;p&gt;The problem was caused by human error by one of our team while using our admin shell to make a mass update to a single customer&amp;rsquo;s websites during a migration. This kicked off a massive cascade of events which overloaded the control loop.&lt;/p&gt;
&lt;p&gt;This was strictly an admin error - the WebFaction migration tool that many customers are using is safe to use.&lt;/p&gt;</description>
        <content type="html">&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - The dashboard and API are back online.&lt;/p&gt;
&lt;p&gt;The problem was caused by human error by one of our team while using our admin shell to make a mass update to a single customer&amp;rsquo;s websites during a migration. This kicked off a massive cascade of events which overloaded the control loop.&lt;/p&gt;
&lt;p&gt;This was strictly an admin error - the WebFaction migration tool that many customers are using is safe to use.&lt;/p&gt;
&lt;p&gt;We&amp;rsquo;ve rolled back the updates and have cleared the pending updates from the control loop and all systems are operating normally at this time.&lt;/p&gt;
&lt;p&gt;This issue affected Apache/PHP-CGI applications in the dashboard. We believe there should not be any lingering issues but if you notice a problem with any of your Apache/PHP-CGI applications then please try an edit+save cycle on the application and wait a minute for the changes to take effect. If the problem persists then please contact Opalstack Support for further assistance. 
  &lt;span class=&#34;faded&#34;&gt;(02:12 UTC — Aug 8)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;&lt;em&gt;Identified&lt;/em&gt; - We&amp;rsquo;ve taken the dashboard offline while we work to resolve this. 
  &lt;span class=&#34;faded&#34;&gt;(01:05 UTC — Aug 8)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;At this time there is an issue with our control loop which deploys changes from the dashboard to our servers. Dashboard changes will remain pending until the issue is resolved. We&amp;rsquo;ll update this post as soon as possible. 
  &lt;span class=&#34;faded&#34;&gt;(00:57 UTC — Aug 8)&lt;/span&gt;

&lt;/p&gt;
</content>
      </item>
    
      <item>
        <title>[Resolved] Delay in dashboard operations</title>
        <link>https://opalstackstatus.com/issues/2021-08-01-delay-in-dashboard-operations/</link>
        <pubDate>Sun, 01 Aug 2021 23:12:53 +0000</pubDate>
        <guid>https://opalstackstatus.com/issues/2021-08-01-delay-in-dashboard-operations/</guid>
        <category>2021-08-02 04:51:47</category>
        <description>&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - The problem has been corrected and the dashboard operation backlog is cleared. 
  &lt;span class=&#34;faded&#34;&gt;(04:51 UTC — Aug 2)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;At this time there is a significant delay in the time that it is taking for changes made in the Opalstack dashboard (ie creating or modifying domains, apps, sites, email, shell users, etc).&lt;/p&gt;
&lt;p&gt;We&amp;rsquo;re investigating the issue and will update this post when more info is available. 
  &lt;span class=&#34;faded&#34;&gt;(23:12 UTC — Aug 1)&lt;/span&gt;

&lt;/p&gt;</description>
        <content type="html">&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - The problem has been corrected and the dashboard operation backlog is cleared. 
  &lt;span class=&#34;faded&#34;&gt;(04:51 UTC — Aug 2)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;At this time there is a significant delay in the time that it is taking for changes made in the Opalstack dashboard (ie creating or modifying domains, apps, sites, email, shell users, etc).&lt;/p&gt;
&lt;p&gt;We&amp;rsquo;re investigating the issue and will update this post when more info is available. 
  &lt;span class=&#34;faded&#34;&gt;(23:12 UTC — Aug 1)&lt;/span&gt;

&lt;/p&gt;
</content>
      </item>
    
      <item>
        <title>[Resolved] Control panel and API down for scheduled maintenance.</title>
        <link>https://opalstackstatus.com/issues/2021-04-17-control-panel-and-api-down-for-scheduled-maintenance/</link>
        <pubDate>Sat, 17 Apr 2021 04:45:00 +0000</pubDate>
        <guid>https://opalstackstatus.com/issues/2021-04-17-control-panel-and-api-down-for-scheduled-maintenance/</guid>
        <category>2021-04-17 05:06:58</category>
        <description>&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - The control panel and API are back online. 
  &lt;span class=&#34;faded&#34;&gt;(05:06 UTC — Apr 17)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;&lt;em&gt;Watching&lt;/em&gt; - We expect the service will be back online in ~15 minutes. 
  &lt;span class=&#34;faded&#34;&gt;(04:48 UTC — Apr 17)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;The control panel and API are down for &lt;a href=&#34;https://status.opalstack.com/schedules/22&#34;&gt;scheduled maintenance&lt;/a&gt;. We&amp;rsquo;ll update this post when the service is back online. 
  &lt;span class=&#34;faded&#34;&gt;(04:45 UTC — Apr 17)&lt;/span&gt;

&lt;/p&gt;</description>
        <content type="html">&lt;p&gt;&lt;em&gt;Fixed&lt;/em&gt; - The control panel and API are back online. 
  &lt;span class=&#34;faded&#34;&gt;(05:06 UTC — Apr 17)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;&lt;em&gt;Watching&lt;/em&gt; - We expect the service will be back online in ~15 minutes. 
  &lt;span class=&#34;faded&#34;&gt;(04:48 UTC — Apr 17)&lt;/span&gt;

&lt;/p&gt;
&lt;p&gt;The control panel and API are down for &lt;a href=&#34;https://status.opalstack.com/schedules/22&#34;&gt;scheduled maintenance&lt;/a&gt;. We&amp;rsquo;ll update this post when the service is back online. 
  &lt;span class=&#34;faded&#34;&gt;(04:45 UTC — Apr 17)&lt;/span&gt;

&lt;/p&gt;
</content>
      </item>
    
      <item>
        <title>[Resolved] Dashboard was not pushing changes</title>
        <link>https://opalstackstatus.com/issues/2020-12-09-dashboard-was-not-pushing-changes/</link>
        <pubDate>Wed, 09 Dec 2020 17:30:00 +0000</pubDate>
        <guid>https://opalstackstatus.com/issues/2020-12-09-dashboard-was-not-pushing-changes/</guid>
        <category>2020-12-09 21:30:03</category>
        <description>&lt;p&gt;Four hours ago at approximately 17:30 UTC today on 09 Dec 2020 a bug was introduced into our admin dashboard that blocked the ability for new changes to be pushed out to servers.&lt;/p&gt;
&lt;p&gt;This affected all dashboard operations: new apps, new sites, email, domains, etc were held back due to the bug.&lt;/p&gt;
&lt;p&gt;It&amp;rsquo;s been corrected and most items should be caught up within the next 30 minutes. Let&amp;rsquo;s Encrypt certificates may take a while longer but will eventually go through. 
  &lt;span class=&#34;faded&#34;&gt;(17:30 UTC — Dec 9)&lt;/span&gt;

&lt;/p&gt;</description>
        <content type="html">&lt;p&gt;Four hours ago at approximately 17:30 UTC today on 09 Dec 2020 a bug was introduced into our admin dashboard that blocked the ability for new changes to be pushed out to servers.&lt;/p&gt;
&lt;p&gt;This affected all dashboard operations: new apps, new sites, email, domains, etc were held back due to the bug.&lt;/p&gt;
&lt;p&gt;It&amp;rsquo;s been corrected and most items should be caught up within the next 30 minutes. Let&amp;rsquo;s Encrypt certificates may take a while longer but will eventually go through. 
  &lt;span class=&#34;faded&#34;&gt;(17:30 UTC — Dec 9)&lt;/span&gt;

&lt;/p&gt;
</content>
      </item>
    
      <item>
        <title>[Resolved] Control Panel CSS broken</title>
        <link>https://opalstackstatus.com/issues/2019-12-04-control-panel-css-broken/</link>
        <pubDate>Wed, 04 Dec 2019 16:15:00 +0000</pubDate>
        <guid>https://opalstackstatus.com/issues/2019-12-04-control-panel-css-broken/</guid>
        <category>2019-12-04 16:42:12</category>
        <description>&lt;p&gt;The main control panel CSS was briefly broken this morning which may have rendered the panel unusable for customers. The error has been corrected. 
  &lt;span class=&#34;faded&#34;&gt;(16:15 UTC — Dec 4)&lt;/span&gt;

&lt;/p&gt;</description>
        <content type="html">&lt;p&gt;The main control panel CSS was briefly broken this morning which may have rendered the panel unusable for customers. The error has been corrected. 
  &lt;span class=&#34;faded&#34;&gt;(16:15 UTC — Dec 4)&lt;/span&gt;

&lt;/p&gt;
</content>
      </item>
    
      <item>
        <title>[Resolved] Control panel issue</title>
        <link>https://opalstackstatus.com/issues/2019-11-25-control-panel-issue/</link>
        <pubDate>Mon, 25 Nov 2019 07:00:00 +0000</pubDate>
        <guid>https://opalstackstatus.com/issues/2019-11-25-control-panel-issue/</guid>
        <category>2019-11-26 19:54:33</category>
        <description>&lt;p&gt;At around 7AM UTC on 25 November 2019 a problem developed with the API tokens used by the control panel. As a result, mail users and other items added via the control panel after that time may not have been created correctly.&lt;/p&gt;
&lt;p&gt;The token issue is resolved. If you notice any problems with mail users, shell users, applications, and other items created via the panel in the past 24-36 hours then please &lt;a href=&#34;https://help.opalstack.com/article/9/getting-help&#34;&gt;contact our support team&lt;/a&gt; for assistance. 
  &lt;span class=&#34;faded&#34;&gt;(07:00 UTC — Nov 25)&lt;/span&gt;

&lt;/p&gt;</description>
        <content type="html">&lt;p&gt;At around 7AM UTC on 25 November 2019 a problem developed with the API tokens used by the control panel. As a result, mail users and other items added via the control panel after that time may not have been created correctly.&lt;/p&gt;
&lt;p&gt;The token issue is resolved. If you notice any problems with mail users, shell users, applications, and other items created via the panel in the past 24-36 hours then please &lt;a href=&#34;https://help.opalstack.com/article/9/getting-help&#34;&gt;contact our support team&lt;/a&gt; for assistance. 
  &lt;span class=&#34;faded&#34;&gt;(07:00 UTC — Nov 25)&lt;/span&gt;

&lt;/p&gt;
</content>
      </item>
    
  </channel>
</rss>
