Service Incident - September 1, 2023 (Workspaces)

Anthony DiCi
  • Updated

Summary

We had a brief service incident that affected the visibility of workspaces in Terra.

When our engineers were attempting to delete the kubernetes resources for Bond in prod, the BPM ones were instead deleted by accident, as the wrong button in ArgoCD was pushed. The resources were quickly recreated, but a short outage did occur. Per GCP logs, BPM’s ingress (which would take the longest of all the resources to come back up) was down from 11:50am to 12:02pm EST.

See the Timeline section for the latest troubleshooting and resolution updates and the Impact section to understand how this could impact your use of the system. 

Timeline

September 1, 2023 12:02 PM - Issue Remediated - issue was remediated

September 1, 2023 11:55 AM - Issue Declared - issue was declared as a production service incident

September 1, 2023 11:50 AM - Issue Discovered - issue was introduced to production

Impact

Users may have been unable to see or access any of there workspaces during this brief outage. Please note that no action is required and the issue has been fully resolved.

For more information

Please follow this article to get the most up to date information on this incident. If you would like to be notified of all service incidents or upcoming scheduled maintenance, click Follow on this page

Was this article helpful?

0 out of 0 found this helpful

Comments

0 comments

Please sign in to leave a comment.