Service Incident - November 16, 2023 (Galaxy)

Samantha (she/her)
  • Updated

Summary

Our engineers have identified an issue with restarting paused Galaxy environments on Terra.

See the Timeline section for the latest troubleshooting and resolution updates and the Impact section to understand how this could impact your use of the system. 

Timeline

January 2, 2023 11:45 AM ET - Issue Remediation - Our engineers have made the decision to disable the pause/resume functionality for Galaxy apps. Users should DELETE a Galaxy instance while saving their Persistent Disk and start a new instance when needed.

November 16, 2023 4:39 PM ET - Issue Investigation - Our engineers are currently working on a fix for this issue. In the meantime we suggest that users Delete their Galaxy app instead of Pausing to avoid running into the error when restarting.

November 16, 2023 3:42 PM ET - Issue Escalated - Our engineers were able to reliably reproduce the issue and have escalated it as a production incident.

November 15, 2023 2:08 PM ET - Issue Reported - A user reported this issue to Terra Support

Impact

Terra users with paused Galaxy instances are impacted. Users attempting to restart a paused Galaxy instance, will receive the following error: 

Error Creating Galaxy App

Details
Your 'GALAXY' app has an error
Error connecting to https://1446202803.jupyter-prod.firecloud.org using address 34.31.63.119:443 (unresolved: false)

Users with running Galaxy apps should DELETE their app instead of PAUSING to avoid running into the above error when restarting the app. 

For more information

Please follow this article to get the most up to date information on this incident. If you would like to be notified of all service incidents or upcoming scheduled maintenance, click Follow on this page

Was this article helpful?

Comments

0 comments

Please sign in to leave a comment.