Summary
On the morning of April 30, 2020, we are seeing job submissions and results retrieval queued for much longer than expected. We are currently investigating.
See the Timeline section for the latest troubleshooting and resolution updates and the Impact section to understand how this could impact your use of the system.
Timeline
April 31, 2020 11:38 AM ET - Issue resolution - Our engineers are seeing no unusual queueing at this time. We are monitoring for new flare-ups and prioritizing work to improve Cromwell stability under heavy load.
April 30, 2020 9:35 AM ET - Issue discovered - Our engineers were informed of reports from yesterday evening, April 29, of job submissions and results retrieval taking much longer than usual. They are actively investigating the root cause.
Impact
Users may be experiencing long queue times for job submission or job results retrieval. There is no indication that additional costs will be accrued by users, as this is happening on Cromwell's end, not Google's.
For more information
Please follow this article to get the most up to date information on this incident. If you would like to be notified of all service incidents or upcoming scheduled maintenance, click Follow on this page.