The following release notes correspond to January 11, 2021 - January 20, 2021. In addition to these changes, this release includes back-end updates to Google integrations to improve upcoming features.
Notebooks
- Galaxy instances are now able to be paused and resumed from within in Terra. Pausing stops compute costs but keeps storage, so instances can be started up again without losing work. Galaxy instances will be auto-paused after 1 hour.
- Hadoop/Spark utilities (such as hdfs, spark-submit, yarn, and hadoop commands) now work from within Terra notebooks and the terminal.
- Fixed a bug preventing runtimes from being created with some custom Dockerhub images.
- Removed legacy
/api/cluster/...
Leonardo APIs. Instead, the/api/google/v1/runtimes
routes should be used. More information is available here. - Clusters are able to make use of all preemptible workers. This is a fix to a bug affecting some users, where Dataproc clusters with preemptible workers were not correctly being created.
- Made cost estimate in Terra UI more accurate for Spark clusters with preemptible workers
Workflows
- We've upgraded to Cromwell 55. As part of this update:
- Cromwell now offers support for the use of reference disks on the PAPI v2 backend as an alternative to localizing reference inputs. Read more about it here.
- Cromwell now offers support for the use of Docker image caches on the PAPI v2 lifesciences beta backend. More details available here.
- Cromwell can now help tasks recover from preemption by allowing them to specify a 'checkpoint' file which will be restored to the worker VM on the next attempt if the task is interrupted. Read more about this change here.
- In addition, Cromwell 55 includes bugfixes that address the following bugs:
- Fixes to address bugs that prevented
read_json()
from working with arrays and primitives. More information can be found here. - Fixed a bug that prevented the call caching diff endpoint from working with scatters in workflows with archived metadata.
- Fixes to address bugs that prevented
- For more information about Cromwell, including changes present in the newest version, visit the Cromwell website.