Resubmitting Failed Workflows Makes a new Set
The new feature to be able to resubmit failed workflows is amazing! It has already saved me a ton of time and made my Terra experience better.
However, I found it surprising that it generated a new Set and added it to my Data Model just from clicking that retry button. I suppose it might be helpful to have a Set created if you end up wanting to rerun on that set in the future, but I would imagine that my Sets in my data model are going to get very cluttered very quickly. If it's deemed helpful to have a Set added to the Data Model every time you click the rerun button, could there at least be a way to filter them out of the Data Model view? Otherwise when I want to launch the Set that I've specifically made myself I have to sift through a long list of these automatically generated Sets in order to find what I'm looking for.
Happy to provide screenshots or examples if needed.
Screenshots would be really helpful!
Sure! So if I click the rerun button (that's the third icon in that list) from the job history page:
I then get this in my data model:
The first three participant sets there are automatically generated from when I clicked the retry button (while "mixes_v0" is my own participant set). I'm worried that if I continue to rerun failures this way (which will definitely keep happening), it will make my data model cluttered and difficult to sort through.
This is one area where we're fighting against the backend API, which requires a set in order to submit multiple workflows. Ultimately we would like to get away from this. I don't have a clear expectation when that work might get done. When there is only 1 failure, we should not be creating a set. We have a story in progress now that should be released next week for handling 1-failure resubmits.
In the meantime, we have added the ability to delete rows from your data model tables. You can delete the sets being generated so they don't clog up your data model. Ultimately, we'd like to get away from generating them in the first place, as you suggest.
Thanks for the update!
I wanted to update that, for submissions representing a single failed workflow, you can now relaunch that failure without creating a set.
For submissions with multiple failures, we still have to create a set. But those sets can be deleted in the UI.
Please sign in to leave a comment.