Need Help?

Search our documentation and community forum

Terra is a cloud-native platform for biomedical researchers to access data, run analysis tools, and collaborate.
Terra powers important scientific projects like FireCloud, AnVIL, and BioData Catalyst. Learn more.

Notification when workflow is done

Planned

Comments

6 comments

  • Avatar
    Jason Cerrato

    Hi Abarbera,

    Thank you for your request. I've created a ticket for our engineers to take a look at for consideration.

    Kind regards,

    Jason

    0
    Comment actions Permalink
  • Avatar
    Laura Egolf

    Hi, has a feature like this been added? It would be useful to receive an email notification when a task finishes (whether or not it failed). Thanks!

    0
    Comment actions Permalink
  • Avatar
    Jason Cerrato

    Hi Laura Egolf,

    Thank you for writing in. This has not yet been built but I will inform the appropriate team of your interest. I will also be happy to follow up in this thread should the feature get built!

    Kind regards,

    Jason

    0
    Comment actions Permalink
  • Avatar
    Andrew Davidson

    when I run bash scripts on computers at my univ, I use the following to receive txt message when my script completes

    echo "$host data is up $dateStamp ${@:2} " | mail 83186626322@txt.att.net

    I wonder if this would work in a workflow on terra. I am a newbie and do not know enough about workflows to test this

    Part of the trick is you want this to run when the workflow stops. that could be because of error, crash, or successful completion. 

    0
    Comment actions Permalink
  • Avatar
    Jason Cerrato

    Hi Andrew Davidson,

    Thanks for writing in! Let me check with one of our workflow engineers to get their opinion on whether this would work in a Terra-submitted workflow.

    Kind regards,

    Jason

    0
    Comment actions Permalink
  • Avatar
    Jason Cerrato

    Hi Andrew Davidson,

    It looks like this solution might work, but it would require testing. One of our engineers was able to confirm that mail wasn't installed by default on their Debian Google VM, so you may need to make sure that the Docker you use for your task(s) has mail installed. Then, you would need to confirm that it would work as expected on the Google VM in a workflow submission. However, even if both of these confirmations were to happen, the solution would still only work in specific cases.

    To run the command in a workflow you would need to add it to your WDL - likely as the last command in the last task of the workflow. However, WDL doesn’t have a try-else-finally mechanism that will run a final command if previous commands/tasks fail. As such your last command would only run in cases where the entire workflow finished successfully, which may not be as useful as you would like it to be.

    One of our engineers did create a WDL that will monitor a submission and can be set up to send an email or call a webhook when the base submission is done, regardless of success/failure. I can give you more details about their solution if you're interested, though if you are new to Terra and submitting workflows it may prove a little challenging to get it situated the way you want. Note too that it can't be considered a robust, platform-supported solution. 

    The ideal solution would definitely be the implementation of a platform-level feature for monitoring. I'm going to flag up this continued interest with our development team so they can take it into consideration, and I'll be happy to follow up in this thread with any updates.

    If you have any further questions or concerns, please let us know!

    Kind regards,

    Jason

    0
    Comment actions Permalink

Please sign in to leave a comment.

Powered by Zendesk