How do I save a folder as a checkpoint?

Post author
Milan Parikh

I have a workflow in which a single program with many steps is run, generating multiple files that are all needed to resume from if the task is interrupted. As far as I can tell I can only set a single file as the checkpoint file, is there some way around this?

Thanks!

Comments

4 comments

  • Comment author
    Samantha (she/her)

    Hi Milan Parikh,

     

    Thanks for reaching out. Unfortunately, you can only specify one checkpoint file, not a folder of files. However, there may be other solutions for what you are trying to do. Would you be able to share your WDL with me (svelasqu@broadinstitute.org) so I can have our engineers take a closer look?

     

    Best,
    Samantha

    0
  • Comment author
    Milan Parikh
    • Edited

    Hi Samantha,

    Sure, I've just emailed it to you!

    Thanks,

    Milan Parikh

    0
  • Comment author
    Samantha (she/her)

    Hi Milan Parikh,

    Sorry for the delayed response. Our engineers looked into this and unfortunately, it's not directly possible to do this through your WDL, but it might be possible if you can have your R script periodically zip your output folder and have that be checkpointed.

    Best,

    Samantha

    0
  • Comment author
    Milan Parikh

    Hi Samantha,

    Thank you for the update, I'll try to find a way to do that.

    Best,

    Milan Parikh

    0

Please sign in to leave a comment.