Memory retry mechanism not adjusting memory

Post author
Migwell

We have a task which has this exact structure (details have been removed):

task Task {
    input {
        String memory = "8G"
    } 
    runtime {
       memory: memory
       maxRetries: 5
    }
    command {
        echo "Available Memory on Terra: $MEM_SIZE$MEM_UNIT"
    }
    output {}
}

In Terra, this successfully retries, and we can see 6 attempts (5 retries), which is great. However, every single attempt logs "Available Memory on Terra: 8.0GB", from the first to the last task. Clearly the memory retry mechanism isn't working correctly. Can you explain what we are doing wrong here, and how to resolve it?

Comments

2 comments

  • Comment author
    Pamela Bretscher

    Hi Migwell,

    Thank you for writing in about this issue. Can you share the workspace where you are seeing this issue with Terra Support by clicking the Share button in your workspace? The Share option is in the three-dots menu at the top-right.

    1. Toggle the "Share with support" button to "Yes"
    2. Click Save

    Please provide us with

    1. A link to your workspace
    2. The relevant submission ID
    3. The relevant workflow ID

    We’ll be happy to take a closer look as soon as we can!

    Kind regards,

    Pamela

    0
  • Comment author
    Migwell

    Hi Pamela, I've just shared a workspace containing a workflow that demonstrates this behaviour. Happy to send you more details privately.

    0

Please sign in to leave a comment.