PAPI error code 4

Post author
Seunghun Han

Hi,

One of the jobs I was running on Terra failed after about 168hrs (this job is expected to take long time) with following error

"Task PC.PCAir:NA:1 failed. The job was stopped before the command finished. PAPI error code 4. User specified operation timeout reached" 

But I don't have any User specification in my WDL or as an input. 
Could you help me on this issue?

Thanks,
Seunghun Han 

Comments

3 comments

  • Comment author
    Sushma Chaluvadi
    • Edited

    Hello Seunghun,

    There is a global, absolute limit on how long a PAPI VM can run, which is most likely 7 days which is why the task failed at the approximate 168 hours (1 week). We believe the source of the “user specified operation timeout” refers to PAPI’s role as a user of Compute Engine.
     
    You can try to do some parallelization of the task to help reduce the runtime so it does not hit the limit.

     

    0
  • Comment author
    tmajarian

    Hi! I know this is an old thread but I am running into the same issue.

     

    Is there really no way to get around this 7 day time limit? Is this a limit imposed by Google or by Terra?

     

    Thanks!

    0
  • Comment author
    Samantha (she/her)

    Hi tmajarian,

    Unfortunately, there is no way around the time limit. Currently, Terra only supports jobs up to 168 hours (7 days). However, we do have a feature request to allow users to configure the limit: https://support.terra.bio/hc/en-us/community/posts/360077588191-Make-the-7-day-hard-limit-for-VMs-configurable. You can upvote the post and add a comment, which our product team will take into consideration when prioritizing the requests.

    Best,

    Samantha

    0

Please sign in to leave a comment.