PAPI error code 4

September 18, 2019 13:57
3 comments

Hi,

One of the jobs I was running on Terra failed after about 168hrs (this job is expected to take long time) with following error

"Task PC.PCAir:NA:1 failed. The job was stopped before the command finished. PAPI error code 4. User specified operation timeout reached"

But I don't have any User specification in my WDL or as an input.
Could you help me on this issue?

Thanks,
Seunghun Han

Comments

3 comments

Sushma Chaluvadi
- Edited September 20, 2019 17:13
Hello Seunghun,

There is a global, absolute limit on how long a PAPI VM can run, which is most likely 7 days which is why the task failed at the approximate 168 hours (1 week). We believe the source of the “user specified operation timeout” refers to PAPI’s role as a user of Compute Engine.

You can try to do some parallelization of the task to help reduce the runtime so it does not hit the limit.

0
tmajarian
- August 26, 2021 14:41
Hi! I know this is an old thread but I am running into the same issue.

Is there really no way to get around this 7 day time limit? Is this a limit imposed by Google or by Terra?

Thanks!

0
Samantha (she/her)
- August 26, 2021 16:32
Hi tmajarian,

Unfortunately, there is no way around the time limit. Currently, Terra only supports jobs up to 168 hours (7 days). However, we do have a feature request to allow users to configure the limit: https://support.terra.bio/hc/en-us/community/posts/360077588191-Make-the-7-day-hard-limit-for-VMs-configurable. You can upvote the post and add a comment, which our product team will take into consideration when prioritizing the requests.

Best,

Samantha

0

Please sign in to leave a comment.