Unable to determine when quota has been exceeded

I think I based my task off of an deprecated example. premptive is a boolean. the example I used defaulted to "3"

I will re-run test and update this request accordingly

Andy

I have run some simple usability, performance, and cost experiments on Terra. The results are very promissing

I am trying to figure out how to use terra at scale. In one of my early tests, I selected 10 samples and ran a workflow that quantifies reads using Salmon.

submission id:  a3746d28-710d-4d10-b1d2-dc34dfa3c6fc

my CPU quota default is 24.

the runtime was configured to required 6 preemptive CPUs. I think Salmon was designed to run on a single machine. I configured it to use 6 threads. So my assumption is that my workflow should have required 60 CPUs to run. I assume that 5 of these CPUs / containers were basically idle. This should have exceeded the CPU quota.

I noticed that submission completed in about 4 hrs. Some samples were proceeded in as little as 40 mins. some of the runtime difference could be due to different file sizes however I think that is unlikely.  I assume that the long total run time was due to the quota being exceeded, however, I have no way to confirm this. I spent the morning trying to figure out how to use google console to figure this out. I can not find any evidence that the quota exceeded?

The reason this is important, My lab plans to eventually run several thousand samples. We like the idea of quotas. We have a lot of inexperienced people. At the same time, we want to identify resource problems such as quotas being exceeded.

https://www.youtube.com/watch?v=u-kbSmdRzAQ

https://cloud.google.com/docs/quota#monitoring_quota_metrics?utm_source=youtube&utm_medium=Unpaidsocial&utm_campaign=yur-20201002-working-with-quotas

I looked at "quota exceeded error", "quota limit", and "Rate Quota usage"

It is important that we structure our work so that it completes quickly, and runs to completion. Budget is always an issue, using primitive CPUs will save us a lot of money however Google does not allow preemptive CPUs to run for more than 24 hrs

Kind regards

Andy