custom runtime configuration
I have a process which demands about 200GB of memory. So I would like to specify 5 CPU and 1TB. Can I specify this kind of configuration when the available options don't serve the purpose?
Thanks
I have a process which demands about 200GB of memory. So I would like to specify 5 CPU and 1TB. Can I specify this kind of configuration when the available options don't serve the purpose?
Thanks
Comments
5 comments
Hi AIBS MolGen,
Thanks for writing in. I've brought this feature request to our product team as something to consider.
The Terra UI currently only has options for
n1Google machine types but you can try making changes to the configuration by calling this API https://notebooks.firecloud.org/#/runtimes/createRuntime and using a different machine type that matches your specifications.{"runtimeConfig": {
"cloudService": "gce",
"machineType": "<pick-a-machine-type>",
"diskSize": <pick-a-disk-size>
},
"labels": {
"saturnAutoCreated": "true"
}
}
You'll need to authorize your account first, then click Try it out and add the custom properties before finally selecting Execute. One caveat to note is that we only have testing for the
n1machine types, so these custom machine types might have unexpected issues.Please let me know if you have any questions.
Best,
Samantha
A related question. After a job fails, how do I check the disk or memory usage for my job? I have a job that keeps failing and I am pretty sure it is either a disk problem or a memory problem. I've also seen this from my workflow.log, although I requested 1T disk.
Hi Ruolin Liu,
Thanks for your question. You can take a look at the size of your VM by clicking the "Compute Details" button on the workflow of interest in the Job Manager.
You can see both the boot disk size and the general disk size. These are distinct settings that serve different purposes.
https://cromwell.readthedocs.io/en/stable/RuntimeAttributes/#bootdisksizegb
https://cromwell.readthedocs.io/en/stable/RuntimeAttributes/#disks
If you want us to take a closer look at your job, please write to us at support@terra.bio and share the workspace with GROUP_FireCloud-Support@firecloud.org - we'll be happy to help!
Kind regards,
Jason
Thank you Jason! Do you know this line here `environment : MEM_SIZE : 4GB` is memory per CPU or total memory for the instance?
Hi Ruolin Liu,
Happy to help! That 4G would be the total memory for the instance.
Jason
Please sign in to leave a comment.