Issue: Slow localization of input files

Jason Cerrato

In this article, you'll learn a possible solution for files that localize slowly.

The Issue

File inputs are localizing slower than expected for your workflow task(s).

Possible Solution

File input/output operations per second (IOPS) scale with the size of your disk. If you find that your files localize slowly, consider increasing the disk size allotted for your task. You may even save money in the long run, as the overall compute time may be greatly shortened with the improved IOPS performance.

Google reference: https://cloud.google.com/compute/docs/disks/performance#machine-type-disk-limits

Was this article helpful?

1 out of 1 found this helpful

Comments

1 comment

  • Comment author
    Ash O'Farrell

    It turns out this also helps with slow delocalization of files at the end of a task too! Throwing more space (and an SSD) at a task slashed the delocalization time of its outputs by almost 75%. Thanks for the tip!

    1

Please sign in to leave a comment.