Issue: Slow localization of input files

Jason Cerrato

The Issue

File inputs may be localizing slower than expected.

Possible Solution

File input/output operations per second (IOPS) scale with the size of your disk. If you find that your files are localizing slowly, you may consider increasing the disk size allotted for your task. You may even save money in the long run, as the overall compute time may be greatly shortened with the improved IOPS performance.

Google reference: https://cloud.google.com/compute/docs/disks/performance#machine-type-disk-limits

Was this article helpful?

1 out of 1 found this helpful

Have more questions? Submit a request

Comments

1 comment

  • Comment author
    Ash O'Farrell

    It turns out this also helps with slow delocalization of files at the end of a task too! Throwing more space (and an SSD) at a task slashed the delocalization time of its outputs by almost 75%. Thanks for the tip!

    1

Please sign in to leave a comment.