In this article, you'll learn a possible solution for files that localize slowly.
File inputs may localize slower than expected.
File input/output operations per second (IOPS) scale with the size of your disk. If you find that your files localize slowly, consider increasing the disk size allotted for your task. You may even save money in the long run, as the overall compute time may be greatly shortened with the improved IOPS performance.
Google reference: https://cloud.google.com/compute/docs/disks/performance#machine-type-disk-limits
It turns out this also helps with slow delocalization of files at the end of a task too! Throwing more space (and an SSD) at a task slashed the delocalization time of its outputs by almost 75%. Thanks for the tip!
Please sign in to leave a comment.