I am having tasks spending a lot of time in PreparingJob state. In the following figure:
You can see the long tasks starting with a long light blue segment that is described as PreparingJob. The dark blue segments are the UserAction states where the code is actually run. These were tasks that requested 4 CPUs and less than 8GB of RAM. The only thing special about the tasks was that they processed long arrays of files, the first two Array[File]+ with 1,407 small files each and the second one Array[File]+ with 1,407 small files.
I have shared the workspace with GROUP_FireCloud-Support@firecloud.org if that helps and these were the labels for the job:
Please sign in to leave a comment.