I've been trying to process 5000 samples (Cram->Bam for now) and it's been taking very long (I submitted on Friday (3 days ago) and I still have >1000 "running"). when the long running jobs complete, I see that they spent several days waiting for a resource (I'd copy-paste the message, but it only shows up in hover-text in the timing diagram...) either DISKS or CPU. I'm not requesting an obscene amount of disk per job (only 200 gb) nor a particularly large cpu count (3 gb)
Could you please let me know what I need to do in order to be able to actually run 5000 jobs concurrently?
Please sign in to leave a comment.