Paired-Fastq-to-Unmapped-Bam stopped with the message "No space left on device".

Post author
KM

Hi, @Samantha. I'm new to Terra and need your help for my revise experiments!!

I tried Paired-Fastq-to-Unmapped-Bam with my own files but it stopped. I think it may be because "No space left on device". Part of the Stderr file is shown below. Could you help me??

I am not sure how Terra works, but where do I set the disk space that I can use? When I created a Jupyter Notebook VM in the Tutorial, I set a persistent disk space. However, when I just run Workflow, I can run it without setting the disk space.

- workspace: https://app.terra.bio/#workspaces/KM-202301/Sequence-Format-Conversion%20KM20230121_3
- Submission ID: <cc96492c-43ce-47aa-bcf3-4431cba5d71e>
- workflow ID: eb0279a4-5813-4241-a042-0e6a63677b06
- workflow ID: 0bb3de91-9dd2-4244-83d6-e3f53060b87f
- workflow ID: 1c077068-4951-4ad1-b805-21ed2cb58628
- workflow ID: 8d19c686-a552-4c83-8208-f4663cb27645
- I heve toggled the "Share with support" button to "Yes".

...
INFO    2023-01-24 07:15:34    FastqToSam    Processed 1,050,000,000 records.  Elapsed time: 03:09:30s.  Time for last 1,000,000:    9s.  Last read position: */*
INFO    2023-01-24 07:15:44    FastqToSam    Processed 1,051,000,000 records.  Elapsed time: 03:09:40s.  Time for last 1,000,000:    9s.  Last read position: */*
INFO    2023-01-24 07:15:51    FastqToSam    Processed 525759724 fastq reads
[Tue Jan 24 08:11:34 GMT 2023] picard.sam.FastqToSam done. Elapsed time: 245.54 minutes.
Runtime.totalMemory()=2559049728
To get help, see http://broadinstitute.github.io/picard/index.html#GettingHelp
htsjdk.samtools.util.RuntimeIOException: Write error; BinaryCodec in writemode; streamed file (filename not available)
    at htsjdk.samtools.util.BinaryCodec.writeBytes(BinaryCodec.java:222)
    at htsjdk.samtools.util.BlockCompressedOutputStream.writeGzipBlock(BlockCompressedOutputStream.java:444)
    at htsjdk.samtools.util.BlockCompressedOutputStream.deflateBlock(BlockCompressedOutputStream.java:408)
    at htsjdk.samtools.util.BlockCompressedOutputStream.write(BlockCompressedOutputStream.java:301)
    at htsjdk.samtools.util.BinaryCodec.writeBytes(BinaryCodec.java:220)
    at htsjdk.samtools.util.BinaryCodec.writeBytes(BinaryCodec.java:212)
    at htsjdk.samtools.BAMRecordCodec.encode(BAMRecordCodec.java:168)
    at htsjdk.samtools.BAMFileWriter.writeAlignment(BAMFileWriter.java:144)
    at htsjdk.samtools.SAMFileWriterImpl.close(SAMFileWriterImpl.java:227)
    at htsjdk.samtools.AsyncSAMFileWriter.synchronouslyClose(AsyncSAMFileWriter.java:38)
    at htsjdk.samtools.util.AbstractAsyncWriter.close(AbstractAsyncWriter.java:89)
    at picard.sam.FastqToSam.doWork(FastqToSam.java:367)
    at picard.cmdline.CommandLineProgram.instanceMain(CommandLineProgram.java:309)
    at org.broadinstitute.hellbender.cmdline.PicardCommandLineProgramExecutor.instanceMain(PicardCommandLineProgramExecutor.java:37)
    at org.broadinstitute.hellbender.Main.runCommandLineProgram(Main.java:160)
    at org.broadinstitute.hellbender.Main.mainEntry(Main.java:203)
    at org.broadinstitute.hellbender.Main.main(Main.java:289)
Caused by: java.io.IOException: No space left on device
    at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
    at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
    at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
    at sun.nio.ch.IOUtil.write(IOUtil.java:65)
    at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
    at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
    at java.nio.channels.Channels.writeFully(Channels.java:101)
    at java.nio.channels.Channels.access$000(Channels.java:61)
    at java.nio.channels.Channels$1.write(Channels.java:174)
    at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
    at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
    at htsjdk.samtools.util.BinaryCodec.writeBytes(BinaryCodec.java:220)
    ... 16 more

Comments

2 comments

  • Comment author
    Samantha (she/her)

    Hi KM,

    Thanks for reaching out. You are correct that the reason the workflow is failing is because of insufficient disk space. You'll need increase the disk space and resubmit the workflow.

    When running a workflow on Terra, the VM settings are configured in the WDL script, in the `runtime` section of the task. There are default runtime attribute values used if no value is specified.

    Here is the runtime section for the PairedFastQsToUnmappedBAM task.

    Disk space is calculated a few lines above 

    In the Inputs tab of the workflow configuration, you have the option to override the default values of machine_mem_gb and additional_disk_space_gb. 

     

    I hope this helps. Please let me know if you any other questions.

     

    Best,

    Samantha

    0
  • Comment author
    KM

    Hi Samantha, thank you for your kindness. It worked well and I really appreciate your help.

    0

Please sign in to leave a comment.