Requester Pays Google buckets not asking for project to bill Completed

Post author
Jason Cerrato

When visiting a Terra workspace bucket that has requester pays enabled, Google does not seem to ask for a project to bill for download of the data. When you try to download a file, Google returns the following error:

Bucket is a requester pays bucket but no user project provided.

We are currently investigating this issue.


EDIT: April 7, 2022

This issue also seems to be resulting in pop-up errors for the Terra UI when visiting a requester pays workspace in a billing project you have access to. The error reports "Error loading storage cost data."



  • Comment author
    Jason Cerrato
    • Official comment

    Google engineers have pushed out a fix for this issue. Users can once again select a project to bill for requester pays buckets and successfully download files via the Google Cloud Console UI.

  • Comment author
    Jason Cerrato

    We were able to confirm that this issue is affecting non-Terra Google requester pays buckets as well. We are filing a bug report with Google to investigate this issue.

    As a workaround, you can download files from Google Cloud via the command line by providing a project to bill in your gsutil cp command. For example:

    gsutil -u project-to-bill gs://requester-pays-bucket/file gs://destination-bucket
  • Comment author
    Jason Ni

    Hi! I could confirm that this approach works indeed to cp from requester pays bucket. But when I run the gatk joint genotyping script, I get this error code 400

    Picked up _JAVA_OPTIONS:
    05:15:35.461 INFO  NativeLibraryLoader - Loading from jar:file:/gatk/gatk-package-!/com/intel/gkl/native/
    05:15:35.872 INFO  GenomicsDBImport - ------------------------------------------------------------
    05:15:35.873 INFO  GenomicsDBImport - The Genome Analysis Toolkit (GATK) v4.1.8.0
    05:15:35.873 INFO  GenomicsDBImport - For support and documentation go to
    05:15:35.873 INFO  GenomicsDBImport - Executing as root@7f7d5677e221 on Linux v5.15.65+ amd64
    05:15:35.873 INFO  GenomicsDBImport - Java runtime: OpenJDK 64-Bit Server VM v1.8.0_242-8u242-b08-0ubuntu3~18.04-b08
    05:15:35.874 INFO  GenomicsDBImport - Start Date/Time: October 11, 2022 5:15:35 AM GMT
    05:15:35.874 INFO  GenomicsDBImport - ------------------------------------------------------------
    05:15:35.874 INFO  GenomicsDBImport - ------------------------------------------------------------
    05:15:35.875 INFO  GenomicsDBImport - HTSJDK Version: 2.22.0
    05:15:35.875 INFO  GenomicsDBImport - Picard Version: 2.22.8
    05:15:35.875 INFO  GenomicsDBImport - HTSJDK Defaults.COMPRESSION_LEVEL : 2
    05:15:35.875 INFO  GenomicsDBImport - HTSJDK Defaults.USE_ASYNC_IO_READ_FOR_SAMTOOLS : false
    05:15:35.875 INFO  GenomicsDBImport - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_SAMTOOLS : true
    05:15:35.876 INFO  GenomicsDBImport - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_TRIBBLE : false
    05:15:35.876 INFO  GenomicsDBImport - Deflater: IntelDeflater
    05:15:35.876 INFO  GenomicsDBImport - Inflater: IntelInflater
    05:15:35.876 INFO  GenomicsDBImport - GCS max retries/reopens: 20
    05:15:35.876 INFO  GenomicsDBImport - Requester pays: disabled
    05:15:35.876 INFO  GenomicsDBImport - Initializing engine
    05:15:37.561 INFO  FeatureManager - Using codec IntervalListCodec to read file file:///cromwell_root/fc-secure-4329a05b-7ebf-4931-86a6-1e3b2a0a9f0e/submissions/bae11f4f-a837-4299-9454-9b3ae6972b67/JointGenotyping/3154593f-8309-4f4c-aa1f-dacf92ce5479/call-SplitIntervalList/glob-d928cd0f5fb17b6bd5e635f48c18ccfb/0000-scattered.interval_list
    05:15:37.788 INFO  IntervalArgumentCollection - Processing 385747762 bp from intervals
    05:15:37.799 INFO  GenomicsDBImport - Done initializing engine
    05:15:38.250 INFO  GenomicsDBLibLoader - GenomicsDB native library version : 1.3.0-e701905
    05:15:38.251 INFO  GenomicsDBImport - Vid Map JSON file will be written to /cromwell_root/genomicsdb/vidmap.json
    05:15:38.251 INFO  GenomicsDBImport - Callset Map JSON file will be written to /cromwell_root/genomicsdb/callset.json
    05:15:38.251 INFO  GenomicsDBImport - Complete VCF Header will be written to /cromwell_root/genomicsdb/vcfheader.vcf
    05:15:38.251 INFO  GenomicsDBImport - Importing to workspace - /cromwell_root/genomicsdb
    05:15:38.251 WARN  GenomicsDBImport - GenomicsDBImport cannot use multiple VCF reader threads for initialization when the number of intervals is greater than 1. Falling back to serial VCF reader initialization.
    05:15:38.251 INFO  ProgressMeter - Starting traversal
    05:15:38.252 INFO  ProgressMeter -        Current Locus  Elapsed Minutes     Batches Processed   Batches/Minute
    05:15:51.646 INFO  GenomicsDBImport - Shutting down engine
    [October 11, 2022 5:15:51 AM GMT] done. Elapsed time: 0.27 minutes.
    code:      400
    message:   Bucket is a requester pays bucket but no user project provided.
    reason:    required
    location:  null
    retryable: false Bucket is a requester pays bucket but no user project provided.
    	at java.nio.file.Files.exists(
    	at htsjdk.tribble.util.ParsingUtils.resourceExists(
    	at htsjdk.tribble.AbstractFeatureReader.isTabix(
    	at htsjdk.tribble.AbstractFeatureReader$ComponentMethods.isTabix(
    	at htsjdk.tribble.AbstractFeatureReader.getFeatureReader(
    	at org.genomicsdb.importer.GenomicsDBImporter.lambda$null$2(
    	at java.util.concurrent.CompletableFuture$
    	at java.util.concurrent.ThreadPoolExecutor.runWorker(
    	at java.util.concurrent.ThreadPoolExecutor$
    Caused by: 400 Bad Request
      "code" : 400,
      "errors" : [ {
        "domain" : "global",
        "message" : "Bucket is a requester pays bucket but no user project provided.",
        "reason" : "required"
      } ],
      "message" : "Bucket is a requester pays bucket but no user project provided."
    	... 20 more
    Using GATK jar /gatk/gatk-package-
        java -Dsamjdk.use_async_io_read_samtools=false -Dsamjdk.use_async_io_write_samtools=true -Dsamjdk.use_async_io_write_tribble=false -Dsamjdk.compression_level=2 -Xms8g -jar /gatk/gatk-package- GenomicsDBImport --genomicsdb-workspace-path genomicsdb --batch-size 50 -L /cromwell_root/fc-secure-4329a05b-7ebf-4931-86a6-1e3b2a0a9f0e/submissions/bae11f4f-a837-4299-9454-9b3ae6972b67/JointGenotyping/3154593f-8309-4f4c-aa1f-dacf92ce5479/call-SplitIntervalList/glob-d928cd0f5fb17b6bd5e635f48c18ccfb/0000-scattered.interval_list --sample-name-map /cromwell_root/fc-secure-4329a05b-7ebf-4931-86a6-1e3b2a0a9f0e/submissions/17a51933-9a4b-4405-b9f3-e8fcf4cc256c/GenerateSampleMap/f77d25e7-d0cd-4a9c-97e2-733512f8b33f/call-GenerateSampleMapFile/generate-sample-map_2022-10-11T04-48-34.sample_map --reader-threads 5 --merge-input-intervals --consolidate

    Would be great if you can provide some guidance!

  • Comment author
    Emily Barnes

    Hi Jason,


    Thank you for writing in about this issue. Can you share the workspace where you are seeing this issue with Terra Support by clicking the Share button in your workspace? The Share option is in the three-dots menu at the top-right.

    1. Toggle the "Share with support" button to "Yes"
    2. Click Save


    Please provide us with

    1. A link to your workspace
    2. The relevant submission ID
    3. The relevant workflow ID


    We’ll be happy to take a closer look as soon as we can!


    Kind regards,



Please sign in to leave a comment.