Need Help?

Search our documentation and community forum

Terra is a cloud-native platform for biomedical researchers to access data, run analysis tools, and collaborate.
Terra powers important scientific projects like FireCloud, AnVIL, and BioData Catalyst. Learn more.

mount my own Google bucket

Comments

4 comments

  • Avatar
    Jason

    Hi Sehyun,

    Thanks for writing in. I'll take a look at this request and get you a response as soon as I can!

    Kind regards,

    Jason

    0
    Comment actions Permalink
  • Avatar
    Jason

    Hi Sehyun,

    gcsfuse has been tricky for some users in the past, but we can see if it's possible to get it working for your case. What issue are you running into using it presently?

    You will need to make sure your Terra account and its service accounts have access to your external resource. We recommend using a group to set up these permissions. See this article for more details: https://support.terra.bio/hc/en-us/articles/360050202631

    After your Terra account and its service accounts have sufficient permission to the external resources, you can try using gcsfuse. Let us know if you run into any specific issues.

    Kind regards,

    Jason

    0
    Comment actions Permalink
  • Avatar
    Jason

    Hi Sehyun,

    I've learned from our Interactive Analysis team that we unfortunately don't offer a mechanism for mounting buckets at this time. The recommended approach is to use client libraries (AnVIL package, gsutil, etc) to move data from GCS. An engineer also mentioned that this is what bucket-mounting tools are doing under the hood anyway. I took a look at Google's Cloud Storage FUSE documentation, and this appears to be correct.

    Even if you were able to install gcs-fuse on your image, they believe it likely wouldn't work because it requires containers to be run in privileged mode, which isn't currently an option. 

    At this time it seems like gcs-fuse is unlikely to work in the current Terra environment. That said I'm happy to file a feature request for the team to consider building in support for gcs-fuse in the future.

    Kind regards,

    Jason

    0
    Comment actions Permalink
  • Avatar
    Sehyun Oh

    Hi Jason,

    Thanks for the update. It's good to know. And yes, it'll be great if you can file a feature request on gcsfuse.

    - Sehyun

    0
    Comment actions Permalink

Please sign in to leave a comment.

Powered by Zendesk