GPUs for Notebook Runtime Environments

Follow

Elena Torlai Triglia

• January 10, 2020 19:13

I am interested in using a tool (scVI - https://scvi.readthedocs.io/ ) that runs much faster on GPUs but at the moment only CPUs can be requested as Notebook Runtime Environments.
It would be great to be allowed to request GPUs as Notebook Runtime Environments.

15

• 

  orr

  • January 13, 2020 21:13

  This would be awesome for any deep learning analyses, good idea!

  2

  Comment actions Permalink
• 

  orr

  • April 22, 2020 15:45

  Hi Terra team, Can we please get some input on whether GPU support can be added? Several of us think this is an important addition. Thank you!

  0

  Comment actions Permalink
• 

  Jason

  • April 22, 2020 18:36

  Hi orr et. al.,

  Thank you for checking in on this. Our notebooks engineering team has done an investigation of the time and effort required for implementation and have concluded that the requirements are high on both fronts. As such, the team will be unable to implement this feature this quarter due to the size of the team and prior commitments that they need to implement first. That said, the team is aware that this is one of the highest requested features for the platform and are actively working on crafting a plan to deliver as soon as they are able. The goal is to implement before end of year.

  As always, I am happy to update everyone on the progress of work as I hear more from the team!

  Kind regards,

  Jason

  0

  Comment actions Permalink
• 

  Matt Elliott

  • February 27, 2021 22:09

  Hi Jason, thanks for the update! Terra has been very helpful to my team and we are also excited about GPU/TPU computation. Will this feature be included in the near future?

  You may want to advise the terra.bio web team to edit their why-cloud page. There are claims that Terra supports not just GPU/TPUs but even FPGAs!

  0

  Comment actions Permalink
• 

  Jason

  • March 01, 2021 15:23

  Hey Matt Elliott,

  We're glad to hear you're excited about it! We're excited to bring it to Terra. Our engineers expect to start work on GPUs for cloud environments in Q2 this year.

  Thank you for pointing out the why-cloud page. This page is intended to explain the benefits of working in the cloud generally, but we can definitely see how this can be confused as describing Terra's features. I've alerted a member of our team to this confusion so that the wording can be re-done for clarity. We appreciate you bringing this to our attention!

  Note that GPUs are indeed already available for Terra-submitted workflows. When GPUs are ready to go on the cloud environment side, I'll be happy to update this thread.

  Kind regards,

  Jason

  0

  Comment actions Permalink
• 

  orr

  • March 01, 2021 19:44

  hi Jason, that's awesome news! thanks for the update- Orr

  0

  Comment actions Permalink
• 

  Matt Elliott

  • March 01, 2021 20:02

  Hi Jason, Thanks for the quick feedback and timeline! We're excited that this functionality is being worked on. 

  0

  Comment actions Permalink

Please sign in to leave a comment.