I am currently running/training MAchine learning models that are very GPU expensive, Google Colab Pro is not giving me enough GPU/RAM

Is there any alternatives with better GPU and more RAM than Google Colab Pro??

  • 2
    $\begingroup$ IMO this question is not appropriate to this forum, as it borders on opinion and non-unique answers $\endgroup$ – Nikos M. May 5 at 16:48
  • 5
    $\begingroup$ You can rent compute in any cloud provider with whatever hardware requirements you may have, and then launch a jupyter server there. $\endgroup$ – noe May 5 at 17:14
  • $\begingroup$ Which forum should I use here in stackexchange? Let me know and I delete my post @NikosM. $\endgroup$ – The Dan May 5 at 17:22
  • 1
    $\begingroup$ I think noe's comment already provided the best answer. All stackexchnage sites I am aware of, reject questions which do not have specific unique answers and border on opinion $\endgroup$ – Nikos M. May 5 at 17:23
  • $\begingroup$ I agree with Nikos, imho the question is not objectively answerable. Are you looking for commerical cloud providers with specific features? If yes which features precisely? As it stands the question could even be answered with "buy whatever hardware you need and build your own high performance system", but probably that wouldn't be satisfying for anybody. Fyi AWS probably provides anything you might need (for a price of course). $\endgroup$ – Erwan May 5 at 22:09

Here are a few options:

  • Commercial cloud provider: AWS is the go-to cloud provider for virtually any need, they have options for everything. Check out their options for Deep Learning.
  • You could also buy your own hardware
  • Finally from a data science perspective there is also the option of modifying the parameters of the model and/or data so that the training fits with the hardware limitations.

Try Kaggle, they offer 30 hours of TPU per week which might help if you are working with tensorflow or torch (TPUs have 128GB of memory). What you should try when running into memory issues is to use half precision floats which reduces memory requirements.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.