Questions tagged [gpu]

Graphics Processing Units (GPUs) within the context of Machine Learning often refer to the hardware requirements, design considerations, or level of parallelization for implementing and running various machine learning algorithms.

Filter by
Sorted by
Tagged with
1 vote
1 answer
17 views

How does compute required scale with number of model parameters?

GPT-3 has 175 billion parameters, required ~$3.114 * 10^{23}$ FLOPS, and took approximately one month to train on ~10k Tesla V100 GPUs. It seems commonly stated that the brain has the equivalent of ~...
user avatar
0 votes
1 answer
57 views

Tensorflow gpu not available for jupyter notebook

I am trying to make tensorflow work with gpu support. First I have tensorflow-gpu installed: However, there is no gpu available....
user avatar
  • 11
0 votes
0 answers
11 views

Is there any point in using a colab TPU for inference?

I have a colab pro+ subscription and like many, I'm finding that the GPU allowance is rather small compared to the price. While I wait for GPU access I was wondering if the TPU VM would be a ...
user avatar
0 votes
0 answers
73 views

ValueError: Mixed precision training with AMP or APEX (`--fp16` or `--bf16`) and half precision evaluation (`--fp16) can only be used on CUDA devices

i’m fine tuning the wav2vec-xlsr model. i’ve created a virtual env for that and i’ve installed cuda 11.0 and tensorflow-gpu==2.5.0 but it gives the following error : ValueError: Mixed precision ...
user avatar
1 vote
1 answer
61 views

BERT base uncased required gpu ram

I'm working on an NLP task, using BERT, and I have a little doubt about GPU memory. I already made a model (using DistilBERT) since I had out-of-memory problems with tensorflow on a RTX3090 (24gb gpu'...
user avatar
  • 68
1 vote
1 answer
18 views

How do NVIDIA GPU restrictions affect AI computational frameworks?

I know this question is very vendor specific and as time passes it might change but I am wondering how NVIDIA available GPU cards nowadays (2022) are restricted in any way license wise or hardware ...
user avatar
  • 119
0 votes
0 answers
14 views

How to build a neural network without using keras compile method

I have the following neural network: ...
user avatar
0 votes
0 answers
31 views

How to use GPU for Keras learning in this example

I have the following code, for vertical federated learning where i use keras to create a simple 2 layer NN ...
user avatar
0 votes
0 answers
7 views

How can i make a process using several small keras models execute faster?

I have a keras model that is being trained using a genetic algorithm. This means that the performance of the model needs to be tested many times. To test the model performance the model is used as a ...
user avatar
0 votes
0 answers
138 views

Keras Error: tensorflow.python.framework.errors_impl.ResourceExhaustedError: failed to allocate memory

I'm attempting to review a lot of famous DL architectures and implement them via Keras. I'm following El Gendy's book & Github (https://github.com/moelgendy/deep_learning_for_vision_systems/blob/...
user avatar
  • 101
0 votes
1 answer
998 views

cuDNN isn't found FWD algo for convolution. How to TRAIN DARKNET ON GE FORCE GTX 1650

ISSUE: while training Darknet with GE FORCE GTX 1650 using following: CUDA 11.0 cuDNN 8.0.5 OPENCV 4.5 Model starts training with config file details as below for [net] section: ...
user avatar
0 votes
0 answers
13 views

Can the Apple M1's iGPU access the entire RAM as "video memory" when training with typical deep learning frameworks?

Can the Apple M1's iGPU access the entire RAM as "video memory" when training with typical deep learning frameworks (e.g., tensorflow_macos)? If not, what memory do they use as video memory?
user avatar
0 votes
1 answer
30 views

Cost Efficient Machine Learning Development Using Cloud GPUs

Let's say I have a Juypter Notebook I am working on where I am analyzing, visualizing, testing, etc. various Machine Learning Models with different hyperparameters on some arbitrary data set or I am ...
user avatar
  • 11
1 vote
0 answers
13 views

Is there a reason not to wirk with AMP (automatic mixed precision)?

According to: Introducing native PyTorch automatic mixed precision for faster training on NVIDIA GPUs It's better to use AMP (with 16 Floating Point) due to: Shorter training time. Lower memory ...
user avatar
0 votes
1 answer
148 views

mBART training "CUDA out of memory"

I want to train a network with mBART model in google colab , but I got the message of ...
user avatar
  • 41
1 vote
0 answers
117 views

Intel Core i7 CPU (10th gen) trains Tensorflow models faster than Intel Iris Plus Graphics GPU

Intro Recently I was able to get my GPU (Intel Iris Plus Graphics) to work with "accelerating" Tensorflow. It took many hours of research and following tutorials (most of which didn't help). ...
user avatar
2 votes
2 answers
6k views

How do I install CUDA GPU for Visual Studio 2022 for windows 10?

I cannot find the visual studio 2019 version and every time I try to install CUDA 11.2.2 on my laptop, It warns me about not that I haven't installed Visual Studio. I've tried installing the C++ add-...
user avatar
0 votes
0 answers
38 views

Improving the Actor Critic algorithm proposed by Keras

In this page of keras's website, a reinforcement learning algorithm based in an actor critic scheme has been described. It is a deep policy gradient algorithm (hence DPG). Of course keras functions ...
user avatar
0 votes
0 answers
40 views

Can a framework use both CPU and GPU in parallel for inference?

Can a framework use both CPU and GPU in parallel for inferencing a model? It seems possible but wondering if any of the frameworks like TensorFlow or PyTorch done this? To explain further, can we use ...
user avatar
  • 109
1 vote
1 answer
104 views

Does GPU decreases training time for on-policy RL?

I was wondering whether using a GPU will be effective if I am using an on-policy (eg PPO) RL as the model? I.e, how can we use a GPU to decrease training time for an on-policy RL model? I recently ...
user avatar
  • 85
0 votes
0 answers
44 views

Unable to connect to files folder in Google Colab after insalling Rapids?

I am following steps mentioned in below link for installing Rapids in Google Colab. However as soon as I run cell no 4, the folders I see in file section disappear and I see "Connecting to a ...
user avatar
0 votes
1 answer
122 views

OOM memory after kernel restart, was working before

Ran my CNN on a SageMaker notebook and it started training, but I had to restart the kernel due to AWS disconnecting. However when I tried to rerun my code, I received an OOM error, and it never ...
user avatar
0 votes
0 answers
986 views

ValueError: GPU is not accessible. Was the library installed correctly?

I installed spacy 3 in a venv and tried to execute: spacy.require_gpu() Then I got this as output: ...
user avatar
  • 187
0 votes
0 answers
49 views

What is num_groups in GroupNorm and how to choose it

I found that batch_norm can cause problems with small batch sizes and that GroupNorm is a good alternative. Now, GroupNorm requires two parameters, the num_group and the num_channels. How can I choose ...
user avatar
0 votes
2 answers
478 views

Model accuracy when training on GPU and then inferencing on CPU

When we are concerned about speed, GPU is way better than CPU. But if I train a model on a GPU and then deploy the same trained model (no quantization techniques used) on a CPU, will this affect the ...
user avatar
1 vote
2 answers
2k views

Alternatives with better GPU than Google Colab Pro

I am currently running/training MAchine learning models that are very GPU expensive, Google Colab Pro is not giving me enough GPU/RAM Is there any alternatives with better GPU and more RAM than ...
user avatar
  • 153
1 vote
0 answers
34 views

Suitable CPU with RTX3070 GPU for deep learning [closed]

I am trying to get a GPU for my deep learning research. Due to stock limitation, I can only get a RTX3070. In my lab, there's some PC/workstation whereby I can install the RTX3070. However, I wonder ...
user avatar
  • 11
0 votes
1 answer
21 views

GPU shows 0 utilization even when tensors and model are mounted on the gpu?

I am trying to run some PyTorch scripts on a remote GPU server. While calling the script in the ubuntu terminal i start as:...
user avatar
1 vote
1 answer
432 views

Why the my Tensorflow code just use one GPU when I assign more than one

I am trying to run my code on a supercomputer with 8 gpus. Though, I assign 8 gpus but one of them is just occupied. I read some notes in websites and it seems that Tensorflow automatically use gpu if ...
user avatar
0 votes
0 answers
137 views

ImportError: DLL load failed while importing _pywrap_tfe when running exe file created by Pyinstaller

I have created the exe file of my code which uses tensorflow on gpu. It seems that building process using Pyinstaller goes fine. However, when I run the exe file in a system without GPU, I get the ...
user avatar
  • 1
1 vote
1 answer
78 views

DIGITS Docker container not picking up GPU

I am running DIGITS Docker container but for some reason it fails to recognize host's GPU: it does not report any GPUs (where I expect 1 to be reported) so in the upper right corner of the DIGITS home ...
user avatar
0 votes
1 answer
57 views

How many video streams can single GPU handle for object detection

I need to detect objects from multiple video streams at realtime (or close to it, like 10 FPS). How many GPUs do I need to detect objects using YOLOv3 or MobileNet for, say, 10 video streams? Is it ...
user avatar
  • 101
0 votes
1 answer
127 views

How to run unmodified Python program on GPU servers with scheduled GPUs?

Say I have one server with 10 GPUs. I have a python program which detects available GPU and use all of them. I have a couple of users who will run python (Machine learning or data mining) programs and ...
user avatar
  • 103
1 vote
1 answer
60 views

Alternatives to GCP / AWS / Azure

Can anyone recommend an alternative to the big 3 cloud computing alternatives? I know they're the best but I found them overly complicated because they cater to massive enterprises. The amount of set ...
user avatar
  • 181
0 votes
1 answer
119 views

Why does my GPU immediately run out of memory when I try to run this code?

I am trying to write a neural network that will train on plays by Shakespeare and then write its own passages. I am using pytorch. For some reason, my GPU ...
user avatar
0 votes
1 answer
262 views

Why does GPU speed up inference?

I understand that GPU can speed up training for each batch multiple data records can be fed to the network which can be parallelized for computation. However, for inference, typically, each time the ...
user avatar
  • 103
2 votes
1 answer
141 views

Use a GPU to speed up neural net training in R

I'm currently training a neural net model in R and am wanting to use a GPU to speed up this process. I've looked into this but it appears that this is unavailable to Mac users as Apple no longer uses ...
user avatar
-1 votes
1 answer
30 views

How much GPUs are needed for Image ehancement? [closed]

I'm looking for a GPU to train my model. Most of the papers that I have followed used 2 or more gtx 1050ti card or higher. (MIRNet, EnlightenGAN) I need to that how much GPU power will it take to ...
user avatar
  • 99
2 votes
1 answer
5k views

CUDA compatibility of GTX 1650ti versus 1650

I am confused about CUDA compatibility. I am studying deep learning and looking for a laptop to buy. One laptop has GTX 1650ti and another has GTX 1650. Will both be able to use GPU for model training,...
user avatar
0 votes
0 answers
23 views

Simultaneous inference on many gpu, question

I want to do boosting for instance segmentation. Lets say I have 5 different models for this and I have 5 GPUs. WHat I want to do is to do the inference on each model on each GPU, and combine the ...
user avatar
1 vote
2 answers
54 views

How can I create a VM instance with GPUs on Google Cloud Platform?

How can I create a VM instance with GPUs on Google Cloud Platform? When I go to https://console.cloud.google.com/compute -> CREATE INSTANCE, I only see CPUs and no GPUs, as shown in the video below....
user avatar
1 vote
1 answer
242 views

How to evenly distribute data to multiple GPUs using Keras

I am using Keras=2.3.1 with Tensorflow-gpu=2.0.0 backend. While I trained model on two RTX 2080 ti 11G GPUs, it allocates all data to '/gpu:0',and nothing changed with '/gpu:1'. Surely, the second GPU ...
user avatar
  • 11
4 votes
1 answer
4k views

What GPU size do I need to fine tune BERT base cased?

I want to fine tune BERT Multilingual but I'm not aware about the GPU requirements to train BERT Multilingual. I have GTX 1050ti 4GB on my local machine. I want to know what size of GPU is needed and ...
user avatar
2 votes
3 answers
2k views

How to install tensorflow-gpu?

I installed cuda-11.0 and cuDNN-8.2 and Tensor-RT 7.1. And then installed tensorflow-gpu. But tf.is_gpu_available() is showing False. Actually, I installed ...
user avatar
0 votes
0 answers
119 views

How to run neural network in gpu instead of cpu?

I installed cuDNN and cuda toolkit 11 in my machine. Now I installed tensorflow-gpu in pip3 of version 2.2.0. But while running neural network, cpu is being used 90% with four cores and gpu is being ...
user avatar
1 vote
1 answer
146 views

GPU vs TPU for convolutional neural networks (NLP)

I am testing ideas on IMDB sentiment analysis task by using word embeddings + CNN approach. What could explain a significant difference in computation time in favor of GPU (~9 seconds per epoch) ...
user avatar
3 votes
2 answers
1k views

Keras OOM for data validation using GPU

I'm trying to run a deep model using GPU and seems Keras running the validation against the whole validation data set in one batch instead of validating in many batches and that's causing out of ...
user avatar
  • 31
1 vote
1 answer
222 views

Is it true more CPU core is better for deep learning?

I just started to learn the deep learning in my free time. I was hoping to buy a laptop where I want to implement some small(alexnet) to medium(GoogleNet) networks maybe something bigger. I searched ...
user avatar
2 votes
1 answer
706 views

How to enable GPU on GradientBoostingClassifier?

Is there a way to enable GPU on GradientBoostingClassifier?
user avatar
  • 165
0 votes
0 answers
286 views

Custom Object Detection on Azure Machine Learning or Databricks

I'm looking to train a custom object detection model using Tensorflow's API. Is it possible to do it in Azure ML Studio or in Databricks? Object Detection link - https://tensorflow-object-detection-...
user avatar
  • 285