Questions tagged [gpu]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
4 views

How do I force my neural network to train on GPU instead of CPU? [closed]

My neural network algorithms have been running on CPU instead of GPU. I have checked online for answers and I was fortunate to get some here. However, the script on this webpage did not run on my ...
0
votes
1answer
16 views

Why GPU doesn't utilise System memory?

I have noticed that more often when training huge Deep Learning models on consumer GPUs (like GTX 1050ti) The network often doesn't work. The reason is that the GPU just doesn't have enough ...
0
votes
0answers
18 views

tf.keras: val accuracy on mnist dataset drops to random guess

For transfer learning purposes I changed mnist into 224x224 px dataset and applied skeletonizing algorithms. I want to train MNIST dataset on "squeezenet" like CNN, which can be found on github. The ...
1
vote
1answer
19 views

Using GPUs of other machines in the network with Keras

My situation is as follows: I have a rather cheap laptop with Ubuntu 18.04 running on it that unfortunately is not powerful enough (old, cheap GPU) to train deep learning models with. I am located in ...
1
vote
0answers
32 views

Keras multi-gpu seems to heavily load one of the cards

I'm using Keras (tf backend) to train a neural net; I'm accelerating with GPUs using the multi gpu options in Keras. For some reason, the program seems to heavily load one of the cards and the others ...
1
vote
0answers
16 views

Is it possible to use a GPU and a TPU together?

I wanted to start with deep learning, and brought a GPU for better performance. Now I have seen, that it is possible to use a TPU with Windows 10. Now I want to know wheter it is possible to use a GPU ...
0
votes
1answer
18 views

Performance gain of GPU when learning DNNs

Currently, I learn deep neural networks on my CPU (i7-6700K) using TensorFlow without AVX2 enabled. The networks need about 3 weeks to be learned. Therefore, I am searching for a (cheap) way to speed ...
0
votes
0answers
17 views

What are the downsides of using TPUs instead of GPUs when performing neural network training or inference?

What are the downsides of using TPUs instead of GPUs when performing neural network training or inference? From what I read on https://www.predictiveanalyticsworld.com/machinelearningtimes/should-you-...
1
vote
1answer
21 views

Distributed DL model with Tensorflow

Suppose I want to develop and train a big end-to-end deep learning model using Tensorflow (1.15, for legacy reasons). The objects are complex, with many types of features that can be extracted: vector ...
1
vote
1answer
194 views

Keras multi GPU in vast.ai

I am trying to run a keras model on vast.ai using multiple GPUs. For that I am using keras.utils.multi_gpu_model , however I keep having this error: ...
1
vote
1answer
23 views

Coding a Content Addressable Memory on a GPU

I´m trying to code a CAM or more simply a dictionary storing the pointer of the data accessible by a key. I try to do it with a GPU but all attempts have been inefficient compared on using System....
1
vote
0answers
61 views

fine tune BERT in a small GPU

I want to to fine tune the BERT base model but the only accelerated HW I have access to is a couple of Quadro 600 GPUs which only pack 1GB RAM and 96 CUDA cores each. My question: is it even possible ...
0
votes
0answers
10 views

Jupyter notebook memory consumption while training vs script

Anyone seeing this issue where, when you're training a model with torch on Jupyter Notebook your GPU memory utilization is more than if it was a python script? Ran the same notebook through a script ...
0
votes
0answers
38 views

Which GPU instance to opt for in Google Cloud?

I am looking to rent a GPU instance in Google Cloud for casual deep learning model training purposes and wondered about the differences between the available Nvidia Tesla versions which are Nvidia ...
0
votes
0answers
17 views

Tensorflow: how to interpret Tensorboard profile? How to increase efficiency according to it?

I use Tesla K80 for training a DNN model built with Tensorflow 2.0. I want to speed up the training. I have already used tf.data.Dataset input pipeline. I'm not using TFRecords files though. From my ...
0
votes
0answers
53 views

How to calculate the memory usage of a deep LSTM network?

I was trying to estimate the memory usage for my LSTM network by referring to an examples of CNN memory usage calculation at http://cs231n.github.io/convolutional-networks/#computational-...
0
votes
0answers
86 views

Tensorflow MirroredStrategy() looks like it may only be working on one GPU?

I finally got a computer with 2 gpus, and tested out https://pytorch.org/tutorials/beginner/blitz/data_parallel_tutorial.html and https://github.com/tensorflow/models/tree/master/tutorials/image/...
1
vote
1answer
480 views

Not able to connect to GPU on Google Colab

I'm trying to use tensorflow with a GPU on Google Colab. I followed the steps listed at https://www.tensorflow.org/install/gpu I confirmed that gpu is visible and CUDA is installed with the ...
0
votes
0answers
18 views

Multi-GPU: Lower performance with more workers, smaller batch size, smaller queue

I'm getting unexpected results when I'm tweaking the training parameters of my run. CNN model (~1M parameters, consecutive 2D CNN into two FC layers) Data set: 20k images from CelebA with 218x178x3 ...
2
votes
1answer
148 views

How can we reduce the GPU memory usage when the model is already small enough?

I trained a model and froze it into a PB(protocol buffer) file and a directory of some variables, and the total size is about 31M. We deployed it using a GPU card and followed this answer and set the <...
1
vote
1answer
29 views

How reproducible should CNN models be? [closed]

I want to train several CNN architectures with Google Colab (GPU), Keras and Tensorflow. Since the trained models are not reproducible due to GPU support, I would like to train the models several ...
2
votes
3answers
89 views

How to fix my high validation loss and inaccuracy

New to machine learning and tried to train my bird recognization model and found very high validation loss and inaccuracy. I'm using this dataset: http://www.vision.caltech.edu/visipedia/CUB-200-2011....
1
vote
1answer
300 views

Supported GPU for Pytorch

Question Which GPUs are supported in Pytorch and where is the information located? Background Almost all articles of Pytorch + GPU are about NVIDIA. Is NVIDIA is the only GPU that can be used by ...
0
votes
0answers
40 views

CNN how can i reduce gpu memory usage with large image sizes?

I am trying to train a cnn-lstm model, my sample image sizes are 640x640. I have a GTX 1080 ti 11GB. I am using Keras with tensorflow backend. Here is the model. ...
-1
votes
1answer
24 views

Deploy local deep learning web app to web

So I've built a (relatively) simple web app with a deep learning image classifier, and I have it running on localhost. How do I upload this to the web so that I can link to it from my website? The ...
3
votes
1answer
5k views

How to disable GPU with TensorFlow?

Using tensorflow-gpu 2.0.0rc0. I want to choose whether it uses the GPU or the CPU.
0
votes
1answer
85 views

Speed of training decrease by adding more GPUs

I am using the distributed Tensorflow with Mirror Strategy. I am training the VGG16 based on custom Estimator. However, by increasing the number of GPUs time of training is increased. As I check, the ...
0
votes
1answer
226 views

How to run a model in an application using gpu (without CUDA)

I am looking for a way to utilize a computer’s gpu without using cuda (or any installable software). The reason for this is I have an application where the neural network runs on a user’s computer and ...
0
votes
1answer
203 views

CUDA 8.0 is compatible with my GeForce GTX 670M Wikipedia says, but TensorFlow rises an error: GTX 670M's Compute Capability is < 3.0

According to Wikipedia, the GeForce GTX 670M has a Compute Capability of 2.1 (and a Fermi micro-architecture), which is confirmed by TensorFlow (I can read "2.1" in the error it rises). Wikipedia ...
0
votes
0answers
253 views

multi gpu with axes dont match array?

If I train a model using 2 GPUs, using multi_gpu_model and the ModelCheckpoint callback to save the best, it gives this error ...
1
vote
1answer
89 views

How do you know when you are using a multi gpu?

I have 2 gpus on my local machines, but i'm not sure that the model I am training is using both of them (the speed has not changed much). My code: ...
0
votes
0answers
28 views

GPUs for non deep learning

Are GPUs actually used to scale up standard machine learning algorithms (not deep learning)?
0
votes
0answers
51 views

Hardware needed for training VGG16 from scratch

i'm working on a classification problem in which i need to classify with the highest accuracy possible 38 classes. Here is a link to the dataset: PlantVillage dataset I want to get the highest ...
1
vote
0answers
104 views

Hardware for deep learning [closed]

Disclaimer: I am very new to using stackexchange so bear with me. I am trying to gain experience using neural networks and would like to do a few projects involving them. Right now I am trying to ...
1
vote
1answer
294 views

How to use Kaggle Api in Google Colab for directly using dataset?

I know that we can use Kaggle's api directly in google colab which downloads the dataset. The commands are : ...
0
votes
1answer
99 views

CNN accuracy and loss doesn't change over epochs for sentiment analysis

I am performing text classification as Good [1] or Bad [0]. The texts are preprocessed and converted to Vectors using Google Word2Vec. Further CNN architecture is used for training. I have roughly ...
0
votes
0answers
127 views

How to set 2 GPU in Mask RCNN? TypeError: __init__() missing 2 required positional arguments: 'inputs' and 'outputs'

I found this: 'https://github.com/matterport/Mask_RCNN/issues/511' pip install keras==2.1.3 - done. change code in parallel_model - done. ...
1
vote
1answer
3k views

Is the PNY NVIDIA Quadro RTX 4000 a good GPU for Machine Learning on Linux?

As a web developer, I am growing increasingly interested in data science/machine learning, enough that I have decided to build a lab at home. I have discovered the Quadro RTX 4000, and am wondering ...
1
vote
0answers
104 views

Training model in Keras(TF backend) with GPU

I want to train my custom dataset for licence plate detection. I have 2000 image for this. First, I trained my labelling dataset in Keras (TF backend) with CPU. optimizer : Adam, learning rate : 0....
1
vote
1answer
44 views

What kind of algorithm should I choose for this music classification system?

I have in mind a program for analyzing short fragments of music, categorizing them as "good" or "bad". This would be part of a larger program that searches for larger good phrases and whole pieces. ...
2
votes
1answer
517 views

How can I monitor the usage of NVLink connections?

If I'm running a Keras model on some Nvidia GPUs which are connected via NVLink, how can I monitor the usage of the NVLink connections? I want to be sure the NVLink connections are being used and see ...
2
votes
1answer
746 views

Using CPU after training in GPU

I am using tensorflow-gpu 1.10.0 and keras-gpu 2.2.4 with a Nvidia gtx765M(2GB) GPU, OS is Win8.1-64 bit- 16GB RAM. I can train a network with 560x560 pix images and batch-size=1, but after training ...
2
votes
2answers
3k views

Why i get OOM error although my model is not that large?

I am a newbie in GPU based training and Deep learning models. I am running cDCGAN (Conditonal DCGAN) in tensorflow on my 2 Nvidia GTX 1080 GPU's. My data-set consists of around 32,0000 images with ...
0
votes
2answers
544 views

How to train more models on 2 GPUs with Keras?

I got 2 GPUs of type NVIDIA GTX 1070 Ti. I would like to train more models on them in such a way that half of the models are trained on one GPU only, and half on the other, at the same time. So as ...
1
vote
2answers
3k views

CUDA_ERROR_OUT_OF_MEMORY: out of memory. How to increase batch size?

I have one GPU: GTX 1050 with ~4GB memory. I try Mask RCNN with 192x192pix and batch=7. I got an error: CUDA_ERROR_OUT_OF_MEMORY: out of memory I found: https://...
0
votes
1answer
1k views

Should I connect my two GPUs with SLI or not? (for Keras + TensorFlow)

I have two GPUs, NVIDIA GTX 1070 Ti. For using Keras with TensorFlow back-end, should I connect them with SLI or not? If not, then they will be treated separately, and one model will be trained on one ...
1
vote
1answer
637 views

Two different GPUs for Keras (Python)?

One question guys, someone knows if it should be ok to get one more GPU of type Nvidia Geforce GTX 1070 (gaming version), given that now I have GTX 1070 Titanium? They don't have another Titanium card ...
3
votes
1answer
11k views

GTX 1660 Ti vs. RTX 2060 for a deep learning pc

I'm planning to build a PC for Deep Learning, after the launch of AMD Ryzen 3rd gen processors. My budget will allow me to choose between a GTX 1660 Ti and RTX 2060. I'm tabulating the specs of both ...
4
votes
1answer
302 views

CNN computing time on good CPU vs cheap GPU

I am a researcher working on my first deep learning project, which consists of using a CNN (pre-trained VGG16+2 densely connected layers) to classify drone imagery of vegetation. In trying to hack ...
1
vote
0answers
34 views

Execution time of the same algorithm for different runs

There is this ongoing discussion with me and my advisor. We have a Deep Learning algorithm (does not matter which one it is, I believe, such as CNN, LSTM etc..). We are using 4 GPU Nvidia machine ...