Questions tagged [gpu]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
14 views

How to calculate the memory usage of a deep LSTM network?

I was trying to estimate the memory usage for my LSTM network by referring to an examples of CNN memory usage calculation at http://cs231n.github.io/convolutional-networks/#computational-...
0
votes
0answers
6 views

Tensorflow MirroredStrategy() looks like it may only be working on one GPU?

I finally got a computer with 2 gpus, and tested out https://pytorch.org/tutorials/beginner/blitz/data_parallel_tutorial.html and https://github.com/tensorflow/models/tree/master/tutorials/image/...
1
vote
1answer
32 views

Not able to connect to GPU on Google Colab

I'm trying to use tensorflow with a GPU on Google Colab. I followed the steps listed at https://www.tensorflow.org/install/gpu I confirmed that gpu is visible and CUDA is installed with the ...
0
votes
0answers
8 views

Multi-GPU: Lower performance with more workers, smaller batch size, smaller queue

I'm getting unexpected results when I'm tweaking the training parameters of my run. CNN model (~1M parameters, consecutive 2D CNN into two FC layers) Data set: 20k images from CelebA with 218x178x3 ...
2
votes
1answer
45 views

How can we reduce the GPU memory usage when the model is already small enough?

I trained a model and froze it into a PB(protocol buffer) file and a directory of some variables, and the total size is about 31M. We deployed it using a GPU card and followed this answer and set the <...
1
vote
1answer
26 views

How reproducible should CNN models be? [closed]

I want to train several CNN architectures with Google Colab (GPU), Keras and Tensorflow. Since the trained models are not reproducible due to GPU support, I would like to train the models several ...
2
votes
3answers
65 views

How to fix my high validation loss and inaccuracy

New to machine learning and tried to train my bird recognization model and found very high validation loss and inaccuracy. I'm using this dataset: http://www.vision.caltech.edu/visipedia/CUB-200-2011....
1
vote
1answer
22 views

Supported GPU for Pytorch

Question Which GPUs are supported in Pytorch and where is the information located? Background Almost all articles of Pytorch + GPU are about NVIDIA. Is NVIDIA is the only GPU that can be used by ...
0
votes
0answers
27 views

CNN how can i reduce gpu memory usage with large image sizes?

I am trying to train a cnn-lstm model, my sample image sizes are 640x640. I have a GTX 1080 ti 11GB. I am using Keras with tensorflow backend. Here is the model. ...
-1
votes
1answer
24 views

Deploy local deep learning web app to web

So I've built a (relatively) simple web app with a deep learning image classifier, and I have it running on localhost. How do I upload this to the web so that I can link to it from my website? The ...
0
votes
1answer
678 views

How to disable GPU with TensorFlow?

Using tensorflow-gpu 2.0.0rc0. I want to choose whether it uses the GPU or the CPU.
0
votes
1answer
37 views

Speed of training decrease by adding more GPUs

I am using the distributed Tensorflow with Mirror Strategy. I am training the VGG16 based on custom Estimator. However, by increasing the number of GPUs time of training is increased. As I check, the ...
0
votes
1answer
70 views

How to run a model in an application using gpu (without CUDA)

I am looking for a way to utilize a computer’s gpu without using cuda (or any installable software). The reason for this is I have an application where the neural network runs on a user’s computer and ...
0
votes
1answer
70 views

CUDA 8.0 is compatible with my GeForce GTX 670M Wikipedia says, but TensorFlow rises an error: GTX 670M's Compute Capability is < 3.0

According to Wikipedia, the GeForce GTX 670M has a Compute Capability of 2.1 (and a Fermi micro-architecture), which is confirmed by TensorFlow (I can read "2.1" in the error it rises). Wikipedia ...
0
votes
0answers
125 views

multi gpu with axes dont match array?

If I train a model using 2 GPUs, using multi_gpu_model and the ModelCheckpoint callback to save the best, it gives this error ...
1
vote
1answer
71 views

How do you know when you are using a multi gpu?

I have 2 gpus on my local machines, but i'm not sure that the model I am training is using both of them (the speed has not changed much). My code: ...
0
votes
0answers
24 views

GPUs for non deep learning

Are GPUs actually used to scale up standard machine learning algorithms (not deep learning)?
0
votes
0answers
24 views

Hardware needed for training VGG16 from scratch

i'm working on a classification problem in which i need to classify with the highest accuracy possible 38 classes. Here is a link to the dataset: PlantVillage dataset I want to get the highest ...
1
vote
0answers
96 views

Hardware for deep learning [closed]

Disclaimer: I am very new to using stackexchange so bear with me. I am trying to gain experience using neural networks and would like to do a few projects involving them. Right now I am trying to ...
1
vote
1answer
206 views

How to use Kaggle Api in Google Colab for directly using dataset?

I know that we can use Kaggle's api directly in google colab which downloads the dataset. The commands are : ...
0
votes
1answer
82 views

CNN accuracy and loss doesn't change over epochs for sentiment analysis

I am performing text classification as Good [1] or Bad [0]. The texts are preprocessed and converted to Vectors using Google Word2Vec. Further CNN architecture is used for training. I have roughly ...
0
votes
0answers
96 views

How to set 2 GPU in Mask RCNN? TypeError: __init__() missing 2 required positional arguments: 'inputs' and 'outputs'

I found this: 'https://github.com/matterport/Mask_RCNN/issues/511' pip install keras==2.1.3 - done. change code in parallel_model - done. ...
1
vote
1answer
2k views

Is the PNY NVIDIA Quadro RTX 4000 a good GPU for Machine Learning on Linux?

As a web developer, I am growing increasingly interested in data science/machine learning, enough that I have decided to build a lab at home. I have discovered the Quadro RTX 4000, and am wondering ...
1
vote
0answers
100 views

Training model in Keras(TF backend) with GPU

I want to train my custom dataset for licence plate detection. I have 2000 image for this. First, I trained my labelling dataset in Keras (TF backend) with CPU. optimizer : Adam, learning rate : 0....
1
vote
1answer
44 views

What kind of algorithm should I choose for this music classification system?

I have in mind a program for analyzing short fragments of music, categorizing them as "good" or "bad". This would be part of a larger program that searches for larger good phrases and whole pieces. ...
2
votes
1answer
285 views

How can I monitor the usage of NVLink connections?

If I'm running a Keras model on some Nvidia GPUs which are connected via NVLink, how can I monitor the usage of the NVLink connections? I want to be sure the NVLink connections are being used and see ...
2
votes
1answer
539 views

Using CPU after training in GPU

I am using tensorflow-gpu 1.10.0 and keras-gpu 2.2.4 with a Nvidia gtx765M(2GB) GPU, OS is Win8.1-64 bit- 16GB RAM. I can train a network with 560x560 pix images and batch-size=1, but after training ...
1
vote
2answers
1k views

Why i get OOM error although my model is not that large?

I am a newbie in GPU based training and Deep learning models. I am running cDCGAN (Conditonal DCGAN) in tensorflow on my 2 Nvidia GTX 1080 GPU's. My data-set consists of around 32,0000 images with ...
0
votes
2answers
446 views

How to train more models on 2 GPUs with Keras?

I got 2 GPUs of type NVIDIA GTX 1070 Ti. I would like to train more models on them in such a way that half of the models are trained on one GPU only, and half on the other, at the same time. So as ...
1
vote
2answers
1k views

CUDA_ERROR_OUT_OF_MEMORY: out of memory. How to increase batch size?

I have one GPU: GTX 1050 with ~4GB memory. I try Mask RCNN with 192x192pix and batch=7. I got an error: CUDA_ERROR_OUT_OF_MEMORY: out of memory I found: https://...
0
votes
1answer
534 views

Should I connect my two GPUs with SLI or not? (for Keras + TensorFlow)

I have two GPUs, NVIDIA GTX 1070 Ti. For using Keras with TensorFlow back-end, should I connect them with SLI or not? If not, then they will be treated separately, and one model will be trained on one ...
1
vote
1answer
464 views

Two different GPUs for Keras (Python)?

One question guys, someone knows if it should be ok to get one more GPU of type Nvidia Geforce GTX 1070 (gaming version), given that now I have GTX 1070 Titanium? They don't have another Titanium card ...
2
votes
1answer
8k views

GTX 1660 Ti vs. RTX 2060 for a deep learning pc

I'm planning to build a PC for Deep Learning, after the launch of AMD Ryzen 3rd gen processors. My budget will allow me to choose between a GTX 1660 Ti and RTX 2060. I'm tabulating the specs of both ...
4
votes
1answer
176 views

CNN computing time on good CPU vs cheap GPU

I am a researcher working on my first deep learning project, which consists of using a CNN (pre-trained VGG16+2 densely connected layers) to classify drone imagery of vegetation. In trying to hack ...
1
vote
0answers
31 views

Execution time of the same algorithm for different runs

There is this ongoing discussion with me and my advisor. We have a Deep Learning algorithm (does not matter which one it is, I believe, such as CNN, LSTM etc..). We are using 4 GPU Nvidia machine ...
1
vote
1answer
181 views

Why Epochs take longer as learning proceeds?

I am training a deep learning model in Tensorflow on GPU (Amazon AWS) and what I observe is that in the beginning each epoch ...
2
votes
2answers
2k views

Spliting keras model into multiple GPU's

Dear fellow Data Scientists. I'm having a problem with splitting model into multiple GPU's. I have read something about "towering" in native tensorflow but my whole architecture is already written in ...
2
votes
0answers
215 views

get a can't set attribute while using GPU in google colab but not not while using CPU

Hi i was learning to create a classifier using pytorch in google colab that i learned in Udacity. here is the link so i was loading data in the dataloader and when i used cpu it loaded and displayed ...
6
votes
1answer
196 views

What are your thoughts on SKLearn's dismissal of GPUs for machine learning?

SKLearn has this broad claim in its FAQs: Outside of neural networks, GPUs don’t play a large role in machine learning today, and much larger gains in speed can often be achieved by a careful ...
2
votes
0answers
768 views

Using the Python Keras multi_gpu_model with LSTM / GRU to predict Timeseries data

I'm having an issue with python keras LSTM / GRU layers with multi_gpu_model for machine learning. When I use a single GPU, the predictions work correctly ...
2
votes
2answers
1k views

What's the advantage of multi-gpu training in real?

The decreasing speed of training loss is almost the same between one gpu and multi-gpu. After averaging the gradients, the only benefit from multi-gpu is that the model seems to see more data in the ...
1
vote
1answer
265 views

Powers of 2 for batch_size in model fit in deep learning

I am currently reading Deep Learning with Python by Francois Chollet, the author of Keras, and in one of his definitions for Mini-batch, he explains that the power of 2 for the ...
2
votes
2answers
60 views

Why is the memory of common GPUs so constrained?

Often we find that the NN training process could be highly constrained by GPU memory size, like in object detection models the training batch size could be limited to 1 or 2, which has inflicted those ...
6
votes
1answer
11k views

How to make my Neural Netwok run on GPU instead of CPU

I have installed Anaconda3 and have installed latest versions of Keras and Tensorflow. Running this command : ...
3
votes
2answers
248 views

How to use a NN architecture that is too big for GPU?

Initially posted in Stack Overflow. I would like to implement a model which is actually 2 neural networks stacked together. However the size of these 2 architecture is too big to fit in GPU at the ...
0
votes
1answer
79 views

Multiple GPU in MXNet C++

I am trying to make MXNet (C++ API) learn, with a common sample in C++, on multiple GPU. According to this MXNet forum post, we need to aggregate manually the gradients that we fetch at the ...
1
vote
1answer
38 views

How to speed up passing of images to a GPU

I am using Ubuntu 16.04 LTS installed on a 4TB HDD. I am working with a large dataset (more than 30 GB and 150,000 images). I have a single 11GB GTX 1080 Ti GPU card on my system. I am training a mask ...
0
votes
1answer
85 views

Validation loss differs on GPU vs CPU

I am consistently seeing higher validation loss when I train & evaluate a model on AWS GPU vs local CPU. I am using the exact same train/eval datasets and the exact same Tensorflow code and ...
0
votes
1answer
441 views

can't install tensorflow with gpu [closed]

I'm trying to install Tensorflow using GPU with CUDA 9.0. I have downloaded and installed CuDNN v 7.0.5. However when I want to train a model on Keras I get an issue: ...
0
votes
1answer
2k views

Multiple keras models parallel - time efficient

I am trying to load two different keras models in parallel. I tried to use the functional API model: ...