Questions tagged [gpu]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
0answers
11 views

Coding a Content Addressable Memory on a GPU

I´m trying to code a CAM or more simply a dictionary storing the pointer of the data accessible by a key. I try to do it with a GPU but all attempts have been inefficient compared on using System....
1
vote
0answers
29 views

fine tune BERT in a small GPU

I want to to fine tune the BERT base model but the only accelerated HW I have access to is a couple of Quadro 600 GPUs which only pack 1GB RAM and 96 CUDA cores each. My question: is it even possible ...
0
votes
0answers
9 views

Jupyter notebook memory consumption while training vs script

Anyone seeing this issue where, when you're training a model with torch on Jupyter Notebook your GPU memory utilization is more than if it was a python script? Ran the same notebook through a script ...
0
votes
0answers
19 views

Which GPU instance to opt for in Google Cloud?

I am looking to rent a GPU instance in Google Cloud for casual deep learning model training purposes and wondered about the differences between the available Nvidia Tesla versions which are Nvidia ...
0
votes
0answers
15 views

Tensorflow: how to interpret Tensorboard profile? How to increase efficiency according to it?

I use Tesla K80 for training a DNN model built with Tensorflow 2.0. I want to speed up the training. I have already used tf.data.Dataset input pipeline. I'm not using TFRecords files though. From my ...
0
votes
0answers
22 views

How to calculate the memory usage of a deep LSTM network?

I was trying to estimate the memory usage for my LSTM network by referring to an examples of CNN memory usage calculation at http://cs231n.github.io/convolutional-networks/#computational-...
0
votes
0answers
29 views

Tensorflow MirroredStrategy() looks like it may only be working on one GPU?

I finally got a computer with 2 gpus, and tested out https://pytorch.org/tutorials/beginner/blitz/data_parallel_tutorial.html and https://github.com/tensorflow/models/tree/master/tutorials/image/...
1
vote
1answer
119 views

Not able to connect to GPU on Google Colab

I'm trying to use tensorflow with a GPU on Google Colab. I followed the steps listed at https://www.tensorflow.org/install/gpu I confirmed that gpu is visible and CUDA is installed with the ...
0
votes
0answers
14 views

Multi-GPU: Lower performance with more workers, smaller batch size, smaller queue

I'm getting unexpected results when I'm tweaking the training parameters of my run. CNN model (~1M parameters, consecutive 2D CNN into two FC layers) Data set: 20k images from CelebA with 218x178x3 ...
2
votes
1answer
56 views

How can we reduce the GPU memory usage when the model is already small enough?

I trained a model and froze it into a PB(protocol buffer) file and a directory of some variables, and the total size is about 31M. We deployed it using a GPU card and followed this answer and set the <...
1
vote
1answer
28 views

How reproducible should CNN models be? [closed]

I want to train several CNN architectures with Google Colab (GPU), Keras and Tensorflow. Since the trained models are not reproducible due to GPU support, I would like to train the models several ...
2
votes
3answers
70 views

How to fix my high validation loss and inaccuracy

New to machine learning and tried to train my bird recognization model and found very high validation loss and inaccuracy. I'm using this dataset: http://www.vision.caltech.edu/visipedia/CUB-200-2011....
1
vote
1answer
57 views

Supported GPU for Pytorch

Question Which GPUs are supported in Pytorch and where is the information located? Background Almost all articles of Pytorch + GPU are about NVIDIA. Is NVIDIA is the only GPU that can be used by ...
0
votes
0answers
35 views

CNN how can i reduce gpu memory usage with large image sizes?

I am trying to train a cnn-lstm model, my sample image sizes are 640x640. I have a GTX 1080 ti 11GB. I am using Keras with tensorflow backend. Here is the model. ...
-1
votes
1answer
24 views

Deploy local deep learning web app to web

So I've built a (relatively) simple web app with a deep learning image classifier, and I have it running on localhost. How do I upload this to the web so that I can link to it from my website? The ...
0
votes
1answer
2k views

How to disable GPU with TensorFlow?

Using tensorflow-gpu 2.0.0rc0. I want to choose whether it uses the GPU or the CPU.
0
votes
1answer
54 views

Speed of training decrease by adding more GPUs

I am using the distributed Tensorflow with Mirror Strategy. I am training the VGG16 based on custom Estimator. However, by increasing the number of GPUs time of training is increased. As I check, the ...
0
votes
1answer
121 views

How to run a model in an application using gpu (without CUDA)

I am looking for a way to utilize a computer’s gpu without using cuda (or any installable software). The reason for this is I have an application where the neural network runs on a user’s computer and ...
0
votes
1answer
130 views

CUDA 8.0 is compatible with my GeForce GTX 670M Wikipedia says, but TensorFlow rises an error: GTX 670M's Compute Capability is < 3.0

According to Wikipedia, the GeForce GTX 670M has a Compute Capability of 2.1 (and a Fermi micro-architecture), which is confirmed by TensorFlow (I can read "2.1" in the error it rises). Wikipedia ...
0
votes
0answers
176 views

multi gpu with axes dont match array?

If I train a model using 2 GPUs, using multi_gpu_model and the ModelCheckpoint callback to save the best, it gives this error ...
1
vote
1answer
74 views

How do you know when you are using a multi gpu?

I have 2 gpus on my local machines, but i'm not sure that the model I am training is using both of them (the speed has not changed much). My code: ...
0
votes
0answers
25 views

GPUs for non deep learning

Are GPUs actually used to scale up standard machine learning algorithms (not deep learning)?
0
votes
0answers
37 views

Hardware needed for training VGG16 from scratch

i'm working on a classification problem in which i need to classify with the highest accuracy possible 38 classes. Here is a link to the dataset: PlantVillage dataset I want to get the highest ...
1
vote
0answers
100 views

Hardware for deep learning [closed]

Disclaimer: I am very new to using stackexchange so bear with me. I am trying to gain experience using neural networks and would like to do a few projects involving them. Right now I am trying to ...
1
vote
1answer
238 views

How to use Kaggle Api in Google Colab for directly using dataset?

I know that we can use Kaggle's api directly in google colab which downloads the dataset. The commands are : ...
0
votes
1answer
88 views

CNN accuracy and loss doesn't change over epochs for sentiment analysis

I am performing text classification as Good [1] or Bad [0]. The texts are preprocessed and converted to Vectors using Google Word2Vec. Further CNN architecture is used for training. I have roughly ...
0
votes
0answers
110 views

How to set 2 GPU in Mask RCNN? TypeError: __init__() missing 2 required positional arguments: 'inputs' and 'outputs'

I found this: 'https://github.com/matterport/Mask_RCNN/issues/511' pip install keras==2.1.3 - done. change code in parallel_model - done. ...
1
vote
1answer
2k views

Is the PNY NVIDIA Quadro RTX 4000 a good GPU for Machine Learning on Linux?

As a web developer, I am growing increasingly interested in data science/machine learning, enough that I have decided to build a lab at home. I have discovered the Quadro RTX 4000, and am wondering ...
1
vote
0answers
102 views

Training model in Keras(TF backend) with GPU

I want to train my custom dataset for licence plate detection. I have 2000 image for this. First, I trained my labelling dataset in Keras (TF backend) with CPU. optimizer : Adam, learning rate : 0....
1
vote
1answer
44 views

What kind of algorithm should I choose for this music classification system?

I have in mind a program for analyzing short fragments of music, categorizing them as "good" or "bad". This would be part of a larger program that searches for larger good phrases and whole pieces. ...
2
votes
1answer
362 views

How can I monitor the usage of NVLink connections?

If I'm running a Keras model on some Nvidia GPUs which are connected via NVLink, how can I monitor the usage of the NVLink connections? I want to be sure the NVLink connections are being used and see ...
2
votes
1answer
628 views

Using CPU after training in GPU

I am using tensorflow-gpu 1.10.0 and keras-gpu 2.2.4 with a Nvidia gtx765M(2GB) GPU, OS is Win8.1-64 bit- 16GB RAM. I can train a network with 560x560 pix images and batch-size=1, but after training ...
1
vote
2answers
2k views

Why i get OOM error although my model is not that large?

I am a newbie in GPU based training and Deep learning models. I am running cDCGAN (Conditonal DCGAN) in tensorflow on my 2 Nvidia GTX 1080 GPU's. My data-set consists of around 32,0000 images with ...
0
votes
2answers
485 views

How to train more models on 2 GPUs with Keras?

I got 2 GPUs of type NVIDIA GTX 1070 Ti. I would like to train more models on them in such a way that half of the models are trained on one GPU only, and half on the other, at the same time. So as ...
1
vote
2answers
2k views

CUDA_ERROR_OUT_OF_MEMORY: out of memory. How to increase batch size?

I have one GPU: GTX 1050 with ~4GB memory. I try Mask RCNN with 192x192pix and batch=7. I got an error: CUDA_ERROR_OUT_OF_MEMORY: out of memory I found: https://...
0
votes
1answer
724 views

Should I connect my two GPUs with SLI or not? (for Keras + TensorFlow)

I have two GPUs, NVIDIA GTX 1070 Ti. For using Keras with TensorFlow back-end, should I connect them with SLI or not? If not, then they will be treated separately, and one model will be trained on one ...
1
vote
1answer
538 views

Two different GPUs for Keras (Python)?

One question guys, someone knows if it should be ok to get one more GPU of type Nvidia Geforce GTX 1070 (gaming version), given that now I have GTX 1070 Titanium? They don't have another Titanium card ...
3
votes
1answer
9k views

GTX 1660 Ti vs. RTX 2060 for a deep learning pc

I'm planning to build a PC for Deep Learning, after the launch of AMD Ryzen 3rd gen processors. My budget will allow me to choose between a GTX 1660 Ti and RTX 2060. I'm tabulating the specs of both ...
4
votes
1answer
214 views

CNN computing time on good CPU vs cheap GPU

I am a researcher working on my first deep learning project, which consists of using a CNN (pre-trained VGG16+2 densely connected layers) to classify drone imagery of vegetation. In trying to hack ...
1
vote
0answers
32 views

Execution time of the same algorithm for different runs

There is this ongoing discussion with me and my advisor. We have a Deep Learning algorithm (does not matter which one it is, I believe, such as CNN, LSTM etc..). We are using 4 GPU Nvidia machine ...
1
vote
1answer
234 views

Why Epochs take longer as learning proceeds?

I am training a deep learning model in Tensorflow on GPU (Amazon AWS) and what I observe is that in the beginning each epoch ...
2
votes
2answers
2k views

Spliting keras model into multiple GPU's

Dear fellow Data Scientists. I'm having a problem with splitting model into multiple GPU's. I have read something about "towering" in native tensorflow but my whole architecture is already written in ...
2
votes
0answers
250 views

get a can't set attribute while using GPU in google colab but not not while using CPU

Hi i was learning to create a classifier using pytorch in google colab that i learned in Udacity. here is the link so i was loading data in the dataloader and when i used cpu it loaded and displayed ...
6
votes
1answer
211 views

What are your thoughts on SKLearn's dismissal of GPUs for machine learning?

SKLearn has this broad claim in its FAQs: Outside of neural networks, GPUs don’t play a large role in machine learning today, and much larger gains in speed can often be achieved by a careful ...
3
votes
0answers
850 views

Using the Python Keras multi_gpu_model with LSTM / GRU to predict Timeseries data

I'm having an issue with python keras LSTM / GRU layers with multi_gpu_model for machine learning. When I use a single GPU, the predictions work correctly ...
2
votes
2answers
1k views

What's the advantage of multi-gpu training in real?

The decreasing speed of training loss is almost the same between one gpu and multi-gpu. After averaging the gradients, the only benefit from multi-gpu is that the model seems to see more data in the ...
1
vote
1answer
302 views

Powers of 2 for batch_size in model fit in deep learning

I am currently reading Deep Learning with Python by Francois Chollet, the author of Keras, and in one of his definitions for Mini-batch, he explains that the power of 2 for the ...
2
votes
2answers
68 views

Why is the memory of common GPUs so constrained?

Often we find that the NN training process could be highly constrained by GPU memory size, like in object detection models the training batch size could be limited to 1 or 2, which has inflicted those ...
7
votes
1answer
12k views

How to make my Neural Netwok run on GPU instead of CPU

I have installed Anaconda3 and have installed latest versions of Keras and Tensorflow. Running this command : ...
3
votes
2answers
294 views

How to use a NN architecture that is too big for GPU?

Initially posted in Stack Overflow. I would like to implement a model which is actually 2 neural networks stacked together. However the size of these 2 architecture is too big to fit in GPU at the ...