Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [gpu]

The tag has no usage guidance.

-1
votes
0answers
17 views

USE GPU with Macbook pro on NVIDIA GeForce GT 650M

I am trying to train my model with Keras in Tenserflow backend with my GPU. I tried everything, installed Cuda and also followed some instructions on the web, however couldnot get it work. ...
1
vote
0answers
13 views

How to use Kaggle Api in Google Colab for directly using dataset?

I know that we can use Kaggle's api directly in google colab which downloads the dataset. The commands are : ...
0
votes
0answers
27 views

CNN accuracy and loss doesn't change over epochs for sentiment analysis

I am performing text classification as Good [1] or Bad [0]. The texts are preprocessed and converted to Vectors using Google Word2Vec. Further CNN architecture is used for training. I have roughly ...
0
votes
0answers
13 views

How to set 2 GPU in Mask RCNN? TypeError: __init__() missing 2 required positional arguments: 'inputs' and 'outputs'

I found this: 'https://github.com/matterport/Mask_RCNN/issues/511' pip install keras==2.1.3 - done. change code in parallel_model - done. ...
1
vote
1answer
41 views

Is the PNY NVIDIA Quadro RTX 4000 a good GPU for Machine Learning on Linux?

As a web developer, I am growing increasingly interested in data science/machine learning, enough that I have decided to build a lab at home. I have discovered the Quadro RTX 4000, and am wondering ...
1
vote
0answers
45 views

Training model in Keras(TF backend) with GPU

I want to train my custom dataset for licence plate detection. I have 2000 image for this. First, I trained my labelling dataset in Keras (TF backend) with CPU. optimizer : Adam, learning rate : 0....
1
vote
1answer
36 views

What kind of algorithm should I choose for this music classification system?

I have in mind a program for analyzing short fragments of music, categorizing them as "good" or "bad". This would be part of a larger program that searches for larger good phrases and whole pieces. ...
2
votes
1answer
21 views

How can I monitor the usage of NVLink connections?

If I'm running a Keras model on some Nvidia GPUs which are connected via NVLink, how can I monitor the usage of the NVLink connections? I want to be sure the NVLink connections are being used and see ...
1
vote
1answer
16 views

error: Command 'nvcc' not found, but can be installed with: after installing CUDA Toolkit 10.0

I have installed cuda10.0.I followed the procedure provided by this link but when I type the command nvcc --version it says nvcc is not installed! "Command 'nvcc' not found, but can be installed with:...
2
votes
1answer
67 views

Using CPU after training in GPU

I am using tensorflow-gpu 1.10.0 and keras-gpu 2.2.4 with a Nvidia gtx765M(2GB) GPU, OS is Win8.1-64 bit- 16GB RAM. I can train a network with 560x560 pix images and batch-size=1, but after training ...
1
vote
1answer
44 views

Why i get OOM error although my model is not that large?

I am a newbie in GPU based training and Deep learning models. I am running cDCGAN (Conditonal DCGAN) in tensorflow on my 2 Nvidia GTX 1080 GPU's. My data-set consists of around 32,0000 images with ...
0
votes
2answers
58 views

How to train more models on 2 GPUs with Keras?

I got 2 GPUs of type NVIDIA GTX 1070 Ti. I would like to train more models on them in such a way that half of the models are trained on one GPU only, and half on the other, at the same time. So as ...
1
vote
1answer
70 views

CUDA_ERROR_OUT_OF_MEMORY: out of memory. How to increase batch size?

I have one GPU: GTX 1050 with ~4GB memory. I try Mask RCNN with 192x192pix and batch=7. I got an error: CUDA_ERROR_OUT_OF_MEMORY: out of memory I found: https://...
0
votes
1answer
41 views

Should I connect my two GPUs with SLI or not? (for Keras + TensorFlow)

I have two GPUs, NVIDIA GTX 1070 Ti. For using Keras with TensorFlow back-end, should I connect them with SLI or not? If not, then they will be treated separately, and one model will be trained on one ...
1
vote
1answer
79 views

Two different GPUs for Keras (Python)?

One question guys, someone knows if it should be ok to get one more GPU of type Nvidia Geforce GTX 1070 (gaming version), given that now I have GTX 1070 Titanium? They don't have another Titanium card ...
2
votes
1answer
2k views

GTX 1660 Ti vs. RTX 2060 for a deep learning pc

I'm planning to build a PC for Deep Learning, after the launch of AMD Ryzen 3rd gen processors. My budget will allow me to choose between a GTX 1660 Ti and RTX 2060. I'm tabulating the specs of both ...
4
votes
1answer
43 views

CNN computing time on good CPU vs cheap GPU

I am a researcher working on my first deep learning project, which consists of using a CNN (pre-trained VGG16+2 densely connected layers) to classify drone imagery of vegetation. In trying to hack ...
1
vote
0answers
17 views

Execution time of the same algorithm for different runs

There is this ongoing discussion with me and my advisor. We have a Deep Learning algorithm (does not matter which one it is, I believe, such as CNN, LSTM etc..). We are using 4 GPU Nvidia machine ...
0
votes
1answer
23 views

Why Epochs take longer as learning proceeds?

I am training a deep learning model in Tensorflow on GPU (Amazon AWS) and what I observe is that in the beginning each epoch ...
1
vote
2answers
311 views

Spliting keras model into multiple GPU's

Dear fellow Data Scientists. I'm having a problem with splitting model into multiple GPU's. I have read something about "towering" in native tensorflow but my whole architecture is already written in ...
1
vote
0answers
69 views

get a can't set attribute while using GPU in google colab but not not while using CPU

Hi i was learning to create a classifier using pytorch in google colab that i learned in Udacity. here is the link so i was loading data in the dataloader and when i used cpu it loaded and displayed ...
6
votes
1answer
106 views

What are your thoughts on SKLearn's dismissal of GPUs for machine learning?

SKLearn has this broad claim in its FAQs: Outside of neural networks, GPUs don’t play a large role in machine learning today, and much larger gains in speed can often be achieved by a careful ...
2
votes
0answers
235 views

Using the Python Keras multi_gpu_model with LSTM / GRU to predict Timeseries data

I'm having an issue with python keras LSTM / GRU layers with multi_gpu_model for machine learning. When I use a single GPU, the predictions work correctly ...
1
vote
2answers
243 views

What's the advantage of multi-gpu training in real?

The decreasing speed of training loss is almost the same between one gpu and multi-gpu. After averaging the gradients, the only benefit from multi-gpu is that the model seems to see more data in the ...
0
votes
1answer
89 views

Powers of 2 for batch_size in model fit in deep learning

I am currently reading Deep Learning with Python by Francois Chollet the author of Keras, and in one of his definitions for Mini-batch, he explained that the power of 2 for the batch_size is due to ...
1
vote
2answers
31 views

Why is the memory of common GPUs so constrained?

Often we find that the NN training process could be highly constrained by GPU memory size, like in object detection models the training batch size could be limited to 1 or 2, which has inflicted those ...
2
votes
1answer
2k views

How to make my Neural Netwok run on GPU instead of CPU

I have installed Anaconda3 and have installed latest versions of Keras and Tensorflow. Running this command : ...
3
votes
2answers
128 views

How to use a NN architecture that is too big for GPU?

Initially posted in Stack Overflow. I would like to implement a model which is actually 2 neural networks stacked together. However the size of these 2 architecture is too big to fit in GPU at the ...
0
votes
1answer
58 views

Multiple GPU in MXNet C++

I am trying to make MXNet (C++ API) learn, with a common sample in C++, on multiple GPU. According to this MXNet forum post, we need to aggregate manually the gradients that we fetch at the ...
1
vote
1answer
34 views

How to speed up passing of images to a GPU

I am using Ubuntu 16.04 LTS installed on a 4TB HDD. I am working with a large dataset (more than 30 GB and 150,000 images). I have a single 11GB GTX 1080 Ti GPU card on my system. I am training a mask ...
0
votes
1answer
44 views

Validation loss differs on GPU vs CPU

I am consistently seeing higher validation loss when I train & evaluate a model on AWS GPU vs local CPU. I am using the exact same train/eval datasets and the exact same Tensorflow code and ...
0
votes
1answer
369 views

can't install tensorflow with gpu [closed]

I'm trying to install Tensorflow using GPU with CUDA 9.0. I have downloaded and installed CuDNN v 7.0.5. However when I want to train a model on Keras I get an issue: ...
0
votes
1answer
843 views

Multiple keras models parallel - time efficient

I am trying to load two different keras models in parallel. I tried to use the functional API model: ...
1
vote
0answers
47 views

Deep Learning in Spark Clusters vs on GPUs?

What would be a better way to perform deep learning on any given task, either using Spark Clusters or by taking advantage of GPU's multiple cores. Which would give less training time and be better ...
1
vote
0answers
108 views

Neuroevolution library/framework with GPU CUDA support

I'm looking for working library/framework allowing you to use neuroevolution algorithms like NEAT with GPU support (CUDA). Are there any working libraries? I know about AccNEAT library but I couldn't ...
0
votes
1answer
119 views

When memory errors occur with model.fit(), is it due to GPU RAM or normal RAM?

With respect to this question, https://stackoverflow.com/questions/51895278/how-to-know-when-to-use-fit-generator-in-keras-when-training-data-gets-too-big when memory errors are reported due to ...
2
votes
1answer
224 views

Is GEMM used in Tensorflow, Theano, Pytorch

I know that Caffe uses GEneral Matrix to Matrix Multiplication (GEMM) which is part of Basic Linear Algebra Subprograms (BLAS) library for performing convolution operations. Where a convolution is ...
0
votes
1answer
67 views

Running a python script with heavy memory requirements [closed]

I need to run a python script where I am loading several(~15) large modules including keras and load several (approx 20) LSTM models and large amount of data for computation. These script has several ...
1
vote
0answers
458 views

Model Parallelism not working? Inception v3 with keras and tensorflow

I have been stuck with a problem like this for a while now. I have an AWS setup with 500 GB of ram and about 7 GPUs. Now the issue is that each time I try to run my keras with tensorflow as back-end ...
0
votes
1answer
28 views

Moving from macbook (without GPU) to linux system with Titan V, only getting a 4x speedup, what am I doing wrong?

I was prototyping a network architecture out on the macbook, and after finding something I was somewhat happy with, I wanted to test it out on a big data set on a system with a Titan V as the macbook ...
2
votes
0answers
322 views

Why Tensorflow does NOT quit when CUDA_ERROR_OUT_OF_MEMORY

It was my understanding that when trying to create a tensorflow session, if the amount of available GPU memory is not enough for what the program asks for, the program should raise an error and exit. ...
1
vote
1answer
56 views

How to setup my Ubuntu PC for these Deep Learning frameworks? [closed]

I need to use both NVIDIA Digits and tensorflow Object Detection API for different deep learning purposes. I am a bit lost with the compatibility issues, especially for what concerns CUDA. So which ...
0
votes
0answers
179 views

What should be the value of parallel iterations in tensorflow RNN implementations?

tf.nn.dynamic_rnn() and tf.nn.raw_rnn() take in an argument called parallel_iterations. The documentation says: ...
2
votes
0answers
228 views

GPU Processing in R (using openCL)

I am trying to estimate a parameter by repeated sampling (Monte Carlo simulation). Each time I sample, I have to run a particular operation on a data.table object. ...
2
votes
0answers
225 views

External GPU vs. internal GPU for machine learning

What are the pros/cons of using external GPUs (e.g., connected through thunderbolt) vs. internal GPUs for machine learning?
3
votes
2answers
513 views

Accelerate deep learning model training on several GPUs

I have a deep learning model that can be trained in one GPU, however, is very slow. Is there a way to accelerate the training by parallelizing it across several GPUs? How would be the training process?...
23
votes
3answers
21k views

Multi GPU in keras

How you can program keras library (or tensorflow) to partitionate training on multiple GPU, let's say you are in an amaozn ec2 instance that has 8 GPU's and you want to use all of them to train faster,...
7
votes
3answers
7k views

Should I use GPU or CPU for inference?

I'm running a deep learning neural network that has been trained by a GPU. I now want to deploy this to multiple hosts for inference. The question is what are the conditions to decide whether I should ...
1
vote
0answers
503 views

Trying to use GPU of laptop for TensorFlow [closed]

I have an HP au111tx laptop with Nvidia 940mx graphics card. Is it possible for me to use this graphics card exclusively for ML. I want to use the integrated graphics card for normal display. I can ...
3
votes
1answer
6k views

What is the difference between Pytorch's DataParallel and DistributedDataParallel?

I am going through this imagenet example. And, in line 88, the module DistributedDataParallel is used. When I searched for the same in the docs, I haven’t found anything. However, I found the ...