Questions tagged [gpu]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
15 views

Simultaneous inference on many gpu, question

I want to do boosting for instance segmentation. Lets say I have 5 different models for this and I have 5 GPUs. WHat I want to do is to do the inference on each model on each GPU, and combine the ...
1
vote
2answers
34 views

How can I create a VM instance with GPUs on Google Cloud Platform?

How can I create a VM instance with GPUs on Google Cloud Platform? When I go to https://console.cloud.google.com/compute -> CREATE INSTANCE, I only see CPUs and no GPUs, as shown in the video below....
1
vote
1answer
44 views

How to evenly distribute data to multiple GPUs using Keras

I am using Keras=2.3.1 with Tensorflow-gpu=2.0.0 backend. While I trained model on two RTX 2080 ti 11G GPUs, it allocates all data to '/gpu:0',and nothing changed with '/gpu:1'. Surely, the second GPU ...
0
votes
0answers
14 views

What GPU size do I need to fine tune BERT base cased?

I want to fine tune BERT Multilingual but I'm not aware about the GPU requirements to train BERT Multilingual. I have GTX 1050ti 4GB on my local machine. I want to know what size of GPU is needed and ...
1
vote
3answers
245 views

How to install tensorflow-gpu?

I installed cuda-11.0 and cuDNN-8.2 and Tensor-RT 7.1. And then installed tensorflow-gpu. But tf.is_gpu_available() is showing False. Actually, I installed ...
0
votes
0answers
23 views

How to run neural network in gpu instead of cpu?

I installed cuDNN and cuda toolkit 11 in my machine. Now I installed tensorflow-gpu in pip3 of version 2.2.0. But while running neural network, cpu is being used 90% with four cores and gpu is being ...
1
vote
1answer
15 views

GPU vs TPU for convolutional neural networks (NLP)

I am testing ideas on IMDB sentiment analysis task by using word embeddings + CNN approach. What could explain a significant difference in computation time in favor of GPU (~9 seconds per epoch) ...
0
votes
0answers
38 views
3
votes
2answers
103 views

Keras OOM for data validation using GPU

I'm trying to run a deep model using GPU and seems Keras running the validation against the whole validation data set in one batch instead of validating in many batches and that's causing out of ...
0
votes
0answers
32 views

Is it true more CPU core is better for deep learning?

I just started to learn the deep learning in my free time. I was hoping to buy a laptop where I want to implement some small(alexnet) to medium(GoogleNet) networks maybe something bigger. I searched ...
1
vote
1answer
43 views

Is it true more CPU core is better for deep learning?

I just started to learn the deep learning in my free time. I was hoping to buy a laptop where I want to implement some small(alexnet) to medium(GoogleNet) networks maybe something bigger. I searched ...
1
vote
1answer
28 views

How to enable GPU on GradientBoostingClassifier?

Is there a way to enable GPU on GradientBoostingClassifier?
0
votes
0answers
28 views

Custom Object Detection on Azure Machine Learning or Databricks

I'm looking to train a custom object detection model using Tensorflow's API. Is it possible to do it in Azure ML Studio or in Databricks? Object Detection link - https://tensorflow-object-detection-...
0
votes
1answer
34 views

Deep learning : CPU vs. GPU quality

I searched for other similar questions on Google and here, but couldn't find any. I'm consistently getting results of less quality when making deep learning with GPU, compared to CPU. Of course, it is ...
0
votes
0answers
19 views

Low GPU utilisation and High GPU memory

I am training a conv net for classifying 3 classes of images of size 512,512 using Pytorch framework. I have 3 Tesla V100s(16 Gb). My GPUs utilization is really low - <10% and GPU memory is really ...
0
votes
1answer
373 views

Is it possible to train stylegan2 with a custom dataset using a graphics card that only has 6GB of VRAM (GeForce GTX 1660)?

I'm attempting to train stylegan2 using a custom dataset, but no matter what settings I use I see the same error: ...
0
votes
0answers
38 views

Tensorflow 2.0 doesnt seem to be detecting my GPU, and runnning on CPU only

Today I tried to train a tensorflow model on my laptop and realized that it was taking way too long. I checked my system's processes and realized that my CPUs were being over-worked and my GPU wasn't ...
1
vote
0answers
27 views

What is the advantages of using FPGA for deep learning- computer vision task?

I noticed some developers prefer to use FPGA like XILINX for their deep learning applications, why they prefer to use FPGA instead of GPU?! Is there any reason for that? I suppose GPUs are very ...
2
votes
0answers
25 views

Any free or affordable resources for network training?

I have a really large network that I need to train but I don't have enough computational power. I tried using Colab but colab doesn't allow multiple parallel runtimes. I'd like to use the caiver ...
0
votes
0answers
32 views

How to run list comprehensions on GPU?

Is there a way to run complex list comprehensions like the following on GPU? ...
0
votes
0answers
14 views

Deep Learning on Float-Value Time Series … How Much VRAM?

How much VRAM can you recommmend for a LSTM with about half a billion values of 32bit Floats per Feature? Every sample takes 100(in the beginning) to 10.000(later, probably still not enough) ...
0
votes
1answer
831 views

FP16, FP32 - what is it all about? or is it just Bitsize for Float-Values (Python)

What is it all about FP16, FP32 in Python? My potential Business Partner and I are building a Deep Learning Setup for working with time series. He came up with "FP16 and FP32" while finding a GPU. It ...
0
votes
1answer
25 views

How many neural networks can a GPU run simultaneously?

I am developing an application that would take feed from multiple IP cameras and run 3 different neural networks on it. I want to determine the number of such IP cameras that can I process parallelly ...
0
votes
0answers
50 views

Slow GPU While Training CNN

TL:DR: While training a small CNN on a Tesla T4, the GPU does not run any faster than about 1/3 - 2/3 of its base clock speed. The training time takes forever, and there is lots of weirdness with ...
0
votes
0answers
17 views

How to use a single GPU (vs. CPUs) in Tensorflow for forward inferencing (validation) vs. only for training

As mentioned in this question, it could be useful to harness a GPU vs. CPU(s) for validation. For example, in cross-validation, where the number of validation examples can exceed the number of ...
0
votes
1answer
27 views

Why GPU doesn't utilise System memory?

I have noticed that more often when training huge Deep Learning models on consumer GPUs (like GTX 1050ti) The network often doesn't work. The reason is that the GPU just doesn't have enough ...
0
votes
0answers
21 views

tf.keras: val accuracy on mnist dataset drops to random guess

For transfer learning purposes I changed mnist into 224x224 px dataset and applied skeletonizing algorithms. I want to train MNIST dataset on "squeezenet" like CNN, which can be found on github. The ...
1
vote
1answer
28 views

Using GPUs of other machines in the network with Keras

My situation is as follows: I have a rather cheap laptop with Ubuntu 18.04 running on it that unfortunately is not powerful enough (old, cheap GPU) to train deep learning models with. I am located in ...
2
votes
0answers
136 views

Keras multi-gpu seems to heavily load one of the cards

I'm using Keras (tf backend) to train a neural net; I'm accelerating with GPUs using the multi gpu options in Keras. For some reason, the program seems to heavily load one of the cards and the others ...
1
vote
0answers
18 views

Is it possible to use a GPU and a TPU together?

I wanted to start with deep learning, and brought a GPU for better performance. Now I have seen, that it is possible to use a TPU with Windows 10. Now I want to know wheter it is possible to use a GPU ...
0
votes
1answer
23 views

Performance gain of GPU when learning DNNs

Currently, I learn deep neural networks on my CPU (i7-6700K) using TensorFlow without AVX2 enabled. The networks need about 3 weeks to be learned. Therefore, I am searching for a (cheap) way to speed ...
1
vote
0answers
35 views

What are the downsides of using TPUs instead of GPUs when performing neural network training or inference?

What are the downsides of using TPUs instead of GPUs when performing neural network training or inference? From what I read on https://www.predictiveanalyticsworld.com/machinelearningtimes/should-you-...
1
vote
1answer
27 views

Distributed DL model with Tensorflow

Suppose I want to develop and train a big end-to-end deep learning model using Tensorflow (1.15, for legacy reasons). The objects are complex, with many types of features that can be extracted: vector ...
1
vote
1answer
360 views

Keras multi GPU in vast.ai

I am trying to run a keras model on vast.ai using multiple GPUs. For that I am using keras.utils.multi_gpu_model , however I keep having this error: ...
1
vote
1answer
36 views

Coding a Content Addressable Memory on a GPU

I´m trying to code a CAM or more simply a dictionary storing the pointer of the data accessible by a key. I try to do it with a GPU but all attempts have been inefficient compared on using System....
1
vote
0answers
85 views

fine tune BERT in a small GPU

I want to to fine tune the BERT base model but the only accelerated HW I have access to is a couple of Quadro 600 GPUs which only pack 1GB RAM and 96 CUDA cores each. My question: is it even possible ...
0
votes
0answers
19 views

Jupyter notebook memory consumption while training vs script

Anyone seeing this issue where, when you're training a model with torch on Jupyter Notebook your GPU memory utilization is more than if it was a python script? Ran the same notebook through a script ...
0
votes
0answers
111 views

Which GPU instance to opt for in Google Cloud?

I am looking to rent a GPU instance in Google Cloud for casual deep learning model training purposes and wondered about the differences between the available Nvidia Tesla versions which are Nvidia ...
0
votes
0answers
29 views

Tensorflow: how to interpret Tensorboard profile? How to increase efficiency according to it?

I use Tesla K80 for training a DNN model built with Tensorflow 2.0. I want to speed up the training. I have already used tf.data.Dataset input pipeline. I'm not using TFRecords files though. From my ...
0
votes
0answers
229 views

How to calculate the memory usage of a deep LSTM network?

I was trying to estimate the memory usage for my LSTM network by referring to an examples of CNN memory usage calculation at http://cs231n.github.io/convolutional-networks/#computational-...
0
votes
1answer
139 views

Tensorflow MirroredStrategy() looks like it may only be working on one GPU?

I finally got a computer with 2 gpus, and tested out https://pytorch.org/tutorials/beginner/blitz/data_parallel_tutorial.html and https://github.com/tensorflow/models/tree/master/tutorials/image/...
1
vote
1answer
5k views

Not able to connect to GPU on Google Colab

I'm trying to use tensorflow with a GPU on Google Colab. I followed the steps listed at https://www.tensorflow.org/install/gpu I confirmed that gpu is visible and CUDA is installed with the ...
0
votes
0answers
32 views

Multi-GPU: Lower performance with more workers, smaller batch size, smaller queue

I'm getting unexpected results when I'm tweaking the training parameters of my run. CNN model (~1M parameters, consecutive 2D CNN into two FC layers) Data set: 20k images from CelebA with 218x178x3 ...
4
votes
1answer
398 views

How can we reduce the GPU memory usage when the model is already small enough?

I trained a model and froze it into a PB(protocol buffer) file and a directory of some variables, and the total size is about 31M. We deployed it using a GPU card and followed this answer and set the <...
1
vote
1answer
32 views

How reproducible should CNN models be? [closed]

I want to train several CNN architectures with Google Colab (GPU), Keras and Tensorflow. Since the trained models are not reproducible due to GPU support, I would like to train the models several ...
2
votes
3answers
162 views

How to fix my high validation loss and inaccuracy

New to machine learning and tried to train my bird recognization model and found very high validation loss and inaccuracy. I'm using this dataset: http://www.vision.caltech.edu/visipedia/CUB-200-2011....
3
votes
1answer
1k views

Supported GPU for Pytorch

Question Which GPUs are supported in Pytorch and where is the information located? Background Almost all articles of Pytorch + GPU are about NVIDIA. Is NVIDIA is the only GPU that can be used by ...
-1
votes
1answer
26 views

Deploy local deep learning web app to web

So I've built a (relatively) simple web app with a deep learning image classifier, and I have it running on localhost. How do I upload this to the web so that I can link to it from my website? The ...
13
votes
2answers
14k views

How to disable GPU with TensorFlow?

Using tensorflow-gpu 2.0.0rc0. I want to choose whether it uses the GPU or the CPU.
0
votes
1answer
130 views

Speed of training decrease by adding more GPUs

I am using the distributed Tensorflow with Mirror Strategy. I am training the VGG16 based on custom Estimator. However, by increasing the number of GPUs time of training is increased. As I check, the ...