Questions tagged [gpu]

Graphics Processing Units (GPUs) within the context of Machine Learning often refer to the hardware requirements, design considerations, or level of parallelization for implementing and running various machine learning algorithms.

Filter by
Sorted by
Tagged with
1
vote
0answers
16 views

Suitable CPU with RTX3070 GPU for deep learning [closed]

I am trying to get a GPU for my deep learning research. Due to stock limitation, I can only get a RTX3070. In my lab, there's some PC/workstation whereby I can install the RTX3070. However, I wonder ...
0
votes
1answer
12 views

GPU shows 0 utilization even when tensors and model are mounted on the gpu?

I am trying to run some PyTorch scripts on a remote GPU server. While calling the script in the ubuntu terminal i start as:...
1
vote
1answer
21 views

Why the my Tensorflow code just use one GPU when I assign more than one

I am trying to run my code on a supercomputer with 8 gpus. Though, I assign 8 gpus but one of them is just occupied. I read some notes in websites and it seems that Tensorflow automatically use gpu if ...
0
votes
0answers
21 views

ImportError: DLL load failed while importing _pywrap_tfe when running exe file created by Pyinstaller

I have created the exe file of my code which uses tensorflow on gpu. It seems that building process using Pyinstaller goes fine. However, when I run the exe file in a system without GPU, I get the ...
0
votes
0answers
34 views

Tensorflow not detecting GTX 1650TI GPU

I have got a GTX 1650TI GPU and am trying to run Tensorflow using the GPU, however Tensorflow does not detect the GPU. I am using Tensorflow version 2.3.0 with cuda 10.1 and cudnn 7.6. Trying to ...
1
vote
1answer
26 views

DIGITS Docker container not picking up GPU

I am running DIGITS Docker container but for some reason it fails to recognize host's GPU: it does not report any GPUs (where I expect 1 to be reported) so in the upper right corner of the DIGITS home ...
1
vote
0answers
26 views

How to train my CNN using AMD GPU on Windows?

I only have a laptop running Windows 10 with AMD Radeon Graphics Card at my disposal right now. I am aware that this is likely to make things tougher but I need to stick with this as long as I can't ...
0
votes
0answers
16 views

What is done in practice to speed up batch computation for deep learning by standard software packages?

Something that confuses me with machine learning in practice is that when you send in a batch of examples, you are computing the value of each example independently. And then when you backprop, you ...
0
votes
1answer
16 views

How many video streams can single GPU handle for object detection

I need to detect objects from multiple video streams at realtime (or close to it, like 10 FPS). How many GPUs do I need to detect objects using YOLOv3 or MobileNet for, say, 10 video streams? Is it ...
0
votes
1answer
25 views

How to run unmodified Python program on GPU servers with scheduled GPUs?

Say I have one server with 10 GPUs. I have a python program which detects available GPU and use all of them. I have a couple of users who will run python (Machine learning or data mining) programs and ...
1
vote
0answers
18 views

Alternatives to GCP / AWS / Azure

Can anyone recommend an alternative to the big 3 cloud computing alternatives? I know they're the best but I found them overly complicated because they cater to massive enterprises. The amount of set ...
0
votes
0answers
15 views

Can the Apple M1's iGPU access the entire RAM as “video memory” when training with typical deep learning frameworks?

Can the Apple M1's iGPU access the entire RAM as "video memory" when training with typical deep learning frameworks (e.g., tensorflow_macos)? If not, what memory do they use as video memory?
0
votes
0answers
25 views

Parallel inference for 1000 different Tensorflow models using the GPU?

I have a 1000 Tensorflow models with the same architecture but having different weights each. For each of these models I would like to do inference, whereas each of the models also receives different ...
0
votes
0answers
67 views

I installed and configured CUDA and cuDNN, but still can't run my program with my GPU

The reason I ask this question in the Data Science part is mostly Data Scientists are facing with Hardware Acceleration problems. I installed CUDA and cuDNN, also made a lot of configuration to ...
0
votes
1answer
37 views

Why does my GPU immediately run out of memory when I try to run this code?

I am trying to write a neural network that will train on plays by Shakespeare and then write its own passages. I am using pytorch. For some reason, my GPU ...
0
votes
1answer
64 views

Why does GPU speed up inference?

I understand that GPU can speed up training for each batch multiple data records can be fed to the network which can be parallelized for computation. However, for inference, typically, each time the ...
2
votes
1answer
42 views

Use a GPU to speed up neural net training in R

I'm currently training a neural net model in R and am wanting to use a GPU to speed up this process. I've looked into this but it appears that this is unavailable to Mac users as Apple no longer uses ...
-1
votes
1answer
27 views

How much GPUs are needed for Image ehancement? [closed]

I'm looking for a GPU to train my model. Most of the papers that I have followed used 2 or more gtx 1050ti card or higher. (MIRNet, EnlightenGAN) I need to that how much GPU power will it take to ...
2
votes
1answer
2k views

CUDA compatibility of GTX 1650ti versus 1650

I am confused about CUDA compatibility. I am studying deep learning and looking for a laptop to buy. One laptop has GTX 1650ti and another has GTX 1650. Will both be able to use GPU for model training,...
0
votes
0answers
22 views

Simultaneous inference on many gpu, question

I want to do boosting for instance segmentation. Lets say I have 5 different models for this and I have 5 GPUs. WHat I want to do is to do the inference on each model on each GPU, and combine the ...
1
vote
2answers
40 views

How can I create a VM instance with GPUs on Google Cloud Platform?

How can I create a VM instance with GPUs on Google Cloud Platform? When I go to https://console.cloud.google.com/compute -> CREATE INSTANCE, I only see CPUs and no GPUs, as shown in the video below....
1
vote
1answer
71 views

How to evenly distribute data to multiple GPUs using Keras

I am using Keras=2.3.1 with Tensorflow-gpu=2.0.0 backend. While I trained model on two RTX 2080 ti 11G GPUs, it allocates all data to '/gpu:0',and nothing changed with '/gpu:1'. Surely, the second GPU ...
2
votes
1answer
837 views

What GPU size do I need to fine tune BERT base cased?

I want to fine tune BERT Multilingual but I'm not aware about the GPU requirements to train BERT Multilingual. I have GTX 1050ti 4GB on my local machine. I want to know what size of GPU is needed and ...
2
votes
3answers
1k views

How to install tensorflow-gpu?

I installed cuda-11.0 and cuDNN-8.2 and Tensor-RT 7.1. And then installed tensorflow-gpu. But tf.is_gpu_available() is showing False. Actually, I installed ...
0
votes
0answers
57 views

How to run neural network in gpu instead of cpu?

I installed cuDNN and cuda toolkit 11 in my machine. Now I installed tensorflow-gpu in pip3 of version 2.2.0. But while running neural network, cpu is being used 90% with four cores and gpu is being ...
1
vote
1answer
60 views

GPU vs TPU for convolutional neural networks (NLP)

I am testing ideas on IMDB sentiment analysis task by using word embeddings + CNN approach. What could explain a significant difference in computation time in favor of GPU (~9 seconds per epoch) ...
0
votes
0answers
162 views
3
votes
2answers
496 views

Keras OOM for data validation using GPU

I'm trying to run a deep model using GPU and seems Keras running the validation against the whole validation data set in one batch instead of validating in many batches and that's causing out of ...
0
votes
0answers
45 views

Is it true more CPU core is better for deep learning?

I just started to learn the deep learning in my free time. I was hoping to buy a laptop where I want to implement some small(alexnet) to medium(GoogleNet) networks maybe something bigger. I searched ...
1
vote
1answer
163 views

Is it true more CPU core is better for deep learning?

I just started to learn the deep learning in my free time. I was hoping to buy a laptop where I want to implement some small(alexnet) to medium(GoogleNet) networks maybe something bigger. I searched ...
1
vote
1answer
159 views

How to enable GPU on GradientBoostingClassifier?

Is there a way to enable GPU on GradientBoostingClassifier?
0
votes
0answers
133 views

Custom Object Detection on Azure Machine Learning or Databricks

I'm looking to train a custom object detection model using Tensorflow's API. Is it possible to do it in Azure ML Studio or in Databricks? Object Detection link - https://tensorflow-object-detection-...
0
votes
1answer
62 views

Deep learning : CPU vs. GPU quality

I searched for other similar questions on Google and here, but couldn't find any. I'm consistently getting results of less quality when making deep learning with GPU, compared to CPU. Of course, it is ...
0
votes
0answers
91 views

Low GPU utilisation and High GPU memory

I am training a conv net for classifying 3 classes of images of size 512,512 using Pytorch framework. I have 3 Tesla V100s(16 Gb). My GPUs utilization is really low - <10% and GPU memory is really ...
0
votes
1answer
1k views

Is it possible to train stylegan2 with a custom dataset using a graphics card that only has 6GB of VRAM (GeForce GTX 1660)?

I'm attempting to train stylegan2 using a custom dataset, but no matter what settings I use I see the same error: ...
0
votes
0answers
73 views

Tensorflow 2.0 doesnt seem to be detecting my GPU, and runnning on CPU only

Today I tried to train a tensorflow model on my laptop and realized that it was taking way too long. I checked my system's processes and realized that my CPUs were being over-worked and my GPU wasn't ...
2
votes
0answers
25 views

Any free or affordable resources for network training?

I have a really large network that I need to train but I don't have enough computational power. I tried using Colab but colab doesn't allow multiple parallel runtimes. I'd like to use the caiver ...
0
votes
1answer
111 views

How to run list comprehensions on GPU?

Is there a way to run complex list comprehensions like the following on GPU? ...
0
votes
0answers
31 views

Deep Learning on Float-Value Time Series … How Much VRAM?

How much VRAM can you recommmend for a LSTM with about half a billion values of 32bit Floats per Feature? Every sample takes 100(in the beginning) to 10.000(later, probably still not enough) ...
1
vote
1answer
3k views

FP16, FP32 - what is it all about? or is it just Bitsize for Float-Values (Python)

What is it all about FP16, FP32 in Python? My potential Business Partner and I are building a Deep Learning Setup for working with time series. He came up with "FP16 and FP32" while finding a GPU. It ...
0
votes
1answer
45 views

How many neural networks can a GPU run simultaneously?

I am developing an application that would take feed from multiple IP cameras and run 3 different neural networks on it. I want to determine the number of such IP cameras that can I process parallelly ...
0
votes
0answers
168 views

Slow GPU While Training CNN

TL:DR: While training a small CNN on a Tesla T4, the GPU does not run any faster than about 1/3 - 2/3 of its base clock speed. The training time takes forever, and there is lots of weirdness with ...
1
vote
0answers
24 views

How to use a single GPU (vs. CPUs) in Tensorflow for forward inferencing (validation) vs. only for training

As mentioned in this question, it could be useful to harness a GPU vs. CPU(s) for validation. For example, in cross-validation, where the number of validation examples can exceed the number of ...
0
votes
1answer
38 views

Why GPU doesn't utilise System memory?

I have noticed that more often when training huge Deep Learning models on consumer GPUs (like GTX 1050ti) The network often doesn't work. The reason is that the GPU just doesn't have enough ...
1
vote
0answers
28 views

tf.keras: val accuracy on mnist dataset drops to random guess

For transfer learning purposes I changed mnist into 224x224 px dataset and applied skeletonizing algorithms. I want to train MNIST dataset on "squeezenet" like CNN, which can be found on github. The ...
1
vote
1answer
93 views

Using GPUs of other machines in the network with Keras

My situation is as follows: I have a rather cheap laptop with Ubuntu 18.04 running on it that unfortunately is not powerful enough (old, cheap GPU) to train deep learning models with. I am located in ...
2
votes
0answers
222 views

Keras multi-gpu seems to heavily load one of the cards

I'm using Keras (tf backend) to train a neural net; I'm accelerating with GPUs using the multi gpu options in Keras. For some reason, the program seems to heavily load one of the cards and the others ...
0
votes
1answer
26 views

Performance gain of GPU when learning DNNs

Currently, I learn deep neural networks on my CPU (i7-6700K) using TensorFlow without AVX2 enabled. The networks need about 3 weeks to be learned. Therefore, I am searching for a (cheap) way to speed ...
1
vote
0answers
42 views

What are the downsides of using TPUs instead of GPUs when performing neural network training or inference?

What are the downsides of using TPUs instead of GPUs when performing neural network training or inference? From what I read on https://www.predictiveanalyticsworld.com/machinelearningtimes/should-you-...
1
vote
1answer
33 views

Distributed DL model with Tensorflow

Suppose I want to develop and train a big end-to-end deep learning model using Tensorflow (1.15, for legacy reasons). The objects are complex, with many types of features that can be extracted: vector ...