Questions tagged [memory]
The memory tag has no usage guidance.
22
questions
0
votes
1
answer
29
views
Python version and performance in ML
I couldn't find any answer on that question, but does Python version really matter when you implement different ML models (like catboost or xgboost) or NN (like pytorch). I do know that these models ...
-1
votes
2
answers
142
views
Laptop for machine learning jobs
I am buying a new laptop for data science and web development jobs.
Which combination is better:
i9 (12900H) & NVIDIA T600 4GB
or i7 (12800H) & NVIDIA RTX1000A 4GB?
Both run on a DELL ...
- 1
2
votes
2
answers
284
views
Which desktop hardware is best for DL?
I will be building my home Deep Learning workstation. Right now, I'm digging for some time about the best HW to use for home conditions.
The workstation will be used for my work as a developer, but I ...
- 121
2
votes
0
answers
16
views
Can the Apple M1's iGPU access the entire RAM as "video memory" when training with typical deep learning frameworks?
Can the Apple M1's iGPU access the entire RAM as "video memory" when training with typical deep learning frameworks (e.g., tensorflow_macos)? If not, what memory do they use as video memory?
- 5,573
0
votes
0
answers
33
views
How "exactly" are AI-accelerator chip ASICs built differently than GPUs as GPU seem to lead for many AI workloads on performance
There is a lot of discussion on google search about AI-custom-accelerators (like Intel's Gaudi) and GPUs.
Almost all of them say generic things like, a) AI Accelerator chip is for specialized AI ...
- 123
0
votes
0
answers
41
views
Memory Error when loading a txt file for an ML model
I am trying to run the Python code below:
...
- 113
5
votes
1
answer
3k
views
What size language model can you train on a GPU with x GB of memory?
I'm trying to figure out what size language model I will be able to train on a GPU with a certain amount of memory. Let's for simplicity say that 1 GB = 109 bytes; that means that, for example, on a ...
- 161
2
votes
1
answer
97
views
Training Neural Network using TensorFlow on Large Video Dataset for Human Activity Recognition
I am working on a Human Activity Recognition on videos using deep learning and want to train my Neural Network (ConvLSTM & LRCN) on my custom dataset. The issue that I am facing is that my dataset ...
- 21
0
votes
1
answer
141
views
How to calculate the distance matrix when there is a lot of data And the memory does not support it
I am dealing with a data matrix in which most of the variables are binary or multilevel response. I would like to perform the MDS algorithm and for that, I need to calculate the distance matrix first. ...
- 304
2
votes
1
answer
43
views
Is batch size of 1 a valid choice for a very deep neural network with high memory requirement?
I am training a very deep neural network (Panoptic-DeepLab) with a ResNet34 backbone on Google Colab on CityScapes dataset for Panoptic Segmentation, and noticed that, with a big crop size, the batch ...
- 121
1
vote
1
answer
355
views
What are different ways to reduce size of word2vec vectors file?
I am working on an application with memory constraints. We are getting vectors from python Gensim models but need to transmit copies of them to react native mobile app and potentially in-browser JS. ...
- 11
1
vote
0
answers
83
views
How to calculate the fully connected neural network footprint for each layer?
I'm using a MADDPG (RL algorithm) and trying to find out the memory footprint for each layer in it. Maddpg: https://github.com/openai/maddpg
The neural network is described here.
...
- 11
3
votes
1
answer
1k
views
How can I measure time and memory complexity for a deep learning model?
How can I measure or find the time complexity and memory complexity for a model like VGG16 or Resnet50? Also, will it be different from one machine to another like using GTX GPU or RTX GPU?
- 57
1
vote
1
answer
669
views
TF-IDF for 400,000+ unique words in corpus?
I have a corpus with over 400,000 unique words. I would like to build a TF-IDF matrix for this corpus.
I have tried doing this on my laptop (16GB RAM) and Google Colab, but am unable to do so due to ...
- 149
0
votes
1
answer
27
views
determining size of batch, time of sending and memory in to send from scala to ML section
I have a time series (sampling time: 66.66 micro second, number of samples/sampling time=151), I would like to determine some anomalies in them, the inputs are made by scala customer message bus.
...
- 1,794
1
vote
1
answer
387
views
Tips for clustering rows of a gigantic "distance" matrix
I've been assigned to the following task:
I was given 1,000,000 data points and was asked to create a sort of distance matrix and to cluster the rows.
So this matrix is 1,000,000 x 1,000,000 which is ...
- 197
1
vote
1
answer
274
views
PySpark for Big Data and RAM usage
I'm trying to figure out the best and most efficient method of handing ETL operations for big data. My question is this.
Say I have a table that is ~50 GB in size. In order to effectively transfer the ...
- 11
1
vote
1
answer
1k
views
Why is HistGradientBoostingRegressor in sklearn so fast and low on memory?
I trained multiple models for my problem and most ensemble algorithms resulted in lengthy fit and train time and huge model size on disk (approx 10GB for RandomForest) but when I tried ...
- 35
0
votes
0
answers
16
views
Reducing dataset before computing similarity matrix
I'm writing my thesis and am trying to calculate a similarity matrix of houses. I currently have a dataset of 500,000 houses that I need to calculate the similarity between. I.e. I need to calculate ...
2
votes
1
answer
197
views
Running out of memory when calculating loss using SigmoidFocalCrossEntropy
Code Versions:
python == 3.8
tensorflow == 2.2.0
tensorflow-addons == 0.11.2
Recently I've been using tensorflow addon's focal loss function for one of my models. ...
- 23
0
votes
1
answer
725
views
Memory issue when trying to initiate zero tensor with pytorch
I am facing a memory issue while trying to initialize a torch.zeros -
torch.zeros((2000,2000,3200), device=device)
Getting the following error:
...
0
votes
1
answer
598
views
Loading large numpy array (DAIC-WOZ) for LSTM model causes Out of memory errors
I am working on using the DAIC-WOZ Dataset of audio and video extracts for depression detection. While training the audio files, which has three input of eGeMAPS, MFCC, and DENSENET arrays. They are ...
- 173