Questions tagged [performance]

The tag has no usage guidance.

31 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3
votes
0answers
198 views

How much text is enough to train a good embedding model?

I need to train a word2vec embedding model on Wikipedia articles using Gensim. Eventually, I will use the entire Wikipedia for that but for the moment, I'm doing some experimentation/optimization to ...
3
votes
0answers
33 views

Timing sequence in MapReduce

I'm running a test on MapReduce algorithm in different environments, like Hadoop and MongoDB, and using different types of data. What are the different methods or techniques to find out the execution ...
2
votes
0answers
31 views

Python library to process large files

I'm looking for a Python library to process large files without performance problems. For example I want to transfer large files with hash calculating. Python faces memory problems with such processes....
2
votes
1answer
31 views

Relating ROC curves with class statistics

I have three neural net models that I am running on the same dataset (of 7 classes) and calculate their class performance and also ROC curves. The firs tmodel is a 4-layer model with 8 neurons in each ...
2
votes
1answer
206 views

why does performance of machine learning models plateau after certain amount of training data

I'm referring to the below image which I came across. The explanation seemed intuitive at first but I don't think I understand how it works. The image says that the performance of traditional machine ...
2
votes
0answers
154 views

How to choose best model checkpoint when training deep learning model on all the data?

When training a final model for production, it's often recommended to train on all available data (train + dev + test), as discussed here. I'm training a deep learning model. I typically save and use ...
2
votes
0answers
272 views

External GPU vs. internal GPU for machine learning

What are the pros/cons of using external GPUs (e.g., connected through thunderbolt) vs. internal GPUs for machine learning?
1
vote
0answers
12 views

Improve performance of my CNN model

I am working on an image classification problem. There are 876 images in the training and 600 in the test dataset. It is a multi class classification for plants. Since this is my first CNN problem, ...
1
vote
0answers
13 views

Is there a cost associated with converting Koalas dataframe to Spark dataframe?

I know that pandas works "under the hood" with numpy arrays stored in dictionaries. In contrast, Koalas works with the underlying Spark framework. Does that mean that there is no extra cost associated ...
1
vote
0answers
13 views

Multiclass Classification Task - Performance on Each Class Compared to Chance?

As a part of a classification task, a classifier has decided whether different books belong to class A, B or C (which are imbalanced) by looking at certain feature of the book. I have calculated ...
1
vote
2answers
85 views

AUC ROC Threshold Setting in heavy imbalance

I am doing binary logistic regression on a dataset with very heavy class imbalance. Class 1 is only 1% of data. When I train logistic regressor without class weights I get ROC AUC Score of 0.6269. ...
1
vote
0answers
52 views

Model Performance using Precision as evaluation metric

I am dealing with an imbalanced class with the following distribution : (Total dataset size : 10763 X 20) 0 : 91% 1 : 9% To build model on this dataset having class imbalance, I have compared ...
1
vote
0answers
256 views

How can I calculate perplexity for a bigram model?

I didn't find any function in nltk to calculate the perplexity. There are some codes I found: ...
1
vote
0answers
75 views

Time-series clustering Quality Measures

I am clustering time-series datasets which are not labeled (No Ground truth) and I want to measure the quality of the clusters. Could you please suggest any Clustering performance evaluation methods ...
1
vote
1answer
137 views

How to decide optimal threshold for my classification model from FPR, TPR and threshold

I am building my model in Python to classify customer in buyer/ non-buyer category. I used mutiple agorithms for this problem and then after evaluation selecting the best out of all. sklearn package ...
1
vote
1answer
287 views

bad regression performance on imbalanced dataset

My current dataset has a shape of 5300 rows by 160 columns with a numeric target variable range=[641, 3001]. That’s no big dataset, but should in general be enough for decent regression quality. The ...
1
vote
0answers
887 views

Transfer learning: Poor performance with last layer replaced

I am using a transfer learning approach. For this I followed the tensorflow for poets tutorial. I use a pre-trained InceptionV3 architecture trained on the Imagenet dataset. The last layer and the ...
1
vote
0answers
90 views

Performance Metric for topic extraction when there is no ground truth

I am extracting topics from text using a predefined ontology containing 2690 concepts, wordnet(to expand concept terms with their synsets, and other morphological forms of the same word) and lucene to ...
1
vote
0answers
27 views

How to measure the performance of a deep learning model in parasite detection?

I’m working with segmented cells from thin blood smear images and using deep learning models to classify parasitic and uninfected cells. I obtained the following values: Accuracy: 0.986, AUC: 0.99, ...
1
vote
0answers
49 views

Is there a machine learning framework that supports partial evaluation ie can return a function?

Is there a machine learning framework that supports partial evaluation? For example: We train on [model, year, km, ..., colour, price]. Today we call ...
1
vote
0answers
61 views

Analytics oriented database

I'm analyzing a single large table (about 50GB 16M rows, 15 columns perhaps more) currently using PostgreSQL 9.4. Most of my queries doesn't involve more tables. Queries run time are very large. I'm ...
0
votes
0answers
10 views

How to calculate “minimal confidence for the correct label”

In RapidMiner one of the decision tree performance measures is called the margin. The margin is defined as "minimal confidence for the correct label". Can someone explain to me what it means and how ...
0
votes
0answers
24 views

How to improve computation speed on Orange?

I need to process huge data sets on Orange 3.23. My Orange workflow contains several widgets in parallel. It seems that Orange launches each process at a time. Is there a way to run several processes ...
0
votes
0answers
55 views

Doc2vec doesn't use all the CPU power

I have a big dataset that trying to train with a Doc2vec model. I am working on a 8 CPU, 32GB RAM, but as I can see on the monitoring tools, it only uses about 66-67% of the CPU. I am not sure if it ...
0
votes
0answers
13 views

Evaluating randomness in a model performance

I'm evaluating the variability in performance (AUC) in the test set of a machine learning model with an intrinsic random component (xgboost). How many sources of variation should I use? Just ...
0
votes
0answers
10 views

Performant alternatives to Matrix package in R that requires minimal effort by end users to install

Background I'm going to be releasing a package for R that does calculations involving extremely large sparse matrices (1,000,000 x 1,000,000 is the minimum for what we consider useful). For this ...
0
votes
0answers
104 views

For a multiclass classification problem, how do we find the cohen kappa score?

So I have a multiclass classification problem and I have found the Matthews Correlation Coefficient of that (https://scikit-learn.org/stable/modules/model_evaluation.html#matthews-correlation-...
0
votes
0answers
31 views

Changing the performance metric used to optimize with random-forest

I'm looking to change the performance metric used to optimize the training for my data set because it is highly unbalance. Because it's highly unbalanced, I don't feel like accuracy is the appropriate ...
0
votes
0answers
219 views

How to evaluate reinforcement learning model?

I am relatively new to reinforcement learning and have been experiencing with a reinforcement learning model to make decisions based on human activities (dynamic environment). Appreciate if someone ...
0
votes
1answer
30 views

Difference Between Performance Scores

I need some help to understand the meaning between these different scores. Currently, I am doing the classification problems using machine learning, and I have obtained the results for the ...
0
votes
0answers
48 views

Cross-validation and out-of-bag bootstrap applications

I have a question regarding steps on which a specific resample method should be used in general. As far as I know: out-of-bag bootstrap is the resample method with replacement, which has lower ...