Questions tagged [performance]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
7 views

Is iterative pruning always structured?

Iterative pruning works like the following: Evaluate model performance, continue if performance is fine Apply pruning Train the model Go back to step 1 When doing this process using unstructured ...
1
vote
2answers
34 views

Graphs for representing performance of machine learning classifiers [closed]

Can any please guide about how many types of the graph other than ROC can be plotted to represent the performance of the machine learning classifier?
4
votes
1answer
49 views

Finding out why your model is doing better?

I fitted a logistic regression model on a data set and got an AUC score of .70. I added some additional out-hot encoded categorical features to the model and the AUC improved slightly to .74. How do I ...
0
votes
1answer
20 views

How to derive false positive and false negative from top-k accuracy?

I am working on the following "equality identification" problem and become quite confused on how to reasonably define false positive and false negative in my case. Problem: Suppose I have a ...
1
vote
0answers
16 views

How to evaluate the performance of a model in production when labeling data is costly?

I have come to a problem for which I can't find a solution. Let's talk about a hypothetical binary classification problem in which you have some years of (human) labeled data. The final objective is ...
0
votes
0answers
13 views

Model performance metrics

I have a dataset with multiple numeric input values and a categorical output. How can I measure model performance with different algorithms. As the results are categorical, we can not obtain r squared ...
0
votes
2answers
17 views

Getting lower performance metrics when using GridSearchCV

I have defined an XGBoost model and would like to tune some of its hyperparameters. I am using GridSearchCV to find the best params. However, I also tried to fit the model on the entire training ...
0
votes
0answers
10 views

How to use “transposing” for more efficient list comprehensions?

How can I use transposing to execute operations faster, than i currently do in list comprehensions, like: ...
0
votes
0answers
30 views

How to run list comprehensions on GPU?

Is there a way to run complex list comprehensions like the following on GPU? ...
0
votes
0answers
13 views

Deep Learning on Float-Value Time Series … How Much VRAM?

How much VRAM can you recommmend for a LSTM with about half a billion values of 32bit Floats per Feature? Every sample takes 100(in the beginning) to 10.000(later, probably still not enough) ...
0
votes
1answer
684 views

FP16, FP32 - what is it all about? or is it just Bitsize for Float-Values (Python)

What is it all about FP16, FP32 in Python? My potential Business Partner and I are building a Deep Learning Setup for working with time series. He came up with "FP16 and FP32" while finding a GPU. It ...
0
votes
0answers
24 views

Measuring performance of classifiers with different/extra classes

Disclosure - This is also on cross-validated, but has no comments or answers. Then I found this forum and thought it may be best suited here. I'm not sure where to post this, or how best to explain, ...
0
votes
0answers
7 views

Write data.table to HIVE database - performace

Fast version: I have a data.table in R with ~ 8.000.000 rows and 15 columns and I want to write it to an HIVE database. I'm using the ODBC package, but it is dead slow (after 5h is still running...). ...
8
votes
3answers
2k views

Can the F1 score be equal to zero?

As it is mentioned in the F1 score Wikipedia, 'F1 score reaches its best value at 1 (perfect precision and recall) and worst at 0'. What is the worst condition that was mentioned? Even if we ...
0
votes
0answers
13 views

Efficient scanning method on images/volumes when applying neural network

I am a newbie in neural network. I am using this for one of my physics problems. So, please forgive my sheer lack of knowledge in this field. My neural network is a convolutional neural network with ...
0
votes
1answer
158 views

LSTM evaluation metric MAE explanation

I have a hard time understanding the LSTM model performance as I summarize my model as follow: ...
-1
votes
1answer
57 views

What is evaluation metric for two sets? [closed]

I've two sets one is ground truth and other is output of my machine learning models. Assume my groundtruth set is A={1,2,3,4,5} and output of machine learning model is B={3,4,5,6,7,8}. One way I can ...
3
votes
2answers
123 views

What is done first, cross validation or grid search?

When I have the data set to train a model with SVM, which procedure is performed first, cross validation or grid search? I have read this in a couple of books but I don't know in what order all this ...
1
vote
0answers
25 views

Improve performance of my CNN model

I am working on an image classification problem. There are 876 images in the training and 600 in the test dataset. It is a multi class classification for plants. Since this is my first CNN problem, ...
2
votes
0answers
45 views

Python library to process large files

I'm looking for a Python library to process large files without performance problems. For example I want to transfer large files with hash calculating. Python faces memory problems with such processes....
0
votes
0answers
14 views

How to calculate “minimal confidence for the correct label”

In RapidMiner one of the decision tree performance measures is called the margin. The margin is defined as "minimal confidence for the correct label". Can someone explain to me what it means and how ...
1
vote
3answers
489 views

Is there a cost associated with converting Koalas dataframe to Spark dataframe?

I know that pandas works "under the hood" with numpy arrays stored in dictionaries. In contrast, Koalas works with the underlying Spark framework. Does that mean that there is no extra cost associated ...
1
vote
1answer
31 views

what metrics to evaluate rank order results?

I have searched on stackexchange and found a couple of topics like this and this but they are not quite relevant to my problem (or at least I don't know how to make them relevant to my problem). ...
1
vote
0answers
18 views

Multiclass Classification Task - Performance on Each Class Compared to Chance?

As a part of a classification task, a classifier has decided whether different books belong to class A, B or C (which are imbalanced) by looking at certain feature of the book. I have calculated ...
5
votes
1answer
796 views

Why ML model produces different results despite random_state defined? And how to set global random seed for sklearn

I have been running few ML models on same set of data for a binary classification problem with class proportion of 33:67. I had the same algorithms and same set of hyperparamters during yesterday and ...
2
votes
3answers
72 views

Is over-fitting a matter of features engineering or a matter of parameters set?

I am using sklearn package to make models. I tried randomly to set some paramater to a sklearn.ensemble.RandomForestClassifier ...
0
votes
1answer
27 views

Customer Intelligence - How to measure success?

we are creating models that aim to filter new leads from our current customer base. We started to create propensity models that calculate a percentage for each customer for a certain product group. I ...
3
votes
2answers
51 views

Does Sampling size matters in Multi classification Model

I am working on a multi class classification model where few of the class are with less data compare to other classes. I used random sampling technique to create a sample from the population keeping ...
2
votes
1answer
42 views

Relating ROC curves with class statistics

I have three neural net models that I am running on the same dataset (of 7 classes) and calculate their class performance and also ROC curves. The firs tmodel is a 4-layer model with 8 neurons in each ...
0
votes
0answers
28 views

How to improve computation speed on Orange?

I need to process huge data sets on Orange 3.23. My Orange workflow contains several widgets in parallel. It seems that Orange launches each process at a time. Is there a way to run several processes ...
1
vote
1answer
28 views

Faster Data Transfer?

I'm doing a project which involves a small dataset (4GB). I'm trying to upload it to Paperspace to do some analysis but it's taking an absurd amount of time. Using Gradient, it would upload maybe ...
2
votes
1answer
39 views

How can we conclude that an optimization algorithm is better than another one

When we test a new optimization algorithm, what the process that we need to do?For example, do we need to run the algorithm several times, and pick a best performance,i.e., in terms of accuracy, f1 ...
0
votes
0answers
95 views

Doc2vec doesn't use all the CPU power

I have a big dataset that trying to train with a Doc2vec model. I am working on a 8 CPU, 32GB RAM, but as I can see on the monitoring tools, it only uses about 66-67% of the CPU. I am not sure if it ...
1
vote
0answers
16 views

Evaluating randomness in a model performance

I'm evaluating the variability in performance (AUC) in the test set of a machine learning model with an intrinsic random component (xgboost). How many sources of variation should I use? Just ...
2
votes
2answers
744 views

How label smoothing and label flipping increases the performance of a machine learning model

I have seen posts and research papers mentioning these techniques for improving the performance of a machine learning model. These techniques certainly make some sense in the case when we are not ...
1
vote
2answers
131 views

AUC ROC Threshold Setting in heavy imbalance

I am doing binary logistic regression on a dataset with very heavy class imbalance. Class 1 is only 1% of data. When I train logistic regressor without class weights I get ROC AUC Score of 0.6269. ...
2
votes
1answer
387 views

Xgboost multiple class predictive performance beats one versus rest

I have an NLP task I'm tackling with xgboost (R implementation). Before describing my doubt I'll give you some background: I have a corpus of documents for which I did topic discovery, using a term ...
1
vote
1answer
119 views

fast ML algorithms for binary classification with (large+sparse) binary input data

I'm sorry that this is so very broad, but as a non-ML scientist it feels to be almost impossible to keep up with recent developments (esp. in deep learning etc.). Hence, I'm asking for guidance on how ...
0
votes
2answers
70 views

How can i test the performance of a model when the test data contains seen and unseen data

To test the performance of my model based on some selected features, i try to use unseen and seen data. However, when choosing the accuracy based on all data, the model is almost overfitting since ...
0
votes
1answer
22 views

Reordering feature and its impact

How does reordering the features impact model training and its performance? Per my understanding, it should not impact the model performance as weights get tuned according to feature value and not ...
0
votes
1answer
178 views

Normalized metric for comparing regression models performance

I was recently trying to explain to someone whether performance of my estimation approach is good or bad. For instance, whether a model with Mean Absolute Error (MAE) of 17000 is a bad solution. It ...
2
votes
2answers
453 views

why does performance of machine learning models plateau after certain amount of training data

I'm referring to the below image which I came across. The explanation seemed intuitive at first but I don't think I understand how it works. The image says that the performance of traditional machine ...
0
votes
0answers
365 views

How to evaluate reinforcement learning model?

I am relatively new to reinforcement learning and have been experiencing with a reinforcement learning model to make decisions based on human activities (dynamic environment). Appreciate if someone ...
5
votes
1answer
397 views

GPU performance is about 50% slower than benchmarks

Running this benchmark I get 50% slower performance than the author on practically all deep learning sub problems (SINGLE precision and on TRAINING only): I tested this on a GeForce 1080 GTX Ti and ...
0
votes
1answer
34 views

Difference Between Performance Scores

I need some help to understand the meaning between these different scores. Currently, I am doing the classification problems using machine learning, and I have obtained the results for the ...
1
vote
1answer
331 views

Accuracy improving but, val_acc oscillating in ConvNet. What does it mean?

In my ConvNet model, i'm trying to classify some images. It is malware images and it doesn't contain complex features (i think), as expected model learn to classify images easily. You can see my ...
1
vote
0answers
82 views

Model Performance using Precision as evaluation metric

I am dealing with an imbalanced class with the following distribution : (Total dataset size : 10763 X 20) 0 : 91% 1 : 9% To build model on this dataset having class imbalance, I have compared ...
1
vote
0answers
440 views

How can I calculate perplexity for a bigram model?

I didn't find any function in nltk to calculate the perplexity. There are some codes I found: ...
4
votes
1answer
446 views

CNN computing time on good CPU vs cheap GPU

I am a researcher working on my first deep learning project, which consists of using a CNN (pre-trained VGG16+2 densely connected layers) to classify drone imagery of vegetation. In trying to hack ...
2
votes
0answers
219 views

How to choose best model checkpoint when training deep learning model on all the data?

When training a final model for production, it's often recommended to train on all available data (train + dev + test), as discussed here. I'm training a deep learning model. I typically save and use ...