Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [performance]

The tag has no usage guidance.

0
votes
0answers
11 views

Fast Style Transfer memory usage

I'm trying to integrate this tensorflow implementation of fast style transfer with GIMP, the open source image editor. In a few word, the plugin would be a wrapper to the ...
3
votes
1answer
62 views

AUC ROC in keras is different when using tensorflow or scikit functions.

Two solutions for using AUC-ROC to train keras models, proposed here worked for me. But using tensorflow or scikit rocauc functions I get different results. ...
2
votes
4answers
56 views

Neural Network unseen data performance

I started dabbling in neural networks quite recently and encountered a situation which is quite strange (at least with my limited knowledge). The problem I'm using a NN is a regression problem which ...
0
votes
0answers
28 views

How to evaluate computational cost of ArcFace, CosFace and DCFL?

I need for my paper to know at least a rough estimate of computational costs (flops or MAdds) of ArcFace, CosFace and DCFL implementations. But I nowhere can find it... Is it possible to give a rough ...
3
votes
4answers
154 views

Metrics to determine K in K-cross fold validation

Consider a scenario where the dataset in hand is quite large, let's assume 50000 samples (quite well balanced between two classes). What metrics can be used to decide the K value in a K-fold cross-...
0
votes
1answer
30 views

How can I perform backpropagation directly in matrix form?

I had made a neural network library a few months ago, and I wasn't too familiar with matrices. So, instead of performing matrix dot products (between weights and inputs, then adding a bias matrix), I ...
2
votes
2answers
50 views

Logloss vs Accuracy. Which needs to be chosen to evaluate the model performance

While model tuning using Cross validation and Grid search , I was plotting the graph of different learning rate against logloss and accuracy separately. Graph of Logloss --> learning Rate When I ...
1
vote
0answers
37 views

Time-series clustering Quality Measures

I am clustering time-series datasets which are not labeled (No Ground truth) and I want to measure the quality of the clusters. Could you please suggest any Clustering performance evaluation methods ...
2
votes
1answer
45 views

“Each agent was evaluated every 250,000 training frames for 135,000 validation frames” What does this sentences stands for? in DQN nature paper?

In nature paper of DQN by DeepMind, DQN is compared to linear function but they does not said what is this linear function? They compared with some linear functions? 0- What is the meaning of this ...
1
vote
1answer
31 views

How to decide optimal threshold for my classification model from FPR, TPR and threshold

I am building my model in Python to classify customer in buyer/ non-buyer category. I used mutiple agorithms for this problem and then after evaluation selecting the best out of all. sklearn package ...
0
votes
0answers
39 views

How to deal with overfitting in Gradient boosting classification algorithm?

I am training my model on Gradient boosting algorithm with parameters as follows: learning rate: 0.1 number of iterations: 100 depth of tree: 12 I am not getting the output for cross-validation to ...
1
vote
1answer
53 views

bad regression performance on imbalanced dataset

My current dataset has a shape of 5300 rows by 160 columns with a numeric target variable range=[641, 3001]. That’s no big dataset, but should in general be enough for decent regression quality. The ...
0
votes
1answer
30 views

Confidence of this particual prediction

I am looking for a confidence of model to predict well in a given situation. So I have a model $f$ (generic, let's exemplify with a regression model of explicit form for brevity). It well fits on the ...
0
votes
1answer
38 views

Regression model performance with noisy dependent variable

I'm doing a support vector regression with the dependent variable representing measurements from an uncalibrated sensor (measurement error between 2% and 20%) and I want to study the effect of this ...
2
votes
1answer
76 views

how to improve searching index in dataframe

Given a pandas dataframe with a timestamp index, sorted. I have a label and I need to find the closest index to that label. Also, I need to find a smaller timestamp, so the search should be computed ...
10
votes
1answer
82 views

What is the best performance metric used in balancing dataset using SMOTE technique

I used smote technique to oversample my dataset and now I have a balanced dataset. The problem I faced is that the performance metrics; precision, recall, f1 measure, accuracy in the imbalanced ...
0
votes
1answer
19 views

classification performance metric for high risk medical decisions

What is the best classification performance metric for risky medical treatments like surgery? for example a patient should NOT suggest a surgery (negative) if he/she can be treated by medicine (...
1
vote
0answers
33 views

Multi class logistic regression performs bad on certain classes

I'm trying to predict the day of the week for customers next visit from their previous visits (0 is they won't visit, 1 is Monday and so on). I have created some features like the visits days ratios, ...
1
vote
0answers
61 views

Performance Evaluation Metrics used in Training, Validation and Testing [closed]

Which specific performance evaluation metrics are used in training, validation and testing and why? I am thinking error metrics (RMSE, MAE, MSE) are used in validation, and testing should use a wide ...
6
votes
2answers
157 views

What makes you confident in your results? At what point do you think you can present your work to tech illiterate superiors?

I understand that the models are only as good as the data you get, and bad design can generate really bad data. Nonrandom sampling, unbalanced/incomplete designs, confounding, can make data analysis ...
2
votes
1answer
707 views

Interpreting confusion matrix and validation results in convolutional networks

I need some help in the assessment of the training results of a convolutional neural network. Here is my setup: Architecture: InceptionV3 Pre-trained InceptionV3 with weights from image net ...
1
vote
0answers
456 views

Transfer learning: Poor performance with last layer replaced

I am using a transfer learning approach. For this I followed the tensorflow for poets tutorial. I use a pre-trained InceptionV3 architecture trained on the Imagenet dataset. The last layer and the ...
1
vote
1answer
1k views

Improve Precision of a binary classifier - Decision Tree in Python

Currently, I am working on a project. The dataset is balanced roughly in the ratio of 50:50. I created a decision tree classifier. I am achieving decent accuracy (~75%) on validation data but the ...
2
votes
0answers
204 views

External GPU vs. internal GPU for machine learning

What are the pros/cons of using external GPUs (e.g., connected through thunderbolt) vs. internal GPUs for machine learning?
1
vote
0answers
56 views

Performance Metric for topic extraction when there is no ground truth

I am extracting topics from text using a predefined ontology containing 2690 concepts, wordnet(to expand concept terms with their synsets, and other morphological forms of the same word) and lucene to ...
1
vote
0answers
22 views

How to measure the performance of a deep learning model in parasite detection?

I’m working with segmented cells from thin blood smear images and using deep learning models to classify parasitic and uninfected cells. I obtained the following values: Accuracy: 0.986, AUC: 0.99, ...
1
vote
1answer
525 views

how should I measure performance if there is no test data?

I have 'practice' data set which I can split into training, validation, and test set and I will play with data to make a machine learning model. But in real situation, I will be given a very small ...
1
vote
1answer
41 views

How to select a model based on statistical analyses?

I've been statistically validating the performance of different Deep Learning models in classifying parasitized and normal cells. In the process, I could find that there is no statistically ...
6
votes
2answers
7k views

Improve Pandas dataframe filtering speed

I have a dataset with 19 columns and about 250k rows. I have worked with bigger datasets, but this time, Pandas decided to play with my nerves. I tried to split the original dataset into 3 sub-...
0
votes
1answer
329 views

Why use the .idx data format?

The MNIST handwritten digit dataset uses a file format .idx. What are the advantages of this file format over alternatives such as CSV, TSX and ODS?
0
votes
1answer
31 views

How to evaluate the performance based on rate data

I have the following data: Goal Achieved 100 90 150 130 200 175 ... The first column "Goal" is the number which should be done that ...
0
votes
2answers
110 views

How do I compare traditional classifiers performance with my proposed method?

I want to compare my proposed method with traditional machine learning classifiers like Multilayer Perceptron(MLP) and SVM to check the classification accuracy.How do I compare different classifiers?. ...
1
vote
1answer
394 views

How to compare performance of Cosine Similarity and Manhatten Distance?

I'm doing clustering of documents by applying k-Means on the word-vectors. To measure the cluster quality, I calculate David Bouldin Index for different k's. I tried two different distance measures, ...
2
votes
1answer
2k views

Performance issues when merging two dataframe columns into one on millions rows with Pandas

I am trying to merge two address columns into one and separate the resulting string with '--'. The dataset has 10 million rows and 33 columns - but the number of rows grows for a million or so a month....
1
vote
2answers
68 views

ML models: average of all versus average of averages?

I have data for 20 different people and am training a model (e.g. a neural network with the same hyperparameters) on the data from each person; so this gives me 20 models. I chose to use RMSE to ...
4
votes
1answer
114 views

Estimating Titan X graphics card impact on performance

I'm currently training CNNs using Tensorflow (Python) on my GTX 970 (specs here). I recently took a look at the new pascal based Titan Xs and I'm wondering what an estimated performance/speed gain ...
2
votes
1answer
191 views

Comparing Non-deterministic Binary Classifiers

I have two classifiers which I am implementing, and they are both non-deterministic in the sense that they can each give different results (FPR and TPR) when you run them multiple times. I would like ...
2
votes
1answer
71 views

Vectorizing/Parallelizing DataFrame indexing

I want to make the following Python data-processing code more efficient by replacing for loops. Is there any way to vectorize code like this? I have a DataFrame object ...
10
votes
4answers
743 views

How to compare the performance of feature selection methods?

There are several feature selection / variable selection approaches (see for example Guyon & Elisseeff, 2003; Liu et al., 2010): filter methods (e.g., correlation-based, entropy-based, random ...
0
votes
0answers
37 views

How can I compute the performance of the following algorithms?

If the number of classes is C = 5, training set contains N = 3000 samples, and D = 4 dimensions, what would be the best among the following algorithms? Linear one versus one classifiers’ group ...
1
vote
2answers
1k views

Using the trainbr function for classification in Matlab

I am training a neural network for classification using Matlab, and I don't understand if I can use the trainbr training function (Bayesian Regularization ...
1
vote
0answers
41 views

Is there a machine learning framework that supports partial evaluation ie can return a function?

Is there a machine learning framework that supports partial evaluation? For example: We train on [model, year, km, ..., colour, price]. Today we call ...
8
votes
1answer
6k views

Why doesn't training RNNs use 100% of the GPU?

I wonder why training RNNs typically doesn't use 100% of the GPU. For example, if I run this RNN benchmark on a Maxwell Titan X on Ubuntu 14.04.4 LTS x64, the GPU utilization is below 90%: The ...
1
vote
1answer
154 views

Optimal parameter estimation for a classifier with multiple parameters

The image on the left shows a standard ROC curve formed by sweeping a single threshold and recording the corresponding True Positive Rate (TPR) and False Positive Rate (FPR). The image on the right ...
1
vote
2answers
949 views

Benchmarks based on neural networks libraries to compare the performance between different GPUs

I am looking for benchmarks based on neural networks libraries (Theano/TensorFlow/Torch/Caffe/…) to compare the performance between different GPUs. I am aware of: https://github.com/jcjohnson/cnn-...
2
votes
2answers
130 views

ARIMA(X) Validation

I'm in the process of developing a new spark-based ARIMA(X) tool, and have reached the point where I need to know whether my coefficient estimates and forecasts are sensible. I can compare my results ...
0
votes
2answers
62 views

What do this Classification evaluation results mean to you? Do they are suspicious or not?

I have collected dataset with two class labels and used the SVM Method to classify the dataset, and this is the results. Does this appear suspicious or not? scikit-learn classifiers with SVM SVC ...
0
votes
1answer
33 views

Measuring performance of different classifiers without class type in data

To measure the performance of a classification algorithms on a dataset that has an attribute for class type, I divide my dataset to training and test samples and then create a ...
0
votes
1answer
42 views

Cross-validation strategy

I have a regression problem and I am in doubt about how I can calculate RMSE in my life-cycle. I deal with time-series and for every prediction, I want to look N points in the future. It is apparent ...
1
vote
0answers
54 views

Analytics oriented database

I'm analyzing a single large table (about 50GB 16M rows, 15 columns perhaps more) currently using PostgreSQL 9.4. Most of my queries doesn't involve more tables. Queries run time are very large. I'm ...