Community Digest

Top new questions this week:

What is the scikit learn Non-negative Matrix Factorisation Coordinate Descent algorithm?

What is the scikit-learn Coordinate Descent (CD) algorithm for Non-negative Matrix Factorization (NMF)? The sklearn implementation of NMF has two different solvers, Coordinate Descent and ...

scikit-learn matrix-factorisation  
asked by christopherlovell 3 votes

Dealing with categorical variables

I have a panel data set. My dependent variable is total costs, and almost all of my independent variables are categorical variables. For instance, age is "old","new". Now i have some questions. ...

asked by ssssoooo 2 votes
answered by serali 0 votes

Relating ROC curves with class statistics

I have three neural net models that I am running on the same dataset (of 7 classes) and calculate their class performance and also ROC curves. The firs tmodel is a 4-layer model with 8 neurons in each ...

classification performance  
asked by Shahriar49 2 votes

Predicting Sequence based on Tabular Features

I have a dataset regarding a specific junction on a piece of road and the cars that will cross that junction. I am trying to predict the order that cars will pass the specific junction given a set of ...

asked by Daniel Wyatt 2 votes
answered by serali 0 votes

Why in this case are gradient steps not perpendicular to contour lines?

There is a theorem that gradient at point is perpendicular to tangent line to contour line at given point. Why in this picture it seems that this rule is not respected? source: ...

deep-learning gradient-descent linear-algebra books  
asked by MajorTom 2 votes
answered by serali 0 votes

Collaborating on Jupyter Notebooks

I have prepared Jupyter Notebook with some findings and I shared it with other team members through GitHub to get their feedback in a written form. It used to work like this when working together on a ...

asked by dzieciou 2 votes
answered by Fnguyen 3 votes

Is there any optimal way on feature selection for more than one classification algorithms?

I have a wine dataset with 13 features that indicates 3 different wine classes (target), and k-NN, SVM with linear kernel and SVM with rbf kernel algorithms to be tried with this dataset. My goal is ...

machine-learning scikit-learn  
asked by bbasaran 2 votes
answered by 89f3a1c -1 votes

Greatest hits from previous weeks:

Why mini batch size is better than one single "batch" with all training data?

I often read that in case of Deep Learning models the usual practice is to apply mini batches (generally a small one, 32/64) over several training epochs. I cannot really fathom the reason behind ...

machine-learning deep-learning  
asked by Hendrik 40 votes
answered by horaceT 46 votes

What is Ground Truth

In the context of Machine Learning, I have seen the term Ground Truth used a lot. I have searched a lot and found the following definition in Wikipedia: In machine learning, the term "ground ...

machine-learning neural-network deep-learning  
asked by Media 27 votes
answered by Neil Slater 24 votes

How to set batch_size, steps_per epoch and validation steps

I am starting to learn CNNs using Keras. I am using the theano backend. I don't understand how to set values to: batch_size, steps per epoch, validation_steps. What should be the value set to ...

machine-learning keras cnn  
asked by Ermene 24 votes
answered by Silpion 27 votes

ValueError: Input contains NaN, infinity or a value too large for dtype('float32')

I got ValueError when predicting test data using a RandomForest model. My code: clf = RandomForestClassifier(n_estimators=10, max_depth=6, n_jobs=1, verbose=2), y_fit) ...

python random-forest pandas  
asked by Edamame 41 votes
answered by fernando 45 votes

Data scientist vs machine learning engineer

What are the differences, if any, between a "data scientist" and a "machine learning engineer"? Over the past year or so "machine learning engineer" has started to show up a lot in job postings. ...

asked by Ryan Zotti 66 votes
answered by Vincenzo Lavorini 55 votes

Micro Average vs Macro average Performance in a Multiclass classification setting

I am trying out a multiclass classification setting with 3 classes. The class distribution is skewed with most of the data falling in 1 of the 3 classes. (class labels being 1,2,3, with 67.28% of the ...

multiclass-classification evaluation  
asked by SHASHANK GUPTA 108 votes
answered by pythiest 153 votes

GraphViz not working when imported inside PydotPlus (`GraphViz's executables not found`)

I've been trying to make these packages work for quite some time now but with no success. Basically the error is: GraphViz's Executables not found EDIT: I had not posted a terminal log with the ...

asked by Philippe Fanaro 8 votes
answered by Rob 9 votes

Can you answer these questions?

Forecasting future close returns

I have end-of-day time-series dataset with following data Ticker Date Open High Low Close Volume I have calculated end-of-day closing returns (Close_t/Close_t-1) -1 at time t, ...

time-series data-analysis  
asked by Vendetta 1 vote

Similarity of words using BERTMODEL

I want to find the similarity of words using the BERT model within the NER task. I have my own dataset so, I don't want to use the pre-trained model. I do the following: from transformers import ...

nlp word-embeddings similarity bert  
asked by AFB 1 vote
answered by Praneeth 0 votes

How to find the highest quality alloy?

In a robot making company, a robot must be made from a high quality alloy. There are n candidate alloys to be used for this purpose. Each alloy has p attributes and a quality value q. Assessment and ...

regression mse  
asked by Majid Namaazi 1 vote
You're receiving this message because you subscribed to the Data Science community digest.
Unsubscribe from this community digest       Edit email settings       Leave feedback       Privacy
Stack Overflow

Stack Overflow, 110 William Street, 28th floor, New York, NY 10038