Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

0
votes
1answer
25 views

How to compare the output of Self-organizing maps?

I am trying to simultaneously cluster and visualize text documents using Self-organizing maps. Since text documents can be represented in various ways (vector space model, GloVe etc), I am trying to ...
0
votes
0answers
8 views

How to perform T-test and chi square test to my categorical variables like country, education and predict accuracy using logistic regression?

I'm new to Data science. I have been working on a classification project which has columns (Sex, Age, Occupation, Marital Status, education, country, relationship,capital gain, income). Here income('&...
0
votes
1answer
12 views

Any cluster algo can cluster time series datasets based on variation ratio(or quantity)?

I learn machine learning from sciki and read its documents. Clustering cluster groups based on the euclidean distance and filter them by different ways ex: guassian distribution, or mean-shift...etc. ...
0
votes
0answers
21 views

How to structure a scikit-learn machine learning project for predicting sports outcomes?

I'm a beginner in machine learning so please bear with what seem like uninformed questions. I'm trying to create a model that can predict the outcomes of sporting events. My approach to training and ...
0
votes
1answer
15 views

What is the difference between parameters & cooficients in Machine learning?

are both terms interchangeable? I'm kinda new to machine learning field and very confused about these terms in machine learning perspective.
1
vote
1answer
17 views

Why feature crosses may work better than having them as individual features?

On Google ML Crash Course it is said the following: If we build a feature cross from both these features: [behavior type X time of day] then we'll end up with vastly more predictive ...
0
votes
2answers
24 views

Normalization before or after resizing

I'm training deep learning network using images (to be exact - I'm solving semantic segmentation problem). What's the proper order of resizing (I need to resize images to fixed width X height) and ...
0
votes
1answer
32 views

Oversampling before Cross-Validation, is it a problem?

I have a multi-class classification problem to solve which is highly imbalanced. Obviously I'm doing oversampling, but I'm doing cross-validation with the over-sampled dataset, as a result of which I ...
3
votes
2answers
63 views

How to get out of local minimums on stochastic gradient descent?

I'm not programming a neural network but I'm looking at it from a non-hands-on, theoretical point of view and I'm currently wondering how to escape a local minimum and how to get to a global minimum. ...
1
vote
0answers
21 views

Job Recommendation System

I am building a Job Recommendation System where I have Student Data for different subjects in Machine Learning(Data Viz, Python, Statistics, etc) and their skills from the resume. Need to Recommend ...
0
votes
1answer
29 views

Purpose of test data in binary classification

I have a highly biased training dataset where AppId 6,7,8,9,10 are almost never purchased. I made this up just to see how good my comprehension of calculating the classification metrics is such as <...
0
votes
0answers
12 views

How to adjust deep learning parameters using Particle swarm optimization (PSO)?

As success of deep learning depends upon appropriately setting of its parameters to achieve high-quality results. The number of hidden layers and the number of neurons in each layer of a deep machine ...
0
votes
0answers
19 views

Feature selection through Random Forest and Principal Component Analysis

I am working on a binary classification problem and I have 870 numeric independent features to start with. I tried PCA on input features and picked top 200 variables corresponding to first 10 ...
0
votes
0answers
8 views

How do I speedup adding two big vectors of tuples? [migrated]

Recently, I am implementing an algorithm from a paper that I will be using in my master's work, but I've come across some problems regarding the time it is taking to perform some operations. Before I ...
0
votes
0answers
7 views

Knowing Feature Importance from Sparse Matrix

I was working with a dataset which had a textual column as well as numerical columns, so I used tfidf for textual column and created a sparse matrix, similarly for the numerical features I created a ...
-1
votes
1answer
14 views

How to start learning Python for Machine Learning without spending money?

I want to start learning Python for Data Science without spending money. Where to start learning? Which resources such as books and websites do you recommend? Thank in advance for answer!
1
vote
1answer
30 views
0
votes
1answer
20 views

Metrics for presenting RNN/LSTM result

I am working on a two different architecture based on LSTM model to predict the users next action based on the previous actions. I am wondering, what is the best way to present the result? Is it okay ...
0
votes
1answer
33 views

Naive bayes, all of the elements in predict_proba output matrix are less than 0.5

I've created a MultinomialNB classifier model by which I'm trying to label some test texts: ...
0
votes
1answer
10 views

Survey papers on Natural Language Understanding

What are some good survey or review papers on the state of the art of machine learning approaches to grammatical/syntactic structure of natural languages?
0
votes
0answers
16 views

Tools/frameworks/libraries for inverse dynamical modeling

We have a first order dynamical system: x[t+1] = f(x[t], u[t]), where x is the system state and ...
0
votes
1answer
23 views

Predicting for future date

How do I predict a category of data for a future date ? Example: what will the Sales figure for region (or region wise) for a particular date in the future based on the sales person past data for a ...
0
votes
1answer
15 views

Size of Output vector from AvgW2V Vectorizer is less than Size of Input data

Hi, I have been seeing this problem for quite some time. Whenever I tried vectorizing input text data though avgw2v vectorization technique. The size of vectorized data is less than the size of the ...
0
votes
0answers
12 views

What is the most efficient method to detect drowsiness?

What all parameters other than face detection, speed and steering variations, yawning frequency can be used to detect drowsiness? What method is more efficient in drowsiness detection? What ...
2
votes
0answers
41 views

How to handle preprocessing (StandardScaler, LabelEncoder) when using data generator to train?

So, I have a dataset that is too big to load into memory all at once. Therefore I want to use a generator to load batches of data to train on. In this scenario, how do I go about performing scaling ...
0
votes
0answers
8 views

How do I combine two electromagnetic readings to predict the position of a sensor?

I have an electromagnetic sensor and electromagnetic field emitter. The sensor will read power from the emitter. I want to predict the position of the sensor using the reading. Let me simplify the ...
1
vote
1answer
13 views

Product classification in hierarchical categories based on multiple parameters and non-standard descriptions

I want to start a machine learning project in my company and a really big pain for spend analysts is to classify the products that buyers order for maintenance, tooling, raw material and such, as the ...
0
votes
1answer
29 views

Confidence Score For Trained Sentiment Analyser Model

I have trained a text based sentiment analysis model, using SciKit-learn and custom data. I have the model ready and it works fine in predicting a text to a class (Positive or Negative or Neutral). I ...
0
votes
1answer
14 views

What does it mean for an activation function to be “saturated/non-saturated”?

For context, in this paper Several RNN variants such as the long short-term memory (LSTM) [10, 18] and the gated recurrent unit (GRU) [5] have been proposed to address the gradient problems. ...
0
votes
0answers
9 views

LSTM Autoencoder on Patterns of Labels

Currently, I am trying to do anomaly detection on univariate data consisting of labels. For example: [A, A, B, C] is good but [A, A, A, A] is anomalous. I'm dealing with more than just ABC. Is an LSTM ...
1
vote
2answers
41 views

What could explain a much higher F1 score in comparision to accuracy score?

I am building a binary classifier, which classifies numerical data, using Keras. I have 6992 datapoints in my dataset. Test set is 30% of the data. And validation set is 30% of the training set. ...
1
vote
0answers
11 views

Specific data formatting techniques for discontiguous time series?

I'm facing a predicting problem for food alerts. The goal is to predict the variables of the most probable alert in the next x days (also any information I could get about future alerts is really ...
0
votes
0answers
6 views

Why don't we use training/observation data's vector similarity for building models on Tabular data? or if we do , can you name some?

Considering , we get a new observation, we try to find a 100 similar vectors from the training data and average the labels from them to get the prediction.
2
votes
1answer
19 views

Data splitting for a binary classification model

I'm trying to build a binary classification model that will tell who's going to buy the product and who's not. I've heard that splitting a dataset into two different subsets is a common way when you ...
1
vote
1answer
23 views

Loss and Regularization inference

I'm building a Matrix Factorization model for MovieLens dataset with batch-wise training. Loss function for the batch: $$ L_{batch} = 1/|B|\sum_{(u,i)\in{B}}(r_{ui} - \mu - b_u - b_i - p_u^Tq_i)^2 + \...
1
vote
1answer
40 views

What are the limitations while using XGboost algorithm? [closed]

Will XGBoost pose any problem while dealing with categorical variables with more than 2 levels. For example, occupation variable can have values like doctor, engineer, lawyer, data scientist, farmer e....
1
vote
0answers
12 views

Building a predictive algorithm in python using an inspection sensor data of an assembly line (manufacturing)

We have a manufacturing assembly line. At the end of it, there is a sensor that can measure the final product. There is a set engineering tolerance so the product will be inside the limit (OK) or ...
1
vote
0answers
26 views

Can anyone explain how fmincg works?

In the Coursera machine learning course by Andrew Ng, fmincg is used for optimization frequently. I'm not getting the mechanism of it. Can anyone give overview of how it finds the minimum of any ...
0
votes
0answers
12 views

How to measure uncertainty and prediction errors for a naive Bayesian Classifier?

I have a small dataset of 30 rows and 5 columns (4 features and 1 class). The classifier is used to give the likelihood of occurrence of an incident. thus, the class variable gives the probability of ...
0
votes
0answers
16 views

How apply Reinforcement Learning in the following case?

Suppose that I have to move from point A to B and I have to choose among 3 different paths. But we don't know the traffic in each path, so what is the training rule to use to learn the best behaviour? ...
1
vote
1answer
28 views

Machine learning algorithm that uses the Pearson or Spearman correlation?

I've come across linear and multiple regression, SVM, random forests. Does any know of a machine learning algorithm that uses the Pearson correlation or Spearman correlation? Best, Dave
1
vote
1answer
46 views

When to use Dense, Conv1/2D, Dropout, Flatten, and all the other layers?

I have a binary classification problem and want to build a NN model which classifies the data whether class 0 or class 1. My actual implementation looks like the following: ...
0
votes
0answers
12 views

Is there an algorithm for separating/clustering pairs of data so that each member of the pair goes to a distinct cluster?

Basically, I have a giant set of data that exists in pairs (A1A2B1B2C1C2...) and each piece of data has >100 variables. I'm trying to separate that data into two distinct groups, but I don't know ...
0
votes
2answers
40 views

Disadvantages of hyperparameter tuning on a random sample of dataset

I often work with very large datasets where it would be impractical to check all relevant combinations of hyperparameters when constructing a machine learning model. I'm considering randomly sampling ...
1
vote
1answer
79 views

Difference between a target and a label in machine learning

If I have a supervised learning system (for example for the MNIST dataset) I have features (pixel values of MNIST data) and labels (correct digit-value). However sometimes people use the word target (...
1
vote
0answers
173 views

“10-year-challenge” data for age algorithms? [closed]

Both on FB and IG, I see people posting themselves before 10y and now. I have no idea how this challenge started. Could it be a way to collect a colossal amount of data, that could be used to train ...
0
votes
1answer
13 views

Simple question related to an ANN diagram showing all of the matrices' dimensions: inputs, weights and output

I've been reading a few Neural Networks articles for the past week and one thing that I am still trying to grasp is the dimensioning of the matrices on an ANN training. I have created a diagram (based ...
1
vote
1answer
19 views

How to measure variable contribution to an observation in a non-linear model?

Based on my model, if I decline someone due to their score, it should be able to provide some reasoning as to which variables mainly contributed to the decision to decline. Typically in Logistic ...
0
votes
1answer
20 views

Generated training set on convnet

I have a dataset with roughly 800 images that are classified in 18 classes. The classes are spread unevenly, with some classes having 30 images and others having 5. In order to increase my dataset,...
0
votes
0answers
21 views

I want to extract the problem behind the question using NLP/NLU

I want to convert a given question to the problem behind it. For instance, This question "What free software can convert audio files into text files ?" hides a problem/action which is "Convert ...