Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

0
votes
0answers
6 views

Is setting class weight to 0 in Keras fit_generator equivalent to ignoring the class during training?

According to the Keras documentation, class_weight is a dictionary mapping class indices (integers) to a weight (float) value, used for weighting the loss function. So does that mean giving a class a ...
0
votes
0answers
6 views

Unique ETA prediction vs continuous ETA prediction

Currently I have a predictive model, which predicts ETA flight times. Specifically, this is a regression that predicts the flight time that results from some features and the target variable: ...
0
votes
1answer
10 views

Comparative Analysis of two sets of data

I have 2 sets of data which consist of marks of 60 students in a particular subject in year 1 and year 2 respectively. Year 1 : 86, 76, 87, 67, 89, 95.... so on (60 students) Year 2 : 82, 67, 99, 77,...
0
votes
0answers
9 views

Which AI/machine learning technique/tool for finding out what students are ready to learn

We have a dataset of students learning modules and results. From this we have a hard coded dependency tree which decides what they are ready to learn next. I was wondering if there is a machine ...
0
votes
1answer
14 views

Confusion on Delta Rule and Error

I'm currently reading Mitchell's book for Machine Learning, and he just started gradient descent. There's one part that's really confusing me. At one point, he gives this equation for the error of a ...
0
votes
2answers
30 views

Sports prediction using machine learning

I am trying to predict soccer scores using past results. The dataset I have only consists of the home team, the away team, goals scored by the home team and goals scored by the away team in each match....
0
votes
3answers
25 views

What Unsupervised Machine Learning algorithms can be used to detect Fraud in insurance?

I'm about to start a project regarding Fraud Detection in Insurance but there is no dependant variable to train the model and classify it. Please provide the algorithms that I can use to detect Fraud ...
1
vote
2answers
14 views

Reg. Pandas factorize()

-Hi Experts- I just read about factorise() function in Pandas. Using this I'm able to encode (enumerate) my string values into numbers. But, now I'm not able to understand what numbers corresponds ...
0
votes
2answers
18 views

Classification: how to handle reviews/long english words in feature set with all other numerical features

I am currently working on an use case where feature set contains numeric values such as amount, as well as a review feature which contains long winded english text. the english text will very well ...
0
votes
0answers
10 views

How to compare the output of Self-organizing maps?

I am trying to simultaneously cluster and visualize text documents using Self-organizing maps. Since text documents can be represented in various ways (vector space model, GloVe etc), I am trying to ...
0
votes
0answers
8 views

Do you have access to the Marmot dataset for document analysis? The official link is not working

Through here you can find all the links that are not working: http://www.icst.pku.edu.cn/cpdp/sjzy/index.htm So far I haven't been able to access this dataset.
0
votes
0answers
4 views

How to perform T-test and chi square test to my categorical variables like country, education and predict accuracy using logistic regression?

I'm new to Data science. I have been working on a classification project which has columns (Sex, Age, Occupation, Marital Status, education, country, relationship,capital gain, income). Here income('&...
0
votes
0answers
5 views

Any cluster algo can cluster time series datasets based on variation ratio(or quantity)?

I learn machine learning from sciki and read its documents. Clustering cluster groups based on the euclidean distance and filter them by different ways ex: guassian distribution, or mean-shift...etc. ...
0
votes
0answers
10 views

How to structure a scikit-learn machine learning project for predicting sports outcomes?

I'm a beginner in machine learning so please bear with what seem like uninformed questions. I'm trying to create a model that can predict the outcomes of sporting events. My approach to training and ...
0
votes
1answer
13 views

What is the difference between parameters & cooficients in Machine learning?

are both terms interchangeable? I'm kinda new to machine learning field and very confused about these terms in machine learning perspective.
1
vote
1answer
15 views

Why feature crosses may work better than having them as individual features?

On Google ML Crash Course it is said the following: If we build a feature cross from both these features: [behavior type X time of day] then we'll end up with vastly more predictive ...
-1
votes
0answers
16 views

Validation method in machine learning [on hold]

What is "mean validation method" and how is it different to validation technique?
0
votes
2answers
18 views

Normalization before or after resizing

I'm training deep learning network using images (to be exact - I'm solving semantic segmentation problem). What's the proper order of resizing (I need to resize images to fixed width X height) and ...
0
votes
1answer
14 views

Oversampling before Cross-Validation, is it a problem?

I have a multi-class classification problem to solve which is highly imbalanced. Obviously I'm doing oversampling, but I'm doing cross-validation with the over-sampled dataset, as a result of which I ...
2
votes
1answer
35 views

How to get out of local minimums on stochastic gradient descent?

I'm not programming a neural network but I'm looking at it from a non-hands-on, theoretical point of view and I'm currently wondering how to escape a local minimum and how to get to a global minimum. ...
0
votes
0answers
11 views

Job Recommendation System

I am building a Job Recommendation System where I have Student Data for different subjects in Machine Learning(Data Viz, Python, Statistics, etc) and their skills from the resume. Need to Recommend ...
0
votes
1answer
24 views

Purpose of test data in binary classification

I have a highly biased training dataset where AppId 6,7,8,9,10 are almost never purchased. I made this up just to see how good my comprehension of calculating the classification metrics is such as <...
0
votes
0answers
8 views

How to adjust deep learning parameters using Particle swarm optimization (PSO)?

As success of deep learning depends upon appropriately setting of its parameters to achieve high-quality results. The number of hidden layers and the number of neurons in each layer of a deep machine ...
0
votes
0answers
14 views

Feature selection through Random Forest and Principal Component Analysis

I am working on a binary classification problem and I have 870 numeric independent features to start with. I tried PCA on input features and picked top 200 variables corresponding to first 10 ...
0
votes
0answers
10 views

Linux commands description data set [on hold]

I am a beginner I try to build an assistant for my Linux, I choose to use machine learning approach to build it, the user will ask for any task related to files/directories manipulation in natural ...
0
votes
0answers
8 views

How do I speedup adding two big vectors of tuples? [migrated]

Recently, I am implementing an algorithm from a paper that I will be using in my master's work, but I've come across some problems regarding the time it is taking to perform some operations. Before I ...
0
votes
0answers
7 views

Identifying potential customers using social media sentiment score [on hold]

I am beginner to this area. Need head start with this topic Please share the examples of finding potential customers using social media sentiment score & also suggest suitable algorithms Swati
0
votes
0answers
6 views

Knowing Feature Importance from Sparse Matrix

I was working with a dataset which had a textual column as well as numerical columns, so I used tfidf for textual column and created a sparse matrix, similarly for the numerical features I created a ...
-1
votes
1answer
13 views

How to start learning Python for Machine Learning without spending money?

I want to start learning Python for Data Science without spending money. Where to start learning? Which resources such as books and websites do you recommend? Thank in advance for answer!
0
votes
0answers
14 views
0
votes
1answer
14 views

Metrics for presenting RNN/LSTM result

I am working on a two different architecture based on LSTM model to predict the users next action based on the previous actions. I am wondering, what is the best way to present the result? Is it okay ...
0
votes
1answer
5 views

Choose a binary classification algorithm [on hold]

I have a dataset like this: 550 rows 15 binary features(0 or 1) 1 binary target variable(0 or 1) I want to build a classifier with 80% of the above training data. Which algorithms should i try? I am ...
0
votes
1answer
32 views

Naive bayes, all of the elements in predict_proba output matrix are less than 0.5

I've created a MultinomialNB classifier model by which I'm trying to label some test texts: ...
0
votes
1answer
9 views

Survey papers on Natural Language Understanding

What are some good survey or review papers on the state of the art of machine learning approaches to grammatical/syntactic structure of natural languages?
0
votes
0answers
8 views

Tools/frameworks/libraries for inverse dynamical modeling

We have a first order dynamical system: x[t+1] = f(x[t], u[t]), where x is the system state and ...
0
votes
1answer
16 views

Predicting for future date

How do I predict a category of data for a future date ? Example: what will the Sales figure for region (or region wise) for a particular date in the future based on the sales person past data for a ...
0
votes
1answer
8 views

Size of Output vector from AvgW2V Vectorizer is less than Size of Input data

Hi, I have been seeing this problem for quite some time. Whenever I tried vectorizing input text data though avgw2v vectorization technique. The size of vectorized data is less than the size of the ...
0
votes
0answers
11 views

What is the most efficient method to detect drowsiness?

What all parameters other than face detection, speed and steering variations, yawning frequency can be used to detect drowsiness? What method is more efficient in drowsiness detection? What ...
0
votes
0answers
6 views

What is the difference between SSIM and MS-SSIM?

I would like to know what is the difference between SSIM and MS-SSIM? Also, there is a built-in function in Tensorflow for both of them, I am curious to know when should I use SSIM and when MS-SSIM? ...
2
votes
0answers
20 views

How to handle preprocessing (StandardScaler, LabelEncoder) when using data generator to train?

So, I have a dataset that is too big to load into memory all at once. Therefore I want to use a generator to load batches of data to train on. In this scenario, how do I go about performing scaling ...
0
votes
0answers
7 views

How do I combine two electromagnetic readings to predict the position of a sensor?

I have an electromagnetic sensor and electromagnetic field emitter. The sensor will read power from the emitter. I want to predict the position of the sensor using the reading. Let me simplify the ...
0
votes
0answers
9 views

Product classification in hierarchical categories based on multiple parameters and non-standard descriptions

I want to start a machine learning project in my company and a really big pain for spend analysts is to classify the products that buyers order for maintenance, tooling, raw material and such, as the ...
0
votes
0answers
16 views

Confidence Score For Trained Sentiment Analyser Model

I have trained a text based sentiment analysis model, using SciKit-learn and custom data. I have the model ready and it works fine in predicting a text to a class (Positive or Negative or Neutral). I ...
0
votes
1answer
12 views

What does it mean for an activation function to be “saturated/non-saturated”?

For context, in this paper Several RNN variants such as the long short-term memory (LSTM) [10, 18] and the gated recurrent unit (GRU) [5] have been proposed to address the gradient problems. ...
0
votes
0answers
5 views

LSTM Autoencoder on Patterns of Labels

Currently, I am trying to do anomaly detection on univariate data consisting of labels. For example: [A, A, B, C] is good but [A, A, A, A] is anomalous. I'm dealing with more than just ABC. Is an LSTM ...
1
vote
2answers
32 views

What could explain a much higher F1 score in comparision to accuracy score?

I am building a binary classifier, which classifies numerical data, using Keras. I have 6992 datapoints in my dataset. Test set is 30% of the data. And validation set is 30% of the training set. ...
0
votes
0answers
12 views

RNN and LSTM to remeber short term text data [on hold]

Does RNN with LSTM can remember text data , about four to five lines?
0
votes
0answers
6 views

Specific data formatting techniques for discontiguous time series?

I'm facing a predicting problem for food alerts. The goal is to predict the variables of the most probable alert in the next x days (also any information I could get about future alerts is really ...
0
votes
0answers
3 views

Why don't we use training/observation data's vector similarity for building models on Tabular data? or if we do , can you name some?

Considering , we get a new observation, we try to find a 100 similar vectors from the training data and average the labels from them to get the prediction.
1
vote
1answer
10 views

Data splitting for a binary classification model

I'm trying to build a binary classification model that will tell who's going to buy the product and who's not. I've heard that splitting a dataset into two different subsets is a common way when you ...