Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

2
votes
0answers
32 views

Audio files and their corresponding spectrograms for image classification process

Suppose I have a dataset of audio files that I have to use for whale sound classification. I am choosing the strategy of treating it as an image classification problem by using their corresponding ...
1
vote
0answers
6 views

Tensor operation in Tensorflow

I have a tensor of shape (3,?,16). I want to tile each (1,16) sub-tensor 28 times horizontally and vertically so as to end up with a resultant shape of (3,?,28,28.16). How do I go about doing this?
0
votes
0answers
21 views

Tensor Operation in Tensorflow

I have 2 tensors tensor A and tensor B as shown in the image. I want to take each 1x16 vector from tensor B and perform a dot product with the correcponding batch (axis 0 is the batch dimension in ...
1
vote
2answers
60 views

What is the difference between “offline trained model” and “pretrained model”?

I am confused that both are same or not, and then how can I differentiate with the online training model.
2
votes
0answers
24 views

How to force histogram plots to have same axes?

I am comparing my trained model with other benchmark models with the error histogram but the axis of histogram is different for each method as shown in figure.For instance to plot the error histogram ...
0
votes
0answers
15 views

Binary Classifier for photo detection

Two training sets are involved, one complete, one with missing feature data as well. The data consists of CNNs and GIST features. For the normalising, I have MinMax Scaler feature. I have cleaned up ...
0
votes
0answers
27 views

Feature selection caused more overfitting

What does it mean if I used sklearn.feature_selection.SelectFromModel to select features and cross-validation score went up but the testset score went down. This was even more significant compared to ...
7
votes
1answer
76 views

Is it OK to try to find the best PCA k parameter as we do with other hyperparameters?

Principal Component Analysis (PCA) is used to reduce n-dimensional data to k-dimensional data to speed things up in machine learning. After PCA is applied, one can check how much of the variance of ...
0
votes
1answer
29 views

Confusion in applying k-fold cross validation to dataset

I have a data set which is already divided into 10 folds with each fold having training,validation and test sets. I'm not able to understand how to apply 10 fold cross validation on this data set. In ...
1
vote
3answers
29 views

Machine learning in audio?

What are recommended books or online courses that are mostly helpful to someone wanting to delve into machine learning specifically in audio? Or is the learning path mostly the same as for any other ...
3
votes
1answer
63 views

VC dimension of hypothesis space of finite union of intervals

I have the following concept: $$C = \left\{\bigcup_{i=1}^{k}(a_i, b_i): a_i, b_i \in {\Bbb R}, a_i < b_i, i=1,2,..,k\right\} $$ and was wondering how to determine the VC dimension of C?
0
votes
0answers
14 views

Getting Strange Values In Machine Learning Classification Model

I'm trying to train a machine learning model on the following data. Here is a sample: key A0 A1 A2 A3 A4 A5 A6 A7 A8 A9 a 12 15 28 35 22 10 11 10 18 11 d 11 14 29 24 10 ...
1
vote
1answer
32 views

What are the ways to partition a large file that does not fit into memory so it can later be fed as training data?

Is there any other way to partition a large file that does not fit into memory so it can be fed as training data other than using spark? or hadoop?
0
votes
0answers
12 views

What are the crucial steps for creating a recommender system using multiclass classification?

I want to build a recommender system via multiclass classification ( i have 10 classes in the target variable which are products ). I have 5 or 6 features describing a person. I already built a model ...
0
votes
0answers
11 views

What is Computatational Time of Tranisition & Emission Probabilities of Hidden Markov Model?

Not overall Computational Time of Hidden Markov Model. I want to know complexity only for transitions(observed & UnObserved)of HMMs. Note:: Transition & Emission Probabilities are d-by-d ...
1
vote
1answer
26 views

is it bad to have many different measurements for the same target variable?

I'm working on a dataset that has repeated measurements for the same target variable. When I don't change anything and create model, cross validation overfits with 0.99 score but in testset it gives ...
2
votes
2answers
58 views

How to correctly apply the same data transformation , used on the training dataset , on real data in a webservice?

Let's say I used minmaxscaler while creating my model. Now, i'm loading that model via Pickle in a Flask app. Upon receiving a request containing a datapoint I would like to apply to it the same ...
0
votes
1answer
44 views

How to calculate which word fits the best given a context and possible words?

I have this task for research purposes and searched a while for a framework or a paper which already took care of this problem. Unfortunately I don't find anything which helps me with my problem. I ...
1
vote
0answers
28 views

What simple machine learning algorithm to use in POS tagging [closed]

I am new to NLP. I have a dataset that has already a parts of speech included, the only problem is what algorithm to use in order to train my dataset. Sample: ...
1
vote
1answer
19 views

Is there a model that can adapt to additional new training data with different columns?

My training data comes in batches. Sometimes, new batches (completely new samples) come with new columns that are not in old batches, or they may be missing some of the old columns. For example, ...
0
votes
0answers
12 views

Learn User interests from feedback

I'm trying to create a pairwise learning model where user will be provided with 2 items (say $A$ and $B$) from which the user will provide the preference order ($A$ over $B$ or vice versa). Let's say ...
0
votes
1answer
29 views

Combining Classifiers with different Precision and Recall values

Suppose I have two binary classifiers, A and B. Both are trained on the same set of data, and produce predictions on a different (but same for both classifiers) set of data. The precision for A is ...
1
vote
2answers
25 views

Gradient Descent Convergence

I'm a double major in Math and CS interested in Machine Learning. I'm currently taking the popular Coursera course by Prof. Andrew. He's talking and explaining Gradient Descent but I can't avoid ...
1
vote
1answer
68 views

Simple example of Parzen window (kernel density estimation)

I am confused about the Parzen Window question. Suppose we have two training data points located at 0.5 and 0.7, and we use 0.3 as its rectangle window width. How do we estimate its probability ...
0
votes
0answers
10 views

How to measure the co-variance of multiple choice answers to predict a correct answer to a question?

In this article from Mux: https://mux.com/blog/how-we-used-machine-learning-to-predict-hq-trivia-answers/ They talk about using the xgboost algorithm to predict multiple choice answers to questions ...
4
votes
1answer
24 views

How to use a one-hot encoded nominal feature in a classifier in Scikit Learn?

Im working on a genre classification problem on a songs dataset. Since genre is a nominal feature, I used sklearn's LabelBinarizer to get the one-hot encoding for this feature for every row in the ...
0
votes
0answers
22 views

Is it always better to using stacked LSTM than single LSTM?

I am currently studying LSTM and RNNs. I came across several concepts like Multidimensional LSTM and Stacked LSTM. I have used Stacked LSTM and it gives me a better performance than single LSTM. As ...
-2
votes
0answers
20 views

What is the difference between these source codes (XGBoost)

I want to know what is the difference between the two codes? and which one do you advise me to use it? Code 1: ...
0
votes
0answers
10 views

Issues of Standard Recurrent Neural Network

Can anybody explain me the two issues of standard RNN’s i.e Exploding Gradients and Vanishing Gradients.
2
votes
3answers
34 views

Machine Learning, Imputing values that should be blank

Sometimes data sets contain variables that indicate the presence of an event and the value that represented the event. As an example say a teacher wants to predict the grades of his students. Some of ...
2
votes
1answer
30 views

What happens if GBM parameters (e.g., learning rate) vary as the training progresses?

In neural networks there is an idea of a "learning rate schedule" which changes the learning rate as training progresses. This made me ask the question, what would be the impact of varying ...
0
votes
0answers
23 views

Multiclass class classification for text document

I have text document and I want to extract 5 specified types of words or phrases out of this document. I am thinking of using NER first and then multi class classification of NER output. 1. Is there ...
1
vote
2answers
41 views

How do I approach learning Data Science/ML the 'rightest' way? [closed]

First of all, I am not sure if this is the right place to post this so please do let me know if it isn't and tell me where it should be. I really just don't know where to go with this question. Some ...
2
votes
1answer
41 views

Not able to interpret decision tree when using class_weights

I'm working with an imbalanced dataset. I'm using a decision tree (scikit-learn) to build a model. For explaining my problem I've taken iris dataset. When I'm setting class_weight=None, I understood ...
1
vote
1answer
67 views

How to approach a machine learning problem? [closed]

I'm a beginner in machine learning, and no real statistical background ( just basic knowledge ). I comprehend half of what is said on forums about statistical methods and techniques for normalizing ...
0
votes
1answer
24 views

How to choose between classification Vs regression approach?

I need to predict the profitability of the products of a retailer. I can either predict the absolute value of the profit the products will make (continuous outcome) or predict whether the products ...
1
vote
0answers
21 views

Pearson's Coefficient for classification problem

Can we use Pearson's Correlation Coefficient to calculate the correlation between features and target in the case of a classification problem?
0
votes
0answers
18 views

Any model can reach to train incrementally but doesn't lose accuracy/mse?

I have huge dataset in my single computer so that memory is insufficient. I want to train incrementally with xgboost, but I found incremental training isn't like what I thought. I thought: ...
0
votes
0answers
15 views

How can I increase CUDA load on a Tensorflow deep learning task after reducing batch size to fit the GPU?

I am running this TensorFlow task for Swahili-to-English on an NVidia GeForce 1060 GPU with 6GB of VRAM: https://colab.research.google.com/github/tensorflow/tensorflow/blob/master/tensorflow/contrib/...
2
votes
1answer
38 views

Difference in model performance measures of train and test data sets

I am using CART classification technique by dividing a dataset into train and test sets. I have been using Mis-classification error, KS by rank ordering, AUC and Gini as MPMs(model performance ...
1
vote
0answers
31 views

LSTM cell input dimensionality

I am trying to wrap my head around LSTM networks, specifically about the input dimensionality. Suppose we have the following dataset Timestamp Value 1 32 2 44 3 52 4 33 5 23 6 11 ...
1
vote
0answers
8 views

Ensemble learning for multiple hypothesis classes

Just to confirm if the following description falls in the category of ensemble learning. Suppose given a training set $D=\{(X,Y)\}$ we are asked to train a regressor. But now the way we do it is to ...
4
votes
1answer
78 views

getting the weights of intermediate layer in keras

I have an image dataset 376 classes each class has 15 pictures corresponds to a person. I would like to get the feature vector that corresponds to each person. What I have done is, after I compiled ...
3
votes
1answer
31 views

How do I create a data set that has a set of features for multiple options, with one option being the expected outcome?

Most datasets I see are: feature 1, feature 2, feature 3, outcome Where outcome is binary e.g. if they are cancer positive outcome will be 1 and 0 if they don't have cancer. How do I create a ...
1
vote
1answer
21 views

How to decide the processing power required based on the dataset?

To train a machine learning model, the computer often needs more processing power. In this case, a powerful CPU is needed, since it is a large data set, it needs more memory, so rather than a CPU, GPU ...
0
votes
3answers
39 views

How do I use TF*IDF scores for my machine learning model?

I have applied TF*IDF on the 'Ad-topic line' column of my dataset. For every ad-topic line, I get the same output: Firstly, I am unable to make sense of the output. The TF*IDF values are mentioned to ...
0
votes
0answers
24 views

How to transform session-based data into training data?

I am about to build a ML model for an e-commerce shop and would like to hear some thoughts/ideas from you before I start. In short: the purpose of the model that I am about to build is to prevent ...
1
vote
2answers
32 views

Learnable parameters in DNN

I've came across the term "learnable parameters" recently, and googling didn't help much as most search was describing learnable parameters in a CNN instead of a DNN. Is there any difference between ...
0
votes
1answer
17 views

Action Recognition for multiple objects and localization

I want to ask question regarding the action detection on the video with proposed frames. I've used Temporal 3D ConvNet for the action recognition on video. Successfully trained it and can recognize ...