StatsSorceress
  • Member for 4 years, 9 months
  • Last seen this week
How can we convert time series data to supervised learning problem?
0 votes

Short answer: Yes. Long answer: See here: https://machinelearningmastery.com/time-series-forecasting-supervised-learning/

View answer
Calculate likelihood of a date being worked based on location, hours and rate of pay
1 votes

If you're looking for code, I'm not familiar with C#. My answer will focus on theory. tl;dr most machine learning-related packages have a built-in logistic regression function of some sort. That's ...

View answer
Neural network is not giving the expected output after training in Python
0 votes

It looks like your loss is improving (the loss is decreasing every epoch), so I wouldn't say the network isn't training. Try looking at a training plot (which would have epoch on the x-axis and loss ...

View answer
What is difference between feed forward neural network and LSTM?
Accepted answer
4 votes

A feed-forward neural network looks like this: input -> hidden layer 1 -> hidden layer 2 -> ... -> hidden layer k -> output. Each layer may have a different number of neurons, but that's the ...

View answer
Multi-class classification with mostly zero valued data
0 votes

Welcome! Sounds like your data set is highly imbalanced. For techniques on handling an imbalanced data set, please have a look at this. https://machinelearningmastery.com/tactics-to-combat-imbalanced-...

View answer
What is the minimum requirement for the dataset for time series forecasting?
Accepted answer
1 votes

Welcome to the site! Forecasting can be done using any length of time series. For example, if I have a set of data {1, 10, 19, 28}, then I can be pretty sure that the next value in the set is going ...

View answer
Adam optimizer for projected gradient descent
1 votes

tl;dr: All gradient descent-based methods have an update rule similar to Adam's, so I think they'd all give you some grief. I don't know of any optimizers tailored to your application (but maybe you ...

View answer
Standard Deviation for Z-scores
Accepted answer
1 votes

I agree with some aspects of Skiddles' answer, but not all. Assume your data set contains n observations. Based on your question, I see three possibilities: If you're interested in the number of ...

View answer
Does bagging create iid trees?
Accepted answer
0 votes

This question may be more suited to CrossValidated. However: "Bagging" is short for "bootstrap aggregating", meaning that a random sample with replacement is taken from the overall set. The key here ...

View answer
LSTM: How to deal with nonstationarity when predicting a time series
1 votes

Looking again at your autocorrelated process: def my_process(n, p, drift=0, displacement=0): x = np.zeros(n) for i in range(1, n): x[i] = drift * i + p * x[i-1] + (1-...

View answer
How to weigh imbalanced softlabels?
0 votes

If you have imbalanced classes (for example, if you have 3 classes and 100 examples of class 1 and 1000 examples of class 2 and 5000 examples of class 3), then yes, I would weight the loss function (I ...

View answer
Classification of very similar images
2 votes

You're going to have to do some experimenting to figure out what is 'best', but I would recommend starting with a convolutional neural network. Since you're only detecting a very small difference, ...

View answer
Matrix Confusion - Get Model Precision
Accepted answer
2 votes

A confusion matrix gives you the following: [TP, FP] [FN, TN] where TP = 'true positives'; FP = 'false positives'; FN = 'false negatives'; TN = 'true negatives'. You can read more here: http://www....

View answer
Multivariate time series classification
1 votes

Following up on the comment about deep learning, with high dimensional time series data you would be much better served with a recurrent-type of deep model. For example, an LSTM is a very good ...

View answer
Applying machine learning algorithms to subset of attributes in dataframe
Accepted answer
1 votes

Applying a machine learning algorithm on only a subset of the data and including other subsets later does not allow the algorithm to assess the importance of each attribute equally. For example, say ...

View answer
Sliding window leads to overfitting in LSTM?
Accepted answer
13 votes

Although the previous answer by @Imran is correct, I feel it necessary to add a caveat: there are applications out there where people do feed a sliding window in to an LSTM. For example, here, for ...

View answer
Right Way to Input Text Data in Keras Auto Encoder
Accepted answer
1 votes

Here's my take on your questions. Yes, you can zero-pad vectors. However, I would strongly recommend you use an LSTM as part of your encoder if you're using sentences as input. An LSTM can take ...

View answer
Layer notation for convolutional neural networks
Accepted answer
3 votes

One paper referenced by the first paper you linked to is here. It explains in section 3 (experiments) the following notation: 2x48x48-100C5-MP2-100C5-MP2-100C4-MP2-300N-100N-6N represents a net ...

View answer
Several fundamental questions about CNN
1 votes

Here's my take on each of your points. You have very sparse data. Are you storing these data optimally in a sparse object, for example a csr sparse matrix if you're using Keras? This is more likely ...

View answer
which neural network topology to learn correlations between time series?
2 votes

It depends a little on what kind of correlations you're looking for. Are you expecting a correlation that is present at each time step/window, or a different level of correlation per time step/window? ...

View answer
How to find categorical features from a vector representation of text?
0 votes

You could try a clustering algorithm on the vector representation of your text data to see what clusters exist. Then once you have discovered the unique clusters, assign a cluster identity (for ...

View answer
What are some methodologies for performing feature selection for simple feed-forward neural networks?
1 votes

In addition to what was suggested by @Media, you may consider adding a softmax layer to your model right above your input layer. This is a way of visualizing which features are strongly associated ...

View answer
How to cross-validate a deep learning model for highly imbalanced datasets?
Accepted answer
3 votes

Accuracy is not a good indicator of success with imbalanced data. The accepted answer is correct: F1 score is commonly used. Other options include roc_auc_score (see here) and average_precision_score (...

View answer
Logistic Regression Independent Samples
2 votes

Context / big picture: Two events are independent if they have no influence on each other's outcomes. For example, if event A is "I go get coffee" and event B is "it's raining outside", then events A ...

View answer
LSTM predicting expected value and standard deviation with one-hot encoding
2 votes

The standard deviation and mean of a categorical variable is not meaningful. It looks like the original data are from a range of [0, 20), and the space has been discretized. Now, instead of ranges, ...

View answer
Detecting Different Distributions in data
0 votes

I think you're looking for a measure of difference between two probability distributions. In that case, if you have two continuous distributions, try measuring the KL divergence (more information is ...

View answer
Clarification on the Keras Recurrent Unit Cell
1 votes

The value '32' in this case is the size of the cell state and the size of the hidden state being sent forward in the network. Please see my answer here for more information.

View answer
Trying to make compelling plot for classification results with python
6 votes

It's really rare that you'd show a plot of the probabilities for each example in your set. Are you sure you want to do this? A better presentation might be a confusion matrix. Here's how it works: 1) ...

View answer
Tips and tricks for designing time-series variational autoencoders
Accepted answer
3 votes

I can speak from a more theoretical point of view, but honestly I haven't had much success with VAEs. 1) How deep should my encoder and decoder network be? Are there any good guidelines? That ...

View answer
Forget Layer in a Recurrent Neural Network (RNN) -
Accepted answer
15 votes

Great question! tl;dr: The cell state and the hidden state are two different things, but the hidden state is dependent on the cell state and they do indeed have the same size. Longer explanation ...

View answer