Questions tagged [mlp]

The tag has no usage guidance.

0
votes
0answers
18 views

Test set error significantly less than training set error

I am trying to model an decoder(for specifics of it, refer to the details below) using a MLP. But I am getting strange results. Metric being used here is the bit error rate (ber). My training set and ...
0
votes
1answer
28 views

What does it mean when an Actual vs Predicted plot is like this assuming you are using the best model?

I'm trying to predict the monetary value in a fixed time-frame for a project. I wanted to start with a baseline model before doing any feature engineering or advanced pre-processing. I'm using a feed-...
2
votes
1answer
32 views

How to understand what each layer is learning in a Deep learning neural network?

In a recent answer I read on Stack Exchange, I read about a possible way to understand more clearly what happens in each hidden layer of a neural network. Here's the excerpt- You should watch ...
3
votes
1answer
55 views

Geometric interpretation of MLP output

I am really interested in the geometric interpretation of perceptron outputs, mainly as a way to better understand what the network is really doing, but I can't seem to find much information on this ...
2
votes
0answers
16 views

Pruning for multi-layer perceptron

Here, I have the single hidden layer multi-layer perceptron (Input: 4 units, hidden unit: 3 units, output: 1 unit). I want to do pruning before a training process with Keras. Concretely, I just want ...
0
votes
1answer
20 views

Keras MLP Classifer Model not converging

I'm trying to make MLP based classifier based on numerical and categorical data The train_X (Input) data that I'm working with is look like that each data type is 20 numerical and 1 categorical ...
3
votes
1answer
173 views

Why would one crossvalidate the random state number?

Still learning about machine learning, I've stumbled across a kaggle (link), which I cannot understand. Here are lines 72 and 73: ...
0
votes
1answer
21 views

What are the key differences between a MLP with lagged features and a RNN

I've been working with MLP's for a while. Whenever I assumed that the past values of a feature might be useful for predicting the future values of Y, I would just create a new column in my data frame ...
1
vote
1answer
25 views

Why is my MLP with 2 features is doing worse than MLP with 1 feature where the one feature is a combination of feature1*feature2?

I have programmed a MLP for a dataset (~500 rows) containing the length (L) and width (W) of an organism and the output of biomass (the organisms weight in pounds, B). ...
0
votes
0answers
30 views

Deep learning(MLP) on multiclass classification. Model learns only one class

I am new to deep learning. I have imbalanced class data. I used one hot encoding and scaling to preprocess my data. I have used adamoptimizer as optimizer function and sparse categorical crossentropy ...
0
votes
0answers
21 views

Use of MLP with one hidden layer and direct weights from input to output units

One of the questions I saw online while reading about MLPs was - "Consider an MLP architecture with one hidden layer where there are also direct weights from the inputs directly to the output units. ...
0
votes
0answers
23 views

Diffirent results in a function approximation problem using MLPRegressor and Keras

I have different results in a function approximation problem. I am trying to approximate a sine wave using MLPRegressor and Keras (um dense layer) Here is the code for the MLPRegressor: ...
0
votes
1answer
46 views

Why is the reported loss different from the mean squared error calculated on the train data?

Why the loss in this code is not equal to the mean squared error in the training data? It should be equal because I set alpha =0 , therefore there is no regularization. ...
1
vote
0answers
53 views

How Does Sci-Kit Learn Train Regression Neural Networks (MLPRegressor) So Fast?

Why does using the scikit-learn library's MLPRegressor result in such a boost in training time when compared to constructing the network from scratch? I tried both methods and I found that writing the ...
1
vote
1answer
58 views

IN CIFAR 10 DATASET

After building up the mlp using ...
1
vote
2answers
38 views

Input data of variable length - two scenarios

I'm trying to figure out how I could train a neural network with inputs that have variable length. This issue comes up in the following 2 scenarios I'm trying to solve. Scenario 1: I have a long list ...
3
votes
1answer
65 views

How to utilize user feedback due to miss-classification when correct class label is unknown?

Suppose we are developing an app which is supposed to predict a dog's breed by it's picture. We trained a classifier (in my case an MLP) using some dataset and shipped the app to users. Now suppose ...
1
vote
0answers
35 views

Interpreting MLP output

I just wrote an MLP in Python. After having trained it, I pass in some test data to see the result, and I get an array of decimal numbers at the output, rather than the desired binary output. For ...
3
votes
1answer
30 views

Coding MLP: good practices?

I recently finished coding my own MLP neural network in Python. To make my code easier to read, I separated the MLP, into classes; the network class, the layers class and the neuron class, where the ...
7
votes
4answers
97 views

How to handle features which are not always available?

I have a feature in my feature vector that is not always available respectively sometimes (for some samples) it makes no sense to use it. I feed a sklearn MLPClassifier with this feature vector. Does ...
2
votes
2answers
894 views

How do I get the feature importace for a MLPClassifier?

I use the MLPClassifier from scikit learn. I have about 20 features. Is there a scikit method to get the feature importance? I found clf.feature_importances_ but it seems that it only exists for ...
1
vote
1answer
54 views

Can a neural network recognize a letter B as an A if your trained it so?

You have a neural network. And you have, say, pictures of $100,000$ hand-written letters (A-Z). Now you make a typical Training and the neural network will recognize an A as an A, a B as a B, ... Now ...
1
vote
1answer
79 views

One Hot Encoding of Age

My task is to predict how many years a person has left to live using an MLP. There is one specific feature I'd like to discuss: current age. Statistically, it's a conditional probability. Example: ...
2
votes
2answers
389 views

Adding more layers decreases accuracy

I have my ANN trained on MNIST dataset. Hidden layer has 128 neurons and input layer has 784 neurons. This gave me an accuracy of 94%. However when I added one more layer with 64 neurons in each then ...
0
votes
1answer
54 views

Validation loss differs on GPU vs CPU

I am consistently seeing higher validation loss when I train & evaluate a model on AWS GPU vs local CPU. I am using the exact same train/eval datasets and the exact same Tensorflow code and ...
1
vote
1answer
160 views

Why might a neural network consistently underestimate its target?

I have a neural network (MLP) that is consistently underestimating the target variable on the validation set, test set, and on the training set (by about the same amount as on the validation set and ...
2
votes
1answer
168 views

multilayer perceptron do not converge

I have been coding my own multi layer perceptron in MATLAB and it can be compiled without error. My training data features,x, has values from 1 to 360, and training data output, y, has the value of ...
4
votes
2answers
311 views

What is the difference between multi-layer perceptron and generalized feed forward neural network?

I'm reading this paper:An artificial neural network model for rainfall forecasting in Bangkok, Thailand. The author created 6 models, 2 of which have the following architecture: model B: ...
2
votes
1answer
54 views

Is the multilayer perceptron only able to accept 1d vector of input data? If yes, why is this so?

I am going through the tutorial at the link below which uses MNIST handwritten digit database. https://machinelearningmastery.com/handwritten-digit-recognition-using-convolutional-neural-networks-...
1
vote
1answer
10k views

How to adjust the hyperparameters of MLP classifier to get more perfect performance

I am just getting touch with Multi-layer Perceptron. And, I got this accuracy when classifying the DEAP data with MLP. However, I have no idea how to adjust the hyperparameters for improving the ...
2
votes
0answers
69 views

MLP conv layers

When should MLP conv layers be used instead of normal conv layers? Is there a consensus? Or is it the norm to try both and see which one performs better? I would love to better understand the ...
3
votes
1answer
31 views

alternatives to regression to decide weights in an expression

I have a use case in which I am required to predict variable y which depends on 5 variables, xi. Consider something like [ w1*x1 + w2*x2 + w3*x3 + w4*x4 + w5*x5 = y] This expression doesn't ...
1
vote
3answers
338 views

More layers in NN give worse result

So I was working on a classification task with the help of a NN. The data-set was normalised, weights random between 0-1, and all the activations were sigmoid ...
2
votes
3answers
87 views

How each layer of a neural net is responsible for one feature

Through my study of neural networks, I came across the idea that each layer of a neural network is responsible for recognizing one feature of the input data. For example, if we build a neural network ...
2
votes
2answers
2k views

MLPRegressor Output Range

I am using Scikit's MLPRegressor for a timeseries prediction task. My data is scaled between 0 and 1 using the MinMaxScaler ...
1
vote
2answers
85 views

data pre-processing before feeding into a deep learning model

Generally speaking, when training a deep learning model, like MLP, what kind of data pre-processing operation has to be conducted when the input is a numerical sequence.
1
vote
2answers
69 views

Neural Network Hidden Layer Selection

I am trying to build an MLP classifier model on a dataset containing 30000 samples and 23 features. What are the standards I need to consider while selecting the ...
0
votes
1answer
2k views

number of neurons for mnist dataset using mlp?

I am trying to find out what is optimum number of neurons that can be used in MNIST dataset(60,000 training and 10,000 testing data). I build a single hidden layer model using keras,with relu ...
1
vote
1answer
275 views

Polynomial regression vs. multilayer perceptron [closed]

Polynomial regression and multilayer perceptrons have different structures and different learning procedures. What are these two algorithms pros and cons? Are there some situations where one should ...
1
vote
2answers
298 views

How to obtain with a recurrent neural network the Xor function using keras? [closed]

I'm trying to implement a model of recurrent neural network to solve the XOR problem, but I am not still able to do that. Any hints?