Questions tagged [mlp]

MLP stands for multi-layer perceptron, the most basic kind of neural network. Also called DNN (deep neural network), as opposed to CNN or RNN (convolutional and recurrent neural networks).

Filter by
Sorted by
Tagged with
0
votes
0answers
6 views

Sparse data and Neural Networks

I am trying to learn a model to predict the binary outcome of a computer game. The input data consists of the character picks by each of the ten players (two teams of 5, 150 possibilities each, with ...
0
votes
0answers
5 views

keras how to subset input in Model

I have a data of the following format: ...
0
votes
0answers
11 views

Which values should i use as data for this Weka problem?

I have a problem that has to be translated into an ARFF file. We have a robot that has to reach X without going to the black squares. It can go up, down, left, right, or stay to its position. These ...
0
votes
0answers
21 views

Am I doing bayesian optimization correctly for MLP?

I am trying to optimize the below mentioned hyper-parameters of MLP with range as follows. Number of hidden layers (n): 1-10 Number of perceptrons (p): 25, 50, 75, ..., 200 Activation function: ...
1
vote
3answers
52 views

Are weights of a neural network reset between epochs?

If an epoch is defined as the neural network training process after seeing the whole training data once. How is it that when starting the next epoch, the loss is almost always smaller than the first ...
0
votes
1answer
25 views

(De-)Scaling/normalizing input and output data inside Keras model as layer

I am building a 2-hidden layer MLP using Keras. I'm using a SciKit learn wrapper to be able to use the GridSearchCV functionality. My sample-size is limited, ...
0
votes
0answers
18 views

NLP Word ordering problem in Keras

I'm trying to solve the word ordering task: given a syntactically unordered sentence, recover the right order of the words. The adopted approach is to transform each sentence in a dependency tree and ...
0
votes
0answers
12 views

Understanding usage of dropout in Keras

I would like to check if my understanding of how dropout layers should be used in Keras training is correct. I am training pretty simple MLP regression models: ...
1
vote
1answer
17 views

SciKit Learn: Multilayer perceptron early stopping, restore best weights

In the SciKit documentation of the MLP classifier, there is the early_stopping flag which allows to stop the learning if there is not any improvement in several ...
0
votes
1answer
26 views
1
vote
0answers
9 views

Which MSE (total or individual) back-propagate for multi out regression neural network

When we have multi output regression neural network, we can calculate total MSE and individual MSE per output. How this MSE should back-propagate ? Shouldn't we back-propagate individual MSE through ...
1
vote
0answers
16 views

Structuring experiment/training data with months in mind

We're using a whole year's data to predict a certain target variable.The model works like data - OneHot encoding the categorical variables - MinMaxScaler - PCA (to choose a subset of 2000 components ...
1
vote
1answer
15 views

LabelEncoder with a Multi-Layer Perceptron?

So we're working on a machine learning project at work and it's the first time I'm working with an actual team on this. I got pretty good results with a model that uses the following SKLearn pipeline: ...
0
votes
1answer
78 views

Logistic Regression outperforms MLPClassifier

I am new in ML and I am trying to train classifier. I have a tiny dataset, just 90 examples, I divided it 70/30 train/test set and started to train. As I know MLP must outperform Logistic Regression, ...
0
votes
0answers
22 views

How to define the right range values for learning rate, epochs, batch size and hidden layers in a neural network

Well, these last days I am focusing more on developing some experiments with MLP and after CNN neural networks to a paper, here when I was running the experiments I realized that only if I put 0 in ...
0
votes
1answer
16 views

Is it possible to decompose a scalar value to a inter-dependent vector neural network?

My data contains a scalar feature $r$, I found this feature is important for training my deep model. My idea is supposing there is a 3-layer MLP $f(x), x \in \mathbb{R}^{n}$, where $n=1$. It outputs a ...
1
vote
1answer
33 views

Different hidden layer architectures deliver the same classification results, is that normal?

I have a data set with 600 data points with about 10 attributes (binary). The dataset has been normalized: Xnormalized = StandardScaler().fit_transform(X) The ...
0
votes
0answers
24 views

can i get weights per iteration of MLP?

im building an mlp with scikit learn. Is there a way I can access weights and biases of the output layer per iteration? There is an option mlp.coefs_ But it ...
2
votes
2answers
36 views

how to access weights of individual Neurons in the output layers in MLPs?

im working on a neural network using Keras. Its an mlp(multi-layer perceptron). With 8 Neurons in the output layer. Is there a way I can access weights and biases of individual neurons of the output ...
1
vote
1answer
40 views

Scikit model is not able to predict sequence correctly

I am trying to create a regression model using scikit-learn for predicting car price. The input data are, car model(trim), kilometers used, past resale price of similar car and age of used car. I am ...
2
votes
2answers
61 views

About different structures of neural network

https://www.mathworks.com/help/deeplearning/ref/fitnet.html is the tutorial that I am following to understand fitting data to a function. I have few doubts regarding structure and terminologies which ...
0
votes
0answers
18 views

Neural Network to classify target subitens?

Nowadays i am doing a research project where i am allowed to classify given a sample from a large dataset with an already existed sample/target model the belonging target, but in my project there are ...
2
votes
1answer
52 views

Conceptual questions on MLP and Perceptrons

I am facing some confusion regarding the terminologies assocaiated to classification and regression problems esp. using the MLP and Perceptron models. These are the following: 1) When the data is ...
1
vote
0answers
35 views

Help with MLP convergence

I posted this question on AI SE and got advised to ask here for guidance. I've been stuck for a couple of days trying to figure it out how the standard MLP works and why my code doesn't converge at ...
0
votes
2answers
377 views
0
votes
1answer
72 views

Getting different precisions for same neural network with same dataset and hyperparameters in sklearn mlp classifier

I get WAY DIFFERENT results in each run despite using random state for making sure that network outputs same result for same hyper parameters, here is some sample outputs(I've printed the hyper ...
0
votes
0answers
52 views

Issue with using PCA on MLPClassifier

I'm trying to tune my MLPClassifier using GridSearchCV, but it takes ages, so I was wondering if using PCA data will decrease ...
0
votes
1answer
326 views

MLP Parameter tuning - gridsearchCV cannot fit?

I'm making an MLP classifier for binomial classification from 145 features. I want to get the best parameters on my MLP classifier to get a better prediction so I followed the answer to this question,...
0
votes
0answers
22 views

Test set error significantly less than training set error

I am trying to model an decoder(for specifics of it, refer to the details below) using a MLP. But I am getting strange results. Metric being used here is the bit error rate (ber). My training set and ...
0
votes
1answer
56 views

What does it mean when an Actual vs Predicted plot is like this assuming you are using the best model?

I'm trying to predict the monetary value in a fixed time-frame for a project. I wanted to start with a baseline model before doing any feature engineering or advanced pre-processing. I'm using a feed-...
2
votes
1answer
75 views

How to understand what each layer is learning in a Deep learning neural network?

In a recent answer I read on Stack Exchange, I read about a possible way to understand more clearly what happens in each hidden layer of a neural network. Here's the excerpt- You should watch ...
3
votes
1answer
100 views

Geometric interpretation of MLP output

I am really interested in the geometric interpretation of perceptron outputs, mainly as a way to better understand what the network is really doing, but I can't seem to find much information on this ...
2
votes
0answers
67 views

Pruning for multi-layer perceptron

Here, I have the single hidden layer multi-layer perceptron (Input: 4 units, hidden unit: 3 units, output: 1 unit). I want to do pruning before a training process with Keras. Concretely, I just want ...
0
votes
1answer
67 views

Keras MLP Classifer Model not converging

I'm trying to make MLP based classifier based on numerical and categorical data The train_X (Input) data that I'm working with is look like that each data type is 20 numerical and 1 categorical ...
3
votes
1answer
240 views

Why would one crossvalidate the random state number?

Still learning about machine learning, I've stumbled across a kaggle (link), which I cannot understand. Here are lines 72 and 73: ...
0
votes
1answer
46 views

What are the key differences between a MLP with lagged features and a RNN

I've been working with MLP's for a while. Whenever I assumed that the past values of a feature might be useful for predicting the future values of Y, I would just create a new column in my data frame ...
1
vote
1answer
42 views

Why is my MLP with 2 features is doing worse than MLP with 1 feature where the one feature is a combination of feature1*feature2?

I have programmed a MLP for a dataset (~500 rows) containing the length (L) and width (W) of an organism and the output of biomass (the organisms weight in pounds, B). ...
0
votes
0answers
84 views

Deep learning(MLP) on multiclass classification. Model learns only one class

I am new to deep learning. I have imbalanced class data. I used one hot encoding and scaling to preprocess my data. I have used adamoptimizer as optimizer function and sparse categorical crossentropy ...
0
votes
2answers
184 views

Why is the reported loss different from the mean squared error calculated on the train data?

Why the loss in this code is not equal to the mean squared error in the training data? It should be equal because I set alpha =0 , therefore there is no regularization. ...
1
vote
0answers
112 views

How Does Sci-Kit Learn Train Regression Neural Networks (MLPRegressor) So Fast?

Why does using the scikit-learn library's MLPRegressor result in such a boost in training time when compared to constructing the network from scratch? I tried both methods and I found that writing the ...
1
vote
1answer
208 views

IN CIFAR 10 DATASET

After building up the mlp using ...
1
vote
2answers
91 views

Input data of variable length - two scenarios

I'm trying to figure out how I could train a neural network with inputs that have variable length. This issue comes up in the following 2 scenarios I'm trying to solve. Scenario 1: I have a long list ...
3
votes
1answer
75 views

How to utilize user feedback due to miss-classification when correct class label is unknown?

Suppose we are developing an app which is supposed to predict a dog's breed by it's picture. We trained a classifier (in my case an MLP) using some dataset and shipped the app to users. Now suppose ...
2
votes
1answer
83 views

Interpreting MLP output

I just wrote an MLP in Python. After having trained it, I pass in some test data to see the result, and I get an array of decimal numbers at the output, rather than the desired binary output. For ...
3
votes
1answer
39 views

Coding MLP: good practices?

I recently finished coding my own MLP neural network in Python. To make my code easier to read, I separated the MLP, into classes; the network class, the layers class and the neuron class, where the ...
8
votes
4answers
125 views

How to handle features which are not always available?

I have a feature in my feature vector that is not always available respectively sometimes (for some samples) it makes no sense to use it. I feed a sklearn MLPClassifier with this feature vector. Does ...
4
votes
2answers
5k views

How do I get the feature importace for a MLPClassifier?

I use the MLPClassifier from scikit learn. I have about 20 features. Is there a scikit method to get the feature importance? I found clf.feature_importances_ but it seems that it only exists for ...
3
votes
1answer
127 views

Can a neural network recognize a letter B as an A if your trained it so?

You have a neural network. And you have, say, pictures of $100,000$ hand-written letters (A-Z). Now you make a typical Training and the neural network will recognize an A as an A, a B as a B, ... Now ...
1
vote
3answers
224 views

One Hot Encoding of Age

My task is to predict how many years a person has left to live using an MLP. There is one specific feature I'd like to discuss: current age. Statistically, it's a conditional probability. Example: ...
2
votes
2answers
1k views

Adding more layers decreases accuracy

I have my ANN trained on MNIST dataset. Hidden layer has 128 neurons and input layer has 784 neurons. This gave me an accuracy of 94%. However when I added one more layer with 64 neurons in each then ...