Questions tagged [mlp]

MLP stands for multi-layer perceptron, the most basic kind of neural network. Also called DNN (deep neural network), as opposed to CNN or RNN (convolutional and recurrent neural networks).

Filter by
Sorted by
Tagged with
0
votes
1answer
236 views

MLP classifier Gridsearch CV parameters to tune?

I'm looking to tune the parameters for sklearn's MLP classifier but don't know which to tune/how many options to give them? Example is learning rate. should i give it[.0001,.001,.01,.1,.2,.3]? or is ...
1
vote
2answers
1k views

Feature scaling for MLP neural network sklearn

I am working with a dataset where the features have multiple scales. Before running scikit-learns's MLP neural network I was reading around and found a variety of different opinions for feature ...
3
votes
1answer
89 views

Neural Network regression negative performance

I have a problem with the performance of a multi layer perceptron regressor (neural network) and I cannot figure out why. Task: I am trying to improve a time series prediction. I have predictions of a ...
1
vote
0answers
27 views

Testing a Binary Classifier

I have been training a binary multilayer perceptron on a database made out of roughly 3600 0 values, and 4 1 values. Afterwards, I'm testing the MLP on a test set made out of 7 0 values and 7 1 ...
1
vote
1answer
112 views

What are the key differences between a MLP with lagged features and a RNN

I've been working with MLP's for a while. Whenever I assumed that the past values of a feature might be useful for predicting the future values of Y, I would just create a new column in my data frame ...
2
votes
1answer
1k views

multilayer perceptron do not converge

I have been coding my own multi layer perceptron in MATLAB and it can be compiled without error. My training data features,x, has values from 1 to 360, and training data output, y, has the value of ...
2
votes
1answer
28 views

Structuring experiment/training data with months in mind

We're using a whole year's data to predict a certain target variable.The model works like data - OneHot encoding the categorical variables - MinMaxScaler - PCA (to choose a subset of 2000 components ...
0
votes
1answer
28 views

Is it possible that MLP has better accuracy than CNN?

I am working on the epilepsy classification system which consumes EEG signals and in the result says if withing the certain period is a seizure or not. I take an advantage of Keras API for the sake of ...
0
votes
0answers
32 views

Predicting Y Values Properly in a Regression Task using Scaled Values (Random Forest & MLP)

I have a supervised learning regression task: I am trying to forecast demand for a product based on sales in past years. Data description: Samples (rows) - Demand for a certain product (at a certain ...
0
votes
0answers
15 views

Tensorflow process killed

I need to train 5 models each for 10 times using tensorflow and keras for a homework. 2 of the models are multilayer perceptron models and remaining 3 of them are CNN models. I am training using my ...
0
votes
1answer
34 views

Multiple solutions with same minima in MLP with same weights

I came across an excercise on deep learning from here. It goes as follows: Consider a simple MLP with a single hidden layer of $d$ dimensions in the hidden layer and a single output. Show that for any ...
1
vote
0answers
15 views

Developing Custom MLP for Mnist

I am trying to develop a custom MLP for MNIST Dataset with 2 hidden fully connected layers Mnist: 28281 FC1: input 28*28, output 512 FC2: input 512, output 128 Classifier: FC: input 128, output 10 I ...
1
vote
0answers
41 views

SHAP for Deep Neural Network taking long time

I have 60,000 samples with each having 1,800 features. I have made a multilayer perceptron in Keras and I want to use SHAP values to arrive at global feature importance. Is the matrix too big for SHAP?...
2
votes
1answer
34 views

avoiding premature convergence with neural networks (EA's)

I am currently writing a program that would be able to play snake on an 25*25 grid. It works by optimizing a set of weights of 300 different solutions (each solution would be a different neural ...
3
votes
1answer
353 views

Why does the MAE still remain, at all?

This may seem to be a silly question. But I just wonder why the MAE doesn't reduce to values close to 0. It's the result of an MLP with 2 hidden layers and 6 neurons per hidden layer, trying to ...
0
votes
0answers
30 views

Minimizing Costfunction in a Feedforward MLP

I made a sweep on a feedforward MLP changing number of layers and neurons per layer, in order to see an effect on the costfunction. Costfunction = 0.5 (Trainingoutput - Modeloutput)^2. For the ...
0
votes
1answer
28 views

Why we use an activation function for introducing nonlinearity instead of a polynomial Perceptron implementation?

I perceive a single perceptron as a single linear function $y = a_1x_1 + a_2x_2 + ... + a_nx_n + b_0$ with a goal to calculate the best weights combination $ w_1, w_2, ..., w_n $ that minimizes the ...
2
votes
3answers
106 views

About different structures of neural network

https://www.mathworks.com/help/deeplearning/ref/fitnet.html is the tutorial that I am following to understand fitting data to a function. I have few doubts regarding structure and terminologies which ...
2
votes
1answer
17 views

Training loss stuck in the starting epochs but then starts decreasing. What could be the reason for it?

I am training a model where I found a unique problem that for starting 4 epochs, my loss did not change with the epochs but after that, it started changing. Could it be because of the high learning ...
1
vote
1answer
89 views

Is a multi-layer perceptron exactly the same as a simple fully connected neural network?

I've been learning a little about StyleGans lately and somebody told me that a Multi-Layer Perceptron, MLP, is used in parts of the architecture for transforming noise. When I saw this person's code, ...
1
vote
1answer
156 views

How Does Sci-Kit Learn Train Regression Neural Networks (MLPRegressor) So Fast?

Why does using the scikit-learn library's MLPRegressor result in such a boost in training time when compared to constructing the network from scratch? I tried both methods and I found that writing the ...
2
votes
2answers
672 views

MLP conv layers

When should MLP conv layers be used instead of normal conv layers? Is there a consensus? Or is it the norm to try both and see which one performs better? I would love to better understand the ...
0
votes
0answers
13 views

Multidimensional Output from Radar Imagery and Climate Data

I am trying to predict what my rainfall field will look like at a future timestep using: Radar imagery of rainfall fields at previous timesteps: A set of 2D matrices where each element in each matrix ...
1
vote
1answer
19 views

Input changing row count matrices in an MLP

I want to input a numpy 2d array into MLP but I have an array of 50395 rows that contains many 2d array of shape (x, 129). x ...
1
vote
0answers
125 views

Help with MLP convergence

I posted this question on AI SE and got advised to ask here for guidance. I've been stuck for a couple of days trying to figure it out how the standard MLP works and why my code doesn't converge at ...
1
vote
2answers
115 views

Data pre-processing before feeding into a deep learning model

Generally speaking, when training a deep learning model, like MLP, what kind of data pre-processing operation has to be conducted when the input is a numerical sequence.
0
votes
0answers
25 views

How to implement Multi Layer Perceptron in Keras

I am trying to implement the network in the paper Two-Stream Deep Feature Modeling for Automated Video Endoscopy Data Analysis available here. However, I am confused about the Multi layer Perceptron ...
2
votes
1answer
58 views

SciKit Learn: Multilayer perceptron early stopping, restore best weights

In the SciKit documentation of the MLP classifier, there is the early_stopping flag which allows to stop the learning if there is not any improvement in several ...
0
votes
1answer
289 views

Getting different precisions for same neural network with same dataset and hyperparameters in sklearn mlp classifier

I get WAY DIFFERENT results in each run despite using random state for making sure that network outputs same result for same hyper parameters, here is some sample outputs(I've printed the hyper ...
1
vote
1answer
719 views

What are the differences between MLP and DNN?

So I have been reading about the topic for a while, but i did not find a clear answer why MLP and DNN are being used interchangeably even though there are some differences between them. So far I have ...
0
votes
1answer
36 views

Lower training accuracy than testing accuracy (MLP/Dropout)

I am working on a problem of multi-class classification by MLP. I have set dropout to each middle layer. Now I observe the training accuracy is around 10% less than ...
0
votes
0answers
37 views

Tensorflow V1, tf.global_variables_initializer() got error: InvalidArgumentError: feed a value for placeholder tensor 'X'

I have started learning Tensorflow V1, and try to implement a 4-layer MLP model with Batch Normalization. But once I invoke the BN() function into the model, it will report ...
1
vote
0answers
13 views

model tuning by using loss curves

I have been practicing with the following dataset: http://archive.ics.uci.edu/ml/datasets/Concrete+Compressive+Strength for building a prediction model based on a MLP, but I have some doubts if the ...
3
votes
1answer
169 views

Understanding computations of Perceptron and Multi-Layer Perceptrons on Geometric level

I am currently watching amazing Deep Learning lecture series from Carnegie Melllon University, but I am having little bit of trouble understanding how Perceptrons and MLP are making their decisions on ...
3
votes
2answers
196 views

Geometric interpretation of MLP output

I am really interested in the geometric interpretation of perceptron outputs, mainly as a way to better understand what the network is really doing, but I can't seem to find much information on this ...
0
votes
1answer
33 views

How to structure the output layer of an MLP that finds the quadrant of an arbitrary point in a rectangle?

I'm trying to write a neural network that outputs the quadrant of a rectangle that an arbitrary point lies in. This rectangle has its upper left at {0, 0} and its lower right at {1, 1} (e.g. point {0....
5
votes
1answer
198 views

Can a neural network recognize a letter B as an A if your trained it so?

You have a neural network. And you have, say, pictures of $100,000$ hand-written letters (A-Z). Now you make a typical Training and the neural network will recognize an A as an A, a B as a B, ... Now ...
0
votes
1answer
59 views

implementing forward and backward of a Linear model

I'm implementing the code of this abstraction. The forward is easy and looks like that: I don't understand the backward path and how it fit's the abstraction in the first image: Why is db defined as ...
2
votes
2answers
6k views

MLPRegressor Output Range

I am using Scikit's MLPRegressor for a timeseries prediction task. My data is scaled between 0 and 1 using the MinMaxScaler ...
2
votes
1answer
158 views

Interpreting MLP output

I just wrote an MLP in Python. After having trained it, I pass in some test data to see the result, and I get an array of decimal numbers at the output, rather than the desired binary output. For ...
2
votes
3answers
606 views

Are weights of a neural network reset between epochs?

If an epoch is defined as the neural network training process after seeing the whole training data once. How is it that when starting the next epoch, the loss is almost always smaller than the first ...
0
votes
1answer
734 views

(De-)Scaling/normalizing input and output data inside Keras model as layer

I am building a 2-hidden layer MLP using Keras. I'm using a SciKit learn wrapper to be able to use the GridSearchCV functionality. My sample-size is limited, ...
0
votes
1answer
134 views
0
votes
1answer
166 views

Logistic Regression outperforms MLPClassifier

I am new in ML and I am trying to train classifier. I have a tiny dataset, just 90 examples, I divided it 70/30 train/test set and started to train. As I know MLP must outperform Logistic Regression, ...
0
votes
1answer
138 views

What does it mean when an Actual vs Predicted plot is like this assuming you are using the best model?

I'm trying to predict the monetary value in a fixed time-frame for a project. I wanted to start with a baseline model before doing any feature engineering or advanced pre-processing. I'm using a feed-...
1
vote
0answers
14 views

Which MSE (total or individual) back-propagate for multi out regression neural network

When we have multi output regression neural network, we can calculate total MSE and individual MSE per output. How this MSE should back-propagate ? Shouldn't we back-propagate individual MSE through ...
16
votes
2answers
58k views

How to adjust the hyperparameters of MLP classifier to get more perfect performance

I am just getting touch with Multi-layer Perceptron. And, I got this accuracy when classifying the DEAP data with MLP. However, I have no idea how to adjust the hyperparameters for improving the ...
1
vote
1answer
27 views

LabelEncoder with a Multi-Layer Perceptron?

So we're working on a machine learning project at work and it's the first time I'm working with an actual team on this. I got pretty good results with a model that uses the following SKLearn pipeline: ...
3
votes
1answer
42 views

Alternatives to regression to decide weights in an expression

I have a use case in which I am required to predict variable $y$ which depends on five variables $x_i$. Consider something like $$ y=w_1 x_1+ w_2 x_2+ w_3 x_3+ w_4 x_4+ w_5 x_5.$$ This expression ...
1
vote
2answers
352 views

Why is the reported loss different from the mean squared error calculated on the train data?

Why the loss in this code is not equal to the mean squared error in the training data? It should be equal because I set alpha =0 , therefore there is no regularization. ...