Questions tagged [perceptron]

Perceptron is a basic linear classifier that outputs binary labels.

87 questions
Filter by
Sorted by
Tagged with
363 views

Interpreting MLP output

I just wrote an MLP in Python. After having trained it, I pass in some test data to see the result, and I get an array of decimal numbers at the output, rather than the desired binary output. For ...
• 53
96 views

Coding MLP: good practices?

I recently finished coding my own MLP neural network in Python. To make my code easier to read, I separated the MLP, into classes; the network class, the layers class and the neuron class, where the ...
• 53
262 views

Is the prediction algorithm absolutely the same for all linear classifiers?

Is the prediction algorithm absolutely the same for all linear classifiers and linear regression algorithms? As known, any linear classifier can be described as: ...
• 649
1 vote
426 views

Confusion on Delta Rule and Error

I'm currently reading Mitchell's book for Machine Learning, and he just started gradient descent. There's one part that's really confusing me. At one point, he gives this equation for the error of a ...
• 189
609 views

• 189
231 views

• 161
2k views

Perceptron - Which step function to choose

I'm studying Perceptron algorithm. Some books use this step function 1 if x>=0 else -1 where x is a dot product between the weights w and a sample x. Other ...
• 451
15k views

Strange behavior with Adam optimizer when training for too long

I'm trying to train a single perceptron (1000 input units, 1 output, no hidden layers) on 64 randomly generated data points. I'm using Pytorch using the Adam optimizer: ...
• 263
2k views

How to implement gradient descent for a tanh() activation function for a single layer perceptron?

I am required to implement a simple perceptron based neural network for an image classification task, with a binary output and a single layer, however I am having difficulties. I have a few problems: ...
13k views

Is the percepetron algorithm's convergence dependent on the linearity of the data?

Does the fact that I have linearly separable data or not impact the convergence of the perceptron algorithm? Is it always gonna converge if the data is linearly separable and not if it is not ? Is ...
97 views

An optimization problem involving perceptron

What I do not understand is that is there only one input for each weights or there is a vector of inputs from 1 to n? I also dont get the notation for inputs and outputs? Is that a notation or a ...
1k views

How should the hyper parameters be defined for the other algorithms defined for sklearn_crfsuite.CRF

In the example given for sklearn_crfsuite, the parameter space that needs to be passed to a cross_validating class like RandomizedSearchCV is defined as below. ...
1 vote
264 views

Why is a perceptron initialized with a random line?

I'm setting up a single perceptron for doing linear classification. Why is the perceptron initialized with random weights and a random bias instead of just having all of the weights set to zero ...
1 vote
207 views

Criterion for Firing a perceptron

The criterion for firing a perceptron is as follows Why is it that when the function $w \cdot x + b = 0$ the output is zero as well. Why couldn't it have been set to 1? If one were to simulate the ...
1k views

Perceptron weight vector update

I read about the Rosenblatt Perceptron Learning Algorithm. Often there is an explicit note: It is important to note that all weights in the weight vector are being updated simultaneously But why ...
• 143
480 views

Is there a relationship between LDA, linear SVMs and Perceptron?

LDA (linear discriminant analysis), SVMs with a linear kernel, and perceptrons are linear classifiers. Is there any other relationship between them, e.g.: Every decision boundary that can be found by ...
• 18.8k
16k views

Perceptron learning rate

Today I've seen many Perceptron implementations with learning rates. According to Wikipedia: there is no need for a learning rate in the perceptron algorithm. This is because multiplying the ...
• 323