2
$\begingroup$


I am writing a scientific paper that - among other things - deals with logistic regression in the context of machine learning.
I read this article where the author states that, given a set of instance-label pairs $(\boldsymbol{x_i},y_i),\ i=1,...,l\ \ \boldsymbol(x_i) \in R^n,\ y_i \in \{-1,+1\}$, Logistic Regression solves the following optimization problem:

$$ \begin{equation}\label{eq:log} \min_{w} \frac{1}{2}\boldsymbol{w}^T\boldsymbol{w} + C\sum\limits_{i=1}^l log(1+e^{-y_i\boldsymbol{w}^T \boldsymbol{x_i}}) \end{equation}\ \ \ \ \ \ \ \ \ \ (Eq.1) $$

Is it correct if I say that: "The first summand of Equation 1 is a regularization term while the second represents the negative log-likelihood loss function"?

Thank you for your kind assistance.

Improve this question
$\endgroup$
2

1 Answer 1

Reset to default
1
$\begingroup$

Yes the first is the L2 regularization term to keep the norm of weights parameter as small as possible.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.