Stack Exchange network consists of 183 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.
Ask questions, find answers and collaborate at work with Stack Overflow for Teams.
Ask questions, find answers and collaborate at work with Stack Overflow for Teams. Explore Teams
Teams
Q&A for work
Connect and share knowledge within a single location that is structured and easy to search.
LeakyRelu allows a small gradient when the unit is not active (negetivenegative): f(x) = alpha * x for x < 0,
$$ f(x) = alpha * x \:\text{for} \: x < 0, $$ f(x) = x for x >= 0.$$f(x) = x \:\text{for}\: x >= 0.$$
LeakyRelu allows a small gradient when the unit is not active (negetive): f(x) = alpha * x for x < 0, f(x) = x for x >= 0.
LeakyRelu allows a small gradient when the unit is not active (negative):
$$ f(x) = alpha * x \:\text{for} \: x < 0, $$ $$f(x) = x \:\text{for}\: x >= 0.$$
