Questions tagged [notation]

Notation refers to a specific way of writing various concepts, functions, etc. Usually it is introduced to abbreviate complicated expressions and make common idioms more readable.

Filter by
Sorted by
Tagged with
2
votes
1answer
95 views

Layer notation for feed forward neural networks

Apologies in advance, for I have a fairly rudimentary question on the notations for studying Feed-Forward Neural Networks. Here is a nice schematic taken from this blog-post. Here $x_i = f_i(W_i \...
2
votes
1answer
142 views

What does the pair of vertical lines in empirical entropy formula mean?

I am learning from this post. $\alpha$ is the ratio of the first subset, $$\alpha=\frac{\left|D_{1}\right|}{\left|D\right|}$$ according to the context and code of the post, $\left|D\right|$ means ...
1
vote
1answer
70 views

Meaning of equation for CNN probabilities

So the first equation above refers to a CNN (rather a committee of CNNs) for image classification. I am unable to understand exactly what the author is trying to do in the first equation. So far, I ...
1
vote
0answers
47 views

PAC Learnability - Notation

the following is from Understanding Machine Learning: Theory to Algorithm textbook: Definition of PAC Learnability: A hypothesis class $H$ is PAC learnable if there exist a function $m_H : (0, 1)^2 \...
1
vote
0answers
187 views

Does this notation mean vector-concatenation?

When reading papers on neural networks, I occasionally stumble upon the following notation with a semicolon: $$ \text{tanh}(\mathbf{W_c}[\mathbf{c}_t;\mathbf{h}_t]) $$ Unless otherwise noted, does ...
2
votes
1answer
876 views

Layer notation for convolutional neural networks

When reading about convolutional neural networks (CNNs), I often come across a special notation used in the community and in scientific papers, describing the architecture of the network in terms of ...
1
vote
1answer
90 views

Cannot see what the “notation abuse” is, mentioned by author of book

From Sutton and Barto, Reinforcement Learning: An Introduction (second edition draft), in equation 3.4 of page 38. The probabilities given by the four-argument function p completely characterize ...
1
vote
1answer
131 views

Why is an activation function notated as “g”?

In many cases an activation function is notated as g (e.g. Andrew Ng's Course courses), especially if it doesn't refer to any specific activation function such as ...
2
votes
2answers
58 views

Pound notation in Summation

I was going through a paper comparing glove and word2vec. I came across the pound notation shown below. What does it mean when used like this? The link for paper is here