Questions tagged [notation]
Notation refers to a specific way of writing various concepts, functions, etc. Usually it is introduced to abbreviate complicated expressions and make common idioms more readable.
9
questions
2
votes
1answer
95 views
Layer notation for feed forward neural networks
Apologies in advance, for I have a fairly rudimentary question on the notations for studying Feed-Forward Neural Networks. Here is a nice schematic taken from this blog-post.
Here $x_i = f_i(W_i \...
2
votes
1answer
142 views
What does the pair of vertical lines in empirical entropy formula mean?
I am learning from this post.
$\alpha$ is the ratio of the first subset,
$$\alpha=\frac{\left|D_{1}\right|}{\left|D\right|}$$
according to the context and code of the post, $\left|D\right|$ means ...
1
vote
1answer
70 views
Meaning of equation for CNN probabilities
So the first equation above refers to a CNN (rather a committee of CNNs) for image classification. I am unable to understand exactly what the author is trying to do in the first equation.
So far, I ...
1
vote
0answers
47 views
PAC Learnability - Notation
the following is from Understanding Machine Learning: Theory to Algorithm textbook:
Definition of PAC Learnability: A hypothesis class $H$ is PAC learnable
if there exist a function $m_H : (0, 1)^2 \...
1
vote
0answers
187 views
Does this notation mean vector-concatenation?
When reading papers on neural networks, I occasionally stumble upon the following notation with a semicolon:
$$
\text{tanh}(\mathbf{W_c}[\mathbf{c}_t;\mathbf{h}_t])
$$
Unless otherwise noted, does ...
2
votes
1answer
876 views
Layer notation for convolutional neural networks
When reading about convolutional neural networks (CNNs), I often come across a special notation used in the community and in scientific papers, describing the architecture of the network in terms of ...
1
vote
1answer
90 views
Cannot see what the “notation abuse” is, mentioned by author of book
From Sutton and Barto, Reinforcement Learning: An Introduction (second edition draft), in equation 3.4 of page 38.
The probabilities given by the four-argument function p completely characterize ...
1
vote
1answer
131 views
Why is an activation function notated as “g”?
In many cases an activation function is notated as g (e.g. Andrew Ng's Course courses), especially if it doesn't refer to any specific activation function such as ...
2
votes
2answers
58 views
Pound notation in Summation
I was going through a paper comparing glove and word2vec. I came across the pound notation shown below. What does it mean when used like this?
The link for paper is here
