Questions tagged [notation]
Notation refers to a specific way of writing various concepts, functions, etc. Usually it is introduced to abbreviate complicated expressions and make common idioms more readable.
14
questions
0
votes
0answers
9 views
Notation for anti-optimal
What's the notation for the worst element/solution?
The best "something" can be denoted with *, i.e.:
$R^* = R_{best}$
$R^? = R_{worst}$
0
votes
0answers
10 views
Notation of Transposed Convolution Operation in Equation
How do I notate a transposed convolution operation (as it is used in deep learning), in a math equation?
A convolution operation for example is often notated as $\hat{y} = x \circledast W$ where $W$ ...
1
vote
1answer
214 views
What types of matrix multiplication are used in Machine Learning? When are they used?
I'm looking at equations for neural networks and backpropagation and I see this symbol in the equations, ⊙. I thought matrix multiplication of neural networks always involved matrices that matched ...
2
votes
2answers
66 views
Formal math notation of masked vector
I'm struggling to write my algorithm in a concise and correct way.
The following is an explanation for an optimizer's update step of part of a vector of weights (not a matrix in my case).
I have a ...
2
votes
2answers
22 views
Notation for features (general notation for continuous and discrete random variables)
I'm looking for the right notation for features from different types.
Let us say that my samples as $m$ features that can be modeled with $X_1,...,X_m$. The features Don't share the same distribution (...
2
votes
1answer
152 views
Layer notation for feed forward neural networks
Apologies in advance, for I have a fairly rudimentary question on the notations for studying Feed-Forward Neural Networks. Here is a nice schematic taken from this blog-post.
Here $x_i = f_i(W_i \...
2
votes
1answer
150 views
What does the pair of vertical lines in empirical entropy formula mean?
I am learning from this post.
$\alpha$ is the ratio of the first subset,
$$\alpha=\frac{\left|D_{1}\right|}{\left|D\right|}$$
according to the context and code of the post, $\left|D\right|$ means ...
1
vote
1answer
104 views
Meaning of equation for CNN probabilities
So the first equation above refers to a CNN (rather a committee of CNNs) for image classification. I am unable to understand exactly what the author is trying to do in the first equation.
So far, I ...
2
votes
1answer
83 views
PAC Learnability - Notation
The following is from Understanding Machine Learning: Theory to Algorithm textbook:
Definition of PAC Learnability: A hypothesis class $\mathcal H$ is PAC learnable
if there exist a function $m_H : (...
1
vote
0answers
322 views
Does this notation mean vector-concatenation?
When reading papers on neural networks, I occasionally stumble upon the following notation with a semicolon:
$$
\text{tanh}(\mathbf{W_c}[\mathbf{c}_t;\mathbf{h}_t])
$$
Unless otherwise noted, does ...
3
votes
1answer
1k views
Layer notation for convolutional neural networks
When reading about convolutional neural networks (CNNs), I often come across a special notation used in the community and in scientific papers, describing the architecture of the network in terms of ...
1
vote
1answer
95 views
Cannot see what the “notation abuse” is, mentioned by author of book
From Sutton and Barto, Reinforcement Learning: An Introduction (second edition draft), in equation 3.4 of page 38.
The probabilities given by the four-argument function p completely characterize ...
3
votes
1answer
170 views
Why is an activation function notated as “g”?
In many cases an activation function is notated as g (e.g. Andrew Ng's Course courses), especially if it doesn't refer to any specific activation function such as ...
2
votes
2answers
58 views
Pound notation in Summation
I was going through a paper comparing glove and word2vec. I came across the pound notation shown below. What does it mean when used like this?
The link for paper is here
