Questions tagged [linear-algebra]

A field of mathematics concerned with the study of finite dimensional vector spaces, including matrices and their manipulation, which are important in statistics.

12 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
6
votes
0answers
174 views

Finding linear transformation under which distance matrices are similar

I have n sets of vectors, where each set S_i contains k vectors in ...
3
votes
1answer
25 views

PCA formulation - Deep Learning book by Ian Goodfellow

I am reading this deep learning book by Ian goodfellow. In the PCA formulation in the first chapter i.e Linear Algebra, he mentions the following: we need to choose the encoding matrix D. To do so,...
3
votes
0answers
50 views

Linear algebra library for c++

I have been trying to find the substitute of numpy and perform some linear algebra using c++ and here's a list of libraries I have encountered: Eigen Armadillo Dlib GNU Scientific library Please ...
2
votes
0answers
48 views

How does SVD actually provide the recommendations? I seem to get conflicting answers

I am reading a text book that basically says the following: Given a matrix A where A is USERS x ITEMS we can use SVD to decompose the matrix into: $$A = U \times \Sigma \times V^T$$ Then we can take ...
1
vote
0answers
16 views

How to add extra constraints to an equation?

Background: I have an equation which looks like as follows: $W \times P = R$ $\left[\begin{array} &{1}&{0}&{0}&-\frac{w_{1}}{w_{o1}} &\dots &{0} &-\frac{w_{1}}{w_{0} } \\...
1
vote
0answers
86 views

Connection between piecewise linear basis functions and RELU activation function

ReLU activation is defined as follows $$\sigma(x)=\max(0, x).$$ Let's assume that I have deep network of 1 hidden layer, than output from my layer has form $$ f(x)= \sigma(Wx +b), $$ where matrix W ...
1
vote
0answers
74 views

Can we think of neurons as maps between matrices?

Usually when we think about neurons, we imagine that they enact some kind of map between real numbers. For example, a neuron might take in real numbers $x_{i}$ and weight them with parameters $W_{ij}$,...
1
vote
0answers
12 views

Structures for incorporating linear functions into a nonlinear optimization problem

I'm working on a problem which naturally involves both linear and nonlinear operations, and I'd like some help understanding the best way to combine these into a neural network framework. To be more ...
0
votes
0answers
9 views

Chaining bias terms in backprob

let's say I have a few linear layers $l_1 \dots l_n$: $y=I(\dots I(IX + b_1) + b_2) \dots +b_n)$ where $n$ is sufficiently large and $I$ is the (nonparametric) identity matrix. The gradient for $b_n$...
0
votes
0answers
9 views

Performant alternatives to Matrix package in R that requires minimal effort by end users to install

Background I'm going to be releasing a package for R that does calculations involving extremely large sparse matrices (1,000,000 x 1,000,000 is the minimum for what we consider useful). For this ...
0
votes
0answers
26 views

Dimensionality reduction categories

According to what I found, dimensionality reduction has two types feature selection and feature extraction . In feature extraction, we find PCA, LDA ,LLE , ISOMAP, etc.. In other works i find random ...
0
votes
1answer
36 views

Can I use regression to solve a multiple equation problem

I'm working on a problem which is a multiple equation. I have a group of people and each person in the group is working on different tasks (e.g. n tasks in total). Each person in this group is working ...