Share Your Experience: Take the 2024 Developer Survey

# Questions tagged [mathematics]

Mathematics in a data science or machine learning context refers to the mathematical underpinnings for algorithms, optimization, statistics, and linear algebra etc.

239 questions
Filter by
Sorted by
Tagged with
20 views

### How to analyze time series data and create time series model in Python?

I am trying to understand time-series data and model. In youtube tutorial and others, mostly univariate examples are shown. And they are applicable or suitable for those conditions. What if our ...
20 views

### Diffusion Models: Conditioning on Time vs. Noise Level

I am new to SE-Data Science, therefore I hope this is the right place to ask this rather theoretical question. In diffusion models we usually have a time variable which determines the noise schedule (...
• 101
21 views

### Does performing k-NN on the centroids of clusters obtained from k-means make sense mathematically?

While playing around with some text embeddings, I used k-means clustering to get 4 clusters. I also have the labels for these embeddings, and I may simply use k-NN to classify new embeddings. However, ...
• 103
16 views

### Weighted average for multiple confusion matrix

I have problem and i have no idea how to resolve it. I have 4 Confusion Matrixes and i need to calculate for example Matthews Correlation for each CM. In second step i want calculate BIG KPI result ...
28 views

### What is the Understanding level required in mathematics to become a great data scientist?

I am a civil engineer and i got some undergraduate courses in linear algebra, probability and statistics. I am pursuing some ML/DS courses in udemy so I'm just a beginner and I would like to become a ...
158 views

### AutoDiff on different operations?

How it is possible to use automative differentiation (computational graph) on operations like - convolution? I know that 2d convolution can be represented by matrix multiplication. But what about 3d ...
• 45
10 views

### Trying to understand Ch.2.1 "2.1. Monads and their algebras" of "Categorical Deep Learning: An Algebraic Theory of Architectures"

I am trying to read article "Categorical Deep Learning: An Algebraic Theory of Architectures" https://arxiv.org/abs/2402.15332 and I am stuck with the Chapter 2.1 "2.1. Monads and their ...
• 141
58 views

### Time Series Analysis and Price Elasticity

Introduction: As of now, I am a fourth year data science student. As of now, I also have my own company where I work parttime (8/12 hours per week) to gain some more experience in the domain. As you ...
• 21
21 views

### Question on theory from original GBM article

I am reading the original gradient boosting machine article and, maybe because my statistics are a bit rusty, have a few questions on one section. In section ...
• 11
20 views

### Continuous Function from Binned Data with Consistent Integrals

I have binned energy production data (in Wh) in 5-minute intervals. This means that, at the timestamp of t + 5 minutes, the value represents the amount of energy generated in the interval from t to t +...
24 views

### Dimenson reduction from a cosine similarity matrix

I have a silly little question: I have 200 press articles (string), I vectorize these articles with an embedding model (sentence embedding), so I have 1024 values per article. I then have a 200 x 1024 ...
8 views

### Discuss kNN, test/train, random projection, unit vector, vectored matrix, hamming distance, stft, Y=(aAX1:M)

Suggestion Investigation Looking for suggestions or guide for how to setup a clean approach and discussion on how to apply a python suggested way to solve this challenge Looking for suggestions or ...
17 views

### Inverse Probability Fallacy of Maximum Likelihood Estimation

How can we justify that the parameters estimated via Maximum Likelihood Estimation are the optimal parameters for the data, given that MLE involves computing the data's likelihood as a function of the ...
26 views

### Intuition Behind Xavier Initialization

I am trying to understand the intuition behind why xavier works. So far I have pieced togther that $Var(Z)=n_{in}*Var(X)*Var(W)$ and so if we want the variance to mitigate the variance diminishing ...
• 1
36 views

### Why do we use the RELU activation function?

I reading about activation functions in feedforward neural networks. ad a really old paper https://web.njit.edu/~usman/courses/cs677_spring21/hornik-nn-1991.pdf. They prove that by using arbitrary ...
44 views

### Gradient function in LogisitcLoss class

I am going through a code for XGBoost from scratch and I am referring to this repository here The log-loss function is given by On differentiating the above function with respect to y_pred (referring ...
11 views

### Why do all the resulting curves from my function combining N-many random ReLUs look like quadratics?

I've written a function that generates a sum of N-many RelU functions, with random slopes and activation points. I was expecting these resulting functions to be arbitrary, random curves, but for some ...
1 vote
112 views

### Which machine learning models are rational to use on NP-hard and NP-complete "theoretical" problems?

Time and time again I run into "surprising" NP-hard problems that seem naturally simpler than they are. I recently worked on a weighted graph theoretical problem where the point is to ...
• 113
1 vote
366 views

### Why both ChatGPT and Bard can't get a simple matrix calculation right?

I asked the following question to both ChatGPT 4 and Bard to see if they can get a simple matrix calculation right (after all Bill Gates said he was impressed by ChatGPT's math ability). So I asked, <...
• 133
44 views

### Suggestions to learn the Machine Learning models in greater depth?

I've been learning machine learning for the past few weeks from books and online courses. The books I've been reading, and currently still reading is "Hands-On Machine Learning with Scikit-Learn ...
34 views

### RetNet Paper Multi Scale Retention dimemsion question

From the paper: https://arxiv.org/pdf/2307.08621.pdf But since X is of size n by $d_{model}$. How can we compute $XW_Q$? Since the row length of X which is $d_{model}$ is not the same as the column ...
1 vote
47 views

### How in the heck should I tackle this classification problem? I'm not even sure if it's classification or regression

So, I'm currently a third year student in electrical engineering and I'm currently enrolled in a Mathematical Modelling and Machine Learning class and we're currently tasked to classify or use ...
• 11
43 views

### Question regarding Lecture 5 CS229

I was at the part where we are using one covariance matrix and two mean vectors for fitting our Gaussian. I understood that we are using one covariance matrix and we can use different ones that would ...
9 views

### Derive Keras Cosine Restarts Scheduler Formula from Source Code

I used Keras implementation of the cosine restarts algorithm. I need to know the exact formula of the algorithm for my LaTeX manuscript. The documentation is here. The implementation differs (in terms ...
• 101
14 views

### When training deep learning model which is better, training with sampled data Vs. training on shorter epoch

I am running multiple hyperparameter optimization trials therefore trying to find a way to reduce time consumption. Two ways that I could think of are search hyperparameter on subset of data. search ...
• 469
56 views

### How to split a range of numbers considering other variables as well?

Let's say that I have a vector of numbers and I'd like to split it into 3 most optimal ranges for example, then I suppose I can use k-means or Jenks natural breaks. If I'd like to do the same thing ...
22 views

### How to prove equation (7)(8) in paper A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learning?

I couldn't derive the formula (7)(8) in paper https://arxiv.org/pdf/2110.01515.pdf They didn't seem obvious to me.
1 vote
46 views

### Handling error when returning from log transform

Before training the model, I convert a target value to the log scale since range of the target is quite large. After training the model, the Absolute Mean error was estimated as, for instance, 0.5. If ...
• 13
49 views

13 views

• 1
22 views

### Chi-Sqare test and Continuous values

How does chi-square test work for continuous variables. I see that it is used in most papers to test dependencies between continuous explanatory variables and the target variable. Please how does this ...
1 vote
25 views

### Fast Fourier Transform in computer vision

Can someone explain me how does FFT works in computer vision, please. I know something about FFT as an algorithm of competitive programming but I can't understand how it perform an image in computer ...
• 121
1 vote
46 views

### In WGAN paper, why does clipping weights approximate Lipschitz function?

In Wasserstein GAN, it's explained that maximizing a certain formula over a set of K-Lipschitz functions approximates the 1-Wasserstein distance and they model the functions as NNs. That much I ...
• 11
1 vote
94 views

### Trying to extrapolate info from a partial data set - statistical inference

I am wondering if my logic is OK here or not. 98% of a group without a device has an event occur 2% of group with device has an event occur Since we know that correlation isn't causation I can't say ...
• 63
16 views

### Matrix factorization approximate products to solve math solution

Problem Matrix factorization for approximating products how do we solve such that Z approximates products N, M. How to define the math formula for solve for Z approximtaes the products of N,M? ...
47 views

### Can't find this book [closed]

I came across the most comprehensive ML Mathematics book (700+ pages) with sections on Probability, Calculus, Linear Algebra and Mathematical Foundations of the famous tricks in Deep Learning on ...
90 views

### Are there deterministic problems a neural network can't learn?

I have a software which takes 5 input numbers and outputs a number, deterministically. I want to try and mimic this software precisely with a neural network, but I am finding it very difficult. The ...
• 31
111 views

### How does dropout behave like model averaging?

It is claimed Srivastava, Hinton, et al. that "dropout can be effectively applied in the hidden layers as well and that it can be interpreted as a form of model averaging" and that "...
1 vote
36 views

### A mathematician from the outside looking in

I am wondering if anybody could give a survey of applications of approximation theory to data science. One application I am familiar with are, for example, wavelet neural networks. Does anybody know ...
• 111
1 vote
185 views

### Is it possible to extract mathematical expression of an trained ML Model?

In Python & R, Linear Regression model gives the mathematical representation after learning the training data, typically in the form of intercept, coefficients of variables, and the p-value/t-...
• 11
13 views

### What is the difference between classification and regression metrices such as accuracy and MSE? [duplicate]

What is the difference between classification metrics such as accuracy and regression metrics such as MPE? & Why can’t accuracy be used as regression metric?