Questions tagged [machine-learning]
Machine Learning is a subfield of computer science that draws on elements from algorithmic analysis, computational statistics, mathematics, optimization, etc. It is mainly concerned with the use of data to construct models that have high predictive/forecasting ability. Topics include modeling building, applications, theory, etc.
11,105
questions
0
votes
1
answer
18
views
Is there a machine learning model I should look into to predict the effect land topology will have on prevailing wind direction near bodies of water
I'd like to predict the change in wind velocity due to land near bodies of water. Warmer or colder land should change the wind velocity of nearshore breeze. I'd also like to predict wind shadows that ...
- 101
0
votes
1
answer
12
views
How do GPT models go from token probabilities to textual outputs?
Suppose GPT-2 or GPT-3 is trying to generate the next token, and it has a probability distribution (after applying softmax to some output logits) for the different possible next tokens. How does it ...
- 101
0
votes
1
answer
9
views
Single model or multiple models for predicting at each level in a multi-level classification problem
Given a flat structured data with features that can be considered hierarchical, where each feature is at a different level (e.g., Brand at the top level, Product, Color, and Size at different levels), ...
0
votes
0
answers
10
views
Accelerated learning when wrapping layers in a class
I am implementing a VGG-like network using Pytorch 1.13.1 (python=3.7.12) for image classification on the CINIC-10 dataset. The following two implementations turn out to have very different training ...
- 1
0
votes
1
answer
12
views
How many parameters does the vanilla Transformer have?
The original Transformer paper (Vaswani et al; 2017 NeurIPS) describes the model architecture and the hyperparameters in quite some detail, but it misses to provide the exact (or even rough) model ...
- 163
1
vote
2
answers
24
views
How to boost the performance of a single decision tree by adding additional trees?
I have a binary classification task and the data has imbalance issue (99% is negative and 1% is positive). I am able to build a decision tree that is carefully tuned, weighted, and post-pruned. Take ...
- 11
0
votes
0
answers
13
views
how each tree in random forest structured/built?
I'm new to machine learning and I want to use random forest for the problem I have. What I have done so far is I did the 80/20 split of the original data set.
I need to understand what will happen ...
- 1
0
votes
0
answers
5
views
fine tuning open ai model with historical data
i'm trying to understand more about training models and unsure how to approach this problem.
I have a bunch of historical financial data that I would like open ai to use as additional context when ...
- 101
0
votes
1
answer
11
views
moments of weight vectors in Adam
When performing backpropagation with Adam algorithm, are the moment and the second moment of the weight vectors calculated also for the weights in hidden layers?
- 122
0
votes
0
answers
6
views
Feature selection in high-dimensional datasets with sparse features
What are the most effective techniques for feature selection in high-dimensional datasets with sparse features in the field of natural language processing?
- 101
0
votes
0
answers
9
views
Word2Vec Data Leak
I want to train a machine learning model that can determine the sentiment of tweets about different stocks.
To do this I have a dataset, lets call it A. For dataset A about 30% of the data is labelled....
0
votes
1
answer
11
views
Integrating time context in a machine learning model
Basically, what I'm curious about, are there any methods in machine learning to make the model take into account events that happen in real time that affect the data points during that time period. ...
0
votes
0
answers
18
views
General question on the test and train data
Currently I'm working on a Kaggle problem. I have to predict an outcome by the given information. There are few metafiles for training a model with lots of features (>30). However, in the test file ...
- 1
1
vote
1
answer
15
views
Why the label is not explicitly involved in the loss function of skip-gram?
I am recently learning word embedding myself. When learning skip-gram from the paper https://arxiv.org/pdf/1310.4546.pdf[Distributed Representations of Words and Phrases and their Compositionality], I ...
- 11
0
votes
0
answers
10
views
What are the state-of-the-art knowledge distillation methods?
I need to implement some state-of-the-art knowledge distillation (KD) methods to distill dark knowledge of the teacher network to the student network with Pytorch.
I would really appreciated to any ...
- 1
0
votes
0
answers
8
views
Difference between Validation Error on Learning Curve and Validation Error Calculation in Machine Learning Model
I am encountering a problem where the validation error I see on the learning curve of my machine learning model is different from the validation error I calculate using the mean squared error function....
0
votes
0
answers
7
views
How to add query filter to the Nearest Neighbors algorithm?
I have Nearest Neighbors model, built with sklearn sklearn.neighbors.NearestNeighbors, which I use to make content based recommendations.
Sometimes I need to ...
- 101
0
votes
1
answer
18
views
GPT-2 architecture question
I am currently working on a NLP model that compares two comments and determines which one would be more popular. I have already came up with an architecture - it will be based on GPT-2. But now I am ...
0
votes
1
answer
26
views
Understanding correlation - Machine Learning
I am experimenting a project on identifying cancer or not - Binary classification
The dataset has many columns. Here, I added correlation values between few input columns and the target column[cancer/...
- 21
0
votes
1
answer
12
views
Do models of social systems suffer from prediction drift?
Background
I've created a binary classification model that predicts the probability of fraud for a given sample.
The choice of threshold allows me to set how many frauds are captured in the training ...
- 511
0
votes
1
answer
27
views
Why does Logistic Regression perform better than machine learning models in clinical prediction studies
I am developing binary classification models to predict a medical condition in my dataset. My results show that both Linear Regression and Linear SVM consistently outperformed other ML algorithms (SVM,...
- 365
0
votes
0
answers
26
views
How to combine two datasets to create training data
I am working on a problem where I have say dataset 1 (D1) and dataset 2 (D2), now D1 has three features F1, F2, F3, and D2 has four features F1, F2, F3, and F4. The number of samples in D1 is 7000 and ...
3
votes
1
answer
31
views
How can someone build a dataset for a "propensity to purchase" model?
Ok, this might seem a trivial question for some and it's not even a question, more like a discussion. I read the rules and I believe it's everything fine, so I'm gonna take my chances...
Here's the ...
- 31
0
votes
0
answers
8
views
Practical limits of backpropagation
I have been performing a few neural network algorithms to perform linear regression.
First, I tried SGD. It takes around 20000 epochs to converge, but loss (MSE) is around 0.001.
(To note that perfect ...
- 122
0
votes
0
answers
9
views
Why is ReLU so effective?
The question title is pretty self-explicative.
I'm pretty new to ML and I can't figure out how a function that returns x if x > 0 else 0 can be so good as activation function
- 122
1
vote
2
answers
58
views
+50
mapping similar strings to same number values
I need a way to map strings to a numeric space, where the mapping moves similar strings to the same number.
For example:
in
...
- 61
0
votes
0
answers
8
views
Problem of constant shift in prediction for neural network regression model with gradient-domain loss function
I'm training a regression model using neural network which is trained on MSE of both output and spatial gradient of output. With some simplification, the model is:
$$
y = f(\mathbf{x};\theta)
$$
where ...
- 1
1
vote
1
answer
12
views
Does high number of output labels affect the performance of BERT and how to handle the class imbalance issue while doing multi text classification?
I am using BERT to do multiclass text classification. The number of output classes I have to predict from is: 116 and there is high degree of class imbalance that I see.
We have the following kind of ...
0
votes
0
answers
24
views
Differential equations, real time measurements of variables, and ML
TL;DR: We measure variable $x$ every $10$ minutes, solve a differential equation $\frac{\mathrm{d}y}{\mathrm{d}t}$ where $y=f(x)$. We are interested in the time it takes for the cumulative value of $y$...
1
vote
2
answers
21
views
How can i implement an confucion matrix?
im trying to do a research but i need to make a confusion matrix how can i do that on this model?
https://www.kaggle.com/code/stpeteishii/race-classify-densenet201
Sorry im so so new to everything.
- 11
1
vote
1
answer
31
views
Best ML models for long term time series forecast
I have a project to make a long term prediction (like 5 years) of electricity production by types of power plants (solor, wind, coal, nuclear etc.).
I have access to time series data in MW [megawatts] ...
- 11
0
votes
0
answers
8
views
How to generate synthetic feature instead of synthetic image using Diffusion-based generative Model?
Is it possible to pass some extracted features from the pre-trained ResNet model to a diffusion model for training and further generate synthetic features instead of images like GAN or VAE?
P.S. I ...
- 301
0
votes
0
answers
11
views
Siamese Neural network inputs
A currently task involves the classification of bacteria as antibiotic susceptible and antibiotic resistant.
I have 4 data sets: treated resistant, treated susceptible, untreated resistant and ...
0
votes
1
answer
17
views
what is static objective function
Paper on Adam mentions Stationary Objective function. I am not able to find its definition on Internet (or may be it's there with some other name and I am not able to figure it out). I will be ...
- 203
0
votes
0
answers
5
views
Which is the best choice for evaluating models on small and unbalanced textual datasets?
We are dealing with a small multilabel dataset (around 15k samples) of texts that is imbalanced. Some classes have more than 4k samples and others have around 700 samples. We are using a classifier ...
- 139
0
votes
1
answer
29
views
Are some weight gradients equal?
I want to create a 3 layers neural network from scratch to perform linear regression.
The first and the second layer have 2 neurons, and the last layer has one neuron.
Feature vector x is divided into ...
- 122
0
votes
1
answer
16
views
How to split a single feature vector into a layer of 2 neurons
Given an array x = [1, 2, 3, ...] , I want to split each sample x[i] into 2 neurons.
My idea was to initialize a variable ...
- 122
1
vote
0
answers
23
views
SVM, Is the slack value always equal to the alpha value for points within the margin?
I'm preparing for an exam and I got stuck on this question.
I understand that the alpha values 'affects' how much influence corresponding data point has on the position of the decision boundary, and ...
- 11
0
votes
0
answers
20
views
Workflow for improving and comparing deep learning models
Say I have the most basic neural network that performs some task (eg Keras sequential model with one hidden layer, used to binary classification) and a list of ideas how one could improve it (like: ...
- 103
0
votes
0
answers
17
views
What are some approaches to improve the classification of ONE particular instance of interest?
I'd like to know if there are some methods to correct a specific misclassified instance of interest (e.g. in a Logistic Regression or Random Forest).
Like maybe increasing the error for that ...
1
vote
0
answers
20
views
How to calculate gradient of MSE in backpropagation? [duplicate]
I want to implement a neural network from scratch to solve linear regression by using backpropagation. I don't understand how to compute the gradient of the MSE cost function with respect to each ...
- 122
0
votes
0
answers
16
views
Is binary classification a good starting point for estimating the predictive uncertainty of the model
If yes, are there any papers that mention this point of view?
- 23
1
vote
1
answer
31
views
Can I fit a model with the parameters found with RandomizedSearchCV?
I want to ask you a question.
Suppose I use the following RandomizedSearchCV to find the model's best hyperparams:
...
0
votes
1
answer
21
views
Feature engineering for interest-based age classification
I have a dataset which has users (rows) with the list of their interests (IABs), which looks like this
...
- 1
0
votes
0
answers
10
views
Product scrape data clustering model
I am developing a tool that scrapes multiple websites for products. Some websites sell the products themselves, while others feature products sold by third-party sellers that may have incorrect ...
- 101
0
votes
2
answers
20
views
Using time serie to predict another variable
I would like to analyse head rotation data in space. For this I measured at 15HZ the rotation around the X, Y and Z angles for a little more than ten minutes. I would like to use these movements to ...
0
votes
0
answers
14
views
TensorFlow Attribute error
I am trying to learn to solve differential equations with TensorFlow.
Can anyone tell me how to correct this error from PS python3 .\simple_ode.py
...
- 1
0
votes
1
answer
29
views
ReLu layer in CNN (RGB Image)
I am able to get convoluted values from RGB Image lets say for each channel.
So I have red channel with values: -100,8,96,1056,-632,2,3....
Now what I do is that I ...
- 103
0
votes
1
answer
21
views
Statistical test for comparing number of clusters in data
I am performing $K$-means clustering on a dataset consisting of $n$ observations and $d$ variables, and I'm trying to determine the optimal number of clusters. Is there a test that can determine the ...
- 121
0
votes
0
answers
6
views
Internal Validation of K-Modes in R
I am wondering if anyone knows of an R library suitable for internal validation of the k-modes algorithm?
Therefore, an R library with silhouette coefficient and other indices suitable for validating ...
- 203