Questions tagged [sampling]
The sampling tag has no usage guidance.
185
questions
0
votes
0
answers
22
views
statistical analysis of two data sets have different number of sampling
I have two datasets from my statistical fault analysis: one with 400 iterations and another with 500 iterations. Both datasets have the same maximum and minimum values, and some data points are ...
- 1
0
votes
0
answers
54
views
Why is 0.7, in general, the default value of temperature for LLMs?
I have recently read through a lot of documentation and articles about Large Language Models (LLMs), and I have come to the conclusion that 0.7 is, most of the time, the default value for the ...
- 1
0
votes
0
answers
28
views
Training Biased/Uneven Categorical Data with CatBoost, Unbalanced/Unseen Categories Handling
Summary:
I am training a discount eligibility model where the dataset represents historical data for products where people availed discounts based on simple features like product category, discount ...
- 101
0
votes
1
answer
40
views
how to evaluate a model on our data when the model is imported from a library and thus not trained by us?
The company I work for has deployed a trained rule-based sentiment analyzer model vader to make predictions on customer's attitude. We import the model from nltk library directly, so we didn't train ...
- 3
1
vote
0
answers
20
views
Calculating an integral with as few grid points as possible
Suppose I have a function $f\colon [0,1] \to \mathbb{R}$ which is maybe continuous (it's at least in $L^1$).
I have a sample of $N$ points $\{x_i\}$ taken from the domain $[0,1]$ randomly from some ...
- 111
0
votes
0
answers
25
views
Comparing Models based on two different sample sets of a single data set
I want to compare the performance of two different ML models like M1 and M2. I have a very huge data set and having two different downsampling of this data set, call them S1 and S2. Can I compare the ...
- 113
0
votes
0
answers
21
views
How to refine sampling of points via averaging?
I am working with a generative model which is generating points that are less accurate than I would like. I have strong reason to believe the errors should average out along a particular axis (to give ...
- 1
0
votes
0
answers
14
views
Ranking 10^10 random strings
I would like to model a biological process that starts from a pool of 10^10+ random strings (a string can be 6-24 letters long; the alphabet contains 20 letters, say A-T) and I want to order those ...
0
votes
0
answers
15
views
Appropriate sample size for prediction algorithm
Our study aims to develop a Random Forest algorithm to predict the incidence of suicidal thoughts, after one year, based on the responses given to four surveys at baseline (time-1). Each survey ...
- 1
0
votes
1
answer
31
views
Question about collapsing variable and oversampling minority classes
i have imbalanced data consisting of nine classes, and i am planning to collapse them into two classes. i performed stratified (proportionate) sampling between test, validation, and training sets ...
- 121
0
votes
0
answers
12
views
Normalizing flows with truth values?
I am interested in using normalizing flows to map to a certain distribution of points, but I want to make sure that the distribution is not just of the correct general shape, but also that specific ...
- 31
0
votes
0
answers
10
views
What is the best way to apply Bootstapped weights to data for statistical analysis?
I'm working with a survey dataset for some statistical analysis. My issue is that there are weight columns, but I have no idea how they did the weighting or what the weights are for. I'm not familiar ...
1
vote
0
answers
10
views
Group or find associations and orderings for elements that appear in different samples (analyzing examples of input files for undocumented code)
I'm trying to understand and use a physics simulation code that was written decades ago. It uses input files that have their origins in stacks of punch cards as input. In other words each line is a ...
- 121
0
votes
0
answers
22
views
Generate new sample with higher variance, covariance from empirical distribution
I am analyzing the joint distribution of three continuous variables. I would like to sample from the joint distribution of these three variables, which is straight forward. However, I also want to ...
0
votes
1
answer
45
views
Is Logistic Regression possible using a Convenience Sample?
I've collected some survey data on homeless individuals, surveying their drug use, education level, age, gender etc. I hope to run a logistic regression to see how impactful homelessness (+other ...
0
votes
1
answer
90
views
Understanding bootstrapping in bias variance decomposition
I was going through bias and variance tradeoff article and it makes use of bias_variance_decomp function from mlxtend library. ...
- 179
0
votes
1
answer
44
views
Determining the information loss due to undersampling
I have an image dataset that I need to segment into directories (train, validation and test) using ImageDataGenerator in TensorFlow/Keras. The dataset is highly imbalanced:
For this I have decided to ...
- 77
1
vote
1
answer
406
views
Creating a dataframe using roll-forward window on multivariate time series
Based on the simplifed sample dataframe
...
- 141
1
vote
2
answers
58
views
Strategy to choose maximum value from an unknown array of n numbers
Suppose you have an array of n normally distributed numbers whose values are initially unknown(and the probability parameters are unknown too). You must choose one number and you want it to have ...
- 123
0
votes
0
answers
64
views
class label is less than 1 percent in classification problem
I am working on a ML problem where one class label is very less than even 1 percent. i.e 0.0002%
I have tried undersampling, oversampling, SMOTE but the results are not satisfactory on the model.
I ...
- 101
4
votes
3
answers
184
views
Timing of applying random oversampling on the dataset
I tried to learn classification using machine learning algorithms. I went through Breast Cancer - EDA, Balancing and ML the notebook. In this notebook ...
- 359
1
vote
0
answers
90
views
How to subset a 'representative sample'?
Sometimes I need to subsample a dataset for my analysis/modelling. What are the strategies/things to check for to select a subsample that's representative of the entire sample? And in addition, how to ...
- 411
2
votes
1
answer
755
views
Why we do random sampling when we select the training set?
The usual workflow when building a machine learning model starts with random splitting the data set into training and test set.
What I can't understand is why we do this. For example lets say we have ...
- 181
1
vote
0
answers
12
views
Data collection after the model is built and deployed
I have built a machine learning model which predicts whether a customer will buy a product or not. The model performs well on cross validation tests. Now, I will deploy it in production to recommend ...
- 123
0
votes
0
answers
21
views
Scikit Learn Random Forest Classifier Hyperparameter Min Target Sample Size
From reading the docs on Scikit Learn, I haven't been able to find an answer, but does anyone know if there is a way to specify to always include a specific number out of the max sample size of ...
1
vote
0
answers
45
views
Interrupted Time Series with Unevenly Distributed Samples
I'm working on causal inference using Interrupted Time Series Design.
I have multiple samples per day and am selecting my analysis bandwidth based on pre-treatment RMSE on leave-on-out cross ...
0
votes
1
answer
21
views
How can I distribute samples optimally to fit a model?
I'm trying to fit a model to a low number (~5-10) of data points. I might be able to suggest the optimal distribution of the data points beforehand, knowing a bit about the data and the model I ...
- 101
0
votes
1
answer
35
views
Recommended number of features for regression problem
In the following link the answer recommends a feauture amount of N/3 for regression (or it is quoted).
Where N corresponds to the sample size:
How many features to sample using Random Forests
Is there ...
- 3
2
votes
3
answers
96
views
What could go wrong if I sample before classification?
I have a million entries in a table that I can use to train a binary classifier. Only 30 thousand of them are positive. Is there anything fundamentally wrong with selecting around 30 thousand negative ...
- 196
0
votes
1
answer
34
views
Sampling a data based on average and variance of another data
I have a set of textual datasets that have the following average and variance tokens lengths:
...
- 252
0
votes
0
answers
568
views
Is it always appropriate to use SMOTE in an imbalanced multiclass dataset?
Is it good practice to always use SMOTE and random undersampling in an imbalanced multiclass dataset or are there exceptions? In context, I am using a traditional machine learning model (SVC) for ...
0
votes
0
answers
32
views
Compare standard deviations in different samples?
I have some data which you can group based on different variables.
I know how to test if they have significantly different means. But what the deviation inside the samples?
- 189
2
votes
1
answer
197
views
How create a representative small subset from a huge dataset, for local development?
I have a time series problem and the dataset I'm using is rather huge. Around 100GB. For local development I'm trying to subset this into a very small batch around 50MB, just to make sure unit tests ...
- 123
1
vote
0
answers
31
views
Stratified sampling - use of proxy variable
For splitting of the data into train/test/val I use stratified sampling. Is it appropriate to define strata using information extracted from the dataset? E.g. use machine-learning to model proxy ...
- 11
1
vote
1
answer
72
views
Sampling Technique for mixed data type
I am looking for a very specific sampling technique which pertains to a very large dataset with mixed data type i.e, I have categorical as well as continous variables and want to have a sample that ...
- 13
2
votes
1
answer
39
views
Discrepency in 25th percentile of standard deviation calculation
For each of the following sample sizes [3,5,7,9], I Need to calculate the 25th percentile of the standard deviation for the values sampled. And the total number of trials will be 10.
DataFrame
...
- 143
0
votes
0
answers
62
views
Is it right method to remove instances that are hard to predict before train test split?
In a binary classification problem,
I have a slightly unbalanced medical dataset with class distribution:
0:5600, 1:1500
0 without a problem and 1 with a problem.
I tried many pipelines, automls, and ...
- 103
1
vote
1
answer
42
views
Multiclass data redistribution
I want to redistribute the data in classes according to new proportions and wonder what is the optimal way to do it.
For example I have
...
- 301
2
votes
1
answer
500
views
Negative sampling for graph representation learning
I was watching a lecture about graph representation learning (from here) and got a little bit confusing about how they define the negative samping procedure.
In the presentation J. Leskovec briefly ...
- 21
1
vote
1
answer
1k
views
Is there a relationship between learning rate and training set size?
I have a large dataset to use for training a Neural Network model. However, I don't have enough resources to do a proper hyperparameters tuning on the whole dataset. Therefore, my idea is to tune the ...
- 95
1
vote
1
answer
56
views
Reducing (Variance) | the gap between my weights
I have ML ready samples. And each sample has a weight.
The weights distribute between [0-1]
My problem arise because there are a lot of samples which are ...
- 121
0
votes
1
answer
788
views
Controlling the sampling from Variational AutoEncoder (VAE)
Suppose a Variational Autoencoder (VAE) is trained with mnist data. To sample, one draws from normal distribution. My question is: suppose I am interested in generating only 1s and no other digits. ...
- 103
1
vote
2
answers
618
views
Subsampling the “right” amout of data to train an ML model
I am training a machine learning model (i.e., a classifier) on a large dataset. I know that I can get the same results using less data (about 30%) but I would like to avoid the trial and error process ...
- 11
1
vote
0
answers
46
views
Stratification sampling of a json Array [closed]
I have a json array file that i need to create a smaller sample of for testing purposes. A sample of the file looks like:
...
- 11
1
vote
1
answer
396
views
What is the proper proportion for train and test set for classification system?
I have recently googled the best proportion for training and test set for classifying physiological data between normal and abnormal. Much of the source tells that the proportion should be 70:30 or 80:...
- 21
2
votes
2
answers
311
views
Undersampling for credit card fraud detection before or after Train/Test Split
I have a credit card dataset with 98% transactions are Non-Fraud and 2% are fraud.
I have been trying to undersample the majotrity class before train and test split and get very good recall and ...
2
votes
3
answers
387
views
Sampling n data points from high dimensional data
I have some face images(of a single person), which I ran through an embedding generator to get 128-dimensional embedding.
I have 1000 such embedding (shape of the dataset (1000, 128)). I have a ...
- 121
1
vote
1
answer
96
views
How to bin a distribution data reported with different frequencies ( salaries ), showing mixed linearity and non-linearity?
I am researching on pay-scales, and wish to receive advise to treat data of salaries.
Objective
My interest is to approximate the salary corresponding to different hierarchical levels in an ...
- 165
0
votes
0
answers
31
views
Sampling items from a population of subpopulations
I have a population of $n$ items to label and a budget to label only $m$ ($m << n$) of them before training. The population can be partitioned into subpopulations, recursively. In other words, ...
- 697
1
vote
2
answers
53
views
Recover a integer valued function with *-learning
I have the following problem. From a technical model we have a function $f(n,p)$ approximating its runtime. The function $f$ which maps
$$
f: \mathbb{N} \times \mathbb{P} \to \mathbb{R}_{+}
$$
where $...
- 111