Questions tagged [features]
The features tag has no usage guidance.
96
questions
0
votes
0
answers
24
views
propper feature encoding
I working with the following data set
also here is it's detailed description of "packet_dat" column
I can't understand how I can encode packet_dat column into proper feature so my ...
- 101
0
votes
0
answers
18
views
How to best visualize feature-label combinations as a tree/chart/table?
Given different combinations of four feature, a, b, c, d, we can get different different sets of labels from a fixed label set ...
- 2,340
0
votes
0
answers
17
views
Formal terminology: metafeatures then groupby (GROUP BY) operation
In ML training and other analytics I often combine features to produce a 'metafeature' and then perform a 'groupby' (pandas) or 'GROUP BY' (SQL) query. What is the technical term for this operation?
...
- 208
0
votes
2
answers
494
views
How many features is too many when using feature selection methods?
Now obviously there is no such thing as an ideal number as every problem is different, but I've been Googling, ChatGPTing, & Youtubing this question for a few days now and I am constantly getting ...
0
votes
1
answer
18
views
Time series and regression with dataframes as features
I am working on a data science project where I have 4 different dataframes representing 4 different metrics (let's say, met1, met2, met3 and met4). These metrics are time series and each one of them ...
1
vote
0
answers
37
views
Feature Importance in Stacked Model
I have built a stacked model using mlxtend StakingCVClassifier. I want to know the feature importance scores now. Is there any way I can calculate feature importance scores for the stacked model? If ...
- 11
0
votes
0
answers
23
views
Intuition behind Jensen Shannon divergence between deep features of two images?
Jensen Shanon divergence is mainly used to determine the divergence between two probability distributions. Can it be used to calculate the difference between the deep feature vectors of two images?
I ...
- 1
0
votes
1
answer
133
views
How would I design a database structure for a feature store?
I have a personal project to create predictions for tennis matches.
It currently consists of a Python application and a MySQL database. I extract data from various websites and APIs and store it in ...
- 103
0
votes
0
answers
50
views
Best Feature Extraction Practise for Long Audio Data
I have a video dataset and my aim is classifying predefined scenes in these videos at 1fps (that means I perform classification at each second). Therefore, I plan to fuse audio and visual features for ...
0
votes
0
answers
16
views
how to analyze model performance without any ML libraries using a BI tool?
I have a dataset that has the ML model predictions along with the true labels column of the predictions and ...
- 13
5
votes
2
answers
565
views
How to handle similarity search on mixed data types vectors?
I think this question is one that many beginners run into and I could not find a decent generic guide for it.
My issue is the following. I want to evaluate similarity of vectors which have mixed data ...
- 53
0
votes
1
answer
28
views
How to fit n features in a number of neurons smaller than n
Suppose I have a feature composed by 784 numbers, and I want to use it as input of a neural network implemented from scratch whose first layer has 64 neurons.
How can I put 784 numbers in 64 neurons?
- 152
0
votes
1
answer
150
views
Should highly correlated features be removed, even if they have different type of information?
A quick example for this: we have many feature and two of them are policy count and premium_total (for all policies). We are predicting the expected claim amount with GBM or RF. Both policy_count and ...
- 25
0
votes
1
answer
444
views
Shapley Values - How to interpret each value for each feature for a specific instance?
I am using Shap Values(the 'shap' module in python) to help me understand a bit better the relation between my features and my target. I am currently working on a binary classification problem.
I know ...
0
votes
0
answers
31
views
How the low level features are combined to form high level features in CNN? What happens to combine low level feature to form higher ones in bw layers
I want to understand basics behind cnn features formation like how high level features are formed using low level features in a CNN?
0
votes
1
answer
18
views
How do I match the number of the features of new text data to the data used in the training of the model
I am working on a classifier for some twitter data to predict who it was tweeted by. I am only using the text of the tweets to build the model. After all text related preprocessing here is how I ...
- 11
1
vote
1
answer
697
views
How to select relevant columns from a dataset with many features
I have a dataset with a large number of potential features (>100) and I am interested in finding a relatively small subset of these (maybe on the order of 5, or 20) features which is best suited to ...
- 45
0
votes
0
answers
17
views
How to use a material number as a feature for Machine Learning?
I have a problem. I want to use a classification algorithm. I also have materialNumber as a column. Could I use that as a feature for my Machine Learning algorithm? ...
- 89
0
votes
1
answer
66
views
Create features for each row or only for a specific value
I have a problem. I want to predict when the customer will place another order in how many days if an order comes in.
I have already created my target variable ...
- 89
1
vote
0
answers
53
views
Reverse engineer PII sensitive data from Inceptionv3 pre-trained model generated features
I'm using the pre-trained Inceptionv3 to build out features from proprietary documents. Some of these documents contain sensitive PII data. I use the 2K output from the second last layer as the ...
- 11
0
votes
2
answers
66
views
Hard time finding literature on feature clustering using Principal Component Analysis
Im new to StackExchange, so i am sorry if this is not the right way to ask a question on StackExhange.
For my thesis I wish to propose a methode for future research on using PCA to cluster features (...
- 1
0
votes
0
answers
23
views
Relation between Features & Polynomial Equations in Machine Learning
In Machine Learning, if the data we are working on has, say, 6 features/variables, does that mean the prediction line/curve of our ML model is represented by a Hexic polynomial equation whose degree ...
- 275
1
vote
1
answer
553
views
Feature engineering before splitting
This is a sister post to the original closed post (here). Since the data transformation part is done after data spliting on the TRAINING data only, I wonder wouldn't such transformation has dependency ...
- 411
1
vote
0
answers
19
views
Is there a multi-modal population based metaheuristic that is non-GA?
I have a feature set from which I want to select various combinations and permutations of the features. The length of a solution feature vector can range between , say 5 - 20 features , and the ...
- 11
0
votes
1
answer
968
views
Is there a way to combine multiple ML models where each use datasets with different features?
I have a dataset where some features (c,d) apply to only when a feature (a) is a specific value.
For example
...
- 1
0
votes
1
answer
167
views
train-test split on forecasting a time series using external features
I have a question regarding the train-test split when forecasting a timeseries using features instead of the time series itself. I know that I should use a time-based train-test-split if i use lagged ...
- 3
1
vote
1
answer
27
views
Finding attributes that make up dense clusters of fraudulent transactions
I have data about purchases customers made in my website.
Some users later decline the purchase, a scenario I'd like to avoid.
I have lots of data about the purchases made in my website, so I'd like ...
1
vote
0
answers
16
views
vertical or horizontal storage of timesteps in feature store
I'd like to use a feature store to store some time series and I asked myself what's the best way to store the timesteps. Is it better to store each timestep horizontal and then doing windowing after ...
- 111
0
votes
1
answer
31
views
Query regarding the 'Data type' of features in Machine Learning
Should all the features in a dataset be converted to the same data type? For instance, if all the features have numerical values, some int & some float, should they all be converted to float? What ...
- 275
2
votes
1
answer
389
views
Training & Test feature shape is different from number of columns in dataset
I am making a Sequential Neural Network for regression with 3 dense layers which will be trained on a simple dataset. But before I even get to that part of the code to execute the model I am getting a ...
1
vote
0
answers
15
views
Can regression algorithms treat multiple input features as a single feature for prediction?
I have a regression problem where I have multiple RSSI values from 3 beacons and I need to predict the x & y coordinates of the mobile object sending the signals based on the RSSI values captured ...
- 11
0
votes
1
answer
26
views
How to choose feedforward architecture for few number of features but very large instance?
Assume I have 1 million of data instance and each instance contains 100 feature. For each instance, I also have a lable.
The ...
- 319
1
vote
1
answer
43
views
How to build multiple variable regression having a mix of numerical & categorical features?
There is a need to estimate Annual Average Daily Traffic Volume (AADT).
We have bunch of data about vehicles' speeds during several years. It is noticed that AADT depends on the average number of such ...
0
votes
1
answer
163
views
Non-commutative distance formula
I am trying to find a distance formula or a method that can give the non-commutative distance between two points in a feature space.
Suppose there are two movies represented in an R^n feature space. ...
- 1
1
vote
1
answer
32
views
Integer encoding and weighing when one feature consists of more names [closed]
Hello I am trying to make a content based movie recommendation system and one feature is genre of the movie. I will give an integer number to each genre randomly. However, some movies are of more than ...
- 25
0
votes
1
answer
468
views
Resampling : My dataset is categorical or numerical?
I have a dataset with 203 variables. Like age>40 (0 -yes, 1-no), gender(0 or 1), used or not 200 types of drugs (one hot encoded into 200 variables), and one target variable (0 or 1). This is an ...
- 103
0
votes
1
answer
29
views
Using partially defined features in an unified deep learning model
Suppose we have two types of feature A and B. A is defined for all kinds of samples while B is only defined for some of the samples. Here, B is partially defined does not mean B is missing value (such ...
- 515
1
vote
1
answer
17
views
Structuring extensive medical histories + demographic information for prediciting future medical outcomes
I'm looking for advice structuring extensive medical histories for predicting future outcomes, specifically hospital admissions.
Let's say I want to predict the whether or not someone will be admitted ...
- 111
1
vote
0
answers
17
views
Latent space for cross domain numerical features
I would like to find the shared latent space between two set of features. I have source and target domain features already extracted from images. I have 4 set of feature vectors for normal and ...
- 21
2
votes
0
answers
735
views
How SHAP value explains contribution of features for outliers event?
I'm trying to understand and experiment with how the SHAP value can explain behaviour for each outlier events (rows) and how it can be related to shap.force_plot(). ...
- 364
1
vote
2
answers
180
views
Does binning a time series with pd.qcut (using quantiles) create data leakage?
Let's say I want to predict whether a company will default on it's debt at some point in time (so binary classification) and one of the time series variables I'm using is the "revenue" of ...
2
votes
1
answer
1k
views
Multi-Feature One-Hot-Encoder with varying amount of feature instances
Let's assume we have data instances like this:
...
- 23
1
vote
2
answers
376
views
-2
votes
1
answer
77
views
combine two features into one [closed]
In an epidemic disease dataset of 3 months, I have a feature (var dt_died) with the death dates of patients (800 people died out of all 12k unique subjects in this dataset, so obviously only dead ...
- 103
0
votes
1
answer
533
views
Feature importance difference in two similar machine learning models
Situation 1:
I have trained a text classification model (Model 1) which gives me a probability of true class as X. I have also trained a classification model (Model 2) using only the categorical and ...
3
votes
0
answers
78
views
Non-Gaussian like distributions - Classifier of source data fails on target data
I ask you for help on a classification problem (classes are represented by the numbers 0,1 and 2). All features are extracted from time series data (fundamental is sinus shape).
I have a source ...
- 41
1
vote
0
answers
37
views
Self Organising Map with variable length ordered sets of N-grams
I want to preface my question with the highlighted situation I have might not be applicable to kohonen self organising maps (SOM) due to a lack of understanding on my part so I do apologise if that is ...
- 111
1
vote
1
answer
238
views
distribution difference between image and text
Once for the task of image captioning I've read that, the features extracted from image and text by deep networks are from two different worlds and got different distribution. My question is how is ...
- 249
1
vote
1
answer
338
views
Neural networks with not-fixed dimension for input and output
I would like to know if it exists a model/method which can deal with input and output of different dimension.
For example, let us say that the maximum number of info we could have is 6 features and 5 ...
- 23
1
vote
0
answers
28
views
Machine learning on graphs
I'm looking for some method/model to help me with my current problem:
I have a geometry, consisting of points, and eges. For each point I take information about itself and its neighbours. For now I ...
- 23