Questions tagged [features]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
50 views

Should highly correlated features be removed, even if they have different type of information?

A quick example for this: we have many feature and two of them are policy count and premium_total (for all policies). We are predicting the expected claim amount with GBM or RF. Both policy_count and ...
0 votes
1 answer
51 views

Shapley Values - How to interpret each value for each feature for a specific instance?

I am using Shap Values(the 'shap' module in python) to help me understand a bit better the relation between my features and my target. I am currently working on a binary classification problem. I know ...
0 votes
0 answers
11 views

How the low level features are combined to form high level features in CNN? What happens to combine low level feature to form higher ones in bw layers

I want to understand basics behind cnn features formation like how high level features are formed using low level features in a CNN?
0 votes
0 answers
44 views

SHAP: How can interpret a certain feature has positive or negative impact correctly?

I want to raise a question here already I created an issue in the related workaround but still haven't gotten any clarification about it. I also want to tag most related posts I found: post1 & ...
  • 385
0 votes
0 answers
15 views

Machine learning features - detect mean shift using expected values

I have an LGBM model that trains on machine learning features and predicts some numerical outcome with new data coming periodically. I would like to make sure that the new input data is "similar&...
  • 1
0 votes
1 answer
14 views

How do I match the number of the features of new text data to the data used in the training of the model

I am working on a classifier for some twitter data to predict who it was tweeted by. I am only using the text of the tweets to build the model. After all text related preprocessing here is how I ...
  • 11
0 votes
0 answers
10 views

Zernike moment calculations

I am trying to work with Zernike moments and am after all my efforts not able to understand a few things. Following is the formula I found in literature: I cannot understand what the impact of p (...
  • 21
1 vote
1 answer
318 views

How to select relevant columns from a dataset with many features

I have a dataset with a large number of potential features (>100) and I am interested in finding a relatively small subset of these (maybe on the order of 5, or 20) features which is best suited to ...
0 votes
0 answers
16 views

How to use a material number as a feature for Machine Learning?

I have a problem. I want to use a classification algorithm. I also have materialNumber as a column. Could I use that as a feature for my Machine Learning algorithm? ...
  • 89
0 votes
1 answer
61 views

Create features for each row or only for a specific value

I have a problem. I want to predict when the customer will place another order in how many days if an order comes in. I have already created my target variable ...
  • 89
1 vote
0 answers
46 views

Reverse engineer PII sensitive data from Inceptionv3 pre-trained model generated features

I'm using the pre-trained Inceptionv3 to build out features from proprietary documents. Some of these documents contain sensitive PII data. I use the 2K output from the second last layer as the ...
  • 11
0 votes
2 answers
44 views

Hard time finding literature on feature clustering using Principal Component Analysis

Im new to StackExchange, so i am sorry if this is not the right way to ask a question on StackExhange. For my thesis I wish to propose a methode for future research on using PCA to cluster features (...
  • 1
0 votes
0 answers
81 views

LSTM for binary classification using multiple attributes

I haven't used neural networks for many years, so excuse my ignorance. I was wondering what is the most appropriate way to train a LSTM model based on my dataset. I have 3 attributes as follows: ...
  • 101
0 votes
0 answers
22 views

Relation between Features & Polynomial Equations in Machine Learning

In Machine Learning, if the data we are working on has, say, 6 features/variables, does that mean the prediction line/curve of our ML model is represented by a Hexic polynomial equation whose degree ...
  • 273
1 vote
1 answer
276 views

Feature engineering before splitting

This is a sister post to the original closed post (here). Since the data transformation part is done after data spliting on the TRAINING data only, I wonder wouldn't such transformation has dependency ...
  • 397
1 vote
0 answers
18 views

Is there a multi-modal population based metaheuristic that is non-GA?

I have a feature set from which I want to select various combinations and permutations of the features. The length of a solution feature vector can range between , say 5 - 20 features , and the ...
  • 11
0 votes
1 answer
595 views

Is there a way to combine multiple ML models where each use datasets with different features?

I have a dataset where some features (c,d) apply to only when a feature (a) is a specific value. For example ...
  • 1
0 votes
1 answer
116 views

train-test split on forecasting a time series using external features

I have a question regarding the train-test split when forecasting a timeseries using features instead of the time series itself. I know that I should use a time-based train-test-split if i use lagged ...
  • 3
1 vote
1 answer
24 views

Finding attributes that make up dense clusters of fraudulent transactions

I have data about purchases customers made in my website. Some users later decline the purchase, a scenario I'd like to avoid. I have lots of data about the purchases made in my website, so I'd like ...
1 vote
0 answers
14 views

vertical or horizontal storage of timesteps in feature store

I'd like to use a feature store to store some time series and I asked myself what's the best way to store the timesteps. Is it better to store each timestep horizontal and then doing windowing after ...
  • 111
0 votes
1 answer
26 views

Query regarding the 'Data type' of features in Machine Learning

Should all the features in a dataset be converted to the same data type? For instance, if all the features have numerical values, some int & some float, should they all be converted to float? What ...
  • 273
2 votes
1 answer
295 views

Training & Test feature shape is different from number of columns in dataset

I am making a Sequential Neural Network for regression with 3 dense layers which will be trained on a simple dataset. But before I even get to that part of the code to execute the model I am getting a ...
1 vote
0 answers
14 views

Can regression algorithms treat multiple input features as a single feature for prediction?

I have a regression problem where I have multiple RSSI values from 3 beacons and I need to predict the x & y coordinates of the mobile object sending the signals based on the RSSI values captured ...
0 votes
1 answer
23 views

How to choose feedforward architecture for few number of features but very large instance?

Assume I have 1 million of data instance and each instance contains 100 feature. For each instance, I also have a lable. The ...
  • 309
1 vote
1 answer
41 views

How to build multiple variable regression having a mix of numerical & categorical features?

There is a need to estimate Annual Average Daily Traffic Volume (AADT). We have bunch of data about vehicles' speeds during several years. It is noticed that AADT depends on the average number of such ...
0 votes
1 answer
123 views

Non-commutative distance formula

I am trying to find a distance formula or a method that can give the non-commutative distance between two points in a feature space. Suppose there are two movies represented in an R^n feature space. ...
1 vote
1 answer
28 views

Integer encoding and weighing when one feature consists of more names [closed]

Hello I am trying to make a content based movie recommendation system and one feature is genre of the movie. I will give an integer number to each genre randomly. However, some movies are of more than ...
  • 25
0 votes
1 answer
360 views

Resampling : My dataset is categorical or numerical?

I have a dataset with 203 variables. Like age>40 (0 -yes, 1-no), gender(0 or 1), used or not 200 types of drugs (one hot encoded into 200 variables), and one target variable (0 or 1). This is an ...
  • 3
0 votes
1 answer
20 views

Using partially defined features in an unified deep learning model

Suppose we have two types of feature A and B. A is defined for all kinds of samples while B is only defined for some of the samples. Here, B is partially defined does not mean B is missing value (such ...
1 vote
1 answer
15 views

Structuring extensive medical histories + demographic information for prediciting future medical outcomes

I'm looking for advice structuring extensive medical histories for predicting future outcomes, specifically hospital admissions. Let's say I want to predict the whether or not someone will be admitted ...
  • 111
1 vote
0 answers
17 views

Latent space for cross domain numerical features

I would like to find the shared latent space between two set of features. I have source and target domain features already extracted from images. I have 4 set of feature vectors for normal and ...
  • 21
2 votes
0 answers
575 views

How SHAP value explains contribution of features for outliers event?

I'm trying to understand and experiment with how the SHAP value can explain behaviour for each outlier events (rows) and how it can be related to shap.force_plot(). ...
  • 385
1 vote
2 answers
125 views

Does binning a time series with pd.qcut (using quantiles) create data leakage?

Let's say I want to predict whether a company will default on it's debt at some point in time (so binary classification) and one of the time series variables I'm using is the "revenue" of ...
2 votes
1 answer
753 views

Multi-Feature One-Hot-Encoder with varying amount of feature instances

Let's assume we have data instances like this: ...
1 vote
2 answers
238 views

Xgboost : A variable specific Feature importance

I have a data set something like this: ...
-2 votes
1 answer
67 views

combine two features into one [closed]

In an epidemic disease dataset of 3 months, I have a feature (var dt_died) with the death dates of patients (800 people died out of all 12k unique subjects in this dataset, so obviously only dead ...
  • 3
0 votes
1 answer
410 views

Feature importance difference in two similar machine learning models

Situation 1: I have trained a text classification model (Model 1) which gives me a probability of true class as X. I have also trained a classification model (Model 2) using only the categorical and ...
3 votes
0 answers
58 views

Non-Gaussian like distributions - Classifier of source data fails on target data

I ask you for help on a classification problem (classes are represented by the numbers 0,1 and 2). All features are extracted from time series data (fundamental is sinus shape). I have a source ...
  • 41
1 vote
0 answers
37 views

Self Organising Map with variable length ordered sets of N-grams

I want to preface my question with the highlighted situation I have might not be applicable to kohonen self organising maps (SOM) due to a lack of understanding on my part so I do apologise if that is ...
  • 111
1 vote
1 answer
192 views

distribution difference between image and text

Once for the task of image captioning I've read that, the features extracted from image and text by deep networks are from two different worlds and got different distribution. My question is how is ...
1 vote
1 answer
186 views

Neural networks with not-fixed dimension for input and output

I would like to know if it exists a model/method which can deal with input and output of different dimension. For example, let us say that the maximum number of info we could have is 6 features and 5 ...
  • 23
1 vote
0 answers
27 views

Machine learning on graphs

I'm looking for some method/model to help me with my current problem: I have a geometry, consisting of points, and eges. For each point I take information about itself and its neighbours. For now I ...
  • 23
0 votes
1 answer
168 views

Terminology in machine learning: exogenous features vs external features

I am currently writing a scientific paper and do not know whether to call some of my input features of my neural network either external or exogenous. My neural network receives as input features like ...
  • 65
0 votes
1 answer
4k views

grid search result max_features = 'sqrt' in random forest - how to understand

I did a grid search at random forest params. the result of print(randomforestreg.best_params_) The result is = {'max_depth': 28, 'n_estimators': 500 ',max_features'...
  • 329
0 votes
2 answers
27 views

When combined correlation of features decreases

I'm building a machine learning model in Python to predict soccer player values. I'm trying to predict a "player_value" column containing the value of a specific player. Consider a sample of ...
  • 147
3 votes
3 answers
382 views

How to insert two features in a model when a feature only applies to a certain group in the model

I'm building a machine learning model in Python to predict soccer player values. Consider the following feature columns of the dataframe: ...
  • 147
1 vote
1 answer
70 views

Are my features enough?

I am trying to fit a regression model on a non linear data. The features I have are around 12 and around 800 samples. With the help of PyCaret, i tried to fit the data on to around 22 model, and then ...
1 vote
1 answer
39 views

Imputing features with NA values in classification task

I currently have a dataset where each observation is a person's traffic ticket history over districts. For each column, which represents a district: 1 represents that a person has received 1+ traffic ...
  • 271
4 votes
2 answers
3k views

Similarity Measure between two feature vectors

I have face identification system with following details: VGG16 model for feature extraction 512 dimensional feature vector (...
  • 143
0 votes
1 answer
67 views

Classification or regression problem?

I have a table with this features: ...
  • 1