Questions tagged [feature-construction]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
18 views

How to represent a time duration feature for cases where time is still counting

I have a problem where I am trying to classify the outcome of costumer complaint cases. I have several features already such as type of item bought, reason for complaint etc... I am trying to add a ...
user avatar
1 vote
0 answers
11 views

Best way to represent a version feature based on percentiles

We're training a binary classifier in AutoML, and one of the features consist of browser versions. Currently these versions are provided "normalized" to the model, according to the ...
user avatar
1 vote
1 answer
86 views

Algorithms for casual feature selection for continuous Y

Currently I have been trying to find some good algorithms for feature selection. Using correlation or other non casual type of method will not be the right way to do a feature selection. I'm am ...
user avatar
0 votes
0 answers
16 views

Deep learning / computer vision technique: aggregating many input images to a single representation of the features within

I have a few thousand grayscale images, and I would like to generate a universal representation of the patterns within - a semantic/ordered composition of all features, so to speak. For instance, take ...
user avatar
  • 101
3 votes
1 answer
127 views

Finding if an outcome is predictable

Suppose we are asked to predict something given a set of features, how do we know if that target is actually predictable? That is, how do we know if there is actually some relation between the ...
user avatar
0 votes
0 answers
18 views

How do you aggregate features of lists (pooling alternatives)?

Is it possible to reduce non-correlated multi-dimensional data over features to 1D data? A working option is pooling (mean/min/max) over an embedding vector (n samples of embeddings of m dimensions). ...
user avatar
  • 101
0 votes
1 answer
91 views

How to model a 3D graph into a vector so that I can feed it into a classification algorithm?

I have a 3D graph like below: Ref: google images It has 2 angles as X and Y and the Z axis is amplitude value (Each 3D graph is representing a pixel). I want to model this into some useful data ...
user avatar
1 vote
0 answers
11 views

Tsallis entropy - advice needed regarding obtaining probability distribution

As is always the way I stumbled across Tsallis entropy on SO whilst looking for something completely different. This soon lead me reading all sorts of interesting but terse academic papers. I am ...
user avatar
1 vote
0 answers
61 views

How to add more weight to certain features?

I have extracted features from two types of signals. Prior to merging them to create one feature vector, I have computed an importance score of every feature within that type of signal. I would like ...
user avatar
  • 11
1 vote
0 answers
22 views

Regression with a feature which has its own depth

I'm relatively new to ML/Statistical Analysis, and I'm facing a dataset structured like this ...
user avatar
  • 11
2 votes
1 answer
56 views

How do I combine predictions from classifiers for two different problem?

I am working on a classification problem for predicting whether the shipment is going to be late or not. I would say the classifier is mediocre at predicting the positive class at the moment. But the ...
user avatar
  • 21
1 vote
0 answers
38 views

Best Feature extraction for at the end retrieving audio

I work on a machine learning algo, which basically learns sequences in an audio .wav and generates the most “logical” sequences. The algorithm learns features, so I generate MFCCs from the audio file. ...
user avatar
1 vote
0 answers
44 views

Data Lineage/Traceability in Pipelines

I want to collect information about: 1) from which single data signals a feature is composed in a ML pipeline and 2) what data preprocessing operations are/were executed on a data signal. Does anyone ...
user avatar
1 vote
1 answer
49 views

How to model a supervised recommender system with varying data

Suppose there are 2000 movies and a company wants to recommend some movies (for example, at most 5 movies) to each visitor. The objective is to learn how to predict which movie will be selected if a ...
user avatar
  • 181
1 vote
2 answers
44 views

Problem with a feature (normal distribution + peak around 0)

I have a feature that shows a characteristic of the instances. That characteristic can be present or not. If present it shows an almost normal distribution of values (actually a bit skewed to the ...
user avatar
1 vote
0 answers
53 views

Handling highly correlated features [closed]

I have a data set of transactions and want to build a fraud detection model (classifier). Only 3 variables are given that could be used as input features. The number of transactions during past 3, 6 ...
user avatar
1 vote
0 answers
23 views

Is there a common relationship between data inputs and the number of attainable features?

Is there a known relationship between the amount of information gain that comes from new data added to a dataset? for eg: If I have a plant watering system that tells me: An integer of how wet the ...
user avatar
1 vote
1 answer
34 views

Imputing features with NA values in classification task

I currently have a dataset where each observation is a person's traffic ticket history over districts. For each column, which represents a district: 1 represents that a person has received 1+ traffic ...
user avatar
  • 261
2 votes
1 answer
491 views

How to handle a feature vector that could be variable length?

I would like to train a machine learning model with several features as input as X[] and with one output as Y. For example Every sample has a Data frame like this: ...
user avatar
  • 21
1 vote
1 answer
33 views

Importance of features

It is common to say in ML feature selection that features that are irrelevant in isolation can be important in combination with other features. Is there a simple example (one or two features) to ...
user avatar
0 votes
1 answer
23 views

How to group categorical columns into similar types?

(Forgive me if the question is ill put. I am a novice in data science. Please comment or edit so that the question can be improved) I have a dataset where we have to predict the future sale of a shop....
user avatar
0 votes
1 answer
23 views

Is it suitable to change a feature by itself to generate an another feature?

Hi all I would love to hear your answers on this. Lets say I have two variables, voltage and current, in my data set. I could add another feature by squaring current (so as to calculate power). Is ...
user avatar
0 votes
1 answer
30 views

Representing user information

I have a task of representing a users feature matrix , i have features like gender , age etc but I also have a multivalue feature called as "movies watched" which is essentially another table of ...
user avatar
  • 191
0 votes
1 answer
59 views

Feature importance and deriving rules using tree based classification models

I have a dataset where I have categorical and continuous values with targets 0/1 (binary classification task). Since I need to find patterns and relationships in the occurrence of the event or target, ...
user avatar
  • 101
1 vote
0 answers
39 views

Extracting Features for Graph transformation

Suppose I have a directed graph G (V,E) whose transformation is defined by a library of patterns. Each vertex is of particular type. The library of patterns contain subgraphs (g1,g2,g3 etc)and it's ...
user avatar
  • 141
2 votes
2 answers
282 views

Categorical features preprocessing for clustering

Can anyone tell suggest the best practice for clustering data with mixtured features (both with categorical and continuous). I am struggling with a problem; I realized that for all metrics algorithms ...
user avatar
1 vote
1 answer
82 views

NLP Feature creation from phrase matching

I'm building a model to classify email content, to decide whether the email should lead to a JIRA ticket being "Raised" or "Not Raised". The problem I am having is the data is highly imbalanced with ...
user avatar
1 vote
1 answer
80 views

Depending samples in ad ranking and click rate prediction

I am struggling with the following problem: Suppose we fit a machine learning model to model advertisers click rates. I used a Logistic Regression approach using a one-hot/dummy encoding. We have ...
user avatar
0 votes
0 answers
467 views

One feature - several units

I have a dataframe where one of the features is the Mileage expressed in some cases in $\frac{km}{l}$, while in others is expressed in $\frac{km}{kg}$, according to the combustion type of the car (so ...
user avatar
  • 369
2 votes
2 answers
238 views

How to treat the undefined values which make sense?

I'm currently trying to create a few features to improve the performances of a model. One of those features that I would like to create corresponds to the difference in days between a customer's ...
user avatar
1 vote
1 answer
41 views

Potential problems with expanding training set

The problem is a binary classification one. My dataset contains users with activity over multiple days, where they all start with class 0 and can become class 1 after a certain activity (which is not ...
user avatar
3 votes
2 answers
7k views

Combining Latitude/Longitude position into single feature

I have been playing with two dimensional machine learning using pandas (trying to do something like this), and I would like to combine Lat/Long into a single numerical feature -- ideally in a linear ...
user avatar
2 votes
2 answers
48 views

Creating a metric based on some features

I want to create a new metric based on some features but dont know how to start. I basically want to create a "job satisfaction level" metric based on some features. The features could be work hours, ...
user avatar
  • 61
1 vote
2 answers
1k views

What are features for state-action pairs in RL?

I read this answer: What are features in the context of reinforcement learning? But it only describes features for the state only in the context of cartpole, ie. Cart Position, Cart Velocity, Pole ...
user avatar
1 vote
1 answer
1k views

How to put multiple features into RNN input vector

I am trying to code a recurrent neural network (LSTM) to create music in python and was considering using multiple features instead of just the note pitch as an input into the network. Initially I had ...
user avatar
  • 37
3 votes
3 answers
1k views

how to evaluate feature quality for decision tree model

Most of the tutorials assume that the features are known before generating the model and give no way to select 'good' feature and to discard 'bad' ones. The naive method is to test the model with new ...
user avatar
  • 197
2 votes
1 answer
37 views

I want to create an additional feature(column) based on some manipulation of values from existing features

Consider my data-frame to be like this ('x','y','z' are features): I want to create a python function which will take an expression as a string (something like this: 'x+y-2z') and create a new ...
user avatar
3 votes
1 answer
225 views

Label Encode with pre defined classes [closed]

I have trained a model (Random Forest) and now I would like to use it to predict certain data on a particular day. I have a categorical column where there are some values (say a,b,c,d,e) over a period....
user avatar
3 votes
1 answer
57 views

Using historical label as a feature in my ML model?

I am working on a predictive model to predict change in the price of an asset (up, down, no change). The labeling is based on the derivative of the price and is exponentially smoothed with an alpha of ...
user avatar
1 vote
1 answer
315 views

How to deal with Optional Input

I'm from the vision world and only worked with pixels from 0-255, ignoring any side effects. My current problem is different, in the way that I cannot rely on the input data. What my problem is: I ...
user avatar
1 vote
2 answers
362 views

how to represent location-code as a feature in machine learning model?

I am trying to predict the damage to a buildings after earthquake on a dataset which contains "district number" as feature. I think the feature will have a significant importance in predicting the ...
user avatar
3 votes
2 answers
6k views

Too much inputs = overfitting?

First question : can I mix different sorts of inputs types for example, height and age (of course my inputs are normalized)? in general, can we mix different types of inputs in a neural network ? ...
user avatar
10 votes
4 answers
2k views

Is this a good practice of feature engineering?

I have a practical question about feature engineering... say I want to predict house prices by using logistic regression and used a bunch of features including zip code. Then by checking the feature ...
user avatar
1 vote
1 answer
43 views

Making bigram features from a particular dataset

I have a folder which has a number of files which have a format like these ...
user avatar
1 vote
0 answers
39 views

Orange Feature Construction widget: Inability to see formulas while file sharing

Our team is sharing Orange "work bench" files across team members. Unfortunately, we find the Feature Construction widget does not display code consistently (nor is there any "x" to indicate an error)....
user avatar
  • 11
1 vote
1 answer
288 views

Feature construction widget on Orange 3.13

I am working with Orange for my thesis with logs and core data; however, since I am a beginner, I am a little bit stuck with the feature construction widget. Ultimately, I would like to combine ...
user avatar
  • 11
0 votes
1 answer
61 views

How to represent relation between users as a feature?

I'm developing a model for unsupervised anomaly detection. I have a dataset representing communications between users (each example represents a communication): there are many features (time, duration,...
user avatar
24 votes
3 answers
9k views

How to combine categorical and continuous input features for neural network training

Suppose we have two kinds of input features, categorical and continuous. The categorical data may be represented as one-hot code A, while the continuous data is just a vector B in N-dimension space. ...
user avatar
0 votes
1 answer
20 views

Feature has a pattern in relation to class but does not enhance classifier to predict class

I have a feature x that when I plot it again my class variable y it shows some sort of pattern, i.e. it is obvious that x has a relation with y, but when I add the x to my logistic model it reduce the ...
user avatar
  • 204
2 votes
3 answers
1k views

Why adding combinations of features would increase performance of linear SVM?

I have a dataset of ~5000 elements represented by vectors composed by ~30 binary values (0 or 1) on which I am performing binary classification with SVM with linear kernel (I use the Scikit learn lib)...
user avatar
  • 33