Questions tagged [feature-construction]
The feature-construction tag has no usage guidance.
27
questions with no upvoted or accepted answers
3
votes
0
answers
113
views
What are best practices for collaborative feature engineering?
I work in a large company on several data science projects. For each of the projects me and my colleagues construct features that have some predictive value for the specific target in that project.
...
- 961
3
votes
2
answers
503
views
How to treat the undefined values which make sense?
I'm currently trying to create a few features to improve the performances of a model. One of those features that I would like to create corresponds to the difference in days between a customer's ...
- 203
2
votes
0
answers
81
views
Feature selection and model performance
Featuretools provides an automated way to generate features from your data, by providing relationships within your data and applying their so-called deep feature synthesis. It generates features like ...
- 121
1
vote
0
answers
22
views
Best way to represent a version feature based on percentiles
We're training a binary classifier in AutoML, and one of the features consist of browser versions.
Currently these versions are provided "normalized" to the model, according to the ...
1
vote
1
answer
195
views
Algorithms for casual feature selection for continuous Y
Currently I have been trying to find some good algorithms for feature selection. Using correlation or other non casual type of method will not be the right way to do a feature selection. I'm am ...
- 214
1
vote
0
answers
15
views
Tsallis entropy - advice needed regarding obtaining probability distribution
As is always the way I stumbled across Tsallis entropy on SO whilst looking for something completely different. This soon lead me reading all sorts of interesting but terse academic papers.
I am ...
- 111
1
vote
0
answers
137
views
How to add more weight to certain features?
I have extracted features from two types of signals. Prior to merging them to create one feature vector, I have computed an importance score of every feature within that type of signal.
I would like ...
- 11
1
vote
0
answers
23
views
Regression with a feature which has its own depth
I'm relatively new to ML/Statistical Analysis, and I'm facing a dataset structured like this
...
- 11
1
vote
0
answers
61
views
Best Feature extraction for at the end retrieving audio
I work on a machine learning algo, which basically learns sequences in an audio .wav and generates the most “logical” sequences. The algorithm learns features, so I generate MFCCs from the audio file. ...
1
vote
0
answers
78
views
Data Lineage/Traceability in Pipelines
I want to collect information about: 1) from which single data signals a feature is composed in a ML pipeline and 2) what data preprocessing operations are/were executed on a data signal.
Does anyone ...
- 11
1
vote
1
answer
57
views
How to model a supervised recommender system with varying data
Suppose there are 2000 movies and a company wants to recommend some movies (for example, at most 5 movies) to each visitor. The objective is to learn how to predict which movie will be selected if a ...
- 201
1
vote
0
answers
24
views
Is there a common relationship between data inputs and the number of attainable features?
Is there a known relationship between the amount of information gain that comes from new data added to a dataset?
for eg: If I have a plant watering system that tells me:
An integer of how wet the ...
- 13
1
vote
0
answers
41
views
Extracting Features for Graph transformation
Suppose I have a directed graph G (V,E) whose transformation is defined by a library of patterns. Each vertex is of particular type.
The library of patterns contain subgraphs (g1,g2,g3 etc)and it's ...
- 141
1
vote
0
answers
42
views
Orange Feature Construction widget: Inability to see formulas while file sharing
Our team is sharing Orange "work bench" files across team members. Unfortunately, we find the Feature Construction widget does not display code consistently (nor is there any "x" to indicate an error)....
- 11
1
vote
1
answer
432
views
Feature construction widget on Orange 3.13
I am working with Orange for my thesis with logs and core data; however, since I am a beginner, I am a little bit stuck with the feature construction widget. Ultimately, I would like to combine ...
- 11
0
votes
0
answers
18
views
How can I extract useful data out of a molecule?
In my dataframe, I have a feature with molecules like C1=CC=C(C=C1)C(=O)OC2=CC=CC3=C2C=CC=C3O, and C1=CC=C(C=C1)CCCNC(=O)/C(=C/C2=CC(=C(C=C2)O)O)/C#N.
I have no experience with RDKit and deepchem, and ...
0
votes
1
answer
23
views
How to add lagging Features for Forecasting with a random lag range without adding a new column per lag?
The common way of adding lagging features in time series forecasting problems is adding lag columns with pandas.shift(). While it is a fine method but what about when wanting to use a random integer (...
0
votes
0
answers
9
views
Deriving consistency feature for a student using a study app over the days
I want to build a recommendation engine for the revision app.
Basic Idea
After each module we will ask student questions and based on the correctness of their answers we will decide after how many ...
- 101
0
votes
0
answers
30
views
propper feature encoding
I working with the following data set
also here is it's detailed description of "packet_dat" column
I can't understand how I can encode packet_dat column into proper feature so my ...
- 101
0
votes
0
answers
17
views
How do I reconstruct irregularly spaced lat-lon data (in the form of a matrix) using spherical harmonic fitting?
Introductory Links to spherical harmonics give a mildly rigorous introduction to the concept; but very few links describe how to actually use them. I have latitude-longitude data arranged the ...
- 11
0
votes
0
answers
57
views
Effect of removing duplicate and identical entries on dimensionality reduction
I have huge data with thousands of observations and millions of features. I need to do clustering so I use PCA/t-SNE/UMAP for dimensionality reduction followed by K-Means.
Currently, I retain only ...
- 101
0
votes
0
answers
51
views
How to structure spatio-temporal data for LSTM model input
I have a dataset representing species distribution (binary presence/absence) and I would like to use a LSTM to predict future species distribution. I am having trouble working out how I should shape ...
- 27
0
votes
2
answers
46
views
How to group categorical columns into similar types?
(Forgive me if the question is ill put. I am a novice in data science. Please comment or edit so that the question can be improved)
I have a dataset where we have to predict the future sale of a shop....
0
votes
1
answer
33
views
Representing user information
I have a task of representing a users feature matrix , i have features like gender , age etc but I also have a multivalue feature called as "movies watched" which is essentially another table of ...
- 191
0
votes
0
answers
667
views
One feature - several units
I have a dataframe where one of the features is the Mileage expressed in some cases in $\frac{km}{l}$, while in others is expressed in $\frac{km}{kg}$, according to the combustion type of the car (so ...
- 369
-1
votes
1
answer
93
views
Suitable aggregations (mean, median or something else) to make features?
Trying to solve a classification problem using a large number of features, some are individual numbers from a signal while others are aggregates of values to create a feature (median, mean etc).
I ...
- 1
-1
votes
1
answer
55
views
How do I create my features
I am working on the prediction of the behaviour of a new well in a map.
The data that I have is a map in a form of a grid and its properties (9 of them), and a set of wells with the position of each ...
- 1