Questions tagged [feature-extraction]

Variables (used for prediction or explication) used in regression or regression-like models (like clustering, discrimination). Use this tag for questions about constructing such variables or selecting the best among them.

0
votes
1answer
25 views

Feature engineering for categorical variables

I have some categorical variables in my dataset for a regression problem. 1) One of the variable can take 3 values (Girls, Boys, Girls&Boys). Converting it into one-hot encoding or binary ...
1
vote
1answer
21 views

How to treat a categorical variable which can have multiple values in regression?

I am working on a regression problem and has a categorical feature 'CATEGORY' which can take as many as 1600 categories. On top of that, each observation can have any number of categories in that ...
8
votes
3answers
155 views

Why do RNNs usually have fewer hidden layers than CNNs?

CNNs can have hundreds of hidden layers and since they are often used with image data, having many layers captures more complexity. However, as far as I have seen, RNNs usually have few layers e.g. ...
0
votes
1answer
28 views

Potential problems with expanding training set

The problem is a binary classification one. My dataset contains users with activity over multiple days, where they all start with class 0 and can become class 1 after a certain activity (which is not ...
2
votes
1answer
25 views

Creating a Object Detection model from scratch using Keras

I have a dataset containing 330 images which contain guns. Along with the images, I have a text file associated with each image file which contains, The number of objects ( guns ) in the image. ...
0
votes
0answers
9 views

Actually using scipy.signal.stft multidimensional array as a feature

I'm trying to improve my score in the LANL Earthquake Prediction challenge on Kaggle extracting more features from the acoustic data through STFT transforming. Eventually I've found this well written ...
0
votes
1answer
17 views

How can I train a many-to-one RNN with an array of 2D matrices?

I have eye tracking data for every word of a novel. Features for every word is given separately. I want to take groups of 100 words to make a sample and then use each of these samples as a single ...
0
votes
1answer
25 views

Feature Importance Scores Python

I have a dataset having 7 attributes viz., time, C1, ... C7 pertaining to earth quake reports where each column/attribute represents a certain aspect of damage viz., power, sewer_and_water, ...
0
votes
1answer
26 views

how to deal with two high correlations feature which both has a low correlation with target

I am doing a prediction of house trade money. Here is the correlation matrix of features whose correlations are larger than 0.3 as follows: ...
0
votes
0answers
22 views

fourier transform on classification data

I have a dataset with sequences and date of occurrence of each element in the sequence. I wanted to extract some features from the date and I was wondering if its possible to use fourier ...
2
votes
1answer
45 views

Best way to classify plots which are overlapping?

I have an experiment in which it was done under two conditions. For each condition, the experiment was performed 26 times. The output of the experiment is a plot with 70 time indices. I would like to ...
0
votes
0answers
30 views

Can we use pca for supervise classification?

My questions are: Can we use "pca feature selection" for supervised classification? What will happen to labels when we use dimension reduction? If I understand it right when we use pca for feature ...
0
votes
1answer
21 views

Classification of data generated by radar using FFT

I have time domain data which is having binary label in form of 0 and 1. I applied FFT to all the features and label as well. The problem is my output label is now not binary anymore. How to solve ...
1
vote
0answers
34 views

What are the audio features to best describe a music?

I'm working on the content-based filtering part of a recommender system for an audio streaming project. I firstly used the k-mean algorithm with music genres and one-hot encoding to classify musics ...
1
vote
1answer
30 views

Feature importance after PCA (or other dimensionality reduction methods)

I have text data which I one hot encoded and then used PCA on it (although I'm experimenting with other methods as well, LDA, NMF..). I am using the result of the dimensionality reduction as an input ...
0
votes
1answer
38 views

Printing Feature Contributions in a Random Forest algorithm from the Treeinterpreter library leading to errors

I am working on a dataset where I predict the risks of developing pancreatic cancer with respect to a number of variables. I have created a random forest, and want to find the feature contributions. I ...
0
votes
0answers
38 views

BERT has a non deterministic behaviour

I am using the BERT implementation in https://github.com/google-research/bert for feature extracting and I have noticed a weird behaviour which I was not expecting: if I execute the program twice on ...
1
vote
0answers
19 views

How to incorporate an attribute that only exists in some observations?

In a binary classification problem, some of my observations have an event that occurs. I can, obviously, add a 1/0 flag if the event occurs ("event_occurred" in the data below). However, my intuition ...
0
votes
0answers
34 views

Dimension of feature vectors for classification task in the DCGAN paper

I am trying to implement one of the section in the DCGAN paper (https://arxiv.org/pdf/1511.06434.pdf) i.e. Using the Discriminator network trained on ImageNet-1k as a feature extractor to classify ...
0
votes
1answer
37 views

Machine learning algorithm that can use many instances to predict 1 continuous outcome per person

I am trying to use movements identified from accelerometers during sleep to predict gait speed (continuous). I am trying to figure out what the best machine learning algorithms/ feature extraction ...
0
votes
1answer
88 views

Calculating Feature Importance of Time Series Data

I am new to time-series modeling, and I was wondering what the standard way of quantifying feature importances are in a time-series setting? What types of models allow for the greatest interpretation ...
0
votes
0answers
79 views

Local Binary Patterns features using matlab 'extractLBPFeatures'

I am trying to understand the extractLBPFeatures function to extract the 59 uniform features, here is a simple code that extracts the 59 features from an image <...
0
votes
0answers
14 views

Local Binary features with unit16 images vs unit8 images

I have unit16 image dataset, and I would like to extract LBP features from it using the Matlab function extractLBPFeatures, which uses uniform LBP (59 features). ...
0
votes
0answers
14 views

Local Binary Patterns features

I have a dataset of images that differ in sizes, and when I extract the local binary pattern (uniform local binary 59 feature) from them I get several features as zeros, is it acceptable as features, ...
0
votes
3answers
48 views

How do I use TF*IDF scores for my machine learning model?

I have applied TF*IDF on the 'Ad-topic line' column of my dataset. For every ad-topic line, I get the same output: Firstly, I am unable to make sense of the output. The TF*IDF values are mentioned to ...
0
votes
1answer
44 views

How exactly do I extract the important features from strings for machine learning?

Forgive me for my ignorance. Linked below is an image of my dataset with 1000 tuples. https://i.stack.imgur.com/WHIlx.png I have the following questions (1) How exactly do I go about extracting ...
1
vote
2answers
60 views

How exactly do I go about extracting features from timestamps for machine learning? [closed]

My dataset has a timestamp column with the following format: 06/24/18 0:56 How exactly do I convert this information into features that can be used for classification algorithms like logistic ...
0
votes
1answer
26 views

General question on EDA, correlations, classification, ML

I am looking for a general best practices regarding classification and correlations. I created a new predictor feature call it B, based on a certain threshold in a feature A. Now I started to do EDA ...
1
vote
1answer
63 views

To remove Chinese characters as features -

I have created document-term matrix using TfIdfVectorizer, but just noticed the feature contains Chinese characters. Is it possible to remove them using Python's regex? I believe these characters ...
0
votes
1answer
15 views

Inverse Binary Feature

I am feeding a binary value into my NN which represents whether the given example is a public holiday or not. Is there a difference between assigning a 0 to public holidays and 1 to all other days or ...
1
vote
1answer
292 views

Python Time series: extracting features on a rolling window basis

I have a long univariate time series, and before performing some machine learning models with it, I want to extract as many features as I can from the time series on a rolling-window basis. As a ...
1
vote
0answers
36 views

Adding Fourier transform features to data

I'm working on some timeseries data which after visualising seems to be periodic(repeating at some interval), So I planned on finding the Fourier transform of the entire and pick the top n amplitudes ...
0
votes
1answer
82 views

How do I create a feature vector for the training of an SVM?

I have an understanding problem with implementing an SVM as a classifier for images. The whole thing should be done in python. Now, when I have extracted all the features, e.g. HOG, contours, textures,...
1
vote
1answer
82 views

Dealing with correlated features when calculating permutation importance

I have implemented the permutation importance calculation as found here in my attempt to identify features that contribute little to my model's (Gradient Boosted Tree model) predictive power. The ...
1
vote
0answers
24 views

Feature Extraction [closed]

I've a data set for different sensor values(like voltage, pressure, vibration etc) for a machine. I need to extract features from it to be able to do predictive maintenance. Which features should i ...
2
votes
0answers
30 views

Using datasets to predict the results for other devices

I have a datasets that contain results from a series of physical tests. It has about a dozen features and the outcome of each test is distinguished by 3 different classes. The dataset includes ...
5
votes
3answers
131 views

How does Doc2Vec treat numerical data which is a part of text data?

I have data containing both numbers and raw text related differently like: The power of diesel generator is 15kva. I need a single phase generator. Three phase generator required of 140 kva. Need 70g/...
3
votes
3answers
196 views

What is the ideal database that allows fast cosine distance?

I'm currently trying to store many feature vectors in a database so that, upon request, I can compare an incoming feature vector against many other (if not all) stored in the db. I would need to ...
0
votes
0answers
10 views

Discrete wavelet transform for image texture analysis

I am planning to use the discrete wavelet transform to extract textural features from grayscale images for classification purpose. However, I am not sure which type of wavelet should I choose? most of ...
0
votes
1answer
78 views

ML: How to think feature selection?

What is the basic philosophy behind feature selection and modelling? How do you actually start? Could you please share your real (practical) inputs? Bit of background: I am actually trying to analyse ...
0
votes
0answers
41 views

How to balance specificity and sensitivity?

I have included accuracy and feature minimization in my fitness function. How should I balance specificity and sensitivity?
2
votes
0answers
57 views

how to extract the Top contributing labels/words in universal-sentence-encoder-large - TransformerModel?

I'm using the universal-sentence-encoder-large (Transformer Model) encoding process for embedding and then using the embedding for Clustering - Basically for unsupervised learning. I want to get the ...
0
votes
0answers
8 views

A noise robust Local binary patterns variant

I’m thinking of using Local Binary Patterns (LBP) to extract features from MRI images of brain tumours to build a module for classification, due to its computational simplicity and good performance, ...
0
votes
1answer
27 views

Size of Output vector from AvgW2V Vectorizer is less than Size of Input data

Hi, I have been seeing this problem for quite some time. Whenever I tried vectorizing input text data though avgw2v vectorization technique. The size of vectorized data is less than the size of the ...
0
votes
0answers
24 views

Dimensionality reduction categories

According to what I found, dimensionality reduction has two types feature selection and feature extraction . In feature extraction, we find PCA, LDA ,LLE , ISOMAP, etc.. In other works i find random ...
3
votes
3answers
70 views

How to understand features impact in a non linear case?

I give a simple example: I have a set of houses with different features (# rooms, perimeter, # neighbours, etc...), almost 15, and a price value for each house. The features are also quite correlated (...
1
vote
1answer
61 views

A suitable feature vector for images

I have a set of images of various products from different websites. I want to cluster the images based on the product shown in the image. How can I generate a suitable feature vector for an image for ...
3
votes
3answers
208 views

Feature engineering from date, mean and standard deviation

I have a multi class classification problem where I should predict the passengers for flights (0-7 classes). The training set consists of the following features: Date of the flight Mean of the weeks ...
0
votes
1answer
84 views

Value of features is zero in Decision tree Classifier

I used CountVectorizer and TfidfVectorizer seperately to vectorize text which is 100K reviews and passed the vector data to a Decision tree Classifier. Upon using _feature_importances__ attribute of ...
1
vote
1answer
204 views

How to plot data points and not centroids using sklearn k-means?

I have issues finding a way to plot data points colored by cluster with k-means. I have a very long list of strings.I managed to plot the centroids but not the data points; ...