Questions tagged [feature-extraction]

Variables (used for prediction or explication) used in regression or regression-like models (like clustering, discrimination). Use this tag for questions about constructing such variables or selecting the best among them.

Filter by
Sorted by
Tagged with
1
vote
0answers
23 views

Extracting Features for Graph transformation

Suppose I have a directed graph G (V,E) whose transformation is defined by a library of patterns. Each vertex is of particular type. The library of patterns contain subgraphs (g1,g2,g3 etc)and it's ...
8
votes
4answers
2k views

Is (manual) feature extraction outdated?

I recently attended a PhD thesis defence in which one committee members claimed that "manual feature extraction is outdated. Nowadays, we have [deep] machine learning models doing that job for us ...
0
votes
0answers
17 views

Information Gain & Gini Index for NLP

I know how Information Gain and Gini Index work in General. I have problem figuring out how to apply these techniques in NLP and text feature extraction. Can someone show me an example of how to ...
1
vote
1answer
34 views

What to do with large number of collinear variables?

I have this time-series dataset that has 63 features, out of which 57 were manually engineered. While checking for collinearity, I get this correlation matrix: As can be seen there are a number of ...
0
votes
0answers
6 views

Pipeline that cached the results

I use pandas to do feature extraction for machine learning. I hope to achieve the following: Consider I have five data processing steps done sequentially, and I execute it once, the results will be ...
0
votes
1answer
23 views

extract document topic vectors from lda model

how can I extract document-topic matrix from LDA model and use it as input features an svm classifier? I am using gensim for implementation
0
votes
0answers
8 views

Accelerometer and Gyroscope features

I am having accelerometer and gyroscope reading along x,y,z axis and want to get motion direction info at each time step. What all feature extraction would be best suited for this type of requirement. ...
0
votes
0answers
7 views

What techniques can I use to find position relationship in group of elements?

I have 14,000 tagged documents. These are custom forms that our employees create and fill out. I need to build a model that will be able to classify the types of each input field of the form in order ...
1
vote
0answers
11 views

What is the use of having shared weights in later layers of a CNN?

In a CNN, all the neurons in a single layer use the same weights and bias. As a result, all the neurons detect the same feature. The early layers of a CNN detect simple features like edges and hence ...
0
votes
1answer
22 views

feature extraction from single word for classification into nouns and names

I would like to write a NN that can classify different kinds of words(e.g. nouns,verbs,names) and am struggling to find information on how to do feature extraction on single words.For example, i would ...
0
votes
2answers
65 views

Feature extraction; similarity and classification of accelerometer data

I have several expert persons performing the same specific action (for example, squat or leap forward) multiple times. Say 5 persons do 100 squats each. They have an accelerometer attached to the same ...
2
votes
1answer
61 views

Feature selection is not that useful?

I've been doing a few DataScience competitions now, and i'm noticing something quite odd and frustrating to me. Why is it frustrating? Because , in theory, when you read about datascience it's all ...
1
vote
0answers
24 views

Applying the fourier transform

I have been trying to apply Fourier transform for two days, but haven't been able to because all the examples I've seen so far are not on actual dataset and use standard values that I don't understand ...
0
votes
1answer
37 views

Intuition behind the PCA algorithm

I am trying to understand PCA intuitively. Here it goes: After finding the eigenvectors and eigenvalues of the covariance matrix of the dataset, the eigenvalues will represent how spread out the ...
1
vote
1answer
45 views

Bag-of-words model : Boolean vs. TF-IDF

When I design a document classifier using traditional feature engineering, I would prefer (to Boolean model) tf-idf model to represent a document into a vector because intuitively Boolean model loses ...
1
vote
0answers
7 views

Bayesian classification of “JSON” data

"Machine Learning over JSON" describes some issues surrounding the classification of JSON documents. Namely, Categorical Features Data is Hierarchical Missingness is Chunky The first two have fairly ...
0
votes
1answer
19 views

Adding time as a feature with xgboost/random forests

I am trying to use xgboost for performing some regression and the features I have are rather simple and limited. I have the time stamp associated with some ...
0
votes
0answers
16 views

How to use skimage.feature.hog to calculate hog of training data where examples are stacked vertically

I have a $n*1024$ dimensional $2D$ array where n is number of examples which contain n images($32*32$) stacked vertically. I would like to calculate the hog of these images ...
2
votes
1answer
39 views

Feature extraction in audio spectrogram

I have audio and its spectrogram of the words in English language. (A spectrogram is a frequency domain representation of a signal) Consider the words: chain, change, chair, chapter. As you can notice,...
0
votes
0answers
25 views

What is the dimension reduction method to large numbers of independent features while only two of them are important?why?

What is the dimension reduction method to model a data with large numbers of independent features (for instance 5k features), while only two of them are important (are effective in cost function)? I ...
1
vote
1answer
29 views

Modeling the Price Movement- What analysis should be used

I am trying to model the price of a hotel as the check-in date arrives. I have a data set which looks like- For e.g- if I am looking at the booking date of Dec 31st, I would want to analyze the ...
0
votes
0answers
14 views

What are the common feature extraction technic to compare 2 sequence of timestamps?

I am building some predictive models for an online shopping site. I have timestamp log of customers' arrival time, time spent on a product's webpage, purchased or not, and a few others. I have tried ...
0
votes
0answers
24 views

What is the meaning of constraint two neural networks against each other?

I have two identical autoencoders with the same number of layers and parameters. I would like to find the similarity between two images from different domains such as an image captured from the camera ...
0
votes
1answer
111 views

Any issue with “overlapping” sliding windows in time-series data analysis?

I am developing some classification/regression models form accelerometry time-series data. So far, I have created datapoints by extracting features from non-overlapping sliding windows of the time-...
2
votes
1answer
49 views

Blind feature engineering

I received a dataset for analysis that had ~100 numeric columns with anonymous column names(X1, X2, X3, etc...) and asked to do a binary classification. My resulting classification algorithm using a ...
0
votes
0answers
31 views

How to time series forecast with multiple time series data sets on the same time series index

How does time series work with multiple time series data sets on the same index? For example, suppose I were a utilities company. Suppose I have the electricity usage of two homes, each indexed for ...
3
votes
1answer
45 views

How and Why to rescale image range between [0,1] and [-1,1]

I am trying to implement model described in Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network in which author says in section 3.2 that We scaled the range of the ...
-1
votes
1answer
28 views

Extracting information from online job postings

Okay, so I'm trying to build a data set about data science job openings. I want to extract information about what kind of minimum education level is expected in each job posting and also how much ...
1
vote
1answer
35 views

Dimensionality reduction based on value of a variable

I have a dataset including 100k high dimensional data (e.g. houses in LA) (dim=100, e.g. house parameters like area, distance to downtown, etc.). Below is the 2-component PCA representation of the ...
0
votes
3answers
325 views

how to avoid tokenizing w/ sklearn feature extraction

I'm trying to analyze some machine log files and the column I'm looking at can have values like 'Part.C1.11.Reading Status'. I want to treat the complete string as one token and I don't want it to be ...
2
votes
0answers
10 views

Confusion regarding prediction results of SVM and ANN on feature vectors

I am making a custom image classifier using Transfer Learning on Inception V3. I have 3 classes of images with ~6K images each. The input dimension of the network is 500X500 and the output of the ...
1
vote
1answer
386 views

Feature engineering for categorical variables

I have some categorical variables in my dataset for a regression problem. 1) One of the variable can take 3 values (Girls, Boys, Girls&Boys). Converting it into one-hot encoding or binary ...
1
vote
1answer
146 views

How to treat a categorical variable which can have multiple values in regression?

I am working on a regression problem and has a categorical feature 'CATEGORY' which can take as many as 1600 categories. On top of that, each observation can have any number of categories in that ...
8
votes
3answers
186 views

Why do RNNs usually have fewer hidden layers than CNNs?

CNNs can have hundreds of hidden layers and since they are often used with image data, having many layers captures more complexity. However, as far as I have seen, RNNs usually have few layers e.g. ...
0
votes
1answer
33 views

Potential problems with expanding training set

The problem is a binary classification one. My dataset contains users with activity over multiple days, where they all start with class 0 and can become class 1 after a certain activity (which is not ...
3
votes
1answer
1k views

Creating a Object Detection model from scratch using Keras

I have a dataset containing 330 images which contain guns. Along with the images, I have a text file associated with each image file which contains, The number of objects ( guns ) in the image. ...
0
votes
0answers
43 views

Actually using scipy.signal.stft multidimensional array as a feature

I'm trying to improve my score in the LANL Earthquake Prediction challenge on Kaggle extracting more features from the acoustic data through STFT transforming. Eventually I've found this well written ...
0
votes
1answer
23 views

How can I train a many-to-one RNN with an array of 2D matrices?

I have eye tracking data for every word of a novel. Features for every word is given separately. I want to take groups of 100 words to make a sample and then use each of these samples as a single ...
0
votes
1answer
56 views

Feature Importance Scores Python

I have a dataset having 7 attributes viz., time, C1, ... C7 pertaining to earth quake reports where each column/attribute represents a certain aspect of damage viz., power, sewer_and_water, ...
0
votes
1answer
33 views

how to deal with two high correlations feature which both has a low correlation with target

I am doing a prediction of house trade money. Here is the correlation matrix of features whose correlations are larger than 0.3 as follows: ...
0
votes
0answers
41 views

fourier transform on classification data

I have a dataset with sequences and date of occurrence of each element in the sequence. I wanted to extract some features from the date and I was wondering if its possible to use fourier ...
2
votes
1answer
82 views

Best way to classify plots which are overlapping?

I have an experiment in which it was done under two conditions. For each condition, the experiment was performed 26 times. The output of the experiment is a plot with 70 time indices. I would like to ...
1
vote
1answer
42 views

Can we use pca for supervise classification?

My questions are: Can we use "pca feature selection" for supervised classification? What will happen to labels when we use dimension reduction? If I understand it right when we use pca for feature ...
0
votes
1answer
26 views

Classification of data generated by radar using FFT

I have time domain data which is having binary label in form of 0 and 1. I applied FFT to all the features and label as well. The problem is my output label is now not binary anymore. How to solve ...
1
vote
0answers
43 views

What are the audio features to best describe a music?

I'm working on the content-based filtering part of a recommender system for an audio streaming project. I firstly used the k-mean algorithm with music genres and one-hot encoding to classify musics ...
1
vote
1answer
108 views

Feature importance after PCA (or other dimensionality reduction methods)

I have text data which I one hot encoded and then used PCA on it (although I'm experimenting with other methods as well, LDA, NMF..). I am using the result of the dimensionality reduction as an input ...
0
votes
1answer
125 views

Printing Feature Contributions in a Random Forest algorithm from the Treeinterpreter library leading to errors

I am working on a dataset where I predict the risks of developing pancreatic cancer with respect to a number of variables. I have created a random forest, and want to find the feature contributions. I ...
1
vote
1answer
113 views

BERT has a non deterministic behaviour

I am using the BERT implementation in https://github.com/google-research/bert for feature extracting and I have noticed a weird behaviour which I was not expecting: if I execute the program twice on ...
1
vote
0answers
19 views

How to incorporate an attribute that only exists in some observations?

In a binary classification problem, some of my observations have an event that occurs. I can, obviously, add a 1/0 flag if the event occurs ("event_occurred" in the data below). However, my intuition ...
0
votes
0answers
48 views

Dimension of feature vectors for classification task in the DCGAN paper

I am trying to implement one of the section in the DCGAN paper (https://arxiv.org/pdf/1511.06434.pdf) i.e. Using the Discriminator network trained on ImageNet-1k as a feature extractor to classify ...