Questions tagged [feature-extraction]

Variables (used for prediction or explication) used in regression or regression-like models (like clustering, discrimination). Use this tag for questions about constructing such variables or selecting the best among them.

Filter by
Sorted by
Tagged with
3
votes
0answers
183 views

Layman's explanation of when to use which smoother algorithm/technique: FFT, loess, Savitzky-Golay, etc

As an analytics practitioner, I frequently come across noisy data (e.g. IoT data). When building a model or machine learning algorithm, it can be advantageous to smooth this data. Over the years, I ...
0
votes
0answers
18 views

Feature values with different units

I have a dataset with values in kmpl and km/kg on one column of the dataset. How may I extract the features from this dataset?
1
vote
1answer
408 views

MR images segmentation for feature extraction

I have datasets of brain MR images with tumours, the tumours are already selected manually by a physicist using Image J. I have read about segmentation, but I still couldn't understand how do they ...
1
vote
0answers
56 views

feature Extraction with mobileNet visualization

I am trying to create a logical visualization regarding how feature extraction with mobile net works in ml5.js. There's a good explanation here: https://youtu.be/kRpZ5OqUY6Y With ml5, you use a part ...
1
vote
2answers
194 views

What are some good methods to forecast future revenue on categorical and value based data?

I have monthly snapshots (3 years) of all the contract data. It includes following information: Contract status [Categorical]: Proposed, tracked, submitted, won, lost, etc Contract stages [...
0
votes
0answers
18 views

How to extract important text markers from samples to identify patterns?

Problem I have collected a decently large set of movie trailer titles from various Youtube trailer channels. I'd like to extract or infer the movie title and release year from this set in some way to ...
4
votes
1answer
294 views

What are the rules when extracting SVO triples from preprocessed text?

If you have some already preprocessed text that is tagged, what are the rules to extract Subject-Verb-Object (SVO) triples if you want a triple like (word, word, word). Can you give the sentence as ...
1
vote
1answer
23 views

Dimensionality reduction for feature extraction when missing some feature values

I have two questions: 1-Which method is appropriate for dimensionality reduction for feature extraction when missing some feature values? 2-Which textbook is the best source for the answer in (1)?
0
votes
1answer
44 views

Single image feature reduction at inference time : SVM

I am trying to train a SVM classifier using scikit-learn.. At training time I want to reduce the feature vector dimension. I have used PCA to reduce the dimension. ...
0
votes
0answers
7 views

TensorFlow - Image Vectorization - Add New Files

I am using tensorflow for feature extraction from images. Images are divided into 5 categories, each having various designs (which are labelled and trained to the system). Model is trained to find ...
0
votes
1answer
18 views

How do I get my Neural network to ignore certain values?

I was wondering if there was a way that I can get my CNN encoder-decoder neural network to completely ignore certain values in my data (2d images). There are some pixel values of 0 that never change ...
1
vote
1answer
186 views

Mapping between original feature space and an interpretable feature space

I'm reading the following really interesting paper https://arxiv.org/pdf/1602.04938.pdf on local interpretable model explanations on page 3 however particularly section 3.3 Sampling for Local ...
0
votes
1answer
16 views

Using extracted feature vector to perform zero shot detection

I've developed a deep learning model trained from scratch on fruits and vegetables. However, as the data is limited, I can only cover a few different types of fruits and vegetables with the model ...
0
votes
0answers
11 views

Doing feature extraction from name data?

I'm working with a genre prediction application right now, and I was curious about handling name data. I was planning to try to use that in the prediction(as a normal human can usually estimate ...
14
votes
2answers
16k views

List of feature engineering techniques

Is there any resource with a list of feature engineering techniques? A mapping of type of data, model and feature engineering technique would be a gold mine.
0
votes
1answer
14 views

Using partially defined features in an unified deep learning model

Suppose we have two types of feature A and B. A is defined for all kinds of samples while B is only defined for some of the samples. Here, B is partially defined does not mean B is missing value (such ...
31
votes
6answers
10k views

Are there any tools for feature engineering?

Specifically what I am looking for are tools with some functionality, which is specific to feature engineering. I would like to be able to easily smooth, visualize, fill gaps, etc. Something similar ...
0
votes
1answer
100 views

Feature Engineering - correlation with binary outcome - Titanic Dataset - Ticket feature

I am currently building my first machine learning model using the titanic dataset. After the data exploration, I decided to focus my attention on the 'Ticket' feature. One thing I have noticed about ...
0
votes
0answers
40 views

struggling with sklearn Pipeline, FeatureUnion for NLP

I'm working on Kaggle dataset trying to classify in the Tweet is a disaster or not. I have "text" feature that I will transform using TF-IDF but I also want to use "keyword" ...
3
votes
1answer
149 views

Extract features from a survey

I need to use the answers from a questionnaire for training a classifier. I discovered that some questions can have nested sub-questions.. Let's say (just an example) that I want to predict whether a ...
0
votes
1answer
18 views

Is it a good idea to combine fine tuning and feature extraction techniques?

I have a normal/tumor medical images dataset and, for the same patients, also the relative genomics, and my goal is to predict if a patient has a tumor by combining all the information. To achieve ...
0
votes
1answer
13 views

How to decide which method to use TFIDF, or BOW

In a huge dataset for NLP it is taking very long time to classify my dataset therefore, trying each feature extraction method separetly is time consuming and not effecient. Is there a way that can ...
0
votes
1answer
62 views

General question on EDA, correlations, classification, ML

I am looking for a general best practices regarding classification and correlations. I created a new predictor feature call it B, based on a certain threshold in a feature A. Now I started to do EDA ...
1
vote
1answer
15 views

How many words should be taken as features in a ML problem?

I would like to ask you how many words should be taken as features in a ML program. For example, if I have 30000 distinct words to make a vocabulary, what would a good number be? I am currently ...
0
votes
1answer
35 views

Would a neural network trained on extracted features have the same accuracy as a full network with frozen layers?

Let's say that I train two neural networks on the exact same dataset. The first network is a VGG19 model with frozen convolutional layers so only the top dense ...
1
vote
0answers
19 views

Regression with a feature which has its own depth

I'm relatively new to ML/Statistical Analysis, and I'm facing a dataset structured like this ...
1
vote
1answer
146 views

extract document topic vectors from lda model

how can I extract document-topic matrix from LDA model and use it as input features an svm classifier? I am using gensim for implementation
1
vote
0answers
26 views

How can I transform a sequence into features

When Machine Learning libraries don't support categorical features those features can be one-hot encoded into a series of binary feature columns. I have a feature that represents a sequence or ...
1
vote
2answers
548 views

How to quantify a tokenized user agent string for a neural network?

I am currently experimenting with user agent strings. My current plan is to tokenize the user agent string and split it in its important parts. Like OS, Browser Name, etc. After that, does it make ...
18
votes
2answers
6k views

How to choose the features for a neural network?

I know that there is no a clear answer for this question, but let's suppose that I have a huge neural network, with a lot of data and I want to add a new feature in input. The "best" way ...
1
vote
2answers
39 views

Problem with a feature (normal distribution + peak around 0)

I have a feature that shows a characteristic of the instances. That characteristic can be present or not. If present it shows an almost normal distribution of values (actually a bit skewed to the ...
9
votes
3answers
253 views

Why do RNNs usually have fewer hidden layers than CNNs?

CNNs can have hundreds of hidden layers and since they are often used with image data, having many layers captures more complexity. However, as far as I have seen, RNNs usually have few layers e.g. ...
1
vote
1answer
103 views

What is meta- data and meta features?

I want to know what is metadata and what is meant by meta features? When I google Meta Features what I get is feature selection tool called "Meta-Feature". What is the function of feature ...
1
vote
2answers
97 views

Feature extraction; similarity and classification of accelerometer data

I have several expert persons performing the same specific action (for example, squat or leap forward) multiple times. Say 5 persons do 100 squats each. They have an accelerometer attached to the same ...
0
votes
0answers
32 views

Is it wrong to use residuals from one model as data in another model?

Why is it wrong to use the residuals from one model to fit another? Is it wrong? Is the difference down to how the residuals are used? For example, the residuals are useful features for extending a ...
1
vote
1answer
255 views

What's the difference between transfer learning and feature extraction in CNN?

So from what i understand, transfer learning is the fact of training a model on a dataset where you have a lot of data, then keeping most of trained coefficients, and only re-training the last layer ...
1
vote
1answer
303 views

Feature extraction - wavelet transformation + autoregression

I am working on a feature extraction problem (ECG signal). Within my literature review I stumbled across the following text: "The wavelet transform is used to extract the coefficients of the ...
0
votes
0answers
10 views

Feature vector representation

I have a clarification. I have to create a classification model for certain set of documents. We are supposed to flag it anamoly or not based on certain terms in the document. My question is the terms ...
2
votes
2answers
101 views

What are the audio features to best describe a music?

I'm working on the content-based filtering part of a recommender system for an audio streaming project. I firstly used the k-mean algorithm with music genres and one-hot encoding to classify musics ...
0
votes
1answer
127 views

Information Gain & Gini Index for NLP

I know how Information Gain and Gini Index work in General. I have problem figuring out how to apply these techniques in NLP and text feature extraction. Can someone show me an example of how to ...
1
vote
2answers
45 views

Can machine learning models treat a vector as a whole feature to learn

We know a ML model naturally takes a feature vector with real valued elements as input and learn to predict. But can it treat a fixed-size vector as a whole feature to learn? For example, when using a ...
0
votes
1answer
136 views

Should I normalise image pixel wise for pretrained VGG16 model

My goal is to use pretrained VGG16 to compute the feature vectors excluding the top layer. I want to compute embedding(no training involved) per image one by one rather than feeding batches to the ...
5
votes
1answer
650 views

Time Series pattern recognition and classification problem

I have some labeled sensor data. Now, I would like to know how to extract features from time series using DFT, DWT, and HAAR transforms. I know that the transformations above transform a signal to ...
1
vote
0answers
48 views

Examples of “unusual”/non-trivial features that actually worked for improving model score [closed]

I have been working for a while in credit problems for classification and regression and on these problems I have had the necessity of improving already good performing models, for this when ...
1
vote
1answer
30 views

Creating features from raw accelerometer data

I have a dataset containing raw 3-axis accelerometer data collected from a users lower leg and I want to create a classification model (as simple as possible) that detects if the user is sat down or ...
1
vote
1answer
47 views

How to extract features from long chemical names?

I have an interesting problem that I am uncertain about how to even get started. I am working on a binary classifier that will take a chemical name, encoded as a string, and predict whether it is a '...
9
votes
1answer
299 views

How does a convolutional ply differ from an ordinary convolutional network?

I am currently working on recreating the results of this paper. In the paper they describe a method for using CNN for features extraction, and have a acoustic model that is Dnn-hmm and pretrained ...
1
vote
0answers
383 views

Feature extraction in ConvNNs - layers progression

This is a bit of a confusion I have and I never saw any explanation of it, so I have to ask the question. Whenever I see the discussion on how a ConvNNs extracts features, I see something like this: ...
0
votes
1answer
22 views

How to group categorical columns into similar types?

(Forgive me if the question is ill put. I am a novice in data science. Please comment or edit so that the question can be improved) I have a dataset where we have to predict the future sale of a shop....
0
votes
1answer
26 views

How to utilize measurement accuracy metadata in classifier

Given that one wants to ascribe a class to groups of measurements using a classifier model, in what way can one include information about measurement accuracy? More specifically, is there a feature ...

1
2 3 4 5
7