Questions tagged [feature-extraction]

Variables (used for prediction or explication) used in regression or regression-like models (like clustering, discrimination). Use this tag for questions about constructing such variables or selecting the best among them.

Filter by
Sorted by
Tagged with
0
votes
0answers
4 views

Feature selection algorithm for psychometrics, when there is several predicted variables

I'm on a psychometric study. It is a survey. All variables are on a scale of 7. So these are considered as continuous variables. I have this dataset: 600 features 100 predicted variables 100 survey ...
0
votes
0answers
25 views

Extract features using Bounding Box

I have a ground truth bounding box for a 3d object. I would like to extract useful features for the object. My goal is to concatenate these visual object features with language features (from the ...
0
votes
1answer
22 views

How to load any particular folder files from a zip dataset

Twitter is a great source of information. Using The Health-News-Tweets.zip dataset contains tweets by different agencies like BBC Health, CBC Health, etc. I will ...
1
vote
1answer
19 views

Feature extraction with mixed categorical and numerical variables

I've been reading up on feature extraction methods - but the ones I have come across all seem to be numerical. To do feature extraction on a mixed numerical/ categorical dataset are there techniques ...
3
votes
1answer
104 views

What is the point of generating new features (linear or non linear) out of existing features in a dataset?

During feature engineering, we can create new features out of existing ones by using arithmetic operations albeit linear or not. Let's say we have two features x and z. We can then create (engineer) a ...
0
votes
1answer
21 views

Creating a complex featureset for regression modeling

I am currently working a on project that requires me to convert all of the categorical variables to continuous (or binary) variables to build a regression model. The problem is that I have more than ...
2
votes
0answers
18 views

What technique's can be used to identify and count individual animals in a dataset?

Problem: I have an image dataset that contains a lot of different chitals (a species of deer). The images are taken by cameratraps in a National Park. I would like to count the individual animals. For ...
0
votes
0answers
7 views

I am looking for general image-based clustering methods

My task is to cluster some images, I decided to use the VGG model to extract the features and then use K-Means to cluster these features. But my question: When I use a VGG as a feature extractor, I ...
0
votes
0answers
16 views

Using multiple TF-IDF to create a feature

I have around 200k comments and I extracted the top 200 words (without stop words) out of their content. Each comment is linked to a specific date. I would like to ask a very stupid question: Is it ...
0
votes
0answers
19 views

payment data prediction at test time

I have the payment data of the client. I want to predict the prob of customers paying late with target classes being 0-30 days, 30-60 days, 60-90 days, and 90+ days based on this paper. The features I ...
1
vote
1answer
44 views

How to model a 3D graph into a vector so that I can feed it into a classification algorithm?

I have a 3D graph like below: Ref: google images It has 2 angles as X and Y and the Z axis is amplitude value (Each 3D graph is representing a pixel). I want to model this into some useful data ...
0
votes
0answers
14 views

single layer autoencoder performing a lot worse than pca

I am trying to use a single layer autoencoder with linear activation function to perform dimensionality reduction on a dataset before clustering. The data consists of 5000 samples with 2000 features ...
0
votes
1answer
48 views

How to use efficient net as feature extractor for meta/Few shot learning in PyTorch

I am working on few shot learning and I wanted to use efficient-net as backbone feature extractor. Most of the model use Resnet as feature extractor. For example I can use below line of code and it ...
1
vote
0answers
20 views

What should be the input shape for convLSTM if ResNet-50 is applied before?

I have a video dataset, extracted all its frames, and applied ResNet-50 to extract features from all frames. ResNet-50 provides feature map of (2534, 7, 7, 2048), 2534 are the number of frames. Now I ...
1
vote
0answers
30 views

Permutation importance of features [closed]

This agnostic-model is not well addressed in research papers. I read articles where it was used to test the accuracy of the models, trying to understand the importance of individual features and their ...
3
votes
3answers
119 views

Deciding which samples the model will (probably) classify incorrectly

Problem: Given a neural network for image classification, the objective is to develop an algorithm which decides which images are 'problematic' and the model is probably going to classify them ...
0
votes
0answers
25 views

How to extract important text markers from samples to identify patterns?

Problem I have collected a decently large set of movie trailer titles from various Youtube trailer channels. I'd like to extract or infer the movie title and release year from this set in some way to ...
1
vote
2answers
30 views

Dimensionality reduction for feature extraction when missing some feature values

I have two questions: 1-Which method is appropriate for dimensionality reduction for feature extraction when missing some feature values? 2-Which textbook is the best source for the answer in (1)?
0
votes
0answers
13 views

TensorFlow - Image Vectorization - Add New Files

I am using tensorflow for feature extraction from images. Images are divided into 5 categories, each having various designs (which are labelled and trained to the system). Model is trained to find ...
1
vote
1answer
60 views

How do I get my Neural network to ignore certain values?

I was wondering if there was a way that I can get my CNN encoder-decoder neural network to completely ignore certain values in my data (2d images). There are some pixel values of 0 that never change ...
0
votes
1answer
17 views

Using extracted feature vector to perform zero shot detection

I've developed a deep learning model trained from scratch on fruits and vegetables. However, as the data is limited, I can only cover a few different types of fruits and vegetables with the model ...
0
votes
0answers
12 views

Doing feature extraction from name data?

I'm working with a genre prediction application right now, and I was curious about handling name data. I was planning to try to use that in the prediction(as a normal human can usually estimate ...
0
votes
0answers
72 views

struggling with sklearn Pipeline, FeatureUnion for NLP

I'm working on Kaggle dataset trying to classify in the Tweet is a disaster or not. I have "text" feature that I will transform using TF-IDF but I also want to use "keyword" ...
0
votes
1answer
24 views

Is it a good idea to combine fine tuning and feature extraction techniques?

I have a normal/tumor medical images dataset and, for the same patients, also the relative genomics, and my goal is to predict if a patient has a tumor by combining all the information. To achieve ...
0
votes
1answer
37 views

Would a neural network trained on extracted features have the same accuracy as a full network with frozen layers?

Let's say that I train two neural networks on the exact same dataset. The first network is a VGG19 model with frozen convolutional layers so only the top dense ...
1
vote
0answers
21 views

Regression with a feature which has its own depth

I'm relatively new to ML/Statistical Analysis, and I'm facing a dataset structured like this ...
1
vote
0answers
29 views

How can I transform a sequence into features

When Machine Learning libraries don't support categorical features those features can be one-hot encoded into a series of binary feature columns. I have a feature that represents a sequence or ...
0
votes
1answer
16 views

Using partially defined features in an unified deep learning model

Suppose we have two types of feature A and B. A is defined for all kinds of samples while B is only defined for some of the samples. Here, B is partially defined does not mean B is missing value (such ...
0
votes
1answer
25 views

How to decide which method to use TFIDF, or BOW

In a huge dataset for NLP it is taking very long time to classify my dataset therefore, trying each feature extraction method separetly is time consuming and not effecient. Is there a way that can ...
0
votes
0answers
53 views

Is it wrong to use residuals from one model as data in another model?

Why is it wrong to use the residuals from one model to fit another? Is it wrong? Is the difference down to how the residuals are used? For example, the residuals are useful features for extending a ...
0
votes
0answers
10 views

Feature vector representation

I have a clarification. I have to create a classification model for certain set of documents. We are supposed to flag it anamoly or not based on certain terms in the document. My question is the terms ...
1
vote
1answer
16 views

How many words should be taken as features in a ML problem?

I would like to ask you how many words should be taken as features in a ML program. For example, if I have 30000 distinct words to make a vocabulary, what would a good number be? I am currently ...
0
votes
0answers
136 views

How to merge multiple filters of a layer to a single filter in convolutional neural network?

In a convolutional neural network (CNN), the layer weights are learnt such that they extract meaningful features from the data. For each layer, can we merge multiple filters into a single filter after ...
2
votes
1answer
49 views

Cannot understand feature extraction

I'm following an AI course and we've just entered the deep learning chapter. Speaking about the difference between classic machine learning models and deep learning, it turns out one of the most ...
0
votes
0answers
43 views

Rolling window on uneven time series classification

I have a univariate time series data that I would like to take about 60 seconds of, extract features using tsfresh and classify into multiclass. So I might end up with a dataframe like: ...
2
votes
1answer
40 views

Creating features from raw accelerometer data

I have a dataset containing raw 3-axis accelerometer data collected from a users lower leg and I want to create a classification model (as simple as possible) that detects if the user is sat down or ...
0
votes
0answers
71 views

ValueError: Could not guess the value column! Please hand it to the function as an argument

I'm using the tsfresh library to extract features on my data but I keep getting an error: ...
1
vote
1answer
20 views

Matching Data Text of Two Place with Exception [closed]

I have data of two places name and it's address in a row and i have to match it. Data is text type, I have read, it have to convert to numeric type that generated by the text. I extracted the numeric ...
1
vote
0answers
15 views

I need help in PCA results using WEKA Tool [closed]

I'm working on an experiment using KDD'99 cupset I have 42 features. the paper I 'm comparing with concludes that 3 features with precision ..% ok are the best subset to identify the attack X. In my ...
1
vote
0answers
8 views

Use feature-importance to decide what features to increase to increase target

(Please suggest another title for this question if you like - I find it rather difficult to phrase) Say I have an ice-cream stand and I record 3 features of my customers ...
1
vote
0answers
52 views

Examples of "unusual"/non-trivial features that actually worked for improving model score [closed]

I have been working for a while in credit problems for classification and regression and on these problems I have had the necessity of improving already good performing models, for this when ...
0
votes
1answer
42 views

Selecting only a certain number of top features using tsfresh

How can I select the top n features of time series dataset using tsfresh? Can I decide the number of top features I would like to extract?
1
vote
1answer
225 views

What is meta- data and meta features?

I want to know what is metadata and what is meant by meta features? When I google Meta Features what I get is feature selection tool called "Meta-Feature". What is the function of feature ...
0
votes
0answers
15 views

What are the different ways to feature engineer webpage data for input into a webpage classification model?

Looking for resources on the different ways that one can manipulate webpage data to input as features into a neural net. I'm aware of a service called diffbot that claims to use a CV based method to &...
0
votes
0answers
10 views

How to store and query biometric data for an authentication system?

I am trying to design, and hopefully implement, an authentication system which centers around the use of biometric images. I plan to use different machine learning and deep learning techniques to help ...
1
vote
1answer
25 views

Sneakers representation learning

I am trying to make a model which would take an image of shoes as an input and output a meaningful N-dimensional embedding of the shoes, so that they could be searchable/comparable/clustered and used ...
0
votes
0answers
12 views

Create a single feature vector from the 2 edges of the vertex

Overview Consider the 4 examples of the right angled vertex shown below. In each example, the vertex is made up of 2 line segments- A and B, which are perpendicular, and the all examples are nearly ...
0
votes
2answers
316 views

Problem extracting words from dataframe

I have the following dataset which is a .json file: and I would like to get the first word for every string inside lista_asm, so I would like to get: jmp,push,...
0
votes
1answer
27 views

Is the result of feature extraction a feature representation?

If a use a feature extraction method on images, do I then get a feature representation or is there a different meaning behind feature representation? To my understanding, when I use a CNN on an image ...
1
vote
2answers
41 views

Problem with a feature (normal distribution + peak around 0)

I have a feature that shows a characteristic of the instances. That characteristic can be present or not. If present it shows an almost normal distribution of values (actually a bit skewed to the ...

1
2 3 4 5
7