Skip to main content

Questions tagged [feature-extraction]

Variables (used for prediction or explication) used in regression or regression-like models (like clustering, discrimination). Use this tag for questions about constructing such variables or selecting the best among them.

Filter by
Sorted by
Tagged with
0 votes
0 answers
4 views

Video / image recognition: Featurize movement

How would it be best to featurize movement of objects between video frames? Let's say I have a footage of a wolf pack and I am trying to understand where the Alpha is there. The best is actually not ...
Tagar's user avatar
  • 198
0 votes
0 answers
8 views

Feature Selection in no labeled data

I'm new to this field and trying to learn by working with a fraud dataset. Initially, I used the dataset as is, but now I'm trying unsupervised learning without the labels. I've tried clustering ...
DrGenius's user avatar
  • 101
0 votes
0 answers
6 views

Finding invariant feature areas within representation vector for each meta-class/group?

I have pairs of images which are not the same class, but are from the same meta-class/group. I have a standard CNN which produces a representation for each sample. If I have several pairs of images ...
StudentV's user avatar
0 votes
0 answers
21 views

Questions about the process of feature selection through feature importance

'Shap feature importance' was obtained through xgboost, and variables with the lowest feature importance were removed one by one from 50 variables until only 1 variable remained. As a result of ...
JAE's user avatar
  • 13
0 votes
0 answers
9 views

İnternal and hold out test for shap

There is an internal test set and a hold out test set. I explain the model with Shap library. Should I use the internal test set or the external test set? What should I do if there is a difference?
Nemo's user avatar
  • 1
1 vote
1 answer
27 views

How to match the two datasets on Electoral bonds given by SBI?

Just stumbled across the Electoral bond dataset https://www.kaggle.com/datasets/shaundanielll/electoral-bond-data-state-bank-of-india There are two csvs- One contains Encashment data(Date of ...
dirtynerdy's user avatar
0 votes
1 answer
12 views

i am trying to get the the variance of derivative of order 2. i only have the data of an EEG signal sampled at 128 Hz. is the below code correct

I basically want to implement equation 7 present in the added image ...
Shreedatta Nasik's user avatar
0 votes
0 answers
46 views

Feature extractor for a a 2D array input

I want to train a SAC algorithm from Stable Baselines 3 with a (100,210) shaped array as input. The array is a stack of observations cumulated along axis 0. The last row is current observation. SAC ...
GerardL's user avatar
  • 13
0 votes
1 answer
15 views

How to use FeatureUnion

I am trying to solve an exercise problem in my data sceive course. The problem requires me to construct a pipeline and use feature union to extract the most relevant features. Have coded as in the ...
Krishnan Ganapathy's user avatar
0 votes
1 answer
22 views

How to improve the influence of one element of the input on the latent code in an autoencoder?

I am trying to apply an autoencoder for feature extraction with the input like I=[x1,x2,x3,...,xn]. Representing the latent code after encoding as L, I want to improve the influence of one element of ...
JJbow's user avatar
  • 15
0 votes
0 answers
45 views

How can I calculate the data energy loss after PCA?

Recently in a slide in about PCA (Principal Component Analysis) I saw a question: "How much is the data energy loss in PCA?&...
hasanghaforian's user avatar
0 votes
0 answers
9 views

What I do wrong with my speech recognition CTC model

I want to train an english speech to text model using architecture similar to deepspeech. In general it has 4 blocks: feature extraction I used melspectrogram. (I used n_mels=80) This translates (...
Захар Наумець's user avatar
0 votes
0 answers
9 views

Deriving consistency feature for a student using a study app over the days

I want to build a recommendation engine for the revision app. Basic Idea After each module we will ask student questions and based on the correctness of their answers we will decide after how many ...
Keshav Raj's user avatar
0 votes
1 answer
36 views

Number of feature extraction layers in CNN

In a course I took about machine learning, we normally used about 2 feature extraction layers for image classification tasks, using MNIST or ...
evilmandarine's user avatar
0 votes
0 answers
30 views

propper feature encoding

I working with the following data set also here is it's detailed description of "packet_dat" column I can't understand how I can encode packet_dat column into proper feature so my ...
Roma's user avatar
  • 101
0 votes
0 answers
18 views

Combining Computer Vision and traditional machine learning to predict respondent reactions (from a survey) to seeing a picture. Is it possible?

I have the following task Computer Vision/prediction task which I’m interested in hearing whether you guys think is feasible. I have a dataset of 1000 respondents coming from a survey, where ...
Andy's user avatar
  • 11
0 votes
1 answer
25 views

Encoding soft clustering results as features

I want to use cluster numbers from soft clustering algorithm output as a some sort of categorical feature (or features), add them to other features for further training in another model (Y's from soft ...
franz-german's user avatar
1 vote
1 answer
43 views

How to build a categorization system without a target variable?

The data I have a large dataset containing execution logs from various tests conducted over several years. The logs can be noisy and often contain a plethora of messages detailing the ongoing ...
Mr Kartofel's user avatar
1 vote
1 answer
42 views

Feature selection for propensity model

I'm trying to build a propensity model for whether or not a customer will buy a second product. I was given data that looks like this: | Age | Income | DaysSince1stPurchase | Bought2ndProduct | |:---- ...
BlueSkyz's user avatar
0 votes
1 answer
17 views

How to represent facial features from video and classify high/low personality traits from facial features?

The dataset has 3-minute 30fps video conversations (no audio) of 150 extroverted and 150 introverted individuals. The goal is to classify them as "introverts" or "extroverts" based ...
TheBiometricsGuy's user avatar
0 votes
0 answers
20 views

Why is the feature direction chosen in the direction associated with largest eigenvalue of $Σ_T$ in case of more than two classes?

Why is the feature direction chosen in the direction associated with largest eigenvalue of $Σ_T$ in case of more than two classes? Please see the following.
DSPinfinity's user avatar
0 votes
1 answer
21 views

Approaches to dataset, whose elements have different size

I am working with a dataset where each elements is a square table of size m-by-n, where m (the number of rows) is the same for all the data points, while n (the number of columns) varies from tens to ...
Roger V.'s user avatar
  • 103
0 votes
0 answers
13 views

How to train model with data received from different 3x accelerometers sensors?

I want to make a model based on accelerometer data to recognise different activities like running, walking etc. I have a small dataset collected from my target sensor. I found another dataset with ...
eugenn's user avatar
  • 101
0 votes
0 answers
14 views

How to analyze social media data to see its impact on a game's sales

I work for a console gaming giant. We forecasted the sales for a RPG game that was to be released few months back. But the actual sales was twice the forecast. This compelled the developers to ...
Ritik P. Nayak's user avatar
0 votes
1 answer
87 views

Text classification with very short strings

I have a dataset of short job titles (e.g., 'marketing manager', 'system administrator', etc.) and their respective Census occupation code (e.g., 1006 Computer systems analysts). I am interested in ...
topi-dont-know's user avatar
-1 votes
1 answer
23 views

How to Data Engineer a dataset to get the best featurres to predict a target class?

In my dataset, I have data of IDs that don't create any meaningful relationship with each other and when I test that dataset on different models I am not getting accuracy more than 40%. Anyone can ...
Farhan Aslam's user avatar
0 votes
0 answers
22 views

Sentiment extraction with hugging face ready to use model

I have a set of reviews for which I need to extract their sentiments and use those sentiments as an independent variable in an econometric model. I used one of the ready-to-use models of hugging face ...
m sh's user avatar
  • 3
0 votes
1 answer
34 views

Different scaling methods of different features results in a faux dependency between them

My dataset contains the following two features: "movie duration" (minutes) and "tv shows duration" (seasons). If a certain sample is of type "movie", it's duration will ...
Shir's user avatar
  • 1
0 votes
0 answers
178 views

Can DeepSort be made to track objects beside people?

As far as my understanding goes, the model used for feature extraction in DeepSort is specified as the first argument of the function create_box_encoder in the file ...
Mehdi Charife's user avatar
0 votes
0 answers
66 views

FTT Features to use after time-domain is transformed to frequency-domain

Please forgive the question if it sounds trivial/naive, I am from computer science background, not electrical/computer engineering. I work with GPS trajectory dataset for classification. Data was ...
Amina Umar's user avatar
0 votes
0 answers
77 views

Best Feature Extraction Practise for Long Audio Data

I have a video dataset and my aim is classifying predefined scenes in these videos at 1fps (that means I perform classification at each second). Therefore, I plan to fuse audio and visual features for ...
kubicwerke's user avatar
0 votes
1 answer
97 views

What's the best way to handle unclassified data in a dataset when using a decision tree-based classification model in Python?

I trained a model that performs classification using decision trees. I will use my model to perform classification on my dataset. My dataset also contains data that does not belong to any class in the ...
Uğur Eren's user avatar
0 votes
1 answer
41 views

How to treat single column with both continuous and categorical data for ML model

I am working on financial data where I have a feature(column) with 90% values between 0-1000 (continuous) and 10% values as -1, -2 and -9. (default values) Default value definition: -1: data not ...
Advin's user avatar
  • 1
0 votes
0 answers
28 views

What is the steps to generate data from a plot and use them to have a predication using python?

I have a plot that represent a BH curve for magnatic material. The material have a behavior for each H value for two different temperature 25 C and 100 C. Figure 1. I need to extract the data for each ...
Will's user avatar
  • 1
1 vote
1 answer
48 views

Making a netcdf data using xarray

I am very very new to the world of data science as I only started using it in my new job so I would really appreciate help from the community experts (maybe also in simple words :)). I am trying to ...
Shaz's user avatar
  • 125
0 votes
1 answer
277 views

MEL VS linear spectrograms for bioacoustics machine learning

I don't have background in bioacoustics but working on a data-science project in bioacoustics. I am working with animal vocalizations recorded at sampling rate of 250000. Animals are bats, which are ...
user305883's user avatar
2 votes
1 answer
40 views

What ML techniques could be used for biometric feature extraction and ID generation?

I'm working on a project that involves generating a unique ID for a given biometric (such as an iris image). I'm interested in exploring the use of ML techniques for feature extraction and ID ...
Sedan Grib's user avatar
0 votes
1 answer
2k views

How to extract embeddings from an audio file using wav2vec along with context

I am trying to use wav2vec embeddings from the XLSR model for emotion recognition on the EMODB dataset. How can I extract embeddings using wav2vec? I want to use the XLSR model pre-trained with ...
Aun Zaidi's user avatar
1 vote
2 answers
936 views

Issues with audio embedding using wav2vec

I am having issues with audio embedding using the wav2vec library while trying to classify emotions using audio signals from the EMODB dataset (Emotions dataset in German). I am using the following ...
Aun Zaidi's user avatar
1 vote
0 answers
12 views

Boosting the effect of some of the features in SVM

I'm doing text classification with SVM. I'm using Tfidf vectorization. In addition to the text vectors, I have a context data denoting the possible outcomes of the prediction. For example, I have a ...
cuneyttyler's user avatar
0 votes
1 answer
50 views

Which Feature Selection Techniques for NLP is this represent

I have a dataset that came from NLP for technical documents my dataset has 60,000 records There are 30,000 features in the dataset and the value is the number of repetitions that word/feature appeared ...
asmgx's user avatar
  • 549
0 votes
1 answer
22 views

which features are most important for skin diseases classification?

I am working on skin problem detection and am using a skin image dataset. I want to extract features from the images, but I can't understand which handcrafted features I should extract. I did some ...
Rezuana Haque's user avatar
0 votes
1 answer
35 views

Why plot features?

In PyTorch's tutorial, Speech Recognition With Wav2Vec2, the acoustic features are extracted from the audio waveform (even though it was unnecessary, as the model can perform feature extraction and ...
Bolchojeet's user avatar
1 vote
2 answers
93 views

Feature Extraction using deep learning but classification Using boosting or other ML algorithms

Is it logical to perform feature extraction using deep learning but classification using traditional machine learning or boosting techniques at the same time? Is it okay to use ML algorithms for ...
Rubaiath-E- Ulfath's user avatar
0 votes
1 answer
72 views

Minimum number of items required to build a good hybrid recommender system?

I am trying to build a hybrid recommender system using lightFM that only recommends one of $3$ items. In my case, they are marketing campaigns that a company would like to recommend for users at a ...
bmasri's user avatar
  • 101
2 votes
0 answers
81 views

Feature selection and model performance

Featuretools provides an automated way to generate features from your data, by providing relationships within your data and applying their so-called deep feature synthesis. It generates features like ...
holzben's user avatar
  • 121
2 votes
1 answer
319 views

Handling of readability scores for short texts

I have a classification problem using emails as my dataset. I would like to use scores from various readability formulas as features for the classification. However, most of them are defined for ...
liakoyras's user avatar
  • 636
0 votes
2 answers
491 views

Autoencoder vs Pre-trained network for feature extraction

I wanted to know if anyone has any sort of guidance on what is better for image classification on a lot of classes (about 400) with a small amount of samples per class (around 20), for relatively big ...
MrStealYourFrog's user avatar
1 vote
3 answers
158 views

Using the results of clustering to retrain a neural network

I am following and expanding upon previous work from the winner of the Melanoma Classification from here. The dataset has 9 classes. The competition is only interested in the one class (Melanoma). I ...
Adrian B's user avatar
  • 198
0 votes
1 answer
803 views

Min Pooling vs Max Pooling

If I train a simple CNN with an MNIST dataset for digit classification. Is it possible to get a similar performance if I replace the max-pooling layers with the min-pooling layers? This problem may be ...
a_parida's user avatar
  • 153

1
2 3 4 5
9