Can anybody tell me what the purpose of feature generation is? And why feature space enrichment is needed before classifying an image? Is it a necessary step?

Is there any method to enrich feature space?


Feature Generation -- This is the process of taking raw, unstructured data and defining features (i.e. variables) for potential use in your statistical analysis. For instance, in the case of text mining you may begin with a raw log of thousands of text messages (e.g. SMS, email, social network messages, etc) and generate features by removing low-value words (i.e. stopwords), using certain size blocks of words (i.e. n-grams) or applying other rules.

Feature Extraction -- After generating features, it is often necessary to test transformations of the original features and select a subset of this pool of potential original and derived features for use in your model (i.e. feature extraction and selection). Testing derived values is a common step because the data may contain important information which has a non-linear pattern or relationship with your outcome, thus the importance of the data element may only be apparent in its transformed state (e.g. higher order derivatives). Using too many features can result in multicollinearity or otherwise confound statistical models, whereas extracting the minimum number of features to suit the purpose of your analysis follows the principle of parsimony.

Enhancing your feature space in this way is often a necessary step in classification of images or other data objects because the raw feature space is typically filled with an overwhelming amount of unstructured and irrelevant data that comprises what's often referred to as "noise" in the paradigm of a "signal" and "noise" (which is to say that some data has predictive value and other data does not). By enhancing the feature space you can better identify the important data which has predictive or other value in your analysis (i.e. the "signal") while removing confounding information (i.e. "noise").

  • 2
    $\begingroup$ Nice answer! (+1) $\endgroup$ – Aleksandr Blekh Jan 19 '15 at 15:31
  • 1
    $\begingroup$ It is my pleasure! $\endgroup$ – Aleksandr Blekh Jan 19 '15 at 16:34
  • $\begingroup$ Thank you.. Is there any methods to perform feature space enrichment? $\endgroup$ – Saratha Priya Jan 19 '15 at 17:39
  • $\begingroup$ Sure. There are many such methods. For instance the Gabor filter is a bandpass filter edge detection algorithm commonly used for feature generation in facial recognition and texture classification. This can be used in combination with classification algorithms such as support vector machines. $\endgroup$ – Hack-R Jan 20 '15 at 2:48
  • $\begingroup$ Can I use that for feature enrichment in image classification? $\endgroup$ – Saratha Priya Jan 20 '15 at 7:45

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.