2
$\begingroup$

In continuation to this question, I have a conceptual question. If I am not using the 'nfeatures' then I am getting 7 features from a feature set of 515 features. If I use the 'nnfeatures' tag (this tag specifies the minimum number of features I want it to display) with a value of 10, then I am getting those 7 faetures along with 3 new one. Now I am unable to decide how many features should I take. Is it okay to take 7 features out of 515 features? Will any ML algorithm be able to capture the characteristics of the data with just these 7 features?

Another question is, a criterion value is given when the sequentialfs algorithm is applied in MATLAB. What is this criterion function? From this page I came to know that a set of features are chosen whose mean criterion value is the lowest. So does it mean that only those features are chosen with the minimum criterion value? Also, if this is the case, then how does the algorithm decide how many features it should select?

$\endgroup$
0
$\begingroup$

Disclaimer: I do not know enough about MATLAB to answer the full question but I'll have a go at answering the rest

1 - How many features should you take?

If this is a predictive problem you're trying to solve, how about you try and assess the accuracy of your predictions by using features sets of 7 and 10 respectively? You might find that there is very little difference in predictive power so taking 7 might be OK.

NB: I am quite surprised that your feature selection algo selected such a small proportion of your available features - you're right to want to dig a little deeper on what's happening under the hood..

2 - Will any ML algorithm be able to capture the characteristics of the data with just these 7 features?

If your feature selection algo is working fine then there's all the likelihood that a ML would be able to characterise the underlying structure of your dataset relatively easily.

There's a number of problems out there that have a large amount of explanatory variables but are best characterised by a select few (for instance GDP is usually relatively well explained by what it was last quarter, with all other related variables having small impacts on prediction accuracy).

3 - MATLAB QUESTIONS: TBC

Sorry I can't answer all your questions - maybe someone will come by with MATLAB knowledge and we can roll our answers together. Otherwise you might be better splitting this into two questions to get more detailed answers on the MATLAB algo.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.