3
$\begingroup$

Given a two class multi dimensional classification problem, what reason would you give to choose Artificial Neural Network for carrying out the classification instead of Support Vector Machine or other classification methods?

$\endgroup$
0
$\begingroup$

SVM is Parametric. Parametric models are something with fixed finite number of parameters independent of dataset size. Anything which is not parametric model is non-parametric model. ANN is non parametric. Also ANN has 'deep architectures" which can represent "intelligent" behaviour/functions etc more efficiently than "shallow architectures" like SVMs. ANN may have any number of outputs, while support vector machines have only one.

| improve this answer | |
$\endgroup$
3
$\begingroup$

I wouldn't give any reason to make an choice a priori, based on such a broad description.

Instead I would build models for NN and SVM (or any other that you were considering), train them on the data then compare using cross-validation and a suitable metric for your problem - such as accuracy, F1 score, AUROC or log loss. You may also want to note characteristics other than performance metric if you care about costs such as time to train, amount of computing resource required etc.

Experience may tell you likely best choices from the problem domain. For instance, if you are classifying photographic or scanned images, then currently a convolutional neural network would be a very strong candidate, as these have repeatedly shown themselves as best performers with real-world image data.

| improve this answer | |
$\endgroup$
  • 2
    $\begingroup$ Quick adds: In general SVM: Less prone to over fitting because of the margin, fast predictions, slower training for large datasets. ANN: More prone to over fitting and we need to try out methods as you have mentioned, slower predictions, faster training. $\endgroup$ – phoxis Oct 23 '15 at 5:06

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.