Questions tagged [svm]
Support Vector Machines (SVM) are a popular supervised machine learning algorithm that can be used for classification or regression.
22
questions
5
votes
1
answer
4k
views
What is the difference between C and lambda in the context of an SVM?
I don't understand the difference between the parameter $C$ and $\lambda$ in terms of the SVM. It seems to me that they are both involved in regulating over-fitting of the data.
What difference ...
196
votes
6
answers
351k
views
How to draw Deep learning network architecture diagrams?
I have built my model. Now I want to draw the network architecture diagram for my research paper. Example is shown below:
- 2,467
10
votes
4
answers
4k
views
Skewed multi-class data
I have a dataset which contains ~100,000 samples of 50 classes. I have been using SVM with an RBF kernel to train and predict new data. The problem though is the dataset is skewed towards different ...
- 933
6
votes
2
answers
1k
views
Classifying survey response text SVM
I have 800 responses to an open-ended survey question. Each response is categorized into 3 categories based on a list of 70 categories. These categories are things like "stronger leadership", "better ...
- 83
3
votes
2
answers
1k
views
Understanding Learning Curves
I would like to clarify my understanding of learning curves with two example plots below. I am experimenting with small data sets here between 500 and 1500 samples to clarify my understanding.
My ...
- 133
25
votes
2
answers
49k
views
Can you explain the difference between SVC and LinearSVC in scikit-learn?
I've recently started learning to work with sklearn and have just come across this peculiar result.
I used the digits dataset ...
- 536
12
votes
2
answers
4k
views
The differences between SVM and Logistic Regression
I am reading about SVM and I've faced to the point that non-kernelized SVMs are nothing more than linear separators. Therefore, ...
- 6,031
11
votes
2
answers
2k
views
Consequence of Feature Scaling
I am currently using SVM and scaling my training features to the range of [0,1].
I first fit/transform my training set and then apply the same transformation to my testing set. For example:
...
- 933
8
votes
2
answers
11k
views
Predicting probability from scikit-learn SVC decision_function with decision_function_shape='ovo'
I have a multiclass SVM classifier with labels 'A', 'B', 'C', 'D'.
This is the code I'm running:
...
- 203
7
votes
1
answer
1k
views
Custom metrics for unbalanced classes problem in RandomForest or SVM
My dataset has highly unbalanced classes ‒ foreground of 30 classes with tens of samples against background set of >100k samples. Classifying foreground class as background is quite OK, while ...
- 71
4
votes
1
answer
2k
views
Mathematical formulation of Support Vector Machines?
I'm trying to learn maths behind SVM (hard margin) but due to different forms of mathematical formulations I'm bit confused.
Assume we have two sets of points $\text{(i.e. positives, negatives)}$ one ...
- 931
3
votes
2
answers
27k
views
3
votes
1
answer
2k
views
Should the output of regression models, like SVR, be normalized?
I have a regression problem which I solved using SVR. Accidentally, I normalized my output along with the inputs by removing the mean and dividing by standard ...
- 547
3
votes
1
answer
219
views
Can we use Stop Words while using multinomial navies theorem?
I'm collecting Twitter tweets for sentiment analysis. I chose to use Multinomial Navies theorem for finding the sentiment.
I found some examples of SVM theorem making use of stop words. My question ...
- 389
2
votes
2
answers
192
views
Different runs of feature selection algorithm giving different set of selected feature. How to choose the best set among them?
I am using the forward feature selection algorithm from MATLAB. The code is as follows:
...
- 1,161
2
votes
1
answer
57
views
Is it possible to implement a classifier according to quarters? What about missing data?
I have a dataset with several individuals and features. I'm studying behavior over the year (for instance, averages or iterations of money gained, jobs, etc.).
My ultimate goal is to implement a ...
- 109
2
votes
1
answer
110
views
What algorithm can predict structured outputs of arbitrary size?
I have a collection of graph objects of variable size (input) which are each paired to another graph of variable size (output). The task is, given an input graph, produce the most likely output graph. ...
- 123
2
votes
1
answer
633
views
Should bag of words in training set include test set data when doing text classification?
I'm doing text classification to identify 'attacks' from Wikipedia comments using a simple bag of words model and a linear SVM classifier. Because of class imbalance, I'm using the F1 score as my ...
- 121
1
vote
1
answer
1k
views
How to classify whether text answer is relevant to an initial text question
I have a text classification problem in which i need to classify an answer to a message as either relevant or not.
In the first phase of my calculations, I have already used a SVM to determine if ...
- 117
1
vote
1
answer
291
views
Why won't my SVM learn a sequence of repeated elements
I recently started playing with SVMs for a one class classification, I was able to get some reasonable classifications from real data and but was trying to optimize the nu and gamma parameters when I ...
- 113
0
votes
1
answer
115
views
How to increase the accuracy of 1 class
Hai I am working with blood transfusion data set using SVM classifier.I applied SVC with C=17 and kernel rbf. It is highly imbalanced data set and I balanced it using SMOTE. But class 1 is performing ...
0
votes
2
answers
416
views
How to quantify the performance of the classifier (multi-class SVM) using the test data?
I am working on a traffic sign recognition code in MATLAB using Belgian Traffic Sign Dataset. The dataset consists of training data and test data.
I resized the given images and extracted HOG ...
- 141