Supppose we have SVM trained on a dataset and the support vectors are $SV=\{x_1,x_2,\cdots,x_n\}$. Then, we know that the decision plan is decided by $SV$. My question is that if we remove one support vector (say $x_1$) from the dataset and train the model again. Will the other support vectors $\{x_2,\cdots,x_n\}$ still be the new support vectors after we training on the new dataset?


1 Answer 1


No, you cannot say that. Check the next image as an example, in which I removed one blue support vector and the new boundary does not use any of the old support vectors. More specifically, on the left example the margin is passing through the yellow area, while on the right one it is passing through the green one.

enter image description here

  • $\begingroup$ Thanks. The figure is brilliant! $\endgroup$
    – maple
    Aug 13, 2022 at 14:22
  • $\begingroup$ Thanks a lot :) $\endgroup$
    – DaSim
    Aug 16, 2022 at 6:50

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.