I am working to create a SVM binary classifier for classification of Tweets based on news class "Crime" and "Non Crime". I have downloaded a dataset of 6400 rows from various sources and training my model on it. While I am able to achieve over 95% accuracy, what concerns me is about its performance on new datasets. The system will be deployed on live streaming tweets, so how can I put in a feedback system such as my model is continuously updates itself? As in, say for new crime type news source which were not covered in training model, how to incorporate them further?
I am asking a broad methodology question, not some specific program related question as I would like to figure out the implementation myself :)