I have made a model to predict some values. In real time, it works perfectly fine and yields prediction within a fraction of a second. The algorithm I am using is PassiveAggresiveClassifier to predict on multiple classes.
However, when I load tested it, it lagged in performance. I tried on passing 500 requests at a time and it essentially bogged down.
Is there a way to enhance this aspect of a model program-wise? Can python solve this? Is there another way?