Even after all these years of data science from 2010 to 2018, why is there no general framework for putting a predictive model into production?

  • 1
    $\begingroup$ Wow, that's a broad question. In it's current form, it's probably impossible to answer - a narrower version could elicit some great responses, though. $\endgroup$ – Robert de Graaf Jan 30 '18 at 2:38

Depending on what exactly you mean by framework, I would argue that there is. Using a REST interface to serve a production model at inference time is pretty close to a general serving framework at this point.

However, there are a potentially infinite number of use cases that would diverge from this standard even if one categorically existed. Some mobile apps using image recognition models on personal data that the user doesn't want transmitted to the cloud are pushing the envelope of ways to compress formerly huge neural network architectures into ones that easily fit into mobile-sized memory, for example.

If you're talking software framework, it shouldn't be surprising that a field of programming practice (or, rather, plethora of fields) that find needs for a variety of languages and even ecosystems within languages would have difficulty forming a consensus around a single aporoach.

It's likely that deployment frameworks have yet to build in enough benefit to justify a reduction in general flexibility to justify their use.


Not the answer you're looking for? Browse other questions tagged or ask your own question.