Is there a recommended approach for storing processed data for testing new data products?
Basically, I'd like to have a system where a data scientist or an analyst could think of a new data product to present to users, do the data processing to create it, and then put it in a data store that our application can then access easily.
What I'm not sure about is what kind of data store would be good for this type of "testing" use case. Since it would need to be flexible enough to handle different types of data products, like aggregates, windowed data, etc. And ideally it wouldn't require a huge instrumentation process to try out new things.