1
$\begingroup$

I'm trying to find a tool or workflow that would allow a team to analysis data in multiple steps, where intermediate results are cached. (I'll assume that the raw data is in a relational database and the end result shall be shown in a web UI.)

Multiple steps: This requirement can be describe in SQL as VIEWS:

CREATE VIEW b AS SELECT FROM a WHERE ... GROUP BY ... HAVING ...
CREATE VIEW c AS SELECT FROM b WHERE ... GROUP BY ... HAVING ...

Caching: Additionally to the process described above, we want to temporarily store the 'views' b and c. (Either until the underlying data changes or for a set amount of time. The latter is acceptable for the use case.)

Saving the view as a (temporary) tables, updated periodically, comes to mind, but we would have to build a workflow around this.

Team: This project requires some collaboration. A user should be able share queries with a team and have others build on top of it.

I want to avoid reinventing the wheel. Is there a technology stack that does this already?

$\endgroup$

closed as off-topic by Stereo, Icyblade, Dawny33, Sean Owen Mar 11 '17 at 5:05

This question appears to be off-topic. The users who voted to close gave this specific reason:

  • "This question does not appear to be about data science, within the scope defined in the help center." – Stereo, Icyblade, Dawny33, Sean Owen
If this question can be reworded to fit the rules in the help center, please edit the question.