I am pretty new to the Data Science world and I am looking for some advices.
One of the tasks that I have to do, is to go alone at a customer place for few days/weeks and dig into their data lake to see what it is possible to do with their data.
It is something I have never done before and I am a bit lost on multiple things :
- What are the best methods to find the most interesting data among the other (in a relatively short period of time)
- What tools will I need ? (An Apache Zeppelin with some pre-build dashboards ?)
- Data Parsing
- Vizualisation
- Other ?
- What kind of results is best ? (Cool vizualisation, list of interesting correlation, use cases that could be solved, etc...)
- In this context, is there additional constraints that I may not have anticipated ?
There is various type of customers, with various type of data, so I am looking (if possible) for relatively generic advices.
I have a developer/data-engineer background (Scala, Java, Python), and some basic knowledges in stats and ML.
The goal of my company is to use my results in order to enrich the sofwares that they develop for their customers.