Often when i get a new project in machine learning the client always ask me either to do a particular task like a prediction for one thing or give me data and ask me to find what i can do with it.

i've read the book hands-on machine learning with scikit-learn & tensorflow where you can see a full process for starting a project , basically drawing plots and search in correlation matrices what is interesting.

Do you guys have a special way to do this ? what is the step by step process you use ?

Thank you.

  • $\begingroup$ It is not clear what are you asking for exactly, can you elaborate? Are you interested in a standard process to do data analysis/data mining, or are you asking for the process to build, train, test and validate a machine learning model? $\endgroup$
    – Wajdi
    Jun 26 '19 at 15:45
  • $\begingroup$ standard process to find and show to a client what i can do with his data. $\endgroup$
    – Fabieng
    Jun 26 '19 at 18:36
  • $\begingroup$ Alright, I have posted an answer below with more details on what process you can take :) $\endgroup$
    – Wajdi
    Jun 27 '19 at 7:40

One of the standardized process for doing data analysis / data mining is the CRISP DM (Cross-industry standard process for data mining) which is one of the most adopted norms in the industry.

The process is very straightforward and starts by an important task which is the Business understanding of the issue or data you are dealing with.

This means that a prior research should be done if the analyst is not very familiar with the industry or the problem.

What makes this standard very popular is the fact that you can iterate various times between the step of formulating the problem ( writing in simple terms), data exploration and data visualization.

Here is a a very rich document that you can follow.

It would take a bit of time to go through all of the steps, however what could be quit interesting is the practice part, where you adapt your own client's problem into a simple question and start your exploration phase right away.

CRISP DM steps

  • $\begingroup$ Thank for that . $\endgroup$
    – Fabieng
    Jun 28 '19 at 12:37
  • $\begingroup$ if this answers your question, you can accept it as an answer :) $\endgroup$
    – Wajdi
    Jun 29 '19 at 12:32

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.