I have collected data for a PhD thesis, and need help understanding how to build a road map to do analytical and statistical analysis. The PhD is not itself in statistics or machine learning, but I would like to understand what are the steps and type of analysis that I have to follow for analysing data for an advanced degree? In general, how should I approach such a problem?
In the data I have collected, there are 623 observations including one continuous dependent variable and 13 independent variables (continuous, categorical, and ordinal) that are defined based on the researcher experience and literature review.
I considered planning to do several regression analysis to predict the dependent variable and study the effective factors (if they are positive, negative, and their magnitude) on it. I've tried multiple linear regression including different transformation on independent variables. On the other hand, I'm not sure if I should study each independent variables through the time and forecast their values in the time horizon?
Here are the steps in my mind so far:
Plotting the scatter plots of different independent variables vs dependent variable to define outliers and check if the model is linear also with respect to coefficients
Removing the potential outliers
Splitting the data into two data sets to build the model and validate it after that.
If the model is linear then:
Performing the multiple linear regression
Performing the multiple linear regression including different transformations to enhance the model
Validating the model
Doing the quantile regression
Doing supervised learning machine etc.
If the model is not linear, I may instead need to use non-linear statistical techniques.
Any feedback would be highly appreciated. My goal is to build a clear and robust road map for this part of the work.