0
$\begingroup$

I am working in a company but I am new in the field. We have a central server which is faster than my laptop (of course). So my goal is that I still use my laptop to do python analysis for machine learning but actual computation is happening in the central server so that the computing power is stronger. I am not considering any cloud service as we have a fast server computer.

But I am clueless in this yet. Can anyone advise me how to do this?

Thank you very much in advance.

Improve this question
$\endgroup$
2
  • $\begingroup$ You can work with a very small data on laptop for development (say just 20k samples) and check-in the code. On sever; run the same training with whole data. $\endgroup$
    – Shamit Verma
    May 9, 2019 at 11:26
  • $\begingroup$ This is a standard situation, everybody codes and genarates the pilot on their laptop and then sends it to the headnode of the cluster for farming to the slave nodes via a queuing system. The Jupyter notebook may be a good workaround $\endgroup$
    – M__
    Jun 8, 2019 at 19:03

1 Answer 1

Reset to default
1
$\begingroup$

I have a similar set-up; I run both local and remote installations of Jupyter. On the server I have JupyterHub running, into which i can ssh. Locally I have Anaconda set up etc.

If you are meticulous in mirroring any custom libraries across the system (or even better package them for pip installs) this works quite well.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.