24
$\begingroup$

As there are numerous tools available for data science tasks, and it's cumbersome to install everything and build up a perfect system.

Is there a Linux/Mac OS image with Python, R and other open-source data science tools installed and available for people to use right away? An Ubuntu or a light weight OS with latest version of Python, R (including IDEs), and other open source data visualization tools installed will be ideal. I haven't come across one in my quick search on Google.

Please let me know if there are any or if someone of you have created one for yourself? I assume some universities might have their own VM images. Please share such links.

$\endgroup$
  • $\begingroup$ Although this question could be viewed as borderline offtopic I somehow find it a good one for the site IMHO. $\endgroup$ – Sean Owen Jan 23 '15 at 10:21
  • 3
    $\begingroup$ In addition to the awesome comments, there's a (somewhat older) blog post comparing several different solutions: jeroenjanssens.com/2013/12/07/… $\endgroup$ – LauriK Jan 23 '15 at 13:29
13
$\begingroup$

There is another choice which popular recently: docker(https://www.docker.com). Docker is a container and let you create/maintain a working environment very easily and fast.

Hope that would help you.

$\endgroup$
12
$\begingroup$

If you are looking for a VM with a bunch of tools preinstalled, try the Data Science Toolbox.

$\endgroup$
  • $\begingroup$ Interesting project (+1). Thank you for sharing! It might be easier to use it than to figure out why Docker didn't want to work on my Win 7 laptop (see above). However, it still might be a good idea to learn Docker, considering recent trends. $\endgroup$ – Aleksandr Blekh Jan 23 '15 at 10:45
  • $\begingroup$ Nice information. Comparing to vm tools, it needs some time to understand how docker operates. If you are already familiar with vm, it's a good idea to use this toolbox. Thank you for sharing. $\endgroup$ – fansia Jan 23 '15 at 15:55
  • $\begingroup$ Thank you for sharing. It is definitely interesting. But I don't see how someone can use it without a graphical interface. I would need R-studio, and PyCharm for Python.( iPython notebook is there). I will need to play with a bit to understand it completely. $\endgroup$ – JeanVuda Jan 24 '15 at 0:03
  • 1
    $\begingroup$ @AleksandrBlekh I was able to finally get docker to work on my Windows 7 machine by regenerating the certificates docker-machine regenerate-certs I hope that helps :) $\endgroup$ – R.K. Aug 20 '15 at 6:12
  • $\begingroup$ @R.K.: Thank you for letting me know. I will give it a try when I'll get a chance (it might take a while, though, as there are some higher priority matters waiting to be taken care of). $\endgroup$ – Aleksandr Blekh Aug 20 '15 at 9:11
8
$\begingroup$

While Docker images are now more trendy, I personally find Docker technology not user-friendly, even for advanced users. If you are OK with using non-local VM images and can use Amazon Web Services (AWS) EC2, consider R-focused images for data science projects, pre-built by Louis Aslett. The images contain very recent, if not the latest, versions of Ubuntu LTS, R and RStudio Server. You can access them here.

Besides main components I've listed above, the images contain many useful data science tools built-in as well. For example, the images support LaTeX, ODBC, OpenGL, Git, optimized numeric libraries and more.

$\endgroup$
  • $\begingroup$ Thank you so much for mentioning this option. I will definitely give it a try. However, I want an image that has exactly like this AMI, but can be run with VirtualBox on my laptop. $\endgroup$ – JeanVuda Jan 23 '15 at 3:08
  • $\begingroup$ I watched a tutorial recently about Docker, tested it and found it easy to understand. What part did you find not user-friendly? $\endgroup$ – Robert Smith Jan 23 '15 at 3:24
  • $\begingroup$ @JeanVids: You're very welcome. I understand your desire to have a local VM - that was the reason I've tried Docker on my computer. I will let you know, if I find a VirtualBox VM image focused on data science (hopefully, R-based). $\endgroup$ – Aleksandr Blekh Jan 23 '15 at 3:49
  • 1
    $\begingroup$ @RobertSmith: I understand. Perhaps, the problem was that I was trying to set it up on my Windows machine. Anyway, I will give it a try some time later. Thanks for your comments. $\endgroup$ – Aleksandr Blekh Jan 23 '15 at 4:48
  • 1
    $\begingroup$ @AleksandrBlekh Yes, that might be the main problem. Unfortunately there are many issues when installing this sort of thing on Windows. $\endgroup$ – Robert Smith Jan 23 '15 at 5:08
5
$\begingroup$

Did you try Cloudera's QuickStart VM?:

I found it very easy to run it and it includes open source software such as Mahout and Spark.

$\endgroup$
5
$\begingroup$

Today i used this repository from https://github.com/sequenceiq/docker-spark and build it with docker. it is a docker image building spark based on hadoop image of the same owner. if you to use spark, it has a python api called pyspark http://spark.apache.org/docs/latest/api/python/

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.