If I understand the Databricks philosophy correctly, Spark will soon be heavily moving toward dataframes, i.e. away from the usual map/reduce on RDDs. I was wondering if there are any good suggestions for online courses or books that introduce Spark from the dataframe point of view? I know Databricks has a good number of resources on dataframes but I would really like to see some more detailed courses.
2 Answers
edX offers some spark courses. Try the following:
I believe this is through a partnership with Databricks
-
1$\begingroup$ I know of the old version of this course which is still using the old paradigm. Maybe the next one is new? $\endgroup$– Alex R.Jun 5, 2016 at 20:09
Alex, you can check in this Coursera Big Data Course a chapter about Spark DataFrames in "Week 5", it's an introduction but it explains how to setup PySpark for DataFrames, may be for your situation it would be a good start.
Regards
-
$\begingroup$ This link doesn't work anymore. Might be helpful to note which institution offered it and who the instructor was, to help narrow it down within the Coursera search results. $\endgroup$ Aug 7, 2016 at 23:38
-
1$\begingroup$ Hi Brian, the Coursera Specialization has changed a few months ago, now you can access trough the Big Data Specialization from UC San Diego in the third course, but is a simple introduction with a initial tutorial for start to know Spark coursera.org/specializations/big-data . Also you have the Edx Course mentioned in other answer that is a part of spark series edx.org/course/introduction-apache-spark-uc-berkeleyx-cs105x $\endgroup$ Aug 8, 2016 at 16:22