I have a python script written with Spark Context and I want to run it. I tried to integrate IPython with Spark, but I could not do that. So, I tried to set the spark path [ Installation folder/bin ] as an environment variable and called spark-submit command in the cmd prompt. I believe that it is finding the spark context, but it produces a really big error. Can someone please help me with this issue?
Environment variable path: C:/Users/Name/Spark-1.4;C:/Users/Name/Spark-1.4/bin
After that, in cmd prompt: spark-submit script.py