I am trying to update my spark configuration to solve some dependency problems.

This pom.xml file seems to be useful for this purpose.

I am using a spark docker image.

ls /spark/conf


docker.properties.template    slaves.template
fairscheduler.xml.template    spark-defaults.conf.template
log4j.properties.template     spark-env.sh.template

I've searched pom.xml in the container by using find / -name "pom.xml" and got nothing.

Is there a way to use a pom.xml file to update spark configuration?

| improve this question | | | | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.