Return to Answer

With Docker Swarm Mode you could set up your own secure cluster of low-cost machines.

• So if you are into distributed processig of large datasets, Docker Swarm (and alternatively perhaps the container managemenent tool Kubernetes) can be the basis for deploying Apache Spark (or similar software) on many containers (and/or hosts), for parallel processing.

• If you are into real-time analysis of data streams, you could scale up the cluster relatively easily, according to current demand, without buying lots of expensive network equipment or costly management software from vendors of virtualization technologies.

(I haven't done this personally except for toy examples in the context of MOOCs. However, here is a blogpost from April 2019 about Spark on Docker Swarm, by someone else. - Maybe Swarm Mode is still only available for Docker Enterprise Edition, not the free Community Edition)

With Docker Swarm Mode you could set up your own secure cluster of low-cost machines.

• So if you are into distributed processig of large datasets, Docker Swarm (and alternatively perhaps the container managemenent tool Kubernetes) can be the basis for deploying Apache Spark (or similar software) on many containers (and/or hosts), for parallel processing.

• If you are into real-time analysis of data streams, you could scale up the cluster relatively easily, according to current demand, without buying lots of expensive network equipment or costly management software from vendors of virtualization technologies.

(I haven't done this personally except for toy examples in the context of MOOCs. However, here is a blogpost from April 2019 about Spark on Docker Swarm, by someone else. - Beware that Swarm Mode was once only available for Docker Enterprise Edition, not the free Community Edition. Now the documentation no longer says so, but I don't know for sure)

With Docker Swarm Mode you could set up your own secure cluster of low-cost machines.

• So if you are into distributed processig of large datasets, Docker Swarm (and alternatively perhaps the container managemenent tool Kubernetes) can be the basis for deploying Apache Spark (or similar software) on many containers (and/or hosts), for parallel processing.

• If you are into real-time analysis of data streams, you could scale up the cluster relatively easily, according to current demand, without buying lots of expensive network equipment or costly management software from vendors of virtualization technologies.

(I haven't done this personally except for toy examples in the context of MOOCs. Maybe this is still only available for Docker Enterprise Edition, not the free Community Edition)

With Docker Swarm Mode you could set up your own secure cluster of low-cost machines.

• So if you are into distributed processig of large datasets, Docker Swarm (and alternatively perhaps the container managemenent tool Kubernetes) can be the basis for deploying Apache Spark (or similar software) on many containers (and/or hosts), for parallel processing.

• If you are into real-time analysis of data streams, you could scale up the cluster relatively easily, according to current demand, without buying lots of expensive network equipment or costly management software from vendors of virtualization technologies.

(I haven't done this personally except for toy examples in the context of MOOCs. However, here is a blogpost from April 2019 about Spark on Docker Swarm, by someone else. - Maybe Swarm Mode is still only available for Docker Enterprise Edition, not the free Community Edition)

With Docker Swarm you could set up your own cluster of low-cost machines.

• So if you are into distributed processig of large datasets, Docker Swarm (and alternatively perhaps the container managemenent tool Kubernetes) can be the basis for deploying Apache Spark (or similar software) on many containers (and/or hosts), for parallel processing.

• If you are into real-time analysis of data streams, you could scale up the cluster relatively easily, according to current demand, without buying lots of expensive network equipment or costly management software from vendors of virtualization technolgies.

(I haven't done this personally except for toy examples in the context of MOOCs)

With Docker Swarm Mode you could set up your own secure cluster of low-cost machines.

• So if you are into distributed processig of large datasets, Docker Swarm (and alternatively perhaps the container managemenent tool Kubernetes) can be the basis for deploying Apache Spark (or similar software) on many containers (and/or hosts), for parallel processing.

• If you are into real-time analysis of data streams, you could scale up the cluster relatively easily, according to current demand, without buying lots of expensive network equipment or costly management software from vendors of virtualization technologies.

(I haven't done this personally except for toy examples in the context of MOOCs. Maybe this is still only available for Docker Enterprise Edition, not the free Community Edition)