标签:
Master URL | Meaning |
---|---|
local | Run Spark locally with one worker thread (i.e. no parallelism at all). |
local[K] | Run Spark locally with K worker threads (ideally, set this to the number of cores on your machine). |
local[*] | Run Spark locally with as many worker threads as logical cores on your machine. |
spark://HOST:PORT | Connect to the given Spark standalone cluster master. The port must be whichever one your master is configured to use, which is 7077 by default. |
mesos://HOST:PORT |
Connect to the given Mesos cluster. The port must be whichever one your is configured to use, which is
5050 by default. Or, for a Mesos cluster using ZooKeeper, use mesos://zk://... . |
yarn-client |
Connect to a YARN cluster in client mode. The cluster location will be found based on the HADOOP_CONF_DIR variable. |
yarn-cluster |
Connect to a YARN cluster in cluster mode. The cluster location will be found based on HADOOP_CONF_DIR. |
【甘道夫】Spark1.3.0 Submitting Applications 官方文档精华摘要
标签:
原文地址:http://blog.csdn.net/u010967382/article/details/45062381