Spark-submit 测试任务提交

标签：clu   master   yarn   ipa   hadoop2   oop   kpi   spark   pre   

./spark-submit --keytab /usr/local/noah/basp-dataprocess-log/conf/noah.keytabs --principal noah@BJ.CTC --class org.apache.spark.examples.SparkPi --master local[*] ../lib/spark-examples-1.6.3.2.6.0.3-8-hadoop2.7.3.2.6.0.3-8.jar 100
./spark-submit --class org.apache.spark.examples.SparkPi --master local[*] /app/hdp/2.6.0.3-8/spark2/examples/jars/spark-examples_2.11-2.1.0.2.6.0.3-8.jar
 100
 /usr/hdp/2.6.0.3-8/spark2/bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn --deploy-mode cluster /app/hdp/2.6.0.3-8/spark2/examples/jars/spark-examples_2.11-2.1.0.2.6.0.3-8.jar 100
./spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client /app/hdp/2.6.0.3-8/spark2/examples/jars/spark-examples_2.11-2.1.0.2.6.0.3-8.jar 100

Spark-submit 测试任务提交

标签：clu   master   yarn   ipa   hadoop2   oop   kpi   spark   pre   

原文地址：https://blog.51cto.com/fengyunshan911/2416098