码迷,mamicode.com
首页 > 其他好文 > 详细

快速从一个空虚拟机,空idea打通提交spark

时间:2019-03-12 09:22:02      阅读:182      评论:0      收藏:0      [点我收藏+]

标签:opened   event   closed   view   col   park   https   ado   close   

技术图片
https://www.cnblogs.com/xxbbtt/p/8143593.html
View Code
#!/bin/bash
# Install Spark on CentOS 7
yum install java -y
java -version

yum install wget -y
wget http://downloads.typesafe.com/scala/2.11.7/scala-2.11.7.tgz
tar xvf scala-2.11.7.tgz
sudo mv scala-2.11.7 /usr/lib
sudo ln -s /usr/lib/scala-2.11.7 /usr/lib/scala
export PATH=$PATH:/usr/lib/scala/bin
scala -version

wget http://d3kbcqa49mib13.cloudfront.net/spark-1.6.0-bin-hadoop2.6.tgz
tar xvf spark-1.6.0-bin-hadoop2.6.tgz

export SPARK_HOME=$HOME/spark-1.6.0-bin-hadoop2.6
export PATH=$PATH:$SPARK_HOME/bin

firewall-cmd --permanent --zone=public --add-port=6066/tcp
firewall-cmd --permanent --zone=public --add-port=7077/tcp
firewall-cmd --permanent --zone=public --add-port=8080-8081/tcp
firewall-cmd --reload

echo ‘export PATH=$PATH:/usr/lib/scala/bin‘ >> .bash_profile
echo ‘export SPARK_HOME=$HOME/spark-1.6.0-bin-hadoop2.6‘ >> .bash_profile
echo ‘export PATH=$PATH:$SPARK_HOME/bin‘ >> .bash_profile

# 刷新配置
source /root/.bash_profile

 

快速从一个空虚拟机,空idea打通提交spark

标签:opened   event   closed   view   col   park   https   ado   close   

原文地址:https://www.cnblogs.com/tangsonghuai/p/10514460.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!