标签：
正在准备做Spark SQL external data source与关系型数据库交互的部分，参考下Sqoop2是如何操作关系型数据库的。
下载地址：http://archive.cloudera.com/cdh5/cdh/5/
下载并安装：
cd /home/spark/app/ wget http://archive.cloudera.com/cdh5/cdh/5/sqoop2-1.99.3-cdh5.0.0.tar.gz tar -zxvf sqoop2-1.99.3-cdh5.0.0.tar.gz cd sqoop2-1.99.3-cdh5.0.0
注：由于本地采用的hadoop是2.3.0-cdh5.0.0版本，故本案例中使用的是cdh5.0.0对应的sqoop版本；
添加sqoop2到系统环境变量中：
export SQOOP2_HOME=/home/spark/app/sqoop2-1.99.3-cdh5.0.0 export CATALINA_BASE=$SQOOP2_HOME/server export PATH=.:$SQOOP2_HOME/bin:$PATH
拷贝mysql驱动包到$SQOOP2_HOME/server/lib下
cp mysql-connector-java-5.1.10-bin.jar $SQOOP2_HOME/server/lib/
修改配置文件：
$SQOOP2_HOME/server/conf/sqoop.properties
org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/home/spark/app/hadoop-2.3.0-cdh5.0.0/etc/hadoop
common.loader=${catalina.base}/lib,${catalina.base}/lib/*.jar,${catalina.home}/lib,${catalina.home}/lib/*.jar,${catalina.home}/../lib/*.jar,/home/spark/app/hadoop-2.3.0-cdh5.0.0/share/hadoop/common/*.jar,/home/spark/app/hadoop-2.3.0-cdh5.0.0/share/hadoop/common/lib/*.jar,/home/spark/app/hadoop-2.3.0-cdh5.0.0/share/hadoop/hdfs/*.jar,/home/spark/app/hadoop-2.3.0-cdh5.0.0/share/hadoop/hdfs/lib/*.jar,/home/spark/app/hadoop-2.3.0-cdh5.0.0/share/hadoop/mapreduce/*.jar,/home/spark/app/hadoop-2.3.0-cdh5.0.0/share/hadoop/mapreduce/lib/*.jar,/home/spark/app/hadoop-2.3.0-cdh5.0.0/share/hadoop/tools/*.jar,/home/spark/app/hadoop-2.3.0-cdh5.0.0/share/hadoop/tools/lib/*.jar,/home/spark/app/hadoop-2.3.0-cdh5.0.0/share/hadoop/yarn/*.jar,/home/spark/app/hadoop-2.3.0-cdh5.0.0/share/hadoop/yarn/lib/*.jar
启停sqoop-server:
$SQOOP2_HOME/bin/sqoop.sh server start $SQOOP2_HOME/bin/sqoop.sh server stop
启动sqoop客户端：
$SQOOP2_HOME/bin/sqoop.sh client
为客户端配置服务器：
sqoop:000> set server --host hadoop000 --port 12000 --webapp sqoop
查看服务器端信息：
sqoop:000> show server --all
标签：
原文地址：http://www.cnblogs.com/luogankun/p/4209017.html
