标签:spark 数据库 performance jdbc select
Hive Tables
将HIVE_HOME/conf/hive-site.xml
文件copy到SPARK_HOME/conf/下
When not configured by the hive-site.xml, the context automatically creates metastore_db
and warehouse
in
the current directory.
// sc is an existing SparkContext.
val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)
sqlContext.sql("CREATE TABLE IF NOT EXISTS src (key INT, value STRING)")
sqlContext.sql("LOAD DATA LOCAL INPATH ‘examples/src/main/resources/kv1.txt‘ INTO TABLE src")
// Queries are expressed in HiveQL
sqlContext.sql("FROM src SELECT key, value").collect().foreach(println)
标签:spark 数据库 performance jdbc select
原文地址:http://blog.csdn.net/stark_summer/article/details/45843803