spark 实战

标签：ctrl   lob   home   use   base   exit   ret   col   read   

1  cd  /usr/local/spark/spark-2.3.1-bin-hadoop2.6

2  ./bin/pyspark

3 

>>> textFile = spark.read.text("README.md")
2018-07-10 09:03:16 WARN ObjectStore:568 - Failed to get database global_temp, returning NoSuchObjectException
>>> textFile.count()
103
>>> textFile = spark.read.text("/home/zcy/working/data_tst/tst")
>>> textFile.count()
4
>>> textFile.first()
Row(value=u‘111111‘)

5 退出spark :   Use exit() or Ctrl-D (i.e. EOF) to exit

spark 实战

标签：ctrl   lob   home   use   base   exit   ret   col   read   

原文地址：https://www.cnblogs.com/testzcy/p/9287146.html