码迷,mamicode.com
首页 > 其他好文 > 详细

命令行下编译Wordcount

时间:2014-11-22 16:01:23      阅读:166      评论:0      收藏:0      [点我收藏+]

标签:style   blog   http   ar   sp   java   文件   on   div   

1. 编辑WordCount.java文件,在下载的hadoop安装包里有WordCount的例子

http://mirrors.hust.edu.cn/apache/hadoop/common/hadoop-2.2.0/hadoop-2.2.0.tar.gz

2. 把WordCount编译成一个jar文件

 mkdir wordcount_classes
 javac -cp classpath -d wordcount_classes WordCount.java
 jar -cvf wordcount.jar -C wordcount_classes/ . 
这里的classpath和之前的hadoop版本有所区别,需要按照新的设置方法,这一点网上很少提及!
新的classpath为:
$HADOOP_HOME/share/hadoop/common/hadoop-common-2.2.0.jar:$HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:$HADOOP_HOME/share/hadoop/common/lib/commons-cli-1.2.jar
 

3.创建HDFS文件夹

hadoop fs -mkdir wordCount
hadoop fs -mkdir wordCount/input
echo "Hello World Bye World" > file0
echo "Hello Hadoop Goodbye Hadoop" > file1
hadoop fs -put file* wordCount/input

4.运行

hadoop jar wordcount.jar org.myorg.WordCount wordCount/input wordCount/output
hadoop fs -cat /user/cloudera/wordcount/output/part-00000

 

 

命令行下编译Wordcount

标签:style   blog   http   ar   sp   java   文件   on   div   

原文地址:http://www.cnblogs.com/kxdblog/p/4115230.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!