标签：云帆大数据学院 mahout graphx hive flume sqoop
YARN有2个守护线程：ResourceManager、NodeManager。
[hadoop@localhost hadoop-2.2.0]$sbin/yarn-daemon.sh start resourcemanager
[hadoop@localhost hadoop-2.2.0]$sbin/yarn-daemon.sh start nodemanager
YARN管理地址：
ResourceManager： 主机名：8088 。本环境中为：http://hadoop-yarn.dragon.org:8088
NameNodeManager：主机名：8042 。本环境中为：http://hadoop-yarn.dragon.org:8042
(1) $HADOOP_HOME/share/hadoop/mapreduce目录下有很多例子程序：
Anexample program must be given as the first argument.
Validprogram names are:
aggregatewordcount: An Aggregate basedmap/reduce program that counts the words in the input files.
aggregatewordhist: An Aggregate basedmap/reduce program that computes the histogram of the words in the input files.
bbp: A map/reduce program that usesBailey-Borwein-Plouffe to compute exact digits of Pi.
dbcount: An example job that count thepageview counts from a database.
distbbp: A map/reduce program that uses aBBP-type formula to compute exact bits of Pi.
grep: A map/reduce program that counts thematches of a regex in the input.
join: A job that effects a join over sorted,equally partitioned datasets
multifilewc: A job that counts words fromseveral files.
pentomino: A map/reduce tile laying programto find solutions to pentomino problems.
pi: A map/reduce program that estimates Piusing a quasi-Monte Carlo method.
randomtextwriter: A map/reduce program thatwrites 10GB of random textual data per node.
randomwriter: A map/reduce program thatwrites 10GB of random data per node.
secondarysort: An example defining asecondary sort to the reduce.
sort: A map/reduce program that sorts thedata written by the random writer.
sudoku: A sudoku solver.
teragen: Generate data for the terasort
terasort: Run the terasort
teravalidate: Checking results of terasort
wordcount: A map/reduce program that countsthe words in the input files.
wordmean: A map/reduce program that countsthe average length of the words in the input files.
wordmedian: A map/reduce program that countsthe median length of the words in the input files.
wordstandarddeviation: A map/reduce programthat counts the standard deviation of the length of the words in the inputfiles.
(2) 如何运行这些程序
运行这些例子通过$HADOOP_HOME/bin/yarn jar 命令执行，如：下面的例子是执行pi函数：
[root@hadoop-yarn hadoop-2.2.0]# bin/yarn jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar
说明：红色部分：命令 蓝色部分：jar文件所在的路径
标签：云帆大数据学院 mahout graphx hive flume sqoop
原文地址：http://yfteach01.blog.51cto.com/9428662/1629699
