码迷,mamicode.com
首页 > 其他好文 > 详细

hadoop 配置 单台机器

时间:2015-04-29 07:04:02      阅读:150      评论:0      收藏:0      [点我收藏+]

标签:

http://khangaonkar.blogspot.com/2012/09/hadoop-2x-tutorial.html

1. hdfs-site.xml

namenode and datanode folder need to create in advance, all the content in these two folder should be deleted every time do 

hadoop namenode -format

otherwise clusterID for namenode and datanode will not match

http://stackoverflow.com/questions/26907878/hadoop-multinode-cluster-data-node-not-working-properly

<configuration>
<property>
    <name>dfs.replication</name>
    <value>1</value>
  </property>
  <property>
    <name>dfs.namenode.name.dir</name>
    <value>file:/home/steve/hdfs/namenode</value>
  </property>
  <property>
    <name>dfs.datanode.data.dir</name>
    <value>/home/steve/hdfs/datanode</value>
  </property>
</configuration>

2. core-site.xml

<configuration>
<property>
    <name>fs.default.name</name>
    <value>hdfs://localhost:9000</value>
  </property>
</configuration>

3. yarn-site.xml

<configuration>

 <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
  </property>
 <property>
    <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
    <value>org.apache.hadoop.mapred.ShuffleHandler</value>
  </property>


</configuration>

4. mapred-site.xml

<configuration>
<property>
    <name>mapreduce.framework.name</name>
    <value>yarn</value>
  </property>
</configuration>

 

hadoop 配置 单台机器

标签:

原文地址:http://www.cnblogs.com/phoenix13suns/p/4464548.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!