码迷,mamicode.com
首页 > 其他好文 > 详细

Hadoop安装错误总结

时间:2018-04-28 22:19:17      阅读:165      评论:0      收藏:0      [点我收藏+]

标签:文件   ice   ast   work   address   service   red   reduce   styles   

Master的NodeManager/DateNode未启动

日志中未出现任何错误

  • 正常现象,如需在Master中启动可在slave文件中
    slaves

    localhost
    slave01
    slave02

Master的ResourceManager未启动

  1. 检查yarn-site.xml
  2. 检查mapred-site.xml

Slave的DateNode未启动

  • 检查yarn-site.xml
    yarn-site.xml

    <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
    </property> 

Name node is in safe mode

  • 退出Safe Mode

    hadoop dfsadmin -safemode leave

参考配置

core-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
    <name>fs.defaultFS</name>
    <value>hdfs://master:9000</value>
</property>
<property>
    <name>hadoop.tmp.dir</name>
    <value>file:///home/zkpk/hadooptmpdata</value>
</property>
</configuration>

hdfs-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
    <name>dfs.replication</name>
    <value>1</value>
</property><property>
    <name>dfs.namenode.name.dir</name>
    <value>file:///home/zkpk/hadoopname</value>
</property><property>
    <name>dfs.datanode.data.dir</name>
    <value>file:///home/zkpk/hadoopdata</value>
</property>
</configuration>

mapred-site.xml

<?xml version="1.0"?>
<configuration>
<property>
    <name>mapreduce.framework.name</name>
    <value>yarn</value>
</property>
<property>
    <name>mapreduce.jobhistory.address</name>
    <value>master:10020</value>
</property>
<property>
    <name>mapreduce.jobhistory.address</name>
    <value>master:19888</value>
</property>
</configuration>

yarn-site.xml

<?xml version="1.0"?>
<configuration>
    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>
    <property>
        <name>yarn.resourcemanager.address</name>
        <value>master:18040</value>
    </property>
    <property>
        <name>yarn.resourcemanager.scheduler.address</name>
        <value>master:18030</value>
    </property>
    <property>
        <name>yarn.resourcemanager.resource-tracker.address</name>
        <value>master:18025</value>
    </property>
    <property>
        <name>yarn.resourcemanager.admin.address</name>
        <value>master:18141</value>
    </property>
    <property>
        <name>yarn.resourcemanager.webapp.address</name>
        <value>master:18088</value>
    </property>
</configuration>

Hadoop安装错误总结

标签:文件   ice   ast   work   address   service   red   reduce   styles   

原文地址:https://www.cnblogs.com/zhuxiaoxi/p/8946709.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!