码迷,mamicode.com
首页 > 其他好文 > 详细

Hadoop 管理工具HUE配置-Yarn Resource Manager HA配置

时间:2015-07-18 21:11:50      阅读:169      评论:0      收藏:0      [点我收藏+]

标签:

安装HUE之后,需要配置很多东西才能将这个系统的功能发挥出来,因为Yarn是配置的HA模式,所以在配置HUE的时候,会有些不用,下面一段文字是官网拿来的

  # Configuration for YARN (MR2)
  # ------------------------------------------------------------------------
  [[yarn_clusters]]
 
    [[[default]]]
 
      # Whether to submit jobs to this cluster
      submit_to=True
 
      # Name used when submitting jobs
      logical_name=ha-rm
 
      # URL of the ResourceManager API
      resourcemanager_api_url=http://gethue-1.com:8088
 
      # URL of the ProxyServer API
      proxy_api_url=http://gethue-1.com:8088
 
      # URL of the HistoryServer API
      history_server_api_url=http://gethue-1.com:19888
 
    [[[ha]]]
      # Enter the host on which you are running the failover Resource Manager
      resourcemanager_api_url=http://gethue-2.com:8088
      logical_name=ha-rm
      submit_to=True

这里需要说明一下,[[[default]]] 和 [[ha]]中各配置一个RM,logical_name名字就是yarn-site.xml中配置的

<property> 
        <name>yarn.resourcemanager.ha.rm-ids</name>  
        <value>rm1,rm2</value> 
</property>  
URL of the ResourceManager API 这里配置资源管理的地址和端口,对应yarn-site.xml中的
<property> 
        <name>yarn.resourcemanager.webapp.address.rm1</name>  
        <value>1423-0001:23188</value> 
  </property>  
  <property> 
        <name>yarn.resourcemanager.webapp.address.rm2</name>  
        <value>1423-0002:23188</value> 
  </property>
URL of the HistoryServer API 这里配置历史记录资源管理的地址和端口,对应mapred-site.xml中的
<property>
              <name>mapreduce.jobhistory.webapp.address</name>
              <value>1423-0003:19888</value>
</property>

我的配置文件如下:

  [[yarn_clusters]]

    [[[default]]]
      # Enter the host on which you are running the ResourceManager
      ## resourcemanager_host=localhost

      # The port where the ResourceManager IPC listens on
      ## resourcemanager_port=8032

      # Whether to submit jobs to this cluster
      submit_to=True

      # Resource Manager logical name (required for HA)
      logical_name=rm1

      # Change this if your YARN cluster is Kerberos-secured
      ## security_enabled=false

      # URL of the ResourceManager API
      resourcemanager_api_url=http://1423-0001:23188

      # URL of the HistoryServer API
      history_server_api_url=http://1423-0003:19888

      # In secure mode (HTTPS), if SSL certificates from YARN Rest APIs
      # have to be verified against certificate authority
      ## ssl_cert_ca_verify=True

    # HA support by specifying multiple clusters
    # e.g.

    [[[ha]]]
      # Resource Manager logical name (required for HA)
      logical_name=rm2
      resourcemanager_api_url=http://1423-0002:23188
      history_server_api_url=http://1423-0003:19888
      submit_to=True

 

Hadoop 管理工具HUE配置-Yarn Resource Manager HA配置

标签:

原文地址:http://www.cnblogs.com/liuchangchun/p/4657520.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!