码迷,mamicode.com
首页 > 其他好文 > 详细

利用Ambari进行hdp小版本升级

时间:2016-06-14 17:47:01      阅读:511      评论:0      收藏:0      [点我收藏+]

标签:

HDP2.2 升级手册

* 注意事项:

  • 升级描述:当前HDP版本2.2.0.0,升级版本2.2.6.0;
  • 手动升级(命令行)方式官方文档:http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.2.6/bk_upgrading_hdp_manually/content/ch_upgrade_2_1.html

1. 升级前准备工作

1.1 重启服务* 注:因为上次升级Ambari metrics没有重启服务,所以这次重启所有服务以应用上一次的配置更新;

1.2 备份所有服务的配置文件:

mkdir /root/backup
tar -cvf /root/backup/hdp_config_backup.tar /etc/

1.3 检查 Hive Server 节点端口使用情况,如果端口被占用,需要手动修改;

netstat -anp | grep 1001[01]

1.4 备份 Hive 元数据库

备份
mysqldump hive > /root/backup/backup_hive.sql

还原
mysql hive < /root/backup/backup_hive.sql

1.5 关闭正在运行的 Mapreducecrontab 定时任务、Kill掉所有已经发布的 Storm topology

1.6 将升级安装包解压到YUM主机。

tar -xzvf HDP-2.2.6.0-centos6-rpm.tar.gz
mv HDP /var/www/html/HDP2.2.6

2. 升级

2.1 登录到 Ambari,添加新的HDP版本;

技术分享

http://public-repo-1.hortonworks.com/HDP2.2.6/centos6/2.x/updates/2.2.6.0/
http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos6


技术分享

 

2.2 保存后,点击安装,Ambari 将为所有节点安装新的HDP组件;

技术分享
技术分享

2.3 等待安装后,点击更新,Ambari 将为所有节点更新HDP组件;

技术分享

2.4 更新过程中,Ambari 将提示6次需要干预的操作,因为升级前已经准备好了,所以当遇到提示时直接确认即可,整个升级过程将持续1小时左右;

技术分享

升级完成

技术分享

3. 恢复应用服务

3.1 升级完成后,Hive server thrift 端口将改为 10010,所以需要检查相关应用的配置,修改对应的端口参数值;

4. 其他

HDP 升级过程中的提示

    1. Before continuing, please backup the Hive Metastore database located on the following host(s): hadoop002.icccuat.com.

    2. The initial batch of DataNode, RegionServer and NodeManager hosts have been upgraded. You are advised to check the hosts and perform cluster/workload-specific tests against your cluster to ensure proper operation before proceeding with upgrade of the remaining services.

    3. Please note that the HiveServer port will now change to 10010 if hive is using a binary transfer mode or 10011 if hive is using an http transport mode. You can use “netstat -anp | grep 1001[01]” to determine if the port is available on each of following HiveServer host(s): hadoop002.icccuat.com. If the port is not available, the process using it must be terminated.
      Updated ‘hive-site’ with ‘hive.server2.thrift.port=10010’

    4. Before continuing, please deactivate and kill any currently running topologies.

    5. Please rebuild your topology using the new Storm version dependencies and resubmit it using the newly created jar.

    6. Your cluster version has been upgraded. Click on Finalize when you are ready to finalize the upgrade and commit to the new version. You are strongly encouraged to run tests on your cluster to ensure it is fully operational before finalizing. You cannot go back to the original version once the upgrade is finalized.

利用Ambari进行hdp小版本升级

标签:

原文地址:http://www.cnblogs.com/riyueyuzhuzhu/p/5584756.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!