码迷,mamicode.com
首页 > 其他好文 > 详细

Storm的一些重要的bug issues

时间:2015-05-25 16:37:21      阅读:114      评论:0      收藏:0      [点我收藏+]

标签:storm

Fix cascading Storm failure by improving reconnection strategy and buffering messages

上面的isusse是storm从0.9.3升级到0.9.4主要的优化,去掉了0.9.3中对于worker之间通信的bug。0.9.3对于worker之间如果连接不上就直接throw一个exception出来,导致该worker crash,那么和该worker 连接的worker也有可能在连接超时时crash,从而导致worker级联crash,job无法正常工作,数据丢失。

0.9.4改进的是不抛出异常,直接丢弃message,等待刷新重连,具体讨论可见该issue

Make worker receiver thread number configurable


技术分享
Nathan Marz
 added a comment - 04/Apr/14 01:28
It would be a good experiment, but we‘d have to make sure that incoming messages from the same task always go to the same receiver thread (otherwise messages sent by a task to another task could be received out of order)

Storm Performance cannot be scaled up by adding more CPU cores
https://github.com/apache/storm/pull/103

Storm的一些重要的bug issues

标签:storm

原文地址:http://blog.csdn.net/wzhg0508/article/details/45970369

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!