码迷,mamicode.com
首页 > 其他好文 > 详细

redis celery too many connection

时间:2014-12-18 23:33:02      阅读:551      评论:0      收藏:0      [点我收藏+]

标签:blog   http   ar   io   os   sp   for   on   div   

用django 框架,异步任务用celery,队列用redis

出现了这个问题,too many connection

 

 Couldn‘t ack ‘5f41afc62d-a112-bef34d5de1cc‘, reason:ConnectionError(‘Too many connections‘,)

Traceback (most recent call last):
  File "/srv/www/wom/env/lib/python2.6/site-packages/kombu/message.py", line 93, in ack_log_error
    self.ack()
  File "/srv/www/wom/env/lib/python2.6/site-packages/kombu/message.py", line 88, in ack
    self.channel.basic_ack(self.delivery_tag)
  File "/srv/www/wom/env/lib/python2.6/site-packages/kombu/transport/virtual/__init__.py", line 566, in basic_ack
    self.qos.ack(delivery_tag)
  File "/srv/www/wom/env/lib/python2.6/site-packages/kombu/transport/redis.py", line 152, in ack
    self._remove_from_indices(delivery_tag).execute()
  File "/srv/www/wom/env/lib/python2.6/site-packages/redis/client.py", line 1914, in execute
    self.shard_hint)
  File "/srv/www/wom/env/lib/python2.6/site-packages/redis/connection.py", line 395, in get_connection
    connection = self.make_connection()
  File "/srv/www/wom/env/lib/python2.6/site-packages/redis/connection.py", line 402, in make_connection
    raise ConnectionError("Too many connections")
ConnectionError: Too many connections
 
 
看了文档之后,要设个变量

BROKER_POOL_LIMIT

New in version 2.3.

The maximum number of connections that can be open in the connection pool.

The pool is enabled by default since version 2.5, with a default limit of ten connections. This number can be tweaked depending on the number of threads/greenthreads (eventlet/gevent) using a connection. For example running eventlet with 1000 greenlets that use a connection to the broker, contention can arise and you should consider increasing the limit.

If set to None or 0 the connection pool will be disabled and connections will be established and closed for every use.

Default (since 2.5) is to use a pool of 10 connections.
 

CELERY_REDIS_MAX_CONNECTIONS

Maximum number of connections available in the Redis connection pool used for sending and retrieving results.
 
 

BROKER_TRANSPORT_OPTIONS

New in version 2.2.

A dict of additional options passed to the underlying transport.

See your transport user manual for supported options (if any).

Example setting the visibility timeout (supported by Redis and SQS transports):

BROKER_TRANSPORT_OPTIONS = {‘visibility_timeout‘: 18000}  # 5 hours
bubuko.com,布布扣

要设置 max_connections 才能解决下面的问题 

redis celery too many connection

标签:blog   http   ar   io   os   sp   for   on   div   

原文地址:http://www.cnblogs.com/yemsheng/p/4172886.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!