There are many queueing systems out there. Each one of them is different and was created for solving certain problems. This page tries to collect the libraries that are widely popular and have a successful record of running on (big) production systems.
The goal is to create a quality list of queues with a collection of articles, blog posts, slides, and videos about them. After reading the linked articles, you should have a good idea about: the pros and cons of each queue, a basic understanding of how the queue works, and what each queue is trying to achieve. Basically, you should have all the information you need to decide which queue will best fit your needs.
The whole site is open source and is updated quite frequently. If you find any mistakes or see something missing, feel free to post an issue or send a pull request. All contributions are welcome! Thanks.
Apache ActiveMQ ™ is the most popular and powerful open source messaging and Integration Patterns server.
Resources
ActiveMQ‘s next generation of messaging.
Resources
Beanstalkd is a simple, fast work queue.
Resources
Crossroads I/O (‘libxs‘) is a library for building scalable and high performance distributed applications. It fits between classic BSD sockets, JMS/AMQP-style message queues, and enterprise message-oriented middleware.
Resources
simple, lightweight message queue
Resources
Database based asynchronously priority queue system
Resources
An open source project to build a multi-protocol, embeddable, very high performance, clustered, asynchronous messaging system.
Resources
IronMQ is an easy-to-use highly available message queuing service. It is available as a cloud service on Amazon and Rackspace as well as on-premise with Iron.io‘s enterprise offering. Features include a nice dashboard to manage queues, easy to create webhooks, unicast and multicast Push Queues, autoscaling alerts for worker processes, and error queues.
Resources
Apache Kafka is publish-subscribe messaging rethought as a distributed commit log.
Resources
simple, distributed message queue system
Resources
nanomsg is a socket library that provides several common communication patterns
Resources
realtime distributed message processing at scale
Resources
Apache Qpid™ makes messaging tools that speak AMQP and support many languages and platforms (in C++, Python, Java JMS and .NET)
Resources
Simple, efficient worker queue for Ruby & PostgreSQL.
Resources
Robust messaging for applications
Resources
A rock-solid job queue, written in Ruby, backed by Redis.
Resources
RestMQ is a message queue which uses HTTP as transport, JSON to format a minimalist protocol and is organized as REST resources. It stands on the shoulder of giants, built over Python, Twisted, Cyclone (a Tornado implementation over twisted) and Redis.
Resources
RQ (Redis Queue) is a simple Python library for queueing jobs and processing them in the background with workers
Resources
Simple, efficient background processing for Ruby.
- Based on Redis
- Multithreaded, employs Celluloid under the hood
- Web UI
- Resque Compatibility
- Sidekiq Pro - paid version ($750) with support and additional features (batches, notifications, reliability, metrics)
- Fast growing community
Resources
Amazon Simple Queue Service (SQS) is a fast, reliable, scalable, fully managed queue service.
Resources
Zaqar is a queuing and notification service made by and for OpenStack, but not only for it
Resources
