[LRUG] Queuing systems

Neil Middleton neil.middleton at gmail.com
Wed Sep 7 03:04:17 PDT 2011


Incidentally - I've seen a few people mentioning the Resque tolerance thing. What sort of numbers can you expect here? Are we talking 99.9% OK or what?

Neil

On Wednesday, 7 September 2011 at 10:38, Chris Rode wrote:

> Ultimately it comes down to how scalable and how important each message is to you. 
> 
> If losing a message here or there is not palatable, you will need to look at an AMQP compliant solution (we have clocked reads and writes on RabbitMQ at 1000's per second).
> 
> Another option is the redis-backed resque which is great. It is not guaranteed to be fault tolerant though due to the fact that redis is not designed as a message queuing system, although it goes to pains to reduce the loss. 
> 
> I hope that helps
> 
> Chris
> 
> On 07/09/2011, at 11:18, Neil Middleton <neil.middleton at gmail.com (mailto:neil.middleton at gmail.com)> wrote:
> 
> > Hundreds, possibly thousands of new jobs per second.
> > 
> > Neil
> > 
> > On Wednesday, 7 September 2011 at 10:17, Graham Ashton wrote:
> > 
> > > On 7 Sep 2011, at 10:14, Neil Middleton wrote:
> > > 
> > > > a crap load of data from an API
> > > 
> > > How much is a crap load?
> > > _______________________________________________
> > > Chat mailing list
> > > Chat at lists.lrug.org (mailto:Chat at lists.lrug.org)
> > > http://lists.lrug.org/listinfo.cgi/chat-lrug.org
> > 
> > _______________________________________________
> > Chat mailing list
> > Chat at lists.lrug.org (mailto:Chat at lists.lrug.org)
> > http://lists.lrug.org/listinfo.cgi/chat-lrug.org
> _______________________________________________
> Chat mailing list
> Chat at lists.lrug.org (mailto:Chat at lists.lrug.org)
> http://lists.lrug.org/listinfo.cgi/chat-lrug.org

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lrug.org/pipermail/chat-lrug.org/attachments/20110907/1b13f057/attachment-0003.html>


More information about the Chat mailing list