<html><body bgcolor="#FFFFFF"><div>Ultimately it comes down to how scalable and how important each message is to you. </div><div><br></div><div>If losing a message here or there is not palatable, you will need to look at an AMQP compliant solution (we have clocked reads and writes on RabbitMQ at 1000's per second).</div><div><br></div><div>Another option is the redis-backed resque which is great. It is not guaranteed to be fault tolerant though due to the fact that redis is not designed as a message queuing system, although it goes to pains to reduce the loss. </div><div><br></div><div>I hope that helps</div><div><br></div><div>Chris<br><br>On 07/09/2011, at 11:18, Neil Middleton <<a href="mailto:neil.middleton@gmail.com">neil.middleton@gmail.com</a>> wrote:<br><br></div><div></div><blockquote type="cite"><div>
<div>Hundreds, possibly thousands of new jobs per second.<br></div>
<div><br>Neil<br></div>
<p style="color: #A0A0A8;">On Wednesday, 7 September 2011 at 10:17, Graham Ashton wrote:</p>
<blockquote type="cite" style="border-left-style:solid;border-width:1px;margin-left:0px;padding-left:10px;">
<span><div><div>On 7 Sep 2011, at 10:14, Neil Middleton wrote:<br><br><blockquote type="cite"><div>a crap load of data from an API<br></div></blockquote><br>How much is a crap load?<br>_______________________________________________<br>Chat mailing list<br><a href="mailto:Chat@lists.lrug.org"><a href="mailto:Chat@lists.lrug.org">Chat@lists.lrug.org</a></a><br><a href="http://lists.lrug.org/listinfo.cgi/chat-lrug.org"><a href="http://lists.lrug.org/listinfo.cgi/chat-lrug.org">http://lists.lrug.org/listinfo.cgi/chat-lrug.org</a></a><br></div></div></span>
</blockquote>
<div>
<br>
</div>
</div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>Chat mailing list</span><br><span><a href="mailto:Chat@lists.lrug.org">Chat@lists.lrug.org</a></span><br><span><a href="http://lists.lrug.org/listinfo.cgi/chat-lrug.org">http://lists.lrug.org/listinfo.cgi/chat-lrug.org</a></span><br></div></blockquote></body></html>