[LRUG] Downloading images quickly

Gerhard Lazu gerhard at lazu.co.uk
Mon Feb 11 03:09:11 PST 2013


Joining this late, but you could easily do it via GNU parallel. On your
command line:

parallel wget :::
http://rubyonrails.org/images/pages/overview/screencasts2.png
http://rubyonrails.org/images/pages/overview/download32.png
http://rubyonrails.org/images/pages/documentation/awdr4.png

Yes, brew install parallel

Gerhard

------------------------------
Twitter <http://twitter.com/#!/gerhardlazu> Github<https://github.com/gerhard>
 Blog <http://gerhardlazu.com/>


On Tue, Feb 5, 2013 at 11:07 AM, Andrew Stewart
<boss at airbladesoftware.com>wrote:

> Hola El Rug,
>
> I want to download a number of images over HTTP as quickly as possible.  I
> thought the simplest way would be to use Typhoeus (please tell me if
> there's a simpler way):
>
>     https://gist.github.com/airblade/4713705
>
> To test that it was working, I added a `sleep 3` inside the
> `request.on_complete` block (lines 17-19).  I then gave it an array of 40
> URLs of assets on Amazon S3 and ran it.
>
> I was expecting this to take ~40s but it actually took 120s.  What am I
> doing wrong?
>
> I'm on OS X 10.6.8, Ruby 1.9.3p286, typhoeus 0.5.4, ethon 0.5.7, ffi 1.2.1.
>
> Thanks!
>
> Cheers,
> Andy Stewart
> -------
> http://airbladesoftware.com
>
>
>
> _______________________________________________
> Chat mailing list
> Chat at lists.lrug.org
> http://lists.lrug.org/listinfo.cgi/chat-lrug.org
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lrug.org/pipermail/chat-lrug.org/attachments/20130211/833c2b28/attachment.html>


More information about the Chat mailing list