Monday, February 11, 2013

Multitask file downloader in Bash in 2 SECONDS

Thanks to +Ohad Lutzky, there is much better solution for this task in simple bash one-liner using xargs. Here is how:
MAXJOBS=50; cat $UrlsFile | xargs -I @ -P $MAXJOBS bash -c 'curl @ > ...'

Clean and simple. 100% Unix :)

P.S. I wrap curl with another bash command because I want separate per-URL output redirection.

1 comment:

  1. MakerWare doesn’t give you an indication of where it’s at in the process. Entire households will discover fun projects for artistic family time, as well as|in addition to} a huge number of well-known franchise characters, tabletop game characters, and complex 3D printable puzzles for collaborative fun. This can be actually handy for visualizing the final print, particularly if it involves quantity of} components. GrabCAD is a common 3D file internet hosting website, catering to not only 3D printing fans, however anybody with an curiosity in engineering or 3D modeling. Browse via tons of of examples of our 3D printing, 3D design, and customized fabricated builds. Things like sculptures Hand Held Back Massager and collectible figurines are best created with an natural modeling device -- ZBrush is our go-to device software program device for natural sculpting.

    ReplyDelete