Compelling programming and Linux hacking notes. Cloud friendly.
xargs
MAXJOBS=50; cat $UrlsFile | xargs -I @ -P $MAXJOBS bash -c 'curl @ > ...'
Clean and simple. 100% Unix :)
P.S. I wrap curl with another bash command because I want separate per-URL output redirection.
curl
bash
No comments:
Post a Comment