wget spyder to crawl webpage wget -e robots=off -r -l 50 --timeout=10 -t 2 --delete-after http://webpage.com/; ab -c 10 -n 1000 http://webpage.com/; Learn More : Share this Share on FacebookTweet on TwitterPlus on Google+ Learn More Multiple Choice Question :wget spyder to crawl webpageBookStore CSSHow to Edit HOSTS File on MacInstallment Loans Bad Credit- monthlyloansonline.co.uk12 Month Loans Uk- monthlyloansonline.co.ukHow to Edit HOSTS File on Windows