wget spyder to crawl webpage wget -e robots=off -r -l 50 --timeout=10 -t 2 --delete-after http://webpage.com/; ab -c 10 -n 1000 http://webpage.com/; Learn More : Share this Share on FacebookTweet on TwitterPlus on Google+