wget spyder to crawl webpage

wget -e robots=off -r -l 50 --timeout=10 -t 2 --delete-after http://webpage.com/;

ab -c 10 -n 1000 http://webpage.com/;


Learn More :