php - Looking for a spider to crawl my website thousands of times to test ad distribution -
pretty straight forward. we're implementing new ad serving platform , it's paramount distribution of our ads correct.
i've come few solutions 1 i'd explore first spider hit website thousands , thousands of times ensure distribution correct.
any suggestions awesome.
are going check 1 page or multiple?
wget under linux should able save file quickly, many times you'd like. there i'd grep part of string want search (http://adserver1.wherever.com) , show count. of can automated shell scripting make automatic.
good luck!
Comments
Post a Comment