Tag: "crawling"

Bingbot replacing MSNbot in October

Over the last couple month the Bing web team has been busy refining and rolling our improvements to their web crawling software that indexes website on Bing.com On October 1st 2010, MSNbot will cease to crawl and will be replaced by Bingbot. This will show in your server logs as: bingbot/2.0 The HTTP header From […]