Comments on: Baidu Robots.txt http://www.gordonchoi.com/baidu-robots-txt-20100420?utm_source=rss&utm_medium=rss&utm_campaign=baidu-robots-txt Web Analytics Insights, SEO/PPC Tools/Tips, Google Plus Fri, 03 Feb 2012 03:28:20 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Mark http://www.gordonchoi.com/baidu-robots-txt-20100420/comment-page-1#comment-144875 Mark Mon, 19 Dec 2011 13:16:49 +0000 http://www.gordonchoi.com/?p=4362#comment-144875 Thanks for this Gordon. Baidu has been clogging up my CPU for days on several large wordpress sites. Hopefully this robots.txt code will sort it all out Thanks for this Gordon.

Baidu has been clogging up my CPU for days on several large wordpress sites.

Hopefully this robots.txt code will sort it all out

]]> By: SEM Dojo ?????? » SEO??? http://www.gordonchoi.com/baidu-robots-txt-20100420/comment-page-1#comment-143733 SEM Dojo ?????? » SEO??? Fri, 22 Apr 2011 14:24:48 +0000 http://www.gordonchoi.com/?p=4362#comment-143733 [...] ?????Robots.txt???????????????????????????????????????????XML-Sitemap.com,???????30????????????????sitemap. ??????????????????Google Webmaster Tool???sitemap, ???????????????Google????Robots.txt????????????????How to Write a Robots.Txt File?Gordon Choi ?????Baidu Robots.txt????????robots.txt????????? [...] [...] ?????Robots.txt???????????????????????????????????????????XML-Sitemap.com,???????30????????????????sitemap. ??????????????????Google Webmaster Tool???sitemap, ???????????????Google????Robots.txt????????????????How to Write a Robots.Txt File?Gordon Choi ?????Baidu Robots.txt????????robots.txt????????? [...]

]]> By: Andkon http://www.gordonchoi.com/baidu-robots-txt-20100420/comment-page-1#comment-143692 Andkon Wed, 30 Mar 2011 13:17:24 +0000 http://www.gordonchoi.com/?p=4362#comment-143692 This is great article, Now I realize why baidu can crawl all my pages and post. For a gaming site I think allowing all my pages and post to be crawl by spider would be fine. Lots of thanks for the info! This is great article, Now I realize why baidu can crawl all my pages and post. For a gaming site I think allowing all my pages and post to be crawl by spider would be fine. Lots of thanks for the info!

]]>