# Robots.txt file from http://www.8taobao8.com # All robots will spider the domain Sitemap: http://www.8taobao8.com/sitemap_index.xml Sitemap: http://www.8taobao8.com/baidumap_article_1.xml Sitemap: http://www.8taobao8.com/baidumap_article_2.xml Sitemap: http://www.8taobao8.com/baidumap_article_3.xml Sitemap: http://www.8taobao8.com/baidumap_article_4.xml Sitemap: http://www.8taobao8.com/baidumap_article_5.xml Sitemap: http://www.8taobao8.com/baidumap_article_6.xml User-agent: * Disallow: /top/ Disallow: /open/ User-agent: Crawler Disallow: