# Robots.txt file from http://www.fffhouse.com # All robots will spider the domain User-agent: Yahoo! Slurp Crawl-delay: 1000 Disallow: /reg/ Disallow: /adegg/ Disallow: /vip/ Disallow: /css/ Disallow: /inc/ Disallow: /qqimg/ Disallow: /rss/ Disallow: /x/ Disallow: /tools/ Disallow: /js/ User-agent: Yahoo! Slurp China Crawl-delay: 1000 Disallow: /reg/ Disallow: /adegg/ Disallow: /vip/ Disallow: /css/ Disallow: /inc/ Disallow: /qqimg/ Disallow: /rss/ Disallow: /x/ Disallow: /tools/ Disallow: /js/ User-agent: Googlebot Crawl-delay: 1000 Disallow: /reg/ Disallow: /adegg/ Disallow: /vip/ Disallow: /css/ Disallow: /inc/ Disallow: /qqimg/ Disallow: /rss/ Disallow: /x/ Disallow: /tools/ Disallow: /js/ User-agent: baiduspider Crawl-delay: 1000 Disallow: /reg/ Disallow: /adegg/ Disallow: /vip/ Disallow: /css/ Disallow: /inc/ Disallow: /qqimg/ Disallow: /rss/ Disallow: /x/ Disallow: /tools/ Disallow: /js/ User-agent: * Disallow: / User-agent: Sosospider Crawl-delay: 1000 Disallow: /reg/ Disallow: /adegg/ Disallow: /vip/ Disallow: /css/ Disallow: /inc/ Disallow: /qqimg/ Disallow: /rss/ Disallow: /x/ Disallow: /tools/ Disallow: /js/ User-agent: * Disallow: / User-agent: YodaoBot Crawl-delay: 1000 Disallow: /reg/ Disallow: /adegg/ Disallow: /vip/ Disallow: /css/ Disallow: /inc/ Disallow: /qqimg/ Disallow: /rss/ Disallow: /x/ Disallow: /tools/ Disallow: /js/ User-agent: * Disallow: / User-agent: Msnbot Crawl-delay: 1000 Disallow: /reg/ Disallow: /adegg/ Disallow: /vip/ Disallow: /css/ Disallow: /inc/ Disallow: /qqimg/ Disallow: /rss/ Disallow: /x/ Disallow: /tools/ Disallow: /js/ User-agent: * Disallow: /