User-agent: * Disallow: /feed/rss Disallow: /archives/date Disallow: /outbound #these 2 are non-existent directories and archive.org_bot requests keep requesting them Disallow: /file # BEGIN XML-SITEMAP-PLUGIN Sitemap: http://reading.kingrat.biz/sitemap.xml.gz # END XML-SITEMAP-PLUGIN # The following are commercial services, and do not currently have a license to use my content in the manner described on their web sites. (Rat's Reading is currently licensed only under a Creative Commons non-commercial license.) User-agent: Spinn3r Disallow: / User-agent: Tailrank Disallow: / User-agent: Biz360 Disallow: / User-agent: TurnitinBot Disallow: / User-agent: R6_FeedFetcher Disallow: / User-agent: R6_CommentReader Disallow: / User-agent: PostRank Disallow: / User-agent: dotbot Disallow: / User-agent: 80legs Disallow: / User-agent: Exabot Disallow: /