# ============================ # Block Chinese search & related crawlers # ============================ User-agent: Baiduspider User-agent: Baiduspider-image User-agent: Baiduspider-video User-agent: Baiduspider-news User-agent: Baiduspider-favo User-agent: Baiduspider-cpro User-agent: Sogou spider User-agent: Sogou web spider User-agent: Sogou inst spider User-agent: Sogou-Test-Spider User-agent: 360Spider User-agent: HaosouSpider User-agent: Yisouspider User-agent: YisouSpider User-agent: PetalBot User-agent: Bytespider Disallow: / # ============================ # Rules for all other crawlers # ============================ User-agent: * Disallow: /apanel_assets Disallow: /application Disallow: /dropbox_backup Disallow: /sqle Disallow: /system Disallow: /tiles_term_condition Disallow: /tilescalculator Disallow: /tiles-store Disallow: /store Disallow: /en-ar/ Disallow: /en-es/ Disallow: /en-fr/ Disallow: /en-de/ Disallow: /en-it/ Disallow: /en-pt/ Disallow: /en-ja/ Disallow: /en-tr/ Disallow: /en-ru/ Disallow: /en-ca/ Disallow: /en-hi/ Disallow: /en-ko/ Disallow: /en-vi/ Disallow: /en-jv/ Disallow: /en-fa/ Disallow: /en-ind/ Disallow: /en-pl/ Disallow: /en-yo/ Disallow: /en-my/ Disallow: /en-su/ Disallow: /search Disallow: /image-search Disallow: /*? Disallow: /*?*