# Every bot that might possibly read and respect this file. User-agent: * Disallow: /en/en/ Disallow: /en/ru/ Disallow: /en/ua/ Disallow: /en/cn/ Disallow: /en/tw/ Disallow: /en/ja/ Disallow: /ru/en/ Disallow: /ru/ru/ Disallow: /ru/ua/ Disallow: /ru/cn/ Disallow: /ru/tw/ Disallow: /ru/ja/ Disallow: /ua/en/ Disallow: /ua/ru/ Disallow: /ua/ua/ Disallow: /ua/cn/ Disallow: /ua/tw/ Disallow: /ua/ja/ Disallow: /cn/en/ Disallow: /cn/ru/ Disallow: /cn/ua/ Disallow: /cn/cn/ Disallow: /cn/tw/ Disallow: /cn/ja/ Disallow: /tw/en/ Disallow: /tw/ru/ Disallow: /tw/ua/ Disallow: /tw/cn/ Disallow: /tw/tw/ Disallow: /tw/ja/ Disallow: /ja/en/ Disallow: /ja/ru/ Disallow: /ja/ua/ Disallow: /ja/cn/ Disallow: /ja/tw/ Disallow: /ja/ja/ # Wait 1 second between successive requests. Crawl-delay: 5