# Robots.txt # For domain: http://www.1996mysticcobra.com # All robots will spider the domain User-agent: MJ12bot Crawl-Delay: 5 Disallow: otvetoff.ru baidu.com