User-agent: * Disallow: /admin Disallow: *calendar* Disallow: *lesson_plan* Disallow: /userFiles Crawl-delay: 5 Request-rate: 1/5 Visit-time: 0400-0900 User-agent: Baiduspider Disallow: / User-agent: Yandex Disallow: / User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: MJ12bot/v1.4.5 Disallow: / User-agent: MJ12bot/v1.4.0 Disallow: / User-agent: MJ12bot/v1.2.4 Disallow: / User-agent: MJ12bot/v1.2.3 Disallow: / User-agent: MJ12bot/v1.0.8 Disallow: / User-agent: MJ12bot/v1.0.7 Disallow: / User-agent: MJ12bot/v1.0.6 Disallow: / User-agent: MJ12bot/v1.0.5 Disallow: /