# https://www.robotstxt.org/robotstxt.html # Aassay - Survey Creator and Analyser # Allow all legitimate search engine crawlers User-agent: Googlebot Allow: / Disallow: /admin/ Disallow: /dashboard Disallow: /my-forms Disallow: /my-quizzes Disallow: /my-polls Disallow: /free-forms Disallow: /templates Disallow: /profile Disallow: /payment Disallow: /form/new Disallow: /quiz/new Disallow: /poll/new Disallow: /preview-form Disallow: /quiz-preview Disallow: /reset-password/ Disallow: /payment/test-mode Disallow: /payment/callback Disallow: /pdf/ Crawl-delay: 1 User-agent: Bingbot Allow: / Disallow: /admin/ Disallow: /dashboard Disallow: /my-forms Disallow: /my-quizzes Disallow: /my-polls Disallow: /free-forms Disallow: /templates Disallow: /profile Disallow: /payment Disallow: /form/new Disallow: /quiz/new Disallow: /poll/new Disallow: /preview-form Disallow: /quiz-preview Disallow: /reset-password/ Disallow: /payment/test-mode Disallow: /payment/callback Disallow: /pdf/ Crawl-delay: 2 User-agent: * Allow: / Disallow: /admin/ Disallow: /dashboard Disallow: /my-forms Disallow: /my-quizzes Disallow: /my-polls Disallow: /free-forms Disallow: /templates Disallow: /profile Disallow: /payment Disallow: /form/new Disallow: /quiz/new Disallow: /poll/new Disallow: /preview-form Disallow: /quiz-preview Disallow: /reset-password/ Disallow: /payment/test-mode Disallow: /payment/callback Disallow: /pdf/ Crawl-delay: 5 # Block known bad bots User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DotBot Disallow: / # Sitemap location Sitemap: https://www.aassay.com/sitemap.xml # Host directive (helps Yandex) Host: https://www.aassay.com