User-agent: TurnitinBot Disallow: / User-agent: Scrapy Disallow: / User-agent: SemrushBot Disallow: /