User-agent: * Disallow: /organise/ Disallow: /live/ ############################################################ # AI DATA SCRAPERS – block training access to /events/ & /slides/ ############################################################ # OpenAI User-agent: GPTBot Disallow: /events/ Disallow: /slides/ Disallow: /organise/ Disallow: /live/ Allow: / # Google User-agent: Google-Extended Disallow: /events/ Disallow: /slides/ Disallow: /organise/ Disallow: /live/ Allow: / # Anthropic User-agent: ClaudeBot Disallow: /events/ Disallow: /slides/ Disallow: /organise/ Disallow: /live/ Allow: / # Apple User-agent: Applebot-Extended Disallow: /events/ Disallow: /slides/ Disallow: /organise/ Disallow: /live/ Allow: / # ByteDance User-agent: Bytespider Disallow: /events/ Disallow: /slides/ Disallow: /organise/ Disallow: /live/ Allow: / # Common Crawl User-agent: CCBot Disallow: /events/ Disallow: /slides/ Disallow: /organise/ Disallow: /live/ Allow: / # Cohere User-agent: cohere-training-data-crawler Disallow: /events/ Disallow: /slides/ Disallow: /organise/ Disallow: /live/ Allow: / # Huawei User-agent: PanguBot User-agent: PetalBot Disallow: /events/ Disallow: /slides/ Disallow: /organise/ Disallow: /live/ Allow: / # Meta User-agent: FacebookBot User-agent: Meta-ExternalAgent Disallow: /events/ Disallow: /slides/ Disallow: /organise/ Disallow: /live/ Allow: / # Webz.io User-agent: omgili User-agent: Omgilibot User-agent: Webzio-Extended Disallow: /events/ Disallow: /slides/ Disallow: /organise/ Disallow: /live/ Allow: / # Other scrapers User-agent: AI2Bot User-agent: Cotoyogi User-agent: Datenbank Crawler User-agent: Diffbot User-agent: Factset_spyderbot User-agent: ICC-Crawler User-agent: Kangaroo Bot User-agent: netEstate Imprint Crawler User-agent: SemrushBot-OCOB User-agent: Timpibot Disallow: /events/ Disallow: /slides/ Disallow: /organise/ Disallow: /live/ Allow: /