User-agent: bingbot Crawl-delay: 10 User-agent: BLEXBot Crawl-delay: 300 User-agent: istellabot Crawl-delay: 60 User-agent: MSNBot Crawl-delay: 15 User-agent: Semrushbot Crawl-delay: 40 User-agent: YandexBot Crawl-delay: 90 User-agent: PetalBot Crawl-delay: 190 User-agent: * Disallow: /online/web/WFS/*/*/-/ Disallow: /online/web/BOS/*/*/-/ Disallow: */b2c-mobile-shop/* Sitemap: https://www.trony.it/online/sitemap/TRONY-SITEMAP # Ban bots that don't benefit us. # -------------------------------- User-agent: Nuclei User-agent: WikiDo User-agent: Riddler User-agent: Zoominfobot User-agent: Go-http-client User-agent: Node/simplecrawler User-agent: CazoodleBot User-agent: dotbot/1.0 User-agent: Gigabot User-agent: Barkrowler User-agent: BLEXBot User-agent: magpie-crawler Disallow: /