# RayTeam - crawling policy
#
# Conventional search engines are welcome: the content of this site is public
# and was written to be found by people looking for guidance on privacy,
# digital exposure and information security.
#
# Collectors dedicated to mass scraping and to building training corpora are
# not authorised. The restriction is consistent with RayTeam's institutional
# position on data collection and resale. It depends on the collector's
# cooperation and does not replace technical controls on the server.

User-agent: *
Allow: /
Disallow: /api/

User-agent: CCBot
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: PerplexityBot
Disallow: /

Sitemap: https://rayran.site/sitemap.xml