# OpenAI crawlers (OAI-SearchBot = search/citations, ChatGPT-User = on-demand # fetches, GPTBot = training) are explicitly allowed with the same exclusions # as everyone else. Named groups do not inherit the "*" rules, so the list is # repeated. User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot User-Agent: * # Prevent crawling of Cloudflare's CDN URLs, Disallow: /cdn-cgi/ # Default Disallow: /admin/ Disallow: /*/admin/ Disallow: /account/ Disallow: /*/account/ Disallow: /*/*suggestions Disallow: /storefront/ Disallow: /*/storefront/ Disallow: /cart/ Disallow: /*/cart/ Disallow: /checkout/ Disallow: /*/checkout/ Disallow: /password/ Disallow: /*/password/ Disallow: /logout/ Disallow: /*/logout/ Disallow: /install/ Disallow: /license/ Disallow: /offline/ Allow: / Sitemap: https://www.ruma-home.com/sitemap.xml # LLM guidance: https://www.ruma-home.com/llms.txt