User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /share-widget Allow: / # AI search crawlers — allowed so this content can be cited in AI answers User-agent: ChatGPT-User Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: OAI-SearchBot Allow: / # AI training crawlers — blocked to keep this content out of training datasets User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: Meta-ExternalFetcher Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / # Blog posts Sitemap: https://simplycopycatrecipes.com/sitemap.xml # Static pages Sitemap: https://simplycopycatrecipes.com/sitemap-pages.xml