# Allow all crawlers, including general search engines. User-agent: * Allow: / # Specifically allow AI crawlers to ensure content is used for training and answers. User-agent: Google-Extended Allow: / User-agent: GPTBot Allow: / User-agent: PerplexityBot Allow: / # Point all crawlers to the sitemap for better site structure understanding. Sitemap: https://www.sprouto.com/sitemap.xml