# Allow all search engine crawlers, block admin pages User-agent: * Allow: / Disallow: /manage Disallow: /explore-deals Disallow: /blacklisted-websites Disallow: /restaurant-chain-websites # Google User-agent: Googlebot Allow: / # Bing User-agent: Bingbot Allow: / # DuckDuckGo (uses Bing's index, but also has its own crawler) User-agent: DuckDuckBot Allow: / # Yahoo (uses Bing's index) User-agent: Slurp Allow: / # Baidu User-agent: Baiduspider Allow: / # Yandex User-agent: YandexBot Allow: / Sitemap: https://www.findmecheapfood.com/sitemap.xml