# Search Engine Crawling Instructions # This file tells search engines which pages they can and cannot crawl # Universal Access User-agent: * Allow: / # Major Search Engines User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / User-agent: Baiduspider Allow: / User-agent: YandexBot Allow: / # Sitemap Location Sitemap: https://www.alexandertibbets.com/sitemap.xml # Archive Blocking User-agent: archive.org_bot Disallow: / User-agent: ia_archiver Disallow: /