User-Agent: *
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /_next/

Host: https://crawlraven.com
Sitemap: https://crawlraven.com/sitemap.xml