# PDFZippy - Production robots.txt # This file controls search engine crawler access User-agent: * Allow: / # Disallow private areas Disallow: /admin/ Disallow: /dashboard/ Disallow: /api/ Disallow: /process/ Disallow: /storage/ # Crawl-delay for better server performance Crawl-delay: 1 # Sitemap location Sitemap: https://pdfzippy.com/sitemap.xml