Crawls the sitemap of the given domain and returns all discovered page URLs. Supports sitemap index files (recursive), parallel fetching with concurrency control, deduplication, and filters out non-page resources (images, PDFs, etc.).
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Domain name to crawl sitemaps for (e.g., 'example.com'). The domain will be automatically normalized and validated.
Successful response