The Crawler Logs file allows you to monitor and debug your crawler’s activity by recording detailed logs for each crawl run. Logs are useful for troubleshooting crawl issues, verifying site coverage, and monitoring crawler performance over time.
settingsBasic authentication header of the form Basic <encoded-value>, where <encoded-value> is the base64-encoded string username:password.
Crawler ID. Universally unique identifier (UUID) of the crawler.
"e0f6db8a-24f5-4092-83a4-1b2c6cb6d809"
Crawler log ID. Universally unique identifier (UUID) of the crawler log.
"a2ebb507-ef64-4b6b-9d84-ef66baaa7a80"
Get Crawler File Response.