Retrieve crawler stats

Retrieves information about the number of crawled, skipped, and failed URLs.

GET /1/crawlers/{id}/stats/urls

Retrieve crawler stats

cURL

curl --request GET \
  --url https://crawler.algolia.com/api/1/crawlers/{id}/stats/urls \
  --header 'Authorization: Basic <encoded-value>'

200

{
  "count": 1,
  "data": []
}

Required ACL: settings

Authorizations

Authorization · string · header · required

Basic authentication header of the form Basic <encoded-value>, where <encoded-value> is the base64-encoded string username:password.

Path Parameters

id · string · required

Crawler ID. Universally unique identifier (UUID) of the crawler.

Example:

"e0f6db8a-24f5-4092-83a4-1b2c6cb6d809"

Response

200

application/json

OK

count · integer · required

Total number of crawled URLs.

Required range: x >= 0

data · object[] · required

Show child attributes

data. status · enum<string>

Crawled URL status.

For more information, see Troubleshooting by crawl status.

Available options: DONE, SKIPPED, FAILED

data. reason · string

Reason for this status.

data. category · enum<string>

Step where the status information was generated.

For more information, see Troubleshooting by crawl status.

Available options: fetch, extraction, indexing, success

data. count · integer

Number of URLs with this status.

data. readable · string

Reason for this status.