safetyChecks

Checks to ensure the crawl was successful.

• Type: object

For more information, see Safety checks.

Examples

JavaScript

{
  safetyChecks: {
    beforeIndexPublishing: {
      maxLostRecordsPercentage: 10,
      maxFailedUrls: 15

    }
  }
}

Parameters

beforeIndexPublishing · object

Checks triggered after the Crawler finishes, before pushing the records to Algolia into the final index.

Show child attributes

beforeIndexPublishing.maxLostRecordsPercentage · number · default: 10

Defines the limit of records difference between the new and the last crawl as a percentage of total records (inclusive). If the new number of records is less than last number of records * (1 - maxLostRecordsPercentage / 100), the process throws a SafeReindexingError, blocking the crawler until manual restart.

beforeIndexPublishing.maxFailedUrls · number

Maximum allowed number of URLs failed to crawl. By default, the crawler doesn’t stop if it encounters such errors.