maxDepth

Maximum path depth of crawled URLs.

• Type: number
• Maximum: 100

Path depth is a measure for the number of path segments. For example:

http://example.com          => 1
http://example.com/         => 1
http://example.com/foo      => 1
http://example.com/foo/     => 2
http://example.com/foo/bar  => 2
http://example.com/foo/bar/ => 3

The Crawler doesn’t crawl URLs with a depth higher than maxDepth.

This limit doesn’t apply to manually added URLs (startUrls or sitemaps).

Examples

JavaScript

{
  maxDepth: 10,
}