SitemapSupport

Controls how sitemap files are used during a crawl.

crawler/webJavadoc: SitemapSupport

Notes

Specifies the sitemap processing strategy, such as whether to use sitemap files as a source of start URLs, to skip them entirely, or to use them to supplement other discovery methods. The selected value determines how the crawler integrates sitemap data into the crawl queue.

Usage

YAML

SitemapSupport: FIRST

JSON

{
  "SitemapSupport": "FIRST"
}

XML

<sitemapSupport/>

Allowed Values

• FIRST
• LAST
• NEVER