Class GenericSitemapLocator

java.lang.Object
com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocator
All Implemented Interfaces:
Configurable<GenericSitemapLocatorConfig>, SitemapLocator

public class GenericSitemapLocator extends Object implements SitemapLocator, Configurable<GenericSitemapLocatorConfig>

If there is a sitemap defined as a start reference for the same URL web site, this locator is not used. Otherwise, it tells the crawler to use the sitemap as defined in the web site "robots.txt" file (provided the web site defines one and RobotsTxtProvider is enabled). If no sitemap resolution was possible from "robots.txt", an attempt will be made to retrieve a sitemap using the configured sitemap paths. Default paths are: /sitemap.xml and /sitemap_index.xml