Class GenericSitemapLocatorConfig
java.lang.Object
com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig
Configuration for
GenericSitemapLocator.-
Nested Class Summary
Nested Classes -
Field Summary
Fields -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionprotected booleanbooleangetPaths()Gets the URL paths, relative to the URL root, from which to try locate and resolve sitemaps.inthashCode()booleanWhether to disable checking for the sitemap locations in a web site robots.txt file.voidSets the URL paths, relative to the URL root, from which to try locate and resolve sitemaps.setRobotsTxtSitemapDisabled(boolean robotsTxtSitemapDisabled) Whether to disable checking for the sitemap locations in a web site robots.txt file.toString()
-
Field Details
-
DEFAULT_PATHS
-
-
Constructor Details
-
GenericSitemapLocatorConfig
public GenericSitemapLocatorConfig()
-
-
Method Details
-
getPaths
Gets the URL paths, relative to the URL root, from which to try locate and resolve sitemaps. Default paths are "/sitemap.xml" and "/sitemap-index.xml".- Returns:
- sitemap paths.
-
setPaths
Sets the URL paths, relative to the URL root, from which to try locate and resolve sitemaps.- Parameters:
paths- sitemap paths.
-
isRobotsTxtSitemapDisabled
public boolean isRobotsTxtSitemapDisabled()Whether to disable checking for the sitemap locations in a web site robots.txt file. -
setRobotsTxtSitemapDisabled
Whether to disable checking for the sitemap locations in a web site robots.txt file.- Returns:
this.
-
equals
-
canEqual
-
hashCode
public int hashCode() -
toString
-