Uses of Class
com.norconex.crawler.web.doc.operations.robot.RobotsTxt.RobotsTxtBuilder

Packages that use RobotsTxt.RobotsTxtBuilder

Package	Description
com.norconex.crawler.web.doc.operations.robot

Uses of RobotsTxt.RobotsTxtBuilder in com.norconex.crawler.web.doc.operations.robot

Methods in com.norconex.crawler.web.doc.operations.robot that return RobotsTxt.RobotsTxtBuilder

Modifier and Type	Method	Description
static RobotsTxt.RobotsTxtBuilder	RobotsTxt.builder()
RobotsTxt.RobotsTxtBuilder	RobotsTxt.RobotsTxtBuilder.clearFilters()
RobotsTxt.RobotsTxtBuilder	RobotsTxt.RobotsTxtBuilder.clearSitemapLocations()
RobotsTxt.RobotsTxtBuilder	RobotsTxt.RobotsTxtBuilder.crawlDelay(float crawlDelay)
RobotsTxt.RobotsTxtBuilder	RobotsTxt.RobotsTxtBuilder.filter(RobotsTxtFilter filter)
RobotsTxt.RobotsTxtBuilder	RobotsTxt.RobotsTxtBuilder.filters(Collection<? extends RobotsTxtFilter> filters)
RobotsTxt.RobotsTxtBuilder	RobotsTxt.RobotsTxtBuilder.sitemapLocation(String sitemapLocation)
RobotsTxt.RobotsTxtBuilder	RobotsTxt.RobotsTxtBuilder.sitemapLocations(Collection<? extends String> sitemapLocations)