Package com.norconex.crawler.web.doc.operations.robot

Class RobotsTxt.RobotsTxtBuilder

java.lang.Object

com.norconex.crawler.web.doc.operations.robot.RobotsTxt.RobotsTxtBuilder

Enclosing class:

RobotsTxt

public static class RobotsTxt.RobotsTxtBuilder
extends Object

Method Summary

Modifier and Type	Method	Description
RobotsTxt	build()
RobotsTxt.RobotsTxtBuilder	clearFilters()
RobotsTxt.RobotsTxtBuilder	clearSitemapLocations()
RobotsTxt.RobotsTxtBuilder	crawlDelay(float crawlDelay)
RobotsTxt.RobotsTxtBuilder	filter(RobotsTxtFilter filter)
RobotsTxt.RobotsTxtBuilder	filters(Collection<? extends RobotsTxtFilter> filters)
RobotsTxt.RobotsTxtBuilder	sitemapLocation(String sitemapLocation)
RobotsTxt.RobotsTxtBuilder	sitemapLocations(Collection<? extends String> sitemapLocations)
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Details

filter

public RobotsTxt.RobotsTxtBuilder filter(RobotsTxtFilter filter)

filters

public RobotsTxt.RobotsTxtBuilder filters(Collection<? extends RobotsTxtFilter> filters)

clearFilters

public RobotsTxt.RobotsTxtBuilder clearFilters()

sitemapLocation

public RobotsTxt.RobotsTxtBuilder sitemapLocation(String sitemapLocation)

sitemapLocations

public RobotsTxt.RobotsTxtBuilder sitemapLocations(Collection<? extends String> sitemapLocations)

clearSitemapLocations

public RobotsTxt.RobotsTxtBuilder clearSitemapLocations()

crawlDelay

public RobotsTxt.RobotsTxtBuilder crawlDelay(float crawlDelay)

Returns:

this.

build

public RobotsTxt build()

toString

public String toString()

Overrides:

toString in class Object