Uses of Class
com.norconex.crawler.web.doc.operations.robot.RobotsMeta

Packages that use RobotsMeta

Package	Description
com.norconex.crawler.web.doc.operations.robot
com.norconex.crawler.web.doc.operations.robot.impl
com.norconex.crawler.web.doc.pipelines.importer

Uses of RobotsMeta in com.norconex.crawler.web.doc.operations.robot

Methods in com.norconex.crawler.web.doc.operations.robot that return RobotsMeta

Modifier and Type	Method	Description
RobotsMeta	RobotsMetaProvider.getRobotsMeta(Reader document, String documentUrl, ContentType contentType, Properties httpHeaders)	Extracts Robots meta information for a page, if any.

Uses of RobotsMeta in com.norconex.crawler.web.doc.operations.robot.impl

Methods in com.norconex.crawler.web.doc.operations.robot.impl that return RobotsMeta

Modifier and Type	Method	Description
RobotsMeta	StandardRobotsMetaProvider.getRobotsMeta(Reader document, String documentUrl, ContentType contentType, Properties httpHeaders)

Uses of RobotsMeta in com.norconex.crawler.web.doc.pipelines.importer

Methods in com.norconex.crawler.web.doc.pipelines.importer that return RobotsMeta

Modifier and Type	Method	Description
RobotsMeta	WebImporterPipelineContext.getRobotsMeta()

Methods in com.norconex.crawler.web.doc.pipelines.importer with parameters of type RobotsMeta

Modifier and Type	Method	Description
void	WebImporterPipelineContext.setRobotsMeta(RobotsMeta robotsMeta)