Package com.norconex.crawler.web.doc.operations.link.impl

Class TikaLinkExtractor

java.lang.Object

com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractor

All Implemented Interfaces:

Configurable<TikaLinkExtractorConfig>, LinkExtractor

public class TikaLinkExtractor
extends Object
implements LinkExtractor, Configurable<TikaLinkExtractorConfig>

Implementation of LinkExtractor using Apache Tika to perform URL extractions from HTML documents. This is an alternative to the HtmlLinkExtractor or even DomLinkExtractor.

The configuration of content-types, storing the referrer data, and ignoring "nofollow" and ignoring link data are the same as in HtmlLinkExtractor. For link data, this parser only keeps a pre-defined set of link attributes, when available (title, type, uri, text, rel).

See Also:

• HtmlLinkExtractor

Field Summary

Fields inherited from interface com.norconex.commons.lang.config.Configurable

PROPERTY

Constructor Summary

Constructors

Constructor	Description
TikaLinkExtractor()

Method Summary

Modifier and Type	Method	Description
protected boolean	canEqual(Object other)
boolean	equals(Object o)
Set<Link>	extractLinks(Doc doc)
TikaLinkExtractorConfig	getConfiguration()
int	hashCode()
String	toString()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Details

TikaLinkExtractor

public TikaLinkExtractor()

Method Details

extractLinks

public Set<Link> extractLinks(Doc doc)
                       throws IOException

Specified by:

extractLinks in interface LinkExtractor

Throws:

IOException

equals

public boolean equals(Object o)

Overrides:

equals in class Object

canEqual

protected boolean canEqual(Object other)

hashCode

public int hashCode()

Overrides:

hashCode in class Object

toString

public String toString()

Overrides:

toString in class Object

getConfiguration

public TikaLinkExtractorConfig getConfiguration()

Specified by:

getConfiguration in interface Configurable<TikaLinkExtractorConfig>