Package com.norconex.crawler.web.doc.operations.link.impl

Class TikaLinkExtractorConfig

java.lang.Object
com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig
public class TikaLinkExtractorConfig extends Object

Configuration for TikaLinkExtractor.

  • Constructor Details

    • TikaLinkExtractorConfig

      public TikaLinkExtractorConfig()

  • Method Details

    • setFieldMatcher

      public TikaLinkExtractorConfig setFieldMatcher(TextMatcher fieldMatcher)

    • setContentTypeMatcher

      public TikaLinkExtractorConfig setContentTypeMatcher(TextMatcher matcher)
      The matcher of content types to apply link extraction on. No attempt to extract links from any other content types will be made. Default is CommonMatchers.HTML_CONTENT_TYPES.
      Parameters:
      matcher - content type matcher
      Returns:
      this

    • clearRestrictions

      public void clearRestrictions()
      Clears all restrictions.

    • getRestrictions

      public PropertyMatchers getRestrictions()
      Gets all restrictions
      Returns:
      the restrictions

    • isIgnoreNofollow

      public boolean isIgnoreNofollow()

    • isIgnoreLinkData

      public boolean isIgnoreLinkData()
      Whether to ignore extra data associated with a link.
      Since:
      3.0.0

    • getContentTypeMatcher

      public TextMatcher getContentTypeMatcher()
      The matcher of content types to apply link extraction on. No attempt to extract links from any other content types will be made. Default is CommonMatchers.HTML_CONTENT_TYPES.

    • getFieldMatcher

      public TextMatcher getFieldMatcher()
      Matcher of one or more fields to use as the source of content to extract links from, instead of the document content.

    • setIgnoreNofollow

      public TikaLinkExtractorConfig setIgnoreNofollow(boolean ignoreNofollow)
      Returns:
      this.

    • setIgnoreLinkData

      public TikaLinkExtractorConfig setIgnoreLinkData(boolean ignoreLinkData)
      Whether to ignore extra data associated with a link.
      Returns:
      this.
      Since:
      3.0.0

    • equals

      public boolean equals(Object o)
      Overrides:
      equals in class Object

    • canEqual

      protected boolean canEqual(Object other)

    • hashCode

      public int hashCode()
      Overrides:
      hashCode in class Object

    • toString

      public String toString()
      Overrides:
      toString in class Object