Package com.norconex.crawler.core.fetch

Class BaseFetcherConfig

java.lang.Object
com.norconex.crawler.core.fetch.BaseFetcherConfig
Direct Known Subclasses:
BaseAuthNioFetcherConfig, BoxFetcherConfig, EgnyteFetcherConfig, GcsFetcherConfig, GoogleDriveFetcherConfig, HttpClientFetcherConfig, LocalFetcherConfig, M365GraphFetcherConfig, PlaywrightFetcherConfig, WebDriverFetcherConfig
public class BaseFetcherConfig extends Object

Base class implementing the AbstractFetcher.accept(FetchRequest) method using reference filters to determine if this fetcher will accept to fetch a document, in addition to whatever logic implementing classes may provide by optionally overriding AbstractFetcher.acceptRequest(FetchRequest) (which otherwise always return true). It also offers methods to overwrite in order to react to crawler startup and shutdown events.

  • Constructor Details

    • BaseFetcherConfig

      public BaseFetcherConfig()

  • Method Details

    • getReferenceFilters

      public List<ReferenceFilter> getReferenceFilters()
      Gets reference filters
      Returns:
      reference filters

    • setReferenceFilters

      public BaseFetcherConfig setReferenceFilters(List<ReferenceFilter> referenceFilters)
      Sets reference filters.
      Parameters:
      referenceFilters - the referenceFilters to set
      Returns:
      this instance

    • equals

      public boolean equals(Object o)
      Overrides:
      equals in class Object

    • canEqual

      protected boolean canEqual(Object other)

    • hashCode

      public int hashCode()
      Overrides:
      hashCode in class Object

    • toString

      public String toString()
      Overrides:
      toString in class Object