Package com.norconex.crawler.core.fetch
package com.norconex.crawler.core.fetch
-
ClassDescriptionAbstractFetcher<C extends BaseFetcherConfig>Base class implementing the
AbstractFetcher.accept(FetchRequest)method using reference filters to determine if this fetcher will accept to fetch a document, in addition to whatever logic implementing classes may provide by optionally overridingAbstractFetcher.acceptRequest(FetchRequest)(which otherwise always returntrue).Holds all responses obtained from fetching a document using one or multiple fetchers.Base class implementing theAbstractFetcher.accept(FetchRequest)method using reference filters to determine if this fetcher will accept to fetch a document, in addition to whatever logic implementing classes may provide by optionally overridingAbstractFetcher.acceptRequest(FetchRequest)(which otherwise always returntrue).Whether to perform metadata extraction on its own before (or instead) performing document extraction as a whole (including metadata).Indicates whether a given fetch directive should be required to execute, optional, or disabled.Fetch resources.Checked exception thrown upon encountering an error fetching a document.Fetch request.Utility methods for fetching.Implementation ofFetcherthat groups multiple other fetcher to treat them as a single fetcher.