Package com.norconex.crawler.core
Class CrawlerDriver.Builder
java.lang.Object
com.norconex.crawler.core.CrawlerDriver.Builder
- Enclosing class:
CrawlerDriver
-
Method Summary
Modifier and TypeMethodDescriptionbeanMapper(BeanMapper beanMapper) bootstrappers(List<CrawlerBootstrapper> bootstrappers) build()cacheTypes(Map<String, Class<?>> cacheTypes) Optional map of Hazelcast map-config-name (or wildcard pattern as declared in the YAML, e.g.callbacks(CrawlerCallbacks callbacks) crawlEntryType(Class<? extends CrawlerEntry> crawlEntryType) The exact type ofCrawlerEntryif your crawler is subclassing it.crawlerConfigClass(Class<? extends CrawlerConfig> crawlerConfigClass) crawlPipelineFactory(CrawlerPipelineFactory crawlPipelineFactory) docPipelines(CrawlerDocPipelines docPipelines) eventManager(EventManager eventManager) fetchDriver(CrawlerDriver.FetchDriver fetchDriver) Provides a required fetcher implementation, responsible for obtaining resources being crawled.toString()
-
Method Details
-
crawlPipelineFactory
- Returns:
this.
-
crawlerConfigClass
- Returns:
this.
-
bootstrappers
- Returns:
this.
-
docPipelines
- Returns:
this.
-
callbacks
- Returns:
this.
-
beanMapper
- Returns:
this.
-
eventManager
- Returns:
this.
-
fetchDriver
Provides a required fetcher implementation, responsible for obtaining resources being crawled.- Returns:
this.
-
crawlEntryType
The exact type ofCrawlerEntryif your crawler is subclassing it. Defaults toCrawlerEntryclass.- Returns:
this.
-
cacheTypes
Optional map of Hazelcast map-config-name (or wildcard pattern as declared in the YAML, e.g."ledger_*") to the concrete Java type that should be (de)serialized for values in that map. The framework automatically adds theledger_*mapping usingcrawlEntryType(java.lang.Class<? extends com.norconex.crawler.core.ledger.CrawlerEntry>). Extensions that persist their own types should add their entries here.- Returns:
this.
-
build
-
toString
-