Package com.norconex.crawler.fs

Class FsCrawlerConfig

java.lang.Object

com.norconex.crawler.core.CrawlerConfig

com.norconex.crawler.fs.FsCrawlerConfig

public class FsCrawlerConfig
extends CrawlerConfig

File System Crawler configuration. Behaves exactly like CrawlerConfig, with one addition: a LocalFetcher is registered by default, so a configuration that declares no fetchers still crawls the local file system.

Declaring one or more fetchers replaces this default. Declaring an explicitly empty fetchers list leaves the crawler with no fetcher, same as for any other crawler.

See Also:

• LocalFetcher

Nested Class Summary

Nested classes/interfaces inherited from class com.norconex.crawler.core.CrawlerConfig

CrawlerConfig.ChangeDiscovery, CrawlerConfig.Fields, CrawlerConfig.OrphansStrategy

Field Summary

Fields inherited from class com.norconex.crawler.core.CrawlerConfig

DEFAULT_IDLE_TIMEOUT, DEFAULT_MIN_PROGRESS_LOGGING_INTERVAL, DEFAULT_WORKDIR

Constructor Summary

Constructors

Constructor	Description
FsCrawlerConfig()

Method Summary

Methods inherited from class com.norconex.crawler.core.CrawlerConfig

addCommitter, addEventListener, addEventListeners, canEqual, clearEventListeners, equals, getChangeDiscovery, getClusterConfig, getCommitters, getDeferredShutdownDuration, getDocumentChecksummer, getDocumentFetchSupport, getDocumentFilters, getEventListeners, getFetchers, getFetchersMaxRetries, getFetchersRetryDelay, getId, getIdleTimeout, getImporterConfig, getMaxCrawlDuration, getMaxDepth, getMaxDocuments, getMaxQueueBatchSize, getMaxStreamCachePoolSize, getMaxStreamCacheSize, getMetadataChecksummer, getMetadataFetchSupport, getMetadataFilters, getMinProgressLoggingInterval, getNumThreads, getOrphansStrategy, getPostImportConsumers, getPreImportConsumers, getReferenceFilters, getSpoiledReferenceStrategizer, getStartReferences, getStartReferencesFiles, getStartReferencesProviders, getStopOnExceptions, getWorkDir, hashCode, isDocumentDeduplicate, isMetadataDeduplicate, isStartReferencesAsync, removeEventListener, setChangeDiscovery, setClusterConfig, setCommitters, setDeferredShutdownDuration, setDocumentChecksummer, setDocumentDeduplicate, setDocumentFetchSupport, setDocumentFilters, setEventListeners, setFetchers, setFetchersMaxRetries, setFetchersRetryDelay, setId, setIdleTimeout, setImporterConfig, setMaxCrawlDuration, setMaxDepth, setMaxDocuments, setMaxQueueBatchSize, setMaxStreamCachePoolSize, setMaxStreamCacheSize, setMetadataChecksummer, setMetadataDeduplicate, setMetadataFetchSupport, setMetadataFilters, setMinProgressLoggingInterval, setNumThreads, setOrphansStrategy, setPostImportConsumers, setPreImportConsumers, setReferenceFilters, setSpoiledReferenceStrategizer, setStartReferences, setStartReferencesAsync, setStartReferencesFiles, setStartReferencesProviders, setStopOnExceptions, setWorkDir, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Details

FsCrawlerConfig

public FsCrawlerConfig()